2024-09-17T04:00:37.891 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-17T04:00:37.916 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T04:00:38.024 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908507 branch: wip-pdonnell-testing-20240916.200549-debug description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/squid 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: pdonnell@redhat.com first_in_suite: false job_id: '7908507' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/squid ' name: pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240916.200549-debug ceph: cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: global: mon pg warn min per osd: 0 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240916.200549-debug sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 476 sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf sleep_before_teardown: 0 subset: 320/512 suite: fs suite_branch: wip-pdonnell-testing-20240916.200549-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf targets: smithi088.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPM9pPgg82PXib0/Nl+tHW9/KAhcQSu75z6eZVTSeAD6lQ26WY0QoDNdmK8Bp1z6KGNaNFyW4gTaamDxH9znl1o= smithi134.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLofAekZHDM4bmQgDbt5g0G2xHMZEMMMGBRYUd+02snJ/758Z4XFDCoJ7D/DekyYDeL4ehSNGQ3h5bEhyDNgpcY= tasks: - install: branch: squid exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: compiled_cephadm_branch: squid conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:squid roleless: true - print: '**** done end installing squid cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 1 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay true - cephadm.shell: host.a: - ceph fs set cephfs inline_data true --yes-i-really-really-mean-it - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - ceph-fuse: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: - /cephfs/home/pdonnell/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20240916.200549-debug/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/3-upgrade-mgr-staggered.yaml meta: {} postmerge: [] variables: fail_fs: false teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-17_02:09:51 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs false || true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-09-17T04:00:38.025 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa; will attempt to use it 2024-09-17T04:00:38.025 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks 2024-09-17T04:00:38.025 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-17T04:00:38.027 INFO:teuthology.task.internal:Checking packages... 2024-09-17T04:00:38.049 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf' 2024-09-17T04:00:38.049 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T04:00:38.049 INFO:teuthology.packaging:ref: None 2024-09-17T04:00:38.049 INFO:teuthology.packaging:tag: None 2024-09-17T04:00:38.049 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240916.200549-debug 2024-09-17T04:00:38.049 INFO:teuthology.packaging:sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T04:00:38.049 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240916.200549-debug 2024-09-17T04:00:38.189 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4989.gce1b342b 2024-09-17T04:00:38.191 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-17T04:00:38.199 INFO:teuthology.task.internal:no buildpackages task found 2024-09-17T04:00:38.199 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-17T04:00:38.212 INFO:teuthology.task.internal:Saving configuration 2024-09-17T04:00:38.235 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-17T04:00:38.246 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-17T04:00:38.272 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908507', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 03:55:15.673440', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPM9pPgg82PXib0/Nl+tHW9/KAhcQSu75z6eZVTSeAD6lQ26WY0QoDNdmK8Bp1z6KGNaNFyW4gTaamDxH9znl1o='} 2024-09-17T04:00:38.293 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908507', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 03:55:15.671881', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLofAekZHDM4bmQgDbt5g0G2xHMZEMMMGBRYUd+02snJ/758Z4XFDCoJ7D/DekyYDeL4ehSNGQ3h5bEhyDNgpcY='} 2024-09-17T04:00:38.293 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-17T04:00:38.304 INFO:teuthology.task.internal:roles: ubuntu@smithi088.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-09-17T04:00:38.304 INFO:teuthology.task.internal:roles: ubuntu@smithi134.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-09-17T04:00:38.305 INFO:teuthology.run_tasks:Running task console_log... 2024-09-17T04:00:38.376 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f38895cbbe0>, signals=[15]) 2024-09-17T04:00:38.377 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-17T04:00:38.491 INFO:teuthology.task.internal:Opening connections... 2024-09-17T04:00:38.491 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi088.front.sepia.ceph.com 2024-09-17T04:00:38.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T04:00:38.588 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi134.front.sepia.ceph.com 2024-09-17T04:00:38.589 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T04:00:38.665 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-17T04:00:38.673 DEBUG:teuthology.orchestra.run.smithi088:> uname -m 2024-09-17T04:00:38.691 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64 2024-09-17T04:00:38.691 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2024-09-17T04:00:38.749 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="CentOS Stream" 2024-09-17T04:00:38.749 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="9" 2024-09-17T04:00:38.749 INFO:teuthology.orchestra.run.smithi088.stdout:ID="centos" 2024-09-17T04:00:38.749 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="rhel fedora" 2024-09-17T04:00:38.749 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="9" 2024-09-17T04:00:38.749 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el9" 2024-09-17T04:00:38.749 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-17T04:00:38.750 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31" 2024-09-17T04:00:38.750 INFO:teuthology.orchestra.run.smithi088.stdout:LOGO="fedora-logo-icon" 2024-09-17T04:00:38.750 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-17T04:00:38.750 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://centos.org/" 2024-09-17T04:00:38.750 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-17T04:00:38.750 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-17T04:00:38.750 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-17T04:00:38.751 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2024-09-17T04:00:38.776 DEBUG:teuthology.orchestra.run.smithi134:> uname -m 2024-09-17T04:00:38.795 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2024-09-17T04:00:38.795 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2024-09-17T04:00:38.852 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="CentOS Stream" 2024-09-17T04:00:38.853 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="9" 2024-09-17T04:00:38.853 INFO:teuthology.orchestra.run.smithi134.stdout:ID="centos" 2024-09-17T04:00:38.853 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="rhel fedora" 2024-09-17T04:00:38.853 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="9" 2024-09-17T04:00:38.853 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el9" 2024-09-17T04:00:38.853 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-17T04:00:38.853 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31" 2024-09-17T04:00:38.853 INFO:teuthology.orchestra.run.smithi134.stdout:LOGO="fedora-logo-icon" 2024-09-17T04:00:38.853 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-17T04:00:38.853 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://centos.org/" 2024-09-17T04:00:38.853 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-17T04:00:38.854 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-17T04:00:38.854 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-17T04:00:38.854 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2024-09-17T04:00:38.875 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-17T04:00:38.886 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-17T04:00:38.897 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-17T04:00:38.897 DEBUG:teuthology.orchestra.run.smithi088:> test '!' -e /home/ubuntu/cephtest 2024-09-17T04:00:38.899 DEBUG:teuthology.orchestra.run.smithi134:> test '!' -e /home/ubuntu/cephtest 2024-09-17T04:00:38.916 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-17T04:00:38.924 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-17T04:00:38.924 DEBUG:teuthology.orchestra.run.smithi088:> test -z $(ls -A /var/lib/ceph) 2024-09-17T04:00:38.957 DEBUG:teuthology.orchestra.run.smithi134:> test -z $(ls -A /var/lib/ceph) 2024-09-17T04:00:39.065 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-17T04:00:39.121 INFO:teuthology.run_tasks:Running task kernel... 2024-09-17T04:00:39.134 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-17T04:00:39.134 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-17T04:00:39.134 DEBUG:teuthology.orchestra.run.smithi088:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T04:00:39.135 DEBUG:teuthology.orchestra.run.smithi134:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T04:00:39.152 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T04:00:39.152 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T04:00:39.153 DEBUG:teuthology.orchestra.run.smithi088:> uname -r 2024-09-17T04:00:39.153 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2024-09-17T04:00:39.211 INFO:teuthology.orchestra.run.smithi134.stdout:5.14.0-503.el9.x86_64 2024-09-17T04:00:39.211 INFO:teuthology.task.kernel:Running kernel on smithi134: 5.14.0-503.el9.x86_64 2024-09-17T04:00:39.211 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum install -y kernel 2024-09-17T04:00:39.213 INFO:teuthology.orchestra.run.smithi088.stdout:5.14.0-503.el9.x86_64 2024-09-17T04:00:39.213 INFO:teuthology.task.kernel:Running kernel on smithi088: 5.14.0-503.el9.x86_64 2024-09-17T04:00:39.213 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum install -y kernel 2024-09-17T04:00:42.018 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - BaseOS 8.4 MB/s | 8.3 MB 00:00 2024-09-17T04:00:42.377 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - BaseOS 5.8 MB/s | 8.3 MB 00:01 2024-09-17T04:00:43.958 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-09-17T04:00:46.794 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - AppStream 6.1 MB/s | 20 MB 00:03 2024-09-17T04:00:51.016 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - CRB 2.0 MB/s | 6.5 MB 00:03 2024-09-17T04:00:52.583 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - Extras packages 67 kB/s | 19 kB 00:00 2024-09-17T04:00:53.295 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - CRB 2.4 MB/s | 6.5 MB 00:02 2024-09-17T04:00:53.871 INFO:teuthology.orchestra.run.smithi088.stdout:Extra Packages for Enterprise Linux 19 MB/s | 23 MB 00:01 2024-09-17T04:00:54.737 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - Extras packages 82 kB/s | 19 kB 00:00 2024-09-17T04:00:55.991 INFO:teuthology.orchestra.run.smithi134.stdout:Extra Packages for Enterprise Linux 20 MB/s | 23 MB 00:01 2024-09-17T04:00:59.276 INFO:teuthology.orchestra.run.smithi088.stdout:lab-extras 44 kB/s | 1.7 kB 00:00 2024-09-17T04:01:01.132 INFO:teuthology.orchestra.run.smithi088.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-17T04:01:01.132 INFO:teuthology.orchestra.run.smithi088.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-17T04:01:01.229 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-09-17T04:01:01.241 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-17T04:01:01.241 INFO:teuthology.orchestra.run.smithi088.stdout: Package Architecture Version Repository Size 2024-09-17T04:01:01.241 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-17T04:01:01.241 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2024-09-17T04:01:01.241 INFO:teuthology.orchestra.run.smithi088.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-17T04:01:01.241 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2024-09-17T04:01:01.241 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-17T04:01:01.241 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-17T04:01:01.241 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-17T04:01:01.242 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:01:01.242 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2024-09-17T04:01:01.242 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-17T04:01:01.242 INFO:teuthology.orchestra.run.smithi088.stdout:Install 4 Packages 2024-09-17T04:01:01.242 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:01:01.242 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 79 M 2024-09-17T04:01:01.242 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 126 M 2024-09-17T04:01:01.242 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2024-09-17T04:01:01.364 INFO:teuthology.orchestra.run.smithi134.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-09-17T04:01:01.398 INFO:teuthology.orchestra.run.smithi088.stdout:[MIRROR] kernel-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-508.el9.x86_64.rpm (IP: 216.31.2.234) 2024-09-17T04:01:01.398 INFO:teuthology.orchestra.run.smithi088.stdout:[MIRROR] kernel-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-508.el9.x86_64.rpm (IP: 216.31.2.234) 2024-09-17T04:01:01.398 INFO:teuthology.orchestra.run.smithi088.stdout:[MIRROR] kernel-modules-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-508.el9.x86_64.rpm (IP: 216.31.2.234) 2024-09-17T04:01:01.495 INFO:teuthology.orchestra.run.smithi088.stdout:[MIRROR] kernel-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-508.el9.x86_64.rpm (IP: 216.31.2.234) 2024-09-17T04:01:01.504 INFO:teuthology.orchestra.run.smithi088.stdout:[MIRROR] kernel-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-508.el9.x86_64.rpm (IP: 216.31.2.234) 2024-09-17T04:01:01.522 INFO:teuthology.orchestra.run.smithi088.stdout:[MIRROR] kernel-modules-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-508.el9.x86_64.rpm (IP: 216.31.2.234) 2024-09-17T04:01:01.540 INFO:teuthology.orchestra.run.smithi088.stdout:[MIRROR] kernel-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-508.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T04:01:01.545 INFO:teuthology.orchestra.run.smithi088.stdout:[MIRROR] kernel-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-508.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T04:01:01.575 INFO:teuthology.orchestra.run.smithi088.stdout:[MIRROR] kernel-modules-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-508.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T04:01:01.615 INFO:teuthology.orchestra.run.smithi088.stdout:[MIRROR] kernel-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-508.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T04:01:01.626 INFO:teuthology.orchestra.run.smithi088.stdout:[MIRROR] kernel-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-508.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T04:01:01.648 INFO:teuthology.orchestra.run.smithi088.stdout:[MIRROR] kernel-modules-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-508.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T04:01:02.169 INFO:teuthology.orchestra.run.smithi088.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 44 kB/s | 36 kB 00:00 2024-09-17T04:01:02.198 INFO:teuthology.orchestra.run.smithi088.stdout:[MIRROR] kernel-modules-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-508.el9.x86_64.rpm (IP: 216.31.2.234) 2024-09-17T04:01:02.226 INFO:teuthology.orchestra.run.smithi088.stdout:[MIRROR] kernel-modules-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-508.el9.x86_64.rpm (IP: 216.31.2.234) 2024-09-17T04:01:02.248 INFO:teuthology.orchestra.run.smithi088.stdout:[MIRROR] kernel-modules-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-508.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T04:01:02.270 INFO:teuthology.orchestra.run.smithi088.stdout:[MIRROR] kernel-modules-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-508.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T04:01:03.044 INFO:teuthology.orchestra.run.smithi088.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 9.2 MB/s | 16 MB 00:01 2024-09-17T04:01:03.295 INFO:teuthology.orchestra.run.smithi134.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-17T04:01:03.295 INFO:teuthology.orchestra.run.smithi134.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-17T04:01:03.395 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-17T04:01:03.400 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-17T04:01:03.401 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2024-09-17T04:01:03.401 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-17T04:01:03.401 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-17T04:01:03.401 INFO:teuthology.orchestra.run.smithi134.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-17T04:01:03.401 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-09-17T04:01:03.401 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-17T04:01:03.401 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-17T04:01:03.401 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-17T04:01:03.401 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:01:03.401 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-17T04:01:03.401 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-17T04:01:03.401 INFO:teuthology.orchestra.run.smithi134.stdout:Install 4 Packages 2024-09-17T04:01:03.401 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:01:03.402 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 79 M 2024-09-17T04:01:03.402 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 126 M 2024-09-17T04:01:03.402 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-17T04:01:03.703 INFO:teuthology.orchestra.run.smithi088.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 15 MB/s | 35 MB 00:02 2024-09-17T04:01:03.723 INFO:teuthology.orchestra.run.smithi134.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 394 kB/s | 36 kB 00:00 2024-09-17T04:01:04.115 INFO:teuthology.orchestra.run.smithi134.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-09-17T04:01:04.527 INFO:teuthology.orchestra.run.smithi088.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 12 MB/s | 29 MB 00:02 2024-09-17T04:01:04.535 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2024-09-17T04:01:04.535 INFO:teuthology.orchestra.run.smithi088.stdout:Total 24 MB/s | 79 MB 00:03 2024-09-17T04:01:04.565 INFO:teuthology.orchestra.run.smithi134.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 37 MB/s | 35 MB 00:00 2024-09-17T04:01:04.816 INFO:teuthology.orchestra.run.smithi134.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 26 MB/s | 29 MB 00:01 2024-09-17T04:01:04.816 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-17T04:01:04.816 INFO:teuthology.orchestra.run.smithi134.stdout:Total 56 MB/s | 79 MB 00:01 2024-09-17T04:01:05.222 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2024-09-17T04:01:05.497 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-17T04:01:05.576 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2024-09-17T04:01:05.576 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2024-09-17T04:01:05.852 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-17T04:01:05.852 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-17T04:01:06.539 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2024-09-17T04:01:06.539 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2024-09-17T04:01:06.815 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-17T04:01:06.816 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-17T04:01:08.968 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2024-09-17T04:01:09.235 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-17T04:01:09.613 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-17T04:01:09.705 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T04:01:09.927 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-17T04:01:10.010 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T04:01:12.457 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T04:01:12.591 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T04:01:12.759 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T04:01:12.880 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T04:01:17.393 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T04:01:17.441 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T04:01:17.719 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T04:01:17.789 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T04:01:22.289 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T04:01:22.622 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T04:02:00.546 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T04:02:00.586 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-17T04:02:00.947 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T04:02:00.947 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-17T04:02:00.947 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T04:02:00.947 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T04:02:01.066 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T04:02:01.106 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-17T04:02:01.495 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T04:02:01.495 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-17T04:02:01.496 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T04:02:01.496 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T04:02:01.828 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T04:02:01.828 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:02:01.828 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2024-09-17T04:02:01.828 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-17T04:02:01.828 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-17T04:02:01.828 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-17T04:02:01.828 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-17T04:02:01.828 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:02:01.829 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-09-17T04:02:02.174 DEBUG:teuthology.orchestra.run.smithi088:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T04:02:02.266 INFO:teuthology.orchestra.run.smithi088.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T04:02:02.266 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T04:02:02.266 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-17T04:02:02.267 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T04:02:02.267 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T04:02:02.267 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-09-17T04:02:02.267 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi088.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T04:02:02.267 DEBUG:teuthology.orchestra.run.smithi088:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T04:02:02.325 INFO:teuthology.orchestra.run.smithi088.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T04:02:02.325 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T04:02:02.325 DEBUG:teuthology.orchestra.run.smithi088:> sudo rpm -qi grub2-tools 2024-09-17T04:02:02.342 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T04:02:02.343 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:02:02.343 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-17T04:02:02.343 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-17T04:02:02.343 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-17T04:02:02.343 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-17T04:02:02.343 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-17T04:02:02.343 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:02:02.343 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-17T04:02:02.366 INFO:teuthology.orchestra.run.smithi088.stdout:Name : grub2-tools 2024-09-17T04:02:02.366 INFO:teuthology.orchestra.run.smithi088.stdout:Epoch : 1 2024-09-17T04:02:02.366 INFO:teuthology.orchestra.run.smithi088.stdout:Version : 2.06 2024-09-17T04:02:02.366 INFO:teuthology.orchestra.run.smithi088.stdout:Release : 82.el9 2024-09-17T04:02:02.366 INFO:teuthology.orchestra.run.smithi088.stdout:Architecture: x86_64 2024-09-17T04:02:02.366 INFO:teuthology.orchestra.run.smithi088.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-17T04:02:02.366 INFO:teuthology.orchestra.run.smithi088.stdout:Group : Unspecified 2024-09-17T04:02:02.366 INFO:teuthology.orchestra.run.smithi088.stdout:Size : 8274670 2024-09-17T04:02:02.367 INFO:teuthology.orchestra.run.smithi088.stdout:License : GPLv3+ 2024-09-17T04:02:02.367 INFO:teuthology.orchestra.run.smithi088.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-17T04:02:02.367 INFO:teuthology.orchestra.run.smithi088.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-17T04:02:02.367 INFO:teuthology.orchestra.run.smithi088.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-17T04:02:02.367 INFO:teuthology.orchestra.run.smithi088.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-17T04:02:02.367 INFO:teuthology.orchestra.run.smithi088.stdout:Packager : builder@centos.org 2024-09-17T04:02:02.367 INFO:teuthology.orchestra.run.smithi088.stdout:Vendor : CentOS 2024-09-17T04:02:02.367 INFO:teuthology.orchestra.run.smithi088.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-17T04:02:02.367 INFO:teuthology.orchestra.run.smithi088.stdout:Summary : Support tools for GRUB. 2024-09-17T04:02:02.367 INFO:teuthology.orchestra.run.smithi088.stdout:Description : 2024-09-17T04:02:02.367 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:02:02.367 INFO:teuthology.orchestra.run.smithi088.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-17T04:02:02.367 INFO:teuthology.orchestra.run.smithi088.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-17T04:02:02.368 INFO:teuthology.orchestra.run.smithi088.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-17T04:02:02.368 INFO:teuthology.orchestra.run.smithi088.stdout:hardware devices. 2024-09-17T04:02:02.368 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:02:02.368 INFO:teuthology.orchestra.run.smithi088.stdout:This subpackage provides tools for support of all platforms. 2024-09-17T04:02:02.369 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-17T04:02:02.369 INFO:teuthology.task.kernel:Updating grub on smithi088 to boot 5.14.0-508.el9.x86_64 2024-09-17T04:02:02.369 DEBUG:teuthology.orchestra.run.smithi088:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-17T04:02:02.709 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T04:02:02.793 INFO:teuthology.orchestra.run.smithi134.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T04:02:02.793 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T04:02:02.794 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-17T04:02:02.794 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T04:02:02.794 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T04:02:02.794 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-09-17T04:02:02.794 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi134.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T04:02:02.794 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T04:02:02.852 INFO:teuthology.orchestra.run.smithi134.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T04:02:02.852 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T04:02:02.852 DEBUG:teuthology.orchestra.run.smithi134:> sudo rpm -qi grub2-tools 2024-09-17T04:02:02.893 INFO:teuthology.orchestra.run.smithi134.stdout:Name : grub2-tools 2024-09-17T04:02:02.893 INFO:teuthology.orchestra.run.smithi134.stdout:Epoch : 1 2024-09-17T04:02:02.893 INFO:teuthology.orchestra.run.smithi134.stdout:Version : 2.06 2024-09-17T04:02:02.894 INFO:teuthology.orchestra.run.smithi134.stdout:Release : 82.el9 2024-09-17T04:02:02.894 INFO:teuthology.orchestra.run.smithi134.stdout:Architecture: x86_64 2024-09-17T04:02:02.894 INFO:teuthology.orchestra.run.smithi134.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-17T04:02:02.894 INFO:teuthology.orchestra.run.smithi134.stdout:Group : Unspecified 2024-09-17T04:02:02.894 INFO:teuthology.orchestra.run.smithi134.stdout:Size : 8274670 2024-09-17T04:02:02.894 INFO:teuthology.orchestra.run.smithi134.stdout:License : GPLv3+ 2024-09-17T04:02:02.894 INFO:teuthology.orchestra.run.smithi134.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-17T04:02:02.894 INFO:teuthology.orchestra.run.smithi134.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-17T04:02:02.894 INFO:teuthology.orchestra.run.smithi134.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-17T04:02:02.894 INFO:teuthology.orchestra.run.smithi134.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-17T04:02:02.894 INFO:teuthology.orchestra.run.smithi134.stdout:Packager : builder@centos.org 2024-09-17T04:02:02.894 INFO:teuthology.orchestra.run.smithi134.stdout:Vendor : CentOS 2024-09-17T04:02:02.894 INFO:teuthology.orchestra.run.smithi134.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-17T04:02:02.894 INFO:teuthology.orchestra.run.smithi134.stdout:Summary : Support tools for GRUB. 2024-09-17T04:02:02.895 INFO:teuthology.orchestra.run.smithi134.stdout:Description : 2024-09-17T04:02:02.895 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:02:02.895 INFO:teuthology.orchestra.run.smithi134.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-17T04:02:02.895 INFO:teuthology.orchestra.run.smithi134.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-17T04:02:02.895 INFO:teuthology.orchestra.run.smithi134.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-17T04:02:02.895 INFO:teuthology.orchestra.run.smithi134.stdout:hardware devices. 2024-09-17T04:02:02.895 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:02:02.895 INFO:teuthology.orchestra.run.smithi134.stdout:This subpackage provides tools for support of all platforms. 2024-09-17T04:02:02.896 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-17T04:02:02.896 INFO:teuthology.task.kernel:Updating grub on smithi134 to boot 5.14.0-508.el9.x86_64 2024-09-17T04:02:02.896 DEBUG:teuthology.orchestra.run.smithi134:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-17T04:02:03.035 INFO:teuthology.orchestra.run.smithi088.stderr:Generating grub configuration file ... 2024-09-17T04:02:03.562 INFO:teuthology.orchestra.run.smithi134.stderr:Generating grub configuration file ... 2024-09-17T04:02:04.425 INFO:teuthology.orchestra.run.smithi088.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-17T04:02:04.462 INFO:teuthology.orchestra.run.smithi088.stderr:done 2024-09-17T04:02:04.464 DEBUG:teuthology.orchestra.run.smithi088:> mktemp 2024-09-17T04:02:04.479 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.Dm7sVOxphw 2024-09-17T04:02:04.479 DEBUG:teuthology.orchestra.run.smithi088:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Dm7sVOxphw 2024-09-17T04:02:04.545 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0666 /tmp/tmp.Dm7sVOxphw 2024-09-17T04:02:04.683 DEBUG:teuthology.orchestra.remote:smithi088:/tmp/tmp.Dm7sVOxphw is 6KB 2024-09-17T04:02:04.704 DEBUG:teuthology.orchestra.run.smithi088:> rm -fr /tmp/tmp.Dm7sVOxphw 2024-09-17T04:02:04.719 DEBUG:teuthology.orchestra.run.smithi088:> sudo /bin/ls /boot/loader/entries || true 2024-09-17T04:02:04.782 INFO:teuthology.orchestra.run.smithi088.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-17T04:02:04.782 INFO:teuthology.orchestra.run.smithi088.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-17T04:02:04.782 INFO:teuthology.orchestra.run.smithi088.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-17T04:02:04.783 INFO:teuthology.orchestra.run.smithi088.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-17T04:02:04.784 DEBUG:teuthology.orchestra.run.smithi088:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-17T04:02:04.906 INFO:teuthology.orchestra.run.smithi134.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-17T04:02:04.931 INFO:teuthology.orchestra.run.smithi134.stderr:done 2024-09-17T04:02:04.933 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2024-09-17T04:02:04.948 DEBUG:teuthology.orchestra.run.smithi088:> sudo shutdown -r now 2024-09-17T04:02:04.977 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.R738T5Flf8 2024-09-17T04:02:04.978 DEBUG:teuthology.orchestra.run.smithi134:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.R738T5Flf8 2024-09-17T04:02:05.005 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.R738T5Flf8 2024-09-17T04:02:05.149 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.R738T5Flf8 is 6KB 2024-09-17T04:02:05.170 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.R738T5Flf8 2024-09-17T04:02:05.186 DEBUG:teuthology.orchestra.run.smithi134:> sudo /bin/ls /boot/loader/entries || true 2024-09-17T04:02:05.248 INFO:teuthology.orchestra.run.smithi134.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-17T04:02:05.248 INFO:teuthology.orchestra.run.smithi134.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-17T04:02:05.248 INFO:teuthology.orchestra.run.smithi134.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-17T04:02:05.248 INFO:teuthology.orchestra.run.smithi134.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-17T04:02:05.250 DEBUG:teuthology.orchestra.run.smithi134:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-17T04:02:05.407 DEBUG:teuthology.orchestra.run.smithi134:> sudo shutdown -r now 2024-09-17T04:02:34.979 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-09-17T04:02:34.979 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-09-17T04:02:34.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T04:02:35.411 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-09-17T04:02:35.411 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-17T04:02:35.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T04:02:53.373 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-09-17T04:03:02.381 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-09-17T04:03:02.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T04:03:05.437 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-09-17T04:03:17.448 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-09-17T04:03:17.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T04:03:20.513 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-09-17T04:03:35.427 DEBUG:teuthology.orchestra.remote:timed out 2024-09-17T04:03:35.514 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-09-17T04:03:35.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T04:03:44.437 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-17T04:03:44.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T04:03:44.780 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-09-17T04:03:45.127 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-17T04:03:45.127 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-508.el9.x86_64"... 2024-09-17T04:03:45.127 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2024-09-17T04:03:45.142 INFO:teuthology.orchestra.run.smithi134.stdout:5.14.0-508.el9.x86_64 2024-09-17T04:03:45.142 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-17T04:03:45.142 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T04:03:45.143 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-17T04:03:46.144 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-09-17T04:03:46.144 DEBUG:teuthology.orchestra.run.smithi134:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-17T04:03:46.281 INFO:teuthology.orchestra.run.smithi134.stdout:ttyS1 2024-09-17T04:03:46.310 DEBUG:teuthology.parallel:result is None 2024-09-17T04:04:07.470 DEBUG:teuthology.orchestra.run.smithi088:> true 2024-09-17T04:04:07.971 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-09-17T04:04:07.971 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-508.el9.x86_64"... 2024-09-17T04:04:07.971 DEBUG:teuthology.orchestra.run.smithi088:> uname -r 2024-09-17T04:04:07.987 INFO:teuthology.orchestra.run.smithi088.stdout:5.14.0-508.el9.x86_64 2024-09-17T04:04:07.987 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-17T04:04:07.987 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T04:04:07.987 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-17T04:04:08.988 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-09-17T04:04:08.988 DEBUG:teuthology.orchestra.run.smithi088:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-17T04:04:09.055 INFO:teuthology.orchestra.run.smithi088.stdout:ttyS1 2024-09-17T04:04:09.073 DEBUG:teuthology.parallel:result is None 2024-09-17T04:04:09.073 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-17T04:04:09.080 INFO:teuthology.task.internal:Creating test directory... 2024-09-17T04:04:09.080 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T04:04:09.082 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T04:04:09.101 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-17T04:04:09.108 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-17T04:04:09.118 INFO:teuthology.task.internal:Creating archive directory... 2024-09-17T04:04:09.118 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T04:04:09.139 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T04:04:09.226 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-17T04:04:09.232 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-17T04:04:09.232 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T04:04:09.235 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T04:04:09.269 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T04:04:09.274 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T04:04:09.280 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T04:04:09.285 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T04:04:09.286 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-17T04:04:09.293 INFO:teuthology.task.internal:Configuring sudo... 2024-09-17T04:04:09.294 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T04:04:09.329 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T04:04:09.356 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-17T04:04:09.365 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-17T04:04:09.366 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T04:04:09.396 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T04:04:09.413 DEBUG:teuthology.orchestra.run.smithi088:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T04:04:09.491 DEBUG:teuthology.orchestra.run.smithi088:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T04:04:09.539 DEBUG:teuthology.orchestra.run.smithi088:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T04:04:09.617 DEBUG:teuthology.orchestra.run.smithi088:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T04:04:09.663 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-17T04:04:09.663 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T04:04:09.727 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T04:04:09.766 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T04:04:09.829 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T04:04:09.912 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T04:04:09.953 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-17T04:04:09.953 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T04:04:10.018 DEBUG:teuthology.orchestra.run.smithi088:> sudo service rsyslog restart 2024-09-17T04:04:10.021 DEBUG:teuthology.orchestra.run.smithi134:> sudo service rsyslog restart 2024-09-17T04:04:10.067 INFO:teuthology.orchestra.run.smithi088.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T04:04:10.109 INFO:teuthology.orchestra.run.smithi134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T04:04:10.431 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-17T04:04:10.442 INFO:teuthology.task.internal:Starting timer... 2024-09-17T04:04:10.442 INFO:teuthology.run_tasks:Running task pcp... 2024-09-17T04:04:10.457 INFO:teuthology.run_tasks:Running task selinux... 2024-09-17T04:04:10.468 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-17T04:04:10.468 DEBUG:teuthology.orchestra.run.smithi088:> sudo service auditd rotate 2024-09-17T04:04:10.510 INFO:teuthology.orchestra.run.smithi088.stdout:Rotating logs: 2024-09-17T04:04:10.512 DEBUG:teuthology.orchestra.run.smithi134:> sudo service auditd rotate 2024-09-17T04:04:10.551 INFO:teuthology.orchestra.run.smithi134.stdout:Rotating logs: 2024-09-17T04:04:10.552 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-17T04:04:10.553 DEBUG:teuthology.orchestra.run.smithi088:> /usr/sbin/getenforce 2024-09-17T04:04:10.597 INFO:teuthology.orchestra.run.smithi088.stdout:Permissive 2024-09-17T04:04:10.597 DEBUG:teuthology.orchestra.run.smithi134:> /usr/sbin/getenforce 2024-09-17T04:04:10.630 INFO:teuthology.orchestra.run.smithi134.stdout:Permissive 2024-09-17T04:04:10.630 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi088.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi134.front.sepia.ceph.com': 'permissive'} 2024-09-17T04:04:10.630 DEBUG:teuthology.orchestra.run.smithi088:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-17T04:04:10.656 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T04:04:10.656 DEBUG:teuthology.orchestra.run.smithi134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-17T04:04:10.696 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T04:04:10.697 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-17T04:04:10.697 DEBUG:teuthology.orchestra.run.smithi088:> sudo /usr/sbin/setenforce permissive 2024-09-17T04:04:10.728 DEBUG:teuthology.orchestra.run.smithi134:> sudo /usr/sbin/setenforce permissive 2024-09-17T04:04:10.765 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-17T04:04:10.775 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-17T04:04:10.787 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-17T04:04:10.787 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi088.front.sepia.ceph.com,smithi134.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-17T04:07:55.959 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi088.front.sepia.ceph.com'), Remote(name='ubuntu@smithi134.front.sepia.ceph.com')] 2024-09-17T04:07:55.960 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-09-17T04:07:55.961 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T04:07:56.037 DEBUG:teuthology.orchestra.run.smithi088:> true 2024-09-17T04:07:56.115 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-09-17T04:07:56.115 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-17T04:07:56.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T04:07:56.189 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-09-17T04:07:56.265 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-17T04:07:56.265 INFO:teuthology.run_tasks:Running task clock... 2024-09-17T04:07:56.276 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-17T04:07:56.276 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T04:07:56.277 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T04:07:56.279 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T04:07:56.279 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T04:07:56.305 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-17T04:07:56.319 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-17T04:07:56.335 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-17T04:07:56.343 INFO:teuthology.orchestra.run.smithi088.stderr:sudo: ntpd: command not found 2024-09-17T04:07:56.349 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-17T04:07:56.354 INFO:teuthology.orchestra.run.smithi088.stdout:506 Cannot talk to daemon 2024-09-17T04:07:56.368 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-17T04:07:56.373 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: ntpd: command not found 2024-09-17T04:07:56.381 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-17T04:07:56.384 INFO:teuthology.orchestra.run.smithi134.stdout:506 Cannot talk to daemon 2024-09-17T04:07:56.398 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-17T04:07:56.412 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-17T04:07:56.446 INFO:teuthology.orchestra.run.smithi088.stderr:bash: line 1: ntpq: command not found 2024-09-17T04:07:56.449 INFO:teuthology.orchestra.run.smithi088.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T04:07:56.449 INFO:teuthology.orchestra.run.smithi088.stdout:=============================================================================== 2024-09-17T04:07:56.449 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T04:07:56.449 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T04:07:56.449 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T04:07:56.449 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T04:07:56.476 INFO:teuthology.orchestra.run.smithi134.stderr:bash: line 1: ntpq: command not found 2024-09-17T04:07:56.480 INFO:teuthology.orchestra.run.smithi134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T04:07:56.480 INFO:teuthology.orchestra.run.smithi134.stdout:=============================================================================== 2024-09-17T04:07:56.480 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T04:07:56.480 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T04:07:56.480 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T04:07:56.480 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T04:07:56.481 INFO:teuthology.run_tasks:Running task install... 2024-09-17T04:07:56.489 DEBUG:teuthology.task.install:project ceph 2024-09-17T04:07:56.489 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}} 2024-09-17T04:07:56.489 DEBUG:teuthology.task.install:config {'branch': 'squid', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'} 2024-09-17T04:07:56.489 INFO:teuthology.task.install:Using flavor: default 2024-09-17T04:07:56.494 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-17T04:07:56.495 INFO:teuthology.task.install:extra packages: [] 2024-09-17T04:07:56.495 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'squid', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'tag': None, 'wait_for_package': False} 2024-09-17T04:07:56.495 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T04:07:56.495 INFO:teuthology.packaging:ref: None 2024-09-17T04:07:56.495 INFO:teuthology.packaging:tag: None 2024-09-17T04:07:56.495 INFO:teuthology.packaging:branch: squid 2024-09-17T04:07:56.496 INFO:teuthology.packaging:sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T04:07:56.496 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-17T04:07:56.498 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'squid', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'tag': None, 'wait_for_package': False} 2024-09-17T04:07:56.498 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T04:07:56.498 INFO:teuthology.packaging:ref: None 2024-09-17T04:07:56.498 INFO:teuthology.packaging:tag: None 2024-09-17T04:07:56.498 INFO:teuthology.packaging:branch: squid 2024-09-17T04:07:56.498 INFO:teuthology.packaging:sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T04:07:56.498 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-17T04:07:56.705 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/squid/8e98666cb045318799c9328f1ae906cc2d724fd2/centos/9/flavors/default/ 2024-09-17T04:07:56.705 INFO:teuthology.task.install.rpm:Package version is 19.2.0-0 2024-09-17T04:07:56.730 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/squid/8e98666cb045318799c9328f1ae906cc2d724fd2/centos/9/flavors/default/ 2024-09-17T04:07:56.731 INFO:teuthology.task.install.rpm:Package version is 19.2.0-0 2024-09-17T04:07:56.743 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/squid/8e98666cb045318799c9328f1ae906cc2d724fd2/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/squid/8e98666cb045318799c9328f1ae906cc2d724fd2/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/squid/8e98666cb045318799c9328f1ae906cc2d724fd2/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-17T04:07:56.743 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-17T04:07:56.743 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-17T04:07:56.757 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/squid/8e98666cb045318799c9328f1ae906cc2d724fd2/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/squid/8e98666cb045318799c9328f1ae906cc2d724fd2/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/squid/8e98666cb045318799c9328f1ae906cc2d724fd2/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-17T04:07:56.757 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-17T04:07:56.757 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-17T04:07:56.769 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-17T04:07:56.769 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T04:07:56.770 INFO:teuthology.packaging:ref: None 2024-09-17T04:07:56.770 INFO:teuthology.packaging:tag: None 2024-09-17T04:07:56.770 INFO:teuthology.packaging:branch: squid 2024-09-17T04:07:56.770 INFO:teuthology.packaging:sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T04:07:56.770 DEBUG:teuthology.orchestra.run.smithi088:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/squid/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-17T04:07:56.783 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-17T04:07:56.783 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T04:07:56.783 INFO:teuthology.packaging:ref: None 2024-09-17T04:07:56.783 INFO:teuthology.packaging:tag: None 2024-09-17T04:07:56.783 INFO:teuthology.packaging:branch: squid 2024-09-17T04:07:56.783 INFO:teuthology.packaging:sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T04:07:56.784 DEBUG:teuthology.orchestra.run.smithi134:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/squid/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-17T04:07:56.837 DEBUG:teuthology.orchestra.run.smithi088:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-17T04:07:56.849 DEBUG:teuthology.orchestra.run.smithi134:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-17T04:07:56.912 DEBUG:teuthology.orchestra.run.smithi088:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-17T04:07:56.924 DEBUG:teuthology.orchestra.run.smithi134:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-17T04:07:56.976 INFO:teuthology.orchestra.run.smithi088.stdout:check_obsoletes = 1 2024-09-17T04:07:56.978 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum clean all 2024-09-17T04:07:56.988 INFO:teuthology.orchestra.run.smithi134.stdout:check_obsoletes = 1 2024-09-17T04:07:56.989 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum clean all 2024-09-17T04:07:57.201 INFO:teuthology.orchestra.run.smithi088.stdout:45 files removed 2024-09-17T04:07:57.221 INFO:teuthology.orchestra.run.smithi134.stdout:45 files removed 2024-09-17T04:07:57.228 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-radosgw 2024-09-17T04:07:57.248 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-radosgw 2024-09-17T04:07:57.608 INFO:teuthology.orchestra.run.smithi088.stdout:ceph packages for x86_64 832 kB/s | 83 kB 00:00 2024-09-17T04:07:57.618 INFO:teuthology.orchestra.run.smithi134.stdout:ceph packages for x86_64 950 kB/s | 83 kB 00:00 2024-09-17T04:07:57.742 INFO:teuthology.orchestra.run.smithi088.stdout:ceph noarch packages 132 kB/s | 11 kB 00:00 2024-09-17T04:07:57.743 INFO:teuthology.orchestra.run.smithi134.stdout:ceph noarch packages 145 kB/s | 11 kB 00:00 2024-09-17T04:07:57.861 INFO:teuthology.orchestra.run.smithi134.stdout:ceph source packages 27 kB/s | 2.2 kB 00:00 2024-09-17T04:07:57.868 INFO:teuthology.orchestra.run.smithi088.stdout:ceph source packages 24 kB/s | 2.2 kB 00:00 2024-09-17T04:08:00.222 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - BaseOS 3.5 MB/s | 8.3 MB 00:02 2024-09-17T04:08:00.895 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - BaseOS 2.8 MB/s | 8.3 MB 00:02 2024-09-17T04:08:09.782 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - AppStream 2.4 MB/s | 20 MB 00:08 2024-09-17T04:08:14.988 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - CRB 4.7 MB/s | 6.5 MB 00:01 2024-09-17T04:08:16.630 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - Extras packages 64 kB/s | 19 kB 00:00 2024-09-17T04:08:17.609 INFO:teuthology.orchestra.run.smithi134.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-17T04:08:19.233 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 20 MB 00:17 2024-09-17T04:08:23.015 INFO:teuthology.orchestra.run.smithi134.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-17T04:08:24.258 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - CRB 5.3 MB/s | 6.5 MB 00:01 2024-09-17T04:08:25.232 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-17T04:08:25.247 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-17T04:08:25.247 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-09-17T04:08:25.248 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-17T04:08:25.248 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-17T04:08:25.248 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw x86_64 2:19.2.0-0.el9 ceph 11 M 2024-09-17T04:08:25.248 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrading: 2024-09-17T04:08:25.248 INFO:teuthology.orchestra.run.smithi134.stdout: librados2 x86_64 2:19.2.0-0.el9 ceph 3.4 M 2024-09-17T04:08:25.248 INFO:teuthology.orchestra.run.smithi134.stdout: librbd1 x86_64 2:19.2.0-0.el9 ceph 3.2 M 2024-09-17T04:08:25.248 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-09-17T04:08:25.248 INFO:teuthology.orchestra.run.smithi134.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-17T04:08:25.248 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base x86_64 2:19.2.0-0.el9 ceph 5.4 M 2024-09-17T04:08:25.248 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common x86_64 2:19.2.0-0.el9 ceph 21 M 2024-09-17T04:08:25.248 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux x86_64 2:19.2.0-0.el9 ceph 25 k 2024-09-17T04:08:25.249 INFO:teuthology.orchestra.run.smithi134.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-17T04:08:25.249 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-17T04:08:25.249 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-17T04:08:25.249 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2 x86_64 2:19.2.0-0.el9 ceph 751 k 2024-09-17T04:08:25.249 INFO:teuthology.orchestra.run.smithi134.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-17T04:08:25.249 INFO:teuthology.orchestra.run.smithi134.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-17T04:08:25.249 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-17T04:08:25.249 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1 x86_64 2:19.2.0-0.el9 ceph 506 k 2024-09-17T04:08:25.249 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-17T04:08:25.249 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2 x86_64 2:19.2.0-0.el9 ceph 5.4 M 2024-09-17T04:08:25.249 INFO:teuthology.orchestra.run.smithi134.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-17T04:08:25.249 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-17T04:08:25.249 INFO:teuthology.orchestra.run.smithi134.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-17T04:08:25.250 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse x86_64 2:19.2.0-0.el9 ceph 45 k 2024-09-17T04:08:25.250 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common x86_64 2:19.2.0-0.el9 ceph 135 k 2024-09-17T04:08:25.250 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs x86_64 2:19.2.0-0.el9 ceph 161 k 2024-09-17T04:08:25.250 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-17T04:08:25.250 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados x86_64 2:19.2.0-0.el9 ceph 320 k 2024-09-17T04:08:25.250 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd x86_64 2:19.2.0-0.el9 ceph 301 k 2024-09-17T04:08:25.250 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw x86_64 2:19.2.0-0.el9 ceph 99 k 2024-09-17T04:08:25.250 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-17T04:08:25.250 INFO:teuthology.orchestra.run.smithi134.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-17T04:08:25.250 INFO:teuthology.orchestra.run.smithi134.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-17T04:08:25.250 INFO:teuthology.orchestra.run.smithi134.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-17T04:08:25.250 INFO:teuthology.orchestra.run.smithi134.stdout:Installing weak dependencies: 2024-09-17T04:08:25.250 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-17T04:08:25.251 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:08:25.251 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-17T04:08:25.251 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-17T04:08:25.251 INFO:teuthology.orchestra.run.smithi134.stdout:Install 30 Packages 2024-09-17T04:08:25.251 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrade 2 Packages 2024-09-17T04:08:25.251 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:08:25.251 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 60 M 2024-09-17T04:08:25.252 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-17T04:08:25.549 INFO:teuthology.orchestra.run.smithi134.stdout:(1/32): ceph-base-19.2.0-0.el9.x86_64.rpm 48 MB/s | 5.4 MB 00:00 2024-09-17T04:08:25.575 INFO:teuthology.orchestra.run.smithi134.stdout:(2/32): ceph-selinux-19.2.0-0.el9.x86_64.rpm 1.0 MB/s | 25 kB 00:00 2024-09-17T04:08:25.617 INFO:teuthology.orchestra.run.smithi134.stdout:(3/32): libcephfs2-19.2.0-0.el9.x86_64.rpm 18 MB/s | 751 kB 00:00 2024-09-17T04:08:25.650 INFO:teuthology.orchestra.run.smithi134.stdout:(4/32): libradosstriper1-19.2.0-0.el9.x86_64.rp 15 MB/s | 506 kB 00:00 2024-09-17T04:08:25.942 INFO:teuthology.orchestra.run.smithi134.stdout:(5/32): ceph-common-19.2.0-0.el9.x86_64.rpm 42 MB/s | 21 MB 00:00 2024-09-17T04:08:25.968 INFO:teuthology.orchestra.run.smithi134.stdout:(6/32): python3-ceph-argparse-19.2.0-0.el9.x86_ 1.8 MB/s | 45 kB 00:00 2024-09-17T04:08:25.993 INFO:teuthology.orchestra.run.smithi134.stdout:(7/32): python3-ceph-common-19.2.0-0.el9.x86_64 5.3 MB/s | 135 kB 00:00 2024-09-17T04:08:26.018 INFO:teuthology.orchestra.run.smithi134.stdout:(8/32): python3-cephfs-19.2.0-0.el9.x86_64.rpm 6.4 MB/s | 161 kB 00:00 2024-09-17T04:08:26.085 INFO:teuthology.orchestra.run.smithi134.stdout:(9/32): librgw2-19.2.0-0.el9.x86_64.rpm 12 MB/s | 5.4 MB 00:00 2024-09-17T04:08:26.119 INFO:teuthology.orchestra.run.smithi134.stdout:(10/32): python3-rados-19.2.0-0.el9.x86_64.rpm 3.1 MB/s | 320 kB 00:00 2024-09-17T04:08:26.144 INFO:teuthology.orchestra.run.smithi134.stdout:(11/32): python3-rbd-19.2.0-0.el9.x86_64.rpm 12 MB/s | 301 kB 00:00 2024-09-17T04:08:26.169 INFO:teuthology.orchestra.run.smithi134.stdout:(12/32): python3-rgw-19.2.0-0.el9.x86_64.rpm 1.9 MB/s | 99 kB 00:00 2024-09-17T04:08:26.286 INFO:teuthology.orchestra.run.smithi134.stdout:(13/32): ceph-radosgw-19.2.0-0.el9.x86_64.rpm 12 MB/s | 11 MB 00:00 2024-09-17T04:08:26.692 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - Extras packages 17 kB/s | 19 kB 00:01 2024-09-17T04:08:26.861 INFO:teuthology.orchestra.run.smithi134.stdout:(14/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 79 kB/s | 45 kB 00:00 2024-09-17T04:08:26.920 INFO:teuthology.orchestra.run.smithi134.stdout:(15/32): boost-program-options-1.75.0-8.el9.x86 138 kB/s | 107 kB 00:00 2024-09-17T04:08:26.987 INFO:teuthology.orchestra.run.smithi134.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 196 kB/s | 160 kB 00:00 2024-09-17T04:08:27.562 INFO:teuthology.orchestra.run.smithi134.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 73 kB/s | 42 kB 00:00 2024-09-17T04:08:27.646 INFO:teuthology.orchestra.run.smithi088.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-17T04:08:27.712 INFO:teuthology.orchestra.run.smithi134.stdout:(18/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 369 kB/s | 292 kB 00:00 2024-09-17T04:08:27.737 INFO:teuthology.orchestra.run.smithi134.stdout:(19/32): librdkafka-1.6.1-102.el9.x86_64.rpm 757 kB/s | 662 kB 00:00 2024-09-17T04:08:28.271 INFO:teuthology.orchestra.run.smithi134.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 64 kB/s | 36 kB 00:00 2024-09-17T04:08:28.304 INFO:teuthology.orchestra.run.smithi134.stdout:(21/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 84 kB/s | 47 kB 00:00 2024-09-17T04:08:28.330 INFO:teuthology.orchestra.run.smithi134.stdout:(22/32): qatlib-24.02.0-1.el9.x86_64.rpm 287 kB/s | 221 kB 00:00 2024-09-17T04:08:28.372 INFO:teuthology.orchestra.run.smithi134.stdout:(23/32): gperftools-libs-2.9.1-3.el9.x86_64.rpm 3.0 MB/s | 308 kB 00:00 2024-09-17T04:08:28.389 INFO:teuthology.orchestra.run.smithi134.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 3.2 MB/s | 49 kB 00:00 2024-09-17T04:08:28.406 INFO:teuthology.orchestra.run.smithi134.stdout:(25/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 384 kB/s | 26 kB 00:00 2024-09-17T04:08:28.431 INFO:teuthology.orchestra.run.smithi134.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-09-17T04:08:28.464 INFO:teuthology.orchestra.run.smithi134.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 5.7 MB/s | 191 kB 00:00 2024-09-17T04:08:28.523 INFO:teuthology.orchestra.run.smithi134.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.0 MB/s | 839 kB 00:00 2024-09-17T04:08:28.598 INFO:teuthology.orchestra.run.smithi134.stdout:(29/32): librados2-19.2.0-0.el9.x86_64.rpm 46 MB/s | 3.4 MB 00:00 2024-09-17T04:08:28.640 INFO:teuthology.orchestra.run.smithi134.stdout:(30/32): thrift-0.15.0-2.el9.x86_64.rpm 9.0 MB/s | 1.6 MB 00:00 2024-09-17T04:08:28.707 INFO:teuthology.orchestra.run.smithi134.stdout:(31/32): librbd1-19.2.0-0.el9.x86_64.rpm 29 MB/s | 3.2 MB 00:00 2024-09-17T04:08:28.774 INFO:teuthology.orchestra.run.smithi134.stdout:(32/32): libarrow-9.0.0-11.el9.x86_64.rpm 9.5 MB/s | 4.4 MB 00:00 2024-09-17T04:08:28.780 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-17T04:08:28.780 INFO:teuthology.orchestra.run.smithi134.stdout:Total 17 MB/s | 60 MB 00:03 2024-09-17T04:08:28.878 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-17T04:08:28.915 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-17T04:08:28.915 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-17T04:08:29.639 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-17T04:08:29.640 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-17T04:08:31.108 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-17T04:08:31.188 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-17T04:08:31.221 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-17T04:08:31.254 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-17T04:08:31.277 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-17T04:08:31.300 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-17T04:08:31.446 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-17T04:08:31.507 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-17T04:08:31.892 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-17T04:08:31.964 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : librados2-2:19.2.0-0.el9.x86_64 7/34 2024-09-17T04:08:32.066 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados2-2:19.2.0-0.el9.x86_64 7/34 2024-09-17T04:08:32.184 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rados-2:19.2.0-0.el9.x86_64 8/34 2024-09-17T04:08:32.216 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephfs2-2:19.2.0-0.el9.x86_64 9/34 2024-09-17T04:08:32.279 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephfs2-2:19.2.0-0.el9.x86_64 9/34 2024-09-17T04:08:32.316 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-17T04:08:32.360 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ceph-argparse-2:19.2.0-0.el9.x86_64 11/34 2024-09-17T04:08:32.429 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cephfs-2:19.2.0-0.el9.x86_64 12/34 2024-09-17T04:08:32.451 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libradosstriper1-2:19.2.0-0.el9.x86_64 13/34 2024-09-17T04:08:32.506 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libradosstriper1-2:19.2.0-0.el9.x86_64 13/34 2024-09-17T04:08:32.541 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-17T04:08:32.660 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-17T04:08:32.700 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-17T04:08:32.741 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-17T04:08:32.782 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/34 2024-09-17T04:08:32.811 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-17T04:08:32.846 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-17T04:08:33.060 INFO:teuthology.orchestra.run.smithi088.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-17T04:08:33.181 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-17T04:08:33.223 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : librbd1-2:19.2.0-0.el9.x86_64 22/34 2024-09-17T04:08:33.313 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librbd1-2:19.2.0-0.el9.x86_64 22/34 2024-09-17T04:08:33.351 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rbd-2:19.2.0-0.el9.x86_64 23/34 2024-09-17T04:08:33.389 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-17T04:08:33.863 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-17T04:08:33.900 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librgw2-2:19.2.0-0.el9.x86_64 26/34 2024-09-17T04:08:33.955 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librgw2-2:19.2.0-0.el9.x86_64 26/34 2024-09-17T04:08:34.033 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rgw-2:19.2.0-0.el9.x86_64 27/34 2024-09-17T04:08:34.061 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ceph-common-2:19.2.0-0.el9.x86_64 28/34 2024-09-17T04:08:35.271 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-09-17T04:08:35.297 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-17T04:08:35.298 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2024-09-17T04:08:35.298 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-17T04:08:35.298 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2024-09-17T04:08:35.298 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-radosgw x86_64 2:19.2.0-0.el9 ceph 11 M 2024-09-17T04:08:35.298 INFO:teuthology.orchestra.run.smithi088.stdout:Upgrading: 2024-09-17T04:08:35.298 INFO:teuthology.orchestra.run.smithi088.stdout: librados2 x86_64 2:19.2.0-0.el9 ceph 3.4 M 2024-09-17T04:08:35.298 INFO:teuthology.orchestra.run.smithi088.stdout: librbd1 x86_64 2:19.2.0-0.el9 ceph 3.2 M 2024-09-17T04:08:35.298 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2024-09-17T04:08:35.298 INFO:teuthology.orchestra.run.smithi088.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-17T04:08:35.298 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-base x86_64 2:19.2.0-0.el9 ceph 5.4 M 2024-09-17T04:08:35.298 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-common x86_64 2:19.2.0-0.el9 ceph 21 M 2024-09-17T04:08:35.298 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-selinux x86_64 2:19.2.0-0.el9 ceph 25 k 2024-09-17T04:08:35.298 INFO:teuthology.orchestra.run.smithi088.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-17T04:08:35.299 INFO:teuthology.orchestra.run.smithi088.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-17T04:08:35.299 INFO:teuthology.orchestra.run.smithi088.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-17T04:08:35.299 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs2 x86_64 2:19.2.0-0.el9 ceph 751 k 2024-09-17T04:08:35.299 INFO:teuthology.orchestra.run.smithi088.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-17T04:08:35.299 INFO:teuthology.orchestra.run.smithi088.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-17T04:08:35.299 INFO:teuthology.orchestra.run.smithi088.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-17T04:08:35.299 INFO:teuthology.orchestra.run.smithi088.stdout: libradosstriper1 x86_64 2:19.2.0-0.el9 ceph 506 k 2024-09-17T04:08:35.299 INFO:teuthology.orchestra.run.smithi088.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-17T04:08:35.299 INFO:teuthology.orchestra.run.smithi088.stdout: librgw2 x86_64 2:19.2.0-0.el9 ceph 5.4 M 2024-09-17T04:08:35.299 INFO:teuthology.orchestra.run.smithi088.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-17T04:08:35.299 INFO:teuthology.orchestra.run.smithi088.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-17T04:08:35.299 INFO:teuthology.orchestra.run.smithi088.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-17T04:08:35.299 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-argparse x86_64 2:19.2.0-0.el9 ceph 45 k 2024-09-17T04:08:35.299 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-common x86_64 2:19.2.0-0.el9 ceph 135 k 2024-09-17T04:08:35.300 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cephfs x86_64 2:19.2.0-0.el9 ceph 161 k 2024-09-17T04:08:35.300 INFO:teuthology.orchestra.run.smithi088.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-17T04:08:35.300 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rados x86_64 2:19.2.0-0.el9 ceph 320 k 2024-09-17T04:08:35.300 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rbd x86_64 2:19.2.0-0.el9 ceph 301 k 2024-09-17T04:08:35.300 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rgw x86_64 2:19.2.0-0.el9 ceph 99 k 2024-09-17T04:08:35.300 INFO:teuthology.orchestra.run.smithi088.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-17T04:08:35.300 INFO:teuthology.orchestra.run.smithi088.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-17T04:08:35.300 INFO:teuthology.orchestra.run.smithi088.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-17T04:08:35.300 INFO:teuthology.orchestra.run.smithi088.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-17T04:08:35.300 INFO:teuthology.orchestra.run.smithi088.stdout:Installing weak dependencies: 2024-09-17T04:08:35.300 INFO:teuthology.orchestra.run.smithi088.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-17T04:08:35.300 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:08:35.300 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2024-09-17T04:08:35.300 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-17T04:08:35.300 INFO:teuthology.orchestra.run.smithi088.stdout:Install 30 Packages 2024-09-17T04:08:35.301 INFO:teuthology.orchestra.run.smithi088.stdout:Upgrade 2 Packages 2024-09-17T04:08:35.301 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:08:35.301 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 60 M 2024-09-17T04:08:35.301 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2024-09-17T04:08:35.511 INFO:teuthology.orchestra.run.smithi088.stdout:(1/32): ceph-base-19.2.0-0.el9.x86_64.rpm 41 MB/s | 5.4 MB 00:00 2024-09-17T04:08:35.536 INFO:teuthology.orchestra.run.smithi088.stdout:(2/32): ceph-selinux-19.2.0-0.el9.x86_64.rpm 1.0 MB/s | 25 kB 00:00 2024-09-17T04:08:35.570 INFO:teuthology.orchestra.run.smithi088.stdout:(3/32): libcephfs2-19.2.0-0.el9.x86_64.rpm 22 MB/s | 751 kB 00:00 2024-09-17T04:08:35.604 INFO:teuthology.orchestra.run.smithi088.stdout:(4/32): libradosstriper1-19.2.0-0.el9.x86_64.rp 15 MB/s | 506 kB 00:00 2024-09-17T04:08:35.762 INFO:teuthology.orchestra.run.smithi088.stdout:(5/32): ceph-radosgw-19.2.0-0.el9.x86_64.rpm 27 MB/s | 11 MB 00:00 2024-09-17T04:08:35.787 INFO:teuthology.orchestra.run.smithi088.stdout:(6/32): python3-ceph-argparse-19.2.0-0.el9.x86_ 1.8 MB/s | 45 kB 00:00 2024-09-17T04:08:35.813 INFO:teuthology.orchestra.run.smithi088.stdout:(7/32): python3-ceph-common-19.2.0-0.el9.x86_64 5.3 MB/s | 135 kB 00:00 2024-09-17T04:08:35.888 INFO:teuthology.orchestra.run.smithi088.stdout:(8/32): librgw2-19.2.0-0.el9.x86_64.rpm 19 MB/s | 5.4 MB 00:00 2024-09-17T04:08:35.913 INFO:teuthology.orchestra.run.smithi088.stdout:(9/32): python3-cephfs-19.2.0-0.el9.x86_64.rpm 1.6 MB/s | 161 kB 00:00 2024-09-17T04:08:35.947 INFO:teuthology.orchestra.run.smithi088.stdout:(10/32): python3-rados-19.2.0-0.el9.x86_64.rpm 5.3 MB/s | 320 kB 00:00 2024-09-17T04:08:35.980 INFO:teuthology.orchestra.run.smithi088.stdout:(11/32): python3-rbd-19.2.0-0.el9.x86_64.rpm 4.4 MB/s | 301 kB 00:00 2024-09-17T04:08:36.006 INFO:teuthology.orchestra.run.smithi088.stdout:(12/32): python3-rgw-19.2.0-0.el9.x86_64.rpm 1.7 MB/s | 99 kB 00:00 2024-09-17T04:08:36.239 INFO:teuthology.orchestra.run.smithi088.stdout:(13/32): ceph-common-19.2.0-0.el9.x86_64.rpm 25 MB/s | 21 MB 00:00 2024-09-17T04:08:36.264 INFO:teuthology.orchestra.run.smithi088.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 376 kB/s | 107 kB 00:00 2024-09-17T04:08:36.315 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-common-2:19.2.0-0.el9.x86_64 29/34 2024-09-17T04:08:36.349 INFO:teuthology.orchestra.run.smithi088.stdout:(15/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 468 kB/s | 160 kB 00:00 2024-09-17T04:08:36.357 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-common-2:19.2.0-0.el9.x86_64 29/34 2024-09-17T04:08:36.373 INFO:teuthology.orchestra.run.smithi088.stdout:(16/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 338 kB/s | 45 kB 00:00 2024-09-17T04:08:36.424 INFO:teuthology.orchestra.run.smithi088.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 847 kB/s | 42 kB 00:00 2024-09-17T04:08:36.458 INFO:teuthology.orchestra.run.smithi088.stdout:(18/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-09-17T04:08:36.483 INFO:teuthology.orchestra.run.smithi088.stdout:(19/32): librdkafka-1.6.1-102.el9.x86_64.rpm 3.0 MB/s | 662 kB 00:00 2024-09-17T04:08:36.516 INFO:teuthology.orchestra.run.smithi088.stdout:(20/32): qatlib-24.02.0-1.el9.x86_64.rpm 2.3 MB/s | 221 kB 00:00 2024-09-17T04:08:36.542 INFO:teuthology.orchestra.run.smithi088.stdout:(21/32): qatlib-service-24.02.0-1.el9.x86_64.rp 428 kB/s | 36 kB 00:00 2024-09-17T04:08:36.567 INFO:teuthology.orchestra.run.smithi088.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 566 kB/s | 47 kB 00:00 2024-09-17T04:08:36.625 INFO:teuthology.orchestra.run.smithi088.stdout:(23/32): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.8 MB/s | 308 kB 00:00 2024-09-17T04:08:36.650 INFO:teuthology.orchestra.run.smithi088.stdout:(24/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 311 kB/s | 26 kB 00:00 2024-09-17T04:08:36.676 INFO:teuthology.orchestra.run.smithi088.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 967 kB/s | 49 kB 00:00 2024-09-17T04:08:36.701 INFO:teuthology.orchestra.run.smithi088.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-17T04:08:36.743 INFO:teuthology.orchestra.run.smithi088.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-17T04:08:36.777 INFO:teuthology.orchestra.run.smithi088.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.1 MB/s | 839 kB 00:00 2024-09-17T04:08:36.852 INFO:teuthology.orchestra.run.smithi088.stdout:(29/32): librados2-19.2.0-0.el9.x86_64.rpm 46 MB/s | 3.4 MB 00:00 2024-09-17T04:08:36.927 INFO:teuthology.orchestra.run.smithi088.stdout:(30/32): librbd1-19.2.0-0.el9.x86_64.rpm 42 MB/s | 3.2 MB 00:00 2024-09-17T04:08:36.941 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-common-2:19.2.0-0.el9.x86_64 29/34 2024-09-17T04:08:36.977 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-base-2:19.2.0-0.el9.x86_64 30/34 2024-09-17T04:08:36.978 INFO:teuthology.orchestra.run.smithi088.stdout:(31/32): thrift-0.15.0-2.el9.x86_64.rpm 6.8 MB/s | 1.6 MB 00:00 2024-09-17T04:08:37.051 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-base-2:19.2.0-0.el9.x86_64 30/34 2024-09-17T04:08:37.051 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-17T04:08:37.052 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-17T04:08:37.052 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:08:37.053 INFO:teuthology.orchestra.run.smithi088.stdout:(32/32): libarrow-9.0.0-11.el9.x86_64.rpm 9.1 MB/s | 4.4 MB 00:00 2024-09-17T04:08:37.057 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2024-09-17T04:08:37.057 INFO:teuthology.orchestra.run.smithi088.stdout:Total 34 MB/s | 60 MB 00:01 2024-09-17T04:08:37.086 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-selinux-2:19.2.0-0.el9.x86_64 31/34 2024-09-17T04:08:37.157 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2024-09-17T04:08:37.193 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2024-09-17T04:08:37.194 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2024-09-17T04:08:37.913 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2024-09-17T04:08:37.913 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2024-09-17T04:08:39.432 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2024-09-17T04:08:39.504 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-17T04:08:39.541 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-17T04:08:39.566 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-17T04:08:39.589 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-17T04:08:39.616 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-17T04:08:39.817 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-17T04:08:39.869 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-17T04:08:40.243 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-17T04:08:40.309 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : librados2-2:19.2.0-0.el9.x86_64 7/34 2024-09-17T04:08:40.410 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librados2-2:19.2.0-0.el9.x86_64 7/34 2024-09-17T04:08:40.500 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rados-2:19.2.0-0.el9.x86_64 8/34 2024-09-17T04:08:40.536 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephfs2-2:19.2.0-0.el9.x86_64 9/34 2024-09-17T04:08:40.599 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libcephfs2-2:19.2.0-0.el9.x86_64 9/34 2024-09-17T04:08:40.636 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-17T04:08:40.679 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-ceph-argparse-2:19.2.0-0.el9.x86_64 11/34 2024-09-17T04:08:40.749 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cephfs-2:19.2.0-0.el9.x86_64 12/34 2024-09-17T04:08:40.780 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libradosstriper1-2:19.2.0-0.el9.x86_64 13/34 2024-09-17T04:08:40.844 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libradosstriper1-2:19.2.0-0.el9.x86_64 13/34 2024-09-17T04:08:40.887 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-17T04:08:40.996 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-17T04:08:41.029 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-17T04:08:41.075 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-17T04:08:41.102 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/34 2024-09-17T04:08:41.132 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-17T04:08:41.165 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-17T04:08:41.478 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-17T04:08:41.519 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : librbd1-2:19.2.0-0.el9.x86_64 22/34 2024-09-17T04:08:41.611 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librbd1-2:19.2.0-0.el9.x86_64 22/34 2024-09-17T04:08:41.640 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rbd-2:19.2.0-0.el9.x86_64 23/34 2024-09-17T04:08:41.676 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-17T04:08:42.161 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-17T04:08:42.213 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librgw2-2:19.2.0-0.el9.x86_64 26/34 2024-09-17T04:08:42.285 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librgw2-2:19.2.0-0.el9.x86_64 26/34 2024-09-17T04:08:42.362 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rgw-2:19.2.0-0.el9.x86_64 27/34 2024-09-17T04:08:42.390 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-ceph-common-2:19.2.0-0.el9.x86_64 28/34 2024-09-17T04:08:44.722 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-common-2:19.2.0-0.el9.x86_64 29/34 2024-09-17T04:08:44.770 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-common-2:19.2.0-0.el9.x86_64 29/34 2024-09-17T04:08:45.340 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-common-2:19.2.0-0.el9.x86_64 29/34 2024-09-17T04:08:45.381 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-base-2:19.2.0-0.el9.x86_64 30/34 2024-09-17T04:08:45.488 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-base-2:19.2.0-0.el9.x86_64 30/34 2024-09-17T04:08:45.488 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-17T04:08:45.488 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-17T04:08:45.488 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:08:45.533 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-selinux-2:19.2.0-0.el9.x86_64 31/34 2024-09-17T04:08:47.348 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-selinux-2:19.2.0-0.el9.x86_64 31/34 2024-09-17T04:08:47.348 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /sys 2024-09-17T04:08:47.348 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /proc 2024-09-17T04:08:47.349 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /mnt 2024-09-17T04:08:47.349 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /var/tmp 2024-09-17T04:08:47.349 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /home 2024-09-17T04:08:47.349 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /root 2024-09-17T04:08:47.349 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /tmp 2024-09-17T04:08:47.349 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:08:48.318 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-radosgw-2:19.2.0-0.el9.x86_64 32/34 2024-09-17T04:08:48.343 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-radosgw-2:19.2.0-0.el9.x86_64 32/34 2024-09-17T04:08:48.343 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:08:48.343 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-17T04:08:48.343 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T04:08:48.343 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T04:08:48.343 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:08:48.345 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-17T04:08:48.420 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-17T04:08:48.420 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-17T04:08:49.596 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-17T04:08:49.596 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-base-2:19.2.0-0.el9.x86_64 1/34 2024-09-17T04:08:49.596 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-common-2:19.2.0-0.el9.x86_64 2/34 2024-09-17T04:08:49.596 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-radosgw-2:19.2.0-0.el9.x86_64 3/34 2024-09-17T04:08:49.596 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-selinux-2:19.2.0-0.el9.x86_64 4/34 2024-09-17T04:08:49.596 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephfs2-2:19.2.0-0.el9.x86_64 5/34 2024-09-17T04:08:49.597 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libradosstriper1-2:19.2.0-0.el9.x86_64 6/34 2024-09-17T04:08:49.597 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librgw2-2:19.2.0-0.el9.x86_64 7/34 2024-09-17T04:08:49.597 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ceph-argparse-2:19.2.0-0.el9.x86_64 8/34 2024-09-17T04:08:49.597 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ceph-common-2:19.2.0-0.el9.x86_64 9/34 2024-09-17T04:08:49.597 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cephfs-2:19.2.0-0.el9.x86_64 10/34 2024-09-17T04:08:49.597 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rados-2:19.2.0-0.el9.x86_64 11/34 2024-09-17T04:08:49.597 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rbd-2:19.2.0-0.el9.x86_64 12/34 2024-09-17T04:08:49.597 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rgw-2:19.2.0-0.el9.x86_64 13/34 2024-09-17T04:08:49.597 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-17T04:08:49.597 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-17T04:08:49.597 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-17T04:08:49.597 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-17T04:08:49.597 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-17T04:08:49.598 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-17T04:08:49.598 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-17T04:08:49.598 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-17T04:08:49.598 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-17T04:08:49.598 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 23/34 2024-09-17T04:08:49.598 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-17T04:08:49.598 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-17T04:08:49.598 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-17T04:08:49.598 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-17T04:08:49.598 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-17T04:08:49.598 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-17T04:08:49.598 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-17T04:08:49.599 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados2-2:19.2.0-0.el9.x86_64 31/34 2024-09-17T04:08:49.599 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-17T04:08:49.599 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librbd1-2:19.2.0-0.el9.x86_64 33/34 2024-09-17T04:08:50.670 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-17T04:08:50.670 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:08:50.670 INFO:teuthology.orchestra.run.smithi134.stdout:Upgraded: 2024-09-17T04:08:50.670 INFO:teuthology.orchestra.run.smithi134.stdout: librados2-2:19.2.0-0.el9.x86_64 librbd1-2:19.2.0-0.el9.x86_64 2024-09-17T04:08:50.670 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-17T04:08:50.670 INFO:teuthology.orchestra.run.smithi134.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-17T04:08:50.671 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base-2:19.2.0-0.el9.x86_64 2024-09-17T04:08:50.671 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common-2:19.2.0-0.el9.x86_64 2024-09-17T04:08:50.671 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw-2:19.2.0-0.el9.x86_64 2024-09-17T04:08:50.671 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux-2:19.2.0-0.el9.x86_64 2024-09-17T04:08:50.671 INFO:teuthology.orchestra.run.smithi134.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-17T04:08:50.671 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-17T04:08:50.671 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-17T04:08:50.671 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2-2:19.2.0-0.el9.x86_64 2024-09-17T04:08:50.671 INFO:teuthology.orchestra.run.smithi134.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-17T04:08:50.671 INFO:teuthology.orchestra.run.smithi134.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-17T04:08:50.671 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-17T04:08:50.671 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1-2:19.2.0-0.el9.x86_64 2024-09-17T04:08:50.671 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-17T04:08:50.672 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2-2:19.2.0-0.el9.x86_64 2024-09-17T04:08:50.672 INFO:teuthology.orchestra.run.smithi134.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-17T04:08:50.672 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-17T04:08:50.672 INFO:teuthology.orchestra.run.smithi134.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-17T04:08:50.672 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse-2:19.2.0-0.el9.x86_64 2024-09-17T04:08:50.672 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common-2:19.2.0-0.el9.x86_64 2024-09-17T04:08:50.672 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs-2:19.2.0-0.el9.x86_64 2024-09-17T04:08:50.672 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-17T04:08:50.672 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados-2:19.2.0-0.el9.x86_64 2024-09-17T04:08:50.672 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd-2:19.2.0-0.el9.x86_64 2024-09-17T04:08:50.672 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw-2:19.2.0-0.el9.x86_64 2024-09-17T04:08:50.672 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-17T04:08:50.672 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-17T04:08:50.672 INFO:teuthology.orchestra.run.smithi134.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-17T04:08:50.673 INFO:teuthology.orchestra.run.smithi134.stdout: re2-1:20211101-20.el9.x86_64 2024-09-17T04:08:50.673 INFO:teuthology.orchestra.run.smithi134.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-17T04:08:50.673 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:08:50.673 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-17T04:08:51.058 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-test 2024-09-17T04:08:51.644 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:00:29 ago on Tue 17 Sep 2024 04:08:22 AM UTC. 2024-09-17T04:08:51.780 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-17T04:08:51.781 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-17T04:08:51.781 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2024-09-17T04:08:51.781 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-17T04:08:51.781 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-17T04:08:51.781 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test x86_64 2:19.2.0-0.el9 ceph 49 M 2024-09-17T04:08:51.781 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-09-17T04:08:51.781 INFO:teuthology.orchestra.run.smithi134.stdout: libcephsqlite x86_64 2:19.2.0-0.el9 ceph 163 k 2024-09-17T04:08:51.781 INFO:teuthology.orchestra.run.smithi134.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-17T04:08:51.781 INFO:teuthology.orchestra.run.smithi134.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-17T04:08:51.782 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:08:51.782 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-17T04:08:51.782 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-17T04:08:51.782 INFO:teuthology.orchestra.run.smithi134.stdout:Install 4 Packages 2024-09-17T04:08:51.782 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:08:51.782 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 49 M 2024-09-17T04:08:51.782 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 208 M 2024-09-17T04:08:51.783 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-17T04:08:52.108 INFO:teuthology.orchestra.run.smithi134.stdout:(1/4): libcephsqlite-19.2.0-0.el9.x86_64.rpm 2.5 MB/s | 163 kB 00:00 2024-09-17T04:08:52.241 INFO:teuthology.orchestra.run.smithi134.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 478 kB/s | 64 kB 00:00 2024-09-17T04:08:52.291 INFO:teuthology.orchestra.run.smithi134.stdout:(3/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.2 MB/s | 304 kB 00:00 2024-09-17T04:08:52.758 INFO:teuthology.orchestra.run.smithi134.stdout:(4/4): ceph-test-19.2.0-0.el9.x86_64.rpm 68 MB/s | 49 MB 00:00 2024-09-17T04:08:52.760 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-17T04:08:52.761 INFO:teuthology.orchestra.run.smithi134.stdout:Total 50 MB/s | 49 MB 00:00 2024-09-17T04:08:52.789 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-17T04:08:52.809 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-17T04:08:52.809 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-17T04:08:53.180 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-17T04:08:53.180 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-17T04:08:53.718 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-17T04:08:53.791 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-17T04:08:53.840 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-17T04:08:53.868 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephsqlite-2:19.2.0-0.el9.x86_64 3/4 2024-09-17T04:08:55.642 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-selinux-2:19.2.0-0.el9.x86_64 31/34 2024-09-17T04:08:55.643 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /sys 2024-09-17T04:08:55.643 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /proc 2024-09-17T04:08:55.643 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /mnt 2024-09-17T04:08:55.643 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /var/tmp 2024-09-17T04:08:55.643 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /home 2024-09-17T04:08:55.643 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /root 2024-09-17T04:08:55.643 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /tmp 2024-09-17T04:08:55.643 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:08:56.607 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-radosgw-2:19.2.0-0.el9.x86_64 32/34 2024-09-17T04:08:56.640 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-radosgw-2:19.2.0-0.el9.x86_64 32/34 2024-09-17T04:08:56.640 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:08:56.640 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-17T04:08:56.640 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T04:08:56.640 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T04:08:56.640 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:08:56.642 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-17T04:08:56.726 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-17T04:08:56.727 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-17T04:08:57.955 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-17T04:08:57.956 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-base-2:19.2.0-0.el9.x86_64 1/34 2024-09-17T04:08:57.956 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-common-2:19.2.0-0.el9.x86_64 2/34 2024-09-17T04:08:57.956 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-radosgw-2:19.2.0-0.el9.x86_64 3/34 2024-09-17T04:08:57.956 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-selinux-2:19.2.0-0.el9.x86_64 4/34 2024-09-17T04:08:57.956 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephfs2-2:19.2.0-0.el9.x86_64 5/34 2024-09-17T04:08:57.956 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libradosstriper1-2:19.2.0-0.el9.x86_64 6/34 2024-09-17T04:08:57.956 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librgw2-2:19.2.0-0.el9.x86_64 7/34 2024-09-17T04:08:57.956 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-ceph-argparse-2:19.2.0-0.el9.x86_64 8/34 2024-09-17T04:08:57.956 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-ceph-common-2:19.2.0-0.el9.x86_64 9/34 2024-09-17T04:08:57.956 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cephfs-2:19.2.0-0.el9.x86_64 10/34 2024-09-17T04:08:57.956 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rados-2:19.2.0-0.el9.x86_64 11/34 2024-09-17T04:08:57.956 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rbd-2:19.2.0-0.el9.x86_64 12/34 2024-09-17T04:08:57.956 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rgw-2:19.2.0-0.el9.x86_64 13/34 2024-09-17T04:08:57.957 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-17T04:08:57.957 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-17T04:08:57.957 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-17T04:08:57.957 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-17T04:08:57.957 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-17T04:08:57.957 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-17T04:08:57.957 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-17T04:08:57.957 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-17T04:08:57.957 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-17T04:08:57.957 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 23/34 2024-09-17T04:08:57.957 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-17T04:08:57.957 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-17T04:08:57.957 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-17T04:08:57.958 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-17T04:08:57.958 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-17T04:08:57.958 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-17T04:08:57.958 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-17T04:08:57.958 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados2-2:19.2.0-0.el9.x86_64 31/34 2024-09-17T04:08:57.958 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-17T04:08:57.958 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librbd1-2:19.2.0-0.el9.x86_64 33/34 2024-09-17T04:08:58.485 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephsqlite-2:19.2.0-0.el9.x86_64 3/4 2024-09-17T04:08:58.565 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-test-2:19.2.0-0.el9.x86_64 4/4 2024-09-17T04:08:59.071 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-17T04:08:59.071 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:08:59.071 INFO:teuthology.orchestra.run.smithi088.stdout:Upgraded: 2024-09-17T04:08:59.071 INFO:teuthology.orchestra.run.smithi088.stdout: librados2-2:19.2.0-0.el9.x86_64 librbd1-2:19.2.0-0.el9.x86_64 2024-09-17T04:08:59.071 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2024-09-17T04:08:59.071 INFO:teuthology.orchestra.run.smithi088.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-17T04:08:59.071 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-base-2:19.2.0-0.el9.x86_64 2024-09-17T04:08:59.071 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-common-2:19.2.0-0.el9.x86_64 2024-09-17T04:08:59.071 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-radosgw-2:19.2.0-0.el9.x86_64 2024-09-17T04:08:59.072 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-selinux-2:19.2.0-0.el9.x86_64 2024-09-17T04:08:59.072 INFO:teuthology.orchestra.run.smithi088.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-17T04:08:59.072 INFO:teuthology.orchestra.run.smithi088.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-17T04:08:59.072 INFO:teuthology.orchestra.run.smithi088.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-17T04:08:59.072 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs2-2:19.2.0-0.el9.x86_64 2024-09-17T04:08:59.072 INFO:teuthology.orchestra.run.smithi088.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-17T04:08:59.072 INFO:teuthology.orchestra.run.smithi088.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-17T04:08:59.072 INFO:teuthology.orchestra.run.smithi088.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-17T04:08:59.072 INFO:teuthology.orchestra.run.smithi088.stdout: libradosstriper1-2:19.2.0-0.el9.x86_64 2024-09-17T04:08:59.072 INFO:teuthology.orchestra.run.smithi088.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-17T04:08:59.072 INFO:teuthology.orchestra.run.smithi088.stdout: librgw2-2:19.2.0-0.el9.x86_64 2024-09-17T04:08:59.072 INFO:teuthology.orchestra.run.smithi088.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-17T04:08:59.072 INFO:teuthology.orchestra.run.smithi088.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-17T04:08:59.073 INFO:teuthology.orchestra.run.smithi088.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-17T04:08:59.073 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-argparse-2:19.2.0-0.el9.x86_64 2024-09-17T04:08:59.073 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-common-2:19.2.0-0.el9.x86_64 2024-09-17T04:08:59.073 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cephfs-2:19.2.0-0.el9.x86_64 2024-09-17T04:08:59.073 INFO:teuthology.orchestra.run.smithi088.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-17T04:08:59.073 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rados-2:19.2.0-0.el9.x86_64 2024-09-17T04:08:59.073 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rbd-2:19.2.0-0.el9.x86_64 2024-09-17T04:08:59.073 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rgw-2:19.2.0-0.el9.x86_64 2024-09-17T04:08:59.073 INFO:teuthology.orchestra.run.smithi088.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-17T04:08:59.073 INFO:teuthology.orchestra.run.smithi088.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-17T04:08:59.073 INFO:teuthology.orchestra.run.smithi088.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-17T04:08:59.073 INFO:teuthology.orchestra.run.smithi088.stdout: re2-1:20211101-20.el9.x86_64 2024-09-17T04:08:59.073 INFO:teuthology.orchestra.run.smithi088.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-17T04:08:59.074 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:08:59.074 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-09-17T04:08:59.446 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-test 2024-09-17T04:09:00.021 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:00:27 ago on Tue 17 Sep 2024 04:08:33 AM UTC. 2024-09-17T04:09:00.152 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-09-17T04:09:00.152 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-17T04:09:00.153 INFO:teuthology.orchestra.run.smithi088.stdout: Package Architecture Version Repository Size 2024-09-17T04:09:00.153 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-17T04:09:00.153 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2024-09-17T04:09:00.153 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-test x86_64 2:19.2.0-0.el9 ceph 49 M 2024-09-17T04:09:00.153 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2024-09-17T04:09:00.153 INFO:teuthology.orchestra.run.smithi088.stdout: libcephsqlite x86_64 2:19.2.0-0.el9 ceph 163 k 2024-09-17T04:09:00.153 INFO:teuthology.orchestra.run.smithi088.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-17T04:09:00.153 INFO:teuthology.orchestra.run.smithi088.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-17T04:09:00.153 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:09:00.153 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2024-09-17T04:09:00.153 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-17T04:09:00.153 INFO:teuthology.orchestra.run.smithi088.stdout:Install 4 Packages 2024-09-17T04:09:00.154 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:09:00.154 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 49 M 2024-09-17T04:09:00.154 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 208 M 2024-09-17T04:09:00.154 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2024-09-17T04:09:00.331 INFO:teuthology.orchestra.run.smithi088.stdout:(1/4): libcephsqlite-19.2.0-0.el9.x86_64.rpm 2.6 MB/s | 163 kB 00:00 2024-09-17T04:09:00.407 INFO:teuthology.orchestra.run.smithi088.stdout:(2/4): socat-1.7.4.1-6.el9.x86_64.rpm 2.2 MB/s | 304 kB 00:00 2024-09-17T04:09:00.432 INFO:teuthology.orchestra.run.smithi088.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 636 kB/s | 64 kB 00:00 2024-09-17T04:09:00.940 INFO:teuthology.orchestra.run.smithi088.stdout:(4/4): ceph-test-19.2.0-0.el9.x86_64.rpm 73 MB/s | 49 MB 00:00 2024-09-17T04:09:00.943 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2024-09-17T04:09:00.943 INFO:teuthology.orchestra.run.smithi088.stdout:Total 62 MB/s | 49 MB 00:00 2024-09-17T04:09:00.943 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-test-2:19.2.0-0.el9.x86_64 4/4 2024-09-17T04:09:00.943 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-test-2:19.2.0-0.el9.x86_64 1/4 2024-09-17T04:09:00.943 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephsqlite-2:19.2.0-0.el9.x86_64 2/4 2024-09-17T04:09:00.943 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-17T04:09:00.969 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2024-09-17T04:09:00.989 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2024-09-17T04:09:00.989 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2024-09-17T04:09:01.267 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-17T04:09:01.267 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:09:01.267 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-17T04:09:01.267 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test-2:19.2.0-0.el9.x86_64 libcephsqlite-2:19.2.0-0.el9.x86_64 2024-09-17T04:09:01.268 INFO:teuthology.orchestra.run.smithi134.stdout: socat-1.7.4.1-6.el9.x86_64 xmlstarlet-1.6.1-20.el9.x86_64 2024-09-17T04:09:01.268 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:09:01.268 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-17T04:09:01.361 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2024-09-17T04:09:01.361 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2024-09-17T04:09:01.568 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph 2024-09-17T04:09:01.890 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2024-09-17T04:09:01.966 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-17T04:09:02.014 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-17T04:09:02.050 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephsqlite-2:19.2.0-0.el9.x86_64 3/4 2024-09-17T04:09:02.155 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:00:40 ago on Tue 17 Sep 2024 04:08:22 AM UTC. 2024-09-17T04:09:02.307 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-17T04:09:02.310 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-17T04:09:02.310 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-09-17T04:09:02.310 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-17T04:09:02.310 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-17T04:09:02.310 INFO:teuthology.orchestra.run.smithi134.stdout: ceph x86_64 2:19.2.0-0.el9 ceph 6.5 k 2024-09-17T04:09:02.310 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-09-17T04:09:02.311 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds x86_64 2:19.2.0-0.el9 ceph 2.4 M 2024-09-17T04:09:02.311 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr x86_64 2:19.2.0-0.el9 ceph 1.5 M 2024-09-17T04:09:02.311 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core noarch 2:19.2.0-0.el9 ceph-noarch 249 k 2024-09-17T04:09:02.311 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon x86_64 2:19.2.0-0.el9 ceph 4.7 M 2024-09-17T04:09:02.311 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd x86_64 2:19.2.0-0.el9 ceph 17 M 2024-09-17T04:09:02.312 INFO:teuthology.orchestra.run.smithi134.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-17T04:09:02.312 INFO:teuthology.orchestra.run.smithi134.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-17T04:09:02.312 INFO:teuthology.orchestra.run.smithi134.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-17T04:09:02.312 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-17T04:09:02.312 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-17T04:09:02.312 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-17T04:09:02.313 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-17T04:09:02.313 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-17T04:09:02.313 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-17T04:09:02.313 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-17T04:09:02.313 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-17T04:09:02.314 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-17T04:09:02.314 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-17T04:09:02.314 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-17T04:09:02.314 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-17T04:09:02.314 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-17T04:09:02.314 INFO:teuthology.orchestra.run.smithi134.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-17T04:09:02.315 INFO:teuthology.orchestra.run.smithi134.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-17T04:09:02.315 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-17T04:09:02.315 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-17T04:09:02.315 INFO:teuthology.orchestra.run.smithi134.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-17T04:09:02.315 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-17T04:09:02.315 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-17T04:09:02.316 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-17T04:09:02.316 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-17T04:09:02.316 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-17T04:09:02.316 INFO:teuthology.orchestra.run.smithi134.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-17T04:09:02.316 INFO:teuthology.orchestra.run.smithi134.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-17T04:09:02.316 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-17T04:09:02.317 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-17T04:09:02.317 INFO:teuthology.orchestra.run.smithi134.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-17T04:09:02.317 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:09:02.317 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-17T04:09:02.317 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-17T04:09:02.318 INFO:teuthology.orchestra.run.smithi134.stdout:Install 37 Packages 2024-09-17T04:09:02.318 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:09:02.319 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 30 M 2024-09-17T04:09:02.319 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 108 M 2024-09-17T04:09:02.319 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-17T04:09:02.591 INFO:teuthology.orchestra.run.smithi134.stdout:(1/37): ceph-19.2.0-0.el9.x86_64.rpm 108 kB/s | 6.5 kB 00:00 2024-09-17T04:09:02.650 INFO:teuthology.orchestra.run.smithi134.stdout:(2/37): ceph-mgr-19.2.0-0.el9.x86_64.rpm 13 MB/s | 1.5 MB 00:00 2024-09-17T04:09:02.700 INFO:teuthology.orchestra.run.smithi134.stdout:(3/37): ceph-mds-19.2.0-0.el9.x86_64.rpm 14 MB/s | 2.4 MB 00:00 2024-09-17T04:09:02.725 INFO:teuthology.orchestra.run.smithi134.stdout:(4/37): ceph-mgr-modules-core-19.2.0-0.el9.noar 9.8 MB/s | 249 kB 00:00 2024-09-17T04:09:02.825 INFO:teuthology.orchestra.run.smithi134.stdout:(5/37): ceph-mon-19.2.0-0.el9.x86_64.rpm 20 MB/s | 4.7 MB 00:00 2024-09-17T04:09:03.042 INFO:teuthology.orchestra.run.smithi134.stdout:(6/37): ceph-osd-19.2.0-0.el9.x86_64.rpm 43 MB/s | 17 MB 00:00 2024-09-17T04:09:03.735 INFO:teuthology.orchestra.run.smithi134.stdout:(7/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 251 kB/s | 253 kB 00:01 2024-09-17T04:09:03.759 INFO:teuthology.orchestra.run.smithi134.stdout:(8/37): python3-ply-3.11-14.el9.noarch.rpm 149 kB/s | 106 kB 00:00 2024-09-17T04:09:03.910 INFO:teuthology.orchestra.run.smithi134.stdout:(9/37): python3-cryptography-36.0.1-4.el9.x86_6 1.1 MB/s | 1.2 MB 00:01 2024-09-17T04:09:04.460 INFO:teuthology.orchestra.run.smithi134.stdout:(10/37): python3-pycparser-2.20-6.el9.noarch.rp 186 kB/s | 135 kB 00:00 2024-09-17T04:09:04.485 INFO:teuthology.orchestra.run.smithi134.stdout:(11/37): python3-requests-2.25.1-8.el9.noarch.r 172 kB/s | 125 kB 00:00 2024-09-17T04:09:04.586 INFO:teuthology.orchestra.run.smithi134.stdout:(12/37): python3-mako-1.1.4-6.el9.noarch.rpm 1.7 MB/s | 172 kB 00:00 2024-09-17T04:09:04.611 INFO:teuthology.orchestra.run.smithi134.stdout:(13/37): lua-5.4.4-4.el9.x86_64.rpm 1.2 MB/s | 188 kB 00:00 2024-09-17T04:09:04.627 INFO:teuthology.orchestra.run.smithi134.stdout:(14/37): python3-markupsafe-1.1.1-12.el9.x86_64 833 kB/s | 35 kB 00:00 2024-09-17T04:09:04.662 INFO:teuthology.orchestra.run.smithi134.stdout:(15/37): python3-packaging-20.9-5.el9.noarch.rp 1.5 MB/s | 77 kB 00:00 2024-09-17T04:09:04.687 INFO:teuthology.orchestra.run.smithi134.stdout:(16/37): python3-urllib3-1.26.5-6.el9.noarch.rp 276 kB/s | 215 kB 00:00 2024-09-17T04:09:04.704 INFO:teuthology.orchestra.run.smithi134.stdout:(17/37): python3-pytz-2021.1-5.el9.noarch.rpm 673 kB/s | 51 kB 00:00 2024-09-17T04:09:04.721 INFO:teuthology.orchestra.run.smithi134.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 709 kB/s | 42 kB 00:00 2024-09-17T04:09:04.771 INFO:teuthology.orchestra.run.smithi134.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-09-17T04:09:04.805 INFO:teuthology.orchestra.run.smithi134.stdout:(20/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 5.3 MB/s | 172 kB 00:00 2024-09-17T04:09:04.821 INFO:teuthology.orchestra.run.smithi134.stdout:(21/37): lua-devel-5.4.4-4.el9.x86_64.rpm 166 kB/s | 22 kB 00:00 2024-09-17T04:09:04.838 INFO:teuthology.orchestra.run.smithi134.stdout:(22/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 370 kB/s | 43 kB 00:00 2024-09-17T04:09:04.855 INFO:teuthology.orchestra.run.smithi134.stdout:(23/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 654 kB/s | 11 kB 00:00 2024-09-17T04:09:04.889 INFO:teuthology.orchestra.run.smithi134.stdout:(24/37): python3-cherrypy-18.6.1-2.el9.noarch.r 4.2 MB/s | 358 kB 00:00 2024-09-17T04:09:04.917 INFO:teuthology.orchestra.run.smithi134.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 427 kB/s | 23 kB 00:00 2024-09-17T04:09:04.942 INFO:teuthology.orchestra.run.smithi134.stdout:(26/37): python3-jaraco-classes-3.2.1-5.el9.noa 171 kB/s | 18 kB 00:00 2024-09-17T04:09:04.968 INFO:teuthology.orchestra.run.smithi134.stdout:(27/37): python3-jaraco-functools-3.5.0-2.el9.n 254 kB/s | 19 kB 00:00 2024-09-17T04:09:04.993 INFO:teuthology.orchestra.run.smithi134.stdout:(28/37): python3-jaraco-text-3.2.0-6.el9.noarch 262 kB/s | 20 kB 00:00 2024-09-17T04:09:05.018 INFO:teuthology.orchestra.run.smithi134.stdout:(29/37): python3-logutils-0.3.5-21.el9.noarch.r 924 kB/s | 46 kB 00:00 2024-09-17T04:09:05.051 INFO:teuthology.orchestra.run.smithi134.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 944 kB/s | 79 kB 00:00 2024-09-17T04:09:05.077 INFO:teuthology.orchestra.run.smithi134.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 281 kB/s | 16 kB 00:00 2024-09-17T04:09:05.102 INFO:teuthology.orchestra.run.smithi134.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.8 MB/s | 90 kB 00:00 2024-09-17T04:09:05.127 INFO:teuthology.orchestra.run.smithi134.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 714 kB/s | 36 kB 00:00 2024-09-17T04:09:05.178 INFO:teuthology.orchestra.run.smithi134.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.4 MB/s | 272 kB 00:00 2024-09-17T04:09:05.203 INFO:teuthology.orchestra.run.smithi134.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 807 kB/s | 20 kB 00:00 2024-09-17T04:09:05.228 INFO:teuthology.orchestra.run.smithi134.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-17T04:09:05.253 INFO:teuthology.orchestra.run.smithi134.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.3 MB/s | 427 kB 00:00 2024-09-17T04:09:05.258 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-17T04:09:05.259 INFO:teuthology.orchestra.run.smithi134.stdout:Total 10 MB/s | 30 MB 00:02 2024-09-17T04:09:05.412 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-17T04:09:05.452 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-17T04:09:05.452 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-17T04:09:05.935 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-17T04:09:05.936 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-17T04:09:06.655 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libcephsqlite-2:19.2.0-0.el9.x86_64 3/4 2024-09-17T04:09:06.731 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-test-2:19.2.0-0.el9.x86_64 4/4 2024-09-17T04:09:07.292 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-17T04:09:07.348 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-17T04:09:07.389 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-17T04:09:07.425 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-17T04:09:07.498 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-17T04:09:07.541 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-17T04:09:07.582 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-17T04:09:07.674 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-17T04:09:07.752 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-17T04:09:07.793 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-17T04:09:07.828 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-17T04:09:07.858 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-17T04:09:07.892 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-17T04:09:07.926 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-17T04:09:07.975 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-17T04:09:08.035 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-17T04:09:08.069 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-17T04:09:08.117 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-17T04:09:08.150 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-17T04:09:08.223 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-17T04:09:08.361 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-17T04:09:08.456 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-17T04:09:08.518 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-17T04:09:08.556 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-17T04:09:08.613 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-17T04:09:08.669 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-17T04:09:08.855 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-17T04:09:08.902 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-17T04:09:08.981 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-17T04:09:09.069 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-17T04:09:09.109 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-17T04:09:09.150 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-test-2:19.2.0-0.el9.x86_64 4/4 2024-09-17T04:09:09.150 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-test-2:19.2.0-0.el9.x86_64 1/4 2024-09-17T04:09:09.150 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephsqlite-2:19.2.0-0.el9.x86_64 2/4 2024-09-17T04:09:09.151 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-17T04:09:09.233 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-17T04:09:09.398 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-modules-core-2:19.2.0-0.el9.noarch 32/37 2024-09-17T04:09:09.428 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-2:19.2.0-0.el9.x86_64 33/37 2024-09-17T04:09:09.454 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-17T04:09:09.454 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:09:09.454 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2024-09-17T04:09:09.454 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-test-2:19.2.0-0.el9.x86_64 libcephsqlite-2:19.2.0-0.el9.x86_64 2024-09-17T04:09:09.455 INFO:teuthology.orchestra.run.smithi088.stdout: socat-1.7.4.1-6.el9.x86_64 xmlstarlet-1.6.1-20.el9.x86_64 2024-09-17T04:09:09.455 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:09:09.455 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-09-17T04:09:09.455 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-2:19.2.0-0.el9.x86_64 33/37 2024-09-17T04:09:09.456 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:09:09.456 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-17T04:09:09.456 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T04:09:09.456 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T04:09:09.456 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:09:09.723 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph 2024-09-17T04:09:10.304 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Sep 2024 04:08:33 AM UTC. 2024-09-17T04:09:10.440 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-09-17T04:09:10.443 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-17T04:09:10.443 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2024-09-17T04:09:10.443 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-17T04:09:10.443 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2024-09-17T04:09:10.443 INFO:teuthology.orchestra.run.smithi088.stdout: ceph x86_64 2:19.2.0-0.el9 ceph 6.5 k 2024-09-17T04:09:10.443 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2024-09-17T04:09:10.443 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mds x86_64 2:19.2.0-0.el9 ceph 2.4 M 2024-09-17T04:09:10.443 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr x86_64 2:19.2.0-0.el9 ceph 1.5 M 2024-09-17T04:09:10.443 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-modules-core noarch 2:19.2.0-0.el9 ceph-noarch 249 k 2024-09-17T04:09:10.443 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mon x86_64 2:19.2.0-0.el9 ceph 4.7 M 2024-09-17T04:09:10.444 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-osd x86_64 2:19.2.0-0.el9 ceph 17 M 2024-09-17T04:09:10.444 INFO:teuthology.orchestra.run.smithi088.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-17T04:09:10.444 INFO:teuthology.orchestra.run.smithi088.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-17T04:09:10.444 INFO:teuthology.orchestra.run.smithi088.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-17T04:09:10.444 INFO:teuthology.orchestra.run.smithi088.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-17T04:09:10.444 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-17T04:09:10.444 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-17T04:09:10.444 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-17T04:09:10.444 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-17T04:09:10.444 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-17T04:09:10.444 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-17T04:09:10.444 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-17T04:09:10.444 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-17T04:09:10.444 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-17T04:09:10.444 INFO:teuthology.orchestra.run.smithi088.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-17T04:09:10.445 INFO:teuthology.orchestra.run.smithi088.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-17T04:09:10.445 INFO:teuthology.orchestra.run.smithi088.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-17T04:09:10.445 INFO:teuthology.orchestra.run.smithi088.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-17T04:09:10.445 INFO:teuthology.orchestra.run.smithi088.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-17T04:09:10.445 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-17T04:09:10.445 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-17T04:09:10.445 INFO:teuthology.orchestra.run.smithi088.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-17T04:09:10.445 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-17T04:09:10.445 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-17T04:09:10.445 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-17T04:09:10.445 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-17T04:09:10.445 INFO:teuthology.orchestra.run.smithi088.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-17T04:09:10.445 INFO:teuthology.orchestra.run.smithi088.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-17T04:09:10.445 INFO:teuthology.orchestra.run.smithi088.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-17T04:09:10.446 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-17T04:09:10.446 INFO:teuthology.orchestra.run.smithi088.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-17T04:09:10.446 INFO:teuthology.orchestra.run.smithi088.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-17T04:09:10.446 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:09:10.446 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2024-09-17T04:09:10.446 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-17T04:09:10.446 INFO:teuthology.orchestra.run.smithi088.stdout:Install 37 Packages 2024-09-17T04:09:10.446 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:09:10.446 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 30 M 2024-09-17T04:09:10.447 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 108 M 2024-09-17T04:09:10.447 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2024-09-17T04:09:10.660 INFO:teuthology.orchestra.run.smithi088.stdout:(1/37): ceph-19.2.0-0.el9.x86_64.rpm 113 kB/s | 6.5 kB 00:00 2024-09-17T04:09:10.707 INFO:teuthology.orchestra.run.smithi088.stdout:(2/37): ceph-mgr-19.2.0-0.el9.x86_64.rpm 15 MB/s | 1.5 MB 00:00 2024-09-17T04:09:10.757 INFO:teuthology.orchestra.run.smithi088.stdout:(3/37): ceph-mds-19.2.0-0.el9.x86_64.rpm 15 MB/s | 2.4 MB 00:00 2024-09-17T04:09:10.782 INFO:teuthology.orchestra.run.smithi088.stdout:(4/37): ceph-mgr-modules-core-19.2.0-0.el9.noar 9.8 MB/s | 249 kB 00:00 2024-09-17T04:09:10.857 INFO:teuthology.orchestra.run.smithi088.stdout:(5/37): ceph-mon-19.2.0-0.el9.x86_64.rpm 24 MB/s | 4.7 MB 00:00 2024-09-17T04:09:10.912 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-osd-2:19.2.0-0.el9.x86_64 34/37 2024-09-17T04:09:10.939 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-osd-2:19.2.0-0.el9.x86_64 34/37 2024-09-17T04:09:10.939 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:09:10.939 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-17T04:09:10.939 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T04:09:10.939 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T04:09:10.939 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:09:11.066 INFO:teuthology.orchestra.run.smithi088.stdout:(6/37): ceph-osd-19.2.0-0.el9.x86_64.rpm 47 MB/s | 17 MB 00:00 2024-09-17T04:09:11.175 INFO:teuthology.orchestra.run.smithi088.stdout:(7/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 645 kB/s | 253 kB 00:00 2024-09-17T04:09:11.228 INFO:teuthology.orchestra.run.smithi088.stdout:(8/37): python3-ply-3.11-14.el9.noarch.rpm 658 kB/s | 106 kB 00:00 2024-09-17T04:09:11.253 INFO:teuthology.orchestra.run.smithi088.stdout:(9/37): python3-pycparser-2.20-6.el9.noarch.rpm 1.7 MB/s | 135 kB 00:00 2024-09-17T04:09:11.304 INFO:teuthology.orchestra.run.smithi088.stdout:(10/37): python3-requests-2.25.1-8.el9.noarch.r 1.6 MB/s | 125 kB 00:00 2024-09-17T04:09:11.329 INFO:teuthology.orchestra.run.smithi088.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 2.8 MB/s | 215 kB 00:00 2024-09-17T04:09:11.362 INFO:teuthology.orchestra.run.smithi088.stdout:(12/37): python3-cryptography-36.0.1-4.el9.x86_ 2.4 MB/s | 1.2 MB 00:00 2024-09-17T04:09:11.379 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mon-2:19.2.0-0.el9.x86_64 35/37 2024-09-17T04:09:11.403 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mon-2:19.2.0-0.el9.x86_64 35/37 2024-09-17T04:09:11.403 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:09:11.403 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-17T04:09:11.403 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T04:09:11.403 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T04:09:11.403 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:09:11.446 INFO:teuthology.orchestra.run.smithi088.stdout:(13/37): lua-5.4.4-4.el9.x86_64.rpm 1.3 MB/s | 188 kB 00:00 2024-09-17T04:09:11.471 INFO:teuthology.orchestra.run.smithi088.stdout:(14/37): python3-markupsafe-1.1.1-12.el9.x86_64 320 kB/s | 35 kB 00:00 2024-09-17T04:09:11.496 INFO:teuthology.orchestra.run.smithi088.stdout:(15/37): python3-packaging-20.9-5.el9.noarch.rp 1.5 MB/s | 77 kB 00:00 2024-09-17T04:09:11.522 INFO:teuthology.orchestra.run.smithi088.stdout:(16/37): python3-mako-1.1.4-6.el9.noarch.rpm 893 kB/s | 172 kB 00:00 2024-09-17T04:09:11.547 INFO:teuthology.orchestra.run.smithi088.stdout:(17/37): python3-pytz-2021.1-5.el9.noarch.rpm 675 kB/s | 51 kB 00:00 2024-09-17T04:09:11.572 INFO:teuthology.orchestra.run.smithi088.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 551 kB/s | 42 kB 00:00 2024-09-17T04:09:11.631 INFO:teuthology.orchestra.run.smithi088.stdout:(19/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 741 kB/s | 43 kB 00:00 2024-09-17T04:09:11.640 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mds-2:19.2.0-0.el9.x86_64 36/37 2024-09-17T04:09:11.656 INFO:teuthology.orchestra.run.smithi088.stdout:(20/37): lua-devel-5.4.4-4.el9.x86_64.rpm 166 kB/s | 22 kB 00:00 2024-09-17T04:09:11.664 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mds-2:19.2.0-0.el9.x86_64 36/37 2024-09-17T04:09:11.664 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:09:11.664 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-17T04:09:11.664 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T04:09:11.664 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T04:09:11.664 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:09:11.690 INFO:teuthology.orchestra.run.smithi088.stdout:(21/37): luarocks-3.9.2-5.el9.noarch.rpm 1.0 MB/s | 151 kB 00:00 2024-09-17T04:09:11.724 INFO:teuthology.orchestra.run.smithi088.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 404 kB/s | 11 kB 00:00 2024-09-17T04:09:11.728 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-2:19.2.0-0.el9.x86_64 37/37 2024-09-17T04:09:11.749 INFO:teuthology.orchestra.run.smithi088.stdout:(23/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-09-17T04:09:11.774 INFO:teuthology.orchestra.run.smithi088.stdout:(24/37): python3-jaraco-classes-3.2.1-5.el9.noa 364 kB/s | 18 kB 00:00 2024-09-17T04:09:11.799 INFO:teuthology.orchestra.run.smithi088.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 461 kB/s | 23 kB 00:00 2024-09-17T04:09:11.825 INFO:teuthology.orchestra.run.smithi088.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 386 kB/s | 19 kB 00:00 2024-09-17T04:09:11.850 INFO:teuthology.orchestra.run.smithi088.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 391 kB/s | 20 kB 00:00 2024-09-17T04:09:11.875 INFO:teuthology.orchestra.run.smithi088.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 923 kB/s | 46 kB 00:00 2024-09-17T04:09:11.909 INFO:teuthology.orchestra.run.smithi088.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.3 MB/s | 79 kB 00:00 2024-09-17T04:09:11.934 INFO:teuthology.orchestra.run.smithi088.stdout:(30/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.3 MB/s | 358 kB 00:00 2024-09-17T04:09:11.959 INFO:teuthology.orchestra.run.smithi088.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 328 kB/s | 16 kB 00:00 2024-09-17T04:09:11.985 INFO:teuthology.orchestra.run.smithi088.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.7 MB/s | 90 kB 00:00 2024-09-17T04:09:12.010 INFO:teuthology.orchestra.run.smithi088.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 711 kB/s | 36 kB 00:00 2024-09-17T04:09:12.035 INFO:teuthology.orchestra.run.smithi088.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2024-09-17T04:09:12.060 INFO:teuthology.orchestra.run.smithi088.stdout:(35/37): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-17T04:09:12.086 INFO:teuthology.orchestra.run.smithi088.stdout:(36/37): python3-zc-lockfile-2.0-10.el9.noarch. 398 kB/s | 20 kB 00:00 2024-09-17T04:09:12.111 INFO:teuthology.orchestra.run.smithi088.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2024-09-17T04:09:12.114 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2024-09-17T04:09:12.114 INFO:teuthology.orchestra.run.smithi088.stdout:Total 18 MB/s | 30 MB 00:01 2024-09-17T04:09:12.261 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2024-09-17T04:09:12.300 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2024-09-17T04:09:12.300 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2024-09-17T04:09:12.799 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2024-09-17T04:09:12.799 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2024-09-17T04:09:13.578 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-2:19.2.0-0.el9.x86_64 37/37 2024-09-17T04:09:13.578 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-2:19.2.0-0.el9.x86_64 1/37 2024-09-17T04:09:13.578 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mds-2:19.2.0-0.el9.x86_64 2/37 2024-09-17T04:09:13.578 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-2:19.2.0-0.el9.x86_64 3/37 2024-09-17T04:09:13.578 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mon-2:19.2.0-0.el9.x86_64 4/37 2024-09-17T04:09:13.578 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-osd-2:19.2.0-0.el9.x86_64 5/37 2024-09-17T04:09:13.578 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-modules-core-2:19.2.0-0.el9.noarch 6/37 2024-09-17T04:09:13.578 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-17T04:09:13.578 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-17T04:09:13.579 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-17T04:09:13.579 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-17T04:09:13.579 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-17T04:09:13.579 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-17T04:09:13.579 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-17T04:09:13.579 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-17T04:09:13.579 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-17T04:09:13.579 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-17T04:09:13.579 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-17T04:09:13.579 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-17T04:09:13.579 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-17T04:09:13.579 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-17T04:09:13.579 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-17T04:09:13.579 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-17T04:09:13.579 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-17T04:09:13.579 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-17T04:09:13.580 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-17T04:09:13.581 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-17T04:09:13.581 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-17T04:09:13.581 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-17T04:09:13.581 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-17T04:09:13.581 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-17T04:09:13.581 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-17T04:09:13.581 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-17T04:09:13.581 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-17T04:09:13.581 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-17T04:09:13.582 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-17T04:09:13.582 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-17T04:09:14.203 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2024-09-17T04:09:14.264 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-17T04:09:14.307 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-17T04:09:14.341 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-17T04:09:14.413 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-17T04:09:14.448 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-17T04:09:14.481 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-17T04:09:14.573 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-17T04:09:14.652 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-17T04:09:14.693 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-17T04:09:14.701 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-17T04:09:14.701 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:09:14.701 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-17T04:09:14.701 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-2:19.2.0-0.el9.x86_64 2024-09-17T04:09:14.701 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds-2:19.2.0-0.el9.x86_64 2024-09-17T04:09:14.701 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-2:19.2.0-0.el9.x86_64 2024-09-17T04:09:14.702 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core-2:19.2.0-0.el9.noarch 2024-09-17T04:09:14.702 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon-2:19.2.0-0.el9.x86_64 2024-09-17T04:09:14.702 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd-2:19.2.0-0.el9.x86_64 2024-09-17T04:09:14.702 INFO:teuthology.orchestra.run.smithi134.stdout: lua-5.4.4-4.el9.x86_64 2024-09-17T04:09:14.702 INFO:teuthology.orchestra.run.smithi134.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-17T04:09:14.702 INFO:teuthology.orchestra.run.smithi134.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-17T04:09:14.702 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-17T04:09:14.702 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-17T04:09:14.702 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-17T04:09:14.702 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-17T04:09:14.702 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-17T04:09:14.702 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-17T04:09:14.702 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-17T04:09:14.703 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-17T04:09:14.703 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-17T04:09:14.703 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-17T04:09:14.703 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-17T04:09:14.703 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-17T04:09:14.703 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-17T04:09:14.703 INFO:teuthology.orchestra.run.smithi134.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-17T04:09:14.703 INFO:teuthology.orchestra.run.smithi134.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-17T04:09:14.703 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-17T04:09:14.703 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ply-3.11-14.el9.noarch 2024-09-17T04:09:14.703 INFO:teuthology.orchestra.run.smithi134.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-17T04:09:14.703 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-17T04:09:14.703 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-17T04:09:14.704 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-17T04:09:14.704 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-17T04:09:14.704 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-17T04:09:14.704 INFO:teuthology.orchestra.run.smithi134.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-17T04:09:14.704 INFO:teuthology.orchestra.run.smithi134.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-17T04:09:14.704 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-17T04:09:14.704 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-17T04:09:14.704 INFO:teuthology.orchestra.run.smithi134.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-17T04:09:14.704 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:09:14.704 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-17T04:09:14.727 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-17T04:09:14.749 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-17T04:09:14.783 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-17T04:09:14.816 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-17T04:09:14.857 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-17T04:09:14.900 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-17T04:09:14.935 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-17T04:09:14.992 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-17T04:09:15.024 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-17T04:09:15.037 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-base 2024-09-17T04:09:15.097 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-17T04:09:15.244 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-17T04:09:15.324 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-17T04:09:15.377 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-17T04:09:15.415 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-17T04:09:15.472 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-17T04:09:15.527 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-17T04:09:15.622 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:00:53 ago on Tue 17 Sep 2024 04:08:22 AM UTC. 2024-09-17T04:09:15.712 INFO:teuthology.orchestra.run.smithi134.stdout:Package ceph-base-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-17T04:09:15.723 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-17T04:09:15.754 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-17T04:09:15.755 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-09-17T04:09:15.755 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-17T04:09:15.777 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-17T04:09:15.839 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install cephadm 2024-09-17T04:09:15.858 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-17T04:09:15.955 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-17T04:09:15.995 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-17T04:09:16.113 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-17T04:09:16.268 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-modules-core-2:19.2.0-0.el9.noarch 32/37 2024-09-17T04:09:16.297 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-2:19.2.0-0.el9.x86_64 33/37 2024-09-17T04:09:16.323 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-2:19.2.0-0.el9.x86_64 33/37 2024-09-17T04:09:16.324 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:09:16.324 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-17T04:09:16.324 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T04:09:16.324 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T04:09:16.324 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:09:16.416 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:00:54 ago on Tue 17 Sep 2024 04:08:22 AM UTC. 2024-09-17T04:09:16.546 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-17T04:09:16.547 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-17T04:09:16.547 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2024-09-17T04:09:16.547 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-17T04:09:16.547 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-17T04:09:16.547 INFO:teuthology.orchestra.run.smithi134.stdout: cephadm noarch 2:19.2.0-0.el9 ceph-noarch 765 k 2024-09-17T04:09:16.547 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:09:16.547 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-17T04:09:16.547 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-17T04:09:16.547 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-09-17T04:09:16.547 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:09:16.548 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 765 k 2024-09-17T04:09:16.548 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 771 k 2024-09-17T04:09:16.548 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-17T04:09:16.605 INFO:teuthology.orchestra.run.smithi134.stdout:cephadm-19.2.0-0.el9.noarch.rpm 13 MB/s | 765 kB 00:00 2024-09-17T04:09:16.606 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-17T04:09:16.606 INFO:teuthology.orchestra.run.smithi134.stdout:Total 13 MB/s | 765 kB 00:00 2024-09-17T04:09:16.606 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-17T04:09:16.611 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-17T04:09:16.611 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-17T04:09:16.617 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-17T04:09:16.617 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-17T04:09:16.686 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-17T04:09:17.083 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cephadm-2:19.2.0-0.el9.noarch 1/1 2024-09-17T04:09:17.176 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephadm-2:19.2.0-0.el9.noarch 1/1 2024-09-17T04:09:17.541 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cephadm-2:19.2.0-0.el9.noarch 1/1 2024-09-17T04:09:17.773 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-osd-2:19.2.0-0.el9.x86_64 34/37 2024-09-17T04:09:17.801 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-osd-2:19.2.0-0.el9.x86_64 34/37 2024-09-17T04:09:17.801 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:09:17.801 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-17T04:09:17.801 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T04:09:17.801 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T04:09:17.801 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:09:17.807 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephadm-2:19.2.0-0.el9.noarch 1/1 2024-09-17T04:09:17.807 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:09:17.808 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-17T04:09:17.808 INFO:teuthology.orchestra.run.smithi134.stdout: cephadm-2:19.2.0-0.el9.noarch 2024-09-17T04:09:17.808 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:09:17.808 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-17T04:09:18.037 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-immutable-object-cache 2024-09-17T04:09:18.240 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mon-2:19.2.0-0.el9.x86_64 35/37 2024-09-17T04:09:18.264 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mon-2:19.2.0-0.el9.x86_64 35/37 2024-09-17T04:09:18.264 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:09:18.264 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-17T04:09:18.264 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T04:09:18.264 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T04:09:18.264 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:09:18.499 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mds-2:19.2.0-0.el9.x86_64 36/37 2024-09-17T04:09:18.523 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mds-2:19.2.0-0.el9.x86_64 36/37 2024-09-17T04:09:18.523 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:09:18.523 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-17T04:09:18.523 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T04:09:18.523 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T04:09:18.523 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:09:18.587 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-2:19.2.0-0.el9.x86_64 37/37 2024-09-17T04:09:18.633 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:00:56 ago on Tue 17 Sep 2024 04:08:22 AM UTC. 2024-09-17T04:09:18.769 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-17T04:09:18.770 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-17T04:09:18.770 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repo Size 2024-09-17T04:09:18.770 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-17T04:09:18.770 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-17T04:09:18.770 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-immutable-object-cache x86_64 2:19.2.0-0.el9 ceph 145 k 2024-09-17T04:09:18.770 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:09:18.770 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-17T04:09:18.771 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-17T04:09:18.771 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-09-17T04:09:18.771 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:09:18.771 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 145 k 2024-09-17T04:09:18.771 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 435 k 2024-09-17T04:09:18.771 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-17T04:09:18.829 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-immutable-object-cache-19.2.0-0.el9.x86_64 2.4 MB/s | 145 kB 00:00 2024-09-17T04:09:18.830 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-17T04:09:18.830 INFO:teuthology.orchestra.run.smithi134.stdout:Total 2.4 MB/s | 145 kB 00:00 2024-09-17T04:09:18.830 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-17T04:09:18.838 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-17T04:09:18.838 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-17T04:09:18.895 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-17T04:09:18.896 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-17T04:09:19.049 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-17T04:09:19.128 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-immutable-object-cache-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T04:09:19.154 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T04:09:19.154 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:09:19.154 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-17T04:09:19.154 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:09:20.083 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-immutable-object-cache-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T04:09:20.083 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:09:20.083 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-17T04:09:20.083 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-immutable-object-cache-2:19.2.0-0.el9.x86_64 2024-09-17T04:09:20.083 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:09:20.084 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-17T04:09:20.261 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-2:19.2.0-0.el9.x86_64 37/37 2024-09-17T04:09:20.261 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-2:19.2.0-0.el9.x86_64 1/37 2024-09-17T04:09:20.261 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mds-2:19.2.0-0.el9.x86_64 2/37 2024-09-17T04:09:20.261 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-2:19.2.0-0.el9.x86_64 3/37 2024-09-17T04:09:20.261 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mon-2:19.2.0-0.el9.x86_64 4/37 2024-09-17T04:09:20.261 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-osd-2:19.2.0-0.el9.x86_64 5/37 2024-09-17T04:09:20.261 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-modules-core-2:19.2.0-0.el9.noarch 6/37 2024-09-17T04:09:20.261 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-17T04:09:20.261 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-17T04:09:20.262 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-17T04:09:20.262 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-17T04:09:20.262 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-17T04:09:20.262 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-17T04:09:20.262 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-17T04:09:20.262 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-17T04:09:20.262 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-17T04:09:20.262 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-17T04:09:20.262 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-17T04:09:20.262 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-17T04:09:20.262 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-17T04:09:20.262 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-17T04:09:20.262 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-17T04:09:20.263 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-17T04:09:20.263 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-17T04:09:20.263 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-17T04:09:20.263 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-17T04:09:20.263 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-17T04:09:20.263 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-17T04:09:20.263 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-17T04:09:20.263 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-17T04:09:20.263 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-17T04:09:20.263 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-17T04:09:20.263 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-17T04:09:20.263 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-17T04:09:20.263 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-17T04:09:20.263 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-17T04:09:20.264 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-17T04:09:20.356 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr 2024-09-17T04:09:20.942 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:00:58 ago on Tue 17 Sep 2024 04:08:22 AM UTC. 2024-09-17T04:09:21.036 INFO:teuthology.orchestra.run.smithi134.stdout:Package ceph-mgr-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-17T04:09:21.079 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-17T04:09:21.080 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-09-17T04:09:21.080 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-17T04:09:21.134 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-17T04:09:21.134 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:09:21.134 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2024-09-17T04:09:21.134 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-2:19.2.0-0.el9.x86_64 2024-09-17T04:09:21.134 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mds-2:19.2.0-0.el9.x86_64 2024-09-17T04:09:21.135 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-2:19.2.0-0.el9.x86_64 2024-09-17T04:09:21.135 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-modules-core-2:19.2.0-0.el9.noarch 2024-09-17T04:09:21.135 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mon-2:19.2.0-0.el9.x86_64 2024-09-17T04:09:21.135 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-osd-2:19.2.0-0.el9.x86_64 2024-09-17T04:09:21.135 INFO:teuthology.orchestra.run.smithi088.stdout: lua-5.4.4-4.el9.x86_64 2024-09-17T04:09:21.135 INFO:teuthology.orchestra.run.smithi088.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-17T04:09:21.135 INFO:teuthology.orchestra.run.smithi088.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-17T04:09:21.135 INFO:teuthology.orchestra.run.smithi088.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-17T04:09:21.135 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-17T04:09:21.135 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-17T04:09:21.135 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-17T04:09:21.135 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-17T04:09:21.135 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-17T04:09:21.135 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-17T04:09:21.136 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-17T04:09:21.136 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-17T04:09:21.136 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-17T04:09:21.136 INFO:teuthology.orchestra.run.smithi088.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-17T04:09:21.136 INFO:teuthology.orchestra.run.smithi088.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-17T04:09:21.136 INFO:teuthology.orchestra.run.smithi088.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-17T04:09:21.136 INFO:teuthology.orchestra.run.smithi088.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-17T04:09:21.136 INFO:teuthology.orchestra.run.smithi088.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-17T04:09:21.137 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-17T04:09:21.137 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ply-3.11-14.el9.noarch 2024-09-17T04:09:21.137 INFO:teuthology.orchestra.run.smithi088.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-17T04:09:21.137 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-17T04:09:21.137 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-17T04:09:21.137 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-17T04:09:21.138 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-17T04:09:21.138 INFO:teuthology.orchestra.run.smithi088.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-17T04:09:21.138 INFO:teuthology.orchestra.run.smithi088.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-17T04:09:21.138 INFO:teuthology.orchestra.run.smithi088.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-17T04:09:21.138 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-17T04:09:21.138 INFO:teuthology.orchestra.run.smithi088.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-17T04:09:21.139 INFO:teuthology.orchestra.run.smithi088.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-17T04:09:21.139 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:09:21.139 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-09-17T04:09:21.162 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr-dashboard 2024-09-17T04:09:21.488 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-base 2024-09-17T04:09:21.734 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:00:59 ago on Tue 17 Sep 2024 04:08:22 AM UTC. 2024-09-17T04:09:21.865 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-17T04:09:21.866 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-17T04:09:21.866 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-09-17T04:09:21.867 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-17T04:09:21.867 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-17T04:09:21.867 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard noarch 2:19.2.0-0.el9 ceph-noarch 3.6 M 2024-09-17T04:09:21.867 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-09-17T04:09:21.867 INFO:teuthology.orchestra.run.smithi134.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-17T04:09:21.867 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards noarch 2:19.2.0-0.el9 ceph-noarch 32 k 2024-09-17T04:09:21.867 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-prometheus-alerts noarch 2:19.2.0-0.el9 ceph-noarch 16 k 2024-09-17T04:09:21.867 INFO:teuthology.orchestra.run.smithi134.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-17T04:09:21.867 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-17T04:09:21.868 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-17T04:09:21.868 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-17T04:09:21.868 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-17T04:09:21.868 INFO:teuthology.orchestra.run.smithi134.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-17T04:09:21.868 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-17T04:09:21.868 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-17T04:09:21.868 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:09:21.868 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-17T04:09:21.868 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-17T04:09:21.868 INFO:teuthology.orchestra.run.smithi134.stdout:Install 12 Packages 2024-09-17T04:09:21.869 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:09:21.869 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 8.7 M 2024-09-17T04:09:21.869 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 104 M 2024-09-17T04:09:21.869 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-17T04:09:22.076 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:00:49 ago on Tue 17 Sep 2024 04:08:33 AM UTC. 2024-09-17T04:09:22.166 INFO:teuthology.orchestra.run.smithi088.stdout:Package ceph-base-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-17T04:09:22.208 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-09-17T04:09:22.209 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2024-09-17T04:09:22.209 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-09-17T04:09:22.284 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install cephadm 2024-09-17T04:09:22.364 INFO:teuthology.orchestra.run.smithi134.stdout:(1/12): ceph-grafana-dashboards-19.2.0-0.el9.no 631 kB/s | 32 kB 00:00 2024-09-17T04:09:22.389 INFO:teuthology.orchestra.run.smithi134.stdout:(2/12): ceph-prometheus-alerts-19.2.0-0.el9.noa 217 kB/s | 16 kB 00:00 2024-09-17T04:09:22.464 INFO:teuthology.orchestra.run.smithi134.stdout:(3/12): ceph-mgr-dashboard-19.2.0-0.el9.noarch. 24 MB/s | 3.6 MB 00:00 2024-09-17T04:09:22.590 INFO:teuthology.orchestra.run.smithi134.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.3 MB/s | 269 kB 00:00 2024-09-17T04:09:22.640 INFO:teuthology.orchestra.run.smithi134.stdout:(5/12): protobuf-3.14.0-13.el9.x86_64.rpm 3.7 MB/s | 1.0 MB 00:00 2024-09-17T04:09:22.682 INFO:teuthology.orchestra.run.smithi134.stdout:(6/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 5.8 MB/s | 548 kB 00:00 2024-09-17T04:09:22.707 INFO:teuthology.orchestra.run.smithi134.stdout:(7/12): grpc-data-1.46.7-10.el9.noarch.rpm 291 kB/s | 19 kB 00:00 2024-09-17T04:09:22.749 INFO:teuthology.orchestra.run.smithi134.stdout:(8/12): protobuf-compiler-3.14.0-13.el9.x86_64. 3.0 MB/s | 863 kB 00:00 2024-09-17T04:09:22.783 INFO:teuthology.orchestra.run.smithi134.stdout:(9/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 1.9 MB/s | 144 kB 00:00 2024-09-17T04:09:22.808 INFO:teuthology.orchestra.run.smithi134.stdout:(10/12): python3-repoze-lru-0.7-16.el9.noarch.r 526 kB/s | 31 kB 00:00 2024-09-17T04:09:22.833 INFO:teuthology.orchestra.run.smithi134.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 3.8 MB/s | 188 kB 00:00 2024-09-17T04:09:22.862 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:00:49 ago on Tue 17 Sep 2024 04:08:33 AM UTC. 2024-09-17T04:09:22.891 INFO:teuthology.orchestra.run.smithi134.stdout:(12/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 9.8 MB/s | 2.0 MB 00:00 2024-09-17T04:09:22.895 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-17T04:09:22.895 INFO:teuthology.orchestra.run.smithi134.stdout:Total 8.4 MB/s | 8.7 MB 00:01 2024-09-17T04:09:22.943 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-17T04:09:22.960 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-17T04:09:22.960 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-17T04:09:22.991 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-09-17T04:09:22.992 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-17T04:09:22.992 INFO:teuthology.orchestra.run.smithi088.stdout: Package Architecture Version Repository Size 2024-09-17T04:09:22.992 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-17T04:09:22.992 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2024-09-17T04:09:22.992 INFO:teuthology.orchestra.run.smithi088.stdout: cephadm noarch 2:19.2.0-0.el9 ceph-noarch 765 k 2024-09-17T04:09:22.992 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:09:22.992 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2024-09-17T04:09:22.992 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-17T04:09:22.993 INFO:teuthology.orchestra.run.smithi088.stdout:Install 1 Package 2024-09-17T04:09:22.993 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:09:22.993 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 765 k 2024-09-17T04:09:22.993 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 771 k 2024-09-17T04:09:22.993 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2024-09-17T04:09:23.049 INFO:teuthology.orchestra.run.smithi088.stdout:cephadm-19.2.0-0.el9.noarch.rpm 14 MB/s | 765 kB 00:00 2024-09-17T04:09:23.049 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2024-09-17T04:09:23.050 INFO:teuthology.orchestra.run.smithi088.stdout:Total 13 MB/s | 765 kB 00:00 2024-09-17T04:09:23.050 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2024-09-17T04:09:23.055 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2024-09-17T04:09:23.055 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2024-09-17T04:09:23.061 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2024-09-17T04:09:23.061 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2024-09-17T04:09:23.136 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2024-09-17T04:09:23.162 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-17T04:09:23.163 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-17T04:09:23.552 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: cephadm-2:19.2.0-0.el9.noarch 1/1 2024-09-17T04:09:23.644 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : cephadm-2:19.2.0-0.el9.noarch 1/1 2024-09-17T04:09:23.714 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-17T04:09:23.793 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-17T04:09:23.827 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-17T04:09:23.874 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-17T04:09:23.913 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-17T04:09:24.011 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: cephadm-2:19.2.0-0.el9.noarch 1/1 2024-09-17T04:09:24.020 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-17T04:09:24.152 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-17T04:09:24.249 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-17T04:09:24.266 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : cephadm-2:19.2.0-0.el9.noarch 1/1 2024-09-17T04:09:24.266 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:09:24.266 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2024-09-17T04:09:24.266 INFO:teuthology.orchestra.run.smithi088.stdout: cephadm-2:19.2.0-0.el9.noarch 2024-09-17T04:09:24.266 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:09:24.266 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-09-17T04:09:24.292 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-17T04:09:24.321 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-17T04:09:24.352 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-prometheus-alerts-2:19.2.0-0.el9.noarch 10/12 2024-09-17T04:09:24.467 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-immutable-object-cache 2024-09-17T04:09:25.057 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:00:52 ago on Tue 17 Sep 2024 04:08:33 AM UTC. 2024-09-17T04:09:25.191 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-09-17T04:09:25.192 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-17T04:09:25.192 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repo Size 2024-09-17T04:09:25.192 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-17T04:09:25.192 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2024-09-17T04:09:25.192 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-immutable-object-cache x86_64 2:19.2.0-0.el9 ceph 145 k 2024-09-17T04:09:25.192 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:09:25.192 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2024-09-17T04:09:25.192 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-17T04:09:25.193 INFO:teuthology.orchestra.run.smithi088.stdout:Install 1 Package 2024-09-17T04:09:25.193 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:09:25.193 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 145 k 2024-09-17T04:09:25.193 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 435 k 2024-09-17T04:09:25.193 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2024-09-17T04:09:25.263 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-immutable-object-cache-19.2.0-0.el9.x86_64 2.0 MB/s | 145 kB 00:00 2024-09-17T04:09:25.263 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2024-09-17T04:09:25.263 INFO:teuthology.orchestra.run.smithi088.stdout:Total 2.0 MB/s | 145 kB 00:00 2024-09-17T04:09:25.264 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2024-09-17T04:09:25.271 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2024-09-17T04:09:25.271 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2024-09-17T04:09:25.331 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2024-09-17T04:09:25.331 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2024-09-17T04:09:25.411 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-grafana-dashboards-2:19.2.0-0.el9.noarch 11/12 2024-09-17T04:09:25.453 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-dashboard-2:19.2.0-0.el9.noarch 12/12 2024-09-17T04:09:25.480 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2024-09-17T04:09:25.564 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-immutable-object-cache-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T04:09:25.589 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T04:09:25.589 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:09:25.589 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-17T04:09:25.589 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:09:26.488 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-immutable-object-cache-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T04:09:26.488 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:09:26.488 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2024-09-17T04:09:26.488 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-immutable-object-cache-2:19.2.0-0.el9.x86_64 2024-09-17T04:09:26.488 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:09:26.488 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-09-17T04:09:26.716 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-mgr 2024-09-17T04:09:26.846 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.0-0.el9.noarch 12/12 2024-09-17T04:09:26.846 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-grafana-dashboards-2:19.2.0-0.el9.noarch 1/12 2024-09-17T04:09:26.846 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-dashboard-2:19.2.0-0.el9.noarch 2/12 2024-09-17T04:09:26.846 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-prometheus-alerts-2:19.2.0-0.el9.noarch 3/12 2024-09-17T04:09:26.846 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-17T04:09:26.846 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-17T04:09:26.846 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-17T04:09:26.847 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-17T04:09:26.847 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-17T04:09:26.847 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-17T04:09:26.847 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-17T04:09:26.847 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-17T04:09:27.173 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-17T04:09:27.173 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:09:27.173 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-17T04:09:27.173 INFO:teuthology.orchestra.run.smithi134.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-17T04:09:27.173 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards-2:19.2.0-0.el9.noarch 2024-09-17T04:09:27.173 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard-2:19.2.0-0.el9.noarch 2024-09-17T04:09:27.173 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-prometheus-alerts-2:19.2.0-0.el9.noarch 2024-09-17T04:09:27.174 INFO:teuthology.orchestra.run.smithi134.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-17T04:09:27.174 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-17T04:09:27.174 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-17T04:09:27.174 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-17T04:09:27.174 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-17T04:09:27.174 INFO:teuthology.orchestra.run.smithi134.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-17T04:09:27.174 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-17T04:09:27.174 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-17T04:09:27.174 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:09:27.174 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-17T04:09:27.308 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:00:54 ago on Tue 17 Sep 2024 04:08:33 AM UTC. 2024-09-17T04:09:27.398 INFO:teuthology.orchestra.run.smithi088.stdout:Package ceph-mgr-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-17T04:09:27.428 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-17T04:09:27.442 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-09-17T04:09:27.443 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2024-09-17T04:09:27.443 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-09-17T04:09:27.516 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-mgr-dashboard 2024-09-17T04:09:28.013 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:06 ago on Tue 17 Sep 2024 04:08:22 AM UTC. 2024-09-17T04:09:28.087 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:00:55 ago on Tue 17 Sep 2024 04:08:33 AM UTC. 2024-09-17T04:09:28.147 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-17T04:09:28.148 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-17T04:09:28.149 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-09-17T04:09:28.149 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-17T04:09:28.149 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-17T04:09:28.149 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.0-0.el9 ceph-noarch 7.4 M 2024-09-17T04:09:28.149 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-09-17T04:09:28.149 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-17T04:09:28.149 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-17T04:09:28.149 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-17T04:09:28.149 INFO:teuthology.orchestra.run.smithi134.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-17T04:09:28.149 INFO:teuthology.orchestra.run.smithi134.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-17T04:09:28.149 INFO:teuthology.orchestra.run.smithi134.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-17T04:09:28.149 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-17T04:09:28.149 INFO:teuthology.orchestra.run.smithi134.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-17T04:09:28.150 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-17T04:09:28.150 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-17T04:09:28.150 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-17T04:09:28.150 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:09:28.150 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-17T04:09:28.150 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-17T04:09:28.150 INFO:teuthology.orchestra.run.smithi134.stdout:Install 12 Packages 2024-09-17T04:09:28.150 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:09:28.151 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 38 M 2024-09-17T04:09:28.151 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 212 M 2024-09-17T04:09:28.151 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-17T04:09:28.217 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-09-17T04:09:28.218 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-17T04:09:28.219 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2024-09-17T04:09:28.219 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-17T04:09:28.219 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2024-09-17T04:09:28.219 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-dashboard noarch 2:19.2.0-0.el9 ceph-noarch 3.6 M 2024-09-17T04:09:28.219 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2024-09-17T04:09:28.219 INFO:teuthology.orchestra.run.smithi088.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-17T04:09:28.219 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-grafana-dashboards noarch 2:19.2.0-0.el9 ceph-noarch 32 k 2024-09-17T04:09:28.219 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-prometheus-alerts noarch 2:19.2.0-0.el9 ceph-noarch 16 k 2024-09-17T04:09:28.219 INFO:teuthology.orchestra.run.smithi088.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-17T04:09:28.220 INFO:teuthology.orchestra.run.smithi088.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-17T04:09:28.220 INFO:teuthology.orchestra.run.smithi088.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-17T04:09:28.220 INFO:teuthology.orchestra.run.smithi088.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-17T04:09:28.220 INFO:teuthology.orchestra.run.smithi088.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-17T04:09:28.220 INFO:teuthology.orchestra.run.smithi088.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-17T04:09:28.220 INFO:teuthology.orchestra.run.smithi088.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-17T04:09:28.220 INFO:teuthology.orchestra.run.smithi088.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-17T04:09:28.220 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:09:28.220 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2024-09-17T04:09:28.220 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-17T04:09:28.220 INFO:teuthology.orchestra.run.smithi088.stdout:Install 12 Packages 2024-09-17T04:09:28.220 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:09:28.221 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 8.7 M 2024-09-17T04:09:28.221 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 104 M 2024-09-17T04:09:28.221 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2024-09-17T04:09:28.442 INFO:teuthology.orchestra.run.smithi088.stdout:(1/12): ceph-grafana-dashboards-19.2.0-0.el9.no 459 kB/s | 32 kB 00:00 2024-09-17T04:09:28.467 INFO:teuthology.orchestra.run.smithi088.stdout:(2/12): ceph-prometheus-alerts-19.2.0-0.el9.noa 174 kB/s | 16 kB 00:00 2024-09-17T04:09:28.543 INFO:teuthology.orchestra.run.smithi088.stdout:(3/12): ceph-mgr-dashboard-19.2.0-0.el9.noarch. 21 MB/s | 3.6 MB 00:00 2024-09-17T04:09:28.566 INFO:teuthology.orchestra.run.smithi134.stdout:(1/12): ceph-mgr-diskprediction-local-19.2.0-0. 54 MB/s | 7.4 MB 00:00 2024-09-17T04:09:28.632 INFO:teuthology.orchestra.run.smithi134.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 492 kB/s | 33 kB 00:00 2024-09-17T04:09:28.660 INFO:teuthology.orchestra.run.smithi088.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.4 MB/s | 269 kB 00:00 2024-09-17T04:09:28.674 INFO:teuthology.orchestra.run.smithi134.stdout:(3/12): libquadmath-11.5.0-2.el9.x86_64.rpm 775 kB/s | 191 kB 00:00 2024-09-17T04:09:28.708 INFO:teuthology.orchestra.run.smithi134.stdout:(4/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 801 kB 00:00 2024-09-17T04:09:28.709 INFO:teuthology.orchestra.run.smithi088.stdout:(5/12): protobuf-3.14.0-13.el9.x86_64.rpm 3.8 MB/s | 1.0 MB 00:00 2024-09-17T04:09:28.760 INFO:teuthology.orchestra.run.smithi088.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 402 kB/s | 19 kB 00:00 2024-09-17T04:09:28.766 INFO:teuthology.orchestra.run.smithi134.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 199 kB/s | 18 kB 00:00 2024-09-17T04:09:28.785 INFO:teuthology.orchestra.run.smithi088.stdout:(7/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 4.3 MB/s | 548 kB 00:00 2024-09-17T04:09:28.792 INFO:teuthology.orchestra.run.smithi134.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 461 kB/s | 38 kB 00:00 2024-09-17T04:09:28.819 INFO:teuthology.orchestra.run.smithi088.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 4.3 MB/s | 144 kB 00:00 2024-09-17T04:09:28.850 INFO:teuthology.orchestra.run.smithi134.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 14 MB/s | 3.0 MB 00:00 2024-09-17T04:09:28.852 INFO:teuthology.orchestra.run.smithi088.stdout:(9/12): protobuf-compiler-3.14.0-13.el9.x86_64. 2.7 MB/s | 863 kB 00:00 2024-09-17T04:09:28.878 INFO:teuthology.orchestra.run.smithi088.stdout:(10/12): python3-repoze-lru-0.7-16.el9.noarch.r 527 kB/s | 31 kB 00:00 2024-09-17T04:09:28.909 INFO:teuthology.orchestra.run.smithi134.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 2.0 MB/s | 245 kB 00:00 2024-09-17T04:09:28.936 INFO:teuthology.orchestra.run.smithi088.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 2.2 MB/s | 188 kB 00:00 2024-09-17T04:09:29.009 INFO:teuthology.orchestra.run.smithi134.stdout:(9/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 32 MB/s | 5.1 MB 00:00 2024-09-17T04:09:29.012 INFO:teuthology.orchestra.run.smithi088.stdout:(12/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 8.1 MB/s | 2.0 MB 00:00 2024-09-17T04:09:29.015 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2024-09-17T04:09:29.015 INFO:teuthology.orchestra.run.smithi088.stdout:Total 11 MB/s | 8.7 MB 00:00 2024-09-17T04:09:29.034 INFO:teuthology.orchestra.run.smithi134.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.0 MB/s | 250 kB 00:00 2024-09-17T04:09:29.062 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2024-09-17T04:09:29.079 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2024-09-17T04:09:29.079 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2024-09-17T04:09:29.243 INFO:teuthology.orchestra.run.smithi134.stdout:(11/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 10 MB/s | 4.9 MB 00:00 2024-09-17T04:09:29.283 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2024-09-17T04:09:29.284 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2024-09-17T04:09:29.527 INFO:teuthology.orchestra.run.smithi134.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 31 MB/s | 16 MB 00:00 2024-09-17T04:09:29.527 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-17T04:09:29.528 INFO:teuthology.orchestra.run.smithi134.stdout:Total 28 MB/s | 38 MB 00:01 2024-09-17T04:09:29.845 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2024-09-17T04:09:29.885 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-17T04:09:29.911 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-17T04:09:29.911 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-17T04:09:29.929 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-17T04:09:29.964 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-17T04:09:30.010 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-17T04:09:30.049 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-17T04:09:30.157 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-17T04:09:30.291 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-17T04:09:30.341 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-17T04:09:30.341 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-17T04:09:30.385 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-17T04:09:30.429 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-17T04:09:30.457 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-17T04:09:30.489 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-prometheus-alerts-2:19.2.0-0.el9.noarch 10/12 2024-09-17T04:09:31.115 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-17T04:09:31.187 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-17T04:09:31.233 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-17T04:09:31.338 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-17T04:09:31.375 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-17T04:09:31.545 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-grafana-dashboards-2:19.2.0-0.el9.noarch 11/12 2024-09-17T04:09:31.560 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-17T04:09:31.581 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-dashboard-2:19.2.0-0.el9.noarch 12/12 2024-09-17T04:09:31.591 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-17T04:09:31.676 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-17T04:09:32.333 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-17T04:09:32.462 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-17T04:09:32.989 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.0-0.el9.noarch 12/12 2024-09-17T04:09:32.989 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-grafana-dashboards-2:19.2.0-0.el9.noarch 1/12 2024-09-17T04:09:32.990 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-dashboard-2:19.2.0-0.el9.noarch 2/12 2024-09-17T04:09:32.990 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-prometheus-alerts-2:19.2.0-0.el9.noarch 3/12 2024-09-17T04:09:32.990 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-17T04:09:32.990 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-17T04:09:32.990 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-17T04:09:32.990 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-17T04:09:32.990 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-17T04:09:32.990 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-17T04:09:32.990 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-17T04:09:32.990 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-17T04:09:33.312 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-17T04:09:33.312 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:09:33.312 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2024-09-17T04:09:33.312 INFO:teuthology.orchestra.run.smithi088.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-17T04:09:33.313 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-grafana-dashboards-2:19.2.0-0.el9.noarch 2024-09-17T04:09:33.313 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-dashboard-2:19.2.0-0.el9.noarch 2024-09-17T04:09:33.313 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-prometheus-alerts-2:19.2.0-0.el9.noarch 2024-09-17T04:09:33.313 INFO:teuthology.orchestra.run.smithi088.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-17T04:09:33.313 INFO:teuthology.orchestra.run.smithi088.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-17T04:09:33.313 INFO:teuthology.orchestra.run.smithi088.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-17T04:09:33.313 INFO:teuthology.orchestra.run.smithi088.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-17T04:09:33.313 INFO:teuthology.orchestra.run.smithi088.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-17T04:09:33.313 INFO:teuthology.orchestra.run.smithi088.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-17T04:09:33.313 INFO:teuthology.orchestra.run.smithi088.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-17T04:09:33.313 INFO:teuthology.orchestra.run.smithi088.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-17T04:09:33.313 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:09:33.314 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-09-17T04:09:33.579 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-17T04:09:33.690 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-17T04:09:34.158 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:01 ago on Tue 17 Sep 2024 04:08:33 AM UTC. 2024-09-17T04:09:34.292 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-09-17T04:09:34.293 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-17T04:09:34.293 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2024-09-17T04:09:34.293 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-17T04:09:34.293 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2024-09-17T04:09:34.294 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.0-0.el9 ceph-noarch 7.4 M 2024-09-17T04:09:34.294 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2024-09-17T04:09:34.294 INFO:teuthology.orchestra.run.smithi088.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-17T04:09:34.294 INFO:teuthology.orchestra.run.smithi088.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-17T04:09:34.294 INFO:teuthology.orchestra.run.smithi088.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-17T04:09:34.294 INFO:teuthology.orchestra.run.smithi088.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-17T04:09:34.294 INFO:teuthology.orchestra.run.smithi088.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-17T04:09:34.294 INFO:teuthology.orchestra.run.smithi088.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-17T04:09:34.294 INFO:teuthology.orchestra.run.smithi088.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-17T04:09:34.294 INFO:teuthology.orchestra.run.smithi088.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-17T04:09:34.294 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-17T04:09:34.294 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-17T04:09:34.295 INFO:teuthology.orchestra.run.smithi088.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-17T04:09:34.295 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:09:34.295 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2024-09-17T04:09:34.295 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-17T04:09:34.295 INFO:teuthology.orchestra.run.smithi088.stdout:Install 12 Packages 2024-09-17T04:09:34.295 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:09:34.295 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 38 M 2024-09-17T04:09:34.296 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 212 M 2024-09-17T04:09:34.296 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2024-09-17T04:09:34.586 INFO:teuthology.orchestra.run.smithi088.stdout:(1/12): ceph-mgr-diskprediction-local-19.2.0-0. 53 MB/s | 7.4 MB 00:00 2024-09-17T04:09:34.661 INFO:teuthology.orchestra.run.smithi088.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 437 kB/s | 33 kB 00:00 2024-09-17T04:09:34.695 INFO:teuthology.orchestra.run.smithi088.stdout:(3/12): libquadmath-11.5.0-2.el9.x86_64.rpm 771 kB/s | 191 kB 00:00 2024-09-17T04:09:34.716 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-17T04:09:34.740 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.0-0.el9.noarc 12/12 2024-09-17T04:09:34.761 INFO:teuthology.orchestra.run.smithi088.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 273 kB/s | 18 kB 00:00 2024-09-17T04:09:34.795 INFO:teuthology.orchestra.run.smithi088.stdout:(5/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 801 kB 00:00 2024-09-17T04:09:34.820 INFO:teuthology.orchestra.run.smithi088.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 658 kB/s | 38 kB 00:00 2024-09-17T04:09:34.912 INFO:teuthology.orchestra.run.smithi088.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 2.6 MB/s | 245 kB 00:00 2024-09-17T04:09:35.371 INFO:teuthology.orchestra.run.smithi088.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 4.2 MB/s | 3.0 MB 00:00 2024-09-17T04:09:35.454 INFO:teuthology.orchestra.run.smithi088.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.9 MB/s | 250 kB 00:00 2024-09-17T04:09:36.054 INFO:teuthology.orchestra.run.smithi088.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 3.9 MB/s | 4.9 MB 00:01 2024-09-17T04:09:36.221 INFO:teuthology.orchestra.run.smithi088.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.9 MB/s | 5.1 MB 00:01 2024-09-17T04:09:37.497 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.0-0.el9.noarc 12/12 2024-09-17T04:09:37.497 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.0-0.el9.noarc 1/12 2024-09-17T04:09:37.497 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-17T04:09:37.497 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-17T04:09:37.497 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-17T04:09:37.497 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-17T04:09:37.497 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-17T04:09:37.497 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-17T04:09:37.498 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-17T04:09:37.498 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-17T04:09:37.498 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-17T04:09:37.498 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-17T04:09:37.947 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-17T04:09:37.948 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:09:37.948 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-17T04:09:37.948 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local-2:19.2.0-0.el9.noarch 2024-09-17T04:09:37.948 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-17T04:09:37.948 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-17T04:09:37.948 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-17T04:09:37.948 INFO:teuthology.orchestra.run.smithi134.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-17T04:09:37.948 INFO:teuthology.orchestra.run.smithi134.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-17T04:09:37.948 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-17T04:09:37.948 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-17T04:09:37.948 INFO:teuthology.orchestra.run.smithi134.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-17T04:09:37.948 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-17T04:09:37.948 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-17T04:09:37.949 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-17T04:09:37.949 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:09:37.949 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-17T04:09:38.046 INFO:teuthology.orchestra.run.smithi088.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.3 MB/s | 16 MB 00:02 2024-09-17T04:09:38.047 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2024-09-17T04:09:38.047 INFO:teuthology.orchestra.run.smithi088.stdout:Total 10 MB/s | 38 MB 00:03 2024-09-17T04:09:38.343 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr-rook 2024-09-17T04:09:38.404 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2024-09-17T04:09:38.431 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2024-09-17T04:09:38.431 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2024-09-17T04:09:38.870 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2024-09-17T04:09:38.870 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2024-09-17T04:09:38.943 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:16 ago on Tue 17 Sep 2024 04:08:22 AM UTC. 2024-09-17T04:09:39.077 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-17T04:09:39.079 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-17T04:09:39.079 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-09-17T04:09:39.079 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-17T04:09:39.079 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-17T04:09:39.079 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook noarch 2:19.2.0-0.el9 ceph-noarch 49 k 2024-09-17T04:09:39.079 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-09-17T04:09:39.079 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-17T04:09:39.079 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-17T04:09:39.079 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-17T04:09:39.079 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-17T04:09:39.079 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-17T04:09:39.079 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-17T04:09:39.079 INFO:teuthology.orchestra.run.smithi134.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-17T04:09:39.080 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-17T04:09:39.080 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-17T04:09:39.080 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-17T04:09:39.080 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-17T04:09:39.080 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-17T04:09:39.080 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:09:39.080 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-17T04:09:39.080 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-17T04:09:39.080 INFO:teuthology.orchestra.run.smithi134.stdout:Install 13 Packages 2024-09-17T04:09:39.080 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:09:39.081 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 2.2 M 2024-09-17T04:09:39.081 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 26 M 2024-09-17T04:09:39.081 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-17T04:09:39.590 INFO:teuthology.orchestra.run.smithi134.stdout:(1/13): ceph-mgr-rook-19.2.0-0.el9.noarch.rpm 1.0 MB/s | 49 kB 00:00 2024-09-17T04:09:39.643 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2024-09-17T04:09:39.648 INFO:teuthology.orchestra.run.smithi134.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 182 kB/s | 19 kB 00:00 2024-09-17T04:09:39.682 INFO:teuthology.orchestra.run.smithi134.stdout:(3/13): python3-jsonpatch-1.21-16.el9.noarch.rp 184 kB/s | 26 kB 00:00 2024-09-17T04:09:39.707 INFO:teuthology.orchestra.run.smithi134.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.9 MB/s | 222 kB 00:00 2024-09-17T04:09:39.716 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-17T04:09:39.752 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-17T04:09:39.757 INFO:teuthology.orchestra.run.smithi134.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-09-17T04:09:39.783 INFO:teuthology.orchestra.run.smithi134.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 712 kB/s | 54 kB 00:00 2024-09-17T04:09:39.833 INFO:teuthology.orchestra.run.smithi134.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.8 MB/s | 279 kB 00:00 2024-09-17T04:09:39.853 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-17T04:09:39.859 INFO:teuthology.orchestra.run.smithi134.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 320 kB/s | 32 kB 00:00 2024-09-17T04:09:39.892 INFO:teuthology.orchestra.run.smithi134.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 129 kB/s | 14 kB 00:00 2024-09-17T04:09:39.896 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-17T04:09:39.925 INFO:teuthology.orchestra.run.smithi134.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 1.8 MB/s | 59 kB 00:00 2024-09-17T04:09:39.959 INFO:teuthology.orchestra.run.smithi134.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 1.7 MB/s | 220 kB 00:00 2024-09-17T04:09:39.984 INFO:teuthology.orchestra.run.smithi134.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.5 MB/s | 90 kB 00:00 2024-09-17T04:09:40.018 INFO:teuthology.orchestra.run.smithi134.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.7 MB/s | 1.0 MB 00:00 2024-09-17T04:09:40.020 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-17T04:09:40.020 INFO:teuthology.orchestra.run.smithi134.stdout:Total 2.4 MB/s | 2.2 MB 00:00 2024-09-17T04:09:40.081 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-17T04:09:40.084 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-17T04:09:40.099 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-17T04:09:40.100 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-17T04:09:40.111 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-17T04:09:40.191 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-17T04:09:40.194 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-17T04:09:40.196 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-17T04:09:40.696 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-17T04:09:40.861 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-17T04:09:40.865 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-17T04:09:40.927 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-17T04:09:40.990 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-17T04:09:40.991 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-17T04:09:41.028 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-17T04:09:41.070 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-17T04:09:41.205 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-17T04:09:41.306 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-17T04:09:41.364 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-17T04:09:42.068 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-17T04:09:42.118 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-17T04:09:42.152 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-17T04:09:42.199 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-17T04:09:42.219 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-17T04:09:42.222 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-rook-2:19.2.0-0.el9.noarch 13/13 2024-09-17T04:09:43.009 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.0-0.el9.noarch 13/13 2024-09-17T04:09:43.010 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-rook-2:19.2.0-0.el9.noarch 1/13 2024-09-17T04:09:43.010 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-17T04:09:43.010 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-17T04:09:43.010 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-17T04:09:43.010 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-17T04:09:43.010 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-17T04:09:43.010 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-17T04:09:43.010 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-17T04:09:43.010 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-17T04:09:43.010 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-17T04:09:43.010 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-17T04:09:43.010 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-17T04:09:43.255 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-17T04:09:43.285 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.0-0.el9.noarc 12/12 2024-09-17T04:09:43.354 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-17T04:09:43.354 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:09:43.354 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-17T04:09:43.354 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook-2:19.2.0-0.el9.noarch 2024-09-17T04:09:43.354 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-17T04:09:43.354 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-17T04:09:43.354 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-17T04:09:43.354 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-17T04:09:43.355 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-17T04:09:43.355 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-17T04:09:43.355 INFO:teuthology.orchestra.run.smithi134.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-17T04:09:43.355 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-17T04:09:43.355 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-17T04:09:43.355 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-17T04:09:43.355 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-17T04:09:43.355 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-17T04:09:43.355 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:09:43.355 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-17T04:09:43.617 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr-cephadm 2024-09-17T04:09:44.203 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:22 ago on Tue 17 Sep 2024 04:08:22 AM UTC. 2024-09-17T04:09:44.335 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-17T04:09:44.336 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-17T04:09:44.336 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-09-17T04:09:44.336 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-17T04:09:44.336 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-17T04:09:44.336 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-cephadm noarch 2:19.2.0-0.el9 ceph-noarch 146 k 2024-09-17T04:09:44.336 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-09-17T04:09:44.336 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-17T04:09:44.336 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-17T04:09:44.336 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-17T04:09:44.336 INFO:teuthology.orchestra.run.smithi134.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-17T04:09:44.336 INFO:teuthology.orchestra.run.smithi134.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-17T04:09:44.337 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:09:44.337 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-17T04:09:44.337 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-17T04:09:44.337 INFO:teuthology.orchestra.run.smithi134.stdout:Install 6 Packages 2024-09-17T04:09:44.337 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:09:44.337 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 7.0 M 2024-09-17T04:09:44.337 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 33 M 2024-09-17T04:09:44.338 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-17T04:09:44.811 INFO:teuthology.orchestra.run.smithi134.stdout:(1/6): ceph-mgr-cephadm-19.2.0-0.el9.noarch.rpm 3.3 MB/s | 146 kB 00:00 2024-09-17T04:09:44.861 INFO:teuthology.orchestra.run.smithi134.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-17T04:09:44.886 INFO:teuthology.orchestra.run.smithi134.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-09-17T04:09:44.920 INFO:teuthology.orchestra.run.smithi134.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.2 MB/s | 74 kB 00:00 2024-09-17T04:09:44.954 INFO:teuthology.orchestra.run.smithi134.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.3 MB/s | 248 kB 00:00 2024-09-17T04:09:45.914 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.0-0.el9.noarc 12/12 2024-09-17T04:09:45.914 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.0-0.el9.noarc 1/12 2024-09-17T04:09:45.914 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-17T04:09:45.914 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-17T04:09:45.914 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-17T04:09:45.914 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-17T04:09:45.914 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-17T04:09:45.915 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-17T04:09:45.915 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-17T04:09:45.915 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-17T04:09:45.915 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-17T04:09:45.915 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-17T04:09:46.270 INFO:teuthology.orchestra.run.smithi134.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 4.0 MB/s | 6.0 MB 00:01 2024-09-17T04:09:46.272 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-17T04:09:46.273 INFO:teuthology.orchestra.run.smithi134.stdout:Total 3.6 MB/s | 7.0 MB 00:01 2024-09-17T04:09:46.319 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-17T04:09:46.319 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:09:46.319 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2024-09-17T04:09:46.319 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-diskprediction-local-2:19.2.0-0.el9.noarch 2024-09-17T04:09:46.319 INFO:teuthology.orchestra.run.smithi088.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-17T04:09:46.319 INFO:teuthology.orchestra.run.smithi088.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-17T04:09:46.320 INFO:teuthology.orchestra.run.smithi088.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-17T04:09:46.320 INFO:teuthology.orchestra.run.smithi088.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-17T04:09:46.320 INFO:teuthology.orchestra.run.smithi088.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-17T04:09:46.320 INFO:teuthology.orchestra.run.smithi088.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-17T04:09:46.320 INFO:teuthology.orchestra.run.smithi088.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-17T04:09:46.320 INFO:teuthology.orchestra.run.smithi088.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-17T04:09:46.320 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-17T04:09:46.320 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-17T04:09:46.320 INFO:teuthology.orchestra.run.smithi088.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-17T04:09:46.320 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:09:46.320 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-09-17T04:09:46.342 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-17T04:09:46.354 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-17T04:09:46.354 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-17T04:09:46.457 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-17T04:09:46.458 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-17T04:09:46.688 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-mgr-rook 2024-09-17T04:09:46.760 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-17T04:09:46.947 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-17T04:09:47.006 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-17T04:09:47.277 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:14 ago on Tue 17 Sep 2024 04:08:33 AM UTC. 2024-09-17T04:09:47.410 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-09-17T04:09:47.411 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-17T04:09:47.411 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2024-09-17T04:09:47.411 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-17T04:09:47.411 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2024-09-17T04:09:47.411 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-rook noarch 2:19.2.0-0.el9 ceph-noarch 49 k 2024-09-17T04:09:47.411 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2024-09-17T04:09:47.412 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-17T04:09:47.412 INFO:teuthology.orchestra.run.smithi088.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-17T04:09:47.412 INFO:teuthology.orchestra.run.smithi088.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-17T04:09:47.412 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-17T04:09:47.412 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-17T04:09:47.412 INFO:teuthology.orchestra.run.smithi088.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-17T04:09:47.412 INFO:teuthology.orchestra.run.smithi088.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-17T04:09:47.412 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-17T04:09:47.412 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-17T04:09:47.412 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-17T04:09:47.412 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-17T04:09:47.412 INFO:teuthology.orchestra.run.smithi088.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-17T04:09:47.413 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:09:47.413 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2024-09-17T04:09:47.413 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-17T04:09:47.413 INFO:teuthology.orchestra.run.smithi088.stdout:Install 13 Packages 2024-09-17T04:09:47.413 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:09:47.413 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 2.2 M 2024-09-17T04:09:47.413 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 26 M 2024-09-17T04:09:47.413 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2024-09-17T04:09:47.532 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-17T04:09:47.626 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-17T04:09:47.688 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-17T04:09:47.718 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-cephadm-2:19.2.0-0.el9.noarch 6/6 2024-09-17T04:09:47.819 INFO:teuthology.orchestra.run.smithi088.stdout:(1/13): ceph-mgr-rook-19.2.0-0.el9.noarch.rpm 1.2 MB/s | 49 kB 00:00 2024-09-17T04:09:47.886 INFO:teuthology.orchestra.run.smithi088.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 177 kB/s | 19 kB 00:00 2024-09-17T04:09:47.911 INFO:teuthology.orchestra.run.smithi088.stdout:(3/13): python3-jsonpatch-1.21-16.el9.noarch.rp 192 kB/s | 26 kB 00:00 2024-09-17T04:09:47.978 INFO:teuthology.orchestra.run.smithi088.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.4 MB/s | 222 kB 00:00 2024-09-17T04:09:48.003 INFO:teuthology.orchestra.run.smithi088.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-09-17T04:09:48.028 INFO:teuthology.orchestra.run.smithi088.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-17T04:09:48.070 INFO:teuthology.orchestra.run.smithi088.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.7 MB/s | 279 kB 00:00 2024-09-17T04:09:48.096 INFO:teuthology.orchestra.run.smithi088.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 349 kB/s | 32 kB 00:00 2024-09-17T04:09:48.129 INFO:teuthology.orchestra.run.smithi088.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 140 kB/s | 14 kB 00:00 2024-09-17T04:09:48.163 INFO:teuthology.orchestra.run.smithi088.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 1.8 MB/s | 59 kB 00:00 2024-09-17T04:09:48.188 INFO:teuthology.orchestra.run.smithi088.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 3.5 MB/s | 90 kB 00:00 2024-09-17T04:09:48.213 INFO:teuthology.orchestra.run.smithi088.stdout:(12/13): python3-google-auth-2.34.0-1.el9.noarc 1.5 MB/s | 220 kB 00:00 2024-09-17T04:09:48.247 INFO:teuthology.orchestra.run.smithi088.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.1 MB/s | 1.0 MB 00:00 2024-09-17T04:09:48.250 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2024-09-17T04:09:48.250 INFO:teuthology.orchestra.run.smithi088.stdout:Total 2.6 MB/s | 2.2 MB 00:00 2024-09-17T04:09:48.313 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2024-09-17T04:09:48.328 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2024-09-17T04:09:48.328 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2024-09-17T04:09:48.419 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2024-09-17T04:09:48.420 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2024-09-17T04:09:48.529 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.0-0.el9.noarch 6/6 2024-09-17T04:09:48.530 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-cephadm-2:19.2.0-0.el9.noarch 1/6 2024-09-17T04:09:48.530 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-17T04:09:48.530 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-17T04:09:48.530 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-17T04:09:48.530 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-17T04:09:48.805 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-17T04:09:48.805 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:09:48.805 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-17T04:09:48.805 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-cephadm-2:19.2.0-0.el9.noarch 2024-09-17T04:09:48.805 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-17T04:09:48.805 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-17T04:09:48.805 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-17T04:09:48.805 INFO:teuthology.orchestra.run.smithi134.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-17T04:09:48.805 INFO:teuthology.orchestra.run.smithi134.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-17T04:09:48.805 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:09:48.805 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-17T04:09:48.949 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2024-09-17T04:09:49.072 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-fuse 2024-09-17T04:09:49.152 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-17T04:09:49.206 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-17T04:09:49.262 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-17T04:09:49.299 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-17T04:09:49.349 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-17T04:09:49.450 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-17T04:09:49.561 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-17T04:09:49.609 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-17T04:09:49.651 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:27 ago on Tue 17 Sep 2024 04:08:22 AM UTC. 2024-09-17T04:09:49.784 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-17T04:09:49.785 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-17T04:09:49.785 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2024-09-17T04:09:49.785 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-17T04:09:49.785 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-17T04:09:49.785 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse x86_64 2:19.2.0-0.el9 ceph 896 k 2024-09-17T04:09:49.785 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-09-17T04:09:49.785 INFO:teuthology.orchestra.run.smithi134.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-17T04:09:49.785 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:09:49.785 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-17T04:09:49.785 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-17T04:09:49.785 INFO:teuthology.orchestra.run.smithi134.stdout:Install 2 Packages 2024-09-17T04:09:49.785 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:09:49.786 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 976 k 2024-09-17T04:09:49.786 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 2.9 M 2024-09-17T04:09:49.786 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-17T04:09:49.897 INFO:teuthology.orchestra.run.smithi134.stdout:(1/2): ceph-fuse-19.2.0-0.el9.x86_64.rpm 14 MB/s | 896 kB 00:00 2024-09-17T04:09:50.006 INFO:teuthology.orchestra.run.smithi134.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 463 kB/s | 80 kB 00:00 2024-09-17T04:09:50.006 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-17T04:09:50.007 INFO:teuthology.orchestra.run.smithi134.stdout:Total 4.3 MB/s | 976 kB 00:00 2024-09-17T04:09:50.018 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-17T04:09:50.039 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-17T04:09:50.039 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-17T04:09:50.119 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-17T04:09:50.119 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-17T04:09:50.318 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-17T04:09:50.321 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-17T04:09:50.381 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-17T04:09:50.415 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-17T04:09:50.449 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-17T04:09:50.463 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-17T04:09:50.493 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-rook-2:19.2.0-0.el9.noarch 13/13 2024-09-17T04:09:50.513 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-fuse-2:19.2.0-0.el9.x86_64 2/2 2024-09-17T04:09:51.253 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.0-0.el9.noarch 13/13 2024-09-17T04:09:51.253 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-rook-2:19.2.0-0.el9.noarch 1/13 2024-09-17T04:09:51.253 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-17T04:09:51.253 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-17T04:09:51.253 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-17T04:09:51.253 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-17T04:09:51.253 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-17T04:09:51.254 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-17T04:09:51.254 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-17T04:09:51.254 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-17T04:09:51.254 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-17T04:09:51.254 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-17T04:09:51.254 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-17T04:09:51.259 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-fuse-2:19.2.0-0.el9.x86_64 2/2 2024-09-17T04:09:51.260 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-fuse-2:19.2.0-0.el9.x86_64 1/2 2024-09-17T04:09:51.563 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-17T04:09:51.564 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:09:51.564 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-17T04:09:51.564 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse-2:19.2.0-0.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-17T04:09:51.564 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:09:51.564 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-17T04:09:51.589 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-17T04:09:51.590 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:09:51.590 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2024-09-17T04:09:51.590 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-rook-2:19.2.0-0.el9.noarch 2024-09-17T04:09:51.590 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-17T04:09:51.590 INFO:teuthology.orchestra.run.smithi088.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-17T04:09:51.590 INFO:teuthology.orchestra.run.smithi088.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-17T04:09:51.590 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-17T04:09:51.590 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-17T04:09:51.590 INFO:teuthology.orchestra.run.smithi088.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-17T04:09:51.590 INFO:teuthology.orchestra.run.smithi088.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-17T04:09:51.590 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-17T04:09:51.590 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-17T04:09:51.591 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-17T04:09:51.591 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-17T04:09:51.591 INFO:teuthology.orchestra.run.smithi088.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-17T04:09:51.591 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:09:51.591 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-09-17T04:09:51.846 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-mgr-cephadm 2024-09-17T04:09:51.886 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install librados-devel 2024-09-17T04:09:52.431 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:19 ago on Tue 17 Sep 2024 04:08:33 AM UTC. 2024-09-17T04:09:52.477 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:30 ago on Tue 17 Sep 2024 04:08:22 AM UTC. 2024-09-17T04:09:52.564 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-09-17T04:09:52.564 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-17T04:09:52.565 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2024-09-17T04:09:52.565 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-17T04:09:52.565 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2024-09-17T04:09:52.565 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-cephadm noarch 2:19.2.0-0.el9 ceph-noarch 146 k 2024-09-17T04:09:52.565 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2024-09-17T04:09:52.565 INFO:teuthology.orchestra.run.smithi088.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-17T04:09:52.565 INFO:teuthology.orchestra.run.smithi088.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-17T04:09:52.565 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-17T04:09:52.565 INFO:teuthology.orchestra.run.smithi088.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-17T04:09:52.565 INFO:teuthology.orchestra.run.smithi088.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-17T04:09:52.565 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:09:52.566 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2024-09-17T04:09:52.566 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-17T04:09:52.566 INFO:teuthology.orchestra.run.smithi088.stdout:Install 6 Packages 2024-09-17T04:09:52.566 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:09:52.566 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 7.0 M 2024-09-17T04:09:52.566 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 33 M 2024-09-17T04:09:52.566 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2024-09-17T04:09:52.614 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-17T04:09:52.614 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-17T04:09:52.615 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2024-09-17T04:09:52.615 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-17T04:09:52.615 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-17T04:09:52.615 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel x86_64 2:19.2.0-0.el9 ceph 126 k 2024-09-17T04:09:52.615 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:09:52.615 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-17T04:09:52.615 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-17T04:09:52.615 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-09-17T04:09:52.615 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:09:52.615 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 126 k 2024-09-17T04:09:52.615 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 456 k 2024-09-17T04:09:52.615 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-17T04:09:52.668 INFO:teuthology.orchestra.run.smithi134.stdout:librados-devel-19.2.0-0.el9.x86_64.rpm 2.4 MB/s | 126 kB 00:00 2024-09-17T04:09:52.668 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-17T04:09:52.669 INFO:teuthology.orchestra.run.smithi134.stdout:Total 2.3 MB/s | 126 kB 00:00 2024-09-17T04:09:52.669 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-17T04:09:52.674 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-17T04:09:52.674 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-17T04:09:52.737 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-17T04:09:52.737 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-17T04:09:52.815 INFO:teuthology.orchestra.run.smithi088.stdout:(1/6): ceph-mgr-cephadm-19.2.0-0.el9.noarch.rpm 2.4 MB/s | 146 kB 00:00 2024-09-17T04:09:52.882 INFO:teuthology.orchestra.run.smithi088.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 8.0 MB/s | 548 kB 00:00 2024-09-17T04:09:52.885 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-17T04:09:52.908 INFO:teuthology.orchestra.run.smithi088.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-09-17T04:09:52.933 INFO:teuthology.orchestra.run.smithi088.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-09-17T04:09:52.983 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librados-devel-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T04:09:53.391 INFO:teuthology.orchestra.run.smithi088.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 390 kB/s | 248 kB 00:00 2024-09-17T04:09:53.489 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados-devel-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T04:09:53.709 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados-devel-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T04:09:53.709 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:09:53.709 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-17T04:09:53.709 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel-2:19.2.0-0.el9.x86_64 2024-09-17T04:09:53.709 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:09:53.709 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-17T04:09:53.993 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install libcephfs2 2024-09-17T04:09:54.016 INFO:teuthology.orchestra.run.smithi088.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 4.7 MB/s | 6.0 MB 00:01 2024-09-17T04:09:54.018 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2024-09-17T04:09:54.018 INFO:teuthology.orchestra.run.smithi088.stdout:Total 4.8 MB/s | 7.0 MB 00:01 2024-09-17T04:09:54.089 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2024-09-17T04:09:54.100 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2024-09-17T04:09:54.100 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2024-09-17T04:09:54.199 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2024-09-17T04:09:54.199 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2024-09-17T04:09:54.508 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2024-09-17T04:09:54.580 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:32 ago on Tue 17 Sep 2024 04:08:22 AM UTC. 2024-09-17T04:09:54.669 INFO:teuthology.orchestra.run.smithi134.stdout:Package libcephfs2-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-17T04:09:54.691 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-17T04:09:54.712 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-17T04:09:54.713 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-09-17T04:09:54.713 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-17T04:09:54.743 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-17T04:09:54.794 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install libcephfs-devel 2024-09-17T04:09:55.265 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-17T04:09:55.356 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-17T04:09:55.377 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:33 ago on Tue 17 Sep 2024 04:08:22 AM UTC. 2024-09-17T04:09:55.419 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-17T04:09:55.447 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-cephadm-2:19.2.0-0.el9.noarch 6/6 2024-09-17T04:09:55.509 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-17T04:09:55.510 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-17T04:09:55.510 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2024-09-17T04:09:55.510 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-17T04:09:55.510 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-17T04:09:55.510 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel x86_64 2:19.2.0-0.el9 ceph 32 k 2024-09-17T04:09:55.510 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:09:55.510 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-17T04:09:55.511 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-17T04:09:55.511 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-09-17T04:09:55.511 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:09:55.511 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 32 k 2024-09-17T04:09:55.511 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 142 k 2024-09-17T04:09:55.511 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-17T04:09:55.588 INFO:teuthology.orchestra.run.smithi134.stdout:libcephfs-devel-19.2.0-0.el9.x86_64.rpm 408 kB/s | 32 kB 00:00 2024-09-17T04:09:55.589 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-17T04:09:55.589 INFO:teuthology.orchestra.run.smithi134.stdout:Total 402 kB/s | 32 kB 00:00 2024-09-17T04:09:55.589 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-17T04:09:55.593 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-17T04:09:55.593 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-17T04:09:55.609 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-17T04:09:55.610 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-17T04:09:55.691 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-17T04:09:55.835 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephfs-devel-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T04:09:56.232 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephfs-devel-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T04:09:56.256 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.0-0.el9.noarch 6/6 2024-09-17T04:09:56.256 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-cephadm-2:19.2.0-0.el9.noarch 1/6 2024-09-17T04:09:56.256 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-17T04:09:56.256 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-17T04:09:56.256 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-17T04:09:56.256 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-17T04:09:56.467 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephfs-devel-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T04:09:56.467 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:09:56.467 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-17T04:09:56.467 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel-2:19.2.0-0.el9.x86_64 2024-09-17T04:09:56.467 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:09:56.467 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-17T04:09:56.521 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-17T04:09:56.521 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:09:56.521 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2024-09-17T04:09:56.521 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-cephadm-2:19.2.0-0.el9.noarch 2024-09-17T04:09:56.521 INFO:teuthology.orchestra.run.smithi088.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-17T04:09:56.521 INFO:teuthology.orchestra.run.smithi088.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-17T04:09:56.522 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-17T04:09:56.522 INFO:teuthology.orchestra.run.smithi088.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-17T04:09:56.522 INFO:teuthology.orchestra.run.smithi088.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-17T04:09:56.522 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:09:56.522 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-09-17T04:09:56.668 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install librados2 2024-09-17T04:09:56.771 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-fuse 2024-09-17T04:09:57.248 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:35 ago on Tue 17 Sep 2024 04:08:22 AM UTC. 2024-09-17T04:09:57.335 INFO:teuthology.orchestra.run.smithi134.stdout:Package librados2-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-17T04:09:57.345 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:24 ago on Tue 17 Sep 2024 04:08:33 AM UTC. 2024-09-17T04:09:57.379 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-17T04:09:57.380 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-09-17T04:09:57.380 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-17T04:09:57.473 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install librbd1 2024-09-17T04:09:57.477 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-09-17T04:09:57.478 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-17T04:09:57.478 INFO:teuthology.orchestra.run.smithi088.stdout: Package Architecture Version Repository Size 2024-09-17T04:09:57.478 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-17T04:09:57.478 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2024-09-17T04:09:57.478 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-fuse x86_64 2:19.2.0-0.el9 ceph 896 k 2024-09-17T04:09:57.478 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2024-09-17T04:09:57.478 INFO:teuthology.orchestra.run.smithi088.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-17T04:09:57.478 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:09:57.479 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2024-09-17T04:09:57.479 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-17T04:09:57.479 INFO:teuthology.orchestra.run.smithi088.stdout:Install 2 Packages 2024-09-17T04:09:57.479 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:09:57.479 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 976 k 2024-09-17T04:09:57.479 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 2.9 M 2024-09-17T04:09:57.479 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2024-09-17T04:09:57.643 INFO:teuthology.orchestra.run.smithi088.stdout:(1/2): ceph-fuse-19.2.0-0.el9.x86_64.rpm 13 MB/s | 896 kB 00:00 2024-09-17T04:09:57.943 INFO:teuthology.orchestra.run.smithi088.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 217 kB/s | 80 kB 00:00 2024-09-17T04:09:57.944 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2024-09-17T04:09:57.944 INFO:teuthology.orchestra.run.smithi088.stdout:Total 2.0 MB/s | 976 kB 00:00 2024-09-17T04:09:57.955 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2024-09-17T04:09:57.977 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2024-09-17T04:09:57.977 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2024-09-17T04:09:58.054 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:36 ago on Tue 17 Sep 2024 04:08:22 AM UTC. 2024-09-17T04:09:58.057 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2024-09-17T04:09:58.058 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2024-09-17T04:09:58.144 INFO:teuthology.orchestra.run.smithi134.stdout:Package librbd1-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-17T04:09:58.188 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-17T04:09:58.189 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-09-17T04:09:58.189 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-17T04:09:58.250 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2024-09-17T04:09:58.269 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install python3-rados 2024-09-17T04:09:58.395 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-17T04:09:58.466 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-fuse-2:19.2.0-0.el9.x86_64 2/2 2024-09-17T04:09:58.845 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:36 ago on Tue 17 Sep 2024 04:08:22 AM UTC. 2024-09-17T04:09:58.934 INFO:teuthology.orchestra.run.smithi134.stdout:Package python3-rados-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-17T04:09:58.978 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-17T04:09:58.979 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-09-17T04:09:58.979 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-17T04:09:59.063 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install python3-rgw 2024-09-17T04:09:59.154 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-fuse-2:19.2.0-0.el9.x86_64 2/2 2024-09-17T04:09:59.154 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-fuse-2:19.2.0-0.el9.x86_64 1/2 2024-09-17T04:09:59.403 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-17T04:09:59.404 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:09:59.404 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2024-09-17T04:09:59.404 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-fuse-2:19.2.0-0.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-17T04:09:59.404 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:09:59.404 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-09-17T04:09:59.637 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:37 ago on Tue 17 Sep 2024 04:08:22 AM UTC. 2024-09-17T04:09:59.684 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install librados-devel 2024-09-17T04:09:59.725 INFO:teuthology.orchestra.run.smithi134.stdout:Package python3-rgw-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-17T04:09:59.768 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-17T04:09:59.769 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-09-17T04:09:59.769 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-17T04:09:59.846 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install python3-cephfs 2024-09-17T04:10:00.277 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:27 ago on Tue 17 Sep 2024 04:08:33 AM UTC. 2024-09-17T04:10:00.413 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-09-17T04:10:00.414 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-17T04:10:00.414 INFO:teuthology.orchestra.run.smithi088.stdout: Package Architecture Version Repository Size 2024-09-17T04:10:00.414 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-17T04:10:00.414 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2024-09-17T04:10:00.414 INFO:teuthology.orchestra.run.smithi088.stdout: librados-devel x86_64 2:19.2.0-0.el9 ceph 126 k 2024-09-17T04:10:00.414 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:10:00.414 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2024-09-17T04:10:00.414 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-17T04:10:00.414 INFO:teuthology.orchestra.run.smithi088.stdout:Install 1 Package 2024-09-17T04:10:00.414 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:10:00.415 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 126 k 2024-09-17T04:10:00.415 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 456 k 2024-09-17T04:10:00.415 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2024-09-17T04:10:00.428 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:38 ago on Tue 17 Sep 2024 04:08:22 AM UTC. 2024-09-17T04:10:00.464 INFO:teuthology.orchestra.run.smithi088.stdout:librados-devel-19.2.0-0.el9.x86_64.rpm 2.5 MB/s | 126 kB 00:00 2024-09-17T04:10:00.465 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2024-09-17T04:10:00.465 INFO:teuthology.orchestra.run.smithi088.stdout:Total 2.4 MB/s | 126 kB 00:00 2024-09-17T04:10:00.465 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2024-09-17T04:10:00.471 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2024-09-17T04:10:00.471 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2024-09-17T04:10:00.518 INFO:teuthology.orchestra.run.smithi134.stdout:Package python3-cephfs-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-17T04:10:00.534 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2024-09-17T04:10:00.534 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2024-09-17T04:10:00.562 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-17T04:10:00.563 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-09-17T04:10:00.563 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-17T04:10:00.646 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install python3-rbd 2024-09-17T04:10:00.689 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2024-09-17T04:10:00.786 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librados-devel-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T04:10:01.229 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:39 ago on Tue 17 Sep 2024 04:08:22 AM UTC. 2024-09-17T04:10:01.262 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librados-devel-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T04:10:01.319 INFO:teuthology.orchestra.run.smithi134.stdout:Package python3-rbd-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-17T04:10:01.362 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-17T04:10:01.363 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-09-17T04:10:01.363 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-17T04:10:01.438 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install rbd-fuse 2024-09-17T04:10:01.524 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados-devel-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T04:10:01.524 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:10:01.524 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2024-09-17T04:10:01.524 INFO:teuthology.orchestra.run.smithi088.stdout: librados-devel-2:19.2.0-0.el9.x86_64 2024-09-17T04:10:01.525 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:10:01.525 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-09-17T04:10:01.765 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install libcephfs2 2024-09-17T04:10:02.029 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:40 ago on Tue 17 Sep 2024 04:08:22 AM UTC. 2024-09-17T04:10:02.161 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-17T04:10:02.161 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-17T04:10:02.161 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2024-09-17T04:10:02.162 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-17T04:10:02.162 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-17T04:10:02.162 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse x86_64 2:19.2.0-0.el9 ceph 85 k 2024-09-17T04:10:02.162 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:10:02.162 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-17T04:10:02.162 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-17T04:10:02.162 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-09-17T04:10:02.162 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:10:02.162 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 85 k 2024-09-17T04:10:02.162 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 231 k 2024-09-17T04:10:02.162 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-17T04:10:02.215 INFO:teuthology.orchestra.run.smithi134.stdout:rbd-fuse-19.2.0-0.el9.x86_64.rpm 1.6 MB/s | 85 kB 00:00 2024-09-17T04:10:02.216 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-17T04:10:02.216 INFO:teuthology.orchestra.run.smithi134.stdout:Total 1.5 MB/s | 85 kB 00:00 2024-09-17T04:10:02.216 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-17T04:10:02.223 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-17T04:10:02.223 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-17T04:10:02.285 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-17T04:10:02.286 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-17T04:10:02.361 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:29 ago on Tue 17 Sep 2024 04:08:33 AM UTC. 2024-09-17T04:10:02.445 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-17T04:10:02.453 INFO:teuthology.orchestra.run.smithi088.stdout:Package libcephfs2-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-17T04:10:02.497 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-09-17T04:10:02.498 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2024-09-17T04:10:02.499 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-09-17T04:10:02.546 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-fuse-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T04:10:02.571 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install libcephfs-devel 2024-09-17T04:10:02.974 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: rbd-fuse-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T04:10:03.145 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:30 ago on Tue 17 Sep 2024 04:08:33 AM UTC. 2024-09-17T04:10:03.245 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-fuse-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T04:10:03.245 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:10:03.245 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-17T04:10:03.245 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse-2:19.2.0-0.el9.x86_64 2024-09-17T04:10:03.245 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:10:03.245 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-17T04:10:03.276 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-09-17T04:10:03.277 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-17T04:10:03.277 INFO:teuthology.orchestra.run.smithi088.stdout: Package Architecture Version Repository Size 2024-09-17T04:10:03.277 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-17T04:10:03.277 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2024-09-17T04:10:03.277 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs-devel x86_64 2:19.2.0-0.el9 ceph 32 k 2024-09-17T04:10:03.277 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:10:03.277 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2024-09-17T04:10:03.278 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-17T04:10:03.278 INFO:teuthology.orchestra.run.smithi088.stdout:Install 1 Package 2024-09-17T04:10:03.278 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:10:03.278 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 32 k 2024-09-17T04:10:03.278 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 142 k 2024-09-17T04:10:03.278 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2024-09-17T04:10:03.318 INFO:teuthology.orchestra.run.smithi088.stdout:libcephfs-devel-19.2.0-0.el9.x86_64.rpm 794 kB/s | 32 kB 00:00 2024-09-17T04:10:03.318 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2024-09-17T04:10:03.319 INFO:teuthology.orchestra.run.smithi088.stdout:Total 767 kB/s | 32 kB 00:00 2024-09-17T04:10:03.319 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2024-09-17T04:10:03.322 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2024-09-17T04:10:03.322 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2024-09-17T04:10:03.344 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2024-09-17T04:10:03.344 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2024-09-17T04:10:03.438 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2024-09-17T04:10:03.501 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install rbd-mirror 2024-09-17T04:10:03.565 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephfs-devel-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T04:10:03.942 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libcephfs-devel-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T04:10:04.094 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:42 ago on Tue 17 Sep 2024 04:08:22 AM UTC. 2024-09-17T04:10:04.177 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephfs-devel-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T04:10:04.177 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:10:04.178 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2024-09-17T04:10:04.178 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs-devel-2:19.2.0-0.el9.x86_64 2024-09-17T04:10:04.178 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:10:04.178 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-09-17T04:10:04.230 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-17T04:10:04.230 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-17T04:10:04.230 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2024-09-17T04:10:04.230 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-17T04:10:04.231 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-17T04:10:04.231 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-mirror x86_64 2:19.2.0-0.el9 ceph 3.1 M 2024-09-17T04:10:04.231 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:10:04.231 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-17T04:10:04.231 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-17T04:10:04.231 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-09-17T04:10:04.231 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:10:04.231 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 3.1 M 2024-09-17T04:10:04.232 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 13 M 2024-09-17T04:10:04.232 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-17T04:10:04.318 INFO:teuthology.orchestra.run.smithi134.stdout:rbd-mirror-19.2.0-0.el9.x86_64.rpm 36 MB/s | 3.1 MB 00:00 2024-09-17T04:10:04.319 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-17T04:10:04.320 INFO:teuthology.orchestra.run.smithi134.stdout:Total 35 MB/s | 3.1 MB 00:00 2024-09-17T04:10:04.320 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-17T04:10:04.328 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-17T04:10:04.328 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-17T04:10:04.366 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install librados2 2024-09-17T04:10:04.409 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-17T04:10:04.410 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-17T04:10:04.847 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-17T04:10:04.942 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:31 ago on Tue 17 Sep 2024 04:08:33 AM UTC. 2024-09-17T04:10:05.019 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-mirror-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T04:10:05.031 INFO:teuthology.orchestra.run.smithi088.stdout:Package librados2-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-17T04:10:05.045 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: rbd-mirror-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T04:10:05.045 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:10:05.045 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-17T04:10:05.045 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T04:10:05.046 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T04:10:05.046 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:10:05.074 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-09-17T04:10:05.075 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2024-09-17T04:10:05.075 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-09-17T04:10:05.146 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install librbd1 2024-09-17T04:10:05.727 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:32 ago on Tue 17 Sep 2024 04:08:33 AM UTC. 2024-09-17T04:10:05.816 INFO:teuthology.orchestra.run.smithi088.stdout:Package librbd1-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-17T04:10:05.859 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-09-17T04:10:05.860 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2024-09-17T04:10:05.860 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-09-17T04:10:05.931 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install python3-rados 2024-09-17T04:10:06.074 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-mirror-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T04:10:06.074 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:10:06.074 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-17T04:10:06.074 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-mirror-2:19.2.0-0.el9.x86_64 2024-09-17T04:10:06.074 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:10:06.074 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-17T04:10:06.370 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install rbd-nbd 2024-09-17T04:10:06.501 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:33 ago on Tue 17 Sep 2024 04:08:33 AM UTC. 2024-09-17T04:10:06.589 INFO:teuthology.orchestra.run.smithi088.stdout:Package python3-rados-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-17T04:10:06.632 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-09-17T04:10:06.633 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2024-09-17T04:10:06.634 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-09-17T04:10:06.703 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install python3-rgw 2024-09-17T04:10:06.972 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:44 ago on Tue 17 Sep 2024 04:08:22 AM UTC. 2024-09-17T04:10:07.115 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-17T04:10:07.115 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-17T04:10:07.115 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2024-09-17T04:10:07.115 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-17T04:10:07.115 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-17T04:10:07.115 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-nbd x86_64 2:19.2.0-0.el9 ceph 170 k 2024-09-17T04:10:07.115 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:10:07.116 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-17T04:10:07.116 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-17T04:10:07.116 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-09-17T04:10:07.116 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:10:07.116 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 170 k 2024-09-17T04:10:07.116 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 494 k 2024-09-17T04:10:07.117 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-17T04:10:07.172 INFO:teuthology.orchestra.run.smithi134.stdout:rbd-nbd-19.2.0-0.el9.x86_64.rpm 3.0 MB/s | 170 kB 00:00 2024-09-17T04:10:07.172 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-17T04:10:07.173 INFO:teuthology.orchestra.run.smithi134.stdout:Total 2.9 MB/s | 170 kB 00:00 2024-09-17T04:10:07.173 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-17T04:10:07.181 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-17T04:10:07.181 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-17T04:10:07.248 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-17T04:10:07.248 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-17T04:10:07.284 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:34 ago on Tue 17 Sep 2024 04:08:33 AM UTC. 2024-09-17T04:10:07.374 INFO:teuthology.orchestra.run.smithi088.stdout:Package python3-rgw-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-17T04:10:07.418 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-09-17T04:10:07.418 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2024-09-17T04:10:07.419 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-09-17T04:10:07.425 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-17T04:10:07.489 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install python3-cephfs 2024-09-17T04:10:07.537 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-nbd-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T04:10:08.050 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: rbd-nbd-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T04:10:08.071 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:35 ago on Tue 17 Sep 2024 04:08:33 AM UTC. 2024-09-17T04:10:08.159 INFO:teuthology.orchestra.run.smithi088.stdout:Package python3-cephfs-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-17T04:10:08.203 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-09-17T04:10:08.204 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2024-09-17T04:10:08.204 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-09-17T04:10:08.281 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install python3-rbd 2024-09-17T04:10:08.302 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-nbd-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T04:10:08.302 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:10:08.302 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-17T04:10:08.302 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-nbd-2:19.2.0-0.el9.x86_64 2024-09-17T04:10:08.302 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:10:08.302 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-17T04:10:08.572 DEBUG:teuthology.parallel:result is None 2024-09-17T04:10:08.857 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:35 ago on Tue 17 Sep 2024 04:08:33 AM UTC. 2024-09-17T04:10:08.945 INFO:teuthology.orchestra.run.smithi088.stdout:Package python3-rbd-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-17T04:10:08.988 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-09-17T04:10:08.989 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2024-09-17T04:10:08.989 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-09-17T04:10:09.062 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install rbd-fuse 2024-09-17T04:10:09.642 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:36 ago on Tue 17 Sep 2024 04:08:33 AM UTC. 2024-09-17T04:10:09.774 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-09-17T04:10:09.775 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-17T04:10:09.775 INFO:teuthology.orchestra.run.smithi088.stdout: Package Architecture Version Repository Size 2024-09-17T04:10:09.775 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-17T04:10:09.775 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2024-09-17T04:10:09.775 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-fuse x86_64 2:19.2.0-0.el9 ceph 85 k 2024-09-17T04:10:09.775 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:10:09.775 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2024-09-17T04:10:09.775 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-17T04:10:09.775 INFO:teuthology.orchestra.run.smithi088.stdout:Install 1 Package 2024-09-17T04:10:09.775 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:10:09.776 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 85 k 2024-09-17T04:10:09.776 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 231 k 2024-09-17T04:10:09.776 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2024-09-17T04:10:09.829 INFO:teuthology.orchestra.run.smithi088.stdout:rbd-fuse-19.2.0-0.el9.x86_64.rpm 1.6 MB/s | 85 kB 00:00 2024-09-17T04:10:09.831 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2024-09-17T04:10:09.831 INFO:teuthology.orchestra.run.smithi088.stdout:Total 1.5 MB/s | 85 kB 00:00 2024-09-17T04:10:09.831 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2024-09-17T04:10:09.837 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2024-09-17T04:10:09.837 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2024-09-17T04:10:09.900 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2024-09-17T04:10:09.901 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2024-09-17T04:10:10.054 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2024-09-17T04:10:10.152 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-fuse-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T04:10:10.555 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: rbd-fuse-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T04:10:10.804 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-fuse-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T04:10:10.804 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:10:10.804 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2024-09-17T04:10:10.804 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-fuse-2:19.2.0-0.el9.x86_64 2024-09-17T04:10:10.805 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:10:10.805 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-09-17T04:10:11.021 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install rbd-mirror 2024-09-17T04:10:11.611 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:38 ago on Tue 17 Sep 2024 04:08:33 AM UTC. 2024-09-17T04:10:11.748 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-09-17T04:10:11.749 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-17T04:10:11.749 INFO:teuthology.orchestra.run.smithi088.stdout: Package Architecture Version Repository Size 2024-09-17T04:10:11.749 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-17T04:10:11.749 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2024-09-17T04:10:11.749 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-mirror x86_64 2:19.2.0-0.el9 ceph 3.1 M 2024-09-17T04:10:11.750 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:10:11.750 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2024-09-17T04:10:11.750 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-17T04:10:11.750 INFO:teuthology.orchestra.run.smithi088.stdout:Install 1 Package 2024-09-17T04:10:11.750 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:10:11.750 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 3.1 M 2024-09-17T04:10:11.750 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 13 M 2024-09-17T04:10:11.751 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2024-09-17T04:10:11.841 INFO:teuthology.orchestra.run.smithi088.stdout:rbd-mirror-19.2.0-0.el9.x86_64.rpm 34 MB/s | 3.1 MB 00:00 2024-09-17T04:10:11.841 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2024-09-17T04:10:11.841 INFO:teuthology.orchestra.run.smithi088.stdout:Total 34 MB/s | 3.1 MB 00:00 2024-09-17T04:10:11.842 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2024-09-17T04:10:11.852 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2024-09-17T04:10:11.852 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2024-09-17T04:10:11.932 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2024-09-17T04:10:11.933 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2024-09-17T04:10:12.361 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2024-09-17T04:10:12.425 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-mirror-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T04:10:12.449 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: rbd-mirror-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T04:10:12.449 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:10:12.450 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-17T04:10:12.450 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T04:10:12.450 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T04:10:12.450 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:10:13.588 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-mirror-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T04:10:13.589 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:10:13.589 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2024-09-17T04:10:13.589 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-mirror-2:19.2.0-0.el9.x86_64 2024-09-17T04:10:13.589 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:10:13.589 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-09-17T04:10:13.850 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install rbd-nbd 2024-09-17T04:10:14.442 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:41 ago on Tue 17 Sep 2024 04:08:33 AM UTC. 2024-09-17T04:10:14.584 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-09-17T04:10:14.584 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-17T04:10:14.584 INFO:teuthology.orchestra.run.smithi088.stdout: Package Architecture Version Repository Size 2024-09-17T04:10:14.584 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-17T04:10:14.585 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2024-09-17T04:10:14.585 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-nbd x86_64 2:19.2.0-0.el9 ceph 170 k 2024-09-17T04:10:14.585 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:10:14.585 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2024-09-17T04:10:14.585 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-17T04:10:14.585 INFO:teuthology.orchestra.run.smithi088.stdout:Install 1 Package 2024-09-17T04:10:14.585 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:10:14.585 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 170 k 2024-09-17T04:10:14.585 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 494 k 2024-09-17T04:10:14.585 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2024-09-17T04:10:14.629 INFO:teuthology.orchestra.run.smithi088.stdout:rbd-nbd-19.2.0-0.el9.x86_64.rpm 3.9 MB/s | 170 kB 00:00 2024-09-17T04:10:14.629 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2024-09-17T04:10:14.630 INFO:teuthology.orchestra.run.smithi088.stdout:Total 3.7 MB/s | 170 kB 00:00 2024-09-17T04:10:14.630 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2024-09-17T04:10:14.638 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2024-09-17T04:10:14.638 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2024-09-17T04:10:14.705 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2024-09-17T04:10:14.706 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2024-09-17T04:10:14.875 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2024-09-17T04:10:14.991 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-nbd-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T04:10:15.477 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: rbd-nbd-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T04:10:15.728 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-nbd-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T04:10:15.729 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:10:15.729 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2024-09-17T04:10:15.729 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-nbd-2:19.2.0-0.el9.x86_64 2024-09-17T04:10:15.729 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:10:15.729 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-09-17T04:10:15.956 DEBUG:teuthology.parallel:result is None 2024-09-17T04:10:15.957 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T04:10:15.957 INFO:teuthology.packaging:ref: None 2024-09-17T04:10:15.957 INFO:teuthology.packaging:tag: None 2024-09-17T04:10:15.957 INFO:teuthology.packaging:branch: squid 2024-09-17T04:10:15.957 INFO:teuthology.packaging:sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T04:10:15.957 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-17T04:10:16.190 DEBUG:teuthology.orchestra.run.smithi088:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-17T04:10:16.212 INFO:teuthology.orchestra.run.smithi088.stdout:19.2.0-0.el9 2024-09-17T04:10:16.213 INFO:teuthology.packaging:The installed version of ceph is 19.2.0-0.el9 2024-09-17T04:10:16.213 INFO:teuthology.task.install:The correct ceph version 19.2.0-0 is installed. 2024-09-17T04:10:16.215 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T04:10:16.215 INFO:teuthology.packaging:ref: None 2024-09-17T04:10:16.215 INFO:teuthology.packaging:tag: None 2024-09-17T04:10:16.215 INFO:teuthology.packaging:branch: squid 2024-09-17T04:10:16.215 INFO:teuthology.packaging:sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T04:10:16.215 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-17T04:10:16.445 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-17T04:10:16.471 INFO:teuthology.orchestra.run.smithi134.stdout:19.2.0-0.el9 2024-09-17T04:10:16.471 INFO:teuthology.packaging:The installed version of ceph is 19.2.0-0.el9 2024-09-17T04:10:16.471 INFO:teuthology.task.install:The correct ceph version 19.2.0-0 is installed. 2024-09-17T04:10:16.473 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-17T04:10:16.473 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-17T04:10:16.473 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T04:10:16.500 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-17T04:10:16.500 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T04:10:16.541 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-17T04:10:16.541 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-17T04:10:16.541 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T04:10:16.567 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T04:10:16.648 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-17T04:10:16.648 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T04:10:16.677 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T04:10:16.746 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-17T04:10:16.746 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-17T04:10:16.746 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T04:10:16.772 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T04:10:16.838 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-17T04:10:16.838 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T04:10:16.867 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T04:10:16.934 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-17T04:10:16.934 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-17T04:10:16.934 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T04:10:16.959 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T04:10:17.025 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-17T04:10:17.025 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T04:10:17.051 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T04:10:17.119 INFO:teuthology.run_tasks:Running task print... 2024-09-17T04:10:17.136 INFO:teuthology.task.print:**** done install task... 2024-09-17T04:10:17.136 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-17T04:10:17.232 INFO:tasks.cephadm:Config: {'compiled_cephadm_branch': 'squid', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'global': {'mon pg warn min per osd': 0}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}}, 'image': 'quay.ceph.io/ceph-ci/ceph:squid', 'roleless': True, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'} 2024-09-17T04:10:17.233 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:squid 2024-09-17T04:10:17.233 INFO:tasks.cephadm:Cluster fsid is bf2b79a4-74aa-11ef-bceb-c7b262605968 2024-09-17T04:10:17.233 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-17T04:10:17.233 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-09-17T04:10:17.233 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi088': '172.21.15.88', 'mon.smithi134': '172.21.15.134'} 2024-09-17T04:10:17.234 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-17T04:10:17.234 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname $(hostname -s) 2024-09-17T04:10:17.259 DEBUG:teuthology.orchestra.run.smithi134:> sudo hostname $(hostname -s) 2024-09-17T04:10:17.287 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra for squid 2024-09-17T04:10:17.287 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T04:10:17.429 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83087/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-4989-gce1b342b', 'node_name': '172.21.2.1+braggi01', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-4989.gce1b342b'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-17 01:35:48.540909', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240916.200549-debug', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-17T04:10:17.633 INFO:tasks.util.chacra:got chacra host chacra.ceph.com, ref squid, sha1 8e98666cb045318799c9328f1ae906cc2d724fd2 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&ref=squid 2024-09-17T04:10:17.634 INFO:tasks.cephadm:Discovered cachra url: https://chacra.ceph.com/binaries/ceph/squid/8e98666cb045318799c9328f1ae906cc2d724fd2/centos/9/x86_64/flavors/default/cephadm 2024-09-17T04:10:17.634 INFO:tasks.cephadm:Downloading cephadm from url: https://chacra.ceph.com/binaries/ceph/squid/8e98666cb045318799c9328f1ae906cc2d724fd2/centos/9/x86_64/flavors/default/cephadm 2024-09-17T04:10:17.635 DEBUG:teuthology.orchestra.run.smithi088:> curl --silent -L https://chacra.ceph.com/binaries/ceph/squid/8e98666cb045318799c9328f1ae906cc2d724fd2/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-17T04:10:17.960 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r--. 1 ubuntu ubuntu 784488 Sep 17 04:10 /home/ubuntu/cephtest/cephadm 2024-09-17T04:10:17.960 DEBUG:teuthology.orchestra.run.smithi134:> curl --silent -L https://chacra.ceph.com/binaries/ceph/squid/8e98666cb045318799c9328f1ae906cc2d724fd2/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-17T04:10:18.253 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r--. 1 ubuntu ubuntu 784488 Sep 17 04:10 /home/ubuntu/cephtest/cephadm 2024-09-17T04:10:18.253 DEBUG:teuthology.orchestra.run.smithi088:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-17T04:10:18.273 DEBUG:teuthology.orchestra.run.smithi134:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-17T04:10:18.304 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:squid on all hosts... 2024-09-17T04:10:18.304 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid pull 2024-09-17T04:10:18.316 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid pull 2024-09-17T04:10:19.894 INFO:teuthology.orchestra.run.smithi134.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:squid... 2024-09-17T04:10:19.916 INFO:teuthology.orchestra.run.smithi088.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:squid... 2024-09-17T04:10:52.876 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T04:10:52.877 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_version": "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)", 2024-09-17T04:10:52.877 INFO:teuthology.orchestra.run.smithi134.stdout: "image_id": "ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b", 2024-09-17T04:10:52.877 INFO:teuthology.orchestra.run.smithi134.stdout: "repo_digests": [ 2024-09-17T04:10:52.877 INFO:teuthology.orchestra.run.smithi134.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3" 2024-09-17T04:10:52.877 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T04:10:52.877 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T04:11:12.384 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-17T04:11:12.385 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_version": "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)", 2024-09-17T04:11:12.385 INFO:teuthology.orchestra.run.smithi088.stdout: "image_id": "ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b", 2024-09-17T04:11:12.385 INFO:teuthology.orchestra.run.smithi088.stdout: "repo_digests": [ 2024-09-17T04:11:12.385 INFO:teuthology.orchestra.run.smithi088.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3" 2024-09-17T04:11:12.385 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-17T04:11:12.385 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-17T04:11:12.410 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /etc/ceph 2024-09-17T04:11:12.458 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /etc/ceph 2024-09-17T04:11:12.492 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 777 /etc/ceph 2024-09-17T04:11:12.520 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 777 /etc/ceph 2024-09-17T04:11:12.561 INFO:tasks.cephadm:Writing seed config... 2024-09-17T04:11:12.562 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-09-17T04:11:12.562 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-09-17T04:11:12.562 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-17T04:11:12.563 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-17T04:11:12.563 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-17T04:11:12.563 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-17T04:11:12.563 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-17T04:11:12.563 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-17T04:11:12.563 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-17T04:11:12.563 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-17T04:11:12.563 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-17T04:11:12.563 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-17T04:11:12.563 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-17T04:11:12.563 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-17T04:11:12.563 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-17T04:11:12.563 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-17T04:11:12.563 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-17T04:11:12.564 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-09-17T04:11:12.564 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-17T04:11:12.564 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-17T04:11:12.564 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-17T04:11:12.564 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-17T04:11:12.564 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-17T04:11:12.564 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-17T04:11:12.565 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-17T04:11:12.565 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-17T04:11:12.580 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = bf2b79a4-74aa-11ef-bceb-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-09-17T04:11:12.580 DEBUG:teuthology.orchestra.run.smithi088:mon.smithi088> sudo journalctl -f -n 0 -u ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968@mon.smithi088.service 2024-09-17T04:11:12.622 INFO:tasks.cephadm:Bootstrapping... 2024-09-17T04:11:12.622 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid -v bootstrap --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.88 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-17T04:11:12.825 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2024-09-17T04:11:12.825 INFO:teuthology.orchestra.run.smithi088.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:squid', '-v', 'bootstrap', '--fsid', 'bf2b79a4-74aa-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.88', '--skip-admin-label'] 2024-09-17T04:11:12.826 INFO:teuthology.orchestra.run.smithi088.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-17T04:11:12.826 INFO:teuthology.orchestra.run.smithi088.stdout:Verifying podman|docker is present... 2024-09-17T04:11:12.849 INFO:teuthology.orchestra.run.smithi088.stdout:/bin/podman: stdout 5.2.2 2024-09-17T04:11:12.850 INFO:teuthology.orchestra.run.smithi088.stdout:Verifying lvm2 is present... 2024-09-17T04:11:12.850 INFO:teuthology.orchestra.run.smithi088.stdout:Verifying time synchronization is in place... 2024-09-17T04:11:12.857 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-17T04:11:12.857 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-17T04:11:12.864 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-17T04:11:12.864 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout inactive 2024-09-17T04:11:12.870 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout enabled 2024-09-17T04:11:12.877 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout active 2024-09-17T04:11:12.877 INFO:teuthology.orchestra.run.smithi088.stdout:Unit chronyd.service is enabled and running 2024-09-17T04:11:12.877 INFO:teuthology.orchestra.run.smithi088.stdout:Repeating the final host check... 2024-09-17T04:11:12.898 INFO:teuthology.orchestra.run.smithi088.stdout:/bin/podman: stdout 5.2.2 2024-09-17T04:11:12.898 INFO:teuthology.orchestra.run.smithi088.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-17T04:11:12.898 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl is present 2024-09-17T04:11:12.898 INFO:teuthology.orchestra.run.smithi088.stdout:lvcreate is present 2024-09-17T04:11:12.906 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-17T04:11:12.906 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-17T04:11:12.911 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-17T04:11:12.911 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout inactive 2024-09-17T04:11:12.917 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout enabled 2024-09-17T04:11:12.924 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout active 2024-09-17T04:11:12.924 INFO:teuthology.orchestra.run.smithi088.stdout:Unit chronyd.service is enabled and running 2024-09-17T04:11:12.924 INFO:teuthology.orchestra.run.smithi088.stdout:Host looks OK 2024-09-17T04:11:12.924 INFO:teuthology.orchestra.run.smithi088.stdout:Cluster fsid: bf2b79a4-74aa-11ef-bceb-c7b262605968 2024-09-17T04:11:12.924 INFO:teuthology.orchestra.run.smithi088.stdout:Acquiring lock 140116283235632 on /run/cephadm/bf2b79a4-74aa-11ef-bceb-c7b262605968.lock 2024-09-17T04:11:12.924 INFO:teuthology.orchestra.run.smithi088.stdout:Lock 140116283235632 acquired on /run/cephadm/bf2b79a4-74aa-11ef-bceb-c7b262605968.lock 2024-09-17T04:11:12.925 INFO:teuthology.orchestra.run.smithi088.stdout:Verifying IP 172.21.15.88 port 3300 ... 2024-09-17T04:11:12.925 INFO:teuthology.orchestra.run.smithi088.stdout:Verifying IP 172.21.15.88 port 6789 ... 2024-09-17T04:11:12.925 INFO:teuthology.orchestra.run.smithi088.stdout:Base mon IP(s) is [172.21.15.88:3300, 172.21.15.88:6789], mon addrv is [v2:172.21.15.88:3300,v1:172.21.15.88:6789] 2024-09-17T04:11:12.928 INFO:teuthology.orchestra.run.smithi088.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.88 metric 100 2024-09-17T04:11:12.928 INFO:teuthology.orchestra.run.smithi088.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.88 metric 100 2024-09-17T04:11:12.931 INFO:teuthology.orchestra.run.smithi088.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-17T04:11:12.931 INFO:teuthology.orchestra.run.smithi088.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-17T04:11:12.931 INFO:teuthology.orchestra.run.smithi088.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-17T04:11:12.933 INFO:teuthology.orchestra.run.smithi088.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-17T04:11:12.933 INFO:teuthology.orchestra.run.smithi088.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-17T04:11:12.933 INFO:teuthology.orchestra.run.smithi088.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-17T04:11:12.933 INFO:teuthology.orchestra.run.smithi088.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-17T04:11:12.933 INFO:teuthology.orchestra.run.smithi088.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d42d/64 scope link noprefixroute 2024-09-17T04:11:12.933 INFO:teuthology.orchestra.run.smithi088.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-17T04:11:12.934 INFO:teuthology.orchestra.run.smithi088.stdout:Mon IP `172.21.15.88` is in CIDR network `172.21.0.0/20` 2024-09-17T04:11:12.934 INFO:teuthology.orchestra.run.smithi088.stdout:Mon IP `172.21.15.88` is in CIDR network `172.21.0.0/20` 2024-09-17T04:11:12.935 INFO:teuthology.orchestra.run.smithi088.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-17T04:11:12.935 INFO:teuthology.orchestra.run.smithi088.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-17T04:11:12.935 INFO:teuthology.orchestra.run.smithi088.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:squid... 2024-09-17T04:11:13.454 INFO:teuthology.orchestra.run.smithi088.stdout:/bin/podman: stdout ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b 2024-09-17T04:11:13.454 INFO:teuthology.orchestra.run.smithi088.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:squid... 2024-09-17T04:11:13.454 INFO:teuthology.orchestra.run.smithi088.stdout:/bin/podman: stderr Getting image source signatures 2024-09-17T04:11:13.454 INFO:teuthology.orchestra.run.smithi088.stdout:/bin/podman: stderr Copying blob sha256:83d928f919f2c1e0c1bd6bccd6df0f26dec4d40362b4c5deccad70d7b002219d 2024-09-17T04:11:13.454 INFO:teuthology.orchestra.run.smithi088.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-17T04:11:13.455 INFO:teuthology.orchestra.run.smithi088.stdout:/bin/podman: stderr Copying config sha256:ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b 2024-09-17T04:11:13.455 INFO:teuthology.orchestra.run.smithi088.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-17T04:11:14.400 INFO:teuthology.orchestra.run.smithi088.stdout:ceph: stdout ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable) 2024-09-17T04:11:14.401 INFO:teuthology.orchestra.run.smithi088.stdout:Ceph version: ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable) 2024-09-17T04:11:14.401 INFO:teuthology.orchestra.run.smithi088.stdout:Extracting ceph user uid/gid from container image... 2024-09-17T04:11:15.457 INFO:teuthology.orchestra.run.smithi088.stdout:stat: stdout 167 167 2024-09-17T04:11:15.457 INFO:teuthology.orchestra.run.smithi088.stdout:Creating initial keys... 2024-09-17T04:11:16.353 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph-authtool: stdout AQBjAelmZR0dLRAApzrjTxUnqaMDGPSXsTMQAQ== 2024-09-17T04:11:17.302 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph-authtool: stdout AQBkAelmzcCHKBAAnjghw8krMiZWA4VDZujprA== 2024-09-17T04:11:18.233 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph-authtool: stdout AQBlAelmBzZ4JRAAP+eN2oToatRpxk8Vqf4IjA== 2024-09-17T04:11:18.233 INFO:teuthology.orchestra.run.smithi088.stdout:Creating initial monmap... 2024-09-17T04:11:19.106 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-17T04:11:19.106 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-17T04:11:19.106 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to bf2b79a4-74aa-11ef-bceb-c7b262605968 2024-09-17T04:11:19.106 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-17T04:11:19.106 INFO:teuthology.orchestra.run.smithi088.stdout:monmaptool for smithi088 [v2:172.21.15.88:3300,v1:172.21.15.88:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-17T04:11:19.106 INFO:teuthology.orchestra.run.smithi088.stdout:setting min_mon_release = quincy 2024-09-17T04:11:19.106 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/monmaptool: set fsid to bf2b79a4-74aa-11ef-bceb-c7b262605968 2024-09-17T04:11:19.106 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-17T04:11:19.107 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:11:19.107 INFO:teuthology.orchestra.run.smithi088.stdout:Creating mon... 2024-09-17T04:11:22.855 INFO:teuthology.orchestra.run.smithi088.stdout:create mon.smithi088 on 2024-09-17T04:11:23.317 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-17T04:11:23.516 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-17T04:11:24.202 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968.target. 2024-09-17T04:11:24.202 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968.target. 2024-09-17T04:11:24.919 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968@mon.smithi088 2024-09-17T04:11:24.920 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stderr Failed to reset failed state of unit ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968@mon.smithi088.service: Unit ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968@mon.smithi088.service not loaded. 2024-09-17T04:11:25.212 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968.target.wants/ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968@mon.smithi088.service → /etc/systemd/system/ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968@.service. 2024-09-17T04:11:25.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:25 smithi088 podman[27423]: 2024-09-17 04:11:25.352407868 +0000 UTC m=+0.015780224 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:squid 2024-09-17T04:11:26.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:26 smithi088 podman[27423]: 2024-09-17 04:11:26.445221235 +0000 UTC m=+1.108593620 container create e616fdb260644aa425acb3148e18869c1e5eef45a19dbd9bb5efdacfd66508c6 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-mon-smithi088, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-17T04:11:28.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:28 smithi088 podman[27423]: 2024-09-17 04:11:28.294172521 +0000 UTC m=+2.957544870 container init e616fdb260644aa425acb3148e18869c1e5eef45a19dbd9bb5efdacfd66508c6 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-mon-smithi088, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True) 2024-09-17T04:11:28.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:28 smithi088 podman[27423]: 2024-09-17 04:11:28.298128715 +0000 UTC m=+2.961501056 container start e616fdb260644aa425acb3148e18869c1e5eef45a19dbd9bb5efdacfd66508c6 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-mon-smithi088, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=) 2024-09-17T04:11:28.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:28 smithi088 ceph-mon[27443]: mkfs bf2b79a4-74aa-11ef-bceb-c7b262605968 2024-09-17T04:11:28.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:28 smithi088 ceph-mon[27443]: mon.smithi088 is new leader, mons smithi088 in quorum (ranks 0) 2024-09-17T04:11:29.220 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-17T04:11:29.220 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout disabled 2024-09-17T04:11:29.228 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-17T04:11:29.228 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout inactive 2024-09-17T04:11:29.228 INFO:teuthology.orchestra.run.smithi088.stdout:firewalld.service is not enabled 2024-09-17T04:11:29.229 INFO:teuthology.orchestra.run.smithi088.stdout:Not possible to enable service . firewalld.service is not available 2024-09-17T04:11:29.229 INFO:teuthology.orchestra.run.smithi088.stdout:Waiting for mon to start... 2024-09-17T04:11:29.229 INFO:teuthology.orchestra.run.smithi088.stdout:Waiting for mon... 2024-09-17T04:11:29.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:29 smithi088 bash[27423]: e616fdb260644aa425acb3148e18869c1e5eef45a19dbd9bb5efdacfd66508c6 2024-09-17T04:11:29.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:29 smithi088 systemd[1]: Started Ceph mon.smithi088 for bf2b79a4-74aa-11ef-bceb-c7b262605968. 2024-09-17T04:11:29.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:29 smithi088 ceph-mon[27443]: mon.smithi088 is new leader, mons smithi088 in quorum (ranks 0) 2024-09-17T04:11:29.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:29 smithi088 ceph-mon[27443]: monmap epoch 1 2024-09-17T04:11:29.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:29 smithi088 ceph-mon[27443]: fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 2024-09-17T04:11:29.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:29 smithi088 ceph-mon[27443]: last_changed 2024-09-17T04:11:18.564226+0000 2024-09-17T04:11:29.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:29 smithi088 ceph-mon[27443]: created 2024-09-17T04:11:18.564226+0000 2024-09-17T04:11:29.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:29 smithi088 ceph-mon[27443]: min_mon_release 19 (squid) 2024-09-17T04:11:29.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:29 smithi088 ceph-mon[27443]: election_strategy: 1 2024-09-17T04:11:29.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:29 smithi088 ceph-mon[27443]: 0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.smithi088 2024-09-17T04:11:29.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:29 smithi088 ceph-mon[27443]: fsmap 2024-09-17T04:11:29.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:29 smithi088 ceph-mon[27443]: osdmap e1: 0 total, 0 up, 0 in 2024-09-17T04:11:29.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:29 smithi088 ceph-mon[27443]: mgrmap e1: no daemons active 2024-09-17T04:11:30.554 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout cluster: 2024-09-17T04:11:30.554 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout id: bf2b79a4-74aa-11ef-bceb-c7b262605968 2024-09-17T04:11:30.555 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-17T04:11:30.555 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 2024-09-17T04:11:30.555 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout services: 2024-09-17T04:11:30.555 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi088 (age 1.70945s) 2024-09-17T04:11:30.555 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-17T04:11:30.555 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-17T04:11:30.555 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 2024-09-17T04:11:30.555 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout data: 2024-09-17T04:11:30.555 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-17T04:11:30.555 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-17T04:11:30.555 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-17T04:11:30.555 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout pgs: 2024-09-17T04:11:30.556 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 2024-09-17T04:11:30.556 INFO:teuthology.orchestra.run.smithi088.stdout:mon is available 2024-09-17T04:11:30.556 INFO:teuthology.orchestra.run.smithi088.stdout:Assimilating anything we can from ceph.conf... 2024-09-17T04:11:30.607 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:30 smithi088 ceph-mon[27443]: from='client.? 172.21.15.88:0/1766227398' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-17T04:11:31.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:31 smithi088 ceph-mon[27443]: from='client.? 172.21.15.88:0/1814321850' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-17T04:11:31.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:31 smithi088 ceph-mon[27443]: from='client.? 172.21.15.88:0/1814321850' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-17T04:11:32.028 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 2024-09-17T04:11:32.028 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout [global] 2024-09-17T04:11:32.029 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout fsid = bf2b79a4-74aa-11ef-bceb-c7b262605968 2024-09-17T04:11:32.029 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.88:3300,v1:172.21.15.88:6789] 2024-09-17T04:11:32.029 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-17T04:11:32.029 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-17T04:11:32.029 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-17T04:11:32.030 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-17T04:11:32.030 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 2024-09-17T04:11:32.030 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-17T04:11:32.030 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-17T04:11:32.030 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 2024-09-17T04:11:32.030 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout [osd] 2024-09-17T04:11:32.031 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-17T04:11:32.031 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-17T04:11:32.031 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-17T04:11:32.031 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-17T04:11:32.031 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-17T04:11:32.031 INFO:teuthology.orchestra.run.smithi088.stdout:Generating new minimal ceph.conf... 2024-09-17T04:11:32.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:32 smithi088 ceph-mon[27443]: from='client.? 172.21.15.88:0/3841920840' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:11:33.098 INFO:teuthology.orchestra.run.smithi088.stdout:Restarting the monitor... 2024-09-17T04:11:33.365 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:33 smithi088 systemd[1]: Stopping Ceph mon.smithi088 for bf2b79a4-74aa-11ef-bceb-c7b262605968... 2024-09-17T04:11:33.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:33 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-mon-smithi088[27439]: 2024-09-17T04:11:33.365+0000 7f2cc151d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi088 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T04:11:33.685 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:33 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-mon-smithi088[27439]: 2024-09-17T04:11:33.365+0000 7f2cc151d640 -1 mon.smithi088@0(leader) e1 *** Got Signal Terminated *** 2024-09-17T04:11:33.685 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:33 smithi088 podman[27686]: 2024-09-17 04:11:33.50903852 +0000 UTC m=+0.253874322 container died e616fdb260644aa425acb3148e18869c1e5eef45a19dbd9bb5efdacfd66508c6 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-mon-smithi088, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T04:11:34.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:33 smithi088 podman[27686]: 2024-09-17 04:11:33.823763231 +0000 UTC m=+0.568599029 container cleanup e616fdb260644aa425acb3148e18869c1e5eef45a19dbd9bb5efdacfd66508c6 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-mon-smithi088, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-17T04:11:34.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:33 smithi088 bash[27686]: ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-mon-smithi088 2024-09-17T04:11:34.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:33 smithi088 podman[27700]: 2024-09-17 04:11:33.991304339 +0000 UTC m=+0.479623439 container remove e616fdb260644aa425acb3148e18869c1e5eef45a19dbd9bb5efdacfd66508c6 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-mon-smithi088, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T04:11:34.531 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 systemd[1]: ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968@mon.smithi088.service: Deactivated successfully. 2024-09-17T04:11:34.531 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 systemd[1]: Stopped Ceph mon.smithi088 for bf2b79a4-74aa-11ef-bceb-c7b262605968. 2024-09-17T04:11:34.531 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 systemd[1]: Starting Ceph mon.smithi088 for bf2b79a4-74aa-11ef-bceb-c7b262605968... 2024-09-17T04:11:34.531 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 podman[27791]: 2024-09-17 04:11:34.442264411 +0000 UTC m=+0.106656538 container create bbeb722f42bcd0d13e6217f8943f7e6fd8a8b06d1e68f8040ba46456b56fa8cc (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-mon-smithi088, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T04:11:34.531 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 podman[27791]: 2024-09-17 04:11:34.351208934 +0000 UTC m=+0.015601025 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:squid 2024-09-17T04:11:34.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 podman[27791]: 2024-09-17 04:11:34.636085582 +0000 UTC m=+0.300477664 container init bbeb722f42bcd0d13e6217f8943f7e6fd8a8b06d1e68f8040ba46456b56fa8cc (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-mon-smithi088, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T04:11:34.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 podman[27791]: 2024-09-17 04:11:34.639265113 +0000 UTC m=+0.303657197 container start bbeb722f42bcd0d13e6217f8943f7e6fd8a8b06d1e68f8040ba46456b56fa8cc (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-mon-smithi088, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-17T04:11:34.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: set uid:gid to 167:167 (ceph:ceph) 2024-09-17T04:11:34.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable), process ceph-mon, pid 2 2024-09-17T04:11:34.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: pidfile_write: ignore empty --pid-file 2024-09-17T04:11:34.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: load: jerasure load: lrc 2024-09-17T04:11:34.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: RocksDB version: 7.9.2 2024-09-17T04:11:34.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Git sha 0 2024-09-17T04:11:34.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Compile date 2024-09-16 15:09:42 2024-09-17T04:11:34.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: DB SUMMARY 2024-09-17T04:11:34.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: DB Session ID: GQDR9ZM757ATRKTSUP0L 2024-09-17T04:11:34.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: CURRENT file: CURRENT 2024-09-17T04:11:34.890 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: IDENTITY file: IDENTITY 2024-09-17T04:11:34.890 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-17T04:11:34.890 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi088/store.db dir, Total Num: 1, files: 000008.sst 2024-09-17T04:11:34.890 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi088/store.db: 000009.log size: 95264 ; 2024-09-17T04:11:34.890 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.error_if_exists: 0 2024-09-17T04:11:34.890 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.create_if_missing: 0 2024-09-17T04:11:34.890 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.paranoid_checks: 1 2024-09-17T04:11:34.890 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-17T04:11:34.890 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-17T04:11:34.890 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-17T04:11:34.890 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.env: 0x56116b7d4940 2024-09-17T04:11:34.891 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.fs: PosixFileSystem 2024-09-17T04:11:34.891 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.info_log: 0x56116c0c38c0 2024-09-17T04:11:34.891 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.max_file_opening_threads: 16 2024-09-17T04:11:34.891 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.statistics: (nil) 2024-09-17T04:11:34.891 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.use_fsync: 0 2024-09-17T04:11:34.891 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.max_log_file_size: 0 2024-09-17T04:11:34.891 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-17T04:11:34.891 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-17T04:11:34.891 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.keep_log_file_num: 1000 2024-09-17T04:11:34.891 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.recycle_log_file_num: 0 2024-09-17T04:11:34.891 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.allow_fallocate: 1 2024-09-17T04:11:34.891 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.allow_mmap_reads: 0 2024-09-17T04:11:34.891 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.allow_mmap_writes: 0 2024-09-17T04:11:34.892 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.use_direct_reads: 0 2024-09-17T04:11:34.892 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-17T04:11:34.892 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.create_missing_column_families: 0 2024-09-17T04:11:34.892 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.db_log_dir: 2024-09-17T04:11:34.892 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.wal_dir: 2024-09-17T04:11:34.892 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-17T04:11:34.892 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-17T04:11:34.892 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-17T04:11:34.892 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-17T04:11:34.892 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-17T04:11:34.892 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-17T04:11:34.892 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.advise_random_on_open: 1 2024-09-17T04:11:34.892 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.db_write_buffer_size: 0 2024-09-17T04:11:34.893 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.write_buffer_manager: 0x56116c0d2dc0 2024-09-17T04:11:34.893 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-17T04:11:34.893 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-17T04:11:34.893 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-17T04:11:34.893 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.rate_limiter: (nil) 2024-09-17T04:11:34.893 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-17T04:11:34.893 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.wal_recovery_mode: 2 2024-09-17T04:11:34.893 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.enable_thread_tracking: 0 2024-09-17T04:11:34.893 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.enable_pipelined_write: 0 2024-09-17T04:11:34.893 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.unordered_write: 0 2024-09-17T04:11:34.893 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-17T04:11:34.893 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-17T04:11:34.893 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-17T04:11:34.893 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-17T04:11:34.894 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.row_cache: None 2024-09-17T04:11:34.894 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.wal_filter: None 2024-09-17T04:11:34.894 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-17T04:11:34.894 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.allow_ingest_behind: 0 2024-09-17T04:11:34.895 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.two_write_queues: 0 2024-09-17T04:11:34.895 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.manual_wal_flush: 0 2024-09-17T04:11:34.895 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.wal_compression: 0 2024-09-17T04:11:34.895 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.atomic_flush: 0 2024-09-17T04:11:34.895 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-17T04:11:34.895 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-17T04:11:34.895 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-17T04:11:34.896 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.log_readahead_size: 0 2024-09-17T04:11:34.896 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-17T04:11:34.896 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.best_efforts_recovery: 0 2024-09-17T04:11:34.896 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-17T04:11:34.896 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-17T04:11:34.896 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.allow_data_in_errors: 0 2024-09-17T04:11:34.896 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.db_host_id: __hostname__ 2024-09-17T04:11:34.896 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-17T04:11:34.896 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.max_background_jobs: 2 2024-09-17T04:11:34.896 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.max_background_compactions: -1 2024-09-17T04:11:34.896 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.max_subcompactions: 1 2024-09-17T04:11:34.897 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-17T04:11:34.897 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-17T04:11:34.897 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-17T04:11:34.897 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.max_total_wal_size: 0 2024-09-17T04:11:34.897 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-17T04:11:34.897 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-17T04:11:34.897 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-17T04:11:34.897 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-17T04:11:34.897 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.max_open_files: -1 2024-09-17T04:11:34.897 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.bytes_per_sync: 0 2024-09-17T04:11:34.897 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-17T04:11:34.897 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-17T04:11:34.897 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.compaction_readahead_size: 0 2024-09-17T04:11:34.897 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.max_background_flushes: -1 2024-09-17T04:11:34.898 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Compression algorithms supported: 2024-09-17T04:11:34.898 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: kZSTD supported: 0 2024-09-17T04:11:34.898 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: kXpressCompression supported: 0 2024-09-17T04:11:34.898 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: kBZip2Compression supported: 0 2024-09-17T04:11:34.898 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-17T04:11:34.898 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: kLZ4Compression supported: 1 2024-09-17T04:11:34.898 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: kZlibCompression supported: 1 2024-09-17T04:11:34.898 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: kLZ4HCCompression supported: 1 2024-09-17T04:11:34.898 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: kSnappyCompression supported: 1 2024-09-17T04:11:34.898 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-17T04:11:34.898 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-17T04:11:34.898 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi088/store.db/MANIFEST-000010 2024-09-17T04:11:34.898 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-17T04:11:34.898 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-17T04:11:34.898 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.merge_operator: 2024-09-17T04:11:34.899 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.compaction_filter: None 2024-09-17T04:11:34.899 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.compaction_filter_factory: None 2024-09-17T04:11:34.899 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.sst_partitioner_factory: None 2024-09-17T04:11:34.899 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-17T04:11:34.899 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-17T04:11:34.899 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56116c0c3520) 2024-09-17T04:11:34.899 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: cache_index_and_filter_blocks: 1 2024-09-17T04:11:34.899 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-17T04:11:34.899 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-17T04:11:34.899 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: pin_top_level_index_and_filter: 1 2024-09-17T04:11:34.899 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: index_type: 0 2024-09-17T04:11:34.899 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: data_block_index_type: 0 2024-09-17T04:11:34.899 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: index_shortening: 1 2024-09-17T04:11:34.900 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-17T04:11:34.900 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: checksum: 4 2024-09-17T04:11:34.900 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: no_block_cache: 0 2024-09-17T04:11:34.900 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: block_cache: 0x56116c0b71f0 2024-09-17T04:11:34.900 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: block_cache_name: BinnedLRUCache 2024-09-17T04:11:34.900 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: block_cache_options: 2024-09-17T04:11:34.900 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: capacity : 536870912 2024-09-17T04:11:34.900 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: num_shard_bits : 4 2024-09-17T04:11:34.900 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: strict_capacity_limit : 0 2024-09-17T04:11:34.900 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: high_pri_pool_ratio: 0.000 2024-09-17T04:11:34.900 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: block_cache_compressed: (nil) 2024-09-17T04:11:34.900 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: persistent_cache: (nil) 2024-09-17T04:11:34.901 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: block_size: 4096 2024-09-17T04:11:34.901 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: block_size_deviation: 10 2024-09-17T04:11:34.901 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: block_restart_interval: 16 2024-09-17T04:11:34.901 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: index_block_restart_interval: 1 2024-09-17T04:11:34.901 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: metadata_block_size: 4096 2024-09-17T04:11:34.901 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: partition_filters: 0 2024-09-17T04:11:34.901 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: use_delta_encoding: 1 2024-09-17T04:11:34.901 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: filter_policy: bloomfilter 2024-09-17T04:11:34.901 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: whole_key_filtering: 1 2024-09-17T04:11:34.901 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: verify_compression: 0 2024-09-17T04:11:34.901 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: read_amp_bytes_per_bit: 0 2024-09-17T04:11:34.901 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: format_version: 5 2024-09-17T04:11:34.901 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: enable_index_compression: 1 2024-09-17T04:11:34.902 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: block_align: 0 2024-09-17T04:11:34.902 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: max_auto_readahead_size: 262144 2024-09-17T04:11:34.902 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: prepopulate_block_cache: 0 2024-09-17T04:11:34.902 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: initial_auto_readahead_size: 8192 2024-09-17T04:11:34.902 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: num_file_reads_for_auto_readahead: 2 2024-09-17T04:11:34.902 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.write_buffer_size: 33554432 2024-09-17T04:11:34.902 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.max_write_buffer_number: 2 2024-09-17T04:11:34.902 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.compression: NoCompression 2024-09-17T04:11:34.902 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.bottommost_compression: Disabled 2024-09-17T04:11:34.902 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.prefix_extractor: nullptr 2024-09-17T04:11:34.902 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-17T04:11:34.902 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.num_levels: 7 2024-09-17T04:11:34.902 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-17T04:11:34.902 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-17T04:11:34.903 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-17T04:11:34.903 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-17T04:11:34.903 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-17T04:11:34.903 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-17T04:11:34.903 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-17T04:11:34.903 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-17T04:11:34.903 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-17T04:11:34.903 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-17T04:11:34.903 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-17T04:11:34.903 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-17T04:11:34.903 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-17T04:11:34.903 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.compression_opts.level: 32767 2024-09-17T04:11:34.904 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.compression_opts.strategy: 0 2024-09-17T04:11:34.904 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-17T04:11:34.904 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-17T04:11:34.904 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-17T04:11:34.904 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-17T04:11:34.904 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.compression_opts.enabled: false 2024-09-17T04:11:34.904 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-17T04:11:34.904 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-17T04:11:34.904 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-17T04:11:34.904 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-17T04:11:34.904 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.target_file_size_base: 67108864 2024-09-17T04:11:34.904 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-17T04:11:34.904 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-17T04:11:34.904 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-17T04:11:34.905 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-17T04:11:34.905 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-17T04:11:34.905 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-17T04:11:34.905 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-17T04:11:34.905 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-17T04:11:34.905 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-17T04:11:34.905 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-17T04:11:34.905 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-17T04:11:34.905 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-17T04:11:34.905 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-17T04:11:34.905 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-17T04:11:34.905 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.arena_block_size: 1048576 2024-09-17T04:11:34.905 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-17T04:11:34.906 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-17T04:11:34.906 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.disable_auto_compactions: 0 2024-09-17T04:11:34.906 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-17T04:11:34.906 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-17T04:11:34.906 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-17T04:11:34.906 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-17T04:11:34.906 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-17T04:11:34.906 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-17T04:11:34.906 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-17T04:11:34.906 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-17T04:11:34.906 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-17T04:11:34.906 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-17T04:11:34.906 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-17T04:11:34.907 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.inplace_update_support: 0 2024-09-17T04:11:34.907 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-17T04:11:34.907 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-17T04:11:34.907 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-17T04:11:34.907 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-17T04:11:34.907 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.bloom_locality: 0 2024-09-17T04:11:34.907 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.max_successive_merges: 0 2024-09-17T04:11:34.907 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-17T04:11:34.907 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.paranoid_file_checks: 0 2024-09-17T04:11:34.907 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.force_consistency_checks: 1 2024-09-17T04:11:34.907 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.report_bg_io_stats: 0 2024-09-17T04:11:34.907 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.ttl: 2592000 2024-09-17T04:11:34.907 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-17T04:11:34.907 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-17T04:11:34.908 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-17T04:11:34.908 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.enable_blob_files: false 2024-09-17T04:11:34.908 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.min_blob_size: 0 2024-09-17T04:11:34.908 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.blob_file_size: 268435456 2024-09-17T04:11:34.908 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-17T04:11:34.908 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-17T04:11:34.908 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-17T04:11:34.908 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-17T04:11:34.908 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-17T04:11:34.908 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.blob_file_starting_level: 0 2024-09-17T04:11:34.908 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-17T04:11:34.908 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi088/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-17T04:11:34.908 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-17T04:11:34.909 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 2e427fae-164b-4a81-bc04-59a083d43a88 2024-09-17T04:11:34.909 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726546294665820, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-17T04:11:34.909 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-17T04:11:34.909 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726546294667180, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 91192, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 290, "table_properties": {"data_size": 89238, "index_size": 274, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11720, "raw_average_key_size": 47, "raw_value_size": 82702, "raw_average_value_size": 337, "num_data_blocks": 12, "num_entries": 245, "num_filter_entries": 245, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726546294, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "2e427fae-164b-4a81-bc04-59a083d43a88", "db_session_id": "GQDR9ZM757ATRKTSUP0L", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-17T04:11:34.909 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726546294667306, "job": 1, "event": "recovery_finished"} 2024-09-17T04:11:34.909 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-17T04:11:34.909 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi088/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-17T04:11:34.909 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56116c0e4e00 2024-09-17T04:11:34.909 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: DB pointer 0x56116c1e0000 2024-09-17T04:11:34.909 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-17T04:11:34.909 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-17T04:11:34.910 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: ** DB Stats ** 2024-09-17T04:11:34.910 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T04:11:34.910 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-17T04:11:34.910 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T04:11:34.910 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T04:11:34.910 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-17T04:11:34.910 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T04:11:34.910 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T04:11:34.910 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: 2024-09-17T04:11:34.910 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: ** Compaction Stats [default] ** 2024-09-17T04:11:34.910 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T04:11:34.910 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-17T04:11:34.910 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: L0 2/0 90.95 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 99.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-17T04:11:34.911 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Sum 2/0 90.95 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 99.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-17T04:11:34.911 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 99.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-17T04:11:34.911 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: 2024-09-17T04:11:34.911 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: ** Compaction Stats [default] ** 2024-09-17T04:11:34.911 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T04:11:34.911 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-17T04:11:34.911 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 99.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-17T04:11:34.911 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: 2024-09-17T04:11:34.911 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-17T04:11:34.911 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: 2024-09-17T04:11:34.911 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T04:11:34.911 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-17T04:11:34.911 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-17T04:11:34.911 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-17T04:11:34.912 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-17T04:11:34.912 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-17T04:11:34.912 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Cumulative compaction: 0.00 GB write, 20.03 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T04:11:34.912 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Interval compaction: 0.00 GB write, 20.03 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T04:11:34.912 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-17T04:11:34.912 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Block cache BinnedLRUCache@0x56116c0b71f0#2 capacity: 512.00 MB usage: 1.30 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2024-09-17T04:11:34.912 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.83 KB,0.000157952%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-17T04:11:34.912 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: 2024-09-17T04:11:34.912 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-17T04:11:34.912 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: starting mon.smithi088 rank 0 at public addrs [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] at bind addrs [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi088 fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 2024-09-17T04:11:34.912 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: mon.smithi088@-1(???) e1 preinit fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 2024-09-17T04:11:34.912 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: mon.smithi088@-1(???).mds e1 new map 2024-09-17T04:11:34.913 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: mon.smithi088@-1(???).mds e1 print_map 2024-09-17T04:11:34.913 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: e1 2024-09-17T04:11:34.913 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: btime 2024-09-17T04:11:28:340180+0000 2024-09-17T04:11:34.913 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T04:11:34.913 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:11:34.913 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: legacy client fscid: -1 2024-09-17T04:11:34.913 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: 2024-09-17T04:11:34.913 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: No filesystems configured 2024-09-17T04:11:34.913 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: mon.smithi088@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-17T04:11:34.913 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: mon.smithi088@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-17T04:11:34.913 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: mon.smithi088@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-17T04:11:34.913 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: mon.smithi088@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-17T04:11:34.913 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: mon.smithi088@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-17T04:11:34.914 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: mon.smithi088 is new leader, mons smithi088 in quorum (ranks 0) 2024-09-17T04:11:34.914 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: monmap epoch 1 2024-09-17T04:11:34.914 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 2024-09-17T04:11:34.914 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: last_changed 2024-09-17T04:11:18.564226+0000 2024-09-17T04:11:34.914 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: created 2024-09-17T04:11:18.564226+0000 2024-09-17T04:11:34.914 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: min_mon_release 19 (squid) 2024-09-17T04:11:34.914 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: election_strategy: 1 2024-09-17T04:11:34.914 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: 0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.smithi088 2024-09-17T04:11:34.914 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: fsmap 2024-09-17T04:11:34.914 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: osdmap e1: 0 total, 0 up, 0 in 2024-09-17T04:11:34.914 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:34 smithi088 ceph-mon[27811]: mgrmap e1: no daemons active 2024-09-17T04:11:35.326 INFO:teuthology.orchestra.run.smithi088.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-17T04:11:35.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:35 smithi088 bash[27791]: bbeb722f42bcd0d13e6217f8943f7e6fd8a8b06d1e68f8040ba46456b56fa8cc 2024-09-17T04:11:35.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:35 smithi088 systemd[1]: Started Ceph mon.smithi088 for bf2b79a4-74aa-11ef-bceb-c7b262605968. 2024-09-17T04:11:37.360 INFO:teuthology.orchestra.run.smithi088.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-17T04:11:37.373 INFO:teuthology.orchestra.run.smithi088.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-17T04:11:37.373 INFO:teuthology.orchestra.run.smithi088.stdout:Creating mgr... 2024-09-17T04:11:37.373 INFO:teuthology.orchestra.run.smithi088.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-17T04:11:37.374 INFO:teuthology.orchestra.run.smithi088.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-17T04:11:37.374 INFO:teuthology.orchestra.run.smithi088.stdout:Verifying port 0.0.0.0:8443 ... 2024-09-17T04:11:37.636 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968@mgr.smithi088.wmndiv 2024-09-17T04:11:37.637 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stderr Failed to reset failed state of unit ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968@mgr.smithi088.wmndiv.service: Unit ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968@mgr.smithi088.wmndiv.service not loaded. 2024-09-17T04:11:37.787 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968.target.wants/ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968@mgr.smithi088.wmndiv.service → /etc/systemd/system/ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968@.service. 2024-09-17T04:11:37.992 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:37 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/1707073199' entity='client.admin' 2024-09-17T04:11:38.316 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-17T04:11:38.316 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout disabled 2024-09-17T04:11:38.323 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-17T04:11:38.324 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout inactive 2024-09-17T04:11:38.324 INFO:teuthology.orchestra.run.smithi088.stdout:firewalld.service is not enabled 2024-09-17T04:11:38.324 INFO:teuthology.orchestra.run.smithi088.stdout:Not possible to enable service . firewalld.service is not available 2024-09-17T04:11:38.333 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-17T04:11:38.333 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout disabled 2024-09-17T04:11:38.341 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-17T04:11:38.341 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout inactive 2024-09-17T04:11:38.341 INFO:teuthology.orchestra.run.smithi088.stdout:firewalld.service is not enabled 2024-09-17T04:11:38.341 INFO:teuthology.orchestra.run.smithi088.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-09-17T04:11:38.342 INFO:teuthology.orchestra.run.smithi088.stdout:Waiting for mgr to start... 2024-09-17T04:11:38.342 INFO:teuthology.orchestra.run.smithi088.stdout:Waiting for mgr... 2024-09-17T04:11:39.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:38 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/2641422924' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-17T04:11:39.395 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 2024-09-17T04:11:39.401 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout { 2024-09-17T04:11:39.401 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "fsid": "bf2b79a4-74aa-11ef-bceb-c7b262605968", 2024-09-17T04:11:39.401 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "health": { 2024-09-17T04:11:39.401 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-17T04:11:39.401 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-17T04:11:39.401 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-17T04:11:39.401 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2024-09-17T04:11:39.402 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-17T04:11:39.402 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-17T04:11:39.402 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 0 2024-09-17T04:11:39.402 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout ], 2024-09-17T04:11:39.402 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-17T04:11:39.402 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "smithi088" 2024-09-17T04:11:39.402 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout ], 2024-09-17T04:11:39.402 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "quorum_age": 4, 2024-09-17T04:11:39.402 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-17T04:11:39.402 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T04:11:39.402 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-17T04:11:39.402 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-17T04:11:39.402 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2024-09-17T04:11:39.403 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-17T04:11:39.403 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T04:11:39.403 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-17T04:11:39.403 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-17T04:11:39.403 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-17T04:11:39.403 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-17T04:11:39.403 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-17T04:11:39.403 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-17T04:11:39.403 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2024-09-17T04:11:39.403 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-17T04:11:39.403 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-17T04:11:39.403 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-17T04:11:39.403 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-17T04:11:39.403 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-17T04:11:39.404 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-17T04:11:39.404 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-17T04:11:39.404 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-17T04:11:39.404 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-17T04:11:39.404 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2024-09-17T04:11:39.404 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-17T04:11:39.404 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T04:11:39.404 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "btime": "2024-09-17T04:11:28:340180+0000", 2024-09-17T04:11:39.404 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-17T04:11:39.404 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-17T04:11:39.404 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2024-09-17T04:11:39.404 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-17T04:11:39.404 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-17T04:11:39.404 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-17T04:11:39.405 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-17T04:11:39.405 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-17T04:11:39.405 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-17T04:11:39.405 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "restful" 2024-09-17T04:11:39.405 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout ], 2024-09-17T04:11:39.405 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T04:11:39.405 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2024-09-17T04:11:39.405 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-17T04:11:39.405 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T04:11:39.405 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "modified": "2024-09-17T04:11:28.340918+0000", 2024-09-17T04:11:39.405 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T04:11:39.405 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2024-09-17T04:11:39.405 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-17T04:11:39.405 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout } 2024-09-17T04:11:39.406 INFO:teuthology.orchestra.run.smithi088.stdout:mgr not available, waiting (1/15)... 2024-09-17T04:11:42.198 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:42 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/1611547193' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-17T04:11:42.684 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 2024-09-17T04:11:42.685 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout { 2024-09-17T04:11:42.685 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "fsid": "bf2b79a4-74aa-11ef-bceb-c7b262605968", 2024-09-17T04:11:42.685 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "health": { 2024-09-17T04:11:42.685 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-17T04:11:42.685 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-17T04:11:42.685 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-17T04:11:42.685 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2024-09-17T04:11:42.685 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-17T04:11:42.685 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-17T04:11:42.685 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 0 2024-09-17T04:11:42.685 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout ], 2024-09-17T04:11:42.686 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-17T04:11:42.686 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "smithi088" 2024-09-17T04:11:42.686 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout ], 2024-09-17T04:11:42.686 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2024-09-17T04:11:42.686 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-17T04:11:42.686 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T04:11:42.686 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-17T04:11:42.686 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-17T04:11:42.686 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2024-09-17T04:11:42.686 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-17T04:11:42.686 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T04:11:42.686 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-17T04:11:42.686 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-17T04:11:42.687 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-17T04:11:42.687 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-17T04:11:42.687 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-17T04:11:42.687 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-17T04:11:42.687 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2024-09-17T04:11:42.687 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-17T04:11:42.687 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-17T04:11:42.687 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-17T04:11:42.687 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-17T04:11:42.687 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-17T04:11:42.687 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-17T04:11:42.687 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-17T04:11:42.687 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-17T04:11:42.687 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-17T04:11:42.688 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2024-09-17T04:11:42.688 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-17T04:11:42.688 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T04:11:42.688 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "btime": "2024-09-17T04:11:28:340180+0000", 2024-09-17T04:11:42.688 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-17T04:11:42.688 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-17T04:11:42.688 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2024-09-17T04:11:42.688 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-17T04:11:42.688 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-17T04:11:42.688 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-17T04:11:42.688 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-17T04:11:42.688 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-17T04:11:42.688 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-17T04:11:42.688 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "restful" 2024-09-17T04:11:42.688 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout ], 2024-09-17T04:11:42.689 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T04:11:42.689 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2024-09-17T04:11:42.689 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-17T04:11:42.689 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T04:11:42.689 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "modified": "2024-09-17T04:11:28.340918+0000", 2024-09-17T04:11:42.689 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T04:11:42.689 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2024-09-17T04:11:42.689 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-17T04:11:42.689 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout } 2024-09-17T04:11:42.689 INFO:teuthology.orchestra.run.smithi088.stdout:mgr not available, waiting (2/15)... 2024-09-17T04:11:43.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:43 smithi088 ceph-mon[27811]: Activating manager daemon smithi088.wmndiv 2024-09-17T04:11:43.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:43 smithi088 ceph-mon[27811]: mgrmap e2: smithi088.wmndiv(active, starting, since 0.00298935s) 2024-09-17T04:11:43.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:43 smithi088 ceph-mon[27811]: from='mgr.14100 172.21.15.88:0/1274287008' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T04:11:43.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:43 smithi088 ceph-mon[27811]: from='mgr.14100 172.21.15.88:0/1274287008' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T04:11:43.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:43 smithi088 ceph-mon[27811]: from='mgr.14100 172.21.15.88:0/1274287008' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T04:11:43.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:43 smithi088 ceph-mon[27811]: from='mgr.14100 172.21.15.88:0/1274287008' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2024-09-17T04:11:43.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:43 smithi088 ceph-mon[27811]: from='mgr.14100 172.21.15.88:0/1274287008' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mgr metadata", "who": "smithi088.wmndiv", "id": "smithi088.wmndiv"}]: dispatch 2024-09-17T04:11:43.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:43 smithi088 ceph-mon[27811]: Manager daemon smithi088.wmndiv is now available 2024-09-17T04:11:43.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:43 smithi088 ceph-mon[27811]: from='mgr.14100 172.21.15.88:0/1274287008' entity='mgr.smithi088.wmndiv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi088.wmndiv/mirror_snapshot_schedule"}]: dispatch 2024-09-17T04:11:43.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:43 smithi088 ceph-mon[27811]: from='mgr.14100 172.21.15.88:0/1274287008' entity='mgr.smithi088.wmndiv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi088.wmndiv/trash_purge_schedule"}]: dispatch 2024-09-17T04:11:43.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:43 smithi088 ceph-mon[27811]: from='mgr.14100 172.21.15.88:0/1274287008' entity='mgr.smithi088.wmndiv' 2024-09-17T04:11:43.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:43 smithi088 ceph-mon[27811]: from='mgr.14100 172.21.15.88:0/1274287008' entity='mgr.smithi088.wmndiv' 2024-09-17T04:11:43.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:43 smithi088 ceph-mon[27811]: from='mgr.14100 172.21.15.88:0/1274287008' entity='mgr.smithi088.wmndiv' 2024-09-17T04:11:45.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:45 smithi088 ceph-mon[27811]: mgrmap e3: smithi088.wmndiv(active, since 1.00591s) 2024-09-17T04:11:45.932 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 2024-09-17T04:11:45.932 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout { 2024-09-17T04:11:45.932 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "fsid": "bf2b79a4-74aa-11ef-bceb-c7b262605968", 2024-09-17T04:11:45.932 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "health": { 2024-09-17T04:11:45.932 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-17T04:11:45.932 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-17T04:11:45.932 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-17T04:11:45.933 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2024-09-17T04:11:45.933 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-17T04:11:45.933 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-17T04:11:45.933 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 0 2024-09-17T04:11:45.933 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout ], 2024-09-17T04:11:45.933 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-17T04:11:45.933 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "smithi088" 2024-09-17T04:11:45.933 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout ], 2024-09-17T04:11:45.933 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-09-17T04:11:45.933 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-17T04:11:45.933 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T04:11:45.934 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-17T04:11:45.934 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-17T04:11:45.934 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2024-09-17T04:11:45.934 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-17T04:11:45.934 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T04:11:45.934 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-17T04:11:45.934 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-17T04:11:45.934 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-17T04:11:45.934 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-17T04:11:45.934 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-17T04:11:45.935 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-17T04:11:45.935 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2024-09-17T04:11:45.935 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-17T04:11:45.935 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-17T04:11:45.935 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-17T04:11:45.935 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-17T04:11:45.935 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-17T04:11:45.935 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-17T04:11:45.935 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-17T04:11:45.935 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-17T04:11:45.935 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-17T04:11:45.935 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2024-09-17T04:11:45.935 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-17T04:11:45.935 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T04:11:45.935 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "btime": "2024-09-17T04:11:28:340180+0000", 2024-09-17T04:11:45.936 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-17T04:11:45.936 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-17T04:11:45.936 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2024-09-17T04:11:45.936 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-17T04:11:45.936 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-17T04:11:45.936 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-17T04:11:45.936 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-17T04:11:45.936 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-17T04:11:45.936 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-17T04:11:45.936 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "restful" 2024-09-17T04:11:45.936 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout ], 2024-09-17T04:11:45.936 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T04:11:45.936 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2024-09-17T04:11:45.936 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-17T04:11:45.936 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T04:11:45.937 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "modified": "2024-09-17T04:11:28.340918+0000", 2024-09-17T04:11:45.937 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T04:11:45.937 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2024-09-17T04:11:45.937 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-17T04:11:45.937 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout } 2024-09-17T04:11:45.937 INFO:teuthology.orchestra.run.smithi088.stdout:mgr is available 2024-09-17T04:11:46.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:46 smithi088 ceph-mon[27811]: mgrmap e4: smithi088.wmndiv(active, since 2s) 2024-09-17T04:11:46.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:46 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/4133917115' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-17T04:11:47.092 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 2024-09-17T04:11:47.092 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout [global] 2024-09-17T04:11:47.092 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout fsid = bf2b79a4-74aa-11ef-bceb-c7b262605968 2024-09-17T04:11:47.092 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.88:3300,v1:172.21.15.88:6789] 2024-09-17T04:11:47.092 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-17T04:11:47.093 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-17T04:11:47.093 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-17T04:11:47.093 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-17T04:11:47.093 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 2024-09-17T04:11:47.093 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-17T04:11:47.093 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-17T04:11:47.093 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 2024-09-17T04:11:47.093 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout [osd] 2024-09-17T04:11:47.093 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-17T04:11:47.093 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-17T04:11:47.093 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-17T04:11:47.093 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-17T04:11:47.093 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-17T04:11:47.093 INFO:teuthology.orchestra.run.smithi088.stdout:Enabling cephadm module... 2024-09-17T04:11:47.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:47 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/3261290460' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-17T04:11:48.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:48 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/1938454425' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-17T04:11:49.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:49 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/1938454425' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-17T04:11:49.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:49 smithi088 ceph-mon[27811]: mgrmap e5: smithi088.wmndiv(active, since 5s) 2024-09-17T04:11:50.045 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout { 2024-09-17T04:11:50.045 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-17T04:11:50.045 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-17T04:11:50.046 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "active_name": "smithi088.wmndiv", 2024-09-17T04:11:50.046 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-17T04:11:50.046 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout } 2024-09-17T04:11:50.046 INFO:teuthology.orchestra.run.smithi088.stdout:Waiting for the mgr to restart... 2024-09-17T04:11:50.046 INFO:teuthology.orchestra.run.smithi088.stdout:Waiting for mgr epoch 5... 2024-09-17T04:11:50.284 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:50 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/1552391786' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-17T04:11:53.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:52 smithi088 ceph-mon[27811]: Active manager daemon smithi088.wmndiv restarted 2024-09-17T04:11:53.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:52 smithi088 ceph-mon[27811]: Activating manager daemon smithi088.wmndiv 2024-09-17T04:11:53.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:52 smithi088 ceph-mon[27811]: osdmap e2: 0 total, 0 up, 0 in 2024-09-17T04:11:53.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:52 smithi088 ceph-mon[27811]: mgrmap e6: smithi088.wmndiv(active, starting, since 0.00321433s) 2024-09-17T04:11:53.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:52 smithi088 ceph-mon[27811]: from='mgr.14118 172.21.15.88:0/3595849702' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2024-09-17T04:11:53.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:52 smithi088 ceph-mon[27811]: from='mgr.14118 172.21.15.88:0/3595849702' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mgr metadata", "who": "smithi088.wmndiv", "id": "smithi088.wmndiv"}]: dispatch 2024-09-17T04:11:53.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:52 smithi088 ceph-mon[27811]: from='mgr.14118 172.21.15.88:0/3595849702' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T04:11:53.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:52 smithi088 ceph-mon[27811]: from='mgr.14118 172.21.15.88:0/3595849702' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T04:11:53.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:52 smithi088 ceph-mon[27811]: from='mgr.14118 172.21.15.88:0/3595849702' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T04:11:53.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:52 smithi088 ceph-mon[27811]: Manager daemon smithi088.wmndiv is now available 2024-09-17T04:11:53.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:52 smithi088 ceph-mon[27811]: from='mgr.14118 172.21.15.88:0/3595849702' entity='mgr.smithi088.wmndiv' 2024-09-17T04:11:53.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:52 smithi088 ceph-mon[27811]: from='mgr.14118 172.21.15.88:0/3595849702' entity='mgr.smithi088.wmndiv' 2024-09-17T04:11:53.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:52 smithi088 ceph-mon[27811]: from='mgr.14118 172.21.15.88:0/3595849702' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:11:53.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:52 smithi088 ceph-mon[27811]: from='mgr.14118 172.21.15.88:0/3595849702' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:11:53.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:52 smithi088 ceph-mon[27811]: from='mgr.14118 172.21.15.88:0/3595849702' entity='mgr.smithi088.wmndiv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi088.wmndiv/mirror_snapshot_schedule"}]: dispatch 2024-09-17T04:11:53.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:52 smithi088 ceph-mon[27811]: from='mgr.14118 172.21.15.88:0/3595849702' entity='mgr.smithi088.wmndiv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi088.wmndiv/trash_purge_schedule"}]: dispatch 2024-09-17T04:11:54.264 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:53 smithi088 ceph-mon[27811]: Found migration_current of "None". Setting to last migration. 2024-09-17T04:11:54.264 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:53 smithi088 ceph-mon[27811]: from='mgr.14118 172.21.15.88:0/3595849702' entity='mgr.smithi088.wmndiv' 2024-09-17T04:11:54.265 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:53 smithi088 ceph-mon[27811]: from='mgr.14118 172.21.15.88:0/3595849702' entity='mgr.smithi088.wmndiv' 2024-09-17T04:11:54.265 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:53 smithi088 ceph-mon[27811]: mgrmap e7: smithi088.wmndiv(active, since 1.00552s) 2024-09-17T04:11:54.517 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout { 2024-09-17T04:11:54.518 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-17T04:11:54.518 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-17T04:11:54.518 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout } 2024-09-17T04:11:54.518 INFO:teuthology.orchestra.run.smithi088.stdout:mgr epoch 5 is available 2024-09-17T04:11:54.518 INFO:teuthology.orchestra.run.smithi088.stdout:Setting orchestrator backend to cephadm... 2024-09-17T04:11:55.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:54 smithi088 ceph-mon[27811]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-17T04:11:55.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:54 smithi088 ceph-mon[27811]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-17T04:11:55.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:54 smithi088 ceph-mon[27811]: from='mgr.14118 172.21.15.88:0/3595849702' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:11:56.296 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:55 smithi088 ceph-mon[27811]: [17/Sep/2024:04:11:54] ENGINE Bus STARTING 2024-09-17T04:11:56.296 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:55 smithi088 ceph-mon[27811]: [17/Sep/2024:04:11:54] ENGINE Serving on http://172.21.15.88:8765 2024-09-17T04:11:56.296 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:55 smithi088 ceph-mon[27811]: [17/Sep/2024:04:11:54] ENGINE Serving on https://172.21.15.88:7150 2024-09-17T04:11:56.296 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:55 smithi088 ceph-mon[27811]: [17/Sep/2024:04:11:54] ENGINE Bus STARTED 2024-09-17T04:11:56.297 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:55 smithi088 ceph-mon[27811]: [17/Sep/2024:04:11:54] ENGINE Error in HTTPServer.serve 2024-09-17T04:11:56.297 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Traceback (most recent call last): 2024-09-17T04:11:56.297 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T04:11:56.297 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: self._connections.run(self.expiration_interval) 2024-09-17T04:11:56.297 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T04:11:56.297 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: self._run(expiration_interval) 2024-09-17T04:11:56.297 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T04:11:56.297 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T04:11:56.297 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T04:11:56.297 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T04:11:56.297 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T04:11:56.297 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: s = self.context.wrap_socket( 2024-09-17T04:11:56.297 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T04:11:56.297 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: return self.sslsocket_class._create( 2024-09-17T04:11:56.298 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T04:11:56.298 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: self.do_handshake() 2024-09-17T04:11:56.298 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T04:11:56.298 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: self._sslobj.do_handshake() 2024-09-17T04:11:56.298 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T04:11:56.298 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:55 smithi088 ceph-mon[27811]: mgrmap e8: smithi088.wmndiv(active, since 2s) 2024-09-17T04:11:56.298 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:55 smithi088 ceph-mon[27811]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:11:56.298 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:55 smithi088 ceph-mon[27811]: from='mgr.14118 172.21.15.88:0/3595849702' entity='mgr.smithi088.wmndiv' 2024-09-17T04:11:56.298 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:55 smithi088 ceph-mon[27811]: from='mgr.14118 172.21.15.88:0/3595849702' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:11:56.879 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-17T04:11:56.879 INFO:teuthology.orchestra.run.smithi088.stdout:Generating ssh key... 2024-09-17T04:11:57.567 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:57 smithi088 ceph-mon[27811]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:11:58.735 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:58 smithi088 ceph-mon[27811]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:11:58.735 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:58 smithi088 ceph-mon[27811]: Generating ssh key... 2024-09-17T04:11:58.735 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:58 smithi088 ceph-mon[27811]: from='mgr.14118 172.21.15.88:0/3595849702' entity='mgr.smithi088.wmndiv' 2024-09-17T04:11:58.735 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:58 smithi088 ceph-mon[27811]: from='mgr.14118 172.21.15.88:0/3595849702' entity='mgr.smithi088.wmndiv' 2024-09-17T04:11:59.317 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNISgG8T+AtL9A6+rEqCRttVYIJ4jOco0aZSykgwrAxOF8I2J6tJMCwviRvF+3XAMI6TZ6J8u6gOBJ0lDp5BPzGr/8hEzlQF1zOSZmLkvIqU/bia8gOYsfLd/Wansmlo13QdBhpl0ZefR1LXjufNMpy/kvJagSjIy0BGa7cl9LqXrOrTmvW3qTtDtviF5Id7uI4ocJv4WuFrQuttM0mvHuIJqzAobO6PhmspFVqN7OvdoiJJBiwbHrStF6IiqzVOv3aZnHrMGEgaAiL4TPkz0zD+ut2I00lDn5WIu4JH/9JBadBX2L/ly3E+kxWSX7lPDTVfGeEz2u7n1EGsHo5sx4iMB8IXL0jnuTtrmonXdjZUOGGG8Y0QebPgbPTvUWvPFYX9q8Jy0aDoN/Yd/OS3G0E0dsx/EUDZ88fDdDNyWgAQwYfu16jEVpA/ZGqRz6Twzu8DkEVijQefOTQppgKNfpvlVMG24YwisAjpJDC5qy5dxy7ezaLpwgIvkcKbuIKNE= ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968 2024-09-17T04:11:59.317 INFO:teuthology.orchestra.run.smithi088.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-17T04:11:59.317 INFO:teuthology.orchestra.run.smithi088.stdout:Adding key to root@localhost authorized_keys... 2024-09-17T04:11:59.321 INFO:teuthology.orchestra.run.smithi088.stdout:Adding host smithi088... 2024-09-17T04:11:59.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:11:59 smithi088 ceph-mon[27811]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:12:00.695 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:00 smithi088 ceph-mon[27811]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi088", "addr": "172.21.15.88", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:12:01.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:01 smithi088 ceph-mon[27811]: Deploying cephadm binary to smithi088 2024-09-17T04:12:03.665 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout Added host 'smithi088' with addr '172.21.15.88' 2024-09-17T04:12:03.665 INFO:teuthology.orchestra.run.smithi088.stdout:Deploying mon service with default placement... 2024-09-17T04:12:04.278 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:04 smithi088 ceph-mon[27811]: from='mgr.14118 172.21.15.88:0/3595849702' entity='mgr.smithi088.wmndiv' 2024-09-17T04:12:04.278 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:04 smithi088 ceph-mon[27811]: Added host smithi088 2024-09-17T04:12:04.279 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:04 smithi088 ceph-mon[27811]: from='mgr.14118 172.21.15.88:0/3595849702' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:12:05.140 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-17T04:12:05.140 INFO:teuthology.orchestra.run.smithi088.stdout:Deploying mgr service with default placement... 2024-09-17T04:12:05.473 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:05 smithi088 ceph-mon[27811]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:12:05.473 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:05 smithi088 ceph-mon[27811]: Saving service mon spec with placement count:5 2024-09-17T04:12:05.473 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:05 smithi088 ceph-mon[27811]: from='mgr.14118 172.21.15.88:0/3595849702' entity='mgr.smithi088.wmndiv' 2024-09-17T04:12:06.381 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-17T04:12:06.381 INFO:teuthology.orchestra.run.smithi088.stdout:Deploying crash service with default placement... 2024-09-17T04:12:07.133 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:06 smithi088 ceph-mon[27811]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:12:07.133 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:06 smithi088 ceph-mon[27811]: Saving service mgr spec with placement count:2 2024-09-17T04:12:07.133 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:06 smithi088 ceph-mon[27811]: from='mgr.14118 172.21.15.88:0/3595849702' entity='mgr.smithi088.wmndiv' 2024-09-17T04:12:08.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:08 smithi088 ceph-mon[27811]: from='mgr.14118 172.21.15.88:0/3595849702' entity='mgr.smithi088.wmndiv' 2024-09-17T04:12:08.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:08 smithi088 ceph-mon[27811]: from='mgr.14118 172.21.15.88:0/3595849702' entity='mgr.smithi088.wmndiv' 2024-09-17T04:12:08.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:08 smithi088 ceph-mon[27811]: from='mgr.14118 172.21.15.88:0/3595849702' entity='mgr.smithi088.wmndiv' 2024-09-17T04:12:08.485 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-09-17T04:12:08.485 INFO:teuthology.orchestra.run.smithi088.stdout:Deploying ceph-exporter service with default placement... 2024-09-17T04:12:09.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:09 smithi088 ceph-mon[27811]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:12:09.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:09 smithi088 ceph-mon[27811]: Saving service crash spec with placement * 2024-09-17T04:12:09.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:09 smithi088 ceph-mon[27811]: from='mgr.14118 172.21.15.88:0/3595849702' entity='mgr.smithi088.wmndiv' 2024-09-17T04:12:09.648 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout Scheduled ceph-exporter update... 2024-09-17T04:12:09.648 INFO:teuthology.orchestra.run.smithi088.stdout:Deploying prometheus service with default placement... 2024-09-17T04:12:10.471 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:10 smithi088 ceph-mon[27811]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:12:10.471 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:10 smithi088 ceph-mon[27811]: Saving service ceph-exporter spec with placement * 2024-09-17T04:12:11.354 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:11 smithi088 ceph-mon[27811]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:12:11.355 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:11 smithi088 ceph-mon[27811]: Saving service prometheus spec with placement count:1 2024-09-17T04:12:11.355 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:11 smithi088 ceph-mon[27811]: from='mgr.14118 172.21.15.88:0/3595849702' entity='mgr.smithi088.wmndiv' 2024-09-17T04:12:11.355 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:11 smithi088 ceph-mon[27811]: from='mgr.14118 172.21.15.88:0/3595849702' entity='mgr.smithi088.wmndiv' 2024-09-17T04:12:11.357 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-09-17T04:12:11.357 INFO:teuthology.orchestra.run.smithi088.stdout:Deploying grafana service with default placement... 2024-09-17T04:12:12.614 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-09-17T04:12:12.614 INFO:teuthology.orchestra.run.smithi088.stdout:Deploying node-exporter service with default placement... 2024-09-17T04:12:12.861 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:12 smithi088 ceph-mon[27811]: from='mgr.14118 172.21.15.88:0/3595849702' entity='mgr.smithi088.wmndiv' 2024-09-17T04:12:12.862 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:12 smithi088 ceph-mon[27811]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:12:12.862 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:12 smithi088 ceph-mon[27811]: Saving service grafana spec with placement count:1 2024-09-17T04:12:12.862 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:12 smithi088 ceph-mon[27811]: from='mgr.14118 172.21.15.88:0/3595849702' entity='mgr.smithi088.wmndiv' 2024-09-17T04:12:13.864 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-09-17T04:12:13.864 INFO:teuthology.orchestra.run.smithi088.stdout:Deploying alertmanager service with default placement... 2024-09-17T04:12:13.992 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:13 smithi088 ceph-mon[27811]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:12:13.992 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:13 smithi088 ceph-mon[27811]: from='mgr.14118 172.21.15.88:0/3595849702' entity='mgr.smithi088.wmndiv' 2024-09-17T04:12:15.177 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:14 smithi088 ceph-mon[27811]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:12:15.177 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:14 smithi088 ceph-mon[27811]: Saving service node-exporter spec with placement * 2024-09-17T04:12:15.177 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:14 smithi088 ceph-mon[27811]: from='mgr.14118 172.21.15.88:0/3595849702' entity='mgr.smithi088.wmndiv' 2024-09-17T04:12:15.809 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-09-17T04:12:16.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:15 smithi088 ceph-mon[27811]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:12:16.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:15 smithi088 ceph-mon[27811]: Saving service alertmanager spec with placement count:1 2024-09-17T04:12:16.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:15 smithi088 ceph-mon[27811]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:12:17.594 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:17 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/3349873696' entity='client.admin' 2024-09-17T04:12:17.594 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:17 smithi088 ceph-mon[27811]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:12:18.203 INFO:teuthology.orchestra.run.smithi088.stdout:Enabling the dashboard module... 2024-09-17T04:12:18.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:18 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/3793717818' entity='client.admin' 2024-09-17T04:12:19.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:19 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/3722305691' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-17T04:12:19.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:19 smithi088 ceph-mon[27811]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:12:20.689 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:20 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/3722305691' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-17T04:12:20.689 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:20 smithi088 ceph-mon[27811]: mgrmap e9: smithi088.wmndiv(active, since 26s) 2024-09-17T04:12:21.415 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout { 2024-09-17T04:12:21.417 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-17T04:12:21.417 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-17T04:12:21.417 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "active_name": "smithi088.wmndiv", 2024-09-17T04:12:21.417 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-17T04:12:21.417 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout } 2024-09-17T04:12:21.417 INFO:teuthology.orchestra.run.smithi088.stdout:Waiting for the mgr to restart... 2024-09-17T04:12:21.417 INFO:teuthology.orchestra.run.smithi088.stdout:Waiting for mgr epoch 9... 2024-09-17T04:12:21.848 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:21 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/623311804' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-17T04:12:24.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:24 smithi088 ceph-mon[27811]: Active manager daemon smithi088.wmndiv restarted 2024-09-17T04:12:24.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:24 smithi088 ceph-mon[27811]: Activating manager daemon smithi088.wmndiv 2024-09-17T04:12:24.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:24 smithi088 ceph-mon[27811]: osdmap e3: 0 total, 0 up, 0 in 2024-09-17T04:12:24.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:24 smithi088 ceph-mon[27811]: mgrmap e10: smithi088.wmndiv(active, starting, since 0.00292299s) 2024-09-17T04:12:24.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:24 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2024-09-17T04:12:24.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:24 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mgr metadata", "who": "smithi088.wmndiv", "id": "smithi088.wmndiv"}]: dispatch 2024-09-17T04:12:24.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:24 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T04:12:24.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:24 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T04:12:24.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:24 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T04:12:24.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:24 smithi088 ceph-mon[27811]: Manager daemon smithi088.wmndiv is now available 2024-09-17T04:12:24.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:24 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:12:24.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:24 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi088.wmndiv/mirror_snapshot_schedule"}]: dispatch 2024-09-17T04:12:24.890 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:24 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi088.wmndiv/trash_purge_schedule"}]: dispatch 2024-09-17T04:12:26.323 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout { 2024-09-17T04:12:26.324 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-17T04:12:26.324 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-17T04:12:26.324 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout } 2024-09-17T04:12:26.324 INFO:teuthology.orchestra.run.smithi088.stdout:mgr epoch 9 is available 2024-09-17T04:12:26.324 INFO:teuthology.orchestra.run.smithi088.stdout:Generating a dashboard self-signed certificate... 2024-09-17T04:12:26.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:26 smithi088 ceph-mon[27811]: mgrmap e11: smithi088.wmndiv(active, since 1.0055s) 2024-09-17T04:12:26.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:26 smithi088 ceph-mon[27811]: [17/Sep/2024:04:12:25] ENGINE Bus STARTING 2024-09-17T04:12:26.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:26 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' 2024-09-17T04:12:27.563 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-17T04:12:27.563 INFO:teuthology.orchestra.run.smithi088.stdout:Creating initial admin user... 2024-09-17T04:12:27.678 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:27 smithi088 ceph-mon[27811]: [17/Sep/2024:04:12:25] ENGINE Serving on http://172.21.15.88:8765 2024-09-17T04:12:27.678 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:27 smithi088 ceph-mon[27811]: [17/Sep/2024:04:12:25] ENGINE Serving on https://172.21.15.88:7150 2024-09-17T04:12:27.679 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:27 smithi088 ceph-mon[27811]: [17/Sep/2024:04:12:25] ENGINE Bus STARTED 2024-09-17T04:12:27.679 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:27 smithi088 ceph-mon[27811]: [17/Sep/2024:04:12:25] ENGINE Error in HTTPServer.serve 2024-09-17T04:12:27.679 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Traceback (most recent call last): 2024-09-17T04:12:27.679 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T04:12:27.679 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: self._connections.run(self.expiration_interval) 2024-09-17T04:12:27.679 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T04:12:27.679 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: self._run(expiration_interval) 2024-09-17T04:12:27.679 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T04:12:27.679 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T04:12:27.679 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T04:12:27.679 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T04:12:27.679 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T04:12:27.679 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: s = self.context.wrap_socket( 2024-09-17T04:12:27.680 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T04:12:27.680 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: return self.sslsocket_class._create( 2024-09-17T04:12:27.680 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T04:12:27.680 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: self.do_handshake() 2024-09-17T04:12:27.680 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T04:12:27.680 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: self._sslobj.do_handshake() 2024-09-17T04:12:27.680 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T04:12:27.680 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:27 smithi088 ceph-mon[27811]: mgrmap e12: smithi088.wmndiv(active, since 2s) 2024-09-17T04:12:27.680 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:27 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' 2024-09-17T04:12:27.680 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:27 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' 2024-09-17T04:12:27.680 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:27 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' 2024-09-17T04:12:28.771 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:28 smithi088 ceph-mon[27811]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:12:29.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:29 smithi088 ceph-mon[27811]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:12:29.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:29 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' 2024-09-17T04:12:29.809 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$hzMTq/.LQgU2YD4tfszNdOsBKE7ntKM8llVyixztfAnMF4KyhY7Gm", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726546348, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-17T04:12:29.809 INFO:teuthology.orchestra.run.smithi088.stdout:Fetching dashboard port number... 2024-09-17T04:12:30.720 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:30 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/1808626179' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-17T04:12:30.957 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 8443 2024-09-17T04:12:30.966 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-17T04:12:30.967 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout disabled 2024-09-17T04:12:30.974 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-17T04:12:30.974 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout inactive 2024-09-17T04:12:30.974 INFO:teuthology.orchestra.run.smithi088.stdout:firewalld.service is not enabled 2024-09-17T04:12:30.974 INFO:teuthology.orchestra.run.smithi088.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-17T04:12:30.976 INFO:teuthology.orchestra.run.smithi088.stdout:Ceph Dashboard is now available at: 2024-09-17T04:12:30.976 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:12:30.976 INFO:teuthology.orchestra.run.smithi088.stdout: URL: https://smithi088.front.sepia.ceph.com:8443/ 2024-09-17T04:12:30.976 INFO:teuthology.orchestra.run.smithi088.stdout: User: admin 2024-09-17T04:12:30.976 INFO:teuthology.orchestra.run.smithi088.stdout: Password: opi30tp36k 2024-09-17T04:12:30.976 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:12:30.977 INFO:teuthology.orchestra.run.smithi088.stdout:Saving cluster configuration to /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/config directory 2024-09-17T04:12:31.660 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:31 smithi088 ceph-mon[27811]: mgrmap e13: smithi088.wmndiv(active, since 6s) 2024-09-17T04:12:32.188 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-17T04:12:32.188 INFO:teuthology.orchestra.run.smithi088.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-17T04:12:32.188 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:12:32.188 INFO:teuthology.orchestra.run.smithi088.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-17T04:12:32.188 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:12:32.188 INFO:teuthology.orchestra.run.smithi088.stdout:Or, if you are only running a single cluster on this host: 2024-09-17T04:12:32.189 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:12:32.189 INFO:teuthology.orchestra.run.smithi088.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-17T04:12:32.189 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:12:32.189 INFO:teuthology.orchestra.run.smithi088.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-17T04:12:32.189 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:12:32.189 INFO:teuthology.orchestra.run.smithi088.stdout: ceph telemetry on 2024-09-17T04:12:32.189 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:12:32.189 INFO:teuthology.orchestra.run.smithi088.stdout:For more information see: 2024-09-17T04:12:32.189 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:12:32.189 INFO:teuthology.orchestra.run.smithi088.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-17T04:12:32.189 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:12:32.189 INFO:teuthology.orchestra.run.smithi088.stdout:Bootstrap complete. 2024-09-17T04:12:32.230 INFO:tasks.cephadm:Fetching config... 2024-09-17T04:12:32.230 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-17T04:12:32.230 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-17T04:12:32.246 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-17T04:12:32.246 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-17T04:12:32.246 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-17T04:12:32.302 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-17T04:12:32.303 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-17T04:12:32.303 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/keyring of=/dev/stdout 2024-09-17T04:12:32.367 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-17T04:12:32.367 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-17T04:12:32.367 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-17T04:12:32.423 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-17T04:12:32.423 DEBUG:teuthology.orchestra.run.smithi088:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNISgG8T+AtL9A6+rEqCRttVYIJ4jOco0aZSykgwrAxOF8I2J6tJMCwviRvF+3XAMI6TZ6J8u6gOBJ0lDp5BPzGr/8hEzlQF1zOSZmLkvIqU/bia8gOYsfLd/Wansmlo13QdBhpl0ZefR1LXjufNMpy/kvJagSjIy0BGa7cl9LqXrOrTmvW3qTtDtviF5Id7uI4ocJv4WuFrQuttM0mvHuIJqzAobO6PhmspFVqN7OvdoiJJBiwbHrStF6IiqzVOv3aZnHrMGEgaAiL4TPkz0zD+ut2I00lDn5WIu4JH/9JBadBX2L/ly3E+kxWSX7lPDTVfGeEz2u7n1EGsHo5sx4iMB8IXL0jnuTtrmonXdjZUOGGG8Y0QebPgbPTvUWvPFYX9q8Jy0aDoN/Yd/OS3G0E0dsx/EUDZ88fDdDNyWgAQwYfu16jEVpA/ZGqRz6Twzu8DkEVijQefOTQppgKNfpvlVMG24YwisAjpJDC5qy5dxy7ezaLpwgIvkcKbuIKNE= ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-17T04:12:32.502 INFO:teuthology.orchestra.run.smithi088.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNISgG8T+AtL9A6+rEqCRttVYIJ4jOco0aZSykgwrAxOF8I2J6tJMCwviRvF+3XAMI6TZ6J8u6gOBJ0lDp5BPzGr/8hEzlQF1zOSZmLkvIqU/bia8gOYsfLd/Wansmlo13QdBhpl0ZefR1LXjufNMpy/kvJagSjIy0BGa7cl9LqXrOrTmvW3qTtDtviF5Id7uI4ocJv4WuFrQuttM0mvHuIJqzAobO6PhmspFVqN7OvdoiJJBiwbHrStF6IiqzVOv3aZnHrMGEgaAiL4TPkz0zD+ut2I00lDn5WIu4JH/9JBadBX2L/ly3E+kxWSX7lPDTVfGeEz2u7n1EGsHo5sx4iMB8IXL0jnuTtrmonXdjZUOGGG8Y0QebPgbPTvUWvPFYX9q8Jy0aDoN/Yd/OS3G0E0dsx/EUDZ88fDdDNyWgAQwYfu16jEVpA/ZGqRz6Twzu8DkEVijQefOTQppgKNfpvlVMG24YwisAjpJDC5qy5dxy7ezaLpwgIvkcKbuIKNE= ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968 2024-09-17T04:12:32.513 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNISgG8T+AtL9A6+rEqCRttVYIJ4jOco0aZSykgwrAxOF8I2J6tJMCwviRvF+3XAMI6TZ6J8u6gOBJ0lDp5BPzGr/8hEzlQF1zOSZmLkvIqU/bia8gOYsfLd/Wansmlo13QdBhpl0ZefR1LXjufNMpy/kvJagSjIy0BGa7cl9LqXrOrTmvW3qTtDtviF5Id7uI4ocJv4WuFrQuttM0mvHuIJqzAobO6PhmspFVqN7OvdoiJJBiwbHrStF6IiqzVOv3aZnHrMGEgaAiL4TPkz0zD+ut2I00lDn5WIu4JH/9JBadBX2L/ly3E+kxWSX7lPDTVfGeEz2u7n1EGsHo5sx4iMB8IXL0jnuTtrmonXdjZUOGGG8Y0QebPgbPTvUWvPFYX9q8Jy0aDoN/Yd/OS3G0E0dsx/EUDZ88fDdDNyWgAQwYfu16jEVpA/ZGqRz6Twzu8DkEVijQefOTQppgKNfpvlVMG24YwisAjpJDC5qy5dxy7ezaLpwgIvkcKbuIKNE= ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-17T04:12:32.605 INFO:teuthology.orchestra.run.smithi134.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNISgG8T+AtL9A6+rEqCRttVYIJ4jOco0aZSykgwrAxOF8I2J6tJMCwviRvF+3XAMI6TZ6J8u6gOBJ0lDp5BPzGr/8hEzlQF1zOSZmLkvIqU/bia8gOYsfLd/Wansmlo13QdBhpl0ZefR1LXjufNMpy/kvJagSjIy0BGa7cl9LqXrOrTmvW3qTtDtviF5Id7uI4ocJv4WuFrQuttM0mvHuIJqzAobO6PhmspFVqN7OvdoiJJBiwbHrStF6IiqzVOv3aZnHrMGEgaAiL4TPkz0zD+ut2I00lDn5WIu4JH/9JBadBX2L/ly3E+kxWSX7lPDTVfGeEz2u7n1EGsHo5sx4iMB8IXL0jnuTtrmonXdjZUOGGG8Y0QebPgbPTvUWvPFYX9q8Jy0aDoN/Yd/OS3G0E0dsx/EUDZ88fDdDNyWgAQwYfu16jEVpA/ZGqRz6Twzu8DkEVijQefOTQppgKNfpvlVMG24YwisAjpJDC5qy5dxy7ezaLpwgIvkcKbuIKNE= ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968 2024-09-17T04:12:32.619 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-17T04:12:32.865 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:12:32.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:32 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/1676367891' entity='client.admin' 2024-09-17T04:12:34.678 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:34 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/3913217462' entity='client.admin' 2024-09-17T04:12:34.680 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-17T04:12:34.680 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-17T04:12:35.091 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:12:36.397 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi134 2024-09-17T04:12:36.397 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-17T04:12:36.397 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/etc/ceph/ceph.conf 2024-09-17T04:12:36.417 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-17T04:12:36.418 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-17T04:12:36.476 INFO:tasks.cephadm:Adding host smithi134 to orchestrator... 2024-09-17T04:12:36.476 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph orch host add smithi134 2024-09-17T04:12:36.823 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:12:37.091 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:36 smithi088 ceph-mon[27811]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:12:37.091 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:36 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' 2024-09-17T04:12:38.067 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:37 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' 2024-09-17T04:12:38.068 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:37 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' 2024-09-17T04:12:38.068 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:37 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config rm", "who": "osd/host:smithi088", "name": "osd_memory_target"}]: dispatch 2024-09-17T04:12:38.068 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:37 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:12:38.068 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:37 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:12:38.068 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:37 smithi088 ceph-mon[27811]: Updating smithi088:/etc/ceph/ceph.conf 2024-09-17T04:12:38.068 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:37 smithi088 ceph-mon[27811]: Updating smithi088:/var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T04:12:38.068 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:37 smithi088 ceph-mon[27811]: Updating smithi088:/etc/ceph/ceph.client.admin.keyring 2024-09-17T04:12:38.068 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:37 smithi088 ceph-mon[27811]: Updating smithi088:/var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T04:12:38.068 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:37 smithi088 ceph-mon[27811]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi134", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:12:38.068 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:37 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' 2024-09-17T04:12:38.068 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:37 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' 2024-09-17T04:12:38.068 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:37 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' 2024-09-17T04:12:38.068 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:37 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi088", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T04:12:38.069 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:37 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi088", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-17T04:12:38.069 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:37 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:12:39.073 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:38 smithi088 ceph-mon[27811]: Deploying daemon ceph-exporter.smithi088 on smithi088 2024-09-17T04:12:39.074 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:38 smithi088 ceph-mon[27811]: Deploying cephadm binary to smithi134 2024-09-17T04:12:40.870 INFO:teuthology.orchestra.run.smithi088.stdout:Added host 'smithi134' with addr '172.21.15.134' 2024-09-17T04:12:41.618 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:41 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' 2024-09-17T04:12:41.619 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:41 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' 2024-09-17T04:12:41.619 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:41 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' 2024-09-17T04:12:41.619 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:41 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' 2024-09-17T04:12:41.619 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:41 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi088", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T04:12:41.619 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:41 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi088", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-17T04:12:41.619 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:41 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:12:41.619 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:41 smithi088 ceph-mon[27811]: Deploying daemon crash.smithi088 on smithi088 2024-09-17T04:12:41.619 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:41 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' 2024-09-17T04:12:42.126 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-17T04:12:42.373 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:42 smithi088 ceph-mon[27811]: Added host smithi134 2024-09-17T04:12:42.758 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:12:43.404 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:12:43.404 INFO:teuthology.orchestra.run.smithi088.stdout:[{"addr": "172.21.15.88", "hostname": "smithi088", "labels": [], "status": ""}, {"addr": "172.21.15.134", "hostname": "smithi134", "labels": [], "status": ""}] 2024-09-17T04:12:44.051 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:43 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' 2024-09-17T04:12:44.051 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:43 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' 2024-09-17T04:12:44.051 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:43 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' 2024-09-17T04:12:44.052 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:43 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' 2024-09-17T04:12:44.052 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:43 smithi088 ceph-mon[27811]: Deploying daemon node-exporter.smithi088 on smithi088 2024-09-17T04:12:44.052 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:43 smithi088 ceph-mon[27811]: from='client.14189 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T04:12:44.078 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-17T04:12:44.079 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-17T04:12:44.350 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:12:45.754 INFO:teuthology.orchestra.run.smithi088.stderr:adjusted tunables profile to default 2024-09-17T04:12:45.754 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:45 smithi088 ceph-mon[27811]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:12:45.754 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:45 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' 2024-09-17T04:12:45.754 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:45 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/258284390' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-17T04:12:46.999 INFO:tasks.cephadm:Adding mon.smithi088 on smithi088 2024-09-17T04:12:46.999 INFO:tasks.cephadm:Adding mon.smithi134 on smithi134 2024-09-17T04:12:46.999 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph orch apply mon '2;smithi088:172.21.15.88=smithi088;smithi134:172.21.15.134=smithi134' 2024-09-17T04:12:47.060 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:46 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/258284390' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-17T04:12:47.060 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:46 smithi088 ceph-mon[27811]: osdmap e4: 0 total, 0 up, 0 in 2024-09-17T04:12:47.060 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:46 smithi088 ceph-mon[27811]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:12:47.246 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T04:12:47.303 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T04:12:47.902 INFO:teuthology.orchestra.run.smithi134.stdout:Scheduled mon update... 2024-09-17T04:12:48.486 DEBUG:teuthology.orchestra.run.smithi134:mon.smithi134> sudo journalctl -f -n 0 -u ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968@mon.smithi134.service 2024-09-17T04:12:48.489 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T04:12:48.489 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T04:12:48.758 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T04:12:48.802 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T04:12:48.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:48 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' 2024-09-17T04:12:48.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:48 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' 2024-09-17T04:12:48.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:48 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' 2024-09-17T04:12:48.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:48 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' 2024-09-17T04:12:48.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:48 smithi088 ceph-mon[27811]: Deploying daemon alertmanager.smithi088 on smithi088 2024-09-17T04:12:48.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:48 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' 2024-09-17T04:12:49.431 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:12:49.431 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":1,"fsid":"bf2b79a4-74aa-11ef-bceb-c7b262605968","modified":"2024-09-17T04:11:18.564226Z","created":"2024-09-17T04:11:18.564226Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi088","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T04:12:49.431 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 1 2024-09-17T04:12:49.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:49 smithi088 ceph-mon[27811]: from='client.14193 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi088:172.21.15.88=smithi088;smithi134:172.21.15.134=smithi134", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:12:49.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:49 smithi088 ceph-mon[27811]: Saving service mon spec with placement smithi088:172.21.15.88=smithi088;smithi134:172.21.15.134=smithi134;count:2 2024-09-17T04:12:49.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:49 smithi088 ceph-mon[27811]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:12:50.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:50 smithi088 ceph-mon[27811]: from='client.? 172.21.15.134:0/2899401144' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T04:12:50.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:50 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' 2024-09-17T04:12:51.002 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T04:12:51.003 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T04:12:51.261 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T04:12:51.308 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T04:12:51.581 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:51 smithi088 ceph-mon[27811]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:12:51.990 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:12:51.990 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":1,"fsid":"bf2b79a4-74aa-11ef-bceb-c7b262605968","modified":"2024-09-17T04:11:18.564226Z","created":"2024-09-17T04:11:18.564226Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi088","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T04:12:51.990 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 1 2024-09-17T04:12:52.539 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:52 smithi088 ceph-mon[27811]: from='client.? 172.21.15.134:0/3400407141' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T04:12:53.599 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T04:12:53.599 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T04:12:53.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:53 smithi088 ceph-mon[27811]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:12:53.844 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T04:12:53.888 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T04:12:54.731 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:12:54.731 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":1,"fsid":"bf2b79a4-74aa-11ef-bceb-c7b262605968","modified":"2024-09-17T04:11:18.564226Z","created":"2024-09-17T04:11:18.564226Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi088","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T04:12:54.731 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 1 2024-09-17T04:12:55.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:55 smithi088 ceph-mon[27811]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:12:55.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:55 smithi088 ceph-mon[27811]: from='client.? 172.21.15.134:0/4099194238' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T04:12:55.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:55 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' 2024-09-17T04:12:55.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:55 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' 2024-09-17T04:12:55.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:55 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' 2024-09-17T04:12:55.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:55 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' 2024-09-17T04:12:55.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:55 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' 2024-09-17T04:12:55.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:55 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' 2024-09-17T04:12:55.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:55 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' 2024-09-17T04:12:55.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:55 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' 2024-09-17T04:12:55.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:55 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-17T04:12:55.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:55 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' 2024-09-17T04:12:56.286 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T04:12:56.287 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T04:12:56.531 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T04:12:56.576 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T04:12:56.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:56 smithi088 ceph-mon[27811]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-17T04:12:56.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:56 smithi088 ceph-mon[27811]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-17T04:12:56.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:56 smithi088 ceph-mon[27811]: Deploying daemon grafana.smithi088 on smithi088 2024-09-17T04:12:57.187 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:12:57.187 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":1,"fsid":"bf2b79a4-74aa-11ef-bceb-c7b262605968","modified":"2024-09-17T04:11:18.564226Z","created":"2024-09-17T04:11:18.564226Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi088","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T04:12:57.187 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 1 2024-09-17T04:12:57.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:57 smithi088 ceph-mon[27811]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:12:57.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:57 smithi088 ceph-mon[27811]: from='client.? 172.21.15.134:0/3805284186' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T04:12:58.767 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T04:12:58.768 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T04:12:59.013 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T04:12:59.057 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T04:12:59.867 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:12:59.868 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":1,"fsid":"bf2b79a4-74aa-11ef-bceb-c7b262605968","modified":"2024-09-17T04:11:18.564226Z","created":"2024-09-17T04:11:18.564226Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi088","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T04:12:59.868 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 1 2024-09-17T04:12:59.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:59 smithi088 ceph-mon[27811]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:12:59.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:12:59 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:00.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:00 smithi088 ceph-mon[27811]: from='client.? 172.21.15.134:0/243947984' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T04:13:01.432 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T04:13:01.432 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T04:13:01.676 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T04:13:01.720 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T04:13:01.751 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:01 smithi088 ceph-mon[27811]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:13:02.460 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:13:02.460 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":1,"fsid":"bf2b79a4-74aa-11ef-bceb-c7b262605968","modified":"2024-09-17T04:11:18.564226Z","created":"2024-09-17T04:11:18.564226Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi088","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T04:13:02.460 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 1 2024-09-17T04:13:02.815 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:02 smithi088 ceph-mon[27811]: from='client.? 172.21.15.134:0/983715491' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T04:13:03.829 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:03 smithi088 ceph-mon[27811]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:13:04.049 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T04:13:04.049 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T04:13:04.293 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T04:13:04.336 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T04:13:05.088 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:13:05.088 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":1,"fsid":"bf2b79a4-74aa-11ef-bceb-c7b262605968","modified":"2024-09-17T04:11:18.564226Z","created":"2024-09-17T04:11:18.564226Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi088","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T04:13:05.088 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 1 2024-09-17T04:13:05.966 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:05 smithi088 ceph-mon[27811]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:13:05.966 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:05 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:05.966 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:05 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:05.966 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:05 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:05.966 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:05 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:05.967 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:05 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:05.967 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:05 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:05.967 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:05 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:05.967 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:05 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:05.967 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:05 smithi088 ceph-mon[27811]: from='client.? 172.21.15.134:0/3806416932' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T04:13:06.586 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T04:13:06.587 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T04:13:06.834 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T04:13:06.878 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T04:13:07.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:06 smithi088 ceph-mon[27811]: Deploying daemon prometheus.smithi088 on smithi088 2024-09-17T04:13:07.493 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:13:07.493 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":1,"fsid":"bf2b79a4-74aa-11ef-bceb-c7b262605968","modified":"2024-09-17T04:11:18.564226Z","created":"2024-09-17T04:11:18.564226Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi088","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T04:13:07.493 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 1 2024-09-17T04:13:08.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:07 smithi088 ceph-mon[27811]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:13:08.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:07 smithi088 ceph-mon[27811]: from='client.? 172.21.15.134:0/186443431' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T04:13:09.060 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T04:13:09.061 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T04:13:09.304 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T04:13:09.348 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T04:13:09.949 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:13:09.949 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":1,"fsid":"bf2b79a4-74aa-11ef-bceb-c7b262605968","modified":"2024-09-17T04:11:18.564226Z","created":"2024-09-17T04:11:18.564226Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi088","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T04:13:09.949 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 1 2024-09-17T04:13:10.021 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:09 smithi088 ceph-mon[27811]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:13:10.021 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:09 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:11.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:10 smithi088 ceph-mon[27811]: from='client.? 172.21.15.134:0/3697737812' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T04:13:11.600 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T04:13:11.600 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T04:13:11.843 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T04:13:11.887 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T04:13:12.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:11 smithi088 ceph-mon[27811]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:13:12.533 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:13:12.533 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":1,"fsid":"bf2b79a4-74aa-11ef-bceb-c7b262605968","modified":"2024-09-17T04:11:18.564226Z","created":"2024-09-17T04:11:18.564226Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi088","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T04:13:12.534 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 1 2024-09-17T04:13:12.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:12 smithi088 ceph-mon[27811]: from='client.? 172.21.15.134:0/2252097808' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T04:13:13.903 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:13 smithi088 ceph-mon[27811]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:13:14.098 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T04:13:14.099 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T04:13:14.333 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T04:13:14.378 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T04:13:15.013 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:13:15.013 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":1,"fsid":"bf2b79a4-74aa-11ef-bceb-c7b262605968","modified":"2024-09-17T04:11:18.564226Z","created":"2024-09-17T04:11:18.564226Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi088","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T04:13:15.013 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 1 2024-09-17T04:13:15.808 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:15 smithi088 ceph-mon[27811]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:13:15.808 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:15 smithi088 ceph-mon[27811]: from='client.? 172.21.15.134:0/113768254' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T04:13:16.613 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T04:13:16.613 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T04:13:16.855 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T04:13:16.899 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T04:13:17.286 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:16 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:17.286 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:16 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:17.286 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:16 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:17.286 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:16 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-17T04:13:17.286 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:16 smithi088 ceph-mon[27811]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:13:17.731 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:13:17.731 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":1,"fsid":"bf2b79a4-74aa-11ef-bceb-c7b262605968","modified":"2024-09-17T04:11:18.564226Z","created":"2024-09-17T04:11:18.564226Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi088","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T04:13:17.731 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 1 2024-09-17T04:13:18.209 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:17 smithi088 ceph-mon[27811]: from='mgr.14162 172.21.15.88:0/3908538156' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-17T04:13:18.209 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:17 smithi088 ceph-mon[27811]: mgrmap e14: smithi088.wmndiv(active, since 52s) 2024-09-17T04:13:18.209 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:17 smithi088 ceph-mon[27811]: from='client.? 172.21.15.134:0/875841475' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T04:13:19.286 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T04:13:19.286 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T04:13:19.529 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T04:13:19.573 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T04:13:20.191 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:13:20.191 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":1,"fsid":"bf2b79a4-74aa-11ef-bceb-c7b262605968","modified":"2024-09-17T04:11:18.564226Z","created":"2024-09-17T04:11:18.564226Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi088","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T04:13:20.191 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 1 2024-09-17T04:13:20.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:20 smithi088 ceph-mon[27811]: from='client.? 172.21.15.134:0/2849855154' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T04:13:21.824 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T04:13:21.825 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T04:13:21.990 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:21 smithi088 ceph-mon[27811]: Active manager daemon smithi088.wmndiv restarted 2024-09-17T04:13:21.990 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:21 smithi088 ceph-mon[27811]: Activating manager daemon smithi088.wmndiv 2024-09-17T04:13:21.990 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:21 smithi088 ceph-mon[27811]: osdmap e5: 0 total, 0 up, 0 in 2024-09-17T04:13:21.990 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:21 smithi088 ceph-mon[27811]: mgrmap e15: smithi088.wmndiv(active, starting, since 0.00292271s) 2024-09-17T04:13:21.990 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:21 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2024-09-17T04:13:21.990 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:21 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mgr metadata", "who": "smithi088.wmndiv", "id": "smithi088.wmndiv"}]: dispatch 2024-09-17T04:13:21.991 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:21 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T04:13:21.991 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:21 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T04:13:21.991 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:21 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T04:13:21.991 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:21 smithi088 ceph-mon[27811]: Manager daemon smithi088.wmndiv is now available 2024-09-17T04:13:21.991 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:21 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:13:21.991 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:21 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:21.991 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:21 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:13:21.991 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:21 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi088.wmndiv/mirror_snapshot_schedule"}]: dispatch 2024-09-17T04:13:22.077 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T04:13:22.122 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T04:13:22.884 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:13:22.884 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":1,"fsid":"bf2b79a4-74aa-11ef-bceb-c7b262605968","modified":"2024-09-17T04:11:18.564226Z","created":"2024-09-17T04:11:18.564226Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi088","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T04:13:22.885 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 1 2024-09-17T04:13:23.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:22 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi088.wmndiv/trash_purge_schedule"}]: dispatch 2024-09-17T04:13:23.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:22 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:23.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:22 smithi088 ceph-mon[27811]: mgrmap e16: smithi088.wmndiv(active, since 1.0077s) 2024-09-17T04:13:24.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:23 smithi088 ceph-mon[27811]: [17/Sep/2024:04:13:22] ENGINE Bus STARTING 2024-09-17T04:13:24.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:23 smithi088 ceph-mon[27811]: [17/Sep/2024:04:13:22] ENGINE Serving on https://172.21.15.88:7150 2024-09-17T04:13:24.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:23 smithi088 ceph-mon[27811]: [17/Sep/2024:04:13:22] ENGINE Error in HTTPServer.serve 2024-09-17T04:13:24.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Traceback (most recent call last): 2024-09-17T04:13:24.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T04:13:24.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: self._connections.run(self.expiration_interval) 2024-09-17T04:13:24.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T04:13:24.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: self._run(expiration_interval) 2024-09-17T04:13:24.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T04:13:24.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T04:13:24.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T04:13:24.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T04:13:24.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T04:13:24.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: s = self.context.wrap_socket( 2024-09-17T04:13:24.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T04:13:24.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: return self.sslsocket_class._create( 2024-09-17T04:13:24.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T04:13:24.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: self.do_handshake() 2024-09-17T04:13:24.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T04:13:24.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: self._sslobj.do_handshake() 2024-09-17T04:13:24.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T04:13:24.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:23 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:24.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:23 smithi088 ceph-mon[27811]: from='client.? 172.21.15.134:0/3783292196' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T04:13:24.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:23 smithi088 ceph-mon[27811]: [17/Sep/2024:04:13:22] ENGINE Serving on http://172.21.15.88:8765 2024-09-17T04:13:24.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:23 smithi088 ceph-mon[27811]: [17/Sep/2024:04:13:22] ENGINE Bus STARTED 2024-09-17T04:13:24.140 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:23 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:24.553 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T04:13:24.553 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T04:13:24.918 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T04:13:25.315 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T04:13:25.827 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:25 smithi088 ceph-mon[27811]: mgrmap e17: smithi088.wmndiv(active, since 2s) 2024-09-17T04:13:26.031 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:13:26.031 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":1,"fsid":"bf2b79a4-74aa-11ef-bceb-c7b262605968","modified":"2024-09-17T04:11:18.564226Z","created":"2024-09-17T04:11:18.564226Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi088","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T04:13:26.031 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 1 2024-09-17T04:13:26.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:26 smithi088 ceph-mon[27811]: from='client.? 172.21.15.134:0/402767790' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T04:13:26.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:26 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:26.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:26 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:26.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:26 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:26.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:26 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:26.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:26 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:26.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:26 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:26.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:26 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config rm", "who": "osd/host:smithi134", "name": "osd_memory_target"}]: dispatch 2024-09-17T04:13:27.947 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T04:13:27.948 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T04:13:28.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:27 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:28.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:27 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:28.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:27 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config rm", "who": "osd/host:smithi088", "name": "osd_memory_target"}]: dispatch 2024-09-17T04:13:28.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:27 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:13:28.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:27 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:13:28.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:27 smithi088 ceph-mon[27811]: Updating smithi088:/etc/ceph/ceph.conf 2024-09-17T04:13:28.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:27 smithi088 ceph-mon[27811]: Updating smithi134:/etc/ceph/ceph.conf 2024-09-17T04:13:28.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:27 smithi088 ceph-mon[27811]: Updating smithi088:/var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T04:13:28.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:27 smithi088 ceph-mon[27811]: Updating smithi134:/var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T04:13:28.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:27 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:28.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:27 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:28.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:27 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:28.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:27 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:28.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:27 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:28.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:27 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi134", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T04:13:28.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:27 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi134", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-17T04:13:28.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:27 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:13:29.024 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T04:13:29.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:28 smithi088 ceph-mon[27811]: Updating smithi088:/etc/ceph/ceph.client.admin.keyring 2024-09-17T04:13:29.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:28 smithi088 ceph-mon[27811]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2024-09-17T04:13:29.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:28 smithi088 ceph-mon[27811]: Updating smithi088:/var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T04:13:29.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:28 smithi088 ceph-mon[27811]: Updating smithi134:/var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T04:13:29.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:28 smithi088 ceph-mon[27811]: Deploying daemon ceph-exporter.smithi134 on smithi134 2024-09-17T04:13:29.861 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:13:29.862 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":1,"fsid":"bf2b79a4-74aa-11ef-bceb-c7b262605968","modified":"2024-09-17T04:11:18.564226Z","created":"2024-09-17T04:11:18.564226Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi088","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T04:13:29.862 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 1 2024-09-17T04:13:30.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:29 smithi088 ceph-mon[27811]: from='client.? 172.21.15.134:0/663533395' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T04:13:31.528 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T04:13:31.528 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T04:13:32.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:32 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:32.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:32 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:32.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:32 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:32.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:32 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:32.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:32 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi134", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T04:13:32.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:32 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi134", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-17T04:13:32.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:32 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:13:32.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:32 smithi088 ceph-mon[27811]: Deploying daemon crash.smithi134 on smithi134 2024-09-17T04:13:32.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:32 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:32.417 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T04:13:33.209 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:13:33.209 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":1,"fsid":"bf2b79a4-74aa-11ef-bceb-c7b262605968","modified":"2024-09-17T04:11:18.564226Z","created":"2024-09-17T04:11:18.564226Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi088","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T04:13:33.209 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 1 2024-09-17T04:13:33.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:33 smithi088 ceph-mon[27811]: from='client.? 172.21.15.134:0/1642330310' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T04:13:35.067 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:34 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:35.067 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:34 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:35.067 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:34 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:35.067 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:34 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:35.067 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:34 smithi088 ceph-mon[27811]: Deploying daemon node-exporter.smithi134 on smithi134 2024-09-17T04:13:35.096 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T04:13:35.096 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T04:13:35.342 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T04:13:36.213 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:13:36.214 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":1,"fsid":"bf2b79a4-74aa-11ef-bceb-c7b262605968","modified":"2024-09-17T04:11:18.564226Z","created":"2024-09-17T04:11:18.564226Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi088","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T04:13:36.214 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 1 2024-09-17T04:13:36.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:36 smithi088 ceph-mon[27811]: from='client.? 172.21.15.134:0/3076249677' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T04:13:37.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:37 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:13:37.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:37 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:38.451 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T04:13:38.451 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T04:13:38.924 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T04:13:39.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:38 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:39.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:38 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:39.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:38 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:39.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:38 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:39.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:38 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.vwdxcb", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T04:13:39.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:38 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.vwdxcb", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-17T04:13:39.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:38 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T04:13:39.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:38 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:13:39.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:38 smithi088 ceph-mon[27811]: Deploying daemon mgr.smithi134.vwdxcb on smithi134 2024-09-17T04:13:40.204 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:13:40.205 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":1,"fsid":"bf2b79a4-74aa-11ef-bceb-c7b262605968","modified":"2024-09-17T04:11:18.564226Z","created":"2024-09-17T04:11:18.564226Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi088","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T04:13:40.205 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 1 2024-09-17T04:13:40.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:40 smithi088 ceph-mon[27811]: from='client.? 172.21.15.134:0/352180212' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T04:13:42.315 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T04:13:42.316 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T04:13:42.360 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:41 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:42.360 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:41 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:42.360 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:41 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:42.361 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:41 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:42.361 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:41 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T04:13:42.361 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:41 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:13:42.361 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:41 smithi088 ceph-mon[27811]: Deploying daemon mon.smithi134 on smithi134 2024-09-17T04:13:42.361 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:41 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:43.118 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T04:13:43.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:42 smithi088 ceph-mon[27811]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:13:44.452 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:13:44.452 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":1,"fsid":"bf2b79a4-74aa-11ef-bceb-c7b262605968","modified":"2024-09-17T04:11:18.564226Z","created":"2024-09-17T04:11:18.564226Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi088","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T04:13:44.453 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 1 2024-09-17T04:13:45.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:44 smithi088 ceph-mon[27811]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:13:45.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:44 smithi088 ceph-mon[27811]: from='client.? 172.21.15.134:0/3766353184' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T04:13:45.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:45 smithi134 systemd[1]: Started Ceph mon.smithi134 for bf2b79a4-74aa-11ef-bceb-c7b262605968. 2024-09-17T04:13:46.150 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T04:13:46.151 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T04:13:46.396 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi134/config 2024-09-17T04:13:50.669 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:13:50.669 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":2,"fsid":"bf2b79a4-74aa-11ef-bceb-c7b262605968","modified":"2024-09-17T04:13:45.364213Z","created":"2024-09-17T04:11:18.564226Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi088","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi134","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-17T04:13:50.669 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 2 2024-09-17T04:13:50.680 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:50 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2024-09-17T04:13:50.681 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:50 smithi134 ceph-mon[35201]: mon.smithi088 calling monitor election 2024-09-17T04:13:50.681 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:50 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-09-17T04:13:50.681 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:50 smithi134 ceph-mon[35201]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:13:50.681 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:50 smithi134 ceph-mon[35201]: from='mgr.? 172.21.15.134:0/664572930' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.vwdxcb/crt"}]: dispatch 2024-09-17T04:13:50.681 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:50 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-09-17T04:13:50.681 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:50 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-09-17T04:13:50.681 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:50 smithi134 ceph-mon[35201]: mon.smithi134 calling monitor election 2024-09-17T04:13:50.681 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:50 smithi134 ceph-mon[35201]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:13:50.681 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:50 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-09-17T04:13:50.681 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:50 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-09-17T04:13:50.681 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:50 smithi134 ceph-mon[35201]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:13:50.682 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:50 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-09-17T04:13:50.682 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:50 smithi134 ceph-mon[35201]: mon.smithi088 is new leader, mons smithi088,smithi134 in quorum (ranks 0,1) 2024-09-17T04:13:50.682 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:50 smithi134 ceph-mon[35201]: monmap epoch 2 2024-09-17T04:13:50.682 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:50 smithi134 ceph-mon[35201]: fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 2024-09-17T04:13:50.682 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:50 smithi134 ceph-mon[35201]: last_changed 2024-09-17T04:13:45.364213+0000 2024-09-17T04:13:50.682 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:50 smithi134 ceph-mon[35201]: created 2024-09-17T04:11:18.564226+0000 2024-09-17T04:13:50.682 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:50 smithi134 ceph-mon[35201]: min_mon_release 19 (squid) 2024-09-17T04:13:50.682 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:50 smithi134 ceph-mon[35201]: election_strategy: 1 2024-09-17T04:13:50.682 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:50 smithi134 ceph-mon[35201]: 0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.smithi088 2024-09-17T04:13:50.682 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:50 smithi134 ceph-mon[35201]: 1: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.smithi134 2024-09-17T04:13:50.682 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:50 smithi134 ceph-mon[35201]: fsmap 2024-09-17T04:13:50.682 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:50 smithi134 ceph-mon[35201]: osdmap e5: 0 total, 0 up, 0 in 2024-09-17T04:13:50.682 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:50 smithi134 ceph-mon[35201]: mgrmap e17: smithi088.wmndiv(active, since 28s) 2024-09-17T04:13:50.683 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:50 smithi134 ceph-mon[35201]: overall HEALTH_OK 2024-09-17T04:13:50.683 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:50 smithi134 ceph-mon[35201]: Standby manager daemon smithi134.vwdxcb started 2024-09-17T04:13:50.683 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:50 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:50.683 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:50 smithi134 ceph-mon[35201]: from='mgr.? 172.21.15.134:0/664572930' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T04:13:50.683 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:50 smithi134 ceph-mon[35201]: from='mgr.? 172.21.15.134:0/664572930' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.vwdxcb/key"}]: dispatch 2024-09-17T04:13:50.683 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:50 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:50.683 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:50 smithi134 ceph-mon[35201]: from='mgr.? 172.21.15.134:0/664572930' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T04:13:50.683 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:50 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:50.683 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:50 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:50.683 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:50 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:50.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:50 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2024-09-17T04:13:50.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:50 smithi088 ceph-mon[27811]: mon.smithi088 calling monitor election 2024-09-17T04:13:50.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:50 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-09-17T04:13:50.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:50 smithi088 ceph-mon[27811]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:13:50.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:50 smithi088 ceph-mon[27811]: from='mgr.? 172.21.15.134:0/664572930' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.vwdxcb/crt"}]: dispatch 2024-09-17T04:13:50.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:50 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-09-17T04:13:50.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:50 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-09-17T04:13:50.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:50 smithi088 ceph-mon[27811]: mon.smithi134 calling monitor election 2024-09-17T04:13:50.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:50 smithi088 ceph-mon[27811]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:13:50.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:50 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-09-17T04:13:50.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:50 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-09-17T04:13:50.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:50 smithi088 ceph-mon[27811]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:13:50.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:50 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-09-17T04:13:50.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:50 smithi088 ceph-mon[27811]: mon.smithi088 is new leader, mons smithi088,smithi134 in quorum (ranks 0,1) 2024-09-17T04:13:50.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:50 smithi088 ceph-mon[27811]: monmap epoch 2 2024-09-17T04:13:50.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:50 smithi088 ceph-mon[27811]: fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 2024-09-17T04:13:50.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:50 smithi088 ceph-mon[27811]: last_changed 2024-09-17T04:13:45.364213+0000 2024-09-17T04:13:50.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:50 smithi088 ceph-mon[27811]: created 2024-09-17T04:11:18.564226+0000 2024-09-17T04:13:50.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:50 smithi088 ceph-mon[27811]: min_mon_release 19 (squid) 2024-09-17T04:13:50.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:50 smithi088 ceph-mon[27811]: election_strategy: 1 2024-09-17T04:13:50.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:50 smithi088 ceph-mon[27811]: 0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.smithi088 2024-09-17T04:13:50.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:50 smithi088 ceph-mon[27811]: 1: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.smithi134 2024-09-17T04:13:50.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:50 smithi088 ceph-mon[27811]: fsmap 2024-09-17T04:13:50.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:50 smithi088 ceph-mon[27811]: osdmap e5: 0 total, 0 up, 0 in 2024-09-17T04:13:50.890 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:50 smithi088 ceph-mon[27811]: mgrmap e17: smithi088.wmndiv(active, since 28s) 2024-09-17T04:13:50.890 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:50 smithi088 ceph-mon[27811]: overall HEALTH_OK 2024-09-17T04:13:50.890 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:50 smithi088 ceph-mon[27811]: Standby manager daemon smithi134.vwdxcb started 2024-09-17T04:13:50.890 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:50 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:50.890 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:50 smithi088 ceph-mon[27811]: from='mgr.? 172.21.15.134:0/664572930' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T04:13:50.890 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:50 smithi088 ceph-mon[27811]: from='mgr.? 172.21.15.134:0/664572930' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.vwdxcb/key"}]: dispatch 2024-09-17T04:13:50.890 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:50 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:50.890 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:50 smithi088 ceph-mon[27811]: from='mgr.? 172.21.15.134:0/664572930' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T04:13:50.890 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:50 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:50.890 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:50 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:50.890 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:50 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:51.297 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-17T04:13:51.297 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-17T04:13:51.555 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:13:51.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:51 smithi088 ceph-mon[27811]: mgrmap e18: smithi088.wmndiv(active, since 28s), standbys: smithi134.vwdxcb 2024-09-17T04:13:51.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:51 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mgr metadata", "who": "smithi134.vwdxcb", "id": "smithi134.vwdxcb"}]: dispatch 2024-09-17T04:13:51.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:51 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:13:51.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:51 smithi088 ceph-mon[27811]: from='client.? 172.21.15.134:0/3805280884' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T04:13:51.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:51 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-09-17T04:13:51.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:51 smithi134 ceph-mon[35201]: mgrmap e18: smithi088.wmndiv(active, since 28s), standbys: smithi134.vwdxcb 2024-09-17T04:13:51.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:51 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mgr metadata", "who": "smithi134.vwdxcb", "id": "smithi134.vwdxcb"}]: dispatch 2024-09-17T04:13:51.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:51 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:13:51.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:51 smithi134 ceph-mon[35201]: from='client.? 172.21.15.134:0/3805280884' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T04:13:51.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:51 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-09-17T04:13:52.213 INFO:teuthology.orchestra.run.smithi088.stdout:# minimal ceph.conf for bf2b79a4-74aa-11ef-bceb-c7b262605968 2024-09-17T04:13:52.213 INFO:teuthology.orchestra.run.smithi088.stdout:[global] 2024-09-17T04:13:52.214 INFO:teuthology.orchestra.run.smithi088.stdout: fsid = bf2b79a4-74aa-11ef-bceb-c7b262605968 2024-09-17T04:13:52.214 INFO:teuthology.orchestra.run.smithi088.stdout: mon_host = [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] 2024-09-17T04:13:52.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:52 smithi088 ceph-mon[27811]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:13:52.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:52 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:13:52.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:52 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:52.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:52 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/4177509210' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:13:52.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:52 smithi134 ceph-mon[35201]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:13:52.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:52 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:13:52.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:52 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:52.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:52 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/4177509210' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:13:52.804 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-17T04:13:52.804 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-17T04:13:52.804 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/ceph/ceph.conf 2024-09-17T04:13:52.831 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-17T04:13:52.831 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-17T04:13:52.896 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-17T04:13:52.896 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.conf 2024-09-17T04:13:52.922 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-17T04:13:52.922 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-17T04:13:52.985 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-17T04:13:52.986 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph config set client client_mount_timeout 600 2024-09-17T04:13:52.988 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-17T04:13:52.988 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph config set client debug_client 20 2024-09-17T04:13:53.030 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-17T04:13:53.030 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph config set client debug_ms 1 2024-09-17T04:13:53.073 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-17T04:13:53.073 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph config set client rados_mon_op_timeout 900 2024-09-17T04:13:53.116 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-17T04:13:53.116 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph config set client rados_osd_op_timeout 900 2024-09-17T04:13:53.159 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-17T04:13:53.160 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph config set mds debug_mds 20 2024-09-17T04:13:53.203 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-17T04:13:53.203 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph config set mds debug_mds_balancer 20 2024-09-17T04:13:53.246 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-17T04:13:53.247 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph config set mds debug_ms 2 2024-09-17T04:13:53.290 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-17T04:13:53.290 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph config set mds mds_debug_frag True 2024-09-17T04:13:53.334 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-17T04:13:53.335 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph config set mds mds_debug_scatterstat True 2024-09-17T04:13:53.335 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:13:53.380 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-17T04:13:53.380 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph config set mds mds_op_complaint_time 180 2024-09-17T04:13:53.406 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:13:53.414 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-17T04:13:53.415 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph config set mds mds_verify_scatter True 2024-09-17T04:13:53.461 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-17T04:13:53.462 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph config set mds osd_op_complaint_time 180 2024-09-17T04:13:53.512 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-17T04:13:53.512 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph config set mds rados_mon_op_timeout 900 2024-09-17T04:13:53.570 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-17T04:13:53.570 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph config set mds rados_osd_op_timeout 900 2024-09-17T04:13:53.616 INFO:tasks.cephadm:setting config [mgr] client_mount_timeout = 30 2024-09-17T04:13:53.616 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph config set mgr client_mount_timeout 30 2024-09-17T04:13:53.672 INFO:tasks.cephadm:setting config [mgr] debug_client = 20 2024-09-17T04:13:53.673 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph config set mgr debug_client 20 2024-09-17T04:13:53.739 INFO:tasks.cephadm:setting config [mgr] debug_mgr = 20 2024-09-17T04:13:53.739 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph config set mgr debug_mgr 20 2024-09-17T04:13:53.785 INFO:tasks.cephadm:setting config [mgr] debug_ms = 1 2024-09-17T04:13:53.785 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph config set mgr debug_ms 1 2024-09-17T04:13:53.836 INFO:tasks.cephadm:setting config [mgr] mon_warn_on_pool_no_app = False 2024-09-17T04:13:53.836 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph config set mgr mon_warn_on_pool_no_app False 2024-09-17T04:13:53.881 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-17T04:13:53.882 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph config set mon mon_op_complaint_time 120 2024-09-17T04:13:53.949 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-17T04:13:53.949 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph config set osd osd_op_complaint_time 180 2024-09-17T04:13:53.995 DEBUG:tasks.cephadm:set 22 configs 2024-09-17T04:13:53.995 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'bf2b79a4-74aa-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi088') 2024-09-17T04:13:54.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:53 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:54.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:53 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:54.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:53 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:13:54.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:53 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:13:54.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:53 smithi088 ceph-mon[27811]: Updating smithi088:/etc/ceph/ceph.conf 2024-09-17T04:13:54.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:53 smithi088 ceph-mon[27811]: Updating smithi134:/etc/ceph/ceph.conf 2024-09-17T04:13:54.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:53 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:54.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:53 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:54.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:53 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:54.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:53 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:54.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:53 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:54.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:53 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:54.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:53 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:54.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:53 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:13:54.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:53 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:13:54.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:53 smithi134 ceph-mon[35201]: Updating smithi088:/etc/ceph/ceph.conf 2024-09-17T04:13:54.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:53 smithi134 ceph-mon[35201]: Updating smithi134:/etc/ceph/ceph.conf 2024-09-17T04:13:54.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:53 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:54.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:53 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:54.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:53 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:54.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:53 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:54.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:53 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:55.000 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:54 smithi088 ceph-mon[27811]: Updating smithi134:/var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T04:13:55.000 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:54 smithi088 ceph-mon[27811]: Updating smithi088:/var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T04:13:55.000 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:54 smithi088 ceph-mon[27811]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:13:55.000 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:54 smithi088 ceph-mon[27811]: Reconfiguring mon.smithi088 (unknown last config time)... 2024-09-17T04:13:55.000 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:54 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T04:13:55.000 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:54 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T04:13:55.000 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:54 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:13:55.000 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:54 smithi088 ceph-mon[27811]: Reconfiguring daemon mon.smithi088 on smithi088 2024-09-17T04:13:55.000 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:54 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/3898628753' entity='client.admin' 2024-09-17T04:13:55.031 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'bf2b79a4-74aa-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi088') 2024-09-17T04:13:55.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:54 smithi134 ceph-mon[35201]: Updating smithi134:/var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T04:13:55.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:54 smithi134 ceph-mon[35201]: Updating smithi088:/var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T04:13:55.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:54 smithi134 ceph-mon[35201]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:13:55.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:54 smithi134 ceph-mon[35201]: Reconfiguring mon.smithi088 (unknown last config time)... 2024-09-17T04:13:55.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:54 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T04:13:55.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:54 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T04:13:55.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:54 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:13:55.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:54 smithi134 ceph-mon[35201]: Reconfiguring daemon mon.smithi088 on smithi088 2024-09-17T04:13:55.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:54 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/3898628753' entity='client.admin' 2024-09-17T04:13:56.190 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'bf2b79a4-74aa-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi088') 2024-09-17T04:13:56.761 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:56 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/2320477083' entity='client.admin' 2024-09-17T04:13:56.761 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:56 smithi088 ceph-mon[27811]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:13:56.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:56 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/2320477083' entity='client.admin' 2024-09-17T04:13:56.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:56 smithi134 ceph-mon[35201]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:13:57.125 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:13:57.125 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:13:57.126 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:13:57.126 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:13:57.134 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:13:57.138 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:13:57.138 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:13:57.141 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:13:57.930 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:13:58.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:58 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:58.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:58 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:58.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:58 smithi088 ceph-mon[27811]: Reconfiguring mgr.smithi088.wmndiv (unknown last config time)... 2024-09-17T04:13:58.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:58 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi088.wmndiv", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T04:13:58.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:58 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T04:13:58.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:58 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:13:58.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:58 smithi088 ceph-mon[27811]: Reconfiguring daemon mgr.smithi088.wmndiv on smithi088 2024-09-17T04:13:58.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:58 smithi088 ceph-mon[27811]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:13:58.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:58 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:58.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:58 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:13:58.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:58 smithi134 ceph-mon[35201]: Reconfiguring mgr.smithi088.wmndiv (unknown last config time)... 2024-09-17T04:13:58.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:58 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi088.wmndiv", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T04:13:58.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:58 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T04:13:58.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:58 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:13:58.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:58 smithi134 ceph-mon[35201]: Reconfiguring daemon mgr.smithi088.wmndiv on smithi088 2024-09-17T04:13:58.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:58 smithi134 ceph-mon[35201]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:13:59.454 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:59 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/2030548853' entity='client.admin' 2024-09-17T04:13:59.455 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:13:59 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/2620346576' entity='client.admin' 2024-09-17T04:13:59.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:59 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/2030548853' entity='client.admin' 2024-09-17T04:13:59.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:13:59 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/2620346576' entity='client.admin' 2024-09-17T04:14:00.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:00 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/959085729' entity='client.admin' 2024-09-17T04:14:00.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:00 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/3647948692' entity='client.admin' 2024-09-17T04:14:00.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:00 smithi088 ceph-mon[27811]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:00.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:00 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/959085729' entity='client.admin' 2024-09-17T04:14:00.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:00 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/3647948692' entity='client.admin' 2024-09-17T04:14:00.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:00 smithi134 ceph-mon[35201]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:01.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:01.440+0000 7f62c55de640 1 -- 172.21.15.88:0/19988388 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f62ac06e230 msgr2=0x7f62ac0706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:01.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:01.440+0000 7f62c55de640 1 --2- 172.21.15.88:0/19988388 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f62ac06e230 0x7f62ac0706f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f62c01018c0 tx=0x7f62b0007040 comp rx=0 tx=0).stop 2024-09-17T04:14:01.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:01.440+0000 7f62c55de640 1 -- 172.21.15.88:0/19988388 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62c0101a60 msgr2=0x7f62c0196850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:01.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:01.440+0000 7f62c55de640 1 --2- 172.21.15.88:0/19988388 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62c0101a60 0x7f62c0196850 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f62a8004f10 tx=0x7f62a80048f0 comp rx=0 tx=0).stop 2024-09-17T04:14:01.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:01.440+0000 7f62c55de640 1 -- 172.21.15.88:0/19988388 shutdown_connections 2024-09-17T04:14:01.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:01.440+0000 7f62c55de640 1 --2- 172.21.15.88:0/19988388 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f62ac06e230 0x7f62ac0706f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:01.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:01.440+0000 7f62c55de640 1 --2- 172.21.15.88:0/19988388 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62c0101a60 0x7f62c0196850 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:01.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:01.440+0000 7f62c55de640 1 --2- 172.21.15.88:0/19988388 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62c0100860 0x7f62c0196310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:01.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:01.440+0000 7f62c55de640 1 -- 172.21.15.88:0/19988388 >> 172.21.15.88:0/19988388 conn(0x7f62c00fc010 msgr2=0x7f62c0104f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:14:01.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:01.440+0000 7f62c55de640 1 -- 172.21.15.88:0/19988388 shutdown_connections 2024-09-17T04:14:01.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:01.440+0000 7f62c55de640 1 -- 172.21.15.88:0/19988388 wait complete. 2024-09-17T04:14:01.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:01.444+0000 7fa6f77fe640 1 -- 172.21.15.88:0/107630768 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa6fc013030 con 0x7fa7001023f0 2024-09-17T04:14:01.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:01.624+0000 7fa70861b640 1 -- 172.21.15.88:0/107630768 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7fa70018fee0 con 0x7fa7001023f0 2024-09-17T04:14:01.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:01.627+0000 7fa6f77fe640 1 -- 172.21.15.88:0/107630768 <== mon.0 v2:172.21.15.88:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v19)=0 v19) ==== 119+0+0 (secure 0 0 0) 0x7fa6fc05f3b0 con 0x7fa7001023f0 2024-09-17T04:14:01.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:01.629+0000 7fa70861b640 1 -- 172.21.15.88:0/107630768 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fa6ec06e230 msgr2=0x7fa6ec0706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:01.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:01.629+0000 7fa70861b640 1 --2- 172.21.15.88:0/107630768 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fa6ec06e230 0x7fa6ec0706f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0000c00 tx=0x7fa6f0004e10 comp rx=0 tx=0).stop 2024-09-17T04:14:01.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:01.629+0000 7fa70861b640 1 -- 172.21.15.88:0/107630768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7001023f0 msgr2=0x7fa7001975b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:01.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:01.629+0000 7fa70861b640 1 --2- 172.21.15.88:0/107630768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7001023f0 0x7fa7001975b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc00b4e0 tx=0x7fa6fc00b9a0 comp rx=0 tx=0).stop 2024-09-17T04:14:01.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:01.629+0000 7fa70861b640 1 -- 172.21.15.88:0/107630768 shutdown_connections 2024-09-17T04:14:01.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:01.629+0000 7fa70861b640 1 --2- 172.21.15.88:0/107630768 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fa6ec06e230 0x7fa6ec0706f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:01.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:01.629+0000 7fa70861b640 1 --2- 172.21.15.88:0/107630768 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa700104d20 0x7fa700197af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:01.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:01.629+0000 7fa70861b640 1 --2- 172.21.15.88:0/107630768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7001023f0 0x7fa7001975b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:01.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:01.629+0000 7fa70861b640 1 -- 172.21.15.88:0/107630768 >> 172.21.15.88:0/107630768 conn(0x7fa7000fc010 msgr2=0x7fa7000fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:14:01.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:01.629+0000 7fa70861b640 1 -- 172.21.15.88:0/107630768 shutdown_connections 2024-09-17T04:14:01.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:01.629+0000 7fa70861b640 1 -- 172.21.15.88:0/107630768 wait complete. 2024-09-17T04:14:01.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:01 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/1790078500' entity='client.admin' 2024-09-17T04:14:01.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:01 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/19988388' entity='client.admin' 2024-09-17T04:14:01.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:01 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/107630768' entity='client.admin' 2024-09-17T04:14:01.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:01 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/1790078500' entity='client.admin' 2024-09-17T04:14:01.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:01 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/19988388' entity='client.admin' 2024-09-17T04:14:01.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:01 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/107630768' entity='client.admin' 2024-09-17T04:14:02.954 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:02 smithi088 ceph-mon[27811]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:03.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:02 smithi134 ceph-mon[35201]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:04.315 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'bf2b79a4-74aa-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi088') 2024-09-17T04:14:04.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:03.246+0000 7f060bb61640 1 -- 172.21.15.88:0/1108964963 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0604101960 msgr2=0x7f0604101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:04.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:03.246+0000 7f060bb61640 1 --2- 172.21.15.88:0/1108964963 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0604101960 0x7f0604101d60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0600009880 tx=0x7f060002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:14:04.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:03.246+0000 7f060bb61640 1 -- 172.21.15.88:0/1108964963 shutdown_connections 2024-09-17T04:14:04.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:03.246+0000 7f060bb61640 1 --2- 172.21.15.88:0/1108964963 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0604102b60 0x7f0604102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:04.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:03.246+0000 7f060bb61640 1 --2- 172.21.15.88:0/1108964963 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0604101960 0x7f0604101d60 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:04.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:03.246+0000 7f060bb61640 1 -- 172.21.15.88:0/1108964963 >> 172.21.15.88:0/1108964963 conn(0x7f06040fd0f0 msgr2=0x7f06040ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:14:04.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:03.246+0000 7f060bb61640 1 -- 172.21.15.88:0/1108964963 shutdown_connections 2024-09-17T04:14:04.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:03.246+0000 7f060bb61640 1 -- 172.21.15.88:0/1108964963 wait complete. 2024-09-17T04:14:04.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:03.247+0000 7f060bb61640 1 Processor -- start 2024-09-17T04:14:04.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:03.247+0000 7f060bb61640 1 -- start start 2024-09-17T04:14:04.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:03.247+0000 7f060bb61640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0604101960 0x7f0604197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:14:04.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:03.247+0000 7f060bb61640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0604102b60 0x7f0604197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:14:04.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:03.247+0000 7f060bb61640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f060410a800 con 0x7f0604102b60 2024-09-17T04:14:04.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:03.247+0000 7f060bb61640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f060410a680 con 0x7f0604101960 2024-09-17T04:14:04.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:03.247+0000 7f06090fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0604102b60 0x7f0604197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:14:04.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:03.247+0000 7f06090fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0604102b60 0x7f0604197a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38476/0 (socket says 172.21.15.88:38476) 2024-09-17T04:14:04.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:03.247+0000 7f06090fc640 1 -- 172.21.15.88:0/1319768038 learned_addr learned my addr 172.21.15.88:0/1319768038 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:14:04.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:03.247+0000 7f06090fc640 1 -- 172.21.15.88:0/1319768038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0604101960 msgr2=0x7f0604197510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:04.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:03.247+0000 7f06098fd640 1 --2- 172.21.15.88:0/1319768038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0604101960 0x7f0604197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:14:04.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:03.247+0000 7f06090fc640 1 --2- 172.21.15.88:0/1319768038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0604101960 0x7f0604197510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:04.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:03.247+0000 7f06090fc640 1 -- 172.21.15.88:0/1319768038 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06041980d0 con 0x7f0604102b60 2024-09-17T04:14:04.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:03.247+0000 7f06098fd640 1 --2- 172.21.15.88:0/1319768038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0604101960 0x7f0604197510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:14:04.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:03.248+0000 7f06090fc640 1 --2- 172.21.15.88:0/1319768038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0604102b60 0x7f0604197a50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f05f400b420 tx=0x7f05f400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:14:04.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:03.248+0000 7f05faffd640 1 -- 172.21.15.88:0/1319768038 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f05f4011630 con 0x7f0604102b60 2024-09-17T04:14:04.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:03.248+0000 7f060bb61640 1 -- 172.21.15.88:0/1319768038 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f060419cb10 con 0x7f0604102b60 2024-09-17T04:14:04.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:03.248+0000 7f05faffd640 1 -- 172.21.15.88:0/1319768038 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f05f4016070 con 0x7f0604102b60 2024-09-17T04:14:04.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:03.248+0000 7f05faffd640 1 -- 172.21.15.88:0/1319768038 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f05f4010d40 con 0x7f0604102b60 2024-09-17T04:14:04.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:03.248+0000 7f060bb61640 1 -- 172.21.15.88:0/1319768038 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f060419d120 con 0x7f0604102b60 2024-09-17T04:14:04.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:03.249+0000 7f060bb61640 1 -- 172.21.15.88:0/1319768038 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0604101d60 con 0x7f0604102b60 2024-09-17T04:14:04.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:03.249+0000 7f05faffd640 1 -- 172.21.15.88:0/1319768038 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f05f401b460 con 0x7f0604102b60 2024-09-17T04:14:04.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:03.250+0000 7f05faffd640 1 --2- 172.21.15.88:0/1319768038 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f05f006e230 0x7f05f00706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:14:04.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:03.250+0000 7f06098fd640 1 --2- 172.21.15.88:0/1319768038 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f05f006e230 0x7f05f00706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:14:04.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:03.250+0000 7f05faffd640 1 -- 172.21.15.88:0/1319768038 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f05f408c950 con 0x7f0604102b60 2024-09-17T04:14:04.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:03.251+0000 7f06098fd640 1 --2- 172.21.15.88:0/1319768038 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f05f006e230 0x7f05f00706f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f06000096c0 tx=0x7f0600009650 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:14:04.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:03.254+0000 7f05faffd640 1 -- 172.21.15.88:0/1319768038 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f05f405b390 con 0x7f0604102b60 2024-09-17T04:14:04.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:03.425+0000 7f060bb61640 1 -- 172.21.15.88:0/1319768038 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f0604062df0 con 0x7f0604102b60 2024-09-17T04:14:04.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:03.429+0000 7f05faffd640 1 -- 172.21.15.88:0/1319768038 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v20)=0 v20) ==== 117+0+0 (secure 0 0 0) 0x7f05f405f040 con 0x7f0604102b60 2024-09-17T04:14:04.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:03.431+0000 7f060bb61640 1 -- 172.21.15.88:0/1319768038 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f05f006e230 msgr2=0x7f05f00706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:04.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:03.431+0000 7f060bb61640 1 --2- 172.21.15.88:0/1319768038 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f05f006e230 0x7f05f00706f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f06000096c0 tx=0x7f0600009650 comp rx=0 tx=0).stop 2024-09-17T04:14:04.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:03.431+0000 7f060bb61640 1 -- 172.21.15.88:0/1319768038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0604102b60 msgr2=0x7f0604197a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:04.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:03.431+0000 7f060bb61640 1 --2- 172.21.15.88:0/1319768038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0604102b60 0x7f0604197a50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f05f400b420 tx=0x7f05f400b8e0 comp rx=0 tx=0).stop 2024-09-17T04:14:04.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:03.431+0000 7f060bb61640 1 -- 172.21.15.88:0/1319768038 shutdown_connections 2024-09-17T04:14:04.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:03.431+0000 7f060bb61640 1 --2- 172.21.15.88:0/1319768038 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f05f006e230 0x7f05f00706f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:04.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:03.431+0000 7f060bb61640 1 --2- 172.21.15.88:0/1319768038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0604102b60 0x7f0604197a50 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:04.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:03.431+0000 7f060bb61640 1 --2- 172.21.15.88:0/1319768038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0604101960 0x7f0604197510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:04.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:03.431+0000 7f060bb61640 1 -- 172.21.15.88:0/1319768038 >> 172.21.15.88:0/1319768038 conn(0x7f06040fd0f0 msgr2=0x7f0604105fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:14:04.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:03.431+0000 7f060bb61640 1 -- 172.21.15.88:0/1319768038 shutdown_connections 2024-09-17T04:14:04.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:03.431+0000 7f060bb61640 1 -- 172.21.15.88:0/1319768038 wait complete. 2024-09-17T04:14:04.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:04 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/1319768038' entity='client.admin' 2024-09-17T04:14:04.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:04 smithi088 ceph-mon[27811]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:04.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:04 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/1319768038' entity='client.admin' 2024-09-17T04:14:04.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:04 smithi134 ceph-mon[35201]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:05.353 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'bf2b79a4-74aa-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi088') 2024-09-17T04:14:05.353 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'bf2b79a4-74aa-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi088') 2024-09-17T04:14:05.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:05.526+0000 7fb077038640 1 -- 172.21.15.88:0/1648869445 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb070102b60 msgr2=0x7fb070102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:05.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:05.526+0000 7fb077038640 1 --2- 172.21.15.88:0/1648869445 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb070102b60 0x7fb070102fe0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb05c009880 tx=0x7fb05c02a4b0 comp rx=0 tx=0).stop 2024-09-17T04:14:05.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:05.526+0000 7fb077038640 1 -- 172.21.15.88:0/1648869445 shutdown_connections 2024-09-17T04:14:05.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:05.526+0000 7fb077038640 1 --2- 172.21.15.88:0/1648869445 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb070102b60 0x7fb070102fe0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:05.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:05.526+0000 7fb077038640 1 --2- 172.21.15.88:0/1648869445 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb070101960 0x7fb070101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:05.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:05.526+0000 7fb077038640 1 -- 172.21.15.88:0/1648869445 >> 172.21.15.88:0/1648869445 conn(0x7fb0700fd0f0 msgr2=0x7fb0700ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:14:05.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:05.526+0000 7fb077038640 1 -- 172.21.15.88:0/1648869445 shutdown_connections 2024-09-17T04:14:05.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:05.526+0000 7fb077038640 1 -- 172.21.15.88:0/1648869445 wait complete. 2024-09-17T04:14:05.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:05.527+0000 7fb077038640 1 Processor -- start 2024-09-17T04:14:05.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:05.527+0000 7fb077038640 1 -- start start 2024-09-17T04:14:05.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:05.527+0000 7fb077038640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb070101960 0x7fb070197470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:14:05.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:05.527+0000 7fb077038640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb070102b60 0x7fb0701979b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:14:05.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:05.527+0000 7fb077038640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fb07010a780 con 0x7fb070102b60 2024-09-17T04:14:05.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:05.527+0000 7fb077038640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb07010a600 con 0x7fb070101960 2024-09-17T04:14:05.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:05.527+0000 7fb06ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb070102b60 0x7fb0701979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:14:05.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:05.527+0000 7fb06ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb070102b60 0x7fb0701979b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38494/0 (socket says 172.21.15.88:38494) 2024-09-17T04:14:05.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:05.527+0000 7fb06ffff640 1 -- 172.21.15.88:0/1004345875 learned_addr learned my addr 172.21.15.88:0/1004345875 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:14:05.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:05.527+0000 7fb074dd4640 1 --2- 172.21.15.88:0/1004345875 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb070101960 0x7fb070197470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:14:05.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:05.527+0000 7fb06ffff640 1 -- 172.21.15.88:0/1004345875 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb070101960 msgr2=0x7fb070197470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:05.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:05.527+0000 7fb06ffff640 1 --2- 172.21.15.88:0/1004345875 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb070101960 0x7fb070197470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:05.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:05.527+0000 7fb06ffff640 1 -- 172.21.15.88:0/1004345875 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb070198030 con 0x7fb070102b60 2024-09-17T04:14:05.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:05.527+0000 7fb074dd4640 1 --2- 172.21.15.88:0/1004345875 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb070101960 0x7fb070197470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:14:05.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:05.527+0000 7fb06ffff640 1 --2- 172.21.15.88:0/1004345875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb070102b60 0x7fb0701979b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb05c006010 tx=0x7fb05c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:14:05.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:05.528+0000 7fb06dffb640 1 -- 172.21.15.88:0/1004345875 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb05c03f070 con 0x7fb070102b60 2024-09-17T04:14:05.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:05.528+0000 7fb077038640 1 -- 172.21.15.88:0/1004345875 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb07019ca10 con 0x7fb070102b60 2024-09-17T04:14:05.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:05.528+0000 7fb06dffb640 1 -- 172.21.15.88:0/1004345875 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb05c004ac0 con 0x7fb070102b60 2024-09-17T04:14:05.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:05.528+0000 7fb06dffb640 1 -- 172.21.15.88:0/1004345875 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb05c035030 con 0x7fb070102b60 2024-09-17T04:14:05.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:05.528+0000 7fb077038640 1 -- 172.21.15.88:0/1004345875 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb07019cfa0 con 0x7fb070102b60 2024-09-17T04:14:05.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:05.529+0000 7fb077038640 1 -- 172.21.15.88:0/1004345875 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb070101d60 con 0x7fb070102b60 2024-09-17T04:14:05.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:05.529+0000 7fb06dffb640 1 -- 172.21.15.88:0/1004345875 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7fb05c042070 con 0x7fb070102b60 2024-09-17T04:14:05.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:05.530+0000 7fb06dffb640 1 --2- 172.21.15.88:0/1004345875 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fb06006e230 0x7fb0600706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:14:05.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:05.530+0000 7fb06dffb640 1 -- 172.21.15.88:0/1004345875 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fb05c0adc40 con 0x7fb070102b60 2024-09-17T04:14:05.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:05.530+0000 7fb074dd4640 1 --2- 172.21.15.88:0/1004345875 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fb06006e230 0x7fb0600706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:14:05.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:05.530+0000 7fb074dd4640 1 --2- 172.21.15.88:0/1004345875 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fb06006e230 0x7fb0600706f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb064005d00 tx=0x7fb064005c90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:14:05.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:05.534+0000 7fb06dffb640 1 -- 172.21.15.88:0/1004345875 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb05c07c680 con 0x7fb070102b60 2024-09-17T04:14:05.546 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:14:05.549 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:14:05.549 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:14:05.550 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:14:05.555 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:14:05.557 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:14:05.560 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:14:05.564 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:14:05.564 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:14:05.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:05.749+0000 7fb077038640 1 -- 172.21.15.88:0/1004345875 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fb070191590 con 0x7fb070102b60 2024-09-17T04:14:05.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:05.753+0000 7fb06dffb640 1 -- 172.21.15.88:0/1004345875 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v21)=0 v21) ==== 121+0+0 (secure 0 0 0) 0x7fb05c080330 con 0x7fb070102b60 2024-09-17T04:14:05.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:05.755+0000 7fb077038640 1 -- 172.21.15.88:0/1004345875 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fb06006e230 msgr2=0x7fb0600706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:05.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:05.755+0000 7fb077038640 1 --2- 172.21.15.88:0/1004345875 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fb06006e230 0x7fb0600706f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb064005d00 tx=0x7fb064005c90 comp rx=0 tx=0).stop 2024-09-17T04:14:05.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:05.755+0000 7fb077038640 1 -- 172.21.15.88:0/1004345875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb070102b60 msgr2=0x7fb0701979b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:05.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:05.755+0000 7fb077038640 1 --2- 172.21.15.88:0/1004345875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb070102b60 0x7fb0701979b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb05c006010 tx=0x7fb05c0046c0 comp rx=0 tx=0).stop 2024-09-17T04:14:05.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:05.755+0000 7fb077038640 1 -- 172.21.15.88:0/1004345875 shutdown_connections 2024-09-17T04:14:05.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:05.755+0000 7fb077038640 1 --2- 172.21.15.88:0/1004345875 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fb06006e230 0x7fb0600706f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:05.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:05.755+0000 7fb077038640 1 --2- 172.21.15.88:0/1004345875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb070102b60 0x7fb0701979b0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:05.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:05.755+0000 7fb077038640 1 --2- 172.21.15.88:0/1004345875 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb070101960 0x7fb070197470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:05.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:05.755+0000 7fb077038640 1 -- 172.21.15.88:0/1004345875 >> 172.21.15.88:0/1004345875 conn(0x7fb0700fd0f0 msgr2=0x7fb070106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:14:05.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:05.755+0000 7fb077038640 1 -- 172.21.15.88:0/1004345875 shutdown_connections 2024-09-17T04:14:05.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:05.755+0000 7fb077038640 1 -- 172.21.15.88:0/1004345875 wait complete. 2024-09-17T04:14:06.088 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:14:07.036 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:06 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/1004345875' entity='client.admin' 2024-09-17T04:14:07.036 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:06 smithi088 ceph-mon[27811]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:07.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:06 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/1004345875' entity='client.admin' 2024-09-17T04:14:07.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:06 smithi134 ceph-mon[35201]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:08.049 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:07 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:14:08.050 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:07 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/1334649035' entity='client.admin' 2024-09-17T04:14:08.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:07 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:14:08.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:07 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/1334649035' entity='client.admin' 2024-09-17T04:14:08.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:08.522+0000 7f53fc63e640 1 -- 172.21.15.88:0/3573898411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53f4104da0 msgr2=0x7f53f4107190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:08.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:08.522+0000 7f53fc63e640 1 --2- 172.21.15.88:0/3573898411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53f4104da0 0x7f53f4107190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f53e8009880 tx=0x7f53e802a4a0 comp rx=0 tx=0).stop 2024-09-17T04:14:08.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:08.522+0000 7f53fc63e640 1 -- 172.21.15.88:0/3573898411 shutdown_connections 2024-09-17T04:14:08.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:08.522+0000 7f53fc63e640 1 --2- 172.21.15.88:0/3573898411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53f4104da0 0x7f53f4107190 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:08.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:08.522+0000 7f53fc63e640 1 --2- 172.21.15.88:0/3573898411 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53f4102470 0x7f53f4104860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:08.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:08.522+0000 7f53fc63e640 1 -- 172.21.15.88:0/3573898411 >> 172.21.15.88:0/3573898411 conn(0x7f53f40fc010 msgr2=0x7f53f40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:14:08.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:08.522+0000 7f53fc63e640 1 -- 172.21.15.88:0/3573898411 shutdown_connections 2024-09-17T04:14:08.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:08.522+0000 7f53fc63e640 1 -- 172.21.15.88:0/3573898411 wait complete. 2024-09-17T04:14:08.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:08.523+0000 7f53fc63e640 1 Processor -- start 2024-09-17T04:14:08.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:08.523+0000 7f53fc63e640 1 -- start start 2024-09-17T04:14:08.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:08.523+0000 7f53fc63e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53f4102470 0x7f53f4197550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:14:08.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:08.523+0000 7f53fc63e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53f4104da0 0x7f53f4197a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:14:08.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:08.523+0000 7f53fc63e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f53f410a800 con 0x7f53f4104da0 2024-09-17T04:14:08.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:08.523+0000 7f53fc63e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f53f410a680 con 0x7f53f4102470 2024-09-17T04:14:08.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:08.523+0000 7f53f9bd9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53f4104da0 0x7f53f4197a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:14:08.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:08.524+0000 7f53f9bd9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53f4104da0 0x7f53f4197a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38530/0 (socket says 172.21.15.88:38530) 2024-09-17T04:14:08.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:08.524+0000 7f53f9bd9640 1 -- 172.21.15.88:0/2151547658 learned_addr learned my addr 172.21.15.88:0/2151547658 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:14:08.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:08.524+0000 7f53fa3da640 1 --2- 172.21.15.88:0/2151547658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53f4102470 0x7f53f4197550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:14:08.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:08.524+0000 7f53f9bd9640 1 -- 172.21.15.88:0/2151547658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53f4102470 msgr2=0x7f53f4197550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:08.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:08.524+0000 7f53f9bd9640 1 --2- 172.21.15.88:0/2151547658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53f4102470 0x7f53f4197550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:08.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:08.524+0000 7f53f9bd9640 1 -- 172.21.15.88:0/2151547658 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53f4198110 con 0x7f53f4104da0 2024-09-17T04:14:08.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:08.524+0000 7f53f9bd9640 1 --2- 172.21.15.88:0/2151547658 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53f4104da0 0x7f53f4197a90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f53e8006010 tx=0x7f53e80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:14:08.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:08.524+0000 7f53f37fe640 1 -- 172.21.15.88:0/2151547658 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f53e803f070 con 0x7f53f4104da0 2024-09-17T04:14:08.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:08.524+0000 7f53f37fe640 1 -- 172.21.15.88:0/2151547658 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f53e80044d0 con 0x7f53f4104da0 2024-09-17T04:14:08.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:08.524+0000 7f53f37fe640 1 -- 172.21.15.88:0/2151547658 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f53e8035030 con 0x7f53f4104da0 2024-09-17T04:14:08.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:08.524+0000 7f53fc63e640 1 -- 172.21.15.88:0/2151547658 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53f419caf0 con 0x7f53f4104da0 2024-09-17T04:14:08.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:08.524+0000 7f53fc63e640 1 -- 172.21.15.88:0/2151547658 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53f419d100 con 0x7f53f4104da0 2024-09-17T04:14:08.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:08.525+0000 7f53fc63e640 1 -- 172.21.15.88:0/2151547658 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53f4102850 con 0x7f53f4104da0 2024-09-17T04:14:08.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:08.526+0000 7f53f37fe640 1 -- 172.21.15.88:0/2151547658 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f53e8042070 con 0x7f53f4104da0 2024-09-17T04:14:08.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:08.526+0000 7f53f37fe640 1 --2- 172.21.15.88:0/2151547658 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f53dc06e280 0x7f53dc070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:14:08.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:08.526+0000 7f53f37fe640 1 -- 172.21.15.88:0/2151547658 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f53e80adc00 con 0x7f53f4104da0 2024-09-17T04:14:08.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:08.526+0000 7f53fa3da640 1 --2- 172.21.15.88:0/2151547658 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f53dc06e280 0x7f53dc070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:14:08.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:08.527+0000 7f53fa3da640 1 --2- 172.21.15.88:0/2151547658 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f53dc06e280 0x7f53dc070740 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f53e400a810 tx=0x7f53e4008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:14:08.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:08.531+0000 7f53f37fe640 1 -- 172.21.15.88:0/2151547658 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f53e80b4080 con 0x7f53f4104da0 2024-09-17T04:14:08.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:08.703+0000 7f53fc63e640 1 -- 172.21.15.88:0/2151547658 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7f53f419d330 con 0x7f53f4104da0 2024-09-17T04:14:08.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:08.703+0000 7f53f37fe640 1 -- 172.21.15.88:0/2151547658 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v22)=0 v22) ==== 108+0+0 (secure 0 0 0) 0x7f53e807c6c0 con 0x7f53f4104da0 2024-09-17T04:14:08.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:08.706+0000 7f53fc63e640 1 -- 172.21.15.88:0/2151547658 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f53dc06e280 msgr2=0x7f53dc070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:08.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:08.706+0000 7f53fc63e640 1 --2- 172.21.15.88:0/2151547658 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f53dc06e280 0x7f53dc070740 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f53e400a810 tx=0x7f53e4008040 comp rx=0 tx=0).stop 2024-09-17T04:14:08.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:08.706+0000 7f53fc63e640 1 -- 172.21.15.88:0/2151547658 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53f4104da0 msgr2=0x7f53f4197a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:08.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:08.706+0000 7f53fc63e640 1 --2- 172.21.15.88:0/2151547658 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53f4104da0 0x7f53f4197a90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f53e8006010 tx=0x7f53e80048f0 comp rx=0 tx=0).stop 2024-09-17T04:14:08.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:08.706+0000 7f53fc63e640 1 -- 172.21.15.88:0/2151547658 shutdown_connections 2024-09-17T04:14:08.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:08.706+0000 7f53fc63e640 1 --2- 172.21.15.88:0/2151547658 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f53dc06e280 0x7f53dc070740 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:08.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:08.706+0000 7f53fc63e640 1 --2- 172.21.15.88:0/2151547658 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53f4104da0 0x7f53f4197a90 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:08.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:08.706+0000 7f53fc63e640 1 --2- 172.21.15.88:0/2151547658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53f4102470 0x7f53f4197550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:08.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:08.706+0000 7f53fc63e640 1 -- 172.21.15.88:0/2151547658 >> 172.21.15.88:0/2151547658 conn(0x7f53f40fc010 msgr2=0x7f53f40fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:14:08.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:08.706+0000 7f53fc63e640 1 -- 172.21.15.88:0/2151547658 shutdown_connections 2024-09-17T04:14:08.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:08.706+0000 7f53fc63e640 1 -- 172.21.15.88:0/2151547658 wait complete. 2024-09-17T04:14:08.973 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:08 smithi088 ceph-mon[27811]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:09.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:08 smithi134 ceph-mon[35201]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:09.334 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.122+0000 7f80a823e640 1 -- 172.21.15.88:0/157586377 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80a0100860 msgr2=0x7f80a0100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:09.334 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.122+0000 7f80a823e640 1 --2- 172.21.15.88:0/157586377 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80a0100860 0x7f80a0100c60 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8098009880 tx=0x7f809802a4a0 comp rx=0 tx=0).stop 2024-09-17T04:14:09.334 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.122+0000 7f80a823e640 1 -- 172.21.15.88:0/157586377 shutdown_connections 2024-09-17T04:14:09.334 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.122+0000 7f80a823e640 1 --2- 172.21.15.88:0/157586377 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80a0101a60 0x7f80a0101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:09.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.122+0000 7f80a823e640 1 --2- 172.21.15.88:0/157586377 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80a0100860 0x7f80a0100c60 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:09.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.122+0000 7f80a823e640 1 -- 172.21.15.88:0/157586377 >> 172.21.15.88:0/157586377 conn(0x7f80a00fc010 msgr2=0x7f80a00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:14:09.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.122+0000 7f80a823e640 1 -- 172.21.15.88:0/157586377 shutdown_connections 2024-09-17T04:14:09.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.122+0000 7f80a823e640 1 -- 172.21.15.88:0/157586377 wait complete. 2024-09-17T04:14:09.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.123+0000 7f80a823e640 1 Processor -- start 2024-09-17T04:14:09.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.123+0000 7f80a823e640 1 -- start start 2024-09-17T04:14:09.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.123+0000 7f80a823e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80a0100860 0x7f80a01974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:14:09.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.123+0000 7f80a823e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80a0101a60 0x7f80a0197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:14:09.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.123+0000 7f80a823e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f80a01096a0 con 0x7f80a0100860 2024-09-17T04:14:09.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.123+0000 7f80a823e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f80a0109520 con 0x7f80a0101a60 2024-09-17T04:14:09.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.123+0000 7f80a5fda640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80a0100860 0x7f80a01974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:14:09.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.123+0000 7f80a5fda640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80a0100860 0x7f80a01974e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38546/0 (socket says 172.21.15.88:38546) 2024-09-17T04:14:09.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.123+0000 7f80a5fda640 1 -- 172.21.15.88:0/2982009460 learned_addr learned my addr 172.21.15.88:0/2982009460 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:14:09.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.123+0000 7f80a57d9640 1 --2- 172.21.15.88:0/2982009460 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80a0101a60 0x7f80a0197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:14:09.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.123+0000 7f80a5fda640 1 -- 172.21.15.88:0/2982009460 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80a0101a60 msgr2=0x7f80a0197a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:09.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.123+0000 7f80a5fda640 1 --2- 172.21.15.88:0/2982009460 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80a0101a60 0x7f80a0197a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:09.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.123+0000 7f80a5fda640 1 -- 172.21.15.88:0/2982009460 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80a01980a0 con 0x7f80a0100860 2024-09-17T04:14:09.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.123+0000 7f80a5fda640 1 --2- 172.21.15.88:0/2982009460 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80a0100860 0x7f80a01974e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8098006010 tx=0x7f80980045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:14:09.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.123+0000 7f809effd640 1 -- 172.21.15.88:0/2982009460 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f809803f070 con 0x7f80a0100860 2024-09-17T04:14:09.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.123+0000 7f809effd640 1 -- 172.21.15.88:0/2982009460 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8098004a50 con 0x7f80a0100860 2024-09-17T04:14:09.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.123+0000 7f80a823e640 1 -- 172.21.15.88:0/2982009460 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80a019ca80 con 0x7f80a0100860 2024-09-17T04:14:09.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.123+0000 7f809effd640 1 -- 172.21.15.88:0/2982009460 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8098035030 con 0x7f80a0100860 2024-09-17T04:14:09.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.124+0000 7f80a823e640 1 -- 172.21.15.88:0/2982009460 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80a019d010 con 0x7f80a0100860 2024-09-17T04:14:09.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.125+0000 7f80a823e640 1 -- 172.21.15.88:0/2982009460 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80a0100c60 con 0x7f80a0100860 2024-09-17T04:14:09.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.125+0000 7f809effd640 1 -- 172.21.15.88:0/2982009460 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f8098042070 con 0x7f80a0100860 2024-09-17T04:14:09.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.126+0000 7f809effd640 1 --2- 172.21.15.88:0/2982009460 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f808806e280 0x7f8088070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:14:09.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.126+0000 7f809effd640 1 -- 172.21.15.88:0/2982009460 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f80980adb40 con 0x7f80a0100860 2024-09-17T04:14:09.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.127+0000 7f80a57d9640 1 --2- 172.21.15.88:0/2982009460 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f808806e280 0x7f8088070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:14:09.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.127+0000 7f80a57d9640 1 --2- 172.21.15.88:0/2982009460 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f808806e280 0x7f8088070740 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8094005fd0 tx=0x7f8094005850 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:14:09.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.131+0000 7f809effd640 1 -- 172.21.15.88:0/2982009460 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f809807c600 con 0x7f80a0100860 2024-09-17T04:14:09.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.303+0000 7f80a823e640 1 -- 172.21.15.88:0/2982009460 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f80a019d240 con 0x7f80a0100860 2024-09-17T04:14:09.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.306+0000 7f809effd640 1 -- 172.21.15.88:0/2982009460 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v23)=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7f80980802b0 con 0x7f80a0100860 2024-09-17T04:14:09.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.309+0000 7f80a823e640 1 -- 172.21.15.88:0/2982009460 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f808806e280 msgr2=0x7f8088070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:09.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.309+0000 7f80a823e640 1 --2- 172.21.15.88:0/2982009460 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f808806e280 0x7f8088070740 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8094005fd0 tx=0x7f8094005850 comp rx=0 tx=0).stop 2024-09-17T04:14:09.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.309+0000 7f80a823e640 1 -- 172.21.15.88:0/2982009460 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80a0100860 msgr2=0x7f80a01974e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:09.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.309+0000 7f80a823e640 1 --2- 172.21.15.88:0/2982009460 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80a0100860 0x7f80a01974e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8098006010 tx=0x7f80980045e0 comp rx=0 tx=0).stop 2024-09-17T04:14:09.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.309+0000 7f80a823e640 1 -- 172.21.15.88:0/2982009460 shutdown_connections 2024-09-17T04:14:09.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.309+0000 7f80a823e640 1 --2- 172.21.15.88:0/2982009460 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f808806e280 0x7f8088070740 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:09.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.309+0000 7f80a823e640 1 --2- 172.21.15.88:0/2982009460 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80a0101a60 0x7f80a0197a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:09.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.309+0000 7f80a823e640 1 --2- 172.21.15.88:0/2982009460 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80a0100860 0x7f80a01974e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:09.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.309+0000 7f80a823e640 1 -- 172.21.15.88:0/2982009460 >> 172.21.15.88:0/2982009460 conn(0x7f80a00fc010 msgr2=0x7f80a00fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:14:09.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.309+0000 7f80a823e640 1 -- 172.21.15.88:0/2982009460 shutdown_connections 2024-09-17T04:14:09.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.309+0000 7f80a823e640 1 -- 172.21.15.88:0/2982009460 wait complete. 2024-09-17T04:14:09.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.653+0000 7f0966147640 1 -- 172.21.15.88:0/442240658 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0960100860 msgr2=0x7f0960100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:09.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.653+0000 7f0966147640 1 --2- 172.21.15.88:0/442240658 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0960100860 0x7f0960100c60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0950009880 tx=0x7f095002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:14:09.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.653+0000 7f0966147640 1 -- 172.21.15.88:0/442240658 shutdown_connections 2024-09-17T04:14:09.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.653+0000 7f0966147640 1 --2- 172.21.15.88:0/442240658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0960101a60 0x7f0960101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:09.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.653+0000 7f0966147640 1 --2- 172.21.15.88:0/442240658 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0960100860 0x7f0960100c60 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:09.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.653+0000 7f0966147640 1 -- 172.21.15.88:0/442240658 >> 172.21.15.88:0/442240658 conn(0x7f09600fc010 msgr2=0x7f09600fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:14:09.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.653+0000 7f0966147640 1 -- 172.21.15.88:0/442240658 shutdown_connections 2024-09-17T04:14:09.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.653+0000 7f0966147640 1 -- 172.21.15.88:0/442240658 wait complete. 2024-09-17T04:14:09.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.654+0000 7f0966147640 1 Processor -- start 2024-09-17T04:14:09.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.654+0000 7f0966147640 1 -- start start 2024-09-17T04:14:09.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.654+0000 7f0966147640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0960100860 0x7f096006a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:14:09.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.654+0000 7f0966147640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0960101a60 0x7f096019c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:14:09.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.654+0000 7f0966147640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f09601096a0 con 0x7f0960101a60 2024-09-17T04:14:09.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.654+0000 7f0966147640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0960109520 con 0x7f0960100860 2024-09-17T04:14:09.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.654+0000 7f095effd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0960101a60 0x7f096019c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:14:09.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.654+0000 7f095effd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0960101a60 0x7f096019c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38562/0 (socket says 172.21.15.88:38562) 2024-09-17T04:14:09.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.654+0000 7f095effd640 1 -- 172.21.15.88:0/3368253930 learned_addr learned my addr 172.21.15.88:0/3368253930 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:14:09.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.654+0000 7f095f7fe640 1 --2- 172.21.15.88:0/3368253930 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0960100860 0x7f096006a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:14:09.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.655+0000 7f095effd640 1 -- 172.21.15.88:0/3368253930 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0960100860 msgr2=0x7f096006a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:09.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.655+0000 7f095effd640 1 --2- 172.21.15.88:0/3368253930 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0960100860 0x7f096006a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:09.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.655+0000 7f095effd640 1 -- 172.21.15.88:0/3368253930 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f096019c7f0 con 0x7f0960101a60 2024-09-17T04:14:09.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.655+0000 7f095effd640 1 --2- 172.21.15.88:0/3368253930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0960101a60 0x7f096019c230 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f095400d6f0 tx=0x7f095400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:14:09.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.655+0000 7f095cff9640 1 -- 172.21.15.88:0/3368253930 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0954017070 con 0x7f0960101a60 2024-09-17T04:14:09.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.655+0000 7f095cff9640 1 -- 172.21.15.88:0/3368253930 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f095400de00 con 0x7f0960101a60 2024-09-17T04:14:09.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.655+0000 7f0966147640 1 -- 172.21.15.88:0/3368253930 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f096019cae0 con 0x7f0960101a60 2024-09-17T04:14:09.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.655+0000 7f095cff9640 1 -- 172.21.15.88:0/3368253930 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0954004bb0 con 0x7f0960101a60 2024-09-17T04:14:09.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.655+0000 7f0966147640 1 -- 172.21.15.88:0/3368253930 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f096019d070 con 0x7f0960101a60 2024-09-17T04:14:09.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.656+0000 7f0966147640 1 -- 172.21.15.88:0/3368253930 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0960100c60 con 0x7f0960101a60 2024-09-17T04:14:09.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.656+0000 7f095cff9640 1 -- 172.21.15.88:0/3368253930 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f0954010460 con 0x7f0960101a60 2024-09-17T04:14:09.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.657+0000 7f095cff9640 1 --2- 172.21.15.88:0/3368253930 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f094806e280 0x7f0948070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:14:09.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.657+0000 7f095f7fe640 1 --2- 172.21.15.88:0/3368253930 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f094806e280 0x7f0948070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:14:09.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.657+0000 7f095cff9640 1 -- 172.21.15.88:0/3368253930 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f095408cbd0 con 0x7f0960101a60 2024-09-17T04:14:09.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.657+0000 7f095f7fe640 1 --2- 172.21.15.88:0/3368253930 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f094806e280 0x7f0948070740 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0950009230 tx=0x7f09500058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:14:09.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.661+0000 7f095cff9640 1 -- 172.21.15.88:0/3368253930 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f095405f2b0 con 0x7f0960101a60 2024-09-17T04:14:09.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:07.324+0000 7fe3dcc1e640 1 -- 172.21.15.88:0/2080216810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3d8100ad0 msgr2=0x7fe3d8100f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:09.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:07.324+0000 7fe3dcc1e640 1 --2- 172.21.15.88:0/2080216810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3d8100ad0 0x7fe3d8100f50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe3c0009880 tx=0x7fe3c002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:14:09.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:07.324+0000 7fe3dcc1e640 1 -- 172.21.15.88:0/2080216810 shutdown_connections 2024-09-17T04:14:09.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:07.324+0000 7fe3dcc1e640 1 --2- 172.21.15.88:0/2080216810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3d8100ad0 0x7fe3d8100f50 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:09.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:07.324+0000 7fe3dcc1e640 1 --2- 172.21.15.88:0/2080216810 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe3d8101e70 0x7fe3d8102270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:09.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:07.324+0000 7fe3dcc1e640 1 -- 172.21.15.88:0/2080216810 >> 172.21.15.88:0/2080216810 conn(0x7fe3d80fb770 msgr2=0x7fe3d80fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:14:09.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:07.324+0000 7fe3dcc1e640 1 -- 172.21.15.88:0/2080216810 shutdown_connections 2024-09-17T04:14:09.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:07.324+0000 7fe3dcc1e640 1 -- 172.21.15.88:0/2080216810 wait complete. 2024-09-17T04:14:09.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:07.325+0000 7fe3dcc1e640 1 Processor -- start 2024-09-17T04:14:09.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:07.325+0000 7fe3dcc1e640 1 -- start start 2024-09-17T04:14:09.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:07.325+0000 7fe3dcc1e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3d8100ad0 0x7fe3d81004f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:14:09.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:07.325+0000 7fe3dcc1e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe3d8101e70 0x7fe3d819c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:14:09.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:07.325+0000 7fe3dcc1e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d81096c0 con 0x7fe3d8100ad0 2024-09-17T04:14:09.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:07.325+0000 7fe3dcc1e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d8109540 con 0x7fe3d8101e70 2024-09-17T04:14:09.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:07.325+0000 7fe3d659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3d8100ad0 0x7fe3d81004f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:14:09.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:07.325+0000 7fe3d659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3d8100ad0 0x7fe3d81004f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38510/0 (socket says 172.21.15.88:38510) 2024-09-17T04:14:09.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:07.325+0000 7fe3d659c640 1 -- 172.21.15.88:0/1334649035 learned_addr learned my addr 172.21.15.88:0/1334649035 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:14:09.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:07.325+0000 7fe3cffff640 1 --2- 172.21.15.88:0/1334649035 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe3d8101e70 0x7fe3d819c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:14:09.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:07.325+0000 7fe3d659c640 1 -- 172.21.15.88:0/1334649035 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe3d8101e70 msgr2=0x7fe3d819c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:09.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:07.325+0000 7fe3d659c640 1 --2- 172.21.15.88:0/1334649035 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe3d8101e70 0x7fe3d819c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:09.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:07.326+0000 7fe3d659c640 1 -- 172.21.15.88:0/1334649035 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3d819c810 con 0x7fe3d8100ad0 2024-09-17T04:14:09.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:07.326+0000 7fe3cffff640 1 --2- 172.21.15.88:0/1334649035 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe3d8101e70 0x7fe3d819c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:14:09.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:07.326+0000 7fe3d659c640 1 --2- 172.21.15.88:0/1334649035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3d8100ad0 0x7fe3d81004f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe3c800c8f0 tx=0x7fe3c800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:14:09.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:07.326+0000 7fe3cf7fe640 1 -- 172.21.15.88:0/1334649035 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe3c8004020 con 0x7fe3d8100ad0 2024-09-17T04:14:09.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:07.326+0000 7fe3dcc1e640 1 -- 172.21.15.88:0/1334649035 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3d819cb00 con 0x7fe3d8100ad0 2024-09-17T04:14:09.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:07.326+0000 7fe3cf7fe640 1 -- 172.21.15.88:0/1334649035 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe3c80041c0 con 0x7fe3d8100ad0 2024-09-17T04:14:09.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:07.326+0000 7fe3cf7fe640 1 -- 172.21.15.88:0/1334649035 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe3c80047a0 con 0x7fe3d8100ad0 2024-09-17T04:14:09.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:07.326+0000 7fe3dcc1e640 1 -- 172.21.15.88:0/1334649035 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3d819d090 con 0x7fe3d8100ad0 2024-09-17T04:14:09.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:07.327+0000 7fe3dcc1e640 1 -- 172.21.15.88:0/1334649035 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3d8100f50 con 0x7fe3d8100ad0 2024-09-17T04:14:09.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:07.328+0000 7fe3cf7fe640 1 -- 172.21.15.88:0/1334649035 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7fe3c80079b0 con 0x7fe3d8100ad0 2024-09-17T04:14:09.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:07.328+0000 7fe3cf7fe640 1 --2- 172.21.15.88:0/1334649035 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fe3c406e230 0x7fe3c40706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:14:09.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:07.328+0000 7fe3cf7fe640 1 -- 172.21.15.88:0/1334649035 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fe3c808cfa0 con 0x7fe3d8100ad0 2024-09-17T04:14:09.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:07.328+0000 7fe3cffff640 1 --2- 172.21.15.88:0/1334649035 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fe3c406e230 0x7fe3c40706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:14:09.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:07.328+0000 7fe3cffff640 1 --2- 172.21.15.88:0/1334649035 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fe3c406e230 0x7fe3c40706f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe3c00096c0 tx=0x7fe3c0009650 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:14:09.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:07.332+0000 7fe3cf7fe640 1 -- 172.21.15.88:0/1334649035 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe3c8014030 con 0x7fe3d8100ad0 2024-09-17T04:14:09.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:07.507+0000 7fe3dcc1e640 1 -- 172.21.15.88:0/1334649035 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fe3d81904d0 con 0x7fe3d8100ad0 2024-09-17T04:14:09.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:07.510+0000 7fe3cf7fe640 1 -- 172.21.15.88:0/1334649035 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v22)=0 v22) ==== 120+0+0 (secure 0 0 0) 0x7fe3d81904d0 con 0x7fe3d8100ad0 2024-09-17T04:14:09.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:07.512+0000 7fe3dcc1e640 1 -- 172.21.15.88:0/1334649035 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fe3c406e230 msgr2=0x7fe3c40706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:09.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:07.512+0000 7fe3dcc1e640 1 --2- 172.21.15.88:0/1334649035 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fe3c406e230 0x7fe3c40706f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe3c00096c0 tx=0x7fe3c0009650 comp rx=0 tx=0).stop 2024-09-17T04:14:09.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:07.512+0000 7fe3dcc1e640 1 -- 172.21.15.88:0/1334649035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3d8100ad0 msgr2=0x7fe3d81004f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:09.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:07.512+0000 7fe3dcc1e640 1 --2- 172.21.15.88:0/1334649035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3d8100ad0 0x7fe3d81004f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe3c800c8f0 tx=0x7fe3c800cdb0 comp rx=0 tx=0).stop 2024-09-17T04:14:09.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:07.512+0000 7fe3dcc1e640 1 -- 172.21.15.88:0/1334649035 shutdown_connections 2024-09-17T04:14:09.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:07.512+0000 7fe3dcc1e640 1 --2- 172.21.15.88:0/1334649035 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fe3c406e230 0x7fe3c40706f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:09.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:07.512+0000 7fe3dcc1e640 1 --2- 172.21.15.88:0/1334649035 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe3d8101e70 0x7fe3d819c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:09.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:07.512+0000 7fe3dcc1e640 1 --2- 172.21.15.88:0/1334649035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3d8100ad0 0x7fe3d81004f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:09.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:07.512+0000 7fe3dcc1e640 1 -- 172.21.15.88:0/1334649035 >> 172.21.15.88:0/1334649035 conn(0x7fe3d80fb770 msgr2=0x7fe3d8104f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:14:09.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:07.512+0000 7fe3dcc1e640 1 -- 172.21.15.88:0/1334649035 shutdown_connections 2024-09-17T04:14:09.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:07.512+0000 7fe3dcc1e640 1 -- 172.21.15.88:0/1334649035 wait complete. 2024-09-17T04:14:09.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.833+0000 7f0966147640 1 -- 172.21.15.88:0/3368253930 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f0960062df0 con 0x7f0960101a60 2024-09-17T04:14:09.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.837+0000 7f095cff9640 1 -- 172.21.15.88:0/3368253930 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v24)=0 v24) ==== 115+0+0 (secure 0 0 0) 0x7f0954063ae0 con 0x7f0960101a60 2024-09-17T04:14:09.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.839+0000 7f0966147640 1 -- 172.21.15.88:0/3368253930 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f094806e280 msgr2=0x7f0948070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:09.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.839+0000 7f0966147640 1 --2- 172.21.15.88:0/3368253930 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f094806e280 0x7f0948070740 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0950009230 tx=0x7f09500058d0 comp rx=0 tx=0).stop 2024-09-17T04:14:09.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.839+0000 7f0966147640 1 -- 172.21.15.88:0/3368253930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0960101a60 msgr2=0x7f096019c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:09.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.839+0000 7f0966147640 1 --2- 172.21.15.88:0/3368253930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0960101a60 0x7f096019c230 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f095400d6f0 tx=0x7f095400dbb0 comp rx=0 tx=0).stop 2024-09-17T04:14:09.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.839+0000 7f0966147640 1 -- 172.21.15.88:0/3368253930 shutdown_connections 2024-09-17T04:14:09.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.839+0000 7f0966147640 1 --2- 172.21.15.88:0/3368253930 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f094806e280 0x7f0948070740 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:09.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.839+0000 7f0966147640 1 --2- 172.21.15.88:0/3368253930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0960101a60 0x7f096019c230 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:09.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.839+0000 7f0966147640 1 --2- 172.21.15.88:0/3368253930 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0960100860 0x7f096006a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:09.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.839+0000 7f0966147640 1 -- 172.21.15.88:0/3368253930 >> 172.21.15.88:0/3368253930 conn(0x7f09600fc010 msgr2=0x7f0960104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:14:09.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.839+0000 7f0966147640 1 -- 172.21.15.88:0/3368253930 shutdown_connections 2024-09-17T04:14:09.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:09.839+0000 7f0966147640 1 -- 172.21.15.88:0/3368253930 wait complete. 2024-09-17T04:14:10.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:10 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/2982009460' entity='client.admin' 2024-09-17T04:14:10.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:10 smithi088 ceph-mon[27811]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:10.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:10 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/3368253930' entity='client.admin' 2024-09-17T04:14:10.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:10.575+0000 7fa50a493640 1 -- 172.21.15.88:0/3883084123 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa504102b60 msgr2=0x7fa504102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:10.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:10.575+0000 7fa50a493640 1 --2- 172.21.15.88:0/3883084123 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa504102b60 0x7fa504102fe0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa4f8009880 tx=0x7fa4f802a4a0 comp rx=0 tx=0).stop 2024-09-17T04:14:10.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:10.575+0000 7fa50a493640 1 -- 172.21.15.88:0/3883084123 shutdown_connections 2024-09-17T04:14:10.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:10.575+0000 7fa50a493640 1 --2- 172.21.15.88:0/3883084123 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa504102b60 0x7fa504102fe0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:10.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:10.575+0000 7fa50a493640 1 --2- 172.21.15.88:0/3883084123 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa504101960 0x7fa504101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:10.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:10.575+0000 7fa50a493640 1 -- 172.21.15.88:0/3883084123 >> 172.21.15.88:0/3883084123 conn(0x7fa5040fd0f0 msgr2=0x7fa5040ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:14:10.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:10.575+0000 7fa50a493640 1 -- 172.21.15.88:0/3883084123 shutdown_connections 2024-09-17T04:14:10.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:10.575+0000 7fa50a493640 1 -- 172.21.15.88:0/3883084123 wait complete. 2024-09-17T04:14:10.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:10.576+0000 7fa50a493640 1 Processor -- start 2024-09-17T04:14:10.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:10.576+0000 7fa50a493640 1 -- start start 2024-09-17T04:14:10.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:10.576+0000 7fa50a493640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa504101960 0x7fa504197540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:14:10.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:10.576+0000 7fa50a493640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa504102b60 0x7fa504197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:14:10.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:10.576+0000 7fa50a493640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa50410a820 con 0x7fa504102b60 2024-09-17T04:14:10.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:10.576+0000 7fa50a493640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa50410a6a0 con 0x7fa504101960 2024-09-17T04:14:10.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:10.576+0000 7fa5037fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa504102b60 0x7fa504197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:14:10.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:10.576+0000 7fa5037fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa504102b60 0x7fa504197a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38590/0 (socket says 172.21.15.88:38590) 2024-09-17T04:14:10.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:10.576+0000 7fa5037fe640 1 -- 172.21.15.88:0/3346154252 learned_addr learned my addr 172.21.15.88:0/3346154252 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:14:10.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:10.577+0000 7fa5037fe640 1 -- 172.21.15.88:0/3346154252 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa504101960 msgr2=0x7fa504197540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:10.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:10.577+0000 7fa503fff640 1 --2- 172.21.15.88:0/3346154252 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa504101960 0x7fa504197540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:14:10.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:10.577+0000 7fa5037fe640 1 --2- 172.21.15.88:0/3346154252 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa504101960 0x7fa504197540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:10.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:10.577+0000 7fa5037fe640 1 -- 172.21.15.88:0/3346154252 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa504198100 con 0x7fa504102b60 2024-09-17T04:14:10.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:10.577+0000 7fa5037fe640 1 --2- 172.21.15.88:0/3346154252 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa504102b60 0x7fa504197a80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa4f8006010 tx=0x7fa4f80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:14:10.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:10.577+0000 7fa5017fa640 1 -- 172.21.15.88:0/3346154252 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa4f803f070 con 0x7fa504102b60 2024-09-17T04:14:10.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:10.577+0000 7fa5017fa640 1 -- 172.21.15.88:0/3346154252 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa4f80044d0 con 0x7fa504102b60 2024-09-17T04:14:10.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:10.577+0000 7fa50a493640 1 -- 172.21.15.88:0/3346154252 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa50419cae0 con 0x7fa504102b60 2024-09-17T04:14:10.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:10.577+0000 7fa5017fa640 1 -- 172.21.15.88:0/3346154252 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa4f8035030 con 0x7fa504102b60 2024-09-17T04:14:10.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:10.577+0000 7fa50a493640 1 -- 172.21.15.88:0/3346154252 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa50419d0f0 con 0x7fa504102b60 2024-09-17T04:14:10.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:10.578+0000 7fa50a493640 1 -- 172.21.15.88:0/3346154252 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa504101d40 con 0x7fa504102b60 2024-09-17T04:14:10.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:10.578+0000 7fa5017fa640 1 -- 172.21.15.88:0/3346154252 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7fa4f8042070 con 0x7fa504102b60 2024-09-17T04:14:10.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:10.579+0000 7fa5017fa640 1 --2- 172.21.15.88:0/3346154252 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fa4ec06e280 0x7fa4ec070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:14:10.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:10.579+0000 7fa5017fa640 1 -- 172.21.15.88:0/3346154252 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fa4f80adcd0 con 0x7fa504102b60 2024-09-17T04:14:10.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:10.579+0000 7fa503fff640 1 --2- 172.21.15.88:0/3346154252 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fa4ec06e280 0x7fa4ec070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:14:10.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:10.579+0000 7fa503fff640 1 --2- 172.21.15.88:0/3346154252 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fa4ec06e280 0x7fa4ec070740 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa5041029c0 tx=0x7fa4f4008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:14:10.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:10.583+0000 7fa5017fa640 1 -- 172.21.15.88:0/3346154252 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa4f807c790 con 0x7fa504102b60 2024-09-17T04:14:10.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:10 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/2982009460' entity='client.admin' 2024-09-17T04:14:10.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:10 smithi134 ceph-mon[35201]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:10.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:10 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/3368253930' entity='client.admin' 2024-09-17T04:14:10.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:10.758+0000 7fa50a493640 1 -- 172.21.15.88:0/3346154252 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7fa504191630 con 0x7fa504102b60 2024-09-17T04:14:10.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:10.762+0000 7fa5017fa640 1 -- 172.21.15.88:0/3346154252 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v25)=0 v25) ==== 108+0+0 (secure 0 0 0) 0x7fa4f8080440 con 0x7fa504102b60 2024-09-17T04:14:10.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:10.764+0000 7fa50a493640 1 -- 172.21.15.88:0/3346154252 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fa4ec06e280 msgr2=0x7fa4ec070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:10.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:10.764+0000 7fa50a493640 1 --2- 172.21.15.88:0/3346154252 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fa4ec06e280 0x7fa4ec070740 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa5041029c0 tx=0x7fa4f4008040 comp rx=0 tx=0).stop 2024-09-17T04:14:10.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:10.764+0000 7fa50a493640 1 -- 172.21.15.88:0/3346154252 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa504102b60 msgr2=0x7fa504197a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:10.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:10.764+0000 7fa50a493640 1 --2- 172.21.15.88:0/3346154252 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa504102b60 0x7fa504197a80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa4f8006010 tx=0x7fa4f80048f0 comp rx=0 tx=0).stop 2024-09-17T04:14:10.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:10.764+0000 7fa50a493640 1 -- 172.21.15.88:0/3346154252 shutdown_connections 2024-09-17T04:14:10.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:10.764+0000 7fa50a493640 1 --2- 172.21.15.88:0/3346154252 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fa4ec06e280 0x7fa4ec070740 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:10.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:10.764+0000 7fa50a493640 1 --2- 172.21.15.88:0/3346154252 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa504102b60 0x7fa504197a80 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:10.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:10.764+0000 7fa50a493640 1 --2- 172.21.15.88:0/3346154252 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa504101960 0x7fa504197540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:10.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:10.764+0000 7fa50a493640 1 -- 172.21.15.88:0/3346154252 >> 172.21.15.88:0/3346154252 conn(0x7fa5040fd0f0 msgr2=0x7fa504106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:14:10.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:10.764+0000 7fa50a493640 1 -- 172.21.15.88:0/3346154252 shutdown_connections 2024-09-17T04:14:10.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:10.764+0000 7fa50a493640 1 -- 172.21.15.88:0/3346154252 wait complete. 2024-09-17T04:14:11.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.194+0000 7fd003923640 1 -- 172.21.15.88:0/2826549216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcffc100860 msgr2=0x7fcffc100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:11.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.194+0000 7fd003923640 1 --2- 172.21.15.88:0/2826549216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcffc100860 0x7fcffc100c60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcff4009880 tx=0x7fcff402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:14:11.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.194+0000 7fd003923640 1 -- 172.21.15.88:0/2826549216 shutdown_connections 2024-09-17T04:14:11.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.194+0000 7fd003923640 1 --2- 172.21.15.88:0/2826549216 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcffc101a60 0x7fcffc101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:11.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.194+0000 7fd003923640 1 --2- 172.21.15.88:0/2826549216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcffc100860 0x7fcffc100c60 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:11.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.194+0000 7fd003923640 1 -- 172.21.15.88:0/2826549216 >> 172.21.15.88:0/2826549216 conn(0x7fcffc0fc010 msgr2=0x7fcffc0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:14:11.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.194+0000 7fd003923640 1 -- 172.21.15.88:0/2826549216 shutdown_connections 2024-09-17T04:14:11.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.194+0000 7fd003923640 1 -- 172.21.15.88:0/2826549216 wait complete. 2024-09-17T04:14:11.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.195+0000 7fd003923640 1 Processor -- start 2024-09-17T04:14:11.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.195+0000 7fd003923640 1 -- start start 2024-09-17T04:14:11.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.195+0000 7fd003923640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcffc100860 0x7fcffc197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:14:11.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.195+0000 7fd003923640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcffc101a60 0x7fcffc197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:14:11.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.195+0000 7fd003923640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fcffc109700 con 0x7fcffc100860 2024-09-17T04:14:11.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.195+0000 7fd003923640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcffc109580 con 0x7fcffc101a60 2024-09-17T04:14:11.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.195+0000 7fd0016bf640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcffc100860 0x7fcffc197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:14:11.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.195+0000 7fd0016bf640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcffc100860 0x7fcffc197530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38600/0 (socket says 172.21.15.88:38600) 2024-09-17T04:14:11.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.195+0000 7fd0016bf640 1 -- 172.21.15.88:0/1694327248 learned_addr learned my addr 172.21.15.88:0/1694327248 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:14:11.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.195+0000 7fd0016bf640 1 -- 172.21.15.88:0/1694327248 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcffc101a60 msgr2=0x7fcffc197a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:11.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.195+0000 7fd000ebe640 1 --2- 172.21.15.88:0/1694327248 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcffc101a60 0x7fcffc197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:14:11.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.195+0000 7fd0016bf640 1 --2- 172.21.15.88:0/1694327248 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcffc101a60 0x7fcffc197a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:11.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.195+0000 7fd0016bf640 1 -- 172.21.15.88:0/1694327248 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcffc1980f0 con 0x7fcffc100860 2024-09-17T04:14:11.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.195+0000 7fd0016bf640 1 --2- 172.21.15.88:0/1694327248 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcffc100860 0x7fcffc197530 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fcff4006010 tx=0x7fcff40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:14:11.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.195+0000 7fcffa7fc640 1 -- 172.21.15.88:0/1694327248 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcff403f070 con 0x7fcffc100860 2024-09-17T04:14:11.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.196+0000 7fcffa7fc640 1 -- 172.21.15.88:0/1694327248 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcff40044d0 con 0x7fcffc100860 2024-09-17T04:14:11.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.196+0000 7fd003923640 1 -- 172.21.15.88:0/1694327248 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcffc19cad0 con 0x7fcffc100860 2024-09-17T04:14:11.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.196+0000 7fcffa7fc640 1 -- 172.21.15.88:0/1694327248 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcff4035030 con 0x7fcffc100860 2024-09-17T04:14:11.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.196+0000 7fd003923640 1 -- 172.21.15.88:0/1694327248 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcffc19d060 con 0x7fcffc100860 2024-09-17T04:14:11.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.197+0000 7fd003923640 1 -- 172.21.15.88:0/1694327248 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcffc100c60 con 0x7fcffc100860 2024-09-17T04:14:11.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.197+0000 7fcffa7fc640 1 -- 172.21.15.88:0/1694327248 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7fcff4042070 con 0x7fcffc100860 2024-09-17T04:14:11.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.198+0000 7fcffa7fc640 1 --2- 172.21.15.88:0/1694327248 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fcfe406e230 0x7fcfe40706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:14:11.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.198+0000 7fd000ebe640 1 --2- 172.21.15.88:0/1694327248 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fcfe406e230 0x7fcfe40706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:14:11.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.198+0000 7fcffa7fc640 1 -- 172.21.15.88:0/1694327248 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fcff40add00 con 0x7fcffc100860 2024-09-17T04:14:11.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.198+0000 7fd000ebe640 1 --2- 172.21.15.88:0/1694327248 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fcfe406e230 0x7fcfe40706f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcffc1989e0 tx=0x7fcff0008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:14:11.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.202+0000 7fcffa7fc640 1 -- 172.21.15.88:0/1694327248 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcff407c740 con 0x7fcffc100860 2024-09-17T04:14:11.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.378+0000 7fd003923640 1 -- 172.21.15.88:0/1694327248 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7fcffc106880 con 0x7fcffc100860 2024-09-17T04:14:11.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.381+0000 7fcffa7fc640 1 -- 172.21.15.88:0/1694327248 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v26)=0 v26) ==== 111+0+0 (secure 0 0 0) 0x7fcff40803f0 con 0x7fcffc100860 2024-09-17T04:14:11.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.383+0000 7fd003923640 1 -- 172.21.15.88:0/1694327248 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fcfe406e230 msgr2=0x7fcfe40706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:11.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.383+0000 7fd003923640 1 --2- 172.21.15.88:0/1694327248 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fcfe406e230 0x7fcfe40706f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcffc1989e0 tx=0x7fcff0008040 comp rx=0 tx=0).stop 2024-09-17T04:14:11.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.383+0000 7fd003923640 1 -- 172.21.15.88:0/1694327248 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcffc100860 msgr2=0x7fcffc197530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:11.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.383+0000 7fd003923640 1 --2- 172.21.15.88:0/1694327248 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcffc100860 0x7fcffc197530 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fcff4006010 tx=0x7fcff40048f0 comp rx=0 tx=0).stop 2024-09-17T04:14:11.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.384+0000 7fd003923640 1 -- 172.21.15.88:0/1694327248 shutdown_connections 2024-09-17T04:14:11.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.384+0000 7fd003923640 1 --2- 172.21.15.88:0/1694327248 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fcfe406e230 0x7fcfe40706f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:11.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.384+0000 7fd003923640 1 --2- 172.21.15.88:0/1694327248 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcffc101a60 0x7fcffc197a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:11.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.384+0000 7fd003923640 1 --2- 172.21.15.88:0/1694327248 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcffc100860 0x7fcffc197530 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:11.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.384+0000 7fd003923640 1 -- 172.21.15.88:0/1694327248 >> 172.21.15.88:0/1694327248 conn(0x7fcffc0fc010 msgr2=0x7fcffc0fe140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:14:11.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.384+0000 7fd003923640 1 -- 172.21.15.88:0/1694327248 shutdown_connections 2024-09-17T04:14:11.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.384+0000 7fd003923640 1 -- 172.21.15.88:0/1694327248 wait complete. 2024-09-17T04:14:11.591 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'bf2b79a4-74aa-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi088') 2024-09-17T04:14:11.591 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'bf2b79a4-74aa-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi088') 2024-09-17T04:14:11.591 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'bf2b79a4-74aa-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi088') 2024-09-17T04:14:11.960 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:11 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/3346154252' entity='client.admin' 2024-09-17T04:14:11.960 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:11 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/1694327248' entity='client.admin' 2024-09-17T04:14:12.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:11 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/3346154252' entity='client.admin' 2024-09-17T04:14:12.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:11 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/1694327248' entity='client.admin' 2024-09-17T04:14:12.592 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:14:12.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:12.861+0000 7f22754f5640 1 -- 172.21.15.88:0/2027325490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22701023f0 msgr2=0x7f22701047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:12.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:12.861+0000 7f22754f5640 1 --2- 172.21.15.88:0/2027325490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22701023f0 0x7f22701047e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f22600098b0 tx=0x7f226002a4d0 comp rx=0 tx=0).stop 2024-09-17T04:14:12.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:12.861+0000 7f22754f5640 1 -- 172.21.15.88:0/2027325490 shutdown_connections 2024-09-17T04:14:12.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:12.861+0000 7f22754f5640 1 --2- 172.21.15.88:0/2027325490 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2270104d20 0x7f2270107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:12.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:12.861+0000 7f22754f5640 1 --2- 172.21.15.88:0/2027325490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22701023f0 0x7f22701047e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:12.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:12.861+0000 7f22754f5640 1 -- 172.21.15.88:0/2027325490 >> 172.21.15.88:0/2027325490 conn(0x7f22700fc010 msgr2=0x7f22700fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:14:12.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:12.861+0000 7f22754f5640 1 -- 172.21.15.88:0/2027325490 shutdown_connections 2024-09-17T04:14:12.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:12.861+0000 7f22754f5640 1 -- 172.21.15.88:0/2027325490 wait complete. 2024-09-17T04:14:12.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:12.861+0000 7f22754f5640 1 Processor -- start 2024-09-17T04:14:12.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:12.861+0000 7f22754f5640 1 -- start start 2024-09-17T04:14:12.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:12.862+0000 7f22754f5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22701023f0 0x7f2270101ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:14:12.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:12.862+0000 7f22754f5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2270104d20 0x7f22701003a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:14:12.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:12.862+0000 7f22754f5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f227010a7e0 con 0x7f22701023f0 2024-09-17T04:14:12.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:12.862+0000 7f22754f5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f227010a660 con 0x7f2270104d20 2024-09-17T04:14:12.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:12.862+0000 7f226effd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22701023f0 0x7f2270101ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:14:12.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:12.862+0000 7f226effd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22701023f0 0x7f2270101ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50508/0 (socket says 172.21.15.88:50508) 2024-09-17T04:14:12.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:12.862+0000 7f226effd640 1 -- 172.21.15.88:0/3241842156 learned_addr learned my addr 172.21.15.88:0/3241842156 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:14:12.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:12.862+0000 7f226e7fc640 1 --2- 172.21.15.88:0/3241842156 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2270104d20 0x7f22701003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:14:12.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:12.862+0000 7f226effd640 1 -- 172.21.15.88:0/3241842156 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2270104d20 msgr2=0x7f22701003a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:12.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:12.862+0000 7f226effd640 1 --2- 172.21.15.88:0/3241842156 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2270104d20 0x7f22701003a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:12.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:12.862+0000 7f226effd640 1 -- 172.21.15.88:0/3241842156 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22701008e0 con 0x7f22701023f0 2024-09-17T04:14:12.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:12.862+0000 7f226effd640 1 --2- 172.21.15.88:0/3241842156 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22701023f0 0x7f2270101ce0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f22600099d0 tx=0x7f22600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:14:12.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:12.862+0000 7f2267fff640 1 -- 172.21.15.88:0/3241842156 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f226003f070 con 0x7f22701023f0 2024-09-17T04:14:12.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:12.862+0000 7f2267fff640 1 -- 172.21.15.88:0/3241842156 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2260004a40 con 0x7f22701023f0 2024-09-17T04:14:12.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:12.862+0000 7f22754f5640 1 -- 172.21.15.88:0/3241842156 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2270100b70 con 0x7f22701023f0 2024-09-17T04:14:12.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:12.862+0000 7f2267fff640 1 -- 172.21.15.88:0/3241842156 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2260035030 con 0x7f22701023f0 2024-09-17T04:14:12.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:12.863+0000 7f22754f5640 1 -- 172.21.15.88:0/3241842156 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22701010a0 con 0x7f22701023f0 2024-09-17T04:14:12.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:12.863+0000 7f22754f5640 1 -- 172.21.15.88:0/3241842156 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22701027d0 con 0x7f22701023f0 2024-09-17T04:14:12.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:12.864+0000 7f2267fff640 1 -- 172.21.15.88:0/3241842156 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f2260042070 con 0x7f22701023f0 2024-09-17T04:14:12.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:12.865+0000 7f2267fff640 1 --2- 172.21.15.88:0/3241842156 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f225c06e230 0x7f225c0706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:14:12.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:12.865+0000 7f2267fff640 1 -- 172.21.15.88:0/3241842156 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f22600adbd0 con 0x7f22701023f0 2024-09-17T04:14:12.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:12.865+0000 7f226e7fc640 1 --2- 172.21.15.88:0/3241842156 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f225c06e230 0x7f225c0706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:14:12.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:12.865+0000 7f226e7fc640 1 --2- 172.21.15.88:0/3241842156 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f225c06e230 0x7f225c0706f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2270101a60 tx=0x7f225800b390 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:14:12.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:12.869+0000 7f2267fff640 1 -- 172.21.15.88:0/3241842156 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f22600802c0 con 0x7f22701023f0 2024-09-17T04:14:12.952 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:12 smithi088 ceph-mon[27811]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:12.953 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:12 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/2235960751' entity='client.admin' 2024-09-17T04:14:13.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.044+0000 7f22754f5640 1 -- 172.21.15.88:0/3241842156 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f227019f720 con 0x7f22701023f0 2024-09-17T04:14:13.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.047+0000 7f2267fff640 1 -- 172.21.15.88:0/3241842156 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v28)=0 v28) ==== 125+0+0 (secure 0 0 0) 0x7f2260084af0 con 0x7f22701023f0 2024-09-17T04:14:13.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.049+0000 7f22754f5640 1 -- 172.21.15.88:0/3241842156 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f225c06e230 msgr2=0x7f225c0706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:13.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.049+0000 7f22754f5640 1 --2- 172.21.15.88:0/3241842156 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f225c06e230 0x7f225c0706f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2270101a60 tx=0x7f225800b390 comp rx=0 tx=0).stop 2024-09-17T04:14:13.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.049+0000 7f22754f5640 1 -- 172.21.15.88:0/3241842156 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22701023f0 msgr2=0x7f2270101ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:13.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.049+0000 7f22754f5640 1 --2- 172.21.15.88:0/3241842156 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22701023f0 0x7f2270101ce0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f22600099d0 tx=0x7f22600046c0 comp rx=0 tx=0).stop 2024-09-17T04:14:13.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.049+0000 7f22754f5640 1 -- 172.21.15.88:0/3241842156 shutdown_connections 2024-09-17T04:14:13.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.049+0000 7f22754f5640 1 --2- 172.21.15.88:0/3241842156 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f225c06e230 0x7f225c0706f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:13.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.049+0000 7f22754f5640 1 --2- 172.21.15.88:0/3241842156 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2270104d20 0x7f22701003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:13.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.049+0000 7f22754f5640 1 --2- 172.21.15.88:0/3241842156 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22701023f0 0x7f2270101ce0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:13.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.049+0000 7f22754f5640 1 -- 172.21.15.88:0/3241842156 >> 172.21.15.88:0/3241842156 conn(0x7f22700fc010 msgr2=0x7f22700fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:14:13.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.050+0000 7f22754f5640 1 -- 172.21.15.88:0/3241842156 shutdown_connections 2024-09-17T04:14:13.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.050+0000 7f22754f5640 1 -- 172.21.15.88:0/3241842156 wait complete. 2024-09-17T04:14:13.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:12 smithi134 ceph-mon[35201]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:13.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:12 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/2235960751' entity='client.admin' 2024-09-17T04:14:13.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.741+0000 7ff926921640 1 -- 172.21.15.88:0/3378906090 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff920100860 msgr2=0x7ff920100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:13.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.741+0000 7ff926921640 1 --2- 172.21.15.88:0/3378906090 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff920100860 0x7ff920100c60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff910009880 tx=0x7ff91002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:14:13.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.741+0000 7ff926921640 1 -- 172.21.15.88:0/3378906090 shutdown_connections 2024-09-17T04:14:13.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.741+0000 7ff926921640 1 --2- 172.21.15.88:0/3378906090 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff920101a60 0x7ff920101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:13.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.741+0000 7ff926921640 1 --2- 172.21.15.88:0/3378906090 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff920100860 0x7ff920100c60 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:13.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.741+0000 7ff926921640 1 -- 172.21.15.88:0/3378906090 >> 172.21.15.88:0/3378906090 conn(0x7ff9200fc010 msgr2=0x7ff9200fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:14:13.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.741+0000 7ff926921640 1 -- 172.21.15.88:0/3378906090 shutdown_connections 2024-09-17T04:14:13.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.741+0000 7ff926921640 1 -- 172.21.15.88:0/3378906090 wait complete. 2024-09-17T04:14:13.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.742+0000 7ff926921640 1 Processor -- start 2024-09-17T04:14:13.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.742+0000 7ff926921640 1 -- start start 2024-09-17T04:14:13.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.742+0000 7ff926921640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff920100860 0x7ff920104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:14:13.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.742+0000 7ff926921640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff920101a60 0x7ff920102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:14:13.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.742+0000 7ff926921640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ff920109680 con 0x7ff920100860 2024-09-17T04:14:13.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.742+0000 7ff926921640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff920109500 con 0x7ff920101a60 2024-09-17T04:14:13.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.742+0000 7ff91ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff920100860 0x7ff920104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:14:13.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.742+0000 7ff91ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff920100860 0x7ff920104780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50530/0 (socket says 172.21.15.88:50530) 2024-09-17T04:14:13.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.742+0000 7ff91ffff640 1 -- 172.21.15.88:0/1527987845 learned_addr learned my addr 172.21.15.88:0/1527987845 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:14:13.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.743+0000 7ff91f7fe640 1 --2- 172.21.15.88:0/1527987845 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff920101a60 0x7ff920102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:14:13.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.743+0000 7ff91ffff640 1 -- 172.21.15.88:0/1527987845 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff920101a60 msgr2=0x7ff920102e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:13.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.743+0000 7ff91ffff640 1 --2- 172.21.15.88:0/1527987845 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff920101a60 0x7ff920102e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:13.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.743+0000 7ff91ffff640 1 -- 172.21.15.88:0/1527987845 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff920103380 con 0x7ff920100860 2024-09-17T04:14:13.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.743+0000 7ff91f7fe640 1 --2- 172.21.15.88:0/1527987845 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff920101a60 0x7ff920102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:14:13.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.743+0000 7ff91ffff640 1 --2- 172.21.15.88:0/1527987845 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff920100860 0x7ff920104780 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff910006010 tx=0x7ff9100048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:14:13.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.743+0000 7ff91d7fa640 1 -- 172.21.15.88:0/1527987845 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff91003f070 con 0x7ff920100860 2024-09-17T04:14:13.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.743+0000 7ff926921640 1 -- 172.21.15.88:0/1527987845 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff920103610 con 0x7ff920100860 2024-09-17T04:14:13.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.743+0000 7ff91d7fa640 1 -- 172.21.15.88:0/1527987845 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff9100044d0 con 0x7ff920100860 2024-09-17T04:14:13.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.743+0000 7ff91d7fa640 1 -- 172.21.15.88:0/1527987845 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff910035030 con 0x7ff920100860 2024-09-17T04:14:13.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.743+0000 7ff926921640 1 -- 172.21.15.88:0/1527987845 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff920103b40 con 0x7ff920100860 2024-09-17T04:14:13.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.744+0000 7ff926921640 1 -- 172.21.15.88:0/1527987845 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff920109e60 con 0x7ff920100860 2024-09-17T04:14:13.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.744+0000 7ff91d7fa640 1 -- 172.21.15.88:0/1527987845 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7ff910042070 con 0x7ff920100860 2024-09-17T04:14:13.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.745+0000 7ff91d7fa640 1 --2- 172.21.15.88:0/1527987845 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7ff90806e230 0x7ff9080706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:14:13.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.745+0000 7ff91d7fa640 1 -- 172.21.15.88:0/1527987845 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7ff9100add00 con 0x7ff920100860 2024-09-17T04:14:13.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.745+0000 7ff91f7fe640 1 --2- 172.21.15.88:0/1527987845 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7ff90806e230 0x7ff9080706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:14:13.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.745+0000 7ff91f7fe640 1 --2- 172.21.15.88:0/1527987845 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7ff90806e230 0x7ff9080706f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff920104500 tx=0x7ff914005d90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:14:13.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.749+0000 7ff91d7fa640 1 -- 172.21.15.88:0/1527987845 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff91007c740 con 0x7ff920100860 2024-09-17T04:14:13.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.919+0000 7ff926921640 1 -- 172.21.15.88:0/1527987845 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7ff92019f9a0 con 0x7ff920100860 2024-09-17T04:14:13.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.920+0000 7ff91d7fa640 1 -- 172.21.15.88:0/1527987845 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v28)=0 v28) ==== 106+0+0 (secure 0 0 0) 0x7ff9100803f0 con 0x7ff920100860 2024-09-17T04:14:13.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.922+0000 7ff926921640 1 -- 172.21.15.88:0/1527987845 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7ff90806e230 msgr2=0x7ff9080706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:13.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.922+0000 7ff926921640 1 --2- 172.21.15.88:0/1527987845 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7ff90806e230 0x7ff9080706f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff920104500 tx=0x7ff914005d90 comp rx=0 tx=0).stop 2024-09-17T04:14:13.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.922+0000 7ff926921640 1 -- 172.21.15.88:0/1527987845 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff920100860 msgr2=0x7ff920104780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:13.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.922+0000 7ff926921640 1 --2- 172.21.15.88:0/1527987845 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff920100860 0x7ff920104780 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff910006010 tx=0x7ff9100048f0 comp rx=0 tx=0).stop 2024-09-17T04:14:13.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.922+0000 7ff926921640 1 -- 172.21.15.88:0/1527987845 shutdown_connections 2024-09-17T04:14:13.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.922+0000 7ff926921640 1 --2- 172.21.15.88:0/1527987845 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7ff90806e230 0x7ff9080706f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:13.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.922+0000 7ff926921640 1 --2- 172.21.15.88:0/1527987845 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff920101a60 0x7ff920102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:13.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.922+0000 7ff926921640 1 --2- 172.21.15.88:0/1527987845 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff920100860 0x7ff920104780 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:13.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.922+0000 7ff926921640 1 -- 172.21.15.88:0/1527987845 >> 172.21.15.88:0/1527987845 conn(0x7ff9200fc010 msgr2=0x7ff920069ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:14:13.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.922+0000 7ff926921640 1 -- 172.21.15.88:0/1527987845 shutdown_connections 2024-09-17T04:14:13.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.922+0000 7ff926921640 1 -- 172.21.15.88:0/1527987845 wait complete. 2024-09-17T04:14:13.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.928+0000 7f4035d01640 1 -- 172.21.15.88:0/886323606 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4030101a60 msgr2=0x7f4030101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:13.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.928+0000 7f4035d01640 1 --2- 172.21.15.88:0/886323606 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4030101a60 0x7f4030101ee0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4024009880 tx=0x7f402402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:14:13.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.928+0000 7f4035d01640 1 -- 172.21.15.88:0/886323606 shutdown_connections 2024-09-17T04:14:13.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.928+0000 7f4035d01640 1 --2- 172.21.15.88:0/886323606 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4030101a60 0x7f4030101ee0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:13.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.928+0000 7f4035d01640 1 --2- 172.21.15.88:0/886323606 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4030100860 0x7f4030100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:13.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.928+0000 7f4035d01640 1 -- 172.21.15.88:0/886323606 >> 172.21.15.88:0/886323606 conn(0x7f40300fc010 msgr2=0x7f40300fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:14:13.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.928+0000 7f4035d01640 1 -- 172.21.15.88:0/886323606 shutdown_connections 2024-09-17T04:14:13.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.928+0000 7f4035d01640 1 -- 172.21.15.88:0/886323606 wait complete. 2024-09-17T04:14:13.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.928+0000 7f4035d01640 1 Processor -- start 2024-09-17T04:14:13.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.929+0000 7f4035d01640 1 -- start start 2024-09-17T04:14:13.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.929+0000 7f4035d01640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4030100860 0x7f4030197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:14:13.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.929+0000 7f4035d01640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4030101a60 0x7f4030197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:14:13.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.929+0000 7f4035d01640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f4030109680 con 0x7f4030101a60 2024-09-17T04:14:13.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.929+0000 7f4035d01640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4030109500 con 0x7f4030100860 2024-09-17T04:14:13.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.929+0000 7f402f7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4030100860 0x7f4030197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:14:13.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.929+0000 7f402effd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4030101a60 0x7f4030197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:14:13.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.929+0000 7f402f7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4030100860 0x7f4030197520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.88:40428/0 (socket says 172.21.15.88:40428) 2024-09-17T04:14:13.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.929+0000 7f402f7fe640 1 -- 172.21.15.88:0/649010736 learned_addr learned my addr 172.21.15.88:0/649010736 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:14:13.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.929+0000 7f402effd640 1 -- 172.21.15.88:0/649010736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4030100860 msgr2=0x7f4030197520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:13.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.929+0000 7f402effd640 1 --2- 172.21.15.88:0/649010736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4030100860 0x7f4030197520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:13.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.929+0000 7f402effd640 1 -- 172.21.15.88:0/649010736 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4030198050 con 0x7f4030101a60 2024-09-17T04:14:13.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.929+0000 7f402f7fe640 1 --2- 172.21.15.88:0/649010736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4030100860 0x7f4030197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:14:13.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.930+0000 7f402effd640 1 --2- 172.21.15.88:0/649010736 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4030101a60 0x7f4030197a60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4024006010 tx=0x7f40240048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:14:13.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.930+0000 7f402cff9640 1 -- 172.21.15.88:0/649010736 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f402403f070 con 0x7f4030101a60 2024-09-17T04:14:13.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.930+0000 7f402cff9640 1 -- 172.21.15.88:0/649010736 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f40240044d0 con 0x7f4030101a60 2024-09-17T04:14:13.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.930+0000 7f4035d01640 1 -- 172.21.15.88:0/649010736 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f403019ca60 con 0x7f4030101a60 2024-09-17T04:14:13.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.930+0000 7f402cff9640 1 -- 172.21.15.88:0/649010736 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4024035030 con 0x7f4030101a60 2024-09-17T04:14:13.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.930+0000 7f4035d01640 1 -- 172.21.15.88:0/649010736 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f403019cf60 con 0x7f4030101a60 2024-09-17T04:14:13.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.931+0000 7f4035d01640 1 -- 172.21.15.88:0/649010736 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4030100c60 con 0x7f4030101a60 2024-09-17T04:14:13.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.932+0000 7f402cff9640 1 -- 172.21.15.88:0/649010736 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f4024042070 con 0x7f4030101a60 2024-09-17T04:14:13.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.932+0000 7f402cff9640 1 --2- 172.21.15.88:0/649010736 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f401806e230 0x7f40180706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:14:13.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.932+0000 7f402cff9640 1 -- 172.21.15.88:0/649010736 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f40240adc00 con 0x7f4030101a60 2024-09-17T04:14:13.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.932+0000 7f402f7fe640 1 --2- 172.21.15.88:0/649010736 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f401806e230 0x7f40180706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:14:13.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.933+0000 7f402f7fe640 1 --2- 172.21.15.88:0/649010736 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f401806e230 0x7f40180706f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f402000f4d0 tx=0x7f402000a3b0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:14:13.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:13.937+0000 7f402cff9640 1 -- 172.21.15.88:0/649010736 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f40240b4080 con 0x7f4030101a60 2024-09-17T04:14:14.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:14.110+0000 7f4035d01640 1 -- 172.21.15.88:0/649010736 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7f403019d860 con 0x7f4030101a60 2024-09-17T04:14:14.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:14.113+0000 7f402cff9640 1 -- 172.21.15.88:0/649010736 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v29)=0 v29) ==== 119+0+0 (secure 0 0 0) 0x7f40240802f0 con 0x7f4030101a60 2024-09-17T04:14:14.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:14.116+0000 7f4035d01640 1 -- 172.21.15.88:0/649010736 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f401806e230 msgr2=0x7f40180706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:14.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:14.116+0000 7f4035d01640 1 --2- 172.21.15.88:0/649010736 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f401806e230 0x7f40180706f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f402000f4d0 tx=0x7f402000a3b0 comp rx=0 tx=0).stop 2024-09-17T04:14:14.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:14.116+0000 7f4035d01640 1 -- 172.21.15.88:0/649010736 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4030101a60 msgr2=0x7f4030197a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:14.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:14.116+0000 7f4035d01640 1 --2- 172.21.15.88:0/649010736 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4030101a60 0x7f4030197a60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4024006010 tx=0x7f40240048f0 comp rx=0 tx=0).stop 2024-09-17T04:14:14.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:14.116+0000 7f4035d01640 1 -- 172.21.15.88:0/649010736 shutdown_connections 2024-09-17T04:14:14.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:14.116+0000 7f4035d01640 1 --2- 172.21.15.88:0/649010736 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f401806e230 0x7f40180706f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:14.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:14.116+0000 7f4035d01640 1 --2- 172.21.15.88:0/649010736 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4030101a60 0x7f4030197a60 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:14.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:14.116+0000 7f4035d01640 1 --2- 172.21.15.88:0/649010736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4030100860 0x7f4030197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:14.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:14.116+0000 7f4035d01640 1 -- 172.21.15.88:0/649010736 >> 172.21.15.88:0/649010736 conn(0x7f40300fc010 msgr2=0x7f4030069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:14:14.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:14.116+0000 7f4035d01640 1 -- 172.21.15.88:0/649010736 shutdown_connections 2024-09-17T04:14:14.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:14.116+0000 7f4035d01640 1 -- 172.21.15.88:0/649010736 wait complete. 2024-09-17T04:14:14.348 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:14 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/3241842156' entity='client.admin' 2024-09-17T04:14:14.349 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:14 smithi088 ceph-mon[27811]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:14.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:14 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/3241842156' entity='client.admin' 2024-09-17T04:14:14.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:14 smithi134 ceph-mon[35201]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:15.296 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:15 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/649010736' entity='client.admin' 2024-09-17T04:14:15.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:15 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/649010736' entity='client.admin' 2024-09-17T04:14:16.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:16 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:16.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:16 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:16.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:16 smithi088 ceph-mon[27811]: Reconfiguring ceph-exporter.smithi088 (monmap changed)... 2024-09-17T04:14:16.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:16 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi088", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T04:14:16.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:16 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:14:16.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:16 smithi088 ceph-mon[27811]: Reconfiguring daemon ceph-exporter.smithi088 on smithi088 2024-09-17T04:14:16.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:16 smithi088 ceph-mon[27811]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:16.645 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:16 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:16.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:16 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:16.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:16 smithi134 ceph-mon[35201]: Reconfiguring ceph-exporter.smithi088 (monmap changed)... 2024-09-17T04:14:16.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:16 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi088", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T04:14:16.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:16 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:14:16.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:16 smithi134 ceph-mon[35201]: Reconfiguring daemon ceph-exporter.smithi088 on smithi088 2024-09-17T04:14:16.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:16 smithi134 ceph-mon[35201]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:17.033 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'bf2b79a4-74aa-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi088') 2024-09-17T04:14:17.033 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'bf2b79a4-74aa-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi088') 2024-09-17T04:14:17.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.960+0000 7f76fd9cb640 1 -- 172.21.15.88:0/447991251 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76f8101960 msgr2=0x7f76f8101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:17.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.960+0000 7f76fd9cb640 1 --2- 172.21.15.88:0/447991251 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76f8101960 0x7f76f8101d60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f76e8009880 tx=0x7f76e802a4a0 comp rx=0 tx=0).stop 2024-09-17T04:14:17.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.960+0000 7f76fd9cb640 1 -- 172.21.15.88:0/447991251 shutdown_connections 2024-09-17T04:14:17.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.960+0000 7f76fd9cb640 1 --2- 172.21.15.88:0/447991251 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76f8102b60 0x7f76f8102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:17.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.960+0000 7f76fd9cb640 1 --2- 172.21.15.88:0/447991251 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76f8101960 0x7f76f8101d60 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:17.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.960+0000 7f76fd9cb640 1 -- 172.21.15.88:0/447991251 >> 172.21.15.88:0/447991251 conn(0x7f76f80fd0f0 msgr2=0x7f76f80ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:14:17.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.960+0000 7f76fd9cb640 1 -- 172.21.15.88:0/447991251 shutdown_connections 2024-09-17T04:14:17.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.960+0000 7f76fd9cb640 1 -- 172.21.15.88:0/447991251 wait complete. 2024-09-17T04:14:17.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.960+0000 7f76fd9cb640 1 Processor -- start 2024-09-17T04:14:17.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.960+0000 7f76fd9cb640 1 -- start start 2024-09-17T04:14:17.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.961+0000 7f76fd9cb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76f8101960 0x7f76f8197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:14:17.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.961+0000 7f76fd9cb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76f8102b60 0x7f76f81979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:14:17.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.961+0000 7f76fd9cb640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f76f810a780 con 0x7f76f8101960 2024-09-17T04:14:17.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.961+0000 7f76fd9cb640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f76f810a600 con 0x7f76f8102b60 2024-09-17T04:14:17.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.961+0000 7f76f6ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76f8101960 0x7f76f8197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:14:17.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.961+0000 7f76f6ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76f8101960 0x7f76f8197490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38630/0 (socket says 172.21.15.88:38630) 2024-09-17T04:14:17.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.961+0000 7f76f6ffd640 1 -- 172.21.15.88:0/2235960751 learned_addr learned my addr 172.21.15.88:0/2235960751 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:14:17.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.961+0000 7f76f67fc640 1 --2- 172.21.15.88:0/2235960751 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76f8102b60 0x7f76f81979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:14:17.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.961+0000 7f76f6ffd640 1 -- 172.21.15.88:0/2235960751 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76f8102b60 msgr2=0x7f76f81979d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:17.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.961+0000 7f76f6ffd640 1 --2- 172.21.15.88:0/2235960751 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76f8102b60 0x7f76f81979d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:17.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.961+0000 7f76f6ffd640 1 -- 172.21.15.88:0/2235960751 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76f8198050 con 0x7f76f8101960 2024-09-17T04:14:17.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.961+0000 7f76f6ffd640 1 --2- 172.21.15.88:0/2235960751 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76f8101960 0x7f76f8197490 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f76e8006010 tx=0x7f76e80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:14:17.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.961+0000 7f76fc9c9640 1 -- 172.21.15.88:0/2235960751 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f76e803f070 con 0x7f76f8101960 2024-09-17T04:14:17.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.961+0000 7f76fc9c9640 1 -- 172.21.15.88:0/2235960751 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f76e8004a50 con 0x7f76f8101960 2024-09-17T04:14:17.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.961+0000 7f76fd9cb640 1 -- 172.21.15.88:0/2235960751 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76f819ca30 con 0x7f76f8101960 2024-09-17T04:14:17.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.961+0000 7f76fc9c9640 1 -- 172.21.15.88:0/2235960751 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f76e8035030 con 0x7f76f8101960 2024-09-17T04:14:17.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.961+0000 7f76fd9cb640 1 -- 172.21.15.88:0/2235960751 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76f819cfc0 con 0x7f76f8101960 2024-09-17T04:14:17.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.962+0000 7f76fd9cb640 1 -- 172.21.15.88:0/2235960751 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76f8101d60 con 0x7f76f8101960 2024-09-17T04:14:17.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.963+0000 7f76fc9c9640 1 -- 172.21.15.88:0/2235960751 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f76e8042070 con 0x7f76f8101960 2024-09-17T04:14:17.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.963+0000 7f76fc9c9640 1 --2- 172.21.15.88:0/2235960751 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f76e006e280 0x7f76e0070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:14:17.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.963+0000 7f76fc9c9640 1 -- 172.21.15.88:0/2235960751 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f76e80adb30 con 0x7f76f8101960 2024-09-17T04:14:17.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.963+0000 7f76f67fc640 1 --2- 172.21.15.88:0/2235960751 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f76e006e280 0x7f76e0070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:14:17.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.964+0000 7f76f67fc640 1 --2- 172.21.15.88:0/2235960751 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f76e006e280 0x7f76e0070740 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f76f8198940 tx=0x7f76ec00b390 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:14:17.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:11.968+0000 7f76fc9c9640 1 -- 172.21.15.88:0/2235960751 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f76e8080200 con 0x7f76f8101960 2024-09-17T04:14:17.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:12.146+0000 7f76fd9cb640 1 -- 172.21.15.88:0/2235960751 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f76f8191590 con 0x7f76f8101960 2024-09-17T04:14:17.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:12.150+0000 7f76fc9c9640 1 -- 172.21.15.88:0/2235960751 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v27)=0 v27) ==== 121+0+0 (secure 0 0 0) 0x7f76e8084a30 con 0x7f76f8101960 2024-09-17T04:14:17.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:12.152+0000 7f76fd9cb640 1 -- 172.21.15.88:0/2235960751 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f76e006e280 msgr2=0x7f76e0070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:17.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:12.152+0000 7f76fd9cb640 1 --2- 172.21.15.88:0/2235960751 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f76e006e280 0x7f76e0070740 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f76f8198940 tx=0x7f76ec00b390 comp rx=0 tx=0).stop 2024-09-17T04:14:17.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:12.152+0000 7f76fd9cb640 1 -- 172.21.15.88:0/2235960751 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76f8101960 msgr2=0x7f76f8197490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:17.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:12.152+0000 7f76fd9cb640 1 --2- 172.21.15.88:0/2235960751 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76f8101960 0x7f76f8197490 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f76e8006010 tx=0x7f76e80045e0 comp rx=0 tx=0).stop 2024-09-17T04:14:17.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:12.152+0000 7f76fd9cb640 1 -- 172.21.15.88:0/2235960751 shutdown_connections 2024-09-17T04:14:17.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:12.152+0000 7f76fd9cb640 1 --2- 172.21.15.88:0/2235960751 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f76e006e280 0x7f76e0070740 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:17.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:12.152+0000 7f76fd9cb640 1 --2- 172.21.15.88:0/2235960751 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76f8102b60 0x7f76f81979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:17.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:12.152+0000 7f76fd9cb640 1 --2- 172.21.15.88:0/2235960751 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76f8101960 0x7f76f8197490 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:17.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:12.152+0000 7f76fd9cb640 1 -- 172.21.15.88:0/2235960751 >> 172.21.15.88:0/2235960751 conn(0x7f76f80fd0f0 msgr2=0x7f76f8105fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:14:17.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:12.153+0000 7f76fd9cb640 1 -- 172.21.15.88:0/2235960751 shutdown_connections 2024-09-17T04:14:17.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:12.153+0000 7f76fd9cb640 1 -- 172.21.15.88:0/2235960751 wait complete. 2024-09-17T04:14:18.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:17.993+0000 7f7c13714640 1 -- 172.21.15.88:0/3723283997 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c0c101a60 msgr2=0x7f7c0c101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:18.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:17.993+0000 7f7c13714640 1 --2- 172.21.15.88:0/3723283997 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c0c101a60 0x7f7c0c101ee0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc009880 tx=0x7f7bfc02a4a0 comp rx=0 tx=0).stop 2024-09-17T04:14:18.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:17.994+0000 7f7c13714640 1 -- 172.21.15.88:0/3723283997 shutdown_connections 2024-09-17T04:14:18.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:17.994+0000 7f7c13714640 1 --2- 172.21.15.88:0/3723283997 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c0c101a60 0x7f7c0c101ee0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:18.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:17.994+0000 7f7c13714640 1 --2- 172.21.15.88:0/3723283997 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c0c100860 0x7f7c0c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:18.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:17.994+0000 7f7c13714640 1 -- 172.21.15.88:0/3723283997 >> 172.21.15.88:0/3723283997 conn(0x7f7c0c0fc010 msgr2=0x7f7c0c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:14:18.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:17.994+0000 7f7c13714640 1 -- 172.21.15.88:0/3723283997 shutdown_connections 2024-09-17T04:14:18.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:17.994+0000 7f7c13714640 1 -- 172.21.15.88:0/3723283997 wait complete. 2024-09-17T04:14:18.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:17.994+0000 7f7c13714640 1 Processor -- start 2024-09-17T04:14:18.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:17.994+0000 7f7c13714640 1 -- start start 2024-09-17T04:14:18.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:17.994+0000 7f7c13714640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c0c100860 0x7f7c0c104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:14:18.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:17.994+0000 7f7c13714640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c0c101a60 0x7f7c0c102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:14:18.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:17.994+0000 7f7c13714640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f7c0c109720 con 0x7f7c0c100860 2024-09-17T04:14:18.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:17.994+0000 7f7c13714640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7c0c1095a0 con 0x7f7c0c101a60 2024-09-17T04:14:18.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:17.994+0000 7f7c114b0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c0c100860 0x7f7c0c104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:14:18.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:17.994+0000 7f7c114b0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c0c100860 0x7f7c0c104780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50574/0 (socket says 172.21.15.88:50574) 2024-09-17T04:14:18.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:17.994+0000 7f7c114b0640 1 -- 172.21.15.88:0/187069391 learned_addr learned my addr 172.21.15.88:0/187069391 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:14:18.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:17.995+0000 7f7c114b0640 1 -- 172.21.15.88:0/187069391 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c0c101a60 msgr2=0x7f7c0c102e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:18.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:17.995+0000 7f7c114b0640 1 --2- 172.21.15.88:0/187069391 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c0c101a60 0x7f7c0c102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:18.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:17.995+0000 7f7c114b0640 1 -- 172.21.15.88:0/187069391 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c0c103380 con 0x7f7c0c100860 2024-09-17T04:14:18.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:17.995+0000 7f7c114b0640 1 --2- 172.21.15.88:0/187069391 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c0c100860 0x7f7c0c104780 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7c0800b3d0 tx=0x7f7c0800b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:14:18.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:17.995+0000 7f7c027fc640 1 -- 172.21.15.88:0/187069391 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7c08015020 con 0x7f7c0c100860 2024-09-17T04:14:18.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:17.995+0000 7f7c027fc640 1 -- 172.21.15.88:0/187069391 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7c08011af0 con 0x7f7c0c100860 2024-09-17T04:14:18.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:17.995+0000 7f7c13714640 1 -- 172.21.15.88:0/187069391 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c0c103670 con 0x7f7c0c100860 2024-09-17T04:14:18.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:17.995+0000 7f7c027fc640 1 -- 172.21.15.88:0/187069391 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7c08010da0 con 0x7f7c0c100860 2024-09-17T04:14:18.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:17.995+0000 7f7c13714640 1 -- 172.21.15.88:0/187069391 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c0c103c80 con 0x7f7c0c100860 2024-09-17T04:14:18.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:17.996+0000 7f7c13714640 1 -- 172.21.15.88:0/187069391 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c0c100c60 con 0x7f7c0c100860 2024-09-17T04:14:18.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:17.997+0000 7f7c027fc640 1 -- 172.21.15.88:0/187069391 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f7c08018020 con 0x7f7c0c100860 2024-09-17T04:14:18.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:17.997+0000 7f7c027fc640 1 --2- 172.21.15.88:0/187069391 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f7bf806e280 0x7f7bf8070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:14:18.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:17.997+0000 7f7c10caf640 1 --2- 172.21.15.88:0/187069391 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f7bf806e280 0x7f7bf8070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:14:18.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:17.997+0000 7f7c027fc640 1 -- 172.21.15.88:0/187069391 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f7c0808cb20 con 0x7f7c0c100860 2024-09-17T04:14:18.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:17.997+0000 7f7c10caf640 1 --2- 172.21.15.88:0/187069391 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f7bf806e280 0x7f7bf8070740 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc0096c0 tx=0x7f7bfc000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:14:18.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:18.001+0000 7f7c027fc640 1 -- 172.21.15.88:0/187069391 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7c0801f020 con 0x7f7c0c100860 2024-09-17T04:14:18.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:18.175+0000 7f7c13714640 1 -- 172.21.15.88:0/187069391 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f7c0c19fd80 con 0x7f7c0c100860 2024-09-17T04:14:18.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:18.178+0000 7f7c027fc640 1 -- 172.21.15.88:0/187069391 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v30)=0 v30) ==== 121+0+0 (secure 0 0 0) 0x7f7c0805b5e0 con 0x7f7c0c100860 2024-09-17T04:14:18.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:18.180+0000 7f7c13714640 1 -- 172.21.15.88:0/187069391 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f7bf806e280 msgr2=0x7f7bf8070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:18.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:18.180+0000 7f7c13714640 1 --2- 172.21.15.88:0/187069391 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f7bf806e280 0x7f7bf8070740 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc0096c0 tx=0x7f7bfc000bc0 comp rx=0 tx=0).stop 2024-09-17T04:14:18.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:18.180+0000 7f7c13714640 1 -- 172.21.15.88:0/187069391 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c0c100860 msgr2=0x7f7c0c104780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:18.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:18.180+0000 7f7c13714640 1 --2- 172.21.15.88:0/187069391 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c0c100860 0x7f7c0c104780 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7c0800b3d0 tx=0x7f7c0800b890 comp rx=0 tx=0).stop 2024-09-17T04:14:18.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:18.180+0000 7f7c13714640 1 -- 172.21.15.88:0/187069391 shutdown_connections 2024-09-17T04:14:18.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:18.180+0000 7f7c13714640 1 --2- 172.21.15.88:0/187069391 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f7bf806e280 0x7f7bf8070740 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:18.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:18.180+0000 7f7c13714640 1 --2- 172.21.15.88:0/187069391 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c0c101a60 0x7f7c0c102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:18.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:18.180+0000 7f7c13714640 1 --2- 172.21.15.88:0/187069391 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c0c100860 0x7f7c0c104780 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:18.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:18.180+0000 7f7c13714640 1 -- 172.21.15.88:0/187069391 >> 172.21.15.88:0/187069391 conn(0x7f7c0c0fc010 msgr2=0x7f7c0c06a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:14:18.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:18.180+0000 7f7c13714640 1 -- 172.21.15.88:0/187069391 shutdown_connections 2024-09-17T04:14:18.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:18.180+0000 7f7c13714640 1 -- 172.21.15.88:0/187069391 wait complete. 2024-09-17T04:14:18.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:18 smithi088 ceph-mon[27811]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:18.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:18 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/187069391' entity='client.admin' 2024-09-17T04:14:19.008 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'bf2b79a4-74aa-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi088') 2024-09-17T04:14:19.008 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'bf2b79a4-74aa-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi088') 2024-09-17T04:14:19.008 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'bf2b79a4-74aa-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi088') 2024-09-17T04:14:19.009 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'bf2b79a4-74aa-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi088') 2024-09-17T04:14:19.009 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'bf2b79a4-74aa-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='smithi088') 2024-09-17T04:14:19.009 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'bf2b79a4-74aa-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='smithi088') 2024-09-17T04:14:19.009 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'bf2b79a4-74aa-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='smithi088') 2024-09-17T04:14:19.009 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'bf2b79a4-74aa-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='smithi088') 2024-09-17T04:14:19.009 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'bf2b79a4-74aa-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi088') 2024-09-17T04:14:19.009 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'bf2b79a4-74aa-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi088') 2024-09-17T04:14:19.009 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'bf2b79a4-74aa-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi088') 2024-09-17T04:14:19.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:18 smithi134 ceph-mon[35201]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:19.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:18 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/187069391' entity='client.admin' 2024-09-17T04:14:19.421 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph config dump 2024-09-17T04:14:20.008 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:14:21.028 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:20 smithi088 ceph-mon[27811]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:21.028 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:20 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:21.028 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:20 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:21.028 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:20 smithi088 ceph-mon[27811]: Reconfiguring crash.smithi088 (monmap changed)... 2024-09-17T04:14:21.028 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:20 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi088", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T04:14:21.028 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:20 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:14:21.028 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:20 smithi088 ceph-mon[27811]: Reconfiguring daemon crash.smithi088 on smithi088 2024-09-17T04:14:21.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:21.108+0000 7fcc24184640 1 -- 172.21.15.88:0/3158633697 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc1c100860 msgr2=0x7fcc1c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:21.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:21.108+0000 7fcc24184640 1 --2- 172.21.15.88:0/3158633697 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc1c100860 0x7fcc1c100c60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fcc18009880 tx=0x7fcc1802a4a0 comp rx=0 tx=0).stop 2024-09-17T04:14:21.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:21.108+0000 7fcc24184640 1 -- 172.21.15.88:0/3158633697 shutdown_connections 2024-09-17T04:14:21.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:21.108+0000 7fcc24184640 1 --2- 172.21.15.88:0/3158633697 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc1c101a60 0x7fcc1c101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:21.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:21.108+0000 7fcc24184640 1 --2- 172.21.15.88:0/3158633697 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc1c100860 0x7fcc1c100c60 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:21.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:21.108+0000 7fcc24184640 1 -- 172.21.15.88:0/3158633697 >> 172.21.15.88:0/3158633697 conn(0x7fcc1c0fc010 msgr2=0x7fcc1c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:14:21.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:21.108+0000 7fcc24184640 1 -- 172.21.15.88:0/3158633697 shutdown_connections 2024-09-17T04:14:21.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:21.108+0000 7fcc24184640 1 -- 172.21.15.88:0/3158633697 wait complete. 2024-09-17T04:14:21.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:21.108+0000 7fcc24184640 1 Processor -- start 2024-09-17T04:14:21.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:21.108+0000 7fcc24184640 1 -- start start 2024-09-17T04:14:21.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:21.109+0000 7fcc24184640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc1c100860 0x7fcc1c197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:14:21.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:21.109+0000 7fcc24184640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc1c101a60 0x7fcc1c197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:14:21.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:21.109+0000 7fcc24184640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fcc1c1096a0 con 0x7fcc1c101a60 2024-09-17T04:14:21.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:21.109+0000 7fcc24184640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcc1c109520 con 0x7fcc1c100860 2024-09-17T04:14:21.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:21.109+0000 7fcc2171f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc1c101a60 0x7fcc1c197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:14:21.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:21.109+0000 7fcc2171f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc1c101a60 0x7fcc1c197a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50598/0 (socket says 172.21.15.88:50598) 2024-09-17T04:14:21.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:21.109+0000 7fcc2171f640 1 -- 172.21.15.88:0/2160616412 learned_addr learned my addr 172.21.15.88:0/2160616412 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:14:21.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:21.109+0000 7fcc21f20640 1 --2- 172.21.15.88:0/2160616412 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc1c100860 0x7fcc1c197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:14:21.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:21.109+0000 7fcc2171f640 1 -- 172.21.15.88:0/2160616412 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc1c100860 msgr2=0x7fcc1c197520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:21.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:21.109+0000 7fcc2171f640 1 --2- 172.21.15.88:0/2160616412 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc1c100860 0x7fcc1c197520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:21.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:21.109+0000 7fcc2171f640 1 -- 172.21.15.88:0/2160616412 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc1c1980e0 con 0x7fcc1c101a60 2024-09-17T04:14:21.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:21.109+0000 7fcc2171f640 1 --2- 172.21.15.88:0/2160616412 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc1c101a60 0x7fcc1c197a60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c00c8f0 tx=0x7fcc0c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:14:21.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:21.109+0000 7fcc12ffd640 1 -- 172.21.15.88:0/2160616412 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcc0c0079b0 con 0x7fcc1c101a60 2024-09-17T04:14:21.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:21.109+0000 7fcc12ffd640 1 -- 172.21.15.88:0/2160616412 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcc0c0054e0 con 0x7fcc1c101a60 2024-09-17T04:14:21.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:21.109+0000 7fcc24184640 1 -- 172.21.15.88:0/2160616412 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc1c19cb20 con 0x7fcc1c101a60 2024-09-17T04:14:21.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:21.109+0000 7fcc12ffd640 1 -- 172.21.15.88:0/2160616412 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcc0c004dd0 con 0x7fcc1c101a60 2024-09-17T04:14:21.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:21.109+0000 7fcc24184640 1 -- 172.21.15.88:0/2160616412 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc1c19d0b0 con 0x7fcc1c101a60 2024-09-17T04:14:21.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:21.110+0000 7fcc24184640 1 -- 172.21.15.88:0/2160616412 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc1c100c60 con 0x7fcc1c101a60 2024-09-17T04:14:21.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:21.111+0000 7fcc12ffd640 1 -- 172.21.15.88:0/2160616412 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7fcc0c005020 con 0x7fcc1c101a60 2024-09-17T04:14:21.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:21.111+0000 7fcc12ffd640 1 --2- 172.21.15.88:0/2160616412 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fcc0806e230 0x7fcc080706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:14:21.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:21.111+0000 7fcc21f20640 1 --2- 172.21.15.88:0/2160616412 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fcc0806e230 0x7fcc080706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:14:21.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:21.111+0000 7fcc12ffd640 1 -- 172.21.15.88:0/2160616412 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fcc0c08cf20 con 0x7fcc1c101a60 2024-09-17T04:14:21.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:21.112+0000 7fcc21f20640 1 --2- 172.21.15.88:0/2160616412 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fcc0806e230 0x7fcc080706f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcc18000c00 tx=0x7fcc18005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:14:21.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:21.116+0000 7fcc12ffd640 1 -- 172.21.15.88:0/2160616412 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcc0c014030 con 0x7fcc1c101a60 2024-09-17T04:14:21.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:20 smithi134 ceph-mon[35201]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:21.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:20 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:21.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:20 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:21.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:20 smithi134 ceph-mon[35201]: Reconfiguring crash.smithi088 (monmap changed)... 2024-09-17T04:14:21.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:20 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi088", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T04:14:21.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:20 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:14:21.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:20 smithi134 ceph-mon[35201]: Reconfiguring daemon crash.smithi088 on smithi088 2024-09-17T04:14:21.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:21.288+0000 7fcc24184640 1 -- 172.21.15.88:0/2160616412 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fcc1c19d3a0 con 0x7fcc1c101a60 2024-09-17T04:14:21.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:21.289+0000 7fcc12ffd640 1 -- 172.21.15.88:0/2160616412 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v30) ==== 59+0+18512 (secure 0 0 0) 0x7fcc0c05b9e0 con 0x7fcc1c101a60 2024-09-17T04:14:21.290 INFO:teuthology.orchestra.run.smithi088.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T04:14:21.290 INFO:teuthology.orchestra.run.smithi088.stdout:global dev auth_debug true 2024-09-17T04:14:21.290 INFO:teuthology.orchestra.run.smithi088.stdout:global basic container_image quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 * 2024-09-17T04:14:21.290 INFO:teuthology.orchestra.run.smithi088.stdout:global dev debug_asserts_on_shutdown true 2024-09-17T04:14:21.290 INFO:teuthology.orchestra.run.smithi088.stdout:global basic log_to_file true 2024-09-17T04:14:21.291 INFO:teuthology.orchestra.run.smithi088.stdout:global basic log_to_journald false 2024-09-17T04:14:21.291 INFO:teuthology.orchestra.run.smithi088.stdout:global basic log_to_stderr false 2024-09-17T04:14:21.291 INFO:teuthology.orchestra.run.smithi088.stdout:global advanced mon_allow_pool_delete true 2024-09-17T04:14:21.291 INFO:teuthology.orchestra.run.smithi088.stdout:global advanced mon_clock_drift_allowed 1.000000 2024-09-17T04:14:21.291 INFO:teuthology.orchestra.run.smithi088.stdout:global advanced mon_cluster_log_file_level debug 2024-09-17T04:14:21.291 INFO:teuthology.orchestra.run.smithi088.stdout:global advanced mon_cluster_log_to_file true 2024-09-17T04:14:21.291 INFO:teuthology.orchestra.run.smithi088.stdout:global advanced mon_max_pg_per_osd 10000 2024-09-17T04:14:21.291 INFO:teuthology.orchestra.run.smithi088.stdout:global advanced mon_pg_warn_max_object_skew 0.000000 2024-09-17T04:14:21.291 INFO:teuthology.orchestra.run.smithi088.stdout:global advanced mon_pg_warn_min_per_osd 0 2024-09-17T04:14:21.291 INFO:teuthology.orchestra.run.smithi088.stdout:global advanced mon_warn_on_crush_straw_calc_version_zero false 2024-09-17T04:14:21.291 INFO:teuthology.orchestra.run.smithi088.stdout:global advanced mon_warn_on_legacy_crush_tunables false 2024-09-17T04:14:21.291 INFO:teuthology.orchestra.run.smithi088.stdout:global advanced mon_warn_on_osd_down_out_interval_zero false 2024-09-17T04:14:21.292 INFO:teuthology.orchestra.run.smithi088.stdout:global dev mon_warn_on_pool_pg_num_not_power_of_two false 2024-09-17T04:14:21.292 INFO:teuthology.orchestra.run.smithi088.stdout:global advanced mon_warn_on_too_few_osds false 2024-09-17T04:14:21.292 INFO:teuthology.orchestra.run.smithi088.stdout:global dev ms_die_on_bug true 2024-09-17T04:14:21.292 INFO:teuthology.orchestra.run.smithi088.stdout:global dev ms_die_on_old_message true 2024-09-17T04:14:21.292 INFO:teuthology.orchestra.run.smithi088.stdout:global advanced osd_pool_default_erasure_code_profile plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T04:14:21.292 INFO:teuthology.orchestra.run.smithi088.stdout:global advanced osd_pool_default_pg_autoscale_mode off 2024-09-17T04:14:21.292 INFO:teuthology.orchestra.run.smithi088.stdout:mon advanced auth_allow_insecure_global_id_reclaim false 2024-09-17T04:14:21.292 INFO:teuthology.orchestra.run.smithi088.stdout:mon advanced auth_mon_ticket_ttl 660.000000 2024-09-17T04:14:21.292 INFO:teuthology.orchestra.run.smithi088.stdout:mon advanced auth_service_ticket_ttl 240.000000 2024-09-17T04:14:21.292 INFO:teuthology.orchestra.run.smithi088.stdout:mon advanced debug_mon 20/20 2024-09-17T04:14:21.292 INFO:teuthology.orchestra.run.smithi088.stdout:mon advanced debug_ms 1/1 2024-09-17T04:14:21.292 INFO:teuthology.orchestra.run.smithi088.stdout:mon advanced debug_paxos 20/20 2024-09-17T04:14:21.292 INFO:teuthology.orchestra.run.smithi088.stdout:mon advanced mon_data_avail_warn 5 2024-09-17T04:14:21.293 INFO:teuthology.orchestra.run.smithi088.stdout:mon advanced mon_down_mkfs_grace 300 2024-09-17T04:14:21.293 INFO:teuthology.orchestra.run.smithi088.stdout:mon advanced mon_mgr_mkfs_grace 240 2024-09-17T04:14:21.293 INFO:teuthology.orchestra.run.smithi088.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T04:14:21.293 INFO:teuthology.orchestra.run.smithi088.stdout:mon dev mon_osd_prime_pg_temp true 2024-09-17T04:14:21.293 INFO:teuthology.orchestra.run.smithi088.stdout:mon advanced mon_osd_reporter_subtree_level osd 2024-09-17T04:14:21.293 INFO:teuthology.orchestra.run.smithi088.stdout:mon advanced mon_reweight_min_bytes_per_osd 10 2024-09-17T04:14:21.293 INFO:teuthology.orchestra.run.smithi088.stdout:mon advanced mon_reweight_min_pgs_per_osd 4 2024-09-17T04:14:21.293 INFO:teuthology.orchestra.run.smithi088.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim false 2024-09-17T04:14:21.293 INFO:teuthology.orchestra.run.smithi088.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim_allowed false 2024-09-17T04:14:21.293 INFO:teuthology.orchestra.run.smithi088.stdout:mon advanced public_network 172.21.0.0/20 * 2024-09-17T04:14:21.293 INFO:teuthology.orchestra.run.smithi088.stdout:mgr advanced client_mount_timeout 30 2024-09-17T04:14:21.293 INFO:teuthology.orchestra.run.smithi088.stdout:mgr advanced debug_client 20/20 2024-09-17T04:14:21.293 INFO:teuthology.orchestra.run.smithi088.stdout:mgr advanced debug_mgr 20/20 2024-09-17T04:14:21.293 INFO:teuthology.orchestra.run.smithi088.stdout:mgr advanced debug_ms 1/1 2024-09-17T04:14:21.294 INFO:teuthology.orchestra.run.smithi088.stdout:mgr advanced mgr/cephadm/allow_ptrace true * 2024-09-17T04:14:21.294 INFO:teuthology.orchestra.run.smithi088.stdout:mgr advanced mgr/cephadm/container_init True * 2024-09-17T04:14:21.294 INFO:teuthology.orchestra.run.smithi088.stdout:mgr advanced mgr/cephadm/migration_current 7 * 2024-09-17T04:14:21.294 INFO:teuthology.orchestra.run.smithi088.stdout:mgr advanced mgr/dashboard/GRAFANA_API_SSL_VERIFY false * 2024-09-17T04:14:21.294 INFO:teuthology.orchestra.run.smithi088.stdout:mgr advanced mgr/dashboard/ssl_server_port 8443 * 2024-09-17T04:14:21.294 INFO:teuthology.orchestra.run.smithi088.stdout:mgr advanced mgr/orchestrator/orchestrator cephadm 2024-09-17T04:14:21.294 INFO:teuthology.orchestra.run.smithi088.stdout:mgr advanced mon_reweight_min_bytes_per_osd 10 2024-09-17T04:14:21.294 INFO:teuthology.orchestra.run.smithi088.stdout:mgr advanced mon_reweight_min_pgs_per_osd 4 2024-09-17T04:14:21.294 INFO:teuthology.orchestra.run.smithi088.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T04:14:21.294 INFO:teuthology.orchestra.run.smithi088.stdout:osd advanced bdev_async_discard true 2024-09-17T04:14:21.294 INFO:teuthology.orchestra.run.smithi088.stdout:osd dev bdev_debug_aio true 2024-09-17T04:14:21.294 INFO:teuthology.orchestra.run.smithi088.stdout:osd advanced bdev_enable_discard true 2024-09-17T04:14:21.294 INFO:teuthology.orchestra.run.smithi088.stdout:osd advanced bluestore_allocator bitmap * 2024-09-17T04:14:21.294 INFO:teuthology.orchestra.run.smithi088.stdout:osd dev bluestore_block_size 96636764160 * 2024-09-17T04:14:21.295 INFO:teuthology.orchestra.run.smithi088.stdout:osd dev bluestore_fsck_on_mount true 2024-09-17T04:14:21.295 INFO:teuthology.orchestra.run.smithi088.stdout:osd advanced debug_bluefs 1/20 2024-09-17T04:14:21.295 INFO:teuthology.orchestra.run.smithi088.stdout:osd advanced debug_bluestore 1/20 2024-09-17T04:14:21.295 INFO:teuthology.orchestra.run.smithi088.stdout:osd advanced debug_ms 1/1 2024-09-17T04:14:21.295 INFO:teuthology.orchestra.run.smithi088.stdout:osd advanced debug_osd 20/20 2024-09-17T04:14:21.295 INFO:teuthology.orchestra.run.smithi088.stdout:osd advanced debug_rocksdb 4/10 2024-09-17T04:14:21.295 INFO:teuthology.orchestra.run.smithi088.stdout:osd advanced osd_class_default_list * * 2024-09-17T04:14:21.295 INFO:teuthology.orchestra.run.smithi088.stdout:osd advanced osd_class_load_list * * 2024-09-17T04:14:21.295 INFO:teuthology.orchestra.run.smithi088.stdout:osd dev osd_debug_misdirected_ops true 2024-09-17T04:14:21.295 INFO:teuthology.orchestra.run.smithi088.stdout:osd dev osd_debug_op_order true 2024-09-17T04:14:21.295 INFO:teuthology.orchestra.run.smithi088.stdout:osd dev osd_debug_pg_log_writeout true 2024-09-17T04:14:21.295 INFO:teuthology.orchestra.run.smithi088.stdout:osd dev osd_debug_shutdown true 2024-09-17T04:14:21.295 INFO:teuthology.orchestra.run.smithi088.stdout:osd dev osd_debug_verify_cached_snaps true 2024-09-17T04:14:21.295 INFO:teuthology.orchestra.run.smithi088.stdout:osd dev osd_debug_verify_missing_on_start true 2024-09-17T04:14:21.296 INFO:teuthology.orchestra.run.smithi088.stdout:osd dev osd_debug_verify_stray_on_activate true 2024-09-17T04:14:21.296 INFO:teuthology.orchestra.run.smithi088.stdout:osd advanced osd_deep_scrub_update_digest_min_age 30 2024-09-17T04:14:21.296 INFO:teuthology.orchestra.run.smithi088.stdout:osd advanced osd_failsafe_full_ratio 0.950000 2024-09-17T04:14:21.296 INFO:teuthology.orchestra.run.smithi088.stdout:osd advanced osd_mclock_profile high_recovery_ops 2024-09-17T04:14:21.296 INFO:teuthology.orchestra.run.smithi088.stdout:osd advanced osd_memory_target_autotune true 2024-09-17T04:14:21.296 INFO:teuthology.orchestra.run.smithi088.stdout:osd advanced osd_objectstore bluestore * 2024-09-17T04:14:21.296 INFO:teuthology.orchestra.run.smithi088.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T04:14:21.296 INFO:teuthology.orchestra.run.smithi088.stdout:osd advanced osd_op_queue debug_random * 2024-09-17T04:14:21.296 INFO:teuthology.orchestra.run.smithi088.stdout:osd advanced osd_op_queue_cut_off debug_random * 2024-09-17T04:14:21.296 INFO:teuthology.orchestra.run.smithi088.stdout:osd advanced osd_recover_clone_overlap true 2024-09-17T04:14:21.296 INFO:teuthology.orchestra.run.smithi088.stdout:osd advanced osd_recovery_max_chunk 1048576 2024-09-17T04:14:21.296 INFO:teuthology.orchestra.run.smithi088.stdout:osd advanced osd_scrub_load_threshold 5.000000 2024-09-17T04:14:21.296 INFO:teuthology.orchestra.run.smithi088.stdout:osd advanced osd_scrub_max_interval 600.000000 2024-09-17T04:14:21.297 INFO:teuthology.orchestra.run.smithi088.stdout:osd advanced osd_shutdown_pgref_assert true 2024-09-17T04:14:21.297 INFO:teuthology.orchestra.run.smithi088.stdout:mds advanced debug_mds 20/20 2024-09-17T04:14:21.297 INFO:teuthology.orchestra.run.smithi088.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T04:14:21.297 INFO:teuthology.orchestra.run.smithi088.stdout:mds advanced debug_ms 2/2 2024-09-17T04:14:21.297 INFO:teuthology.orchestra.run.smithi088.stdout:mds dev mds_debug_frag true 2024-09-17T04:14:21.297 INFO:teuthology.orchestra.run.smithi088.stdout:mds dev mds_debug_scatterstat true 2024-09-17T04:14:21.297 INFO:teuthology.orchestra.run.smithi088.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T04:14:21.297 INFO:teuthology.orchestra.run.smithi088.stdout:mds dev mds_verify_scatter true 2024-09-17T04:14:21.297 INFO:teuthology.orchestra.run.smithi088.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T04:14:21.297 INFO:teuthology.orchestra.run.smithi088.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T04:14:21.297 INFO:teuthology.orchestra.run.smithi088.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T04:14:21.297 INFO:teuthology.orchestra.run.smithi088.stdout:client advanced client_mount_timeout 600 2024-09-17T04:14:21.297 INFO:teuthology.orchestra.run.smithi088.stdout:client advanced debug_client 20/20 2024-09-17T04:14:21.297 INFO:teuthology.orchestra.run.smithi088.stdout:client advanced debug_ms 1/1 2024-09-17T04:14:21.298 INFO:teuthology.orchestra.run.smithi088.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T04:14:21.298 INFO:teuthology.orchestra.run.smithi088.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T04:14:21.298 INFO:teuthology.orchestra.run.smithi088.stdout:client.rgw advanced rgw_cache_enabled true 2024-09-17T04:14:21.298 INFO:teuthology.orchestra.run.smithi088.stdout:client.rgw advanced rgw_enable_ops_log true 2024-09-17T04:14:21.298 INFO:teuthology.orchestra.run.smithi088.stdout:client.rgw advanced rgw_enable_usage_log true 2024-09-17T04:14:21.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:21.291+0000 7fcc24184640 1 -- 172.21.15.88:0/2160616412 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fcc0806e230 msgr2=0x7fcc080706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:21.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:21.291+0000 7fcc24184640 1 --2- 172.21.15.88:0/2160616412 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fcc0806e230 0x7fcc080706f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcc18000c00 tx=0x7fcc18005a20 comp rx=0 tx=0).stop 2024-09-17T04:14:21.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:21.291+0000 7fcc24184640 1 -- 172.21.15.88:0/2160616412 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc1c101a60 msgr2=0x7fcc1c197a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:21.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:21.291+0000 7fcc24184640 1 --2- 172.21.15.88:0/2160616412 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc1c101a60 0x7fcc1c197a60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c00c8f0 tx=0x7fcc0c00cdb0 comp rx=0 tx=0).stop 2024-09-17T04:14:21.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:21.291+0000 7fcc24184640 1 -- 172.21.15.88:0/2160616412 shutdown_connections 2024-09-17T04:14:21.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:21.291+0000 7fcc24184640 1 --2- 172.21.15.88:0/2160616412 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fcc0806e230 0x7fcc080706f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:21.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:21.291+0000 7fcc24184640 1 --2- 172.21.15.88:0/2160616412 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc1c101a60 0x7fcc1c197a60 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:21.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:21.291+0000 7fcc24184640 1 --2- 172.21.15.88:0/2160616412 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc1c100860 0x7fcc1c197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:21.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:21.291+0000 7fcc24184640 1 -- 172.21.15.88:0/2160616412 >> 172.21.15.88:0/2160616412 conn(0x7fcc1c0fc010 msgr2=0x7fcc1c069d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:14:21.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:21.291+0000 7fcc24184640 1 -- 172.21.15.88:0/2160616412 shutdown_connections 2024-09-17T04:14:21.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:21.291+0000 7fcc24184640 1 -- 172.21.15.88:0/2160616412 wait complete. 2024-09-17T04:14:22.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:21 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/2160616412' entity='client.admin' cmd=[{"prefix": "config dump"}]: dispatch 2024-09-17T04:14:22.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:21 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:22.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:21 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:22.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:21 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:14:22.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:21 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/2160616412' entity='client.admin' cmd=[{"prefix": "config dump"}]: dispatch 2024-09-17T04:14:22.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:21 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:22.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:21 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:22.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:21 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:14:22.272 INFO:tasks.cephadm:Deploying OSDs... 2024-09-17T04:14:22.272 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-17T04:14:22.272 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T04:14:22.289 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T04:14:22.289 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_1 2024-09-17T04:14:22.345 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T04:14:22.345 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T04:14:22.345 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-17T04:14:22.346 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T04:14:22.346 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T04:14:22.346 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2024-09-17 04:13:15.240249667 +0000 2024-09-17T04:14:22.346 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2024-09-17 04:07:34.825103643 +0000 2024-09-17T04:14:22.346 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2024-09-17 04:07:34.825103643 +0000 2024-09-17T04:14:22.346 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2024-09-17 04:07:34.825103643 +0000 2024-09-17T04:14:22.346 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T04:14:22.411 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2024-09-17T04:14:22.411 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2024-09-17T04:14:22.411 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000265874 s, 1.9 MB/s 2024-09-17T04:14:22.412 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T04:14:22.469 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_2 2024-09-17T04:14:22.525 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T04:14:22.525 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T04:14:22.525 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-17T04:14:22.525 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T04:14:22.525 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T04:14:22.525 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2024-09-17 04:13:15.240249667 +0000 2024-09-17T04:14:22.525 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2024-09-17 04:07:35.162096551 +0000 2024-09-17T04:14:22.525 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2024-09-17 04:07:35.162096551 +0000 2024-09-17T04:14:22.525 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2024-09-17 04:07:35.162096551 +0000 2024-09-17T04:14:22.526 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T04:14:22.589 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2024-09-17T04:14:22.589 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2024-09-17T04:14:22.589 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000209665 s, 2.4 MB/s 2024-09-17T04:14:22.590 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T04:14:22.646 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_3 2024-09-17T04:14:22.702 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T04:14:22.702 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T04:14:22.702 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-17T04:14:22.702 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T04:14:22.702 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T04:14:22.702 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2024-09-17 04:13:15.241249646 +0000 2024-09-17T04:14:22.702 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2024-09-17 04:07:35.500089438 +0000 2024-09-17T04:14:22.702 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2024-09-17 04:07:35.500089438 +0000 2024-09-17T04:14:22.703 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2024-09-17 04:07:35.500089438 +0000 2024-09-17T04:14:22.703 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T04:14:22.767 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2024-09-17T04:14:22.767 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2024-09-17T04:14:22.767 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000251864 s, 2.0 MB/s 2024-09-17T04:14:22.768 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T04:14:22.825 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_4 2024-09-17T04:14:22.881 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T04:14:22.881 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T04:14:22.881 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-17T04:14:22.881 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T04:14:22.881 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T04:14:22.881 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2024-09-17 04:13:15.241249646 +0000 2024-09-17T04:14:22.881 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2024-09-17 04:07:35.826082577 +0000 2024-09-17T04:14:22.881 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2024-09-17 04:07:35.826082577 +0000 2024-09-17T04:14:22.881 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2024-09-17 04:07:35.826082577 +0000 2024-09-17T04:14:22.882 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T04:14:22.945 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2024-09-17T04:14:22.945 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2024-09-17T04:14:22.945 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000210455 s, 2.4 MB/s 2024-09-17T04:14:22.946 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T04:14:23.003 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-17T04:14:23.003 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T04:14:23.024 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T04:14:23.025 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_1 2024-09-17T04:14:23.083 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T04:14:23.084 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T04:14:23.084 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-17T04:14:23.084 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T04:14:23.084 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T04:14:23.084 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-09-17 04:13:43.947119101 +0000 2024-09-17T04:14:23.084 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-17 04:07:37.762327945 +0000 2024-09-17T04:14:23.084 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-17 04:07:37.762327945 +0000 2024-09-17T04:14:23.084 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-09-17 04:07:37.762327945 +0000 2024-09-17T04:14:23.085 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T04:14:23.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:22 smithi088 ceph-mon[27811]: Reconfiguring alertmanager.smithi088 (dependencies changed)... 2024-09-17T04:14:23.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:22 smithi088 ceph-mon[27811]: Reconfiguring daemon alertmanager.smithi088 on smithi088 2024-09-17T04:14:23.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:22 smithi088 ceph-mon[27811]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:23.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:22 smithi134 ceph-mon[35201]: Reconfiguring alertmanager.smithi088 (dependencies changed)... 2024-09-17T04:14:23.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:22 smithi134 ceph-mon[35201]: Reconfiguring daemon alertmanager.smithi088 on smithi088 2024-09-17T04:14:23.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:22 smithi134 ceph-mon[35201]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:23.153 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-17T04:14:23.153 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-17T04:14:23.153 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000354172 s, 1.4 MB/s 2024-09-17T04:14:23.155 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T04:14:23.213 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_2 2024-09-17T04:14:23.271 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T04:14:23.271 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T04:14:23.271 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-17T04:14:23.271 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T04:14:23.271 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T04:14:23.271 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-09-17 04:13:43.947119101 +0000 2024-09-17T04:14:23.271 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-17 04:07:38.095319974 +0000 2024-09-17T04:14:23.271 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-17 04:07:38.095319974 +0000 2024-09-17T04:14:23.271 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-09-17 04:07:38.095319974 +0000 2024-09-17T04:14:23.272 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T04:14:23.338 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-17T04:14:23.338 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-17T04:14:23.338 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000224255 s, 2.3 MB/s 2024-09-17T04:14:23.339 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T04:14:23.408 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_3 2024-09-17T04:14:23.478 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T04:14:23.478 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T04:14:23.478 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-17T04:14:23.478 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T04:14:23.478 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T04:14:23.478 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-09-17 04:13:43.948119078 +0000 2024-09-17T04:14:23.479 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-17 04:07:38.420312196 +0000 2024-09-17T04:14:23.479 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-17 04:07:38.420312196 +0000 2024-09-17T04:14:23.479 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-09-17 04:07:38.420312196 +0000 2024-09-17T04:14:23.479 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T04:14:23.555 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-17T04:14:23.555 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-17T04:14:23.555 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000205113 s, 2.5 MB/s 2024-09-17T04:14:23.556 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T04:14:23.618 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_4 2024-09-17T04:14:23.677 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T04:14:23.677 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T04:14:23.678 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-17T04:14:23.678 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T04:14:23.678 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T04:14:23.678 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-09-17 04:13:43.948119078 +0000 2024-09-17T04:14:23.678 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-17 04:07:38.749304321 +0000 2024-09-17T04:14:23.678 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-17 04:07:38.749304321 +0000 2024-09-17T04:14:23.678 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-09-17 04:07:38.749304321 +0000 2024-09-17T04:14:23.678 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T04:14:23.745 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-17T04:14:23.745 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-17T04:14:23.745 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000234408 s, 2.2 MB/s 2024-09-17T04:14:23.747 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T04:14:23.805 INFO:tasks.cephadm:Deploying osd.0 on smithi088 with /dev/vg_nvme/lv_4... 2024-09-17T04:14:23.805 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-17T04:14:24.589 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:14:24.967 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:24 smithi088 ceph-mon[27811]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:25.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:24 smithi134 ceph-mon[35201]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:27.061 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:26 smithi088 ceph-mon[27811]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:27.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:26 smithi134 ceph-mon[35201]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:29.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:28 smithi088 ceph-mon[27811]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:29.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:28 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:29.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:28 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:29.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:28 smithi134 ceph-mon[35201]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:29.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:28 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:29.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:28 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:29.645 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:14:29.670 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi088:vg_nvme/lv_4 2024-09-17T04:14:30.173 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:29 smithi088 ceph-mon[27811]: Reconfiguring grafana.smithi088 (dependencies changed)... 2024-09-17T04:14:30.174 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:29 smithi088 ceph-mon[27811]: Reconfiguring daemon grafana.smithi088 on smithi088 2024-09-17T04:14:30.389 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:14:30.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:29 smithi134 ceph-mon[35201]: Reconfiguring grafana.smithi088 (dependencies changed)... 2024-09-17T04:14:30.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:29 smithi134 ceph-mon[35201]: Reconfiguring daemon grafana.smithi088 on smithi088 2024-09-17T04:14:31.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:30 smithi088 ceph-mon[27811]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:31.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:30 smithi134 ceph-mon[35201]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:31.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:31.874+0000 7f10217fc640 1 -- 172.21.15.88:0/30716731 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f101c1023f0 msgr2=0x7f101c1047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:31.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:31.874+0000 7f10217fc640 1 --2- 172.21.15.88:0/30716731 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f101c1023f0 0x7f101c1047e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f100c0098b0 tx=0x7f100c02a4d0 comp rx=0 tx=0).stop 2024-09-17T04:14:31.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:31.874+0000 7f10217fc640 1 -- 172.21.15.88:0/30716731 shutdown_connections 2024-09-17T04:14:31.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:31.874+0000 7f10217fc640 1 --2- 172.21.15.88:0/30716731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f101c104d20 0x7f101c107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:31.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:31.874+0000 7f10217fc640 1 --2- 172.21.15.88:0/30716731 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f101c1023f0 0x7f101c1047e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:31.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:31.874+0000 7f10217fc640 1 -- 172.21.15.88:0/30716731 >> 172.21.15.88:0/30716731 conn(0x7f101c0fc010 msgr2=0x7f101c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:14:31.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:31.874+0000 7f10217fc640 1 -- 172.21.15.88:0/30716731 shutdown_connections 2024-09-17T04:14:31.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:31.874+0000 7f10217fc640 1 -- 172.21.15.88:0/30716731 wait complete. 2024-09-17T04:14:31.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:31.874+0000 7f10217fc640 1 Processor -- start 2024-09-17T04:14:31.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:31.874+0000 7f10217fc640 1 -- start start 2024-09-17T04:14:31.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:31.875+0000 7f10217fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f101c1023f0 0x7f101c197550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:14:31.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:31.875+0000 7f10217fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f101c104d20 0x7f101c197a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:14:31.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:31.875+0000 7f10217fc640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f101c10a830 con 0x7f101c104d20 2024-09-17T04:14:31.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:31.875+0000 7f10217fc640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f101c10a6b0 con 0x7f101c1023f0 2024-09-17T04:14:31.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:31.875+0000 7f10127fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f101c104d20 0x7f101c197a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:14:31.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:31.875+0000 7f10127fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f101c104d20 0x7f101c197a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52666/0 (socket says 172.21.15.88:52666) 2024-09-17T04:14:31.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:31.875+0000 7f10127fc640 1 -- 172.21.15.88:0/1387288517 learned_addr learned my addr 172.21.15.88:0/1387288517 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:14:31.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:31.875+0000 7f101affd640 1 --2- 172.21.15.88:0/1387288517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f101c1023f0 0x7f101c197550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:14:31.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:31.875+0000 7f10127fc640 1 -- 172.21.15.88:0/1387288517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f101c1023f0 msgr2=0x7f101c197550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:14:31.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:31.875+0000 7f10127fc640 1 --2- 172.21.15.88:0/1387288517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f101c1023f0 0x7f101c197550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:14:31.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:31.875+0000 7f10127fc640 1 -- 172.21.15.88:0/1387288517 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f101c198110 con 0x7f101c104d20 2024-09-17T04:14:31.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:31.875+0000 7f10127fc640 1 --2- 172.21.15.88:0/1387288517 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f101c104d20 0x7f101c197a90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f100400b3d0 tx=0x7f100400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:14:31.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:31.875+0000 7f1018ff9640 1 -- 172.21.15.88:0/1387288517 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1004015020 con 0x7f101c104d20 2024-09-17T04:14:31.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:31.875+0000 7f1018ff9640 1 -- 172.21.15.88:0/1387288517 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1004011af0 con 0x7f101c104d20 2024-09-17T04:14:31.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:31.875+0000 7f10217fc640 1 -- 172.21.15.88:0/1387288517 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f101c19cb50 con 0x7f101c104d20 2024-09-17T04:14:31.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:31.875+0000 7f1018ff9640 1 -- 172.21.15.88:0/1387288517 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1004010d30 con 0x7f101c104d20 2024-09-17T04:14:31.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:31.875+0000 7f10217fc640 1 -- 172.21.15.88:0/1387288517 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f101c19d160 con 0x7f101c104d20 2024-09-17T04:14:31.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:31.876+0000 7f10217fc640 1 -- 172.21.15.88:0/1387288517 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f101c1027d0 con 0x7f101c104d20 2024-09-17T04:14:31.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:31.877+0000 7f1018ff9640 1 -- 172.21.15.88:0/1387288517 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f1004018020 con 0x7f101c104d20 2024-09-17T04:14:31.879 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:31.877+0000 7f1018ff9640 1 --2- 172.21.15.88:0/1387288517 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f100806e280 0x7f1008070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:14:31.879 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:31.877+0000 7f1018ff9640 1 -- 172.21.15.88:0/1387288517 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f100408ca40 con 0x7f101c104d20 2024-09-17T04:14:31.879 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:31.877+0000 7f101affd640 1 --2- 172.21.15.88:0/1387288517 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f100806e280 0x7f1008070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:14:31.879 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:31.878+0000 7f101affd640 1 --2- 172.21.15.88:0/1387288517 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f100806e280 0x7f1008070740 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f100c000c00 tx=0x7f100c005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:14:31.881 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:31.882+0000 7f1018ff9640 1 -- 172.21.15.88:0/1387288517 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f100401f020 con 0x7f101c104d20 2024-09-17T04:14:32.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:14:32.064+0000 7f10217fc640 1 -- 172.21.15.88:0/1387288517 --> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f101c19d3f0 con 0x7f100806e280 2024-09-17T04:14:33.136 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:32 smithi088 ceph-mon[27811]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:33.136 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:32 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T04:14:33.136 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:32 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T04:14:33.136 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:32 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:14:33.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:32 smithi134 ceph-mon[35201]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:33.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:32 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T04:14:33.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:32 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T04:14:33.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:32 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:14:34.002 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:33 smithi088 ceph-mon[27811]: from='client.14348 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:14:34.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:33 smithi134 ceph-mon[35201]: from='client.14348 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:14:35.183 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:34 smithi088 ceph-mon[27811]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:35.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:34 smithi134 ceph-mon[35201]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:36.633 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:36 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:36.633 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:36 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:36.633 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:36 smithi088 ceph-mon[27811]: Reconfiguring prometheus.smithi088 (dependencies changed)... 2024-09-17T04:14:36.633 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:36 smithi088 ceph-mon[27811]: Reconfiguring daemon prometheus.smithi088 on smithi088 2024-09-17T04:14:36.633 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:36 smithi088 ceph-mon[27811]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:36.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:36 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:36.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:36 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:36.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:36 smithi134 ceph-mon[35201]: Reconfiguring prometheus.smithi088 (dependencies changed)... 2024-09-17T04:14:36.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:36 smithi134 ceph-mon[35201]: Reconfiguring daemon prometheus.smithi088 on smithi088 2024-09-17T04:14:36.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:36 smithi134 ceph-mon[35201]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:37.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:37 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/1788755290' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a576201e-1335-4edf-8e9a-3e62264f3bef"}]: dispatch 2024-09-17T04:14:37.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:37 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/1788755290' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a576201e-1335-4edf-8e9a-3e62264f3bef"}]': finished 2024-09-17T04:14:37.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:37 smithi088 ceph-mon[27811]: osdmap e6: 1 total, 0 up, 1 in 2024-09-17T04:14:37.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:37 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T04:14:37.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:37 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:14:37.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:37 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/2573887998' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T04:14:37.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:37 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/1788755290' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a576201e-1335-4edf-8e9a-3e62264f3bef"}]: dispatch 2024-09-17T04:14:37.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:37 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/1788755290' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a576201e-1335-4edf-8e9a-3e62264f3bef"}]': finished 2024-09-17T04:14:37.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:37 smithi134 ceph-mon[35201]: osdmap e6: 1 total, 0 up, 1 in 2024-09-17T04:14:37.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:37 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T04:14:37.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:37 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:14:37.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:37 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/2573887998' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T04:14:38.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:38 smithi088 ceph-mon[27811]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:38.645 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:38 smithi134 ceph-mon[35201]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:41.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:40 smithi088 ceph-mon[27811]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:41.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:40 smithi134 ceph-mon[35201]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:42.993 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:42 smithi088 ceph-mon[27811]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:43.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:42 smithi134 ceph-mon[35201]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:45.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:44 smithi088 ceph-mon[27811]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:45.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:44 smithi134 ceph-mon[35201]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:46.947 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:46 smithi088 ceph-mon[27811]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:47.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:46 smithi134 ceph-mon[35201]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:49.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:48 smithi088 ceph-mon[27811]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:49.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:48 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:49.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:48 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:49.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:48 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi134", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T04:14:49.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:48 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:14:49.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:48 smithi134 ceph-mon[35201]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:49.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:48 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:49.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:48 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:49.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:48 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi134", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T04:14:49.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:48 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:14:50.051 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:49 smithi088 ceph-mon[27811]: Reconfiguring ceph-exporter.smithi134 (monmap changed)... 2024-09-17T04:14:50.052 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:49 smithi088 ceph-mon[27811]: Reconfiguring daemon ceph-exporter.smithi134 on smithi134 2024-09-17T04:14:50.052 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:49 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-17T04:14:50.052 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:49 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:14:50.052 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:49 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:50.052 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:49 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:50.052 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:49 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi134", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T04:14:50.052 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:49 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:14:50.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:49 smithi134 ceph-mon[35201]: Reconfiguring ceph-exporter.smithi134 (monmap changed)... 2024-09-17T04:14:50.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:49 smithi134 ceph-mon[35201]: Reconfiguring daemon ceph-exporter.smithi134 on smithi134 2024-09-17T04:14:50.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:49 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-17T04:14:50.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:49 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:14:50.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:49 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:50.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:49 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:50.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:49 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi134", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T04:14:50.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:49 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:14:51.007 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:50 smithi088 ceph-mon[27811]: Deploying daemon osd.0 on smithi088 2024-09-17T04:14:51.007 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:50 smithi088 ceph-mon[27811]: Reconfiguring crash.smithi134 (monmap changed)... 2024-09-17T04:14:51.007 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:50 smithi088 ceph-mon[27811]: Reconfiguring daemon crash.smithi134 on smithi134 2024-09-17T04:14:51.007 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:50 smithi088 ceph-mon[27811]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:51.007 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:50 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:51.007 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:50 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:51.008 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:50 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.vwdxcb", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T04:14:51.008 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:50 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T04:14:51.008 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:50 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:14:51.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:50 smithi134 ceph-mon[35201]: Deploying daemon osd.0 on smithi088 2024-09-17T04:14:51.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:50 smithi134 ceph-mon[35201]: Reconfiguring crash.smithi134 (monmap changed)... 2024-09-17T04:14:51.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:50 smithi134 ceph-mon[35201]: Reconfiguring daemon crash.smithi134 on smithi134 2024-09-17T04:14:51.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:50 smithi134 ceph-mon[35201]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:51.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:50 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:51.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:50 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:51.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:50 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.vwdxcb", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T04:14:51.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:50 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T04:14:51.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:50 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:14:52.110 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:51 smithi088 ceph-mon[27811]: Reconfiguring mgr.smithi134.vwdxcb (monmap changed)... 2024-09-17T04:14:52.110 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:51 smithi088 ceph-mon[27811]: Reconfiguring daemon mgr.smithi134.vwdxcb on smithi134 2024-09-17T04:14:52.110 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:51 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:14:52.121 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:51 smithi134 ceph-mon[35201]: Reconfiguring mgr.smithi134.vwdxcb (monmap changed)... 2024-09-17T04:14:52.121 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:51 smithi134 ceph-mon[35201]: Reconfiguring daemon mgr.smithi134.vwdxcb on smithi134 2024-09-17T04:14:52.121 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:51 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:14:53.100 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:52 smithi088 ceph-mon[27811]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:53.100 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:52 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:53.100 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:52 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:53.100 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:52 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T04:14:53.100 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:52 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T04:14:53.100 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:52 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:14:53.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:52 smithi134 ceph-mon[35201]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:53.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:52 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:53.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:52 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:53.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:52 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T04:14:53.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:52 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T04:14:53.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:52 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:14:54.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:53 smithi088 ceph-mon[27811]: Reconfiguring mon.smithi134 (monmap changed)... 2024-09-17T04:14:54.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:53 smithi088 ceph-mon[27811]: Reconfiguring daemon mon.smithi134 on smithi134 2024-09-17T04:14:54.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:53 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:54.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:53 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:54.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:53 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T04:14:54.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:53 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi088.front.sepia.ceph.com:9093"}]: dispatch 2024-09-17T04:14:54.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:53 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:54.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:53 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T04:14:54.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:53 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi088.front.sepia.ceph.com:3000"}]: dispatch 2024-09-17T04:14:54.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:53 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:54.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:53 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T04:14:54.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:53 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi088.front.sepia.ceph.com:9095"}]: dispatch 2024-09-17T04:14:54.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:53 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:54.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:53 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:14:54.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:53 smithi134 ceph-mon[35201]: Reconfiguring mon.smithi134 (monmap changed)... 2024-09-17T04:14:54.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:53 smithi134 ceph-mon[35201]: Reconfiguring daemon mon.smithi134 on smithi134 2024-09-17T04:14:54.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:53 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:54.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:53 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:54.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:53 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T04:14:54.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:53 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi088.front.sepia.ceph.com:9093"}]: dispatch 2024-09-17T04:14:54.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:53 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:54.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:53 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T04:14:54.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:53 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi088.front.sepia.ceph.com:3000"}]: dispatch 2024-09-17T04:14:54.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:53 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:54.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:53 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T04:14:54.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:53 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi088.front.sepia.ceph.com:9095"}]: dispatch 2024-09-17T04:14:54.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:53 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:54.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:53 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:14:54.974 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:54 smithi088 ceph-mon[27811]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T04:14:54.974 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:54 smithi088 ceph-mon[27811]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi088.front.sepia.ceph.com:9093"}]: dispatch 2024-09-17T04:14:54.974 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:54 smithi088 ceph-mon[27811]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T04:14:54.974 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:54 smithi088 ceph-mon[27811]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi088.front.sepia.ceph.com:3000"}]: dispatch 2024-09-17T04:14:54.974 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:54 smithi088 ceph-mon[27811]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T04:14:54.974 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:54 smithi088 ceph-mon[27811]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi088.front.sepia.ceph.com:9095"}]: dispatch 2024-09-17T04:14:54.974 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:54 smithi088 ceph-mon[27811]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:55.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:54 smithi134 ceph-mon[35201]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T04:14:55.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:54 smithi134 ceph-mon[35201]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi088.front.sepia.ceph.com:9093"}]: dispatch 2024-09-17T04:14:55.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:54 smithi134 ceph-mon[35201]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T04:14:55.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:54 smithi134 ceph-mon[35201]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi088.front.sepia.ceph.com:3000"}]: dispatch 2024-09-17T04:14:55.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:54 smithi134 ceph-mon[35201]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T04:14:55.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:54 smithi134 ceph-mon[35201]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi088.front.sepia.ceph.com:9095"}]: dispatch 2024-09-17T04:14:55.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:54 smithi134 ceph-mon[35201]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:56.800 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:56 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:56.800 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:56 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:56.800 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:56 smithi088 ceph-mon[27811]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:56.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:56 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:56.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:56 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:56.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:56 smithi134 ceph-mon[35201]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:57.705 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:57 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:57.705 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:57 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:57.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:57 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:57.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:57 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:14:58.850 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:14:58 smithi088 ceph-mon[27811]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:14:58.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:14:58 smithi134 ceph-mon[35201]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:15:01.052 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:00 smithi134 ceph-mon[35201]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:15:01.052 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:00 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:01.052 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:00 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:01.052 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:00 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:15:01.052 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:00 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:15:01.052 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:00 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:01.052 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:00 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:15:01.070 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:00 smithi088 ceph-mon[27811]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:15:01.070 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:00 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:01.070 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:00 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:01.070 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:00 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:15:01.070 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:00 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:15:01.070 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:00 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:01.070 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:00 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:15:02.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:02.162+0000 7f1018ff9640 1 -- 172.21.15.88:0/1387288517 <== mgr.14217 v2:172.21.15.88:6800/1666801150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f101c19d3f0 con 0x7f100806e280 2024-09-17T04:15:02.162 INFO:teuthology.orchestra.run.smithi088.stdout:Created osd(s) 0 on host 'smithi088' 2024-09-17T04:15:02.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:02.165+0000 7f10217fc640 1 -- 172.21.15.88:0/1387288517 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f100806e280 msgr2=0x7f1008070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:15:02.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:02.165+0000 7f10217fc640 1 --2- 172.21.15.88:0/1387288517 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f100806e280 0x7f1008070740 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f100c000c00 tx=0x7f100c005a20 comp rx=0 tx=0).stop 2024-09-17T04:15:02.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:02.165+0000 7f10217fc640 1 -- 172.21.15.88:0/1387288517 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f101c104d20 msgr2=0x7f101c197a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:15:02.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:02.165+0000 7f10217fc640 1 --2- 172.21.15.88:0/1387288517 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f101c104d20 0x7f101c197a90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f100400b3d0 tx=0x7f100400b890 comp rx=0 tx=0).stop 2024-09-17T04:15:02.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:02.165+0000 7f10217fc640 1 -- 172.21.15.88:0/1387288517 shutdown_connections 2024-09-17T04:15:02.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:02.165+0000 7f10217fc640 1 --2- 172.21.15.88:0/1387288517 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f100806e280 0x7f1008070740 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:15:02.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:02.165+0000 7f10217fc640 1 --2- 172.21.15.88:0/1387288517 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f101c104d20 0x7f101c197a90 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:15:02.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:02.165+0000 7f10217fc640 1 --2- 172.21.15.88:0/1387288517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f101c1023f0 0x7f101c197550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:15:02.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:02.165+0000 7f10217fc640 1 -- 172.21.15.88:0/1387288517 >> 172.21.15.88:0/1387288517 conn(0x7f101c0fc010 msgr2=0x7f101c0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:15:02.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:02.165+0000 7f10217fc640 1 -- 172.21.15.88:0/1387288517 shutdown_connections 2024-09-17T04:15:02.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:02.165+0000 7f10217fc640 1 -- 172.21.15.88:0/1387288517 wait complete. 2024-09-17T04:15:02.819 DEBUG:teuthology.orchestra.run.smithi088:osd.0> sudo journalctl -f -n 0 -u ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968@osd.0.service 2024-09-17T04:15:02.822 INFO:tasks.cephadm:Deploying osd.1 on smithi088 with /dev/vg_nvme/lv_3... 2024-09-17T04:15:02.822 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-17T04:15:03.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:02 smithi134 ceph-mon[35201]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:15:03.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:02 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:03.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:02 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:03.048 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:02 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:03.048 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:02 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:03.048 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:02 smithi134 ceph-mon[35201]: from='osd.0 [v2:172.21.15.88:6802/2896435780,v1:172.21.15.88:6803/2896435780]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-17T04:15:03.104 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:02 smithi088 ceph-mon[27811]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:15:03.104 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:02 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:03.104 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:02 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:03.104 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:02 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:03.104 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:02 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:03.104 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:02 smithi088 ceph-mon[27811]: from='osd.0 [v2:172.21.15.88:6802/2896435780,v1:172.21.15.88:6803/2896435780]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-17T04:15:03.651 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:15:04.315 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:04 smithi134 ceph-mon[35201]: from='osd.0 [v2:172.21.15.88:6802/2896435780,v1:172.21.15.88:6803/2896435780]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-17T04:15:04.315 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:04 smithi134 ceph-mon[35201]: osdmap e7: 1 total, 0 up, 1 in 2024-09-17T04:15:04.315 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:04 smithi134 ceph-mon[35201]: from='osd.0 [v2:172.21.15.88:6802/2896435780,v1:172.21.15.88:6803/2896435780]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-09-17T04:15:04.315 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:04 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T04:15:04.315 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:04 smithi134 ceph-mon[35201]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:15:04.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:04 smithi088 ceph-mon[27811]: from='osd.0 [v2:172.21.15.88:6802/2896435780,v1:172.21.15.88:6803/2896435780]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-17T04:15:04.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:04 smithi088 ceph-mon[27811]: osdmap e7: 1 total, 0 up, 1 in 2024-09-17T04:15:04.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:04 smithi088 ceph-mon[27811]: from='osd.0 [v2:172.21.15.88:6802/2896435780,v1:172.21.15.88:6803/2896435780]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-09-17T04:15:04.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:04 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T04:15:04.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:04 smithi088 ceph-mon[27811]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:15:04.388 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:15:04 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-0[49653]: 2024-09-17T04:15:04.305+0000 7feb90ae1640 -1 osd.0 0 waiting for initial osdmap 2024-09-17T04:15:04.388 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:15:04 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-0[49653]: 2024-09-17T04:15:04.310+0000 7feb8d11b640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T04:15:05.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:05 smithi088 ceph-mon[27811]: from='osd.0 [v2:172.21.15.88:6802/2896435780,v1:172.21.15.88:6803/2896435780]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2024-09-17T04:15:05.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:05 smithi088 ceph-mon[27811]: osdmap e8: 1 total, 0 up, 1 in 2024-09-17T04:15:05.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:05 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T04:15:05.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:05 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T04:15:05.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:05 smithi134 ceph-mon[35201]: from='osd.0 [v2:172.21.15.88:6802/2896435780,v1:172.21.15.88:6803/2896435780]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2024-09-17T04:15:05.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:05 smithi134 ceph-mon[35201]: osdmap e8: 1 total, 0 up, 1 in 2024-09-17T04:15:05.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:05 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T04:15:05.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:05 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T04:15:06.566 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:06 smithi088 ceph-mon[27811]: purged_snaps scrub starts 2024-09-17T04:15:06.566 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:06 smithi088 ceph-mon[27811]: purged_snaps scrub ok 2024-09-17T04:15:06.566 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:06 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T04:15:06.566 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:06 smithi088 ceph-mon[27811]: osd.0 [v2:172.21.15.88:6802/2896435780,v1:172.21.15.88:6803/2896435780] boot 2024-09-17T04:15:06.566 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:06 smithi088 ceph-mon[27811]: osdmap e9: 1 total, 1 up, 1 in 2024-09-17T04:15:06.566 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:06 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T04:15:06.566 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:06 smithi088 ceph-mon[27811]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:15:06.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:06 smithi134 ceph-mon[35201]: purged_snaps scrub starts 2024-09-17T04:15:06.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:06 smithi134 ceph-mon[35201]: purged_snaps scrub ok 2024-09-17T04:15:06.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:06 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T04:15:06.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:06 smithi134 ceph-mon[35201]: osd.0 [v2:172.21.15.88:6802/2896435780,v1:172.21.15.88:6803/2896435780] boot 2024-09-17T04:15:06.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:06 smithi134 ceph-mon[35201]: osdmap e9: 1 total, 1 up, 1 in 2024-09-17T04:15:06.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:06 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T04:15:06.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:06 smithi134 ceph-mon[35201]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T04:15:07.227 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:15:07.254 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi088:vg_nvme/lv_3 2024-09-17T04:15:07.485 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:07 smithi088 ceph-mon[27811]: osdmap e10: 1 total, 1 up, 1 in 2024-09-17T04:15:07.485 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:07 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:15:07.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:07 smithi134 ceph-mon[35201]: osdmap e10: 1 total, 1 up, 1 in 2024-09-17T04:15:07.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:07 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:15:08.010 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:15:08.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:08.429+0000 7fbc9a483640 1 -- 172.21.15.88:0/3673030237 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc94100860 msgr2=0x7fbc94100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:15:08.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:08.429+0000 7fbc9a483640 1 --2- 172.21.15.88:0/3673030237 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc94100860 0x7fbc94100c60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbc84009880 tx=0x7fbc8402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:15:08.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:08.429+0000 7fbc9a483640 1 -- 172.21.15.88:0/3673030237 shutdown_connections 2024-09-17T04:15:08.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:08.429+0000 7fbc9a483640 1 --2- 172.21.15.88:0/3673030237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc94101a60 0x7fbc94101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:15:08.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:08.429+0000 7fbc9a483640 1 --2- 172.21.15.88:0/3673030237 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc94100860 0x7fbc94100c60 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:15:08.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:08.429+0000 7fbc9a483640 1 -- 172.21.15.88:0/3673030237 >> 172.21.15.88:0/3673030237 conn(0x7fbc940fc010 msgr2=0x7fbc940fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:15:08.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:08.429+0000 7fbc9a483640 1 -- 172.21.15.88:0/3673030237 shutdown_connections 2024-09-17T04:15:08.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:08.429+0000 7fbc9a483640 1 -- 172.21.15.88:0/3673030237 wait complete. 2024-09-17T04:15:08.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:08.430+0000 7fbc9a483640 1 Processor -- start 2024-09-17T04:15:08.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:08.430+0000 7fbc9a483640 1 -- start start 2024-09-17T04:15:08.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:08.430+0000 7fbc9a483640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc94100860 0x7fbc941963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:15:08.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:08.430+0000 7fbc9a483640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc94101a60 0x7fbc94196910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:15:08.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:08.430+0000 7fbc9a483640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fbc941096a0 con 0x7fbc94101a60 2024-09-17T04:15:08.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:08.430+0000 7fbc9a483640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbc94109520 con 0x7fbc94100860 2024-09-17T04:15:08.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:08.430+0000 7fbc937fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc94101a60 0x7fbc94196910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:15:08.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:08.430+0000 7fbc937fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc94101a60 0x7fbc94196910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56348/0 (socket says 172.21.15.88:56348) 2024-09-17T04:15:08.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:08.430+0000 7fbc937fe640 1 -- 172.21.15.88:0/797246862 learned_addr learned my addr 172.21.15.88:0/797246862 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:15:08.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:08.431+0000 7fbc93fff640 1 --2- 172.21.15.88:0/797246862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc94100860 0x7fbc941963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:15:08.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:08.431+0000 7fbc937fe640 1 -- 172.21.15.88:0/797246862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc94100860 msgr2=0x7fbc941963d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:15:08.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:08.431+0000 7fbc937fe640 1 --2- 172.21.15.88:0/797246862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc94100860 0x7fbc941963d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:15:08.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:08.431+0000 7fbc937fe640 1 -- 172.21.15.88:0/797246862 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc94196f90 con 0x7fbc94101a60 2024-09-17T04:15:08.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:08.431+0000 7fbc937fe640 1 --2- 172.21.15.88:0/797246862 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc94101a60 0x7fbc94196910 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbc88009860 tx=0x7fbc88009d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:15:08.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:08.431+0000 7fbc917fa640 1 -- 172.21.15.88:0/797246862 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbc88005020 con 0x7fbc94101a60 2024-09-17T04:15:08.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:08.431+0000 7fbc917fa640 1 -- 172.21.15.88:0/797246862 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbc880047a0 con 0x7fbc94101a60 2024-09-17T04:15:08.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:08.431+0000 7fbc9a483640 1 -- 172.21.15.88:0/797246862 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc9406a210 con 0x7fbc94101a60 2024-09-17T04:15:08.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:08.431+0000 7fbc917fa640 1 -- 172.21.15.88:0/797246862 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbc88007b00 con 0x7fbc94101a60 2024-09-17T04:15:08.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:08.431+0000 7fbc9a483640 1 -- 172.21.15.88:0/797246862 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc9406a7a0 con 0x7fbc94101a60 2024-09-17T04:15:08.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:08.432+0000 7fbc9a483640 1 -- 172.21.15.88:0/797246862 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc94100c60 con 0x7fbc94101a60 2024-09-17T04:15:08.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:08.432+0000 7fbc917fa640 1 -- 172.21.15.88:0/797246862 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7fbc88004950 con 0x7fbc94101a60 2024-09-17T04:15:08.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:08.433+0000 7fbc917fa640 1 --2- 172.21.15.88:0/797246862 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fbc7c06e230 0x7fbc7c0706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:15:08.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:08.433+0000 7fbc917fa640 1 -- 172.21.15.88:0/797246862 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1982+0+0 (secure 0 0 0) 0x7fbc88013030 con 0x7fbc94101a60 2024-09-17T04:15:08.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:08.433+0000 7fbc93fff640 1 --2- 172.21.15.88:0/797246862 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fbc7c06e230 0x7fbc7c0706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:15:08.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:08.433+0000 7fbc93fff640 1 --2- 172.21.15.88:0/797246862 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fbc7c06e230 0x7fbc7c0706f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbc84006010 tx=0x7fbc84000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:15:08.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:08.437+0000 7fbc917fa640 1 -- 172.21.15.88:0/797246862 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbc8805d340 con 0x7fbc94101a60 2024-09-17T04:15:08.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:08.633+0000 7fbc9a483640 1 -- 172.21.15.88:0/797246862 --> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fbc9406ab10 con 0x7fbc7c06e230 2024-09-17T04:15:09.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:08 smithi088 ceph-mon[27811]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T04:15:09.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:08 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:09.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:08 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:09.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:08 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T04:15:09.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:08 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T04:15:09.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:08 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:15:09.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:08 smithi134 ceph-mon[35201]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T04:15:09.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:08 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:09.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:08 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:09.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:08 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T04:15:09.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:08 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T04:15:09.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:08 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:15:10.248 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:09 smithi088 ceph-mon[27811]: from='client.14366 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:15:10.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:09 smithi134 ceph-mon[35201]: from='client.14366 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:15:11.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:10 smithi088 ceph-mon[27811]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T04:15:11.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:10 smithi134 ceph-mon[35201]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T04:15:13.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:12 smithi088 ceph-mon[27811]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T04:15:13.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:12 smithi088 ceph-mon[27811]: Detected new or changed devices on smithi088 2024-09-17T04:15:13.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:12 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:13.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:12 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:13.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:12 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T04:15:13.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:12 smithi088 ceph-mon[27811]: Adjusting osd_memory_target on smithi088 to 11840M 2024-09-17T04:15:13.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:12 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:13.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:12 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:15:13.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:12 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:15:13.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:12 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:13.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:12 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:15:13.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:12 smithi134 ceph-mon[35201]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T04:15:13.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:12 smithi134 ceph-mon[35201]: Detected new or changed devices on smithi088 2024-09-17T04:15:13.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:12 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:13.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:12 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:13.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:12 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T04:15:13.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:12 smithi134 ceph-mon[35201]: Adjusting osd_memory_target on smithi088 to 11840M 2024-09-17T04:15:13.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:12 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:13.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:12 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:15:13.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:12 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:15:13.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:12 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:13.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:12 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:15:13.883 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:13 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/81897687' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2b6a97ae-75a3-437c-ad8a-b5dde2819592"}]: dispatch 2024-09-17T04:15:13.883 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:13 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/81897687' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2b6a97ae-75a3-437c-ad8a-b5dde2819592"}]': finished 2024-09-17T04:15:13.883 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:13 smithi088 ceph-mon[27811]: osdmap e11: 2 total, 1 up, 2 in 2024-09-17T04:15:13.883 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:13 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T04:15:13.883 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:13 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/3046889945' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T04:15:13.883 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:13 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:13.883 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:13 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:14.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:13 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/81897687' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2b6a97ae-75a3-437c-ad8a-b5dde2819592"}]: dispatch 2024-09-17T04:15:14.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:13 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/81897687' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2b6a97ae-75a3-437c-ad8a-b5dde2819592"}]': finished 2024-09-17T04:15:14.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:13 smithi134 ceph-mon[35201]: osdmap e11: 2 total, 1 up, 2 in 2024-09-17T04:15:14.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:13 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T04:15:14.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:13 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/3046889945' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T04:15:14.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:13 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:14.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:13 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:15.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:14 smithi088 ceph-mon[27811]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T04:15:15.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:14 smithi134 ceph-mon[35201]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T04:15:17.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:16 smithi088 ceph-mon[27811]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T04:15:17.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:16 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:17.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:16 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:17.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:16 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:15:17.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:16 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:15:17.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:16 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:17.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:16 smithi134 ceph-mon[35201]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T04:15:17.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:16 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:17.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:16 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:17.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:16 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:15:17.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:16 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:15:17.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:16 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:19.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:18 smithi088 ceph-mon[27811]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T04:15:19.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:18 smithi134 ceph-mon[35201]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T04:15:21.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:20 smithi088 ceph-mon[27811]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T04:15:21.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:20 smithi134 ceph-mon[35201]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T04:15:22.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:21 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-17T04:15:22.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:21 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:15:22.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:21 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:15:22.200 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:21 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-17T04:15:22.201 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:21 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:15:22.201 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:21 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:15:23.122 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:22 smithi088 ceph-mon[27811]: Deploying daemon osd.1 on smithi088 2024-09-17T04:15:23.122 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:22 smithi088 ceph-mon[27811]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T04:15:23.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:22 smithi134 ceph-mon[35201]: Deploying daemon osd.1 on smithi088 2024-09-17T04:15:23.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:22 smithi134 ceph-mon[35201]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T04:15:25.048 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:24 smithi088 ceph-mon[27811]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T04:15:25.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:24 smithi134 ceph-mon[35201]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T04:15:27.218 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:26 smithi088 ceph-mon[27811]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T04:15:27.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:26 smithi134 ceph-mon[35201]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T04:15:28.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:27 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:15:28.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:27 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:28.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:27 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:28.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:27 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:15:28.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:27 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:28.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:27 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:29.224 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:28 smithi088 ceph-mon[27811]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T04:15:29.248 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:28 smithi134 ceph-mon[35201]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T04:15:30.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:30 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:30.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:30 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:30.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:30 smithi088 ceph-mon[27811]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T04:15:30.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:30 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:30.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:30 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:30.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:30 smithi134 ceph-mon[35201]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T04:15:31.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:31.831+0000 7fbc917fa640 1 -- 172.21.15.88:0/797246862 <== mgr.14217 v2:172.21.15.88:6800/1666801150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fbc9406ab10 con 0x7fbc7c06e230 2024-09-17T04:15:31.831 INFO:teuthology.orchestra.run.smithi088.stdout:Created osd(s) 1 on host 'smithi088' 2024-09-17T04:15:31.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:31.833+0000 7fbc9a483640 1 -- 172.21.15.88:0/797246862 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fbc7c06e230 msgr2=0x7fbc7c0706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:15:31.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:31.833+0000 7fbc9a483640 1 --2- 172.21.15.88:0/797246862 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fbc7c06e230 0x7fbc7c0706f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbc84006010 tx=0x7fbc84000bc0 comp rx=0 tx=0).stop 2024-09-17T04:15:31.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:31.833+0000 7fbc9a483640 1 -- 172.21.15.88:0/797246862 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc94101a60 msgr2=0x7fbc94196910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:15:31.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:31.833+0000 7fbc9a483640 1 --2- 172.21.15.88:0/797246862 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc94101a60 0x7fbc94196910 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbc88009860 tx=0x7fbc88009d20 comp rx=0 tx=0).stop 2024-09-17T04:15:31.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:31.833+0000 7fbc9a483640 1 -- 172.21.15.88:0/797246862 shutdown_connections 2024-09-17T04:15:31.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:31.833+0000 7fbc9a483640 1 --2- 172.21.15.88:0/797246862 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fbc7c06e230 0x7fbc7c0706f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:15:31.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:31.833+0000 7fbc9a483640 1 --2- 172.21.15.88:0/797246862 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc94101a60 0x7fbc94196910 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:15:31.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:31.833+0000 7fbc9a483640 1 --2- 172.21.15.88:0/797246862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc94100860 0x7fbc941963d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:15:31.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:31.833+0000 7fbc9a483640 1 -- 172.21.15.88:0/797246862 >> 172.21.15.88:0/797246862 conn(0x7fbc940fc010 msgr2=0x7fbc94104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:15:31.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:31.833+0000 7fbc9a483640 1 -- 172.21.15.88:0/797246862 shutdown_connections 2024-09-17T04:15:31.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:31.833+0000 7fbc9a483640 1 -- 172.21.15.88:0/797246862 wait complete. 2024-09-17T04:15:32.512 DEBUG:teuthology.orchestra.run.smithi088:osd.1> sudo journalctl -f -n 0 -u ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968@osd.1.service 2024-09-17T04:15:32.514 INFO:tasks.cephadm:Deploying osd.2 on smithi088 with /dev/vg_nvme/lv_2... 2024-09-17T04:15:32.514 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-17T04:15:33.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:32 smithi088 ceph-mon[27811]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T04:15:33.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:32 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:33.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:32 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:33.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:32 smithi134 ceph-mon[35201]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T04:15:33.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:32 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:33.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:32 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:33.218 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:15:34.296 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:15:34 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-1[57630]: 2024-09-17T04:15:34.119+0000 7f6cf750b640 -1 osd.1 0 log_to_monitors true 2024-09-17T04:15:35.084 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:34 smithi088 ceph-mon[27811]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T04:15:35.084 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:34 smithi088 ceph-mon[27811]: from='osd.1 [v2:172.21.15.88:6810/1101608666,v1:172.21.15.88:6811/1101608666]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-17T04:15:35.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:34 smithi134 ceph-mon[35201]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T04:15:35.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:34 smithi134 ceph-mon[35201]: from='osd.1 [v2:172.21.15.88:6810/1101608666,v1:172.21.15.88:6811/1101608666]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-17T04:15:35.988 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:35 smithi088 ceph-mon[27811]: from='osd.1 [v2:172.21.15.88:6810/1101608666,v1:172.21.15.88:6811/1101608666]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-17T04:15:35.988 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:35 smithi088 ceph-mon[27811]: osdmap e12: 2 total, 1 up, 2 in 2024-09-17T04:15:35.989 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:35 smithi088 ceph-mon[27811]: from='osd.1 [v2:172.21.15.88:6810/1101608666,v1:172.21.15.88:6811/1101608666]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-09-17T04:15:35.989 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:35 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T04:15:35.989 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:35 smithi088 ceph-mon[27811]: from='osd.1 [v2:172.21.15.88:6810/1101608666,v1:172.21.15.88:6811/1101608666]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2024-09-17T04:15:36.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:35 smithi134 ceph-mon[35201]: from='osd.1 [v2:172.21.15.88:6810/1101608666,v1:172.21.15.88:6811/1101608666]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-17T04:15:36.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:35 smithi134 ceph-mon[35201]: osdmap e12: 2 total, 1 up, 2 in 2024-09-17T04:15:36.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:35 smithi134 ceph-mon[35201]: from='osd.1 [v2:172.21.15.88:6810/1101608666,v1:172.21.15.88:6811/1101608666]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-09-17T04:15:36.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:35 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T04:15:36.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:35 smithi134 ceph-mon[35201]: from='osd.1 [v2:172.21.15.88:6810/1101608666,v1:172.21.15.88:6811/1101608666]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2024-09-17T04:15:36.877 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:15:36 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-1[57630]: 2024-09-17T04:15:36.615+0000 7f6cf2c6b640 -1 osd.1 0 waiting for initial osdmap 2024-09-17T04:15:36.877 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:15:36 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-1[57630]: 2024-09-17T04:15:36.619+0000 7f6ceb29d640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T04:15:36.946 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:15:36.970 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi088:vg_nvme/lv_2 2024-09-17T04:15:37.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:36 smithi088 ceph-mon[27811]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T04:15:37.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:36 smithi088 ceph-mon[27811]: osdmap e13: 2 total, 1 up, 2 in 2024-09-17T04:15:37.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:36 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T04:15:37.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:36 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T04:15:37.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:36 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:37.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:36 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:37.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:36 smithi088 ceph-mon[27811]: from='osd.1 [v2:172.21.15.88:6810/1101608666,v1:172.21.15.88:6811/1101608666]' entity='osd.1' 2024-09-17T04:15:37.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:36 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:15:37.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:36 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T04:15:37.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:36 smithi134 ceph-mon[35201]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T04:15:37.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:36 smithi134 ceph-mon[35201]: osdmap e13: 2 total, 1 up, 2 in 2024-09-17T04:15:37.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:36 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T04:15:37.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:36 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T04:15:37.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:36 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:37.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:36 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:37.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:36 smithi134 ceph-mon[35201]: from='osd.1 [v2:172.21.15.88:6810/1101608666,v1:172.21.15.88:6811/1101608666]' entity='osd.1' 2024-09-17T04:15:37.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:36 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:15:37.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:36 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T04:15:37.722 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:15:38.124 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:37 smithi088 ceph-mon[27811]: purged_snaps scrub starts 2024-09-17T04:15:38.124 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:37 smithi088 ceph-mon[27811]: purged_snaps scrub ok 2024-09-17T04:15:38.125 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:37 smithi088 ceph-mon[27811]: osd.1 [v2:172.21.15.88:6810/1101608666,v1:172.21.15.88:6811/1101608666] boot 2024-09-17T04:15:38.125 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:37 smithi088 ceph-mon[27811]: osdmap e14: 2 total, 2 up, 2 in 2024-09-17T04:15:38.125 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:37 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T04:15:38.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:37 smithi134 ceph-mon[35201]: purged_snaps scrub starts 2024-09-17T04:15:38.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:37 smithi134 ceph-mon[35201]: purged_snaps scrub ok 2024-09-17T04:15:38.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:37 smithi134 ceph-mon[35201]: osd.1 [v2:172.21.15.88:6810/1101608666,v1:172.21.15.88:6811/1101608666] boot 2024-09-17T04:15:38.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:37 smithi134 ceph-mon[35201]: osdmap e14: 2 total, 2 up, 2 in 2024-09-17T04:15:38.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:37 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T04:15:38.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:38.205+0000 7f34e0497640 1 -- 172.21.15.88:0/1925674073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34d8101960 msgr2=0x7f34d8101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:15:38.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:38.205+0000 7f34e0497640 1 --2- 172.21.15.88:0/1925674073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34d8101960 0x7f34d8101d60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f34d4009880 tx=0x7f34d402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:15:38.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:38.206+0000 7f34e0497640 1 -- 172.21.15.88:0/1925674073 shutdown_connections 2024-09-17T04:15:38.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:38.206+0000 7f34e0497640 1 --2- 172.21.15.88:0/1925674073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34d8102b60 0x7f34d8102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:15:38.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:38.206+0000 7f34e0497640 1 --2- 172.21.15.88:0/1925674073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34d8101960 0x7f34d8101d60 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:15:38.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:38.206+0000 7f34e0497640 1 -- 172.21.15.88:0/1925674073 >> 172.21.15.88:0/1925674073 conn(0x7f34d80fd0f0 msgr2=0x7f34d80ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:15:38.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:38.206+0000 7f34e0497640 1 -- 172.21.15.88:0/1925674073 shutdown_connections 2024-09-17T04:15:38.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:38.206+0000 7f34e0497640 1 -- 172.21.15.88:0/1925674073 wait complete. 2024-09-17T04:15:38.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:38.206+0000 7f34e0497640 1 Processor -- start 2024-09-17T04:15:38.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:38.206+0000 7f34e0497640 1 -- start start 2024-09-17T04:15:38.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:38.206+0000 7f34e0497640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34d8101960 0x7f34d81974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:15:38.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:38.206+0000 7f34e0497640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34d8102b60 0x7f34d8197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:15:38.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:38.206+0000 7f34e0497640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f34d810a7a0 con 0x7f34d8102b60 2024-09-17T04:15:38.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:38.206+0000 7f34e0497640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f34d810a620 con 0x7f34d8101960 2024-09-17T04:15:38.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:38.206+0000 7f34dda32640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34d8102b60 0x7f34d8197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:15:38.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:38.206+0000 7f34dda32640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34d8102b60 0x7f34d8197a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57736/0 (socket says 172.21.15.88:57736) 2024-09-17T04:15:38.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:38.207+0000 7f34dda32640 1 -- 172.21.15.88:0/1223439824 learned_addr learned my addr 172.21.15.88:0/1223439824 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:15:38.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:38.207+0000 7f34de233640 1 --2- 172.21.15.88:0/1223439824 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34d8101960 0x7f34d81974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:15:38.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:38.207+0000 7f34dda32640 1 -- 172.21.15.88:0/1223439824 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34d8101960 msgr2=0x7f34d81974d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:15:38.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:38.207+0000 7f34dda32640 1 --2- 172.21.15.88:0/1223439824 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34d8101960 0x7f34d81974d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:15:38.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:38.207+0000 7f34dda32640 1 -- 172.21.15.88:0/1223439824 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34d8198090 con 0x7f34d8102b60 2024-09-17T04:15:38.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:38.207+0000 7f34dda32640 1 --2- 172.21.15.88:0/1223439824 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34d8102b60 0x7f34d8197a10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f34c800d6f0 tx=0x7f34c800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:15:38.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:38.207+0000 7f34cf7fe640 1 -- 172.21.15.88:0/1223439824 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f34c8017070 con 0x7f34d8102b60 2024-09-17T04:15:38.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:38.207+0000 7f34cf7fe640 1 -- 172.21.15.88:0/1223439824 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f34c800de00 con 0x7f34d8102b60 2024-09-17T04:15:38.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:38.207+0000 7f34e0497640 1 -- 172.21.15.88:0/1223439824 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34d819cad0 con 0x7f34d8102b60 2024-09-17T04:15:38.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:38.207+0000 7f34cf7fe640 1 -- 172.21.15.88:0/1223439824 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f34c8004bb0 con 0x7f34d8102b60 2024-09-17T04:15:38.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:38.207+0000 7f34e0497640 1 -- 172.21.15.88:0/1223439824 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34d8074420 con 0x7f34d8102b60 2024-09-17T04:15:38.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:38.208+0000 7f34e0497640 1 -- 172.21.15.88:0/1223439824 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34d8101d60 con 0x7f34d8102b60 2024-09-17T04:15:38.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:38.209+0000 7f34cf7fe640 1 -- 172.21.15.88:0/1223439824 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f34c8009a30 con 0x7f34d8102b60 2024-09-17T04:15:38.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:38.209+0000 7f34cf7fe640 1 --2- 172.21.15.88:0/1223439824 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f34c406e280 0x7f34c4070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:15:38.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:38.209+0000 7f34de233640 1 --2- 172.21.15.88:0/1223439824 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f34c406e280 0x7f34c4070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:15:38.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:38.209+0000 7f34cf7fe640 1 -- 172.21.15.88:0/1223439824 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2414+0+0 (secure 0 0 0) 0x7f34c808cf00 con 0x7f34d8102b60 2024-09-17T04:15:38.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:38.210+0000 7f34de233640 1 --2- 172.21.15.88:0/1223439824 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f34c406e280 0x7f34c4070740 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f34d4006010 tx=0x7f34d4005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:15:38.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:38.214+0000 7f34cf7fe640 1 -- 172.21.15.88:0/1223439824 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f34c805f260 con 0x7f34d8102b60 2024-09-17T04:15:38.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:15:38.396+0000 7f34e0497640 1 -- 172.21.15.88:0/1223439824 --> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f34d8062630 con 0x7f34c406e280 2024-09-17T04:15:38.926 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:38 smithi088 ceph-mon[27811]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T04:15:38.926 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:38 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T04:15:38.927 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:38 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T04:15:38.927 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:38 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:15:39.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:38 smithi134 ceph-mon[35201]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T04:15:39.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:38 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T04:15:39.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:38 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T04:15:39.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:38 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:15:40.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:39 smithi088 ceph-mon[27811]: from='client.14384 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:15:40.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:39 smithi088 ceph-mon[27811]: osdmap e15: 2 total, 2 up, 2 in 2024-09-17T04:15:40.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:39 smithi134 ceph-mon[35201]: from='client.14384 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:15:40.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:39 smithi134 ceph-mon[35201]: osdmap e15: 2 total, 2 up, 2 in 2024-09-17T04:15:41.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:40 smithi088 ceph-mon[27811]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T04:15:41.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:40 smithi134 ceph-mon[35201]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T04:15:42.321 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:41 smithi088 ceph-mon[27811]: Detected new or changed devices on smithi088 2024-09-17T04:15:42.321 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:41 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:42.322 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:41 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:42.322 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:41 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T04:15:42.322 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:41 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T04:15:42.322 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:41 smithi088 ceph-mon[27811]: Adjusting osd_memory_target on smithi088 to 5920M 2024-09-17T04:15:42.322 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:41 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:42.322 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:41 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:15:42.322 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:41 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:15:42.322 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:41 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:42.322 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:41 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:15:42.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:41 smithi134 ceph-mon[35201]: Detected new or changed devices on smithi088 2024-09-17T04:15:42.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:41 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:42.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:41 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:42.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:41 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T04:15:42.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:41 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T04:15:42.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:41 smithi134 ceph-mon[35201]: Adjusting osd_memory_target on smithi088 to 5920M 2024-09-17T04:15:42.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:41 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:42.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:41 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:15:42.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:41 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:15:42.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:41 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:42.398 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:41 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:15:43.071 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:42 smithi088 ceph-mon[27811]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T04:15:43.071 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:42 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/4190302020' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e57fd249-3087-439b-9ced-1d733503f1a9"}]: dispatch 2024-09-17T04:15:43.071 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:42 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/4190302020' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e57fd249-3087-439b-9ced-1d733503f1a9"}]': finished 2024-09-17T04:15:43.071 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:42 smithi088 ceph-mon[27811]: osdmap e16: 3 total, 2 up, 3 in 2024-09-17T04:15:43.072 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:42 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T04:15:43.072 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:42 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/2425653648' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T04:15:43.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:42 smithi134 ceph-mon[35201]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T04:15:43.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:42 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/4190302020' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e57fd249-3087-439b-9ced-1d733503f1a9"}]: dispatch 2024-09-17T04:15:43.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:42 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/4190302020' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e57fd249-3087-439b-9ced-1d733503f1a9"}]': finished 2024-09-17T04:15:43.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:42 smithi134 ceph-mon[35201]: osdmap e16: 3 total, 2 up, 3 in 2024-09-17T04:15:43.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:42 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T04:15:43.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:42 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/2425653648' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T04:15:45.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:44 smithi088 ceph-mon[27811]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T04:15:45.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:44 smithi134 ceph-mon[35201]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T04:15:46.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:46 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:46.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:46 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:46.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:46 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:15:46.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:46 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:15:46.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:46 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:46.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:46 smithi088 ceph-mon[27811]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T04:15:46.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:46 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:46.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:46 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:46.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:46 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:15:46.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:46 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:15:46.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:46 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:46.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:46 smithi134 ceph-mon[35201]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T04:15:48.861 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:48 smithi088 ceph-mon[27811]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T04:15:49.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:48 smithi134 ceph-mon[35201]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T04:15:51.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:50 smithi088 ceph-mon[27811]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T04:15:51.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:50 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-17T04:15:51.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:50 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:15:51.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:50 smithi134 ceph-mon[35201]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T04:15:51.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:50 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-17T04:15:51.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:50 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:15:52.088 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:51 smithi088 ceph-mon[27811]: Deploying daemon osd.2 on smithi088 2024-09-17T04:15:52.088 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:51 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:15:52.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:51 smithi134 ceph-mon[35201]: Deploying daemon osd.2 on smithi088 2024-09-17T04:15:52.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:51 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:15:53.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:52 smithi088 ceph-mon[27811]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T04:15:53.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:52 smithi134 ceph-mon[35201]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T04:15:55.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:54 smithi088 ceph-mon[27811]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T04:15:55.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:54 smithi134 ceph-mon[35201]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T04:15:57.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:56 smithi088 ceph-mon[27811]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T04:15:57.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:56 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:15:57.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:56 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:57.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:56 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:57.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:56 smithi134 ceph-mon[35201]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T04:15:57.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:56 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:15:57.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:56 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:57.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:56 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:15:59.078 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:15:58 smithi088 ceph-mon[27811]: pgmap v82: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T04:15:59.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:15:58 smithi134 ceph-mon[35201]: pgmap v82: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T04:16:00.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:16:00.584+0000 7f34cf7fe640 1 -- 172.21.15.88:0/1223439824 <== mgr.14217 v2:172.21.15.88:6800/1666801150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f34d8062630 con 0x7f34c406e280 2024-09-17T04:16:00.585 INFO:teuthology.orchestra.run.smithi088.stdout:Created osd(s) 2 on host 'smithi088' 2024-09-17T04:16:00.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:16:00.586+0000 7f34e0497640 1 -- 172.21.15.88:0/1223439824 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f34c406e280 msgr2=0x7f34c4070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:16:00.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:16:00.586+0000 7f34e0497640 1 --2- 172.21.15.88:0/1223439824 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f34c406e280 0x7f34c4070740 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f34d4006010 tx=0x7f34d4005a20 comp rx=0 tx=0).stop 2024-09-17T04:16:00.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:16:00.586+0000 7f34e0497640 1 -- 172.21.15.88:0/1223439824 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34d8102b60 msgr2=0x7f34d8197a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:16:00.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:16:00.586+0000 7f34e0497640 1 --2- 172.21.15.88:0/1223439824 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34d8102b60 0x7f34d8197a10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f34c800d6f0 tx=0x7f34c800dbb0 comp rx=0 tx=0).stop 2024-09-17T04:16:00.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:16:00.586+0000 7f34e0497640 1 -- 172.21.15.88:0/1223439824 shutdown_connections 2024-09-17T04:16:00.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:16:00.586+0000 7f34e0497640 1 --2- 172.21.15.88:0/1223439824 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f34c406e280 0x7f34c4070740 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:16:00.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:16:00.586+0000 7f34e0497640 1 --2- 172.21.15.88:0/1223439824 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34d8102b60 0x7f34d8197a10 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:16:00.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:16:00.586+0000 7f34e0497640 1 --2- 172.21.15.88:0/1223439824 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34d8101960 0x7f34d81974d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:16:00.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:16:00.586+0000 7f34e0497640 1 -- 172.21.15.88:0/1223439824 >> 172.21.15.88:0/1223439824 conn(0x7f34d80fd0f0 msgr2=0x7f34d8106060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:16:00.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:16:00.586+0000 7f34e0497640 1 -- 172.21.15.88:0/1223439824 shutdown_connections 2024-09-17T04:16:00.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:16:00.586+0000 7f34e0497640 1 -- 172.21.15.88:0/1223439824 wait complete. 2024-09-17T04:16:01.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:00 smithi088 ceph-mon[27811]: pgmap v83: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T04:16:01.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:00 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:01.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:00 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:01.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:00 smithi134 ceph-mon[35201]: pgmap v83: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T04:16:01.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:00 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:01.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:00 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:01.196 DEBUG:teuthology.orchestra.run.smithi088:osd.2> sudo journalctl -f -n 0 -u ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968@osd.2.service 2024-09-17T04:16:01.199 INFO:tasks.cephadm:Deploying osd.3 on smithi134 with /dev/vg_nvme/lv_4... 2024-09-17T04:16:01.200 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-17T04:16:01.454 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi134/config 2024-09-17T04:16:02.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:02 smithi134 ceph-mon[35201]: pgmap v84: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T04:16:03.129 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:02 smithi088 ceph-mon[27811]: pgmap v84: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T04:16:03.130 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:16:02 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-2[64975]: 2024-09-17T04:16:02.943+0000 7f4421895640 -1 osd.2 0 log_to_monitors true 2024-09-17T04:16:03.969 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:03 smithi134 ceph-mon[35201]: from='osd.2 [v2:172.21.15.88:6818/3973957395,v1:172.21.15.88:6819/3973957395]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-17T04:16:03.969 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:03 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:03.969 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:03 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:03.971 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:16:04.004 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi134:vg_nvme/lv_4 2024-09-17T04:16:04.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:03 smithi088 ceph-mon[27811]: from='osd.2 [v2:172.21.15.88:6818/3973957395,v1:172.21.15.88:6819/3973957395]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-17T04:16:04.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:03 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:04.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:03 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:04.262 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi134/config 2024-09-17T04:16:04.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:04.705+0000 7f4e56559640 1 -- 172.21.15.134:0/1812643942 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e50102b60 msgr2=0x7f4e50102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:16:04.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:04.705+0000 7f4e56559640 1 --2- 172.21.15.134:0/1812643942 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e50102b60 0x7f4e50102fe0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f4e44009880 tx=0x7f4e4402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:16:04.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:04.705+0000 7f4e56559640 1 -- 172.21.15.134:0/1812643942 shutdown_connections 2024-09-17T04:16:04.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:04.705+0000 7f4e56559640 1 --2- 172.21.15.134:0/1812643942 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e50102b60 0x7f4e50102fe0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:16:04.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:04.705+0000 7f4e56559640 1 --2- 172.21.15.134:0/1812643942 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e50101960 0x7f4e50101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:16:04.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:04.705+0000 7f4e56559640 1 -- 172.21.15.134:0/1812643942 >> 172.21.15.134:0/1812643942 conn(0x7f4e500fd0f0 msgr2=0x7f4e500ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:16:04.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:04.705+0000 7f4e56559640 1 -- 172.21.15.134:0/1812643942 shutdown_connections 2024-09-17T04:16:04.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:04.705+0000 7f4e56559640 1 -- 172.21.15.134:0/1812643942 wait complete. 2024-09-17T04:16:04.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:04.706+0000 7f4e56559640 1 Processor -- start 2024-09-17T04:16:04.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:04.706+0000 7f4e56559640 1 -- start start 2024-09-17T04:16:04.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:04.706+0000 7f4e56559640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e50101960 0x7f4e501974b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:16:04.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:04.706+0000 7f4e56559640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e50102b60 0x7f4e501979f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:16:04.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:04.706+0000 7f4e56559640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f4e5010a780 con 0x7f4e50101960 2024-09-17T04:16:04.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:04.706+0000 7f4e56559640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4e5010a600 con 0x7f4e50102b60 2024-09-17T04:16:04.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:04.706+0000 7f4e4f7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e50102b60 0x7f4e501979f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:16:04.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:04.706+0000 7f4e4f7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e50102b60 0x7f4e501979f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36766/0 (socket says 172.21.15.134:36766) 2024-09-17T04:16:04.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:04.706+0000 7f4e4f7fe640 1 -- 172.21.15.134:0/144767187 learned_addr learned my addr 172.21.15.134:0/144767187 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-17T04:16:04.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:04.706+0000 7f4e4ffff640 1 --2- 172.21.15.134:0/144767187 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e50101960 0x7f4e501974b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:16:04.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:04.706+0000 7f4e4f7fe640 1 -- 172.21.15.134:0/144767187 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e50101960 msgr2=0x7f4e501974b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:16:04.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:04.706+0000 7f4e4f7fe640 1 --2- 172.21.15.134:0/144767187 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e50101960 0x7f4e501974b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:16:04.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:04.706+0000 7f4e4f7fe640 1 -- 172.21.15.134:0/144767187 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e50198070 con 0x7f4e50102b60 2024-09-17T04:16:04.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:04.707+0000 7f4e4f7fe640 1 --2- 172.21.15.134:0/144767187 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e50102b60 0x7f4e501979f0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f4e44006010 tx=0x7f4e440046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:16:04.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:04.707+0000 7f4e4d7fa640 1 -- 172.21.15.134:0/144767187 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4e4403f070 con 0x7f4e50102b60 2024-09-17T04:16:04.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:04.707+0000 7f4e4d7fa640 1 -- 172.21.15.134:0/144767187 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4e44004ac0 con 0x7f4e50102b60 2024-09-17T04:16:04.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:04.707+0000 7f4e4d7fa640 1 -- 172.21.15.134:0/144767187 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4e44035030 con 0x7f4e50102b60 2024-09-17T04:16:04.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:04.707+0000 7f4e56559640 1 -- 172.21.15.134:0/144767187 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e5019ca50 con 0x7f4e50102b60 2024-09-17T04:16:04.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:04.707+0000 7f4e56559640 1 -- 172.21.15.134:0/144767187 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e5019cfe0 con 0x7f4e50102b60 2024-09-17T04:16:04.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:04.708+0000 7f4e56559640 1 -- 172.21.15.134:0/144767187 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e50101d60 con 0x7f4e50102b60 2024-09-17T04:16:04.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:04.708+0000 7f4e4d7fa640 1 -- 172.21.15.134:0/144767187 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f4e44042070 con 0x7f4e50102b60 2024-09-17T04:16:04.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:04.709+0000 7f4e4d7fa640 1 --2- 172.21.15.134:0/144767187 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f4e3806e280 0x7f4e38070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:16:04.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:04.709+0000 7f4e4d7fa640 1 -- 172.21.15.134:0/144767187 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2550+0+0 (secure 0 0 0) 0x7f4e440adfd0 con 0x7f4e50102b60 2024-09-17T04:16:04.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:04.709+0000 7f4e4ffff640 1 --2- 172.21.15.134:0/144767187 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f4e3806e280 0x7f4e38070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:16:04.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:04.709+0000 7f4e4ffff640 1 --2- 172.21.15.134:0/144767187 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f4e3806e280 0x7f4e38070740 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4e501029c0 tx=0x7f4e4000b390 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:16:04.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:04.713+0000 7f4e4d7fa640 1 -- 172.21.15.134:0/144767187 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4e440802a0 con 0x7f4e50102b60 2024-09-17T04:16:04.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:04.887+0000 7f4e56559640 1 -- 172.21.15.134:0/144767187 --> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f4e500626f0 con 0x7f4e3806e280 2024-09-17T04:16:05.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:04 smithi088 ceph-mon[27811]: pgmap v85: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T04:16:05.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:04 smithi088 ceph-mon[27811]: from='osd.2 [v2:172.21.15.88:6818/3973957395,v1:172.21.15.88:6819/3973957395]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-17T04:16:05.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:04 smithi088 ceph-mon[27811]: osdmap e17: 3 total, 2 up, 3 in 2024-09-17T04:16:05.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:04 smithi088 ceph-mon[27811]: from='osd.2 [v2:172.21.15.88:6818/3973957395,v1:172.21.15.88:6819/3973957395]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-09-17T04:16:05.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:04 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T04:16:05.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:04 smithi134 ceph-mon[35201]: pgmap v85: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T04:16:05.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:04 smithi134 ceph-mon[35201]: from='osd.2 [v2:172.21.15.88:6818/3973957395,v1:172.21.15.88:6819/3973957395]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-17T04:16:05.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:04 smithi134 ceph-mon[35201]: osdmap e17: 3 total, 2 up, 3 in 2024-09-17T04:16:05.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:04 smithi134 ceph-mon[35201]: from='osd.2 [v2:172.21.15.88:6818/3973957395,v1:172.21.15.88:6819/3973957395]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-09-17T04:16:05.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:04 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T04:16:05.789 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:16:05 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-2[64975]: 2024-09-17T04:16:05.649+0000 7f441cff5640 -1 osd.2 0 waiting for initial osdmap 2024-09-17T04:16:05.789 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:16:05 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-2[64975]: 2024-09-17T04:16:05.657+0000 7f4415627640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T04:16:06.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:05 smithi088 ceph-mon[27811]: from='osd.2 [v2:172.21.15.88:6818/3973957395,v1:172.21.15.88:6819/3973957395]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2024-09-17T04:16:06.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:05 smithi088 ceph-mon[27811]: osdmap e18: 3 total, 2 up, 3 in 2024-09-17T04:16:06.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:05 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T04:16:06.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:05 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T04:16:06.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:05 smithi088 ceph-mon[27811]: from='client.24167 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:16:06.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:05 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T04:16:06.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:05 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T04:16:06.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:05 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:16:06.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:05 smithi088 ceph-mon[27811]: from='osd.2 [v2:172.21.15.88:6818/3973957395,v1:172.21.15.88:6819/3973957395]' entity='osd.2' 2024-09-17T04:16:06.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:05 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T04:16:06.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:05 smithi134 ceph-mon[35201]: from='osd.2 [v2:172.21.15.88:6818/3973957395,v1:172.21.15.88:6819/3973957395]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2024-09-17T04:16:06.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:05 smithi134 ceph-mon[35201]: osdmap e18: 3 total, 2 up, 3 in 2024-09-17T04:16:06.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:05 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T04:16:06.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:05 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T04:16:06.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:05 smithi134 ceph-mon[35201]: from='client.24167 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:16:06.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:05 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T04:16:06.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:05 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T04:16:06.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:05 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:16:06.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:05 smithi134 ceph-mon[35201]: from='osd.2 [v2:172.21.15.88:6818/3973957395,v1:172.21.15.88:6819/3973957395]' entity='osd.2' 2024-09-17T04:16:06.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:05 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T04:16:07.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:06 smithi088 ceph-mon[27811]: purged_snaps scrub starts 2024-09-17T04:16:07.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:06 smithi088 ceph-mon[27811]: purged_snaps scrub ok 2024-09-17T04:16:07.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:06 smithi088 ceph-mon[27811]: pgmap v88: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T04:16:07.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:06 smithi088 ceph-mon[27811]: osd.2 [v2:172.21.15.88:6818/3973957395,v1:172.21.15.88:6819/3973957395] boot 2024-09-17T04:16:07.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:06 smithi088 ceph-mon[27811]: osdmap e19: 3 total, 3 up, 3 in 2024-09-17T04:16:07.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:06 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T04:16:07.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:06 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:16:07.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:06 smithi134 ceph-mon[35201]: purged_snaps scrub starts 2024-09-17T04:16:07.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:06 smithi134 ceph-mon[35201]: purged_snaps scrub ok 2024-09-17T04:16:07.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:06 smithi134 ceph-mon[35201]: pgmap v88: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T04:16:07.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:06 smithi134 ceph-mon[35201]: osd.2 [v2:172.21.15.88:6818/3973957395,v1:172.21.15.88:6819/3973957395] boot 2024-09-17T04:16:07.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:06 smithi134 ceph-mon[35201]: osdmap e19: 3 total, 3 up, 3 in 2024-09-17T04:16:07.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:06 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T04:16:07.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:06 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:16:08.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:08 smithi134 ceph-mon[35201]: Detected new or changed devices on smithi088 2024-09-17T04:16:08.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:08 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:08.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:08 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:08.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:08 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T04:16:08.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:08 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T04:16:08.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:08 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T04:16:08.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:08 smithi134 ceph-mon[35201]: Adjusting osd_memory_target on smithi088 to 3946M 2024-09-17T04:16:08.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:08 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:08.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:08 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:16:08.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:08 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:16:08.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:08 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:08.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:08 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:16:08.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:08 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:16:08.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:08 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:16:08.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:08 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:08.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:08 smithi134 ceph-mon[35201]: from='client.? 172.21.15.134:0/478408605' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "abb0ae43-4561-4ffe-89c4-20a3cbe1e817"}]: dispatch 2024-09-17T04:16:08.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:08 smithi134 ceph-mon[35201]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "abb0ae43-4561-4ffe-89c4-20a3cbe1e817"}]: dispatch 2024-09-17T04:16:08.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:08 smithi134 ceph-mon[35201]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "abb0ae43-4561-4ffe-89c4-20a3cbe1e817"}]': finished 2024-09-17T04:16:08.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:08 smithi134 ceph-mon[35201]: osdmap e20: 4 total, 3 up, 4 in 2024-09-17T04:16:08.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:08 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T04:16:08.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:08 smithi134 ceph-mon[35201]: from='client.? 172.21.15.134:0/291984278' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T04:16:08.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:08 smithi088 ceph-mon[27811]: Detected new or changed devices on smithi088 2024-09-17T04:16:08.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:08 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:08.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:08 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:08.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:08 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T04:16:08.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:08 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T04:16:08.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:08 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T04:16:08.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:08 smithi088 ceph-mon[27811]: Adjusting osd_memory_target on smithi088 to 3946M 2024-09-17T04:16:08.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:08 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:08.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:08 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:16:08.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:08 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:16:08.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:08 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:08.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:08 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:16:08.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:08 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:16:08.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:08 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:16:08.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:08 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:08.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:08 smithi088 ceph-mon[27811]: from='client.? 172.21.15.134:0/478408605' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "abb0ae43-4561-4ffe-89c4-20a3cbe1e817"}]: dispatch 2024-09-17T04:16:08.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:08 smithi088 ceph-mon[27811]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "abb0ae43-4561-4ffe-89c4-20a3cbe1e817"}]: dispatch 2024-09-17T04:16:08.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:08 smithi088 ceph-mon[27811]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "abb0ae43-4561-4ffe-89c4-20a3cbe1e817"}]': finished 2024-09-17T04:16:08.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:08 smithi088 ceph-mon[27811]: osdmap e20: 4 total, 3 up, 4 in 2024-09-17T04:16:08.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:08 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T04:16:08.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:08 smithi088 ceph-mon[27811]: from='client.? 172.21.15.134:0/291984278' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T04:16:09.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:09 smithi088 ceph-mon[27811]: pgmap v91: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-17T04:16:09.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:09 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-17T04:16:09.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:09 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-17T04:16:09.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:09 smithi088 ceph-mon[27811]: osdmap e21: 4 total, 3 up, 4 in 2024-09-17T04:16:09.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:09 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T04:16:09.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:09 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-17T04:16:09.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:09 smithi134 ceph-mon[35201]: pgmap v91: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-17T04:16:09.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:09 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-17T04:16:09.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:09 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-17T04:16:09.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:09 smithi134 ceph-mon[35201]: osdmap e21: 4 total, 3 up, 4 in 2024-09-17T04:16:09.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:09 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T04:16:09.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:09 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-17T04:16:10.570 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:10 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-17T04:16:10.570 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:10 smithi088 ceph-mon[27811]: osdmap e22: 4 total, 3 up, 4 in 2024-09-17T04:16:10.570 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:10 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T04:16:10.570 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:10 smithi088 ceph-mon[27811]: pgmap v94: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-17T04:16:10.571 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:16:10 smithi088 sudo[69311]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-17T04:16:10.571 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:16:10 smithi088 sudo[69311]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T04:16:10.571 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:16:10 smithi088 sudo[69311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T04:16:10.571 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:16:10 smithi088 sudo[69311]: pam_unix(sudo:session): session closed for user root 2024-09-17T04:16:10.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:10 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-17T04:16:10.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:10 smithi134 ceph-mon[35201]: osdmap e22: 4 total, 3 up, 4 in 2024-09-17T04:16:10.649 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:10 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T04:16:10.649 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:10 smithi134 ceph-mon[35201]: pgmap v94: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-17T04:16:10.841 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:16:10 smithi088 sudo[69314]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-17T04:16:10.841 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:16:10 smithi088 sudo[69314]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T04:16:10.841 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:16:10 smithi088 sudo[69314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T04:16:10.841 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:16:10 smithi088 sudo[69314]: pam_unix(sudo:session): session closed for user root 2024-09-17T04:16:11.099 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:16:10 smithi088 sudo[69317]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-17T04:16:11.099 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:16:10 smithi088 sudo[69317]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T04:16:11.099 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:16:10 smithi088 sudo[69317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T04:16:11.099 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:16:10 smithi088 sudo[69317]: pam_unix(sudo:session): session closed for user root 2024-09-17T04:16:11.361 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:11 smithi088 ceph-mon[27811]: osdmap e23: 4 total, 3 up, 4 in 2024-09-17T04:16:11.361 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:11 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T04:16:11.361 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:11 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:11.361 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:16:11 smithi088 sudo[69320]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-17T04:16:11.361 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:16:11 smithi088 sudo[69320]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T04:16:11.362 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:16:11 smithi088 sudo[69320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T04:16:11.362 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:16:11 smithi088 sudo[69320]: pam_unix(sudo:session): session closed for user root 2024-09-17T04:16:11.362 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:16:11 smithi088 sudo[69323]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-17T04:16:11.362 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:16:11 smithi088 sudo[69323]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T04:16:11.362 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:16:11 smithi088 sudo[69323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T04:16:11.362 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:16:11 smithi088 sudo[69323]: pam_unix(sudo:session): session closed for user root 2024-09-17T04:16:11.638 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:16:11 smithi088 sudo[69326]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-17T04:16:11.906 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:16:11 smithi088 sudo[69326]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T04:16:11.906 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:16:11 smithi088 sudo[69326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T04:16:11.906 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:16:11 smithi088 sudo[69326]: pam_unix(sudo:session): session closed for user root 2024-09-17T04:16:11.907 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:11 smithi134 ceph-mon[35201]: osdmap e23: 4 total, 3 up, 4 in 2024-09-17T04:16:11.907 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:11 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T04:16:11.907 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:11 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:12.103 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:11 smithi088 sudo[69329]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-17T04:16:12.103 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:11 smithi088 sudo[69329]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T04:16:12.103 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:11 smithi088 sudo[69329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T04:16:12.103 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:11 smithi088 sudo[69329]: pam_unix(sudo:session): session closed for user root 2024-09-17T04:16:12.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:12 smithi088 sudo[69332]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-17T04:16:12.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:12 smithi088 sudo[69332]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T04:16:12.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:12 smithi088 sudo[69332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T04:16:12.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:12 smithi088 sudo[69332]: pam_unix(sudo:session): session closed for user root 2024-09-17T04:16:12.617 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:12 smithi134 sudo[40384]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-17T04:16:12.617 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:12 smithi134 sudo[40384]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T04:16:12.617 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:12 smithi134 sudo[40384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T04:16:12.617 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:12 smithi134 sudo[40384]: pam_unix(sudo:session): session closed for user root 2024-09-17T04:16:12.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:12.632+0000 7f4e4d7fa640 1 -- 172.21.15.134:0/144767187 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f4e44003cd0 con 0x7f4e50102b60 2024-09-17T04:16:12.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:12 smithi088 ceph-mon[27811]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T04:16:12.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:12 smithi088 ceph-mon[27811]: pgmap v96: 1 pgs: 1 unknown; 0 B data, 89 MiB used, 268 GiB / 268 GiB avail 2024-09-17T04:16:12.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:12 smithi088 ceph-mon[27811]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T04:16:12.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:12 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2024-09-17T04:16:12.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:12 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-09-17T04:16:12.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:12 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2024-09-17T04:16:12.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:12 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-09-17T04:16:12.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:12 smithi134 sudo[40405]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-17T04:16:12.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:12 smithi134 sudo[40405]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T04:16:12.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:12 smithi134 sudo[40405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T04:16:12.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:12 smithi134 sudo[40405]: pam_unix(sudo:session): session closed for user root 2024-09-17T04:16:12.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:12 smithi134 ceph-mon[35201]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T04:16:12.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:12 smithi134 ceph-mon[35201]: pgmap v96: 1 pgs: 1 unknown; 0 B data, 89 MiB used, 268 GiB / 268 GiB avail 2024-09-17T04:16:12.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:12 smithi134 ceph-mon[35201]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T04:16:12.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:12 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2024-09-17T04:16:12.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:12 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-09-17T04:16:12.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:12 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2024-09-17T04:16:12.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:12 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-09-17T04:16:13.738 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:13 smithi134 ceph-mon[35201]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T04:16:13.738 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:13 smithi134 ceph-mon[35201]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T04:16:13.738 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:13 smithi134 ceph-mon[35201]: mgrmap e19: smithi088.wmndiv(active, since 2m), standbys: smithi134.vwdxcb 2024-09-17T04:16:13.738 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:13 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:13.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:13 smithi088 ceph-mon[27811]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T04:16:13.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:13 smithi088 ceph-mon[27811]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T04:16:13.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:13 smithi088 ceph-mon[27811]: mgrmap e19: smithi088.wmndiv(active, since 2m), standbys: smithi134.vwdxcb 2024-09-17T04:16:13.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:13 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:14.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:14 smithi134 ceph-mon[35201]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-17T04:16:15.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:14 smithi088 ceph-mon[27811]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-17T04:16:15.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:15 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-17T04:16:15.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:15 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:16:16.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:15 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-17T04:16:16.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:15 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:16:16.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:16 smithi088 ceph-mon[27811]: Deploying daemon osd.3 on smithi134 2024-09-17T04:16:16.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:16 smithi088 ceph-mon[27811]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-17T04:16:16.937 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:16 smithi134 ceph-mon[35201]: Deploying daemon osd.3 on smithi134 2024-09-17T04:16:16.937 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:16 smithi134 ceph-mon[35201]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-17T04:16:19.122 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:18 smithi134 ceph-mon[35201]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-17T04:16:19.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:18 smithi088 ceph-mon[27811]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-17T04:16:20.983 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:20 smithi134 ceph-mon[35201]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-17T04:16:21.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:20 smithi088 ceph-mon[27811]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-17T04:16:22.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:21 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:16:22.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:21 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:16:23.070 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:22 smithi134 ceph-mon[35201]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-17T04:16:23.070 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:22 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:16:23.070 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:22 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:23.070 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:22 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:23.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:22 smithi088 ceph-mon[27811]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-17T04:16:23.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:22 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:16:23.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:22 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:23.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:22 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:25.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:24 smithi088 ceph-mon[27811]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-17T04:16:25.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:24 smithi134 ceph-mon[35201]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-17T04:16:25.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:25.770+0000 7f4e4d7fa640 1 -- 172.21.15.134:0/144767187 <== mgr.14217 v2:172.21.15.88:6800/1666801150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4e500626f0 con 0x7f4e3806e280 2024-09-17T04:16:25.771 INFO:teuthology.orchestra.run.smithi134.stdout:Created osd(s) 3 on host 'smithi134' 2024-09-17T04:16:25.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:25.773+0000 7f4e56559640 1 -- 172.21.15.134:0/144767187 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f4e3806e280 msgr2=0x7f4e38070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:16:25.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:25.773+0000 7f4e56559640 1 --2- 172.21.15.134:0/144767187 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f4e3806e280 0x7f4e38070740 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4e501029c0 tx=0x7f4e4000b390 comp rx=0 tx=0).stop 2024-09-17T04:16:25.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:25.773+0000 7f4e56559640 1 -- 172.21.15.134:0/144767187 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e50102b60 msgr2=0x7f4e501979f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:16:25.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:25.773+0000 7f4e56559640 1 --2- 172.21.15.134:0/144767187 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e50102b60 0x7f4e501979f0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f4e44006010 tx=0x7f4e440046c0 comp rx=0 tx=0).stop 2024-09-17T04:16:25.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:25.773+0000 7f4e56559640 1 -- 172.21.15.134:0/144767187 shutdown_connections 2024-09-17T04:16:25.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:25.773+0000 7f4e56559640 1 --2- 172.21.15.134:0/144767187 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f4e3806e280 0x7f4e38070740 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:16:25.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:25.773+0000 7f4e56559640 1 --2- 172.21.15.134:0/144767187 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e50102b60 0x7f4e501979f0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:16:25.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:25.773+0000 7f4e56559640 1 --2- 172.21.15.134:0/144767187 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e50101960 0x7f4e501974b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:16:25.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:25.773+0000 7f4e56559640 1 -- 172.21.15.134:0/144767187 >> 172.21.15.134:0/144767187 conn(0x7f4e500fd0f0 msgr2=0x7f4e501060c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:16:25.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:25.773+0000 7f4e56559640 1 -- 172.21.15.134:0/144767187 shutdown_connections 2024-09-17T04:16:25.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:25.773+0000 7f4e56559640 1 -- 172.21.15.134:0/144767187 wait complete. 2024-09-17T04:16:26.379 DEBUG:teuthology.orchestra.run.smithi134:osd.3> sudo journalctl -f -n 0 -u ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968@osd.3.service 2024-09-17T04:16:26.381 INFO:tasks.cephadm:Deploying osd.4 on smithi134 with /dev/vg_nvme/lv_3... 2024-09-17T04:16:26.382 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-17T04:16:26.671 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi134/config 2024-09-17T04:16:27.115 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:26 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:27.115 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:26 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:27.115 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:26 smithi134 ceph-mon[35201]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-17T04:16:27.115 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:26 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:27.115 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:26 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:27.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:26 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:27.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:26 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:27.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:26 smithi088 ceph-mon[27811]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-17T04:16:27.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:26 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:27.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:26 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:28.354 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:16:28 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-3[41152]: 2024-09-17T04:16:28.206+0000 7f8533ea2640 -1 osd.3 0 log_to_monitors true 2024-09-17T04:16:28.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:28 smithi134 ceph-mon[35201]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-17T04:16:28.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:28 smithi134 ceph-mon[35201]: from='osd.3 [v2:172.21.15.134:6800/1430236667,v1:172.21.15.134:6801/1430236667]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T04:16:28.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:28 smithi134 ceph-mon[35201]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T04:16:29.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:28 smithi088 ceph-mon[27811]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-17T04:16:29.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:28 smithi088 ceph-mon[27811]: from='osd.3 [v2:172.21.15.134:6800/1430236667,v1:172.21.15.134:6801/1430236667]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T04:16:29.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:28 smithi088 ceph-mon[27811]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T04:16:30.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:29 smithi088 ceph-mon[27811]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-17T04:16:30.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:29 smithi088 ceph-mon[27811]: from='osd.3 [v2:172.21.15.134:6800/1430236667,v1:172.21.15.134:6801/1430236667]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-17T04:16:30.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:29 smithi088 ceph-mon[27811]: osdmap e24: 4 total, 3 up, 4 in 2024-09-17T04:16:30.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:29 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T04:16:30.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:29 smithi088 ceph-mon[27811]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-17T04:16:30.139 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:29 smithi134 ceph-mon[35201]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-17T04:16:30.139 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:29 smithi134 ceph-mon[35201]: from='osd.3 [v2:172.21.15.134:6800/1430236667,v1:172.21.15.134:6801/1430236667]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-17T04:16:30.139 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:29 smithi134 ceph-mon[35201]: osdmap e24: 4 total, 3 up, 4 in 2024-09-17T04:16:30.139 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:29 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T04:16:30.139 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:29 smithi134 ceph-mon[35201]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-17T04:16:30.141 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:16:30.169 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi134:vg_nvme/lv_3 2024-09-17T04:16:30.700 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi134/config 2024-09-17T04:16:30.821 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:16:30 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-3[41152]: 2024-09-17T04:16:30.662+0000 7f8530639640 -1 osd.3 0 waiting for initial osdmap 2024-09-17T04:16:30.821 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:16:30 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-3[41152]: 2024-09-17T04:16:30.669+0000 7f8527c34640 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T04:16:31.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:30 smithi134 ceph-mon[35201]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-17T04:16:31.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:30 smithi134 ceph-mon[35201]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-17T04:16:31.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:30 smithi134 ceph-mon[35201]: osdmap e25: 4 total, 3 up, 4 in 2024-09-17T04:16:31.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:30 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T04:16:31.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:30 smithi134 ceph-mon[35201]: from='osd.3 ' entity='osd.3' 2024-09-17T04:16:31.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:30 smithi134 ceph-mon[35201]: osd.3 [v2:172.21.15.134:6800/1430236667,v1:172.21.15.134:6801/1430236667] boot 2024-09-17T04:16:31.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:30 smithi134 ceph-mon[35201]: osdmap e26: 4 total, 4 up, 4 in 2024-09-17T04:16:31.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:30 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T04:16:31.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:30 smithi088 ceph-mon[27811]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-17T04:16:31.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:30 smithi088 ceph-mon[27811]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-17T04:16:31.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:30 smithi088 ceph-mon[27811]: osdmap e25: 4 total, 3 up, 4 in 2024-09-17T04:16:31.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:30 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T04:16:31.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:30 smithi088 ceph-mon[27811]: from='osd.3 ' entity='osd.3' 2024-09-17T04:16:31.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:30 smithi088 ceph-mon[27811]: osd.3 [v2:172.21.15.134:6800/1430236667,v1:172.21.15.134:6801/1430236667] boot 2024-09-17T04:16:31.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:30 smithi088 ceph-mon[27811]: osdmap e26: 4 total, 4 up, 4 in 2024-09-17T04:16:31.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:30 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T04:16:31.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:31.213+0000 7f2e953e4640 1 -- 172.21.15.134:0/3083300335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e901023f0 msgr2=0x7f2e901047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:16:31.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:31.213+0000 7f2e953e4640 1 --2- 172.21.15.134:0/3083300335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e901023f0 0x7f2e901047e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2e80009880 tx=0x7f2e8002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:16:31.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:31.213+0000 7f2e953e4640 1 -- 172.21.15.134:0/3083300335 shutdown_connections 2024-09-17T04:16:31.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:31.213+0000 7f2e953e4640 1 --2- 172.21.15.134:0/3083300335 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e90104d20 0x7f2e90107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:16:31.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:31.213+0000 7f2e953e4640 1 --2- 172.21.15.134:0/3083300335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e901023f0 0x7f2e901047e0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:16:31.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:31.213+0000 7f2e953e4640 1 -- 172.21.15.134:0/3083300335 >> 172.21.15.134:0/3083300335 conn(0x7f2e900fc010 msgr2=0x7f2e900fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:16:31.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:31.213+0000 7f2e953e4640 1 -- 172.21.15.134:0/3083300335 shutdown_connections 2024-09-17T04:16:31.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:31.213+0000 7f2e953e4640 1 -- 172.21.15.134:0/3083300335 wait complete. 2024-09-17T04:16:31.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:31.214+0000 7f2e953e4640 1 Processor -- start 2024-09-17T04:16:31.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:31.214+0000 7f2e953e4640 1 -- start start 2024-09-17T04:16:31.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:31.214+0000 7f2e953e4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e901023f0 0x7f2e90101ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:16:31.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:31.214+0000 7f2e953e4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e90104d20 0x7f2e901003a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:16:31.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:31.215+0000 7f2e953e4640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f2e9010a830 con 0x7f2e901023f0 2024-09-17T04:16:31.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:31.215+0000 7f2e953e4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2e9010a6b0 con 0x7f2e90104d20 2024-09-17T04:16:31.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:31.215+0000 7f2e8e7fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e90104d20 0x7f2e901003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:16:31.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:31.215+0000 7f2e8e7fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e90104d20 0x7f2e901003a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50852/0 (socket says 172.21.15.134:50852) 2024-09-17T04:16:31.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:31.215+0000 7f2e8e7fc640 1 -- 172.21.15.134:0/3736772605 learned_addr learned my addr 172.21.15.134:0/3736772605 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-17T04:16:31.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:31.215+0000 7f2e8effd640 1 --2- 172.21.15.134:0/3736772605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e901023f0 0x7f2e90101ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:16:31.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:31.215+0000 7f2e8e7fc640 1 -- 172.21.15.134:0/3736772605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e901023f0 msgr2=0x7f2e90101ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:16:31.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:31.215+0000 7f2e8e7fc640 1 --2- 172.21.15.134:0/3736772605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e901023f0 0x7f2e90101ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:16:31.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:31.215+0000 7f2e8e7fc640 1 -- 172.21.15.134:0/3736772605 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e901008e0 con 0x7f2e90104d20 2024-09-17T04:16:31.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:31.215+0000 7f2e8e7fc640 1 --2- 172.21.15.134:0/3736772605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e90104d20 0x7f2e901003a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2e8400b3d0 tx=0x7f2e8400b890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:16:31.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:31.215+0000 7f2e77fff640 1 -- 172.21.15.134:0/3736772605 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2e84015020 con 0x7f2e90104d20 2024-09-17T04:16:31.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:31.215+0000 7f2e953e4640 1 -- 172.21.15.134:0/3736772605 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e90100bd0 con 0x7f2e90104d20 2024-09-17T04:16:31.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:31.215+0000 7f2e953e4640 1 -- 172.21.15.134:0/3736772605 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e901011e0 con 0x7f2e90104d20 2024-09-17T04:16:31.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:31.215+0000 7f2e77fff640 1 -- 172.21.15.134:0/3736772605 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2e84011af0 con 0x7f2e90104d20 2024-09-17T04:16:31.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:31.215+0000 7f2e77fff640 1 -- 172.21.15.134:0/3736772605 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2e8401ab50 con 0x7f2e90104d20 2024-09-17T04:16:31.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:31.217+0000 7f2e953e4640 1 -- 172.21.15.134:0/3736772605 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e7c0052c0 con 0x7f2e90104d20 2024-09-17T04:16:31.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:31.217+0000 7f2e77fff640 1 -- 172.21.15.134:0/3736772605 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f2e84018020 con 0x7f2e90104d20 2024-09-17T04:16:31.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:31.217+0000 7f2e77fff640 1 --2- 172.21.15.134:0/3736772605 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f2e7806e2b0 0x7f2e78070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:16:31.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:31.218+0000 7f2e77fff640 1 -- 172.21.15.134:0/3736772605 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 3807+0+0 (secure 0 0 0) 0x7f2e8408d2e0 con 0x7f2e90104d20 2024-09-17T04:16:31.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:31.218+0000 7f2e8effd640 1 --2- 172.21.15.134:0/3736772605 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f2e7806e2b0 0x7f2e78070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:16:31.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:31.218+0000 7f2e8effd640 1 --2- 172.21.15.134:0/3736772605 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f2e7806e2b0 0x7f2e78070770 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2e80000c00 tx=0x7f2e80004f30 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:16:31.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:31.222+0000 7f2e77fff640 1 -- 172.21.15.134:0/3736772605 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2e8401f020 con 0x7f2e90104d20 2024-09-17T04:16:31.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:31.413+0000 7f2e953e4640 1 -- 172.21.15.134:0/3736772605 --> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f2e7c000bf0 con 0x7f2e7806e2b0 2024-09-17T04:16:31.982 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:31 smithi134 ceph-mon[35201]: purged_snaps scrub starts 2024-09-17T04:16:31.983 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:31 smithi134 ceph-mon[35201]: purged_snaps scrub ok 2024-09-17T04:16:31.983 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:31 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T04:16:31.983 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:31 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T04:16:31.983 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:31 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:16:31.983 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:31 smithi134 ceph-mon[35201]: osdmap e27: 4 total, 4 up, 4 in 2024-09-17T04:16:32.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:31 smithi088 ceph-mon[27811]: purged_snaps scrub starts 2024-09-17T04:16:32.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:31 smithi088 ceph-mon[27811]: purged_snaps scrub ok 2024-09-17T04:16:32.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:31 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T04:16:32.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:31 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T04:16:32.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:31 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:16:32.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:31 smithi088 ceph-mon[27811]: osdmap e27: 4 total, 4 up, 4 in 2024-09-17T04:16:33.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:32 smithi088 ceph-mon[27811]: from='client.24187 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:16:33.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:32 smithi088 ceph-mon[27811]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 516 MiB used, 357 GiB / 358 GiB avail 2024-09-17T04:16:33.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:32 smithi088 ceph-mon[27811]: Detected new or changed devices on smithi134 2024-09-17T04:16:33.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:32 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:33.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:32 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:33.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:32 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T04:16:33.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:32 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:33.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:32 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:16:33.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:32 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:16:33.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:32 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:33.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:32 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:16:33.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:32 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:16:33.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:32 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:16:33.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:32 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:33.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:32 smithi088 ceph-mon[27811]: osdmap e28: 4 total, 4 up, 4 in 2024-09-17T04:16:33.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:32 smithi134 ceph-mon[35201]: from='client.24187 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:16:33.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:32 smithi134 ceph-mon[35201]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 516 MiB used, 357 GiB / 358 GiB avail 2024-09-17T04:16:33.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:32 smithi134 ceph-mon[35201]: Detected new or changed devices on smithi134 2024-09-17T04:16:33.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:32 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:33.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:32 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:33.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:32 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T04:16:33.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:32 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:33.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:32 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:16:33.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:32 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:16:33.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:32 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:33.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:32 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:16:33.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:32 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:16:33.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:32 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:16:33.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:32 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:33.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:32 smithi134 ceph-mon[35201]: osdmap e28: 4 total, 4 up, 4 in 2024-09-17T04:16:34.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:33 smithi088 ceph-mon[27811]: Adjusting osd_memory_target on smithi134 to 14912M 2024-09-17T04:16:34.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:33 smithi088 ceph-mon[27811]: osdmap e29: 4 total, 4 up, 4 in 2024-09-17T04:16:34.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:33 smithi134 ceph-mon[35201]: Adjusting osd_memory_target on smithi134 to 14912M 2024-09-17T04:16:34.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:33 smithi134 ceph-mon[35201]: osdmap e29: 4 total, 4 up, 4 in 2024-09-17T04:16:35.095 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:34 smithi134 ceph-mon[35201]: pgmap v112: 1 pgs: 1 remapped+peering; 577 KiB data, 516 MiB used, 357 GiB / 358 GiB avail 2024-09-17T04:16:35.095 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:34 smithi134 ceph-mon[35201]: from='client.? 172.21.15.134:0/2780054523' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "33c07ebe-d45d-478f-b8a9-991d462568f7"}]: dispatch 2024-09-17T04:16:35.095 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:34 smithi134 ceph-mon[35201]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "33c07ebe-d45d-478f-b8a9-991d462568f7"}]: dispatch 2024-09-17T04:16:35.095 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:34 smithi134 ceph-mon[35201]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "33c07ebe-d45d-478f-b8a9-991d462568f7"}]': finished 2024-09-17T04:16:35.096 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:34 smithi134 ceph-mon[35201]: osdmap e30: 5 total, 4 up, 5 in 2024-09-17T04:16:35.096 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:34 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T04:16:35.096 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:34 smithi134 ceph-mon[35201]: from='client.? 172.21.15.134:0/2692246412' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T04:16:35.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:34 smithi088 ceph-mon[27811]: pgmap v112: 1 pgs: 1 remapped+peering; 577 KiB data, 516 MiB used, 357 GiB / 358 GiB avail 2024-09-17T04:16:35.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:34 smithi088 ceph-mon[27811]: from='client.? 172.21.15.134:0/2780054523' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "33c07ebe-d45d-478f-b8a9-991d462568f7"}]: dispatch 2024-09-17T04:16:35.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:34 smithi088 ceph-mon[27811]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "33c07ebe-d45d-478f-b8a9-991d462568f7"}]: dispatch 2024-09-17T04:16:35.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:34 smithi088 ceph-mon[27811]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "33c07ebe-d45d-478f-b8a9-991d462568f7"}]': finished 2024-09-17T04:16:35.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:34 smithi088 ceph-mon[27811]: osdmap e30: 5 total, 4 up, 5 in 2024-09-17T04:16:35.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:34 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T04:16:35.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:34 smithi088 ceph-mon[27811]: from='client.? 172.21.15.134:0/2692246412' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T04:16:37.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:36 smithi088 ceph-mon[27811]: pgmap v115: 1 pgs: 1 remapped+peering; 577 KiB data, 516 MiB used, 357 GiB / 358 GiB avail 2024-09-17T04:16:37.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:36 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:16:37.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:36 smithi134 ceph-mon[35201]: pgmap v115: 1 pgs: 1 remapped+peering; 577 KiB data, 516 MiB used, 357 GiB / 358 GiB avail 2024-09-17T04:16:37.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:36 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:16:39.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:38 smithi088 ceph-mon[27811]: pgmap v116: 1 pgs: 1 remapped+peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-17T04:16:39.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:38 smithi134 ceph-mon[35201]: pgmap v116: 1 pgs: 1 remapped+peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-17T04:16:40.986 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:40 smithi134 ceph-mon[35201]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-17T04:16:41.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:40 smithi088 ceph-mon[27811]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-17T04:16:43.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:42 smithi134 ceph-mon[35201]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-17T04:16:43.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:42 smithi088 ceph-mon[27811]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-17T04:16:43.999 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:43 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-17T04:16:43.999 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:43 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:16:43.999 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:43 smithi134 ceph-mon[35201]: Deploying daemon osd.4 on smithi134 2024-09-17T04:16:44.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:43 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-17T04:16:44.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:43 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:16:44.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:43 smithi088 ceph-mon[27811]: Deploying daemon osd.4 on smithi134 2024-09-17T04:16:45.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:44 smithi134 ceph-mon[35201]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-17T04:16:45.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:44 smithi088 ceph-mon[27811]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-17T04:16:47.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:46 smithi088 ceph-mon[27811]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-17T04:16:47.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:46 smithi134 ceph-mon[35201]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-17T04:16:49.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:48 smithi088 ceph-mon[27811]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-17T04:16:49.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:48 smithi134 ceph-mon[35201]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-17T04:16:50.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:49 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:16:50.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:49 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:50.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:49 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:50.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:49 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:16:50.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:49 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:50.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:49 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:51.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:50 smithi088 ceph-mon[27811]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-17T04:16:51.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:50 smithi134 ceph-mon[35201]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-17T04:16:52.036 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:51 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:16:52.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:51 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:16:52.985 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:52 smithi134 ceph-mon[35201]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-17T04:16:53.026 INFO:teuthology.orchestra.run.smithi134.stdout:Created osd(s) 4 on host 'smithi134' 2024-09-17T04:16:53.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:53.025+0000 7f2e77fff640 1 -- 172.21.15.134:0/3736772605 <== mgr.14217 v2:172.21.15.88:6800/1666801150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2e7c000bf0 con 0x7f2e7806e2b0 2024-09-17T04:16:53.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:53.028+0000 7f2e953e4640 1 -- 172.21.15.134:0/3736772605 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f2e7806e2b0 msgr2=0x7f2e78070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:16:53.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:53.028+0000 7f2e953e4640 1 --2- 172.21.15.134:0/3736772605 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f2e7806e2b0 0x7f2e78070770 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2e80000c00 tx=0x7f2e80004f30 comp rx=0 tx=0).stop 2024-09-17T04:16:53.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:53.028+0000 7f2e953e4640 1 -- 172.21.15.134:0/3736772605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e90104d20 msgr2=0x7f2e901003a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:16:53.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:53.028+0000 7f2e953e4640 1 --2- 172.21.15.134:0/3736772605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e90104d20 0x7f2e901003a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2e8400b3d0 tx=0x7f2e8400b890 comp rx=0 tx=0).stop 2024-09-17T04:16:53.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:53.028+0000 7f2e953e4640 1 -- 172.21.15.134:0/3736772605 shutdown_connections 2024-09-17T04:16:53.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:53.028+0000 7f2e953e4640 1 --2- 172.21.15.134:0/3736772605 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f2e7806e2b0 0x7f2e78070770 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:16:53.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:53.028+0000 7f2e953e4640 1 --2- 172.21.15.134:0/3736772605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e90104d20 0x7f2e901003a0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:16:53.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:53.028+0000 7f2e953e4640 1 --2- 172.21.15.134:0/3736772605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e901023f0 0x7f2e90101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:16:53.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:53.028+0000 7f2e953e4640 1 -- 172.21.15.134:0/3736772605 >> 172.21.15.134:0/3736772605 conn(0x7f2e900fc010 msgr2=0x7f2e900fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:16:53.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:53.028+0000 7f2e953e4640 1 -- 172.21.15.134:0/3736772605 shutdown_connections 2024-09-17T04:16:53.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:53.028+0000 7f2e953e4640 1 -- 172.21.15.134:0/3736772605 wait complete. 2024-09-17T04:16:53.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:52 smithi088 ceph-mon[27811]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-17T04:16:53.656 DEBUG:teuthology.orchestra.run.smithi134:osd.4> sudo journalctl -f -n 0 -u ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968@osd.4.service 2024-09-17T04:16:53.659 INFO:tasks.cephadm:Deploying osd.5 on smithi134 with /dev/vg_nvme/lv_2... 2024-09-17T04:16:53.659 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-17T04:16:53.957 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi134/config 2024-09-17T04:16:54.291 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:54 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:54.291 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:54 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:54.292 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:54 smithi134 ceph-mon[35201]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-17T04:16:54.292 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:54 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:54.292 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:54 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:54.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:54 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:54.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:54 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:54.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:54 smithi088 ceph-mon[27811]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-17T04:16:54.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:54 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:54.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:54 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:55.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:55 smithi088 ceph-mon[27811]: from='osd.4 [v2:172.21.15.134:6808/764689261,v1:172.21.15.134:6809/764689261]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T04:16:55.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:55 smithi088 ceph-mon[27811]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T04:16:55.645 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:55 smithi134 ceph-mon[35201]: from='osd.4 [v2:172.21.15.134:6808/764689261,v1:172.21.15.134:6809/764689261]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T04:16:55.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:55 smithi134 ceph-mon[35201]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T04:16:55.646 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:16:55 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4[48024]: 2024-09-17T04:16:55.295+0000 7f0e713cc640 -1 osd.4 0 log_to_monitors true 2024-09-17T04:16:56.597 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:16:56 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4[48024]: 2024-09-17T04:16:56.358+0000 7f0e6cb2c640 -1 osd.4 0 waiting for initial osdmap 2024-09-17T04:16:56.597 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:16:56 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4[48024]: 2024-09-17T04:16:56.366+0000 7f0e69166640 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T04:16:56.597 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:56 smithi134 ceph-mon[35201]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-17T04:16:56.597 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:56 smithi134 ceph-mon[35201]: from='osd.4 [v2:172.21.15.134:6808/764689261,v1:172.21.15.134:6809/764689261]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-17T04:16:56.597 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:56 smithi134 ceph-mon[35201]: osdmap e31: 5 total, 4 up, 5 in 2024-09-17T04:16:56.597 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:56 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T04:16:56.598 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:56 smithi134 ceph-mon[35201]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-17T04:16:56.598 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:56 smithi134 ceph-mon[35201]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-17T04:16:56.598 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:56 smithi134 ceph-mon[35201]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-17T04:16:56.598 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:56 smithi134 ceph-mon[35201]: osdmap e32: 5 total, 4 up, 5 in 2024-09-17T04:16:56.598 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:56 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T04:16:56.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:56 smithi088 ceph-mon[27811]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-17T04:16:56.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:56 smithi088 ceph-mon[27811]: from='osd.4 [v2:172.21.15.134:6808/764689261,v1:172.21.15.134:6809/764689261]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-17T04:16:56.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:56 smithi088 ceph-mon[27811]: osdmap e31: 5 total, 4 up, 5 in 2024-09-17T04:16:56.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:56 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T04:16:56.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:56 smithi088 ceph-mon[27811]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-17T04:16:56.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:56 smithi088 ceph-mon[27811]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-17T04:16:56.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:56 smithi088 ceph-mon[27811]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-17T04:16:56.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:56 smithi088 ceph-mon[27811]: osdmap e32: 5 total, 4 up, 5 in 2024-09-17T04:16:56.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:56 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T04:16:56.867 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T04:16:56.895 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi134:vg_nvme/lv_2 2024-09-17T04:16:57.608 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:57 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T04:16:57.608 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:57 smithi134 ceph-mon[35201]: osd.4 [v2:172.21.15.134:6808/764689261,v1:172.21.15.134:6809/764689261] boot 2024-09-17T04:16:57.608 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:57 smithi134 ceph-mon[35201]: osdmap e33: 5 total, 5 up, 5 in 2024-09-17T04:16:57.609 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:57 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T04:16:57.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:57 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T04:16:57.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:57 smithi088 ceph-mon[27811]: osd.4 [v2:172.21.15.134:6808/764689261,v1:172.21.15.134:6809/764689261] boot 2024-09-17T04:16:57.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:57 smithi088 ceph-mon[27811]: osdmap e33: 5 total, 5 up, 5 in 2024-09-17T04:16:57.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:57 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T04:16:57.857 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi134/config 2024-09-17T04:16:58.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:58.376+0000 7f5947b71640 1 -- 172.21.15.134:0/4040520737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5940100b20 msgr2=0x7f5940100fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:16:58.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:58.376+0000 7f5947b71640 1 --2- 172.21.15.134:0/4040520737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5940100b20 0x7f5940100fa0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5934009c20 tx=0x7f593402a970 comp rx=0 tx=0).stop 2024-09-17T04:16:58.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:58.376+0000 7f5947b71640 1 -- 172.21.15.134:0/4040520737 shutdown_connections 2024-09-17T04:16:58.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:58.376+0000 7f5947b71640 1 --2- 172.21.15.134:0/4040520737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5940100b20 0x7f5940100fa0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:16:58.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:58.376+0000 7f5947b71640 1 --2- 172.21.15.134:0/4040520737 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5940101de0 0x7f59401021e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:16:58.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:58.376+0000 7f5947b71640 1 -- 172.21.15.134:0/4040520737 >> 172.21.15.134:0/4040520737 conn(0x7f59400fb760 msgr2=0x7f59400fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:16:58.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:58.376+0000 7f5947b71640 1 -- 172.21.15.134:0/4040520737 shutdown_connections 2024-09-17T04:16:58.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:58.376+0000 7f5947b71640 1 -- 172.21.15.134:0/4040520737 wait complete. 2024-09-17T04:16:58.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:58.377+0000 7f5947b71640 1 Processor -- start 2024-09-17T04:16:58.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:58.377+0000 7f5947b71640 1 -- start start 2024-09-17T04:16:58.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:58.377+0000 7f5947b71640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5940100b20 0x7f5940100500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:16:58.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:58.377+0000 7f5947b71640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5940101de0 0x7f594019c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:16:58.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:58.377+0000 7f5947b71640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f5940109690 con 0x7f5940101de0 2024-09-17T04:16:58.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:58.377+0000 7f5947b71640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5940109510 con 0x7f5940100b20 2024-09-17T04:16:58.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:58.377+0000 7f594590d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5940100b20 0x7f5940100500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:16:58.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:58.377+0000 7f594590d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5940100b20 0x7f5940100500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53080/0 (socket says 172.21.15.134:53080) 2024-09-17T04:16:58.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:58.377+0000 7f594590d640 1 -- 172.21.15.134:0/4257425593 learned_addr learned my addr 172.21.15.134:0/4257425593 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-17T04:16:58.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:58.377+0000 7f594510c640 1 --2- 172.21.15.134:0/4257425593 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5940101de0 0x7f594019c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:16:58.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:58.377+0000 7f594590d640 1 -- 172.21.15.134:0/4257425593 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5940101de0 msgr2=0x7f594019c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:16:58.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:58.377+0000 7f594590d640 1 --2- 172.21.15.134:0/4257425593 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5940101de0 0x7f594019c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:16:58.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:58.377+0000 7f594590d640 1 -- 172.21.15.134:0/4257425593 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f594019c7c0 con 0x7f5940100b20 2024-09-17T04:16:58.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:58.377+0000 7f594510c640 1 --2- 172.21.15.134:0/4257425593 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5940101de0 0x7f594019c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:16:58.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:58.378+0000 7f594590d640 1 --2- 172.21.15.134:0/4257425593 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5940100b20 0x7f5940100500 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f593800e970 tx=0x7f593800ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:16:58.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:58.378+0000 7f593effd640 1 -- 172.21.15.134:0/4257425593 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f593800cac0 con 0x7f5940100b20 2024-09-17T04:16:58.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:58.378+0000 7f5947b71640 1 -- 172.21.15.134:0/4257425593 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f594019cab0 con 0x7f5940100b20 2024-09-17T04:16:58.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:58.378+0000 7f5947b71640 1 -- 172.21.15.134:0/4257425593 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f594019d040 con 0x7f5940100b20 2024-09-17T04:16:58.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:58.378+0000 7f593effd640 1 -- 172.21.15.134:0/4257425593 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f593800cc60 con 0x7f5940100b20 2024-09-17T04:16:58.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:58.378+0000 7f593effd640 1 -- 172.21.15.134:0/4257425593 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5938003b70 con 0x7f5940100b20 2024-09-17T04:16:58.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:58.379+0000 7f593cff9640 1 -- 172.21.15.134:0/4257425593 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5940100fa0 con 0x7f5940100b20 2024-09-17T04:16:58.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:58.379+0000 7f593effd640 1 -- 172.21.15.134:0/4257425593 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f5938003e20 con 0x7f5940100b20 2024-09-17T04:16:58.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:58.380+0000 7f593effd640 1 --2- 172.21.15.134:0/4257425593 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f592806e2b0 0x7f5928070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:16:58.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:58.380+0000 7f593effd640 1 -- 172.21.15.134:0/4257425593 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4206+0+0 (secure 0 0 0) 0x7f593808e150 con 0x7f5940100b20 2024-09-17T04:16:58.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:58.380+0000 7f594510c640 1 --2- 172.21.15.134:0/4257425593 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f592806e2b0 0x7f5928070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:16:58.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:58.381+0000 7f594510c640 1 --2- 172.21.15.134:0/4257425593 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f592806e2b0 0x7f5928070770 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5934006010 tx=0x7f59340093f0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:16:58.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:58.386+0000 7f593effd640 1 -- 172.21.15.134:0/4257425593 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f593805bf10 con 0x7f5940100b20 2024-09-17T04:16:58.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:16:58.564+0000 7f593cff9640 1 -- 172.21.15.134:0/4257425593 --> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f59400631e0 con 0x7f592806e2b0 2024-09-17T04:16:58.565 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:58 smithi134 ceph-mon[35201]: purged_snaps scrub starts 2024-09-17T04:16:58.565 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:58 smithi134 ceph-mon[35201]: purged_snaps scrub ok 2024-09-17T04:16:58.565 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:58 smithi134 ceph-mon[35201]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T04:16:58.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:58 smithi088 ceph-mon[27811]: purged_snaps scrub starts 2024-09-17T04:16:58.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:58 smithi088 ceph-mon[27811]: purged_snaps scrub ok 2024-09-17T04:16:58.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:58 smithi088 ceph-mon[27811]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T04:16:59.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:59 smithi088 ceph-mon[27811]: osdmap e34: 5 total, 5 up, 5 in 2024-09-17T04:16:59.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:59 smithi088 ceph-mon[27811]: from='client.24205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:16:59.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:59 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T04:16:59.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:59 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T04:16:59.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:59 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:16:59.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:59 smithi088 ceph-mon[27811]: Detected new or changed devices on smithi134 2024-09-17T04:16:59.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:59 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:59.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:59 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:59.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:59 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T04:16:59.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:59 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T04:16:59.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:59 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:59.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:59 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:16:59.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:59 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:16:59.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:59 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:59.639 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:16:59 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:16:59.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:59 smithi134 ceph-mon[35201]: osdmap e34: 5 total, 5 up, 5 in 2024-09-17T04:16:59.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:59 smithi134 ceph-mon[35201]: from='client.24205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:16:59.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:59 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T04:16:59.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:59 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T04:16:59.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:59 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:16:59.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:59 smithi134 ceph-mon[35201]: Detected new or changed devices on smithi134 2024-09-17T04:16:59.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:59 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:59.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:59 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:59.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:59 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T04:16:59.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:59 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T04:16:59.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:59 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:59.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:59 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:16:59.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:59 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:16:59.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:59 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:16:59.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:16:59 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:17:00.390 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:00 smithi134 ceph-mon[35201]: Adjusting osd_memory_target on smithi134 to 7456M 2024-09-17T04:17:00.390 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:00 smithi134 ceph-mon[35201]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T04:17:00.390 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:00 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:17:00.390 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:00 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:17:00.390 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:00 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:17:00.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:00 smithi088 ceph-mon[27811]: Adjusting osd_memory_target on smithi134 to 7456M 2024-09-17T04:17:00.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:00 smithi088 ceph-mon[27811]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T04:17:00.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:00 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:17:00.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:00 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:17:00.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:00 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:17:01.636 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:01 smithi134 ceph-mon[35201]: from='client.? 172.21.15.134:0/335140605' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7ef9ab40-b3dd-4208-a3c3-1dc86dd74239"}]: dispatch 2024-09-17T04:17:01.636 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:01 smithi134 ceph-mon[35201]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7ef9ab40-b3dd-4208-a3c3-1dc86dd74239"}]: dispatch 2024-09-17T04:17:01.636 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:01 smithi134 ceph-mon[35201]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7ef9ab40-b3dd-4208-a3c3-1dc86dd74239"}]': finished 2024-09-17T04:17:01.636 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:01 smithi134 ceph-mon[35201]: osdmap e35: 6 total, 5 up, 6 in 2024-09-17T04:17:01.636 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:01 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T04:17:01.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:01 smithi088 ceph-mon[27811]: from='client.? 172.21.15.134:0/335140605' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7ef9ab40-b3dd-4208-a3c3-1dc86dd74239"}]: dispatch 2024-09-17T04:17:01.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:01 smithi088 ceph-mon[27811]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7ef9ab40-b3dd-4208-a3c3-1dc86dd74239"}]: dispatch 2024-09-17T04:17:01.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:01 smithi088 ceph-mon[27811]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7ef9ab40-b3dd-4208-a3c3-1dc86dd74239"}]': finished 2024-09-17T04:17:01.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:01 smithi088 ceph-mon[27811]: osdmap e35: 6 total, 5 up, 6 in 2024-09-17T04:17:01.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:01 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T04:17:02.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:02 smithi088 ceph-mon[27811]: from='client.? 172.21.15.134:0/3499653942' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T04:17:02.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:02 smithi088 ceph-mon[27811]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T04:17:02.645 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:02 smithi134 ceph-mon[35201]: from='client.? 172.21.15.134:0/3499653942' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T04:17:02.645 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:02 smithi134 ceph-mon[35201]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T04:17:05.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:04 smithi088 ceph-mon[27811]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T04:17:05.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:04 smithi134 ceph-mon[35201]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T04:17:07.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:06 smithi088 ceph-mon[27811]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T04:17:07.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:06 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:17:07.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:06 smithi134 ceph-mon[35201]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T04:17:07.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:06 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:17:09.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:08 smithi088 ceph-mon[27811]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T04:17:09.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:08 smithi134 ceph-mon[35201]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T04:17:10.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:09 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-17T04:17:10.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:09 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:17:10.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:09 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-17T04:17:10.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:09 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:17:11.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:10 smithi088 ceph-mon[27811]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T04:17:11.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:10 smithi088 ceph-mon[27811]: Deploying daemon osd.5 on smithi134 2024-09-17T04:17:11.141 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:10 smithi134 ceph-mon[35201]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T04:17:11.142 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:10 smithi134 ceph-mon[35201]: Deploying daemon osd.5 on smithi134 2024-09-17T04:17:13.117 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:12 smithi134 ceph-mon[35201]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T04:17:13.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:12 smithi088 ceph-mon[27811]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T04:17:15.081 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:14 smithi134 ceph-mon[35201]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T04:17:15.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:14 smithi088 ceph-mon[27811]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T04:17:16.132 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:15 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:17:16.132 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:15 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:17:16.132 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:15 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:17:16.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:15 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:17:16.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:15 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:17:16.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:15 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:17:17.089 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:16 smithi134 ceph-mon[35201]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T04:17:17.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:16 smithi088 ceph-mon[27811]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T04:17:18.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:18 smithi134 ceph-mon[35201]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T04:17:19.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:18 smithi088 ceph-mon[27811]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T04:17:19.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:19.765+0000 7f593effd640 1 -- 172.21.15.134:0/4257425593 <== mgr.14217 v2:172.21.15.88:6800/1666801150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f59400631e0 con 0x7f592806e2b0 2024-09-17T04:17:19.766 INFO:teuthology.orchestra.run.smithi134.stdout:Created osd(s) 5 on host 'smithi134' 2024-09-17T04:17:19.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:19.767+0000 7f593cff9640 1 -- 172.21.15.134:0/4257425593 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f592806e2b0 msgr2=0x7f5928070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:19.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:19.767+0000 7f593cff9640 1 --2- 172.21.15.134:0/4257425593 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f592806e2b0 0x7f5928070770 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5934006010 tx=0x7f59340093f0 comp rx=0 tx=0).stop 2024-09-17T04:17:19.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:19.767+0000 7f593cff9640 1 -- 172.21.15.134:0/4257425593 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5940100b20 msgr2=0x7f5940100500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:19.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:19.767+0000 7f593cff9640 1 --2- 172.21.15.134:0/4257425593 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5940100b20 0x7f5940100500 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f593800e970 tx=0x7f593800ee30 comp rx=0 tx=0).stop 2024-09-17T04:17:19.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:19.767+0000 7f593cff9640 1 -- 172.21.15.134:0/4257425593 shutdown_connections 2024-09-17T04:17:19.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:19.767+0000 7f593cff9640 1 --2- 172.21.15.134:0/4257425593 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f592806e2b0 0x7f5928070770 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:19.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:19.767+0000 7f593cff9640 1 --2- 172.21.15.134:0/4257425593 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5940101de0 0x7f594019c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:19.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:19.767+0000 7f593cff9640 1 --2- 172.21.15.134:0/4257425593 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5940100b20 0x7f5940100500 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:19.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:19.767+0000 7f593cff9640 1 -- 172.21.15.134:0/4257425593 >> 172.21.15.134:0/4257425593 conn(0x7f59400fb760 msgr2=0x7f5940104f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:19.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:19.767+0000 7f593cff9640 1 -- 172.21.15.134:0/4257425593 shutdown_connections 2024-09-17T04:17:19.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:19.767+0000 7f593cff9640 1 -- 172.21.15.134:0/4257425593 wait complete. 2024-09-17T04:17:20.419 DEBUG:teuthology.orchestra.run.smithi134:osd.5> sudo journalctl -f -n 0 -u ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968@osd.5.service 2024-09-17T04:17:20.421 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-09-17T04:17:20.421 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-17T04:17:20.696 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:17:21.022 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:20 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:17:21.023 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:20 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:17:21.023 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:20 smithi134 ceph-mon[35201]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T04:17:21.023 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:20 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:17:21.023 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:20 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:17:21.031 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:20 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:17:21.031 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:20 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:17:21.031 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:20 smithi088 ceph-mon[27811]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T04:17:21.031 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:20 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:17:21.031 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:20 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:17:21.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:21.196+0000 7fd8637df640 1 -- 172.21.15.88:0/3631221366 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd85c102b60 msgr2=0x7fd85c102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:21.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:21.196+0000 7fd8637df640 1 --2- 172.21.15.88:0/3631221366 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd85c102b60 0x7fd85c102fe0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd84c009880 tx=0x7fd84c02a4a0 comp rx=0 tx=0).stop 2024-09-17T04:17:21.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:21.196+0000 7fd8637df640 1 -- 172.21.15.88:0/3631221366 shutdown_connections 2024-09-17T04:17:21.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:21.196+0000 7fd8637df640 1 --2- 172.21.15.88:0/3631221366 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd85c102b60 0x7fd85c102fe0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:21.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:21.196+0000 7fd8637df640 1 --2- 172.21.15.88:0/3631221366 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd85c101960 0x7fd85c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:21.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:21.196+0000 7fd8637df640 1 -- 172.21.15.88:0/3631221366 >> 172.21.15.88:0/3631221366 conn(0x7fd85c0fd0f0 msgr2=0x7fd85c0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:21.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:21.196+0000 7fd8637df640 1 -- 172.21.15.88:0/3631221366 shutdown_connections 2024-09-17T04:17:21.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:21.196+0000 7fd8637df640 1 -- 172.21.15.88:0/3631221366 wait complete. 2024-09-17T04:17:21.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:21.197+0000 7fd8637df640 1 Processor -- start 2024-09-17T04:17:21.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:21.197+0000 7fd8637df640 1 -- start start 2024-09-17T04:17:21.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:21.197+0000 7fd8637df640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd85c101960 0x7fd85c197470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:21.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:21.197+0000 7fd8637df640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd85c102b60 0x7fd85c1979b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:21.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:21.197+0000 7fd8637df640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fd85c10a780 con 0x7fd85c102b60 2024-09-17T04:17:21.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:21.197+0000 7fd8637df640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd85c10a600 con 0x7fd85c101960 2024-09-17T04:17:21.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:21.197+0000 7fd860d7a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd85c102b60 0x7fd85c1979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:21.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:21.197+0000 7fd860d7a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd85c102b60 0x7fd85c1979b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33662/0 (socket says 172.21.15.88:33662) 2024-09-17T04:17:21.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:21.197+0000 7fd860d7a640 1 -- 172.21.15.88:0/4045513106 learned_addr learned my addr 172.21.15.88:0/4045513106 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:17:21.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:21.197+0000 7fd86157b640 1 --2- 172.21.15.88:0/4045513106 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd85c101960 0x7fd85c197470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:21.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:21.197+0000 7fd860d7a640 1 -- 172.21.15.88:0/4045513106 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd85c101960 msgr2=0x7fd85c197470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:21.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:21.197+0000 7fd860d7a640 1 --2- 172.21.15.88:0/4045513106 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd85c101960 0x7fd85c197470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:21.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:21.197+0000 7fd860d7a640 1 -- 172.21.15.88:0/4045513106 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd85c197fa0 con 0x7fd85c102b60 2024-09-17T04:17:21.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:21.197+0000 7fd86157b640 1 --2- 172.21.15.88:0/4045513106 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd85c101960 0x7fd85c197470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:17:21.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:21.198+0000 7fd860d7a640 1 --2- 172.21.15.88:0/4045513106 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd85c102b60 0x7fd85c1979b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd84c006010 tx=0x7fd84c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:21.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:21.198+0000 7fd8527fc640 1 -- 172.21.15.88:0/4045513106 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd84c03f070 con 0x7fd85c102b60 2024-09-17T04:17:21.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:21.198+0000 7fd8527fc640 1 -- 172.21.15.88:0/4045513106 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd84c0044d0 con 0x7fd85c102b60 2024-09-17T04:17:21.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:21.198+0000 7fd8527fc640 1 -- 172.21.15.88:0/4045513106 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd84c035030 con 0x7fd85c102b60 2024-09-17T04:17:21.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:21.198+0000 7fd8637df640 1 -- 172.21.15.88:0/4045513106 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd85c19c9b0 con 0x7fd85c102b60 2024-09-17T04:17:21.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:21.198+0000 7fd8637df640 1 -- 172.21.15.88:0/4045513106 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd85c19ceb0 con 0x7fd85c102b60 2024-09-17T04:17:21.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:21.199+0000 7fd8637df640 1 -- 172.21.15.88:0/4045513106 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd85c101d60 con 0x7fd85c102b60 2024-09-17T04:17:21.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:21.199+0000 7fd8527fc640 1 -- 172.21.15.88:0/4045513106 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fd84c042070 con 0x7fd85c102b60 2024-09-17T04:17:21.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:21.200+0000 7fd8527fc640 1 --2- 172.21.15.88:0/4045513106 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fd84806e310 0x7fd8480707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:21.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:21.200+0000 7fd8527fc640 1 -- 172.21.15.88:0/4045513106 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4321+0+0 (secure 0 0 0) 0x7fd84c0ae980 con 0x7fd85c102b60 2024-09-17T04:17:21.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:21.200+0000 7fd86157b640 1 --2- 172.21.15.88:0/4045513106 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fd84806e310 0x7fd8480707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:21.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:21.200+0000 7fd86157b640 1 --2- 172.21.15.88:0/4045513106 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fd84806e310 0x7fd8480707d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd85c1029c0 tx=0x7fd85800a5e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:21.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:21.205+0000 7fd8527fc640 1 -- 172.21.15.88:0/4045513106 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd84c07c7d0 con 0x7fd85c102b60 2024-09-17T04:17:21.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:21.372+0000 7fd8637df640 1 -- 172.21.15.88:0/4045513106 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fd85c062df0 con 0x7fd85c102b60 2024-09-17T04:17:21.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:21.372+0000 7fd8527fc640 1 -- 172.21.15.88:0/4045513106 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v35) ==== 74+0+130 (secure 0 0 0) 0x7fd84c080480 con 0x7fd85c102b60 2024-09-17T04:17:21.372 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:17:21.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:21.374+0000 7fd8637df640 1 -- 172.21.15.88:0/4045513106 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fd84806e310 msgr2=0x7fd8480707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:21.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:21.374+0000 7fd8637df640 1 --2- 172.21.15.88:0/4045513106 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fd84806e310 0x7fd8480707d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd85c1029c0 tx=0x7fd85800a5e0 comp rx=0 tx=0).stop 2024-09-17T04:17:21.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:21.374+0000 7fd8637df640 1 -- 172.21.15.88:0/4045513106 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd85c102b60 msgr2=0x7fd85c1979b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:21.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:21.374+0000 7fd8637df640 1 --2- 172.21.15.88:0/4045513106 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd85c102b60 0x7fd85c1979b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd84c006010 tx=0x7fd84c0048f0 comp rx=0 tx=0).stop 2024-09-17T04:17:21.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:21.375+0000 7fd8637df640 1 -- 172.21.15.88:0/4045513106 shutdown_connections 2024-09-17T04:17:21.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:21.375+0000 7fd8637df640 1 --2- 172.21.15.88:0/4045513106 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fd84806e310 0x7fd8480707d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:21.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:21.375+0000 7fd8637df640 1 --2- 172.21.15.88:0/4045513106 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd85c102b60 0x7fd85c1979b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:21.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:21.375+0000 7fd8637df640 1 --2- 172.21.15.88:0/4045513106 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd85c101960 0x7fd85c197470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:21.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:21.375+0000 7fd8637df640 1 -- 172.21.15.88:0/4045513106 >> 172.21.15.88:0/4045513106 conn(0x7fd85c0fd0f0 msgr2=0x7fd85c106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:21.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:21.375+0000 7fd8637df640 1 -- 172.21.15.88:0/4045513106 shutdown_connections 2024-09-17T04:17:21.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:21.375+0000 7fd8637df640 1 -- 172.21.15.88:0/4045513106 wait complete. 2024-09-17T04:17:22.026 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:21 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/4045513106' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-17T04:17:22.026 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:21 smithi134 ceph-mon[35201]: from='osd.5 [v2:172.21.15.134:6816/3477898981,v1:172.21.15.134:6817/3477898981]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T04:17:22.026 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:21 smithi134 ceph-mon[35201]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T04:17:22.026 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:17:21 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5[55013]: 2024-09-17T04:17:21.718+0000 7f3a52e80640 -1 osd.5 0 log_to_monitors true 2024-09-17T04:17:22.059 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:21 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/4045513106' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-17T04:17:22.059 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:21 smithi088 ceph-mon[27811]: from='osd.5 [v2:172.21.15.134:6816/3477898981,v1:172.21.15.134:6817/3477898981]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T04:17:22.059 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:21 smithi088 ceph-mon[27811]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T04:17:22.087 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":35,"num_osds":6,"num_up_osds":5,"osd_up_since":1726546617,"num_in_osds":6,"osd_in_since":1726546621,"num_remapped_pgs":0} 2024-09-17T04:17:22.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:22 smithi088 ceph-mon[27811]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-17T04:17:22.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:22 smithi088 ceph-mon[27811]: osdmap e36: 6 total, 5 up, 6 in 2024-09-17T04:17:22.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:22 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T04:17:22.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:22 smithi088 ceph-mon[27811]: from='osd.5 [v2:172.21.15.134:6816/3477898981,v1:172.21.15.134:6817/3477898981]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-17T04:17:22.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:22 smithi088 ceph-mon[27811]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-17T04:17:22.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:22 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:17:22.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:22 smithi088 ceph-mon[27811]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T04:17:23.087 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:22 smithi134 ceph-mon[35201]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-17T04:17:23.087 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:22 smithi134 ceph-mon[35201]: osdmap e36: 6 total, 5 up, 6 in 2024-09-17T04:17:23.087 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:22 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T04:17:23.087 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:22 smithi134 ceph-mon[35201]: from='osd.5 [v2:172.21.15.134:6816/3477898981,v1:172.21.15.134:6817/3477898981]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-17T04:17:23.087 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:22 smithi134 ceph-mon[35201]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-17T04:17:23.087 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:22 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:17:23.087 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:22 smithi134 ceph-mon[35201]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T04:17:23.087 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-17T04:17:23.343 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:17:23.737 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:17:23 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5[55013]: 2024-09-17T04:17:23.553+0000 7f3a4f617640 -1 osd.5 0 waiting for initial osdmap 2024-09-17T04:17:23.737 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:17:23 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5[55013]: 2024-09-17T04:17:23.563+0000 7f3a46c12640 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T04:17:23.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:23.807+0000 7f2d0a9cb640 1 -- 172.21.15.88:0/1428190479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d04100860 msgr2=0x7f2d04100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:23.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:23.807+0000 7f2d0a9cb640 1 --2- 172.21.15.88:0/1428190479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d04100860 0x7f2d04100c60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2cf4009880 tx=0x7f2cf402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:17:23.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:23.807+0000 7f2d0a9cb640 1 -- 172.21.15.88:0/1428190479 shutdown_connections 2024-09-17T04:17:23.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:23.807+0000 7f2d0a9cb640 1 --2- 172.21.15.88:0/1428190479 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d04101a60 0x7f2d04101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:23.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:23.807+0000 7f2d0a9cb640 1 --2- 172.21.15.88:0/1428190479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d04100860 0x7f2d04100c60 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:23.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:23.807+0000 7f2d0a9cb640 1 -- 172.21.15.88:0/1428190479 >> 172.21.15.88:0/1428190479 conn(0x7f2d040fc010 msgr2=0x7f2d040fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:23.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:23.807+0000 7f2d0a9cb640 1 -- 172.21.15.88:0/1428190479 shutdown_connections 2024-09-17T04:17:23.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:23.807+0000 7f2d0a9cb640 1 -- 172.21.15.88:0/1428190479 wait complete. 2024-09-17T04:17:23.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:23.808+0000 7f2d0a9cb640 1 Processor -- start 2024-09-17T04:17:23.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:23.808+0000 7f2d0a9cb640 1 -- start start 2024-09-17T04:17:23.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:23.808+0000 7f2d0a9cb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d04100860 0x7f2d041963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:23.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:23.808+0000 7f2d0a9cb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d04101a60 0x7f2d04196910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:23.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:23.808+0000 7f2d0a9cb640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f2d041096a0 con 0x7f2d04101a60 2024-09-17T04:17:23.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:23.808+0000 7f2d0a9cb640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2d04109520 con 0x7f2d04100860 2024-09-17T04:17:23.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:23.808+0000 7f2d037fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d04101a60 0x7f2d04196910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:23.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:23.808+0000 7f2d037fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d04101a60 0x7f2d04196910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59034/0 (socket says 172.21.15.88:59034) 2024-09-17T04:17:23.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:23.808+0000 7f2d037fe640 1 -- 172.21.15.88:0/1040714846 learned_addr learned my addr 172.21.15.88:0/1040714846 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:17:23.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:23.808+0000 7f2d03fff640 1 --2- 172.21.15.88:0/1040714846 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d04100860 0x7f2d041963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:23.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:23.808+0000 7f2d037fe640 1 -- 172.21.15.88:0/1040714846 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d04100860 msgr2=0x7f2d041963d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:23.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:23.808+0000 7f2d037fe640 1 --2- 172.21.15.88:0/1040714846 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d04100860 0x7f2d041963d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:23.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:23.808+0000 7f2d037fe640 1 -- 172.21.15.88:0/1040714846 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d04196f90 con 0x7f2d04101a60 2024-09-17T04:17:23.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:23.809+0000 7f2d037fe640 1 --2- 172.21.15.88:0/1040714846 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d04101a60 0x7f2d04196910 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2cf800e970 tx=0x7f2cf800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:23.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:23.809+0000 7f2d017fa640 1 -- 172.21.15.88:0/1040714846 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2cf800cac0 con 0x7f2d04101a60 2024-09-17T04:17:23.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:23.809+0000 7f2d017fa640 1 -- 172.21.15.88:0/1040714846 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2cf80054e0 con 0x7f2d04101a60 2024-09-17T04:17:23.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:23.809+0000 7f2d017fa640 1 -- 172.21.15.88:0/1040714846 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2cf8010430 con 0x7f2d04101a60 2024-09-17T04:17:23.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:23.809+0000 7f2d0a9cb640 1 -- 172.21.15.88:0/1040714846 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d0419b9d0 con 0x7f2d04101a60 2024-09-17T04:17:23.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:23.809+0000 7f2d0a9cb640 1 -- 172.21.15.88:0/1040714846 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d0419bf60 con 0x7f2d04101a60 2024-09-17T04:17:23.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:23.810+0000 7f2d0a9cb640 1 -- 172.21.15.88:0/1040714846 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d04100c60 con 0x7f2d04101a60 2024-09-17T04:17:23.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:23.810+0000 7f2d017fa640 1 -- 172.21.15.88:0/1040714846 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f2cf8004e80 con 0x7f2d04101a60 2024-09-17T04:17:23.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:23.811+0000 7f2d017fa640 1 --2- 172.21.15.88:0/1040714846 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f2cec06e2b0 0x7f2cec070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:23.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:23.811+0000 7f2d017fa640 1 -- 172.21.15.88:0/1040714846 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4358+0+0 (secure 0 0 0) 0x7f2cf808e3d0 con 0x7f2d04101a60 2024-09-17T04:17:23.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:23.811+0000 7f2d03fff640 1 --2- 172.21.15.88:0/1040714846 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f2cec06e2b0 0x7f2cec070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:23.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:23.811+0000 7f2d03fff640 1 --2- 172.21.15.88:0/1040714846 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f2cec06e2b0 0x7f2cec070770 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2cf4009230 tx=0x7f2cf40058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:23.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:23.816+0000 7f2d017fa640 1 -- 172.21.15.88:0/1040714846 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2cf805c180 con 0x7f2d04101a60 2024-09-17T04:17:23.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:23.990+0000 7f2d0a9cb640 1 -- 172.21.15.88:0/1040714846 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f2d04062df0 con 0x7f2d04101a60 2024-09-17T04:17:23.991 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:23 smithi088 ceph-mon[27811]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-17T04:17:23.991 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:23 smithi088 ceph-mon[27811]: osdmap e37: 6 total, 5 up, 6 in 2024-09-17T04:17:23.991 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:23 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T04:17:23.991 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:23 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T04:17:23.991 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:23 smithi088 ceph-mon[27811]: from='osd.5 ' entity='osd.5' 2024-09-17T04:17:23.991 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:23 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:17:23.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:23.991+0000 7f2d017fa640 1 -- 172.21.15.88:0/1040714846 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v37) ==== 74+0+130 (secure 0 0 0) 0x7f2cf805fe30 con 0x7f2d04101a60 2024-09-17T04:17:23.992 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:17:23.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:23.993+0000 7f2d0a9cb640 1 -- 172.21.15.88:0/1040714846 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f2cec06e2b0 msgr2=0x7f2cec070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:23.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:23.993+0000 7f2d0a9cb640 1 --2- 172.21.15.88:0/1040714846 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f2cec06e2b0 0x7f2cec070770 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2cf4009230 tx=0x7f2cf40058d0 comp rx=0 tx=0).stop 2024-09-17T04:17:23.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:23.993+0000 7f2d0a9cb640 1 -- 172.21.15.88:0/1040714846 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d04101a60 msgr2=0x7f2d04196910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:23.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:23.993+0000 7f2d0a9cb640 1 --2- 172.21.15.88:0/1040714846 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d04101a60 0x7f2d04196910 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2cf800e970 tx=0x7f2cf800ed70 comp rx=0 tx=0).stop 2024-09-17T04:17:23.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:23.993+0000 7f2d0a9cb640 1 -- 172.21.15.88:0/1040714846 shutdown_connections 2024-09-17T04:17:23.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:23.993+0000 7f2d0a9cb640 1 --2- 172.21.15.88:0/1040714846 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f2cec06e2b0 0x7f2cec070770 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:23.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:23.993+0000 7f2d0a9cb640 1 --2- 172.21.15.88:0/1040714846 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d04101a60 0x7f2d04196910 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:23.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:23.993+0000 7f2d0a9cb640 1 --2- 172.21.15.88:0/1040714846 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d04100860 0x7f2d041963d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:23.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:23.994+0000 7f2d0a9cb640 1 -- 172.21.15.88:0/1040714846 >> 172.21.15.88:0/1040714846 conn(0x7f2d040fc010 msgr2=0x7f2d04104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:23.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:23.994+0000 7f2d0a9cb640 1 -- 172.21.15.88:0/1040714846 shutdown_connections 2024-09-17T04:17:23.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:23.994+0000 7f2d0a9cb640 1 -- 172.21.15.88:0/1040714846 wait complete. 2024-09-17T04:17:24.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:23 smithi134 ceph-mon[35201]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-17T04:17:24.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:23 smithi134 ceph-mon[35201]: osdmap e37: 6 total, 5 up, 6 in 2024-09-17T04:17:24.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:23 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T04:17:24.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:23 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T04:17:24.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:23 smithi134 ceph-mon[35201]: from='osd.5 ' entity='osd.5' 2024-09-17T04:17:24.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:23 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:17:24.617 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":37,"num_osds":6,"num_up_osds":5,"osd_up_since":1726546617,"num_in_osds":6,"osd_in_since":1726546621,"num_remapped_pgs":0} 2024-09-17T04:17:25.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:24 smithi088 ceph-mon[27811]: purged_snaps scrub starts 2024-09-17T04:17:25.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:24 smithi088 ceph-mon[27811]: purged_snaps scrub ok 2024-09-17T04:17:25.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:24 smithi088 ceph-mon[27811]: Detected new or changed devices on smithi134 2024-09-17T04:17:25.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:24 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T04:17:25.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:24 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:17:25.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:24 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T04:17:25.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:24 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T04:17:25.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:24 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T04:17:25.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:24 smithi088 ceph-mon[27811]: Adjusting osd_memory_target on smithi134 to 4970M 2024-09-17T04:17:25.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:24 smithi088 ceph-mon[27811]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T04:17:25.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:24 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:17:25.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:24 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:17:25.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:24 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:17:25.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:24 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:17:25.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:24 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:17:25.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:24 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:17:25.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:24 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:17:25.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:24 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:17:25.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:24 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/1040714846' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-17T04:17:25.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:24 smithi088 ceph-mon[27811]: osd.5 [v2:172.21.15.134:6816/3477898981,v1:172.21.15.134:6817/3477898981] boot 2024-09-17T04:17:25.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:24 smithi088 ceph-mon[27811]: osdmap e38: 6 total, 6 up, 6 in 2024-09-17T04:17:25.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:24 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T04:17:25.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:24 smithi134 ceph-mon[35201]: purged_snaps scrub starts 2024-09-17T04:17:25.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:24 smithi134 ceph-mon[35201]: purged_snaps scrub ok 2024-09-17T04:17:25.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:24 smithi134 ceph-mon[35201]: Detected new or changed devices on smithi134 2024-09-17T04:17:25.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:24 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T04:17:25.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:24 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:17:25.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:24 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T04:17:25.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:24 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T04:17:25.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:24 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T04:17:25.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:24 smithi134 ceph-mon[35201]: Adjusting osd_memory_target on smithi134 to 4970M 2024-09-17T04:17:25.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:24 smithi134 ceph-mon[35201]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T04:17:25.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:24 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:17:25.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:24 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:17:25.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:24 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:17:25.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:24 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:17:25.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:24 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:17:25.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:24 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:17:25.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:24 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:17:25.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:24 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:17:25.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:24 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/1040714846' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-17T04:17:25.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:24 smithi134 ceph-mon[35201]: osd.5 [v2:172.21.15.134:6816/3477898981,v1:172.21.15.134:6817/3477898981] boot 2024-09-17T04:17:25.148 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:24 smithi134 ceph-mon[35201]: osdmap e38: 6 total, 6 up, 6 in 2024-09-17T04:17:25.148 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:24 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T04:17:25.618 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-17T04:17:25.877 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:17:26.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:26.303+0000 7fbaa9f8d640 1 -- 172.21.15.88:0/2579593676 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbaa4101a60 msgr2=0x7fbaa4101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:26.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:26.303+0000 7fbaa9f8d640 1 --2- 172.21.15.88:0/2579593676 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbaa4101a60 0x7fbaa4101ee0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fba8c009880 tx=0x7fba8c02a4a0 comp rx=0 tx=0).stop 2024-09-17T04:17:26.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:26.303+0000 7fbaa9f8d640 1 -- 172.21.15.88:0/2579593676 shutdown_connections 2024-09-17T04:17:26.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:26.303+0000 7fbaa9f8d640 1 --2- 172.21.15.88:0/2579593676 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbaa4101a60 0x7fbaa4101ee0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:26.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:26.303+0000 7fbaa9f8d640 1 --2- 172.21.15.88:0/2579593676 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbaa4100860 0x7fbaa4100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:26.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:26.303+0000 7fbaa9f8d640 1 -- 172.21.15.88:0/2579593676 >> 172.21.15.88:0/2579593676 conn(0x7fbaa40fc010 msgr2=0x7fbaa40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:26.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:26.303+0000 7fbaa9f8d640 1 -- 172.21.15.88:0/2579593676 shutdown_connections 2024-09-17T04:17:26.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:26.303+0000 7fbaa9f8d640 1 -- 172.21.15.88:0/2579593676 wait complete. 2024-09-17T04:17:26.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:26.304+0000 7fbaa9f8d640 1 Processor -- start 2024-09-17T04:17:26.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:26.304+0000 7fbaa9f8d640 1 -- start start 2024-09-17T04:17:26.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:26.304+0000 7fbaa9f8d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbaa4100860 0x7fbaa406a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:26.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:26.304+0000 7fbaa9f8d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbaa4101a60 0x7fbaa419e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:26.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:26.305+0000 7fbaa9f8d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa4109720 con 0x7fbaa4101a60 2024-09-17T04:17:26.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:26.305+0000 7fbaa9f8d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa41095a0 con 0x7fbaa4100860 2024-09-17T04:17:26.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:26.305+0000 7fbaa2ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbaa4101a60 0x7fbaa419e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:26.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:26.305+0000 7fbaa2ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbaa4101a60 0x7fbaa419e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59052/0 (socket says 172.21.15.88:59052) 2024-09-17T04:17:26.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:26.305+0000 7fbaa2ffd640 1 -- 172.21.15.88:0/2951913013 learned_addr learned my addr 172.21.15.88:0/2951913013 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:17:26.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:26.305+0000 7fbaa37fe640 1 --2- 172.21.15.88:0/2951913013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbaa4100860 0x7fbaa406a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:26.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:26.305+0000 7fbaa2ffd640 1 -- 172.21.15.88:0/2951913013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbaa4100860 msgr2=0x7fbaa406a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:26.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:26.305+0000 7fbaa2ffd640 1 --2- 172.21.15.88:0/2951913013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbaa4100860 0x7fbaa406a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:26.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:26.305+0000 7fbaa2ffd640 1 -- 172.21.15.88:0/2951913013 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa419ec00 con 0x7fbaa4101a60 2024-09-17T04:17:26.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:26.305+0000 7fbaa2ffd640 1 --2- 172.21.15.88:0/2951913013 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbaa4101a60 0x7fbaa419e6c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fba8c006010 tx=0x7fba8c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:26.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:26.305+0000 7fbaa0ff9640 1 -- 172.21.15.88:0/2951913013 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fba8c03f070 con 0x7fbaa4101a60 2024-09-17T04:17:26.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:26.305+0000 7fbaa9f8d640 1 -- 172.21.15.88:0/2951913013 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaa419edd0 con 0x7fbaa4101a60 2024-09-17T04:17:26.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:26.305+0000 7fbaa0ff9640 1 -- 172.21.15.88:0/2951913013 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fba8c0044d0 con 0x7fbaa4101a60 2024-09-17T04:17:26.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:26.305+0000 7fbaa0ff9640 1 -- 172.21.15.88:0/2951913013 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fba8c035030 con 0x7fbaa4101a60 2024-09-17T04:17:26.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:26.305+0000 7fbaa9f8d640 1 -- 172.21.15.88:0/2951913013 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaa419f300 con 0x7fbaa4101a60 2024-09-17T04:17:26.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:26.306+0000 7fbaa9f8d640 1 -- 172.21.15.88:0/2951913013 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaa4100c40 con 0x7fbaa4101a60 2024-09-17T04:17:26.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:26.307+0000 7fbaa0ff9640 1 -- 172.21.15.88:0/2951913013 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fba8c042070 con 0x7fbaa4101a60 2024-09-17T04:17:26.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:26.307+0000 7fbaa0ff9640 1 --2- 172.21.15.88:0/2951913013 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fba9006e2b0 0x7fba90070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:26.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:26.307+0000 7fbaa0ff9640 1 -- 172.21.15.88:0/2951913013 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fba8c0aeb10 con 0x7fbaa4101a60 2024-09-17T04:17:26.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:26.308+0000 7fbaa37fe640 1 --2- 172.21.15.88:0/2951913013 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fba9006e2b0 0x7fba90070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:26.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:26.308+0000 7fbaa37fe640 1 --2- 172.21.15.88:0/2951913013 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fba9006e2b0 0x7fba90070770 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbaa41018c0 tx=0x7fba9400d040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:26.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:26.312+0000 7fbaa0ff9640 1 -- 172.21.15.88:0/2951913013 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fba8c0803d0 con 0x7fbaa4101a60 2024-09-17T04:17:26.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:26.478+0000 7fbaa9f8d640 1 -- 172.21.15.88:0/2951913013 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fbaa4062df0 con 0x7fbaa4101a60 2024-09-17T04:17:26.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:26.478+0000 7fbaa0ff9640 1 -- 172.21.15.88:0/2951913013 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v39) ==== 74+0+130 (secure 0 0 0) 0x7fba8c084c00 con 0x7fbaa4101a60 2024-09-17T04:17:26.479 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:17:26.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:26.480+0000 7fbaa9f8d640 1 -- 172.21.15.88:0/2951913013 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fba9006e2b0 msgr2=0x7fba90070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:26.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:26.480+0000 7fbaa9f8d640 1 --2- 172.21.15.88:0/2951913013 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fba9006e2b0 0x7fba90070770 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbaa41018c0 tx=0x7fba9400d040 comp rx=0 tx=0).stop 2024-09-17T04:17:26.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:26.480+0000 7fbaa9f8d640 1 -- 172.21.15.88:0/2951913013 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbaa4101a60 msgr2=0x7fbaa419e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:26.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:26.480+0000 7fbaa9f8d640 1 --2- 172.21.15.88:0/2951913013 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbaa4101a60 0x7fbaa419e6c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fba8c006010 tx=0x7fba8c0048f0 comp rx=0 tx=0).stop 2024-09-17T04:17:26.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:26.480+0000 7fbaa9f8d640 1 -- 172.21.15.88:0/2951913013 shutdown_connections 2024-09-17T04:17:26.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:26.480+0000 7fbaa9f8d640 1 --2- 172.21.15.88:0/2951913013 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fba9006e2b0 0x7fba90070770 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:26.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:26.480+0000 7fbaa9f8d640 1 --2- 172.21.15.88:0/2951913013 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbaa4101a60 0x7fbaa419e6c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:26.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:26.480+0000 7fbaa9f8d640 1 --2- 172.21.15.88:0/2951913013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbaa4100860 0x7fbaa406a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:26.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:26.480+0000 7fbaa9f8d640 1 -- 172.21.15.88:0/2951913013 >> 172.21.15.88:0/2951913013 conn(0x7fbaa40fc010 msgr2=0x7fbaa4104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:26.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:26.481+0000 7fbaa9f8d640 1 -- 172.21.15.88:0/2951913013 shutdown_connections 2024-09-17T04:17:26.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:26.481+0000 7fbaa9f8d640 1 -- 172.21.15.88:0/2951913013 wait complete. 2024-09-17T04:17:26.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:26 smithi088 ceph-mon[27811]: osdmap e39: 6 total, 6 up, 6 in 2024-09-17T04:17:26.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:26 smithi088 ceph-mon[27811]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:17:26.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:26 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/2951913013' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-17T04:17:26.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:26 smithi134 ceph-mon[35201]: osdmap e39: 6 total, 6 up, 6 in 2024-09-17T04:17:26.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:26 smithi134 ceph-mon[35201]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:17:26.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:26 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/2951913013' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-17T04:17:27.249 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":39,"num_osds":6,"num_up_osds":6,"osd_up_since":1726546644,"num_in_osds":6,"osd_in_since":1726546621,"num_remapped_pgs":0} 2024-09-17T04:17:27.250 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-17T04:17:27.492 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:17:27.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:27.921+0000 7fdd27a37640 1 -- 172.21.15.88:0/389661134 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd20100860 msgr2=0x7fdd20100cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:27.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:27.921+0000 7fdd27a37640 1 --2- 172.21.15.88:0/389661134 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd20100860 0x7fdd20100cc0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fdd14009880 tx=0x7fdd1402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:17:27.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:27.922+0000 7fdd27a37640 1 -- 172.21.15.88:0/389661134 shutdown_connections 2024-09-17T04:17:27.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:27.922+0000 7fdd27a37640 1 --2- 172.21.15.88:0/389661134 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd20100860 0x7fdd20100cc0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:27.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:27.922+0000 7fdd27a37640 1 --2- 172.21.15.88:0/389661134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdd20106860 0x7fdd20106c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:27.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:27.922+0000 7fdd27a37640 1 -- 172.21.15.88:0/389661134 >> 172.21.15.88:0/389661134 conn(0x7fdd200fc580 msgr2=0x7fdd200fe9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:27.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:27.922+0000 7fdd27a37640 1 -- 172.21.15.88:0/389661134 shutdown_connections 2024-09-17T04:17:27.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:27.922+0000 7fdd27a37640 1 -- 172.21.15.88:0/389661134 wait complete. 2024-09-17T04:17:27.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:27.922+0000 7fdd27a37640 1 Processor -- start 2024-09-17T04:17:27.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:27.922+0000 7fdd27a37640 1 -- start start 2024-09-17T04:17:27.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:27.922+0000 7fdd27a37640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdd20100860 0x7fdd2019d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:27.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:27.922+0000 7fdd27a37640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd20106860 0x7fdd2019dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:27.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:27.922+0000 7fdd27a37640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fdd2010dd90 con 0x7fdd20106860 2024-09-17T04:17:27.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:27.922+0000 7fdd27a37640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdd2010dc10 con 0x7fdd20100860 2024-09-17T04:17:27.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:27.923+0000 7fdd24fd2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd20106860 0x7fdd2019dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:27.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:27.923+0000 7fdd24fd2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd20106860 0x7fdd2019dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59060/0 (socket says 172.21.15.88:59060) 2024-09-17T04:17:27.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:27.923+0000 7fdd24fd2640 1 -- 172.21.15.88:0/363612111 learned_addr learned my addr 172.21.15.88:0/363612111 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:17:27.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:27.923+0000 7fdd257d3640 1 --2- 172.21.15.88:0/363612111 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdd20100860 0x7fdd2019d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:27.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:27.923+0000 7fdd24fd2640 1 -- 172.21.15.88:0/363612111 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdd20100860 msgr2=0x7fdd2019d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:27.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:27.923+0000 7fdd24fd2640 1 --2- 172.21.15.88:0/363612111 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdd20100860 0x7fdd2019d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:27.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:27.923+0000 7fdd24fd2640 1 -- 172.21.15.88:0/363612111 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd201978a0 con 0x7fdd20106860 2024-09-17T04:17:27.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:27.923+0000 7fdd257d3640 1 --2- 172.21.15.88:0/363612111 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdd20100860 0x7fdd2019d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:17:27.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:27.923+0000 7fdd24fd2640 1 --2- 172.21.15.88:0/363612111 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd20106860 0x7fdd2019dc20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fdd14031460 tx=0x7fdd140048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:27.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:27.923+0000 7fdd1e7fc640 1 -- 172.21.15.88:0/363612111 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdd1403f070 con 0x7fdd20106860 2024-09-17T04:17:27.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:27.923+0000 7fdd1e7fc640 1 -- 172.21.15.88:0/363612111 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdd14004cf0 con 0x7fdd20106860 2024-09-17T04:17:27.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:27.923+0000 7fdd27a37640 1 -- 172.21.15.88:0/363612111 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd20197b30 con 0x7fdd20106860 2024-09-17T04:17:27.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:27.923+0000 7fdd1e7fc640 1 -- 172.21.15.88:0/363612111 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdd14035030 con 0x7fdd20106860 2024-09-17T04:17:27.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:27.923+0000 7fdd27a37640 1 -- 172.21.15.88:0/363612111 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd20198060 con 0x7fdd20106860 2024-09-17T04:17:27.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:27.924+0000 7fdd27a37640 1 -- 172.21.15.88:0/363612111 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd20101fa0 con 0x7fdd20106860 2024-09-17T04:17:27.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:27.925+0000 7fdd1e7fc640 1 -- 172.21.15.88:0/363612111 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fdd14042070 con 0x7fdd20106860 2024-09-17T04:17:27.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:27.925+0000 7fdd1e7fc640 1 --2- 172.21.15.88:0/363612111 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fdd0806e310 0x7fdd080707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:27.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:27.925+0000 7fdd1e7fc640 1 -- 172.21.15.88:0/363612111 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fdd140ae840 con 0x7fdd20106860 2024-09-17T04:17:27.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:27.925+0000 7fdd257d3640 1 --2- 172.21.15.88:0/363612111 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fdd0806e310 0x7fdd080707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:27.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:27.925+0000 7fdd257d3640 1 --2- 172.21.15.88:0/363612111 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fdd0806e310 0x7fdd080707d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdd201989e0 tx=0x7fdd100073e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:27.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:27.929+0000 7fdd1e7fc640 1 -- 172.21.15.88:0/363612111 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdd1407c560 con 0x7fdd20106860 2024-09-17T04:17:28.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:28.099+0000 7fdd27a37640 1 -- 172.21.15.88:0/363612111 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdd20109e30 con 0x7fdd20106860 2024-09-17T04:17:28.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:28.099+0000 7fdd1e7fc640 1 -- 172.21.15.88:0/363612111 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+11388 (secure 0 0 0) 0x7fdd14080210 con 0x7fdd20106860 2024-09-17T04:17:28.100 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:17:28.101 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":39,"fsid":"bf2b79a4-74aa-11ef-bceb-c7b262605968","created":"2024-09-17T04:11:28.340394+0000","modified":"2024-09-17T04:17:25.557153+0000","last_up_change":"2024-09-17T04:17:24.555775+0000","last_in_change":"2024-09-17T04:17:01.088967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T04:16:08.048076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a576201e-1335-4edf-8e9a-3e62264f3bef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":2896435780},{"type":"v1","addr":"172.21.15.88:6803","nonce":2896435780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":2896435780},{"type":"v1","addr":"172.21.15.88:6805","nonce":2896435780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2896435780},{"type":"v1","addr":"172.21.15.88:6809","nonce":2896435780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":2896435780},{"type":"v1","addr":"172.21.15.88:6807","nonce":2896435780}]},"public_addr":"172.21.15.88:6803/2896435780","cluster_addr":"172.21.15.88:6805/2896435780","heartbeat_back_addr":"172.21.15.88:6809/2896435780","heartbeat_front_addr":"172.21.15.88:6807/2896435780","state":["exists","up"]},{"osd":1,"uuid":"2b6a97ae-75a3-437c-ad8a-b5dde2819592","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":1101608666},{"type":"v1","addr":"172.21.15.88:6811","nonce":1101608666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1101608666},{"type":"v1","addr":"172.21.15.88:6813","nonce":1101608666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1101608666},{"type":"v1","addr":"172.21.15.88:6817","nonce":1101608666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":1101608666},{"type":"v1","addr":"172.21.15.88:6815","nonce":1101608666}]},"public_addr":"172.21.15.88:6811/1101608666","cluster_addr":"172.21.15.88:6813/1101608666","heartbeat_back_addr":"172.21.15.88:6817/1101608666","heartbeat_front_addr":"172.21.15.88:6815/1101608666","state":["exists","up"]},{"osd":2,"uuid":"e57fd249-3087-439b-9ced-1d733503f1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3973957395},{"type":"v1","addr":"172.21.15.88:6819","nonce":3973957395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3973957395},{"type":"v1","addr":"172.21.15.88:6821","nonce":3973957395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":3973957395},{"type":"v1","addr":"172.21.15.88:6825","nonce":3973957395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3973957395},{"type":"v1","addr":"172.21.15.88:6823","nonce":3973957395}]},"public_addr":"172.21.15.88:6819/3973957395","cluster_addr":"172.21.15.88:6821/3973957395","heartbeat_back_addr":"172.21.15.88:6825/3973957395","heartbeat_front_addr":"172.21.15.88:6823/3973957395","state":["exists","up"]},{"osd":3,"uuid":"abb0ae43-4561-4ffe-89c4-20a3cbe1e817","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1430236667},{"type":"v1","addr":"172.21.15.134:6801","nonce":1430236667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1430236667},{"type":"v1","addr":"172.21.15.134:6803","nonce":1430236667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1430236667},{"type":"v1","addr":"172.21.15.134:6807","nonce":1430236667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1430236667},{"type":"v1","addr":"172.21.15.134:6805","nonce":1430236667}]},"public_addr":"172.21.15.134:6801/1430236667","cluster_addr":"172.21.15.134:6803/1430236667","heartbeat_back_addr":"172.21.15.134:6807/1430236667","heartbeat_front_addr":"172.21.15.134:6805/1430236667","state":["exists","up"]},{"osd":4,"uuid":"33c07ebe-d45d-478f-b8a9-991d462568f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":764689261},{"type":"v1","addr":"172.21.15.134:6809","nonce":764689261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":764689261},{"type":"v1","addr":"172.21.15.134:6811","nonce":764689261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":764689261},{"type":"v1","addr":"172.21.15.134:6815","nonce":764689261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":764689261},{"type":"v1","addr":"172.21.15.134:6813","nonce":764689261}]},"public_addr":"172.21.15.134:6809/764689261","cluster_addr":"172.21.15.134:6811/764689261","heartbeat_back_addr":"172.21.15.134:6815/764689261","heartbeat_front_addr":"172.21.15.134:6813/764689261","state":["exists","up"]},{"osd":5,"uuid":"7ef9ab40-b3dd-4208-a3c3-1dc86dd74239","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3477898981},{"type":"v1","addr":"172.21.15.134:6817","nonce":3477898981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3477898981},{"type":"v1","addr":"172.21.15.134:6819","nonce":3477898981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3477898981},{"type":"v1","addr":"172.21.15.134:6823","nonce":3477898981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3477898981},{"type":"v1","addr":"172.21.15.134:6821","nonce":3477898981}]},"public_addr":"172.21.15.134:6817/3477898981","cluster_addr":"172.21.15.134:6819/3477898981","heartbeat_back_addr":"172.21.15.134:6823/3477898981","heartbeat_front_addr":"172.21.15.134:6821/3477898981","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:15:03.639854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:15:35.145583+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:16:03.983073+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:16:29.207130+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:16:56.273448+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:17:22.708485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.88:6801/245760742":"2024-09-18T04:13:21.738800+0000","172.21.15.88:6800/245760742":"2024-09-18T04:13:21.738800+0000","172.21.15.88:0/233265505":"2024-09-18T04:11:52.936995+0000","172.21.15.88:6801/2871304666":"2024-09-18T04:11:52.936995+0000","172.21.15.88:0/910347675":"2024-09-18T04:12:24.422352+0000","172.21.15.88:0/433412784":"2024-09-18T04:11:52.936995+0000","172.21.15.88:0/1996066407":"2024-09-18T04:11:52.936995+0000","172.21.15.88:0/602105794":"2024-09-18T04:12:24.422352+0000","172.21.15.88:6801/2756720871":"2024-09-18T04:12:24.422352+0000","172.21.15.88:6800/2871304666":"2024-09-18T04:11:52.936995+0000","172.21.15.88:0/2048077731":"2024-09-18T04:13:21.738800+0000","172.21.15.88:6800/2756720871":"2024-09-18T04:12:24.422352+0000","172.21.15.88:0/469592792":"2024-09-18T04:12:24.422352+0000","172.21.15.88:0/2258563085":"2024-09-18T04:13:21.738800+0000","172.21.15.88:0/73613879":"2024-09-18T04:13:21.738800+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T04:17:28.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:28.102+0000 7fdd27a37640 1 -- 172.21.15.88:0/363612111 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fdd0806e310 msgr2=0x7fdd080707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:28.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:28.102+0000 7fdd27a37640 1 --2- 172.21.15.88:0/363612111 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fdd0806e310 0x7fdd080707d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdd201989e0 tx=0x7fdd100073e0 comp rx=0 tx=0).stop 2024-09-17T04:17:28.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:28.102+0000 7fdd27a37640 1 -- 172.21.15.88:0/363612111 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd20106860 msgr2=0x7fdd2019dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:28.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:28.102+0000 7fdd27a37640 1 --2- 172.21.15.88:0/363612111 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd20106860 0x7fdd2019dc20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fdd14031460 tx=0x7fdd140048f0 comp rx=0 tx=0).stop 2024-09-17T04:17:28.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:28.102+0000 7fdd27a37640 1 -- 172.21.15.88:0/363612111 shutdown_connections 2024-09-17T04:17:28.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:28.102+0000 7fdd27a37640 1 --2- 172.21.15.88:0/363612111 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fdd0806e310 0x7fdd080707d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:28.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:28.102+0000 7fdd27a37640 1 --2- 172.21.15.88:0/363612111 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd20106860 0x7fdd2019dc20 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:28.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:28.102+0000 7fdd27a37640 1 --2- 172.21.15.88:0/363612111 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdd20100860 0x7fdd2019d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:28.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:28.102+0000 7fdd27a37640 1 -- 172.21.15.88:0/363612111 >> 172.21.15.88:0/363612111 conn(0x7fdd200fc580 msgr2=0x7fdd2006a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:28.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:28.102+0000 7fdd27a37640 1 -- 172.21.15.88:0/363612111 shutdown_connections 2024-09-17T04:17:28.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:28.102+0000 7fdd27a37640 1 -- 172.21.15.88:0/363612111 wait complete. 2024-09-17T04:17:28.876 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T04:16:08.048076+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T04:17:28.876 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-17T04:17:29.121 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:17:29.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:28 smithi088 ceph-mon[27811]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:17:29.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:28 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/363612111' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T04:17:29.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:28 smithi134 ceph-mon[35201]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:17:29.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:28 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/363612111' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T04:17:29.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:29.589+0000 7f29b28c1640 1 -- 172.21.15.88:0/3977974270 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29ac100800 msgr2=0x7f29ac100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:29.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:29.589+0000 7f29b28c1640 1 --2- 172.21.15.88:0/3977974270 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29ac100800 0x7f29ac100c60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f29a0009880 tx=0x7f29a002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:17:29.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:29.589+0000 7f29b28c1640 1 -- 172.21.15.88:0/3977974270 shutdown_connections 2024-09-17T04:17:29.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:29.589+0000 7f29b28c1640 1 --2- 172.21.15.88:0/3977974270 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29ac100800 0x7f29ac100c60 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:29.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:29.589+0000 7f29b28c1640 1 --2- 172.21.15.88:0/3977974270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29ac106800 0x7f29ac106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:29.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:29.589+0000 7f29b28c1640 1 -- 172.21.15.88:0/3977974270 >> 172.21.15.88:0/3977974270 conn(0x7f29ac0fc520 msgr2=0x7f29ac0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:29.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:29.589+0000 7f29b28c1640 1 -- 172.21.15.88:0/3977974270 shutdown_connections 2024-09-17T04:17:29.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:29.589+0000 7f29b28c1640 1 -- 172.21.15.88:0/3977974270 wait complete. 2024-09-17T04:17:29.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:29.590+0000 7f29b28c1640 1 Processor -- start 2024-09-17T04:17:29.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:29.590+0000 7f29b28c1640 1 -- start start 2024-09-17T04:17:29.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:29.590+0000 7f29b28c1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29ac100800 0x7f29ac198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:29.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:29.590+0000 7f29b28c1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29ac106800 0x7f29ac198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:29.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:29.590+0000 7f29b28c1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f29ac10dd30 con 0x7f29ac100800 2024-09-17T04:17:29.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:29.590+0000 7f29b28c1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f29ac10dbb0 con 0x7f29ac106800 2024-09-17T04:17:29.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:29.590+0000 7f29abfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29ac100800 0x7f29ac198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:29.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:29.590+0000 7f29abfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29ac100800 0x7f29ac198890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59080/0 (socket says 172.21.15.88:59080) 2024-09-17T04:17:29.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:29.590+0000 7f29abfff640 1 -- 172.21.15.88:0/1883809054 learned_addr learned my addr 172.21.15.88:0/1883809054 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:17:29.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:29.591+0000 7f29ab7fe640 1 --2- 172.21.15.88:0/1883809054 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29ac106800 0x7f29ac198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:29.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:29.591+0000 7f29abfff640 1 -- 172.21.15.88:0/1883809054 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29ac106800 msgr2=0x7f29ac198dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:29.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:29.591+0000 7f29abfff640 1 --2- 172.21.15.88:0/1883809054 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29ac106800 0x7f29ac198dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:29.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:29.591+0000 7f29abfff640 1 -- 172.21.15.88:0/1883809054 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29ac1993d0 con 0x7f29ac100800 2024-09-17T04:17:29.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:29.591+0000 7f29ab7fe640 1 --2- 172.21.15.88:0/1883809054 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29ac106800 0x7f29ac198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:17:29.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:29.591+0000 7f29abfff640 1 --2- 172.21.15.88:0/1883809054 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29ac100800 0x7f29ac198890 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f299c00b420 tx=0x7f299c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:29.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:29.591+0000 7f29a97fa640 1 -- 172.21.15.88:0/1883809054 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f299c011630 con 0x7f29ac100800 2024-09-17T04:17:29.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:29.591+0000 7f29a97fa640 1 -- 172.21.15.88:0/1883809054 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f299c016070 con 0x7f29ac100800 2024-09-17T04:17:29.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:29.591+0000 7f29b28c1640 1 -- 172.21.15.88:0/1883809054 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29ac1996c0 con 0x7f29ac100800 2024-09-17T04:17:29.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:29.591+0000 7f29a97fa640 1 -- 172.21.15.88:0/1883809054 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f299c010d40 con 0x7f29ac100800 2024-09-17T04:17:29.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:29.591+0000 7f29b28c1640 1 -- 172.21.15.88:0/1883809054 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29ac1a1cc0 con 0x7f29ac100800 2024-09-17T04:17:29.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:29.592+0000 7f29b28c1640 1 -- 172.21.15.88:0/1883809054 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29ac101f40 con 0x7f29ac100800 2024-09-17T04:17:29.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:29.592+0000 7f29a97fa640 1 -- 172.21.15.88:0/1883809054 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f299c01b460 con 0x7f29ac100800 2024-09-17T04:17:29.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:29.593+0000 7f29a97fa640 1 --2- 172.21.15.88:0/1883809054 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f299406e2b0 0x7f2994070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:29.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:29.593+0000 7f29a97fa640 1 -- 172.21.15.88:0/1883809054 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f299c08d680 con 0x7f29ac100800 2024-09-17T04:17:29.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:29.593+0000 7f29ab7fe640 1 --2- 172.21.15.88:0/1883809054 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f299406e2b0 0x7f2994070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:29.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:29.593+0000 7f29ab7fe640 1 --2- 172.21.15.88:0/1883809054 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f299406e2b0 0x7f2994070770 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f29a0006010 tx=0x7f29a00095f0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:29.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:29.597+0000 7f29a97fa640 1 -- 172.21.15.88:0/1883809054 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f29ac1996c0 con 0x7f29ac100800 2024-09-17T04:17:29.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:29.764+0000 7f29b28c1640 1 -- 172.21.15.88:0/1883809054 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f29ac108d90 con 0x7f29ac100800 2024-09-17T04:17:29.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:29.764+0000 7f29a97fa640 1 -- 172.21.15.88:0/1883809054 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) ==== 93+0+10 (secure 0 0 0) 0x7f299c05b320 con 0x7f29ac100800 2024-09-17T04:17:29.765 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2024-09-17T04:17:29.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:29.766+0000 7f29b28c1640 1 -- 172.21.15.88:0/1883809054 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f299406e2b0 msgr2=0x7f2994070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:29.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:29.766+0000 7f29b28c1640 1 --2- 172.21.15.88:0/1883809054 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f299406e2b0 0x7f2994070770 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f29a0006010 tx=0x7f29a00095f0 comp rx=0 tx=0).stop 2024-09-17T04:17:29.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:29.766+0000 7f29b28c1640 1 -- 172.21.15.88:0/1883809054 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29ac100800 msgr2=0x7f29ac198890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:29.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:29.766+0000 7f29b28c1640 1 --2- 172.21.15.88:0/1883809054 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29ac100800 0x7f29ac198890 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f299c00b420 tx=0x7f299c00b8e0 comp rx=0 tx=0).stop 2024-09-17T04:17:29.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:29.767+0000 7f29b28c1640 1 -- 172.21.15.88:0/1883809054 shutdown_connections 2024-09-17T04:17:29.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:29.767+0000 7f29b28c1640 1 --2- 172.21.15.88:0/1883809054 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f299406e2b0 0x7f2994070770 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:29.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:29.767+0000 7f29b28c1640 1 --2- 172.21.15.88:0/1883809054 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29ac106800 0x7f29ac198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:29.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:29.767+0000 7f29b28c1640 1 --2- 172.21.15.88:0/1883809054 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29ac100800 0x7f29ac198890 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:29.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:29.767+0000 7f29b28c1640 1 -- 172.21.15.88:0/1883809054 >> 172.21.15.88:0/1883809054 conn(0x7f29ac0fc520 msgr2=0x7f29ac0fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:29.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:29.767+0000 7f29b28c1640 1 -- 172.21.15.88:0/1883809054 shutdown_connections 2024-09-17T04:17:29.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:29.767+0000 7f29b28c1640 1 -- 172.21.15.88:0/1883809054 wait complete. 2024-09-17T04:17:30.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:29 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/1883809054' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-17T04:17:30.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:29 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/1883809054' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-17T04:17:30.532 INFO:tasks.cephadm:Setting up client nodes... 2024-09-17T04:17:30.532 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-17T04:17:30.779 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:17:31.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:30 smithi088 ceph-mon[27811]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:17:31.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:30 smithi134 ceph-mon[35201]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:17:31.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:31.270+0000 7f89ea708640 1 -- 172.21.15.88:0/3867465591 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89e4101950 msgr2=0x7f89e4101d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:31.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:31.270+0000 7f89ea708640 1 --2- 172.21.15.88:0/3867465591 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89e4101950 0x7f89e4101d50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f89d4009880 tx=0x7f89d402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:17:31.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:31.270+0000 7f89ea708640 1 -- 172.21.15.88:0/3867465591 shutdown_connections 2024-09-17T04:17:31.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:31.270+0000 7f89ea708640 1 --2- 172.21.15.88:0/3867465591 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89e4102b50 0x7f89e4102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:31.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:31.270+0000 7f89ea708640 1 --2- 172.21.15.88:0/3867465591 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89e4101950 0x7f89e4101d50 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:31.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:31.270+0000 7f89ea708640 1 -- 172.21.15.88:0/3867465591 >> 172.21.15.88:0/3867465591 conn(0x7f89e40fd100 msgr2=0x7f89e40ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:31.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:31.270+0000 7f89ea708640 1 -- 172.21.15.88:0/3867465591 shutdown_connections 2024-09-17T04:17:31.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:31.270+0000 7f89ea708640 1 -- 172.21.15.88:0/3867465591 wait complete. 2024-09-17T04:17:31.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:31.270+0000 7f89ea708640 1 Processor -- start 2024-09-17T04:17:31.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:31.270+0000 7f89ea708640 1 -- start start 2024-09-17T04:17:31.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:31.271+0000 7f89ea708640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89e4101950 0x7f89e4075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:31.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:31.271+0000 7f89ea708640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89e4102b50 0x7f89e40745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:31.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:31.271+0000 7f89ea708640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f89e410a7f0 con 0x7f89e4102b50 2024-09-17T04:17:31.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:31.271+0000 7f89ea708640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f89e410a670 con 0x7f89e4101950 2024-09-17T04:17:31.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:31.271+0000 7f89dbfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89e4102b50 0x7f89e40745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:31.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:31.271+0000 7f89dbfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89e4102b50 0x7f89e40745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59092/0 (socket says 172.21.15.88:59092) 2024-09-17T04:17:31.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:31.271+0000 7f89dbfff640 1 -- 172.21.15.88:0/226324667 learned_addr learned my addr 172.21.15.88:0/226324667 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:17:31.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:31.271+0000 7f89e3fff640 1 --2- 172.21.15.88:0/226324667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89e4101950 0x7f89e4075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:31.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:31.271+0000 7f89dbfff640 1 -- 172.21.15.88:0/226324667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89e4101950 msgr2=0x7f89e4075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:31.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:31.271+0000 7f89dbfff640 1 --2- 172.21.15.88:0/226324667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89e4101950 0x7f89e4075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:31.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:31.271+0000 7f89dbfff640 1 -- 172.21.15.88:0/226324667 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89e4074b20 con 0x7f89e4102b50 2024-09-17T04:17:31.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:31.271+0000 7f89e3fff640 1 --2- 172.21.15.88:0/226324667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89e4101950 0x7f89e4075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:17:31.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:31.271+0000 7f89dbfff640 1 --2- 172.21.15.88:0/226324667 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89e4102b50 0x7f89e40745e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f89cc00b420 tx=0x7f89cc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:31.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:31.271+0000 7f89e1ffb640 1 -- 172.21.15.88:0/226324667 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f89cc011630 con 0x7f89e4102b50 2024-09-17T04:17:31.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:31.271+0000 7f89e1ffb640 1 -- 172.21.15.88:0/226324667 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f89cc016070 con 0x7f89e4102b50 2024-09-17T04:17:31.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:31.271+0000 7f89ea708640 1 -- 172.21.15.88:0/226324667 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89e4074e10 con 0x7f89e4102b50 2024-09-17T04:17:31.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:31.271+0000 7f89e1ffb640 1 -- 172.21.15.88:0/226324667 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f89cc010d40 con 0x7f89e4102b50 2024-09-17T04:17:31.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:31.271+0000 7f89ea708640 1 -- 172.21.15.88:0/226324667 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89e4075420 con 0x7f89e4102b50 2024-09-17T04:17:31.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:31.272+0000 7f89ea708640 1 -- 172.21.15.88:0/226324667 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89e4101d50 con 0x7f89e4102b50 2024-09-17T04:17:31.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:31.273+0000 7f89e1ffb640 1 -- 172.21.15.88:0/226324667 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f89cc01b460 con 0x7f89e4102b50 2024-09-17T04:17:31.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:31.273+0000 7f89e1ffb640 1 --2- 172.21.15.88:0/226324667 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f89d006e2b0 0x7f89d0070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:31.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:31.273+0000 7f89e1ffb640 1 -- 172.21.15.88:0/226324667 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f89cc08d6e0 con 0x7f89e4102b50 2024-09-17T04:17:31.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:31.273+0000 7f89e3fff640 1 --2- 172.21.15.88:0/226324667 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f89d006e2b0 0x7f89d0070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:31.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:31.274+0000 7f89e3fff640 1 --2- 172.21.15.88:0/226324667 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f89d006e2b0 0x7f89d0070770 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f89d4000c00 tx=0x7f89d4005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:31.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:31.278+0000 7f89e1ffb640 1 -- 172.21.15.88:0/226324667 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f89cc05b380 con 0x7f89e4102b50 2024-09-17T04:17:31.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:31.507+0000 7f89ea708640 1 -- 172.21.15.88:0/226324667 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f89e419f8f0 con 0x7f89e4102b50 2024-09-17T04:17:31.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:31.509+0000 7f89e1ffb640 1 -- 172.21.15.88:0/226324667 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) ==== 170+0+59 (secure 0 0 0) 0x7f89cc05f030 con 0x7f89e4102b50 2024-09-17T04:17:31.510 INFO:teuthology.orchestra.run.smithi088.stdout:[client.0] 2024-09-17T04:17:31.510 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDbAulmp6pjHhAAP3jyZeEyoYMd204BbMBdvQ== 2024-09-17T04:17:31.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:31.512+0000 7f89ea708640 1 -- 172.21.15.88:0/226324667 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f89d006e2b0 msgr2=0x7f89d0070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:31.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:31.512+0000 7f89ea708640 1 --2- 172.21.15.88:0/226324667 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f89d006e2b0 0x7f89d0070770 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f89d4000c00 tx=0x7f89d4005a20 comp rx=0 tx=0).stop 2024-09-17T04:17:31.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:31.512+0000 7f89ea708640 1 -- 172.21.15.88:0/226324667 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89e4102b50 msgr2=0x7f89e40745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:31.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:31.512+0000 7f89ea708640 1 --2- 172.21.15.88:0/226324667 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89e4102b50 0x7f89e40745e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f89cc00b420 tx=0x7f89cc00b8e0 comp rx=0 tx=0).stop 2024-09-17T04:17:31.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:31.512+0000 7f89ea708640 1 -- 172.21.15.88:0/226324667 shutdown_connections 2024-09-17T04:17:31.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:31.512+0000 7f89ea708640 1 --2- 172.21.15.88:0/226324667 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f89d006e2b0 0x7f89d0070770 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:31.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:31.512+0000 7f89ea708640 1 --2- 172.21.15.88:0/226324667 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89e4102b50 0x7f89e40745e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:31.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:31.512+0000 7f89ea708640 1 --2- 172.21.15.88:0/226324667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89e4101950 0x7f89e4075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:31.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:31.512+0000 7f89ea708640 1 -- 172.21.15.88:0/226324667 >> 172.21.15.88:0/226324667 conn(0x7f89e40fd100 msgr2=0x7f89e40ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:31.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:31.512+0000 7f89ea708640 1 -- 172.21.15.88:0/226324667 shutdown_connections 2024-09-17T04:17:31.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:31.512+0000 7f89ea708640 1 -- 172.21.15.88:0/226324667 wait complete. 2024-09-17T04:17:32.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:31 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/226324667' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T04:17:32.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:31 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/226324667' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-17T04:17:32.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:31 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/226324667' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T04:17:32.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:31 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/226324667' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-17T04:17:32.374 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-17T04:17:32.375 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-17T04:17:32.375 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-17T04:17:32.412 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-17T04:17:32.673 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi134/config 2024-09-17T04:17:33.055 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:32 smithi134 ceph-mon[35201]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:17:33.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:32 smithi088 ceph-mon[27811]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:17:33.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:33.145+0000 7fdb89f17640 1 -- 172.21.15.134:0/3708239955 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb84102b60 msgr2=0x7fdb84102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:33.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:33.145+0000 7fdb89f17640 1 --2- 172.21.15.134:0/3708239955 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb84102b60 0x7fdb84102fe0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c009880 tx=0x7fdb6c02a4a0 comp rx=0 tx=0).stop 2024-09-17T04:17:33.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:33.145+0000 7fdb89f17640 1 -- 172.21.15.134:0/3708239955 shutdown_connections 2024-09-17T04:17:33.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:33.145+0000 7fdb89f17640 1 --2- 172.21.15.134:0/3708239955 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb84102b60 0x7fdb84102fe0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:33.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:33.145+0000 7fdb89f17640 1 --2- 172.21.15.134:0/3708239955 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb84101960 0x7fdb84101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:33.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:33.145+0000 7fdb89f17640 1 -- 172.21.15.134:0/3708239955 >> 172.21.15.134:0/3708239955 conn(0x7fdb840fd0f0 msgr2=0x7fdb840ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:33.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:33.145+0000 7fdb89f17640 1 -- 172.21.15.134:0/3708239955 shutdown_connections 2024-09-17T04:17:33.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:33.145+0000 7fdb89f17640 1 -- 172.21.15.134:0/3708239955 wait complete. 2024-09-17T04:17:33.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:33.145+0000 7fdb89f17640 1 Processor -- start 2024-09-17T04:17:33.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:33.145+0000 7fdb89f17640 1 -- start start 2024-09-17T04:17:33.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:33.145+0000 7fdb89f17640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb84101960 0x7fdb841974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:33.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:33.145+0000 7fdb89f17640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb84102b60 0x7fdb84197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:33.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:33.145+0000 7fdb89f17640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fdb8410a780 con 0x7fdb84101960 2024-09-17T04:17:33.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:33.145+0000 7fdb89f17640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdb8410a600 con 0x7fdb84102b60 2024-09-17T04:17:33.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:33.146+0000 7fdb7bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb84102b60 0x7fdb84197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:33.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:33.146+0000 7fdb7bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb84102b60 0x7fdb84197a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48190/0 (socket says 172.21.15.134:48190) 2024-09-17T04:17:33.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:33.146+0000 7fdb7bfff640 1 -- 172.21.15.134:0/2489157612 learned_addr learned my addr 172.21.15.134:0/2489157612 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-17T04:17:33.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:33.146+0000 7fdb837fe640 1 --2- 172.21.15.134:0/2489157612 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb84101960 0x7fdb841974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:33.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:33.146+0000 7fdb7bfff640 1 -- 172.21.15.134:0/2489157612 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb84101960 msgr2=0x7fdb841974e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:33.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:33.146+0000 7fdb7bfff640 1 --2- 172.21.15.134:0/2489157612 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb84101960 0x7fdb841974e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:33.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:33.146+0000 7fdb7bfff640 1 -- 172.21.15.134:0/2489157612 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb841980a0 con 0x7fdb84102b60 2024-09-17T04:17:33.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:33.146+0000 7fdb7bfff640 1 --2- 172.21.15.134:0/2489157612 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb84102b60 0x7fdb84197a20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c006010 tx=0x7fdb6c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:33.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:33.146+0000 7fdb817fa640 1 -- 172.21.15.134:0/2489157612 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdb6c03f070 con 0x7fdb84102b60 2024-09-17T04:17:33.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:33.146+0000 7fdb817fa640 1 -- 172.21.15.134:0/2489157612 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdb6c004ac0 con 0x7fdb84102b60 2024-09-17T04:17:33.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:33.146+0000 7fdb89f17640 1 -- 172.21.15.134:0/2489157612 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb8419ca80 con 0x7fdb84102b60 2024-09-17T04:17:33.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:33.146+0000 7fdb817fa640 1 -- 172.21.15.134:0/2489157612 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdb6c035030 con 0x7fdb84102b60 2024-09-17T04:17:33.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:33.146+0000 7fdb89f17640 1 -- 172.21.15.134:0/2489157612 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb8419d010 con 0x7fdb84102b60 2024-09-17T04:17:33.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:33.147+0000 7fdb89f17640 1 -- 172.21.15.134:0/2489157612 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb84101d60 con 0x7fdb84102b60 2024-09-17T04:17:33.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:33.148+0000 7fdb817fa640 1 -- 172.21.15.134:0/2489157612 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fdb6c042070 con 0x7fdb84102b60 2024-09-17T04:17:33.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:33.148+0000 7fdb817fa640 1 --2- 172.21.15.134:0/2489157612 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fdb7006e2b0 0x7fdb70070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:33.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:33.149+0000 7fdb817fa640 1 -- 172.21.15.134:0/2489157612 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fdb6c0ae9e0 con 0x7fdb84102b60 2024-09-17T04:17:33.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:33.149+0000 7fdb837fe640 1 --2- 172.21.15.134:0/2489157612 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fdb7006e2b0 0x7fdb70070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:33.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:33.149+0000 7fdb837fe640 1 --2- 172.21.15.134:0/2489157612 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fdb7006e2b0 0x7fdb70070770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdb841029c0 tx=0x7fdb7400b390 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:33.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:33.153+0000 7fdb817fa640 1 -- 172.21.15.134:0/2489157612 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdb6c080330 con 0x7fdb84102b60 2024-09-17T04:17:33.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:33.379+0000 7fdb89f17640 1 -- 172.21.15.134:0/2489157612 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fdb84191590 con 0x7fdb84102b60 2024-09-17T04:17:33.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:33.384+0000 7fdb817fa640 1 -- 172.21.15.134:0/2489157612 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) ==== 170+0+59 (secure 0 0 0) 0x7fdb6c084b60 con 0x7fdb84102b60 2024-09-17T04:17:33.384 INFO:teuthology.orchestra.run.smithi134.stdout:[client.1] 2024-09-17T04:17:33.384 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDdAulmhyy7FhAAbpwBZMb84TnaukGLaGH2JA== 2024-09-17T04:17:33.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:33.386+0000 7fdb89f17640 1 -- 172.21.15.134:0/2489157612 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fdb7006e2b0 msgr2=0x7fdb70070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:33.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:33.386+0000 7fdb89f17640 1 --2- 172.21.15.134:0/2489157612 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fdb7006e2b0 0x7fdb70070770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdb841029c0 tx=0x7fdb7400b390 comp rx=0 tx=0).stop 2024-09-17T04:17:33.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:33.386+0000 7fdb89f17640 1 -- 172.21.15.134:0/2489157612 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb84102b60 msgr2=0x7fdb84197a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:33.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:33.386+0000 7fdb89f17640 1 --2- 172.21.15.134:0/2489157612 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb84102b60 0x7fdb84197a20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c006010 tx=0x7fdb6c0046c0 comp rx=0 tx=0).stop 2024-09-17T04:17:33.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:33.386+0000 7fdb89f17640 1 -- 172.21.15.134:0/2489157612 shutdown_connections 2024-09-17T04:17:33.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:33.386+0000 7fdb89f17640 1 --2- 172.21.15.134:0/2489157612 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fdb7006e2b0 0x7fdb70070770 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:33.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:33.386+0000 7fdb89f17640 1 --2- 172.21.15.134:0/2489157612 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb84102b60 0x7fdb84197a20 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:33.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:33.386+0000 7fdb89f17640 1 --2- 172.21.15.134:0/2489157612 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb84101960 0x7fdb841974e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:33.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:33.386+0000 7fdb89f17640 1 -- 172.21.15.134:0/2489157612 >> 172.21.15.134:0/2489157612 conn(0x7fdb840fd0f0 msgr2=0x7fdb84106060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:33.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:33.386+0000 7fdb89f17640 1 -- 172.21.15.134:0/2489157612 shutdown_connections 2024-09-17T04:17:33.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:17:33.386+0000 7fdb89f17640 1 -- 172.21.15.134:0/2489157612 wait complete. 2024-09-17T04:17:33.990 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-17T04:17:33.990 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-09-17T04:17:33.990 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-17T04:17:34.027 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph config log 1 --format=json 2024-09-17T04:17:34.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:33 smithi088 ceph-mon[27811]: from='client.? 172.21.15.134:0/2489157612' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T04:17:34.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:33 smithi088 ceph-mon[27811]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T04:17:34.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:33 smithi088 ceph-mon[27811]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-17T04:17:34.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:33 smithi134 ceph-mon[35201]: from='client.? 172.21.15.134:0/2489157612' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T04:17:34.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:33 smithi134 ceph-mon[35201]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T04:17:34.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:33 smithi134 ceph-mon[35201]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-17T04:17:34.284 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:17:34.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:34.754+0000 7f9b9c4c0640 1 -- 172.21.15.88:0/1815918480 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b941033d0 msgr2=0x7f9b9410b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:34.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:34.754+0000 7f9b9c4c0640 1 --2- 172.21.15.88:0/1815918480 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b941033d0 0x7f9b9410b8c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9b88009880 tx=0x7f9b8802a530 comp rx=0 tx=0).stop 2024-09-17T04:17:34.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:34.754+0000 7f9b9c4c0640 1 -- 172.21.15.88:0/1815918480 shutdown_connections 2024-09-17T04:17:34.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:34.754+0000 7f9b9c4c0640 1 --2- 172.21.15.88:0/1815918480 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b941033d0 0x7f9b9410b8c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:34.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:34.754+0000 7f9b9c4c0640 1 --2- 172.21.15.88:0/1815918480 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b94102ab0 0x7f9b94102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:34.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:34.754+0000 7f9b9c4c0640 1 -- 172.21.15.88:0/1815918480 >> 172.21.15.88:0/1815918480 conn(0x7f9b940fc550 msgr2=0x7f9b940fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:34.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:34.754+0000 7f9b9c4c0640 1 -- 172.21.15.88:0/1815918480 shutdown_connections 2024-09-17T04:17:34.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:34.754+0000 7f9b9c4c0640 1 -- 172.21.15.88:0/1815918480 wait complete. 2024-09-17T04:17:34.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:34.755+0000 7f9b9c4c0640 1 Processor -- start 2024-09-17T04:17:34.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:34.755+0000 7f9b9c4c0640 1 -- start start 2024-09-17T04:17:34.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:34.755+0000 7f9b9c4c0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b94102ab0 0x7f9b9419d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:34.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:34.755+0000 7f9b9c4c0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b941033d0 0x7f9b9419dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:34.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:34.755+0000 7f9b9c4c0640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f9b9410ede0 con 0x7f9b941033d0 2024-09-17T04:17:34.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:34.755+0000 7f9b9c4c0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9b9410ec60 con 0x7f9b94102ab0 2024-09-17T04:17:34.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:34.755+0000 7f9b99a5b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b941033d0 0x7f9b9419dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:34.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:34.755+0000 7f9b99a5b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b941033d0 0x7f9b9419dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51020/0 (socket says 172.21.15.88:51020) 2024-09-17T04:17:34.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:34.755+0000 7f9b99a5b640 1 -- 172.21.15.88:0/1774326520 learned_addr learned my addr 172.21.15.88:0/1774326520 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:17:34.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:34.755+0000 7f9b9a25c640 1 --2- 172.21.15.88:0/1774326520 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b94102ab0 0x7f9b9419d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:34.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:34.755+0000 7f9b99a5b640 1 -- 172.21.15.88:0/1774326520 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b94102ab0 msgr2=0x7f9b9419d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:34.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:34.755+0000 7f9b99a5b640 1 --2- 172.21.15.88:0/1774326520 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b94102ab0 0x7f9b9419d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:34.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:34.755+0000 7f9b99a5b640 1 -- 172.21.15.88:0/1774326520 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b94197810 con 0x7f9b941033d0 2024-09-17T04:17:34.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:34.755+0000 7f9b99a5b640 1 --2- 172.21.15.88:0/1774326520 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b941033d0 0x7f9b9419dbd0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9b88031460 tx=0x7f9b880045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:34.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:34.756+0000 7f9b937fe640 1 -- 172.21.15.88:0/1774326520 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9b8803f070 con 0x7f9b941033d0 2024-09-17T04:17:34.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:34.756+0000 7f9b937fe640 1 -- 172.21.15.88:0/1774326520 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9b880035f0 con 0x7f9b941033d0 2024-09-17T04:17:34.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:34.756+0000 7f9b9c4c0640 1 -- 172.21.15.88:0/1774326520 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b94197aa0 con 0x7f9b941033d0 2024-09-17T04:17:34.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:34.756+0000 7f9b937fe640 1 -- 172.21.15.88:0/1774326520 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9b88035030 con 0x7f9b941033d0 2024-09-17T04:17:34.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:34.756+0000 7f9b9c4c0640 1 -- 172.21.15.88:0/1774326520 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b94197fd0 con 0x7f9b941033d0 2024-09-17T04:17:34.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:34.757+0000 7f9b9c4c0640 1 -- 172.21.15.88:0/1774326520 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b9406a580 con 0x7f9b941033d0 2024-09-17T04:17:34.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:34.757+0000 7f9b937fe640 1 -- 172.21.15.88:0/1774326520 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f9b88042070 con 0x7f9b941033d0 2024-09-17T04:17:34.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:34.758+0000 7f9b937fe640 1 --2- 172.21.15.88:0/1774326520 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f9b7c06e310 0x7f9b7c0707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:34.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:34.758+0000 7f9b937fe640 1 -- 172.21.15.88:0/1774326520 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f9b880ae4f0 con 0x7f9b941033d0 2024-09-17T04:17:34.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:34.758+0000 7f9b9a25c640 1 --2- 172.21.15.88:0/1774326520 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f9b7c06e310 0x7f9b7c0707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:34.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:34.758+0000 7f9b9a25c640 1 --2- 172.21.15.88:0/1774326520 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f9b7c06e310 0x7f9b7c0707d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c005fd0 tx=0x7f9b8c009500 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:34.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:34.762+0000 7f9b937fe640 1 -- 172.21.15.88:0/1774326520 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9b8807fec0 con 0x7f9b941033d0 2024-09-17T04:17:34.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:34.931+0000 7f9b9c4c0640 1 -- 172.21.15.88:0/1774326520 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f9b94198d40 con 0x7f9b941033d0 2024-09-17T04:17:34.932 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:34 smithi088 ceph-mon[27811]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:17:34.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:34.931+0000 7f9b937fe640 1 -- 172.21.15.88:0/1774326520 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v43) ==== 86+0+187 (secure 0 0 0) 0x7f9b880ae310 con 0x7f9b941033d0 2024-09-17T04:17:34.933 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:17:34.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:34.934+0000 7f9b9c4c0640 1 -- 172.21.15.88:0/1774326520 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f9b7c06e310 msgr2=0x7f9b7c0707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:34.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:34.934+0000 7f9b9c4c0640 1 --2- 172.21.15.88:0/1774326520 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f9b7c06e310 0x7f9b7c0707d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c005fd0 tx=0x7f9b8c009500 comp rx=0 tx=0).stop 2024-09-17T04:17:34.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:34.934+0000 7f9b9c4c0640 1 -- 172.21.15.88:0/1774326520 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b941033d0 msgr2=0x7f9b9419dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:34.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:34.934+0000 7f9b9c4c0640 1 --2- 172.21.15.88:0/1774326520 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b941033d0 0x7f9b9419dbd0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9b88031460 tx=0x7f9b880045c0 comp rx=0 tx=0).stop 2024-09-17T04:17:34.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:34.934+0000 7f9b9c4c0640 1 -- 172.21.15.88:0/1774326520 shutdown_connections 2024-09-17T04:17:34.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:34.934+0000 7f9b9c4c0640 1 --2- 172.21.15.88:0/1774326520 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f9b7c06e310 0x7f9b7c0707d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:34.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:34.934+0000 7f9b9c4c0640 1 --2- 172.21.15.88:0/1774326520 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b941033d0 0x7f9b9419dbd0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:34.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:34.934+0000 7f9b9c4c0640 1 --2- 172.21.15.88:0/1774326520 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b94102ab0 0x7f9b9419d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:34.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:34.934+0000 7f9b9c4c0640 1 -- 172.21.15.88:0/1774326520 >> 172.21.15.88:0/1774326520 conn(0x7f9b940fc550 msgr2=0x7f9b94108ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:34.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:34.934+0000 7f9b9c4c0640 1 -- 172.21.15.88:0/1774326520 shutdown_connections 2024-09-17T04:17:34.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:34.934+0000 7f9b9c4c0640 1 -- 172.21.15.88:0/1774326520 wait complete. 2024-09-17T04:17:35.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:34 smithi134 ceph-mon[35201]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:17:35.681 INFO:teuthology.orchestra.run.smithi088.stdout:[{"version":43,"timestamp":"2024-09-17T04:17:23.789955+0000","name":"","changes":[{"name":"osd/host:smithi134/osd_memory_target","previous_value":"7818253107","new_value":"5212168738"}]}] 2024-09-17T04:17:35.682 INFO:tasks.ceph_manager:config epoch is 43 2024-09-17T04:17:35.682 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-17T04:17:35.682 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-17T04:17:35.682 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-17T04:17:35.928 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:17:36.048 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:35 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/1774326520' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2024-09-17T04:17:36.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:35 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/1774326520' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2024-09-17T04:17:36.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:36.384+0000 7ff554e7b640 1 -- 172.21.15.88:0/3857012739 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff550106800 msgr2=0x7ff550106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:36.406 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:36.384+0000 7ff554e7b640 1 --2- 172.21.15.88:0/3857012739 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff550106800 0x7ff550106be0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff548009c20 tx=0x7ff54802a970 comp rx=0 tx=0).stop 2024-09-17T04:17:36.406 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:36.384+0000 7ff554e7b640 1 -- 172.21.15.88:0/3857012739 shutdown_connections 2024-09-17T04:17:36.406 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:36.384+0000 7ff554e7b640 1 --2- 172.21.15.88:0/3857012739 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff550100800 0x7ff550100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:36.406 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:36.384+0000 7ff554e7b640 1 --2- 172.21.15.88:0/3857012739 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff550106800 0x7ff550106be0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:36.406 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:36.384+0000 7ff554e7b640 1 -- 172.21.15.88:0/3857012739 >> 172.21.15.88:0/3857012739 conn(0x7ff5500fc520 msgr2=0x7ff5500fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:36.406 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:36.384+0000 7ff554e7b640 1 -- 172.21.15.88:0/3857012739 shutdown_connections 2024-09-17T04:17:36.406 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:36.384+0000 7ff554e7b640 1 -- 172.21.15.88:0/3857012739 wait complete. 2024-09-17T04:17:36.406 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:36.385+0000 7ff554e7b640 1 Processor -- start 2024-09-17T04:17:36.406 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:36.385+0000 7ff554e7b640 1 -- start start 2024-09-17T04:17:36.406 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:36.385+0000 7ff554e7b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff550100800 0x7ff55019c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:36.406 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:36.385+0000 7ff554e7b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff550106800 0x7ff55019cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:36.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:36.385+0000 7ff554e7b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ff55010dd30 con 0x7ff550106800 2024-09-17T04:17:36.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:36.385+0000 7ff554e7b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff55010dbb0 con 0x7ff550100800 2024-09-17T04:17:36.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:36.385+0000 7ff54dd9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff550106800 0x7ff55019cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:36.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:36.385+0000 7ff54dd9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff550106800 0x7ff55019cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51028/0 (socket says 172.21.15.88:51028) 2024-09-17T04:17:36.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:36.385+0000 7ff54dd9b640 1 -- 172.21.15.88:0/2781375152 learned_addr learned my addr 172.21.15.88:0/2781375152 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:17:36.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:36.386+0000 7ff54e59c640 1 --2- 172.21.15.88:0/2781375152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff550100800 0x7ff55019c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:36.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:36.386+0000 7ff54dd9b640 1 -- 172.21.15.88:0/2781375152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff550100800 msgr2=0x7ff55019c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:36.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:36.386+0000 7ff54dd9b640 1 --2- 172.21.15.88:0/2781375152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff550100800 0x7ff55019c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:36.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:36.386+0000 7ff54dd9b640 1 -- 172.21.15.88:0/2781375152 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5501967c0 con 0x7ff550106800 2024-09-17T04:17:36.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:36.386+0000 7ff54e59c640 1 --2- 172.21.15.88:0/2781375152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff550100800 0x7ff55019c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:17:36.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:36.386+0000 7ff54dd9b640 1 --2- 172.21.15.88:0/2781375152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff550106800 0x7ff55019cb80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff53800b420 tx=0x7ff53800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:36.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:36.386+0000 7ff5477fe640 1 -- 172.21.15.88:0/2781375152 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff538011630 con 0x7ff550106800 2024-09-17T04:17:36.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:36.386+0000 7ff5477fe640 1 -- 172.21.15.88:0/2781375152 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff538016070 con 0x7ff550106800 2024-09-17T04:17:36.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:36.386+0000 7ff554e7b640 1 -- 172.21.15.88:0/2781375152 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff550196ab0 con 0x7ff550106800 2024-09-17T04:17:36.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:36.386+0000 7ff5477fe640 1 -- 172.21.15.88:0/2781375152 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff538010d40 con 0x7ff550106800 2024-09-17T04:17:36.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:36.386+0000 7ff554e7b640 1 -- 172.21.15.88:0/2781375152 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff550197040 con 0x7ff550106800 2024-09-17T04:17:36.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:36.387+0000 7ff554e7b640 1 -- 172.21.15.88:0/2781375152 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff550101f40 con 0x7ff550106800 2024-09-17T04:17:36.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:36.388+0000 7ff5477fe640 1 -- 172.21.15.88:0/2781375152 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7ff53801b460 con 0x7ff550106800 2024-09-17T04:17:36.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:36.388+0000 7ff5477fe640 1 --2- 172.21.15.88:0/2781375152 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7ff53c06e310 0x7ff53c0707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:36.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:36.388+0000 7ff5477fe640 1 -- 172.21.15.88:0/2781375152 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7ff53808d5f0 con 0x7ff550106800 2024-09-17T04:17:36.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:36.388+0000 7ff54e59c640 1 --2- 172.21.15.88:0/2781375152 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7ff53c06e310 0x7ff53c0707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:36.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:36.389+0000 7ff54e59c640 1 --2- 172.21.15.88:0/2781375152 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7ff53c06e310 0x7ff53c0707d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff548005e30 tx=0x7ff548005da0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:36.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:36.392+0000 7ff5477fe640 1 -- 172.21.15.88:0/2781375152 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff53805b310 con 0x7ff550106800 2024-09-17T04:17:36.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:36.604+0000 7ff554e7b640 1 -- 172.21.15.88:0/2781375152 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7ff550108d70 con 0x7ff550106800 2024-09-17T04:17:36.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:36.607+0000 7ff5477fe640 1 -- 172.21.15.88:0/2781375152 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) ==== 74+0+176563 (secure 0 0 0) 0x7ff53808d410 con 0x7ff550106800 2024-09-17T04:17:36.611 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:17:36.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:36.611+0000 7ff554e7b640 1 -- 172.21.15.88:0/2781375152 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7ff53c06e310 msgr2=0x7ff53c0707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:36.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:36.611+0000 7ff554e7b640 1 --2- 172.21.15.88:0/2781375152 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7ff53c06e310 0x7ff53c0707d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff548005e30 tx=0x7ff548005da0 comp rx=0 tx=0).stop 2024-09-17T04:17:36.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:36.611+0000 7ff554e7b640 1 -- 172.21.15.88:0/2781375152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff550106800 msgr2=0x7ff55019cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:36.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:36.611+0000 7ff554e7b640 1 --2- 172.21.15.88:0/2781375152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff550106800 0x7ff55019cb80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff53800b420 tx=0x7ff53800b8e0 comp rx=0 tx=0).stop 2024-09-17T04:17:36.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:36.611+0000 7ff554e7b640 1 -- 172.21.15.88:0/2781375152 shutdown_connections 2024-09-17T04:17:36.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:36.611+0000 7ff554e7b640 1 --2- 172.21.15.88:0/2781375152 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7ff53c06e310 0x7ff53c0707d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:36.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:36.611+0000 7ff554e7b640 1 --2- 172.21.15.88:0/2781375152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff550106800 0x7ff55019cb80 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:36.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:36.611+0000 7ff554e7b640 1 --2- 172.21.15.88:0/2781375152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff550100800 0x7ff55019c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:36.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:36.611+0000 7ff554e7b640 1 -- 172.21.15.88:0/2781375152 >> 172.21.15.88:0/2781375152 conn(0x7ff5500fc520 msgr2=0x7ff5500fcf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:36.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:36.611+0000 7ff554e7b640 1 -- 172.21.15.88:0/2781375152 shutdown_connections 2024-09-17T04:17:36.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:36.611+0000 7ff554e7b640 1 -- 172.21.15.88:0/2781375152 wait complete. 2024-09-17T04:17:37.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:36 smithi088 ceph-mon[27811]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:17:37.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:36 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/2781375152' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-17T04:17:37.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:36 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:17:37.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:36 smithi134 ceph-mon[35201]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:17:37.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:36 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/2781375152' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-17T04:17:37.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:36 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:17:37.289 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":19,"flags":0,"active_gid":14217,"active_name":"smithi088.wmndiv","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1666801150},{"type":"v1","addr":"172.21.15.88:6801","nonce":1666801150}]},"active_addr":"172.21.15.88:6801/1666801150","active_change":"2024-09-17T04:13:21.738910+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":14242,"name":"smithi134.vwdxcb","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.88:8443/","prometheus":"http://172.21.15.88:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.88:0","nonce":1144222027}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.88:0","nonce":623494993}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.88:0","nonce":142846725}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.88:0","nonce":965301034}]}]} 2024-09-17T04:17:37.294 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-17T04:17:37.294 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-17T04:17:37.294 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-17T04:17:37.542 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:17:38.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:38.000+0000 7f0453657640 1 -- 172.21.15.88:0/2303826299 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f044c1033d0 msgr2=0x7f044c10b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:38.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:38.000+0000 7f0453657640 1 --2- 172.21.15.88:0/2303826299 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f044c1033d0 0x7f044c10b8c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0440009880 tx=0x7f044002a530 comp rx=0 tx=0).stop 2024-09-17T04:17:38.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:38.000+0000 7f0453657640 1 -- 172.21.15.88:0/2303826299 shutdown_connections 2024-09-17T04:17:38.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:38.000+0000 7f0453657640 1 --2- 172.21.15.88:0/2303826299 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f044c1033d0 0x7f044c10b8c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:38.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:38.000+0000 7f0453657640 1 --2- 172.21.15.88:0/2303826299 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f044c102ab0 0x7f044c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:38.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:38.000+0000 7f0453657640 1 -- 172.21.15.88:0/2303826299 >> 172.21.15.88:0/2303826299 conn(0x7f044c0fc550 msgr2=0x7f044c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:38.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:38.000+0000 7f0453657640 1 -- 172.21.15.88:0/2303826299 shutdown_connections 2024-09-17T04:17:38.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:38.000+0000 7f0453657640 1 -- 172.21.15.88:0/2303826299 wait complete. 2024-09-17T04:17:38.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:38.000+0000 7f0453657640 1 Processor -- start 2024-09-17T04:17:38.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:38.000+0000 7f0453657640 1 -- start start 2024-09-17T04:17:38.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:38.001+0000 7f0453657640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f044c102ab0 0x7f044c19d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:38.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:38.001+0000 7f0453657640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f044c1033d0 0x7f044c19db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:38.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:38.001+0000 7f0453657640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f044c10edc0 con 0x7f044c1033d0 2024-09-17T04:17:38.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:38.001+0000 7f0453657640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f044c10ec40 con 0x7f044c102ab0 2024-09-17T04:17:38.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:38.001+0000 7f0450bf2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f044c1033d0 0x7f044c19db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:38.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:38.001+0000 7f0450bf2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f044c1033d0 0x7f044c19db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51046/0 (socket says 172.21.15.88:51046) 2024-09-17T04:17:38.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:38.001+0000 7f0450bf2640 1 -- 172.21.15.88:0/3587306988 learned_addr learned my addr 172.21.15.88:0/3587306988 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:17:38.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:38.001+0000 7f04513f3640 1 --2- 172.21.15.88:0/3587306988 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f044c102ab0 0x7f044c19d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:38.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:38.001+0000 7f0450bf2640 1 -- 172.21.15.88:0/3587306988 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f044c102ab0 msgr2=0x7f044c19d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:38.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:38.001+0000 7f0450bf2640 1 --2- 172.21.15.88:0/3587306988 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f044c102ab0 0x7f044c19d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:38.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:38.001+0000 7f0450bf2640 1 -- 172.21.15.88:0/3587306988 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f044c197790 con 0x7f044c1033d0 2024-09-17T04:17:38.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:38.001+0000 7f0450bf2640 1 --2- 172.21.15.88:0/3587306988 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f044c1033d0 0x7f044c19db50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0440031460 tx=0x7f04400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:38.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:38.001+0000 7f044a7fc640 1 -- 172.21.15.88:0/3587306988 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f044003f070 con 0x7f044c1033d0 2024-09-17T04:17:38.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:38.001+0000 7f0453657640 1 -- 172.21.15.88:0/3587306988 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f044c197a20 con 0x7f044c1033d0 2024-09-17T04:17:38.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:38.001+0000 7f044a7fc640 1 -- 172.21.15.88:0/3587306988 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0440004ac0 con 0x7f044c1033d0 2024-09-17T04:17:38.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:38.001+0000 7f044a7fc640 1 -- 172.21.15.88:0/3587306988 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0440035030 con 0x7f044c1033d0 2024-09-17T04:17:38.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:38.001+0000 7f0453657640 1 -- 172.21.15.88:0/3587306988 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f044c197f50 con 0x7f044c1033d0 2024-09-17T04:17:38.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:38.002+0000 7f0453657640 1 -- 172.21.15.88:0/3587306988 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f044c06a580 con 0x7f044c1033d0 2024-09-17T04:17:38.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:38.003+0000 7f044a7fc640 1 -- 172.21.15.88:0/3587306988 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f0440042070 con 0x7f044c1033d0 2024-09-17T04:17:38.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:38.003+0000 7f044a7fc640 1 --2- 172.21.15.88:0/3587306988 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f043406e2b0 0x7f0434070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:38.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:38.003+0000 7f044a7fc640 1 -- 172.21.15.88:0/3587306988 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f04400ae820 con 0x7f044c1033d0 2024-09-17T04:17:38.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:38.003+0000 7f04513f3640 1 --2- 172.21.15.88:0/3587306988 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f043406e2b0 0x7f0434070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:38.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:38.004+0000 7f04513f3640 1 --2- 172.21.15.88:0/3587306988 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f043406e2b0 0x7f0434070770 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f043c007350 tx=0x7f043c0072e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:38.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:38.007+0000 7f044a7fc640 1 -- 172.21.15.88:0/3587306988 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f044007c4c0 con 0x7f044c1033d0 2024-09-17T04:17:38.176 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:38.175+0000 7f0453657640 1 -- 172.21.15.88:0/3587306988 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f044c198cc0 con 0x7f044c1033d0 2024-09-17T04:17:38.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:38.176+0000 7f044a7fc640 1 -- 172.21.15.88:0/3587306988 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+11388 (secure 0 0 0) 0x7f0440080170 con 0x7f044c1033d0 2024-09-17T04:17:38.177 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:17:38.177 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":39,"fsid":"bf2b79a4-74aa-11ef-bceb-c7b262605968","created":"2024-09-17T04:11:28.340394+0000","modified":"2024-09-17T04:17:25.557153+0000","last_up_change":"2024-09-17T04:17:24.555775+0000","last_in_change":"2024-09-17T04:17:01.088967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T04:16:08.048076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a576201e-1335-4edf-8e9a-3e62264f3bef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":2896435780},{"type":"v1","addr":"172.21.15.88:6803","nonce":2896435780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":2896435780},{"type":"v1","addr":"172.21.15.88:6805","nonce":2896435780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2896435780},{"type":"v1","addr":"172.21.15.88:6809","nonce":2896435780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":2896435780},{"type":"v1","addr":"172.21.15.88:6807","nonce":2896435780}]},"public_addr":"172.21.15.88:6803/2896435780","cluster_addr":"172.21.15.88:6805/2896435780","heartbeat_back_addr":"172.21.15.88:6809/2896435780","heartbeat_front_addr":"172.21.15.88:6807/2896435780","state":["exists","up"]},{"osd":1,"uuid":"2b6a97ae-75a3-437c-ad8a-b5dde2819592","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":1101608666},{"type":"v1","addr":"172.21.15.88:6811","nonce":1101608666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1101608666},{"type":"v1","addr":"172.21.15.88:6813","nonce":1101608666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1101608666},{"type":"v1","addr":"172.21.15.88:6817","nonce":1101608666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":1101608666},{"type":"v1","addr":"172.21.15.88:6815","nonce":1101608666}]},"public_addr":"172.21.15.88:6811/1101608666","cluster_addr":"172.21.15.88:6813/1101608666","heartbeat_back_addr":"172.21.15.88:6817/1101608666","heartbeat_front_addr":"172.21.15.88:6815/1101608666","state":["exists","up"]},{"osd":2,"uuid":"e57fd249-3087-439b-9ced-1d733503f1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3973957395},{"type":"v1","addr":"172.21.15.88:6819","nonce":3973957395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3973957395},{"type":"v1","addr":"172.21.15.88:6821","nonce":3973957395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":3973957395},{"type":"v1","addr":"172.21.15.88:6825","nonce":3973957395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3973957395},{"type":"v1","addr":"172.21.15.88:6823","nonce":3973957395}]},"public_addr":"172.21.15.88:6819/3973957395","cluster_addr":"172.21.15.88:6821/3973957395","heartbeat_back_addr":"172.21.15.88:6825/3973957395","heartbeat_front_addr":"172.21.15.88:6823/3973957395","state":["exists","up"]},{"osd":3,"uuid":"abb0ae43-4561-4ffe-89c4-20a3cbe1e817","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1430236667},{"type":"v1","addr":"172.21.15.134:6801","nonce":1430236667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1430236667},{"type":"v1","addr":"172.21.15.134:6803","nonce":1430236667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1430236667},{"type":"v1","addr":"172.21.15.134:6807","nonce":1430236667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1430236667},{"type":"v1","addr":"172.21.15.134:6805","nonce":1430236667}]},"public_addr":"172.21.15.134:6801/1430236667","cluster_addr":"172.21.15.134:6803/1430236667","heartbeat_back_addr":"172.21.15.134:6807/1430236667","heartbeat_front_addr":"172.21.15.134:6805/1430236667","state":["exists","up"]},{"osd":4,"uuid":"33c07ebe-d45d-478f-b8a9-991d462568f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":764689261},{"type":"v1","addr":"172.21.15.134:6809","nonce":764689261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":764689261},{"type":"v1","addr":"172.21.15.134:6811","nonce":764689261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":764689261},{"type":"v1","addr":"172.21.15.134:6815","nonce":764689261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":764689261},{"type":"v1","addr":"172.21.15.134:6813","nonce":764689261}]},"public_addr":"172.21.15.134:6809/764689261","cluster_addr":"172.21.15.134:6811/764689261","heartbeat_back_addr":"172.21.15.134:6815/764689261","heartbeat_front_addr":"172.21.15.134:6813/764689261","state":["exists","up"]},{"osd":5,"uuid":"7ef9ab40-b3dd-4208-a3c3-1dc86dd74239","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3477898981},{"type":"v1","addr":"172.21.15.134:6817","nonce":3477898981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3477898981},{"type":"v1","addr":"172.21.15.134:6819","nonce":3477898981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3477898981},{"type":"v1","addr":"172.21.15.134:6823","nonce":3477898981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3477898981},{"type":"v1","addr":"172.21.15.134:6821","nonce":3477898981}]},"public_addr":"172.21.15.134:6817/3477898981","cluster_addr":"172.21.15.134:6819/3477898981","heartbeat_back_addr":"172.21.15.134:6823/3477898981","heartbeat_front_addr":"172.21.15.134:6821/3477898981","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:15:03.639854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:15:35.145583+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:16:03.983073+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:16:29.207130+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:16:56.273448+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:17:22.708485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.88:6801/245760742":"2024-09-18T04:13:21.738800+0000","172.21.15.88:6800/245760742":"2024-09-18T04:13:21.738800+0000","172.21.15.88:0/233265505":"2024-09-18T04:11:52.936995+0000","172.21.15.88:6801/2871304666":"2024-09-18T04:11:52.936995+0000","172.21.15.88:0/910347675":"2024-09-18T04:12:24.422352+0000","172.21.15.88:0/433412784":"2024-09-18T04:11:52.936995+0000","172.21.15.88:0/1996066407":"2024-09-18T04:11:52.936995+0000","172.21.15.88:0/602105794":"2024-09-18T04:12:24.422352+0000","172.21.15.88:6801/2756720871":"2024-09-18T04:12:24.422352+0000","172.21.15.88:6800/2871304666":"2024-09-18T04:11:52.936995+0000","172.21.15.88:0/2048077731":"2024-09-18T04:13:21.738800+0000","172.21.15.88:6800/2756720871":"2024-09-18T04:12:24.422352+0000","172.21.15.88:0/469592792":"2024-09-18T04:12:24.422352+0000","172.21.15.88:0/2258563085":"2024-09-18T04:13:21.738800+0000","172.21.15.88:0/73613879":"2024-09-18T04:13:21.738800+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T04:17:38.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:38.178+0000 7f0453657640 1 -- 172.21.15.88:0/3587306988 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f043406e2b0 msgr2=0x7f0434070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:38.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:38.178+0000 7f0453657640 1 --2- 172.21.15.88:0/3587306988 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f043406e2b0 0x7f0434070770 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f043c007350 tx=0x7f043c0072e0 comp rx=0 tx=0).stop 2024-09-17T04:17:38.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:38.178+0000 7f0453657640 1 -- 172.21.15.88:0/3587306988 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f044c1033d0 msgr2=0x7f044c19db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:38.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:38.178+0000 7f0453657640 1 --2- 172.21.15.88:0/3587306988 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f044c1033d0 0x7f044c19db50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0440031460 tx=0x7f04400046c0 comp rx=0 tx=0).stop 2024-09-17T04:17:38.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:38.178+0000 7f0453657640 1 -- 172.21.15.88:0/3587306988 shutdown_connections 2024-09-17T04:17:38.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:38.178+0000 7f0453657640 1 --2- 172.21.15.88:0/3587306988 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f043406e2b0 0x7f0434070770 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:38.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:38.178+0000 7f0453657640 1 --2- 172.21.15.88:0/3587306988 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f044c1033d0 0x7f044c19db50 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:38.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:38.178+0000 7f0453657640 1 --2- 172.21.15.88:0/3587306988 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f044c102ab0 0x7f044c19d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:38.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:38.178+0000 7f0453657640 1 -- 172.21.15.88:0/3587306988 >> 172.21.15.88:0/3587306988 conn(0x7f044c0fc550 msgr2=0x7f044c10aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:38.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:38.178+0000 7f0453657640 1 -- 172.21.15.88:0/3587306988 shutdown_connections 2024-09-17T04:17:38.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:38.178+0000 7f0453657640 1 -- 172.21.15.88:0/3587306988 wait complete. 2024-09-17T04:17:38.847 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-17T04:17:38.848 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-17T04:17:39.094 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:17:39.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:38 smithi088 ceph-mon[27811]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:17:39.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:38 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/3587306988' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T04:17:39.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:38 smithi134 ceph-mon[35201]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:17:39.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:38 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/3587306988' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T04:17:39.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:39.508+0000 7fc544747640 1 -- 172.21.15.88:0/4023629160 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc53c107900 msgr2=0x7fc53c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:39.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:39.508+0000 7fc544747640 1 --2- 172.21.15.88:0/4023629160 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc53c107900 0x7fc53c107ce0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc52c009880 tx=0x7fc52c02a4a0 comp rx=0 tx=0).stop 2024-09-17T04:17:39.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:39.508+0000 7fc544747640 1 -- 172.21.15.88:0/4023629160 shutdown_connections 2024-09-17T04:17:39.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:39.508+0000 7fc544747640 1 --2- 172.21.15.88:0/4023629160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc53c101900 0x7fc53c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:39.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:39.508+0000 7fc544747640 1 --2- 172.21.15.88:0/4023629160 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc53c107900 0x7fc53c107ce0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:39.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:39.508+0000 7fc544747640 1 -- 172.21.15.88:0/4023629160 >> 172.21.15.88:0/4023629160 conn(0x7fc53c0fd600 msgr2=0x7fc53c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:39.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:39.508+0000 7fc544747640 1 -- 172.21.15.88:0/4023629160 shutdown_connections 2024-09-17T04:17:39.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:39.508+0000 7fc544747640 1 -- 172.21.15.88:0/4023629160 wait complete. 2024-09-17T04:17:39.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:39.509+0000 7fc544747640 1 Processor -- start 2024-09-17T04:17:39.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:39.509+0000 7fc544747640 1 -- start start 2024-09-17T04:17:39.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:39.509+0000 7fc544747640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc53c101900 0x7fc53c19d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:39.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:39.509+0000 7fc544747640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc53c107900 0x7fc53c19dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:39.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:39.509+0000 7fc544747640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc53c10ee30 con 0x7fc53c101900 2024-09-17T04:17:39.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:39.509+0000 7fc544747640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc53c10ecb0 con 0x7fc53c107900 2024-09-17T04:17:39.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:39.509+0000 7fc5424e3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc53c101900 0x7fc53c19d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:39.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:39.509+0000 7fc5424e3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc53c101900 0x7fc53c19d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51068/0 (socket says 172.21.15.88:51068) 2024-09-17T04:17:39.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:39.509+0000 7fc5424e3640 1 -- 172.21.15.88:0/3796465556 learned_addr learned my addr 172.21.15.88:0/3796465556 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:17:39.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:39.510+0000 7fc541ce2640 1 --2- 172.21.15.88:0/3796465556 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc53c107900 0x7fc53c19dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:39.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:39.510+0000 7fc5424e3640 1 -- 172.21.15.88:0/3796465556 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc53c107900 msgr2=0x7fc53c19dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:39.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:39.510+0000 7fc5424e3640 1 --2- 172.21.15.88:0/3796465556 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc53c107900 0x7fc53c19dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:39.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:39.510+0000 7fc5424e3640 1 -- 172.21.15.88:0/3796465556 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc53c197880 con 0x7fc53c101900 2024-09-17T04:17:39.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:39.510+0000 7fc5424e3640 1 --2- 172.21.15.88:0/3796465556 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc53c101900 0x7fc53c19d6c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc52c031460 tx=0x7fc52c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:39.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:39.510+0000 7fc5337fe640 1 -- 172.21.15.88:0/3796465556 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc52c03f070 con 0x7fc53c101900 2024-09-17T04:17:39.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:39.510+0000 7fc544747640 1 -- 172.21.15.88:0/3796465556 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc53c197b10 con 0x7fc53c101900 2024-09-17T04:17:39.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:39.510+0000 7fc5337fe640 1 -- 172.21.15.88:0/3796465556 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc52c004cf0 con 0x7fc53c101900 2024-09-17T04:17:39.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:39.510+0000 7fc5337fe640 1 -- 172.21.15.88:0/3796465556 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc52c035030 con 0x7fc53c101900 2024-09-17T04:17:39.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:39.510+0000 7fc544747640 1 -- 172.21.15.88:0/3796465556 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc53c198040 con 0x7fc53c101900 2024-09-17T04:17:39.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:39.511+0000 7fc544747640 1 -- 172.21.15.88:0/3796465556 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc53c103040 con 0x7fc53c101900 2024-09-17T04:17:39.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:39.512+0000 7fc5337fe640 1 -- 172.21.15.88:0/3796465556 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fc52c042070 con 0x7fc53c101900 2024-09-17T04:17:39.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:39.512+0000 7fc5337fe640 1 --2- 172.21.15.88:0/3796465556 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fc52806e2b0 0x7fc528070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:39.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:39.512+0000 7fc5337fe640 1 -- 172.21.15.88:0/3796465556 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fc52c0ae910 con 0x7fc53c101900 2024-09-17T04:17:39.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:39.512+0000 7fc541ce2640 1 --2- 172.21.15.88:0/3796465556 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fc52806e2b0 0x7fc528070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:39.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:39.513+0000 7fc541ce2640 1 --2- 172.21.15.88:0/3796465556 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fc52806e2b0 0x7fc528070770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc53c0ffbf0 tx=0x7fc538008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:39.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:39.516+0000 7fc5337fe640 1 -- 172.21.15.88:0/3796465556 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc52c07c5b0 con 0x7fc53c101900 2024-09-17T04:17:39.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:39.683+0000 7fc544747640 1 -- 172.21.15.88:0/3796465556 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc53c198db0 con 0x7fc53c101900 2024-09-17T04:17:39.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:39.684+0000 7fc5337fe640 1 -- 172.21.15.88:0/3796465556 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+11388 (secure 0 0 0) 0x7fc52c080260 con 0x7fc53c101900 2024-09-17T04:17:39.684 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:17:39.684 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":39,"fsid":"bf2b79a4-74aa-11ef-bceb-c7b262605968","created":"2024-09-17T04:11:28.340394+0000","modified":"2024-09-17T04:17:25.557153+0000","last_up_change":"2024-09-17T04:17:24.555775+0000","last_in_change":"2024-09-17T04:17:01.088967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T04:16:08.048076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a576201e-1335-4edf-8e9a-3e62264f3bef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":2896435780},{"type":"v1","addr":"172.21.15.88:6803","nonce":2896435780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":2896435780},{"type":"v1","addr":"172.21.15.88:6805","nonce":2896435780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2896435780},{"type":"v1","addr":"172.21.15.88:6809","nonce":2896435780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":2896435780},{"type":"v1","addr":"172.21.15.88:6807","nonce":2896435780}]},"public_addr":"172.21.15.88:6803/2896435780","cluster_addr":"172.21.15.88:6805/2896435780","heartbeat_back_addr":"172.21.15.88:6809/2896435780","heartbeat_front_addr":"172.21.15.88:6807/2896435780","state":["exists","up"]},{"osd":1,"uuid":"2b6a97ae-75a3-437c-ad8a-b5dde2819592","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":1101608666},{"type":"v1","addr":"172.21.15.88:6811","nonce":1101608666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1101608666},{"type":"v1","addr":"172.21.15.88:6813","nonce":1101608666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1101608666},{"type":"v1","addr":"172.21.15.88:6817","nonce":1101608666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":1101608666},{"type":"v1","addr":"172.21.15.88:6815","nonce":1101608666}]},"public_addr":"172.21.15.88:6811/1101608666","cluster_addr":"172.21.15.88:6813/1101608666","heartbeat_back_addr":"172.21.15.88:6817/1101608666","heartbeat_front_addr":"172.21.15.88:6815/1101608666","state":["exists","up"]},{"osd":2,"uuid":"e57fd249-3087-439b-9ced-1d733503f1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3973957395},{"type":"v1","addr":"172.21.15.88:6819","nonce":3973957395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3973957395},{"type":"v1","addr":"172.21.15.88:6821","nonce":3973957395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":3973957395},{"type":"v1","addr":"172.21.15.88:6825","nonce":3973957395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3973957395},{"type":"v1","addr":"172.21.15.88:6823","nonce":3973957395}]},"public_addr":"172.21.15.88:6819/3973957395","cluster_addr":"172.21.15.88:6821/3973957395","heartbeat_back_addr":"172.21.15.88:6825/3973957395","heartbeat_front_addr":"172.21.15.88:6823/3973957395","state":["exists","up"]},{"osd":3,"uuid":"abb0ae43-4561-4ffe-89c4-20a3cbe1e817","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1430236667},{"type":"v1","addr":"172.21.15.134:6801","nonce":1430236667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1430236667},{"type":"v1","addr":"172.21.15.134:6803","nonce":1430236667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1430236667},{"type":"v1","addr":"172.21.15.134:6807","nonce":1430236667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1430236667},{"type":"v1","addr":"172.21.15.134:6805","nonce":1430236667}]},"public_addr":"172.21.15.134:6801/1430236667","cluster_addr":"172.21.15.134:6803/1430236667","heartbeat_back_addr":"172.21.15.134:6807/1430236667","heartbeat_front_addr":"172.21.15.134:6805/1430236667","state":["exists","up"]},{"osd":4,"uuid":"33c07ebe-d45d-478f-b8a9-991d462568f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":764689261},{"type":"v1","addr":"172.21.15.134:6809","nonce":764689261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":764689261},{"type":"v1","addr":"172.21.15.134:6811","nonce":764689261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":764689261},{"type":"v1","addr":"172.21.15.134:6815","nonce":764689261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":764689261},{"type":"v1","addr":"172.21.15.134:6813","nonce":764689261}]},"public_addr":"172.21.15.134:6809/764689261","cluster_addr":"172.21.15.134:6811/764689261","heartbeat_back_addr":"172.21.15.134:6815/764689261","heartbeat_front_addr":"172.21.15.134:6813/764689261","state":["exists","up"]},{"osd":5,"uuid":"7ef9ab40-b3dd-4208-a3c3-1dc86dd74239","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3477898981},{"type":"v1","addr":"172.21.15.134:6817","nonce":3477898981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3477898981},{"type":"v1","addr":"172.21.15.134:6819","nonce":3477898981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3477898981},{"type":"v1","addr":"172.21.15.134:6823","nonce":3477898981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3477898981},{"type":"v1","addr":"172.21.15.134:6821","nonce":3477898981}]},"public_addr":"172.21.15.134:6817/3477898981","cluster_addr":"172.21.15.134:6819/3477898981","heartbeat_back_addr":"172.21.15.134:6823/3477898981","heartbeat_front_addr":"172.21.15.134:6821/3477898981","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:15:03.639854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:15:35.145583+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:16:03.983073+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:16:29.207130+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:16:56.273448+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:17:22.708485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.88:6801/245760742":"2024-09-18T04:13:21.738800+0000","172.21.15.88:6800/245760742":"2024-09-18T04:13:21.738800+0000","172.21.15.88:0/233265505":"2024-09-18T04:11:52.936995+0000","172.21.15.88:6801/2871304666":"2024-09-18T04:11:52.936995+0000","172.21.15.88:0/910347675":"2024-09-18T04:12:24.422352+0000","172.21.15.88:0/433412784":"2024-09-18T04:11:52.936995+0000","172.21.15.88:0/1996066407":"2024-09-18T04:11:52.936995+0000","172.21.15.88:0/602105794":"2024-09-18T04:12:24.422352+0000","172.21.15.88:6801/2756720871":"2024-09-18T04:12:24.422352+0000","172.21.15.88:6800/2871304666":"2024-09-18T04:11:52.936995+0000","172.21.15.88:0/2048077731":"2024-09-18T04:13:21.738800+0000","172.21.15.88:6800/2756720871":"2024-09-18T04:12:24.422352+0000","172.21.15.88:0/469592792":"2024-09-18T04:12:24.422352+0000","172.21.15.88:0/2258563085":"2024-09-18T04:13:21.738800+0000","172.21.15.88:0/73613879":"2024-09-18T04:13:21.738800+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T04:17:39.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:39.686+0000 7fc544747640 1 -- 172.21.15.88:0/3796465556 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fc52806e2b0 msgr2=0x7fc528070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:39.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:39.686+0000 7fc544747640 1 --2- 172.21.15.88:0/3796465556 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fc52806e2b0 0x7fc528070770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc53c0ffbf0 tx=0x7fc538008040 comp rx=0 tx=0).stop 2024-09-17T04:17:39.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:39.686+0000 7fc544747640 1 -- 172.21.15.88:0/3796465556 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc53c101900 msgr2=0x7fc53c19d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:39.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:39.686+0000 7fc544747640 1 --2- 172.21.15.88:0/3796465556 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc53c101900 0x7fc53c19d6c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc52c031460 tx=0x7fc52c0048f0 comp rx=0 tx=0).stop 2024-09-17T04:17:39.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:39.686+0000 7fc544747640 1 -- 172.21.15.88:0/3796465556 shutdown_connections 2024-09-17T04:17:39.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:39.686+0000 7fc544747640 1 --2- 172.21.15.88:0/3796465556 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fc52806e2b0 0x7fc528070770 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:39.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:39.686+0000 7fc544747640 1 --2- 172.21.15.88:0/3796465556 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc53c107900 0x7fc53c19dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:39.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:39.686+0000 7fc544747640 1 --2- 172.21.15.88:0/3796465556 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc53c101900 0x7fc53c19d6c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:39.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:39.686+0000 7fc544747640 1 -- 172.21.15.88:0/3796465556 >> 172.21.15.88:0/3796465556 conn(0x7fc53c0fd600 msgr2=0x7fc53c0fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:39.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:39.686+0000 7fc544747640 1 -- 172.21.15.88:0/3796465556 shutdown_connections 2024-09-17T04:17:39.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:39.686+0000 7fc544747640 1 -- 172.21.15.88:0/3796465556 wait complete. 2024-09-17T04:17:40.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:39 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/3796465556' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T04:17:40.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:39 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/3796465556' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T04:17:40.369 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-17T04:17:40.369 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-17T04:17:40.370 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-17T04:17:40.370 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-17T04:17:40.370 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-17T04:17:40.371 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-17T04:17:40.662 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:17:40.667 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:17:40.966 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:40 smithi088 ceph-mon[27811]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:17:41.148 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:40 smithi134 ceph-mon[35201]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:17:41.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.158+0000 7f388bf01640 1 -- 172.21.15.88:0/523680576 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3884101900 msgr2=0x7f3884101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:41.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.158+0000 7f388bf01640 1 --2- 172.21.15.88:0/523680576 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3884101900 0x7f3884101d60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3880009880 tx=0x7f388002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:17:41.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.158+0000 7f388bf01640 1 -- 172.21.15.88:0/523680576 shutdown_connections 2024-09-17T04:17:41.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.158+0000 7f388bf01640 1 --2- 172.21.15.88:0/523680576 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3884101900 0x7f3884101d60 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:41.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.158+0000 7f388bf01640 1 --2- 172.21.15.88:0/523680576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3884107900 0x7f3884107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:41.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.158+0000 7f388bf01640 1 -- 172.21.15.88:0/523680576 >> 172.21.15.88:0/523680576 conn(0x7f38840fd600 msgr2=0x7f38840ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:41.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.158+0000 7f388bf01640 1 -- 172.21.15.88:0/523680576 shutdown_connections 2024-09-17T04:17:41.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.158+0000 7f388bf01640 1 -- 172.21.15.88:0/523680576 wait complete. 2024-09-17T04:17:41.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.159+0000 7f388bf01640 1 Processor -- start 2024-09-17T04:17:41.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.159+0000 7f388bf01640 1 -- start start 2024-09-17T04:17:41.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.159+0000 7f388bf01640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3884101900 0x7f388419d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:41.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.159+0000 7f388bf01640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3884107900 0x7f388419db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:41.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.159+0000 7f388bf01640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f388410edb0 con 0x7f3884107900 2024-09-17T04:17:41.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.159+0000 7f388bf01640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f388410ec30 con 0x7f3884101900 2024-09-17T04:17:41.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.159+0000 7f388949c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3884107900 0x7f388419db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:41.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.159+0000 7f388949c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3884107900 0x7f388419db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51092/0 (socket says 172.21.15.88:51092) 2024-09-17T04:17:41.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.159+0000 7f388949c640 1 -- 172.21.15.88:0/1765507844 learned_addr learned my addr 172.21.15.88:0/1765507844 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:17:41.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.159+0000 7f3889c9d640 1 --2- 172.21.15.88:0/1765507844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3884101900 0x7f388419d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:41.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.159+0000 7f388949c640 1 -- 172.21.15.88:0/1765507844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3884101900 msgr2=0x7f388419d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:41.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.159+0000 7f388949c640 1 --2- 172.21.15.88:0/1765507844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3884101900 0x7f388419d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:41.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.159+0000 7f388949c640 1 -- 172.21.15.88:0/1765507844 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38841977d0 con 0x7f3884107900 2024-09-17T04:17:41.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.159+0000 7f3889c9d640 1 --2- 172.21.15.88:0/1765507844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3884101900 0x7f388419d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:17:41.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.160+0000 7f388949c640 1 --2- 172.21.15.88:0/1765507844 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3884107900 0x7f388419db90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3880031460 tx=0x7f38800048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:41.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.160+0000 7f387affd640 1 -- 172.21.15.88:0/1765507844 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f388003f070 con 0x7f3884107900 2024-09-17T04:17:41.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.160+0000 7f387affd640 1 -- 172.21.15.88:0/1765507844 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3880004cf0 con 0x7f3884107900 2024-09-17T04:17:41.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.160+0000 7f388bf01640 1 -- 172.21.15.88:0/1765507844 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3884197a60 con 0x7f3884107900 2024-09-17T04:17:41.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.160+0000 7f387affd640 1 -- 172.21.15.88:0/1765507844 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3880035030 con 0x7f3884107900 2024-09-17T04:17:41.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.160+0000 7f388bf01640 1 -- 172.21.15.88:0/1765507844 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3884197f90 con 0x7f3884107900 2024-09-17T04:17:41.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.161+0000 7f388bf01640 1 -- 172.21.15.88:0/1765507844 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3884198550 con 0x7f3884107900 2024-09-17T04:17:41.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.161+0000 7f387affd640 1 -- 172.21.15.88:0/1765507844 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f3880042070 con 0x7f3884107900 2024-09-17T04:17:41.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.162+0000 7f387affd640 1 --2- 172.21.15.88:0/1765507844 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f387006e310 0x7f38700707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:41.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.162+0000 7f387affd640 1 -- 172.21.15.88:0/1765507844 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f38800ae7e0 con 0x7f3884107900 2024-09-17T04:17:41.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.162+0000 7f3889c9d640 1 --2- 172.21.15.88:0/1765507844 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f387006e310 0x7f38700707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:41.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.162+0000 7f387affd640 1 --2- 172.21.15.88:0/1765507844 >> [v2:172.21.15.134:6816/3477898981,v1:172.21.15.134:6817/3477898981] conn(0x7f3870074100 0x7f3870076520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:41.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.162+0000 7f387affd640 1 -- 172.21.15.88:0/1765507844 --> [v2:172.21.15.134:6816/3477898981,v1:172.21.15.134:6817/3477898981] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3870076bd0 con 0x7f3870074100 2024-09-17T04:17:41.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.162+0000 7f387affd640 1 -- 172.21.15.88:0/1765507844 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f38800b32a0 con 0x7f3884107900 2024-09-17T04:17:41.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.162+0000 7f3889c9d640 1 --2- 172.21.15.88:0/1765507844 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f387006e310 0x7f38700707d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f387400baa0 tx=0x7f3874005d90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:41.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.162+0000 7f388a49e640 1 --2- 172.21.15.88:0/1765507844 >> [v2:172.21.15.134:6816/3477898981,v1:172.21.15.134:6817/3477898981] conn(0x7f3870074100 0x7f3870076520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:41.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.163+0000 7f388a49e640 1 --2- 172.21.15.88:0/1765507844 >> [v2:172.21.15.134:6816/3477898981,v1:172.21.15.134:6817/3477898981] conn(0x7f3870074100 0x7f3870076520 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:41.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.164+0000 7f387affd640 1 -- 172.21.15.88:0/1765507844 <== osd.5 v2:172.21.15.134:6816/3477898981 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3870076bd0 con 0x7f3870074100 2024-09-17T04:17:41.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.177+0000 7f388bf01640 1 -- 172.21.15.88:0/1765507844 --> [v2:172.21.15.134:6816/3477898981,v1:172.21.15.134:6817/3477898981] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3884062900 con 0x7f3870074100 2024-09-17T04:17:41.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.177+0000 7f387affd640 1 -- 172.21.15.88:0/1765507844 <== osd.5 v2:172.21.15.134:6816/3477898981 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3884062900 con 0x7f3870074100 2024-09-17T04:17:41.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.178+0000 7f388bf01640 1 -- 172.21.15.88:0/1765507844 >> [v2:172.21.15.134:6816/3477898981,v1:172.21.15.134:6817/3477898981] conn(0x7f3870074100 msgr2=0x7f3870076520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:41.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.178+0000 7f388bf01640 1 --2- 172.21.15.88:0/1765507844 >> [v2:172.21.15.134:6816/3477898981,v1:172.21.15.134:6817/3477898981] conn(0x7f3870074100 0x7f3870076520 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:41.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.178+0000 7f388bf01640 1 -- 172.21.15.88:0/1765507844 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f387006e310 msgr2=0x7f38700707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:41.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.178+0000 7f388bf01640 1 --2- 172.21.15.88:0/1765507844 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f387006e310 0x7f38700707d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f387400baa0 tx=0x7f3874005d90 comp rx=0 tx=0).stop 2024-09-17T04:17:41.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.178+0000 7f388bf01640 1 -- 172.21.15.88:0/1765507844 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3884107900 msgr2=0x7f388419db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:41.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.178+0000 7f388bf01640 1 --2- 172.21.15.88:0/1765507844 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3884107900 0x7f388419db90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3880031460 tx=0x7f38800048f0 comp rx=0 tx=0).stop 2024-09-17T04:17:41.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.178+0000 7f388bf01640 1 -- 172.21.15.88:0/1765507844 shutdown_connections 2024-09-17T04:17:41.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.178+0000 7f388bf01640 1 --2- 172.21.15.88:0/1765507844 >> [v2:172.21.15.134:6816/3477898981,v1:172.21.15.134:6817/3477898981] conn(0x7f3870074100 0x7f3870076520 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:41.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.178+0000 7f388bf01640 1 --2- 172.21.15.88:0/1765507844 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f387006e310 0x7f38700707d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:41.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.178+0000 7f388bf01640 1 --2- 172.21.15.88:0/1765507844 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3884107900 0x7f388419db90 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:41.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.178+0000 7f388bf01640 1 --2- 172.21.15.88:0/1765507844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3884101900 0x7f388419d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:41.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.178+0000 7f388bf01640 1 -- 172.21.15.88:0/1765507844 >> 172.21.15.88:0/1765507844 conn(0x7f38840fd600 msgr2=0x7f38840fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:41.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.178+0000 7f388bf01640 1 -- 172.21.15.88:0/1765507844 shutdown_connections 2024-09-17T04:17:41.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:41.178+0000 7f388bf01640 1 -- 172.21.15.88:0/1765507844 wait complete. 2024-09-17T04:17:41.864 INFO:teuthology.orchestra.run.smithi088.stdout:163208757255 2024-09-17T04:17:41.864 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-17T04:17:42.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.274+0000 7fc1ccb4a640 1 -- 172.21.15.88:0/901787001 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1c8102b60 msgr2=0x7fc1c8102f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:42.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.274+0000 7fc1ccb4a640 1 --2- 172.21.15.88:0/901787001 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1c8102b60 0x7fc1c8102f40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc1b8009880 tx=0x7fc1b802a530 comp rx=0 tx=0).stop 2024-09-17T04:17:42.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.274+0000 7fc1ccb4a640 1 -- 172.21.15.88:0/901787001 shutdown_connections 2024-09-17T04:17:42.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.274+0000 7fc1ccb4a640 1 --2- 172.21.15.88:0/901787001 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1c8103480 0x7fc1c810b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:42.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.274+0000 7fc1ccb4a640 1 --2- 172.21.15.88:0/901787001 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1c8102b60 0x7fc1c8102f40 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:42.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.274+0000 7fc1ccb4a640 1 -- 172.21.15.88:0/901787001 >> 172.21.15.88:0/901787001 conn(0x7fc1c80fc520 msgr2=0x7fc1c80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:42.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.274+0000 7fc1ccb4a640 1 -- 172.21.15.88:0/901787001 shutdown_connections 2024-09-17T04:17:42.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.274+0000 7fc1ccb4a640 1 -- 172.21.15.88:0/901787001 wait complete. 2024-09-17T04:17:42.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.275+0000 7fc1ccb4a640 1 Processor -- start 2024-09-17T04:17:42.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.275+0000 7fc1ccb4a640 1 -- start start 2024-09-17T04:17:42.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.275+0000 7fc1ccb4a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1c8102b60 0x7fc1c819d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:42.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.275+0000 7fc1ccb4a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1c8103480 0x7fc1c819dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:42.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.275+0000 7fc1ccb4a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c810ee50 con 0x7fc1c8102b60 2024-09-17T04:17:42.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.275+0000 7fc1ccb4a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c810ecd0 con 0x7fc1c8103480 2024-09-17T04:17:42.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.275+0000 7fc1c659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1c8102b60 0x7fc1c819d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:42.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.275+0000 7fc1c659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1c8102b60 0x7fc1c819d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56106/0 (socket says 172.21.15.88:56106) 2024-09-17T04:17:42.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.275+0000 7fc1c659c640 1 -- 172.21.15.88:0/279686576 learned_addr learned my addr 172.21.15.88:0/279686576 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:17:42.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.275+0000 7fc1c659c640 1 -- 172.21.15.88:0/279686576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1c8103480 msgr2=0x7fc1c819dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:42.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.275+0000 7fc1c659c640 1 --2- 172.21.15.88:0/279686576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1c8103480 0x7fc1c819dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:42.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.276+0000 7fc1c659c640 1 -- 172.21.15.88:0/279686576 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1c81978e0 con 0x7fc1c8102b60 2024-09-17T04:17:42.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.276+0000 7fc1c659c640 1 --2- 172.21.15.88:0/279686576 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1c8102b60 0x7fc1c819d720 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc1b8004f90 tx=0x7fc1b80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:42.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.276+0000 7fc1bf7fe640 1 -- 172.21.15.88:0/279686576 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc1b803f070 con 0x7fc1c8102b60 2024-09-17T04:17:42.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.276+0000 7fc1bf7fe640 1 -- 172.21.15.88:0/279686576 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc1b8004cf0 con 0x7fc1c8102b60 2024-09-17T04:17:42.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.276+0000 7fc1bf7fe640 1 -- 172.21.15.88:0/279686576 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc1b8035030 con 0x7fc1c8102b60 2024-09-17T04:17:42.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.276+0000 7fc1ccb4a640 1 -- 172.21.15.88:0/279686576 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1c8197b70 con 0x7fc1c8102b60 2024-09-17T04:17:42.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.276+0000 7fc1ccb4a640 1 -- 172.21.15.88:0/279686576 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1c81980a0 con 0x7fc1c8102b60 2024-09-17T04:17:42.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.277+0000 7fc1ccb4a640 1 -- 172.21.15.88:0/279686576 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc1c81985e0 con 0x7fc1c8102b60 2024-09-17T04:17:42.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.278+0000 7fc1bf7fe640 1 -- 172.21.15.88:0/279686576 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fc1b8042070 con 0x7fc1c8102b60 2024-09-17T04:17:42.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.278+0000 7fc1bf7fe640 1 --2- 172.21.15.88:0/279686576 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fc1b406e2b0 0x7fc1b4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:42.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.278+0000 7fc1bf7fe640 1 -- 172.21.15.88:0/279686576 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fc1b80ae900 con 0x7fc1c8102b60 2024-09-17T04:17:42.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.278+0000 7fc1c5d9b640 1 --2- 172.21.15.88:0/279686576 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fc1b406e2b0 0x7fc1b4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:42.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.279+0000 7fc1bf7fe640 1 --2- 172.21.15.88:0/279686576 >> [v2:172.21.15.134:6808/764689261,v1:172.21.15.134:6809/764689261] conn(0x7fc1b40740a0 0x7fc1b40764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:42.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.279+0000 7fc1bf7fe640 1 -- 172.21.15.88:0/279686576 --> [v2:172.21.15.134:6808/764689261,v1:172.21.15.134:6809/764689261] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc1b80054e0 con 0x7fc1b40740a0 2024-09-17T04:17:42.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.279+0000 7fc1bf7fe640 1 -- 172.21.15.88:0/279686576 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fc1b80b32a0 con 0x7fc1c8102b60 2024-09-17T04:17:42.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.279+0000 7fc1c5d9b640 1 --2- 172.21.15.88:0/279686576 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fc1b406e2b0 0x7fc1b4070770 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8108950 tx=0x7fc1b0006c90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:42.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.279+0000 7fc1c6d9d640 1 --2- 172.21.15.88:0/279686576 >> [v2:172.21.15.134:6808/764689261,v1:172.21.15.134:6809/764689261] conn(0x7fc1b40740a0 0x7fc1b40764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:42.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.279+0000 7fc1c6d9d640 1 --2- 172.21.15.88:0/279686576 >> [v2:172.21.15.134:6808/764689261,v1:172.21.15.134:6809/764689261] conn(0x7fc1b40740a0 0x7fc1b40764c0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:42.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.280+0000 7fc1bf7fe640 1 -- 172.21.15.88:0/279686576 <== osd.4 v2:172.21.15.134:6808/764689261 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc1b80054e0 con 0x7fc1b40740a0 2024-09-17T04:17:42.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.295+0000 7fc1ccb4a640 1 -- 172.21.15.88:0/279686576 --> [v2:172.21.15.134:6808/764689261,v1:172.21.15.134:6809/764689261] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc1c8062880 con 0x7fc1b40740a0 2024-09-17T04:17:42.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.295+0000 7fc1bf7fe640 1 -- 172.21.15.88:0/279686576 <== osd.4 v2:172.21.15.134:6808/764689261 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc1c8062880 con 0x7fc1b40740a0 2024-09-17T04:17:42.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.296+0000 7fc1ccb4a640 1 -- 172.21.15.88:0/279686576 >> [v2:172.21.15.134:6808/764689261,v1:172.21.15.134:6809/764689261] conn(0x7fc1b40740a0 msgr2=0x7fc1b40764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:42.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.296+0000 7fc1ccb4a640 1 --2- 172.21.15.88:0/279686576 >> [v2:172.21.15.134:6808/764689261,v1:172.21.15.134:6809/764689261] conn(0x7fc1b40740a0 0x7fc1b40764c0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:42.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.296+0000 7fc1ccb4a640 1 -- 172.21.15.88:0/279686576 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fc1b406e2b0 msgr2=0x7fc1b4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:42.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.296+0000 7fc1ccb4a640 1 --2- 172.21.15.88:0/279686576 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fc1b406e2b0 0x7fc1b4070770 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8108950 tx=0x7fc1b0006c90 comp rx=0 tx=0).stop 2024-09-17T04:17:42.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.296+0000 7fc1ccb4a640 1 -- 172.21.15.88:0/279686576 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1c8102b60 msgr2=0x7fc1c819d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:42.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.296+0000 7fc1ccb4a640 1 --2- 172.21.15.88:0/279686576 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1c8102b60 0x7fc1c819d720 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc1b8004f90 tx=0x7fc1b80048f0 comp rx=0 tx=0).stop 2024-09-17T04:17:42.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.296+0000 7fc1ccb4a640 1 -- 172.21.15.88:0/279686576 shutdown_connections 2024-09-17T04:17:42.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.296+0000 7fc1ccb4a640 1 --2- 172.21.15.88:0/279686576 >> [v2:172.21.15.134:6808/764689261,v1:172.21.15.134:6809/764689261] conn(0x7fc1b40740a0 0x7fc1b40764c0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:42.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.296+0000 7fc1ccb4a640 1 --2- 172.21.15.88:0/279686576 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fc1b406e2b0 0x7fc1b4070770 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:42.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.296+0000 7fc1ccb4a640 1 --2- 172.21.15.88:0/279686576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1c8103480 0x7fc1c819dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:42.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.296+0000 7fc1ccb4a640 1 --2- 172.21.15.88:0/279686576 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1c8102b60 0x7fc1c819d720 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:42.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.296+0000 7fc1ccb4a640 1 -- 172.21.15.88:0/279686576 >> 172.21.15.88:0/279686576 conn(0x7fc1c80fc520 msgr2=0x7fc1c8107e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:42.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.296+0000 7fc1ccb4a640 1 -- 172.21.15.88:0/279686576 shutdown_connections 2024-09-17T04:17:42.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:42.296+0000 7fc1ccb4a640 1 -- 172.21.15.88:0/279686576 wait complete. 2024-09-17T04:17:42.635 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:17:42.635 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:17:42.635 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:17:42.658 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:17:42.670 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:17:43.056 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:42 smithi088 ceph-mon[27811]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:17:43.082 INFO:teuthology.orchestra.run.smithi088.stdout:141733920779 2024-09-17T04:17:43.083 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-17T04:17:43.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:42 smithi134 ceph-mon[35201]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:17:44.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.182+0000 7fed8cca3640 1 -- 172.21.15.88:0/1239762611 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed88101960 msgr2=0x7fed88101dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:44.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.182+0000 7fed8cca3640 1 --2- 172.21.15.88:0/1239762611 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed88101960 0x7fed88101dc0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fed7c009880 tx=0x7fed7c02a4a0 comp rx=0 tx=0).stop 2024-09-17T04:17:44.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.182+0000 7fed8cca3640 1 -- 172.21.15.88:0/1239762611 shutdown_connections 2024-09-17T04:17:44.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.182+0000 7fed8cca3640 1 --2- 172.21.15.88:0/1239762611 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed88101960 0x7fed88101dc0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:44.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.182+0000 7fed8cca3640 1 --2- 172.21.15.88:0/1239762611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed88107960 0x7fed88107d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:44.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.182+0000 7fed8cca3640 1 -- 172.21.15.88:0/1239762611 >> 172.21.15.88:0/1239762611 conn(0x7fed880fd680 msgr2=0x7fed880ffaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:44.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.183+0000 7fed8cca3640 1 -- 172.21.15.88:0/1239762611 shutdown_connections 2024-09-17T04:17:44.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.183+0000 7fed8cca3640 1 -- 172.21.15.88:0/1239762611 wait complete. 2024-09-17T04:17:44.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.183+0000 7fed8cca3640 1 Processor -- start 2024-09-17T04:17:44.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.183+0000 7fed8cca3640 1 -- start start 2024-09-17T04:17:44.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.184+0000 7fed8cca3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed88101960 0x7fed8819d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:44.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.184+0000 7fed8cca3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed88107960 0x7fed8819dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:44.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.184+0000 7fed8cca3640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fed8810ee90 con 0x7fed88107960 2024-09-17T04:17:44.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.184+0000 7fed8cca3640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fed8810ed10 con 0x7fed88101960 2024-09-17T04:17:44.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.184+0000 7fed85d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed88107960 0x7fed8819dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:44.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.184+0000 7fed85d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed88107960 0x7fed8819dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56120/0 (socket says 172.21.15.88:56120) 2024-09-17T04:17:44.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.184+0000 7fed85d9b640 1 -- 172.21.15.88:0/2038598849 learned_addr learned my addr 172.21.15.88:0/2038598849 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:17:44.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.184+0000 7fed8659c640 1 --2- 172.21.15.88:0/2038598849 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed88101960 0x7fed8819d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:44.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.184+0000 7fed85d9b640 1 -- 172.21.15.88:0/2038598849 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed88101960 msgr2=0x7fed8819d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:44.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.184+0000 7fed85d9b640 1 --2- 172.21.15.88:0/2038598849 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed88101960 0x7fed8819d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:44.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.184+0000 7fed85d9b640 1 -- 172.21.15.88:0/2038598849 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed88197880 con 0x7fed88107960 2024-09-17T04:17:44.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.184+0000 7fed85d9b640 1 --2- 172.21.15.88:0/2038598849 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed88107960 0x7fed8819dc00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fed7c031460 tx=0x7fed7c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:44.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.184+0000 7fed777fe640 1 -- 172.21.15.88:0/2038598849 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fed7c03f070 con 0x7fed88107960 2024-09-17T04:17:44.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.184+0000 7fed777fe640 1 -- 172.21.15.88:0/2038598849 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fed7c004cf0 con 0x7fed88107960 2024-09-17T04:17:44.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.184+0000 7fed777fe640 1 -- 172.21.15.88:0/2038598849 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fed7c035030 con 0x7fed88107960 2024-09-17T04:17:44.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.184+0000 7fed8cca3640 1 -- 172.21.15.88:0/2038598849 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed88197b10 con 0x7fed88107960 2024-09-17T04:17:44.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.185+0000 7fed8cca3640 1 -- 172.21.15.88:0/2038598849 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed88198040 con 0x7fed88107960 2024-09-17T04:17:44.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.185+0000 7fed8cca3640 1 -- 172.21.15.88:0/2038598849 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fed88198580 con 0x7fed88107960 2024-09-17T04:17:44.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.186+0000 7fed777fe640 1 -- 172.21.15.88:0/2038598849 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fed7c042070 con 0x7fed88107960 2024-09-17T04:17:44.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.187+0000 7fed777fe640 1 --2- 172.21.15.88:0/2038598849 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fed7006e310 0x7fed700707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:44.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.187+0000 7fed8659c640 1 --2- 172.21.15.88:0/2038598849 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fed7006e310 0x7fed700707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:44.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.187+0000 7fed777fe640 1 -- 172.21.15.88:0/2038598849 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fed7c0aefb0 con 0x7fed88107960 2024-09-17T04:17:44.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.187+0000 7fed777fe640 1 --2- 172.21.15.88:0/2038598849 >> [v2:172.21.15.134:6800/1430236667,v1:172.21.15.134:6801/1430236667] conn(0x7fed70074100 0x7fed70076520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:44.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.187+0000 7fed777fe640 1 -- 172.21.15.88:0/2038598849 --> [v2:172.21.15.134:6800/1430236667,v1:172.21.15.134:6801/1430236667] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fed7c04de50 con 0x7fed70074100 2024-09-17T04:17:44.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.187+0000 7fed777fe640 1 -- 172.21.15.88:0/2038598849 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fed7c0af3e0 con 0x7fed88107960 2024-09-17T04:17:44.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.187+0000 7fed8659c640 1 --2- 172.21.15.88:0/2038598849 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fed7006e310 0x7fed700707d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fed881989c0 tx=0x7fed78008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:44.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.187+0000 7fed86d9d640 1 --2- 172.21.15.88:0/2038598849 >> [v2:172.21.15.134:6800/1430236667,v1:172.21.15.134:6801/1430236667] conn(0x7fed70074100 0x7fed70076520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:44.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.188+0000 7fed86d9d640 1 --2- 172.21.15.88:0/2038598849 >> [v2:172.21.15.134:6800/1430236667,v1:172.21.15.134:6801/1430236667] conn(0x7fed70074100 0x7fed70076520 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:44.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.189+0000 7fed777fe640 1 -- 172.21.15.88:0/2038598849 <== osd.3 v2:172.21.15.134:6800/1430236667 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fed7c04de50 con 0x7fed70074100 2024-09-17T04:17:44.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.202+0000 7fed8cca3640 1 -- 172.21.15.88:0/2038598849 --> [v2:172.21.15.134:6800/1430236667,v1:172.21.15.134:6801/1430236667] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fed88062880 con 0x7fed70074100 2024-09-17T04:17:44.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.203+0000 7fed777fe640 1 -- 172.21.15.88:0/2038598849 <== osd.3 v2:172.21.15.134:6800/1430236667 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fed88062880 con 0x7fed70074100 2024-09-17T04:17:44.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.203+0000 7fed8cca3640 1 -- 172.21.15.88:0/2038598849 >> [v2:172.21.15.134:6800/1430236667,v1:172.21.15.134:6801/1430236667] conn(0x7fed70074100 msgr2=0x7fed70076520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:44.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.203+0000 7fed8cca3640 1 --2- 172.21.15.88:0/2038598849 >> [v2:172.21.15.134:6800/1430236667,v1:172.21.15.134:6801/1430236667] conn(0x7fed70074100 0x7fed70076520 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:44.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.203+0000 7fed8cca3640 1 -- 172.21.15.88:0/2038598849 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fed7006e310 msgr2=0x7fed700707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:44.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.203+0000 7fed8cca3640 1 --2- 172.21.15.88:0/2038598849 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fed7006e310 0x7fed700707d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fed881989c0 tx=0x7fed78008040 comp rx=0 tx=0).stop 2024-09-17T04:17:44.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.203+0000 7fed8cca3640 1 -- 172.21.15.88:0/2038598849 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed88107960 msgr2=0x7fed8819dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:44.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.203+0000 7fed8cca3640 1 --2- 172.21.15.88:0/2038598849 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed88107960 0x7fed8819dc00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fed7c031460 tx=0x7fed7c0048f0 comp rx=0 tx=0).stop 2024-09-17T04:17:44.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.203+0000 7fed8cca3640 1 -- 172.21.15.88:0/2038598849 shutdown_connections 2024-09-17T04:17:44.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.203+0000 7fed8cca3640 1 --2- 172.21.15.88:0/2038598849 >> [v2:172.21.15.134:6800/1430236667,v1:172.21.15.134:6801/1430236667] conn(0x7fed70074100 0x7fed70076520 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:44.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.203+0000 7fed8cca3640 1 --2- 172.21.15.88:0/2038598849 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fed7006e310 0x7fed700707d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:44.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.203+0000 7fed8cca3640 1 --2- 172.21.15.88:0/2038598849 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed88107960 0x7fed8819dc00 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:44.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.203+0000 7fed8cca3640 1 --2- 172.21.15.88:0/2038598849 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed88101960 0x7fed8819d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:44.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.203+0000 7fed8cca3640 1 -- 172.21.15.88:0/2038598849 >> 172.21.15.88:0/2038598849 conn(0x7fed880fd680 msgr2=0x7fed880fdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:44.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.203+0000 7fed8cca3640 1 -- 172.21.15.88:0/2038598849 shutdown_connections 2024-09-17T04:17:44.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.203+0000 7fed8cca3640 1 -- 172.21.15.88:0/2038598849 wait complete. 2024-09-17T04:17:44.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.376+0000 7fcaaea5d640 1 -- 172.21.15.88:0/609506665 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcaa8101900 msgr2=0x7fcaa8101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:44.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.376+0000 7fcaaea5d640 1 --2- 172.21.15.88:0/609506665 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcaa8101900 0x7fcaa8101d60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fca9c009880 tx=0x7fca9c02a4a0 comp rx=0 tx=0).stop 2024-09-17T04:17:44.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.376+0000 7fcaaea5d640 1 -- 172.21.15.88:0/609506665 shutdown_connections 2024-09-17T04:17:44.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.376+0000 7fcaaea5d640 1 --2- 172.21.15.88:0/609506665 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcaa8101900 0x7fcaa8101d60 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:44.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.376+0000 7fcaaea5d640 1 --2- 172.21.15.88:0/609506665 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcaa8107900 0x7fcaa8107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:44.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.376+0000 7fcaaea5d640 1 -- 172.21.15.88:0/609506665 >> 172.21.15.88:0/609506665 conn(0x7fcaa80fd5e0 msgr2=0x7fcaa80ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:44.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.376+0000 7fcaaea5d640 1 -- 172.21.15.88:0/609506665 shutdown_connections 2024-09-17T04:17:44.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.376+0000 7fcaaea5d640 1 -- 172.21.15.88:0/609506665 wait complete. 2024-09-17T04:17:44.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.376+0000 7fcaaea5d640 1 Processor -- start 2024-09-17T04:17:44.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.376+0000 7fcaaea5d640 1 -- start start 2024-09-17T04:17:44.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.377+0000 7fcaaea5d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcaa8101900 0x7fcaa80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:44.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.377+0000 7fcaaea5d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcaa8107900 0x7fcaa8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:44.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.377+0000 7fcaaea5d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa810edd0 con 0x7fcaa8101900 2024-09-17T04:17:44.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.377+0000 7fcaaea5d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa810ec50 con 0x7fcaa8107900 2024-09-17T04:17:44.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.377+0000 7fcaa7fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcaa8101900 0x7fcaa80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:44.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.377+0000 7fcaa7fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcaa8101900 0x7fcaa80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56140/0 (socket says 172.21.15.88:56140) 2024-09-17T04:17:44.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.377+0000 7fcaa7fff640 1 -- 172.21.15.88:0/3073676093 learned_addr learned my addr 172.21.15.88:0/3073676093 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:17:44.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.377+0000 7fcaa77fe640 1 --2- 172.21.15.88:0/3073676093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcaa8107900 0x7fcaa8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:44.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.377+0000 7fcaa7fff640 1 -- 172.21.15.88:0/3073676093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcaa8107900 msgr2=0x7fcaa8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:44.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.377+0000 7fcaa7fff640 1 --2- 172.21.15.88:0/3073676093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcaa8107900 0x7fcaa8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:44.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.377+0000 7fcaa7fff640 1 -- 172.21.15.88:0/3073676093 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaa8074f70 con 0x7fcaa8101900 2024-09-17T04:17:44.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.377+0000 7fcaa77fe640 1 --2- 172.21.15.88:0/3073676093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcaa8107900 0x7fcaa8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:17:44.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.377+0000 7fcaa7fff640 1 --2- 172.21.15.88:0/3073676093 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcaa8101900 0x7fcaa80744f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fca9800e970 tx=0x7fca9800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:44.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.377+0000 7fcaa57fa640 1 -- 172.21.15.88:0/3073676093 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fca9800cac0 con 0x7fcaa8101900 2024-09-17T04:17:44.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.377+0000 7fcaaea5d640 1 -- 172.21.15.88:0/3073676093 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaa8075260 con 0x7fcaa8101900 2024-09-17T04:17:44.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.377+0000 7fcaa57fa640 1 -- 172.21.15.88:0/3073676093 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fca980054e0 con 0x7fcaa8101900 2024-09-17T04:17:44.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.377+0000 7fcaa57fa640 1 -- 172.21.15.88:0/3073676093 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fca98010430 con 0x7fcaa8101900 2024-09-17T04:17:44.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.377+0000 7fcaaea5d640 1 -- 172.21.15.88:0/3073676093 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaa81a3e10 con 0x7fcaa8101900 2024-09-17T04:17:44.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.378+0000 7fcaaea5d640 1 -- 172.21.15.88:0/3073676093 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaa8103040 con 0x7fcaa8101900 2024-09-17T04:17:44.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.379+0000 7fcaa57fa640 1 -- 172.21.15.88:0/3073676093 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fca98004e80 con 0x7fcaa8101900 2024-09-17T04:17:44.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.379+0000 7fcaa57fa640 1 --2- 172.21.15.88:0/3073676093 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fca9006e2b0 0x7fca90070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:44.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.379+0000 7fcaa57fa640 1 -- 172.21.15.88:0/3073676093 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fca9808e4e0 con 0x7fcaa8101900 2024-09-17T04:17:44.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.379+0000 7fcaa77fe640 1 --2- 172.21.15.88:0/3073676093 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fca9006e2b0 0x7fca90070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:44.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.380+0000 7fcaa77fe640 1 --2- 172.21.15.88:0/3073676093 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fca9006e2b0 0x7fca90070770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcaa8075f80 tx=0x7fca9c031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:44.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.384+0000 7fcaa57fa640 1 -- 172.21.15.88:0/3073676093 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fca9805c180 con 0x7fcaa8101900 2024-09-17T04:17:44.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.551+0000 7fcaaea5d640 1 -- 172.21.15.88:0/3073676093 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fcaa8109e70 con 0x7fcaa8101900 2024-09-17T04:17:44.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.552+0000 7fcaa57fa640 1 -- 172.21.15.88:0/3073676093 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fca9805fe30 con 0x7fcaa8101900 2024-09-17T04:17:44.552 INFO:teuthology.orchestra.run.smithi088.stdout:163208757255 2024-09-17T04:17:44.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.554+0000 7fcaaea5d640 1 -- 172.21.15.88:0/3073676093 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fca9006e2b0 msgr2=0x7fca90070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:44.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.554+0000 7fcaaea5d640 1 --2- 172.21.15.88:0/3073676093 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fca9006e2b0 0x7fca90070770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcaa8075f80 tx=0x7fca9c031400 comp rx=0 tx=0).stop 2024-09-17T04:17:44.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.554+0000 7fcaaea5d640 1 -- 172.21.15.88:0/3073676093 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcaa8101900 msgr2=0x7fcaa80744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:44.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.554+0000 7fcaaea5d640 1 --2- 172.21.15.88:0/3073676093 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcaa8101900 0x7fcaa80744f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fca9800e970 tx=0x7fca9800ed70 comp rx=0 tx=0).stop 2024-09-17T04:17:44.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.554+0000 7fcaaea5d640 1 -- 172.21.15.88:0/3073676093 shutdown_connections 2024-09-17T04:17:44.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.554+0000 7fcaaea5d640 1 --2- 172.21.15.88:0/3073676093 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fca9006e2b0 0x7fca90070770 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:44.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.554+0000 7fcaaea5d640 1 --2- 172.21.15.88:0/3073676093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcaa8107900 0x7fcaa8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:44.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.554+0000 7fcaaea5d640 1 --2- 172.21.15.88:0/3073676093 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcaa8101900 0x7fcaa80744f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:44.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.554+0000 7fcaaea5d640 1 -- 172.21.15.88:0/3073676093 >> 172.21.15.88:0/3073676093 conn(0x7fcaa80fd5e0 msgr2=0x7fcaa80fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:44.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.554+0000 7fcaaea5d640 1 -- 172.21.15.88:0/3073676093 shutdown_connections 2024-09-17T04:17:44.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.554+0000 7fcaaea5d640 1 -- 172.21.15.88:0/3073676093 wait complete. 2024-09-17T04:17:44.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.976+0000 7f1a7d5fd640 1 -- 172.21.15.88:0/1054044929 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a78102ab0 msgr2=0x7f1a78102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:44.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.976+0000 7f1a7d5fd640 1 --2- 172.21.15.88:0/1054044929 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a78102ab0 0x7f1a78102e90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1a70009880 tx=0x7f1a7002a530 comp rx=0 tx=0).stop 2024-09-17T04:17:44.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.977+0000 7f1a7d5fd640 1 -- 172.21.15.88:0/1054044929 shutdown_connections 2024-09-17T04:17:44.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.977+0000 7f1a7d5fd640 1 --2- 172.21.15.88:0/1054044929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a781033d0 0x7f1a7810b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:44.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.977+0000 7f1a7d5fd640 1 --2- 172.21.15.88:0/1054044929 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a78102ab0 0x7f1a78102e90 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:44.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.977+0000 7f1a7d5fd640 1 -- 172.21.15.88:0/1054044929 >> 172.21.15.88:0/1054044929 conn(0x7f1a780fc550 msgr2=0x7f1a780fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:44.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.977+0000 7f1a7d5fd640 1 -- 172.21.15.88:0/1054044929 shutdown_connections 2024-09-17T04:17:44.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.977+0000 7f1a7d5fd640 1 -- 172.21.15.88:0/1054044929 wait complete. 2024-09-17T04:17:44.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.977+0000 7f1a7d5fd640 1 Processor -- start 2024-09-17T04:17:44.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.978+0000 7f1a7d5fd640 1 -- start start 2024-09-17T04:17:44.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.978+0000 7f1a7d5fd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a78102ab0 0x7f1a7819d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:44.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.978+0000 7f1a7d5fd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a781033d0 0x7f1a7819dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:44.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.978+0000 7f1a7d5fd640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f1a7810ee40 con 0x7f1a78102ab0 2024-09-17T04:17:44.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.978+0000 7f1a7d5fd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1a7810ecc0 con 0x7f1a781033d0 2024-09-17T04:17:44.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.978+0000 7f1a76ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a78102ab0 0x7f1a7819d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:44.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.978+0000 7f1a76ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a78102ab0 0x7f1a7819d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56152/0 (socket says 172.21.15.88:56152) 2024-09-17T04:17:44.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.978+0000 7f1a76ffd640 1 -- 172.21.15.88:0/1350837439 learned_addr learned my addr 172.21.15.88:0/1350837439 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:17:44.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.978+0000 7f1a767fc640 1 --2- 172.21.15.88:0/1350837439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a781033d0 0x7f1a7819dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:44.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.978+0000 7f1a76ffd640 1 -- 172.21.15.88:0/1350837439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a781033d0 msgr2=0x7f1a7819dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:44.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.978+0000 7f1a76ffd640 1 --2- 172.21.15.88:0/1350837439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a781033d0 0x7f1a7819dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:44.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.978+0000 7f1a76ffd640 1 -- 172.21.15.88:0/1350837439 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a78197810 con 0x7f1a78102ab0 2024-09-17T04:17:44.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.978+0000 7f1a767fc640 1 --2- 172.21.15.88:0/1350837439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a781033d0 0x7f1a7819dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:17:44.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.978+0000 7f1a76ffd640 1 --2- 172.21.15.88:0/1350837439 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a78102ab0 0x7f1a7819d690 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1a70031460 tx=0x7f1a700048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:44.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.979+0000 7f1a6ffff640 1 -- 172.21.15.88:0/1350837439 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1a7003f070 con 0x7f1a78102ab0 2024-09-17T04:17:44.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.979+0000 7f1a6ffff640 1 -- 172.21.15.88:0/1350837439 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1a70004cf0 con 0x7f1a78102ab0 2024-09-17T04:17:44.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.979+0000 7f1a7d5fd640 1 -- 172.21.15.88:0/1350837439 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a78197aa0 con 0x7f1a78102ab0 2024-09-17T04:17:44.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.979+0000 7f1a6ffff640 1 -- 172.21.15.88:0/1350837439 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1a70035030 con 0x7f1a78102ab0 2024-09-17T04:17:44.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.979+0000 7f1a7d5fd640 1 -- 172.21.15.88:0/1350837439 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a78197fd0 con 0x7f1a78102ab0 2024-09-17T04:17:44.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.980+0000 7f1a7d5fd640 1 -- 172.21.15.88:0/1350837439 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1a58001030 con 0x7f1a78102ab0 2024-09-17T04:17:44.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.980+0000 7f1a6ffff640 1 -- 172.21.15.88:0/1350837439 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f1a70042070 con 0x7f1a78102ab0 2024-09-17T04:17:44.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.981+0000 7f1a6ffff640 1 --2- 172.21.15.88:0/1350837439 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f1a6406e310 0x7f1a640707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:44.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.981+0000 7f1a767fc640 1 --2- 172.21.15.88:0/1350837439 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f1a6406e310 0x7f1a640707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:44.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.981+0000 7f1a6ffff640 1 -- 172.21.15.88:0/1350837439 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f1a700ae810 con 0x7f1a78102ab0 2024-09-17T04:17:44.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.981+0000 7f1a6ffff640 1 --2- 172.21.15.88:0/1350837439 >> [v2:172.21.15.88:6802/2896435780,v1:172.21.15.88:6803/2896435780] conn(0x7f1a64074100 0x7f1a64076520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:44.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.981+0000 7f1a6ffff640 1 -- 172.21.15.88:0/1350837439 --> [v2:172.21.15.88:6802/2896435780,v1:172.21.15.88:6803/2896435780] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1a700054e0 con 0x7f1a64074100 2024-09-17T04:17:44.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.981+0000 7f1a6ffff640 1 -- 172.21.15.88:0/1350837439 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f1a700b32a0 con 0x7f1a78102ab0 2024-09-17T04:17:44.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.981+0000 7f1a777fe640 1 --2- 172.21.15.88:0/1350837439 >> [v2:172.21.15.88:6802/2896435780,v1:172.21.15.88:6803/2896435780] conn(0x7f1a64074100 0x7f1a64076520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:44.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.981+0000 7f1a767fc640 1 --2- 172.21.15.88:0/1350837439 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f1a6406e310 0x7f1a640707d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1a780feff0 tx=0x7f1a60008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:44.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.981+0000 7f1a777fe640 1 --2- 172.21.15.88:0/1350837439 >> [v2:172.21.15.88:6802/2896435780,v1:172.21.15.88:6803/2896435780] conn(0x7f1a64074100 0x7f1a64076520 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:44.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.982+0000 7f1a6ffff640 1 -- 172.21.15.88:0/1350837439 <== osd.0 v2:172.21.15.88:6802/2896435780 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1a700054e0 con 0x7f1a64074100 2024-09-17T04:17:44.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.996+0000 7f1a7d5fd640 1 -- 172.21.15.88:0/1350837439 --> [v2:172.21.15.88:6802/2896435780,v1:172.21.15.88:6803/2896435780] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1a58002dd0 con 0x7f1a64074100 2024-09-17T04:17:44.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.997+0000 7f1a6ffff640 1 -- 172.21.15.88:0/1350837439 <== osd.0 v2:172.21.15.88:6802/2896435780 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1a58002dd0 con 0x7f1a64074100 2024-09-17T04:17:44.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.997+0000 7f1a7d5fd640 1 -- 172.21.15.88:0/1350837439 >> [v2:172.21.15.88:6802/2896435780,v1:172.21.15.88:6803/2896435780] conn(0x7f1a64074100 msgr2=0x7f1a64076520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:44.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.997+0000 7f1a7d5fd640 1 --2- 172.21.15.88:0/1350837439 >> [v2:172.21.15.88:6802/2896435780,v1:172.21.15.88:6803/2896435780] conn(0x7f1a64074100 0x7f1a64076520 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:44.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.997+0000 7f1a7d5fd640 1 -- 172.21.15.88:0/1350837439 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f1a6406e310 msgr2=0x7f1a640707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:44.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.997+0000 7f1a7d5fd640 1 --2- 172.21.15.88:0/1350837439 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f1a6406e310 0x7f1a640707d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1a780feff0 tx=0x7f1a60008040 comp rx=0 tx=0).stop 2024-09-17T04:17:44.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.997+0000 7f1a7d5fd640 1 -- 172.21.15.88:0/1350837439 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a78102ab0 msgr2=0x7f1a7819d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:44.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.997+0000 7f1a7d5fd640 1 --2- 172.21.15.88:0/1350837439 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a78102ab0 0x7f1a7819d690 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1a70031460 tx=0x7f1a700048f0 comp rx=0 tx=0).stop 2024-09-17T04:17:44.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.997+0000 7f1a7d5fd640 1 -- 172.21.15.88:0/1350837439 shutdown_connections 2024-09-17T04:17:44.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.997+0000 7f1a7d5fd640 1 --2- 172.21.15.88:0/1350837439 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f1a6406e310 0x7f1a640707d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:44.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.997+0000 7f1a7d5fd640 1 --2- 172.21.15.88:0/1350837439 >> [v2:172.21.15.88:6802/2896435780,v1:172.21.15.88:6803/2896435780] conn(0x7f1a64074100 0x7f1a64076520 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:44.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.997+0000 7f1a7d5fd640 1 --2- 172.21.15.88:0/1350837439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a781033d0 0x7f1a7819dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:44.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.997+0000 7f1a7d5fd640 1 --2- 172.21.15.88:0/1350837439 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a78102ab0 0x7f1a7819d690 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:44.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.997+0000 7f1a7d5fd640 1 -- 172.21.15.88:0/1350837439 >> 172.21.15.88:0/1350837439 conn(0x7f1a780fc550 msgr2=0x7f1a78108e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:44.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.997+0000 7f1a7d5fd640 1 -- 172.21.15.88:0/1350837439 shutdown_connections 2024-09-17T04:17:44.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:44.997+0000 7f1a7d5fd640 1 -- 172.21.15.88:0/1350837439 wait complete. 2024-09-17T04:17:45.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:44 smithi088 ceph-mon[27811]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:17:45.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:44 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/3073676093' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-17T04:17:45.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:44 smithi134 ceph-mon[35201]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:17:45.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:44 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/3073676093' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-17T04:17:45.501 INFO:teuthology.orchestra.run.smithi088.stdout:111669149713 2024-09-17T04:17:45.502 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-17T04:17:45.946 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757255 got 163208757255 for osd.5 2024-09-17T04:17:45.947 DEBUG:teuthology.parallel:result is None 2024-09-17T04:17:46.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.117+0000 7ff3b9aaa640 1 -- 172.21.15.88:0/3215984786 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3b4102ab0 msgr2=0x7ff3b4102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:46.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.117+0000 7ff3b9aaa640 1 --2- 172.21.15.88:0/3215984786 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3b4102ab0 0x7ff3b4102e90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac009c20 tx=0x7ff3ac02aa00 comp rx=0 tx=0).stop 2024-09-17T04:17:46.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.117+0000 7ff3b9aaa640 1 -- 172.21.15.88:0/3215984786 shutdown_connections 2024-09-17T04:17:46.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.117+0000 7ff3b9aaa640 1 --2- 172.21.15.88:0/3215984786 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3b41033d0 0x7ff3b410b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:46.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.117+0000 7ff3b9aaa640 1 --2- 172.21.15.88:0/3215984786 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3b4102ab0 0x7ff3b4102e90 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:46.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.117+0000 7ff3b9aaa640 1 -- 172.21.15.88:0/3215984786 >> 172.21.15.88:0/3215984786 conn(0x7ff3b40fc4d0 msgr2=0x7ff3b40fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:46.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.118+0000 7ff3b9aaa640 1 -- 172.21.15.88:0/3215984786 shutdown_connections 2024-09-17T04:17:46.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.118+0000 7ff3b9aaa640 1 -- 172.21.15.88:0/3215984786 wait complete. 2024-09-17T04:17:46.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.118+0000 7ff3b9aaa640 1 Processor -- start 2024-09-17T04:17:46.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.118+0000 7ff3b9aaa640 1 -- start start 2024-09-17T04:17:46.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.118+0000 7ff3b9aaa640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3b4102ab0 0x7ff3b419d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:46.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.118+0000 7ff3b9aaa640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3b41033d0 0x7ff3b419dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:46.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.118+0000 7ff3b9aaa640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b410ee40 con 0x7ff3b4102ab0 2024-09-17T04:17:46.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.118+0000 7ff3b9aaa640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b410ecc0 con 0x7ff3b41033d0 2024-09-17T04:17:46.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.119+0000 7ff3b37fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3b4102ab0 0x7ff3b419d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:46.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.119+0000 7ff3b37fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3b4102ab0 0x7ff3b419d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56166/0 (socket says 172.21.15.88:56166) 2024-09-17T04:17:46.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.119+0000 7ff3b37fe640 1 -- 172.21.15.88:0/2336884069 learned_addr learned my addr 172.21.15.88:0/2336884069 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:17:46.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.119+0000 7ff3b2ffd640 1 --2- 172.21.15.88:0/2336884069 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3b41033d0 0x7ff3b419dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:46.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.119+0000 7ff3b37fe640 1 -- 172.21.15.88:0/2336884069 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3b41033d0 msgr2=0x7ff3b419dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:46.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.119+0000 7ff3b37fe640 1 --2- 172.21.15.88:0/2336884069 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3b41033d0 0x7ff3b419dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:46.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.119+0000 7ff3b37fe640 1 -- 172.21.15.88:0/2336884069 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3b41978f0 con 0x7ff3b4102ab0 2024-09-17T04:17:46.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.119+0000 7ff3b2ffd640 1 --2- 172.21.15.88:0/2336884069 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3b41033d0 0x7ff3b419dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:17:46.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.119+0000 7ff3b37fe640 1 --2- 172.21.15.88:0/2336884069 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3b4102ab0 0x7ff3b419d730 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac005cc0 tx=0x7ff3ac02ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:46.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.119+0000 7ff3b0ff9640 1 -- 172.21.15.88:0/2336884069 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff3ac047070 con 0x7ff3b4102ab0 2024-09-17T04:17:46.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.119+0000 7ff3b9aaa640 1 -- 172.21.15.88:0/2336884069 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3b4197b80 con 0x7ff3b4102ab0 2024-09-17T04:17:46.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.119+0000 7ff3b0ff9640 1 -- 172.21.15.88:0/2336884069 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff3ac003e30 con 0x7ff3b4102ab0 2024-09-17T04:17:46.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.119+0000 7ff3b0ff9640 1 -- 172.21.15.88:0/2336884069 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff3ac033050 con 0x7ff3b4102ab0 2024-09-17T04:17:46.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.119+0000 7ff3b9aaa640 1 -- 172.21.15.88:0/2336884069 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3b41980b0 con 0x7ff3b4102ab0 2024-09-17T04:17:46.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.120+0000 7ff3b9aaa640 1 -- 172.21.15.88:0/2336884069 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff3b4198670 con 0x7ff3b4102ab0 2024-09-17T04:17:46.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.120+0000 7ff3b0ff9640 1 -- 172.21.15.88:0/2336884069 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7ff3ac04a070 con 0x7ff3b4102ab0 2024-09-17T04:17:46.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.121+0000 7ff3b0ff9640 1 --2- 172.21.15.88:0/2336884069 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7ff3a006e2b0 0x7ff3a0070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:46.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.121+0000 7ff3b0ff9640 1 -- 172.21.15.88:0/2336884069 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7ff3ac03e030 con 0x7ff3b4102ab0 2024-09-17T04:17:46.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.121+0000 7ff3b2ffd640 1 --2- 172.21.15.88:0/2336884069 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7ff3a006e2b0 0x7ff3a0070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:46.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.121+0000 7ff3b0ff9640 1 --2- 172.21.15.88:0/2336884069 >> [v2:172.21.15.88:6818/3973957395,v1:172.21.15.88:6819/3973957395] conn(0x7ff3a00740a0 0x7ff3a00764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:46.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.121+0000 7ff3b0ff9640 1 -- 172.21.15.88:0/2336884069 --> [v2:172.21.15.88:6818/3973957395,v1:172.21.15.88:6819/3973957395] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff3ac04ee50 con 0x7ff3a00740a0 2024-09-17T04:17:46.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.121+0000 7ff3b0ff9640 1 -- 172.21.15.88:0/2336884069 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7ff3ac0b4520 con 0x7ff3b4102ab0 2024-09-17T04:17:46.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.121+0000 7ff3b3fff640 1 --2- 172.21.15.88:0/2336884069 >> [v2:172.21.15.88:6818/3973957395,v1:172.21.15.88:6819/3973957395] conn(0x7ff3a00740a0 0x7ff3a00764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:46.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.122+0000 7ff3b2ffd640 1 --2- 172.21.15.88:0/2336884069 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7ff3a006e2b0 0x7ff3a0070770 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff39c006fd0 tx=0x7ff39c008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:46.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.122+0000 7ff3b3fff640 1 --2- 172.21.15.88:0/2336884069 >> [v2:172.21.15.88:6818/3973957395,v1:172.21.15.88:6819/3973957395] conn(0x7ff3a00740a0 0x7ff3a00764c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:46.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.122+0000 7ff3b0ff9640 1 -- 172.21.15.88:0/2336884069 <== osd.2 v2:172.21.15.88:6818/3973957395 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff3ac04ee50 con 0x7ff3a00740a0 2024-09-17T04:17:46.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.135+0000 7ff3b9aaa640 1 -- 172.21.15.88:0/2336884069 --> [v2:172.21.15.88:6818/3973957395,v1:172.21.15.88:6819/3973957395] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff3b4062900 con 0x7ff3a00740a0 2024-09-17T04:17:46.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.136+0000 7ff3b0ff9640 1 -- 172.21.15.88:0/2336884069 <== osd.2 v2:172.21.15.88:6818/3973957395 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff3b4062900 con 0x7ff3a00740a0 2024-09-17T04:17:46.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.136+0000 7ff3b9aaa640 1 -- 172.21.15.88:0/2336884069 >> [v2:172.21.15.88:6818/3973957395,v1:172.21.15.88:6819/3973957395] conn(0x7ff3a00740a0 msgr2=0x7ff3a00764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:46.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.136+0000 7ff3b9aaa640 1 --2- 172.21.15.88:0/2336884069 >> [v2:172.21.15.88:6818/3973957395,v1:172.21.15.88:6819/3973957395] conn(0x7ff3a00740a0 0x7ff3a00764c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:46.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.136+0000 7ff3b9aaa640 1 -- 172.21.15.88:0/2336884069 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7ff3a006e2b0 msgr2=0x7ff3a0070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:46.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.136+0000 7ff3b9aaa640 1 --2- 172.21.15.88:0/2336884069 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7ff3a006e2b0 0x7ff3a0070770 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff39c006fd0 tx=0x7ff39c008040 comp rx=0 tx=0).stop 2024-09-17T04:17:46.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.136+0000 7ff3b9aaa640 1 -- 172.21.15.88:0/2336884069 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3b4102ab0 msgr2=0x7ff3b419d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:46.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.136+0000 7ff3b9aaa640 1 --2- 172.21.15.88:0/2336884069 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3b4102ab0 0x7ff3b419d730 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac005cc0 tx=0x7ff3ac02ee60 comp rx=0 tx=0).stop 2024-09-17T04:17:46.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.136+0000 7ff3b9aaa640 1 -- 172.21.15.88:0/2336884069 shutdown_connections 2024-09-17T04:17:46.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.136+0000 7ff3b9aaa640 1 --2- 172.21.15.88:0/2336884069 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7ff3a006e2b0 0x7ff3a0070770 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:46.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.136+0000 7ff3b9aaa640 1 --2- 172.21.15.88:0/2336884069 >> [v2:172.21.15.88:6818/3973957395,v1:172.21.15.88:6819/3973957395] conn(0x7ff3a00740a0 0x7ff3a00764c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:46.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.136+0000 7ff3b9aaa640 1 --2- 172.21.15.88:0/2336884069 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3b41033d0 0x7ff3b419dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:46.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.136+0000 7ff3b9aaa640 1 --2- 172.21.15.88:0/2336884069 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3b4102ab0 0x7ff3b419d730 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:46.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.136+0000 7ff3b9aaa640 1 -- 172.21.15.88:0/2336884069 >> 172.21.15.88:0/2336884069 conn(0x7ff3b40fc4d0 msgr2=0x7ff3b4103da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:46.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.136+0000 7ff3b9aaa640 1 -- 172.21.15.88:0/2336884069 shutdown_connections 2024-09-17T04:17:46.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:46.136+0000 7ff3b9aaa640 1 -- 172.21.15.88:0/2336884069 wait complete. 2024-09-17T04:17:46.987 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:46 smithi088 ceph-mon[27811]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:17:46.994 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:17:47.023 INFO:teuthology.orchestra.run.smithi088.stdout:81604378647 2024-09-17T04:17:47.023 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-17T04:17:47.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:46 smithi134 ceph-mon[35201]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:17:47.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.799+0000 7f521c445640 1 -- 172.21.15.88:0/4079174750 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52141033d0 msgr2=0x7f521410b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:47.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.799+0000 7f521c445640 1 --2- 172.21.15.88:0/4079174750 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52141033d0 0x7f521410b8c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5204009880 tx=0x7f520402a530 comp rx=0 tx=0).stop 2024-09-17T04:17:47.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.799+0000 7f521c445640 1 -- 172.21.15.88:0/4079174750 shutdown_connections 2024-09-17T04:17:47.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.799+0000 7f521c445640 1 --2- 172.21.15.88:0/4079174750 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52141033d0 0x7f521410b8c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:47.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.799+0000 7f521c445640 1 --2- 172.21.15.88:0/4079174750 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5214102ab0 0x7f5214102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:47.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.799+0000 7f521c445640 1 -- 172.21.15.88:0/4079174750 >> 172.21.15.88:0/4079174750 conn(0x7f52140fc550 msgr2=0x7f52140fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:47.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.799+0000 7f521c445640 1 -- 172.21.15.88:0/4079174750 shutdown_connections 2024-09-17T04:17:47.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.799+0000 7f521c445640 1 -- 172.21.15.88:0/4079174750 wait complete. 2024-09-17T04:17:47.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.800+0000 7f521c445640 1 Processor -- start 2024-09-17T04:17:47.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.800+0000 7f521c445640 1 -- start start 2024-09-17T04:17:47.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.800+0000 7f521c445640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5214102ab0 0x7f521419f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:47.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.800+0000 7f521c445640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52141033d0 0x7f521419fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:47.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.800+0000 7f521c445640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f5214101900 con 0x7f52141033d0 2024-09-17T04:17:47.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.800+0000 7f521c445640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5214101780 con 0x7f5214102ab0 2024-09-17T04:17:47.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.800+0000 7f52199e0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52141033d0 0x7f521419fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:47.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.800+0000 7f52199e0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52141033d0 0x7f521419fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56192/0 (socket says 172.21.15.88:56192) 2024-09-17T04:17:47.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.800+0000 7f521a1e1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5214102ab0 0x7f521419f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:47.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.800+0000 7f52199e0640 1 -- 172.21.15.88:0/4191749736 learned_addr learned my addr 172.21.15.88:0/4191749736 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:17:47.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.801+0000 7f52199e0640 1 -- 172.21.15.88:0/4191749736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5214102ab0 msgr2=0x7f521419f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:47.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.801+0000 7f52199e0640 1 --2- 172.21.15.88:0/4191749736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5214102ab0 0x7f521419f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:47.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.801+0000 7f52199e0640 1 -- 172.21.15.88:0/4191749736 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5214199a80 con 0x7f52141033d0 2024-09-17T04:17:47.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.801+0000 7f52199e0640 1 --2- 172.21.15.88:0/4191749736 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52141033d0 0x7f521419fe00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5204031460 tx=0x7f5204004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:47.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.801+0000 7f520b7fe640 1 -- 172.21.15.88:0/4191749736 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f520403f070 con 0x7f52141033d0 2024-09-17T04:17:47.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.801+0000 7f521c445640 1 -- 172.21.15.88:0/4191749736 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5214199d10 con 0x7f52141033d0 2024-09-17T04:17:47.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.801+0000 7f520b7fe640 1 -- 172.21.15.88:0/4191749736 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f52040035f0 con 0x7f52141033d0 2024-09-17T04:17:47.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.801+0000 7f520b7fe640 1 -- 172.21.15.88:0/4191749736 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5204035030 con 0x7f52141033d0 2024-09-17T04:17:47.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.801+0000 7f521c445640 1 -- 172.21.15.88:0/4191749736 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f521419a240 con 0x7f52141033d0 2024-09-17T04:17:47.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.802+0000 7f521c445640 1 -- 172.21.15.88:0/4191749736 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f521419a840 con 0x7f52141033d0 2024-09-17T04:17:47.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.803+0000 7f520b7fe640 1 -- 172.21.15.88:0/4191749736 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f5204042070 con 0x7f52141033d0 2024-09-17T04:17:47.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.803+0000 7f520b7fe640 1 --2- 172.21.15.88:0/4191749736 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f520006e2b0 0x7f5200070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:47.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.803+0000 7f520b7fe640 1 -- 172.21.15.88:0/4191749736 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f52040aeda0 con 0x7f52141033d0 2024-09-17T04:17:47.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.803+0000 7f521a1e1640 1 --2- 172.21.15.88:0/4191749736 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f520006e2b0 0x7f5200070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:47.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.803+0000 7f520b7fe640 1 --2- 172.21.15.88:0/4191749736 >> [v2:172.21.15.88:6810/1101608666,v1:172.21.15.88:6811/1101608666] conn(0x7f52000740a0 0x7f52000764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:47.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.803+0000 7f520b7fe640 1 -- 172.21.15.88:0/4191749736 --> [v2:172.21.15.88:6810/1101608666,v1:172.21.15.88:6811/1101608666] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f52040054e0 con 0x7f52000740a0 2024-09-17T04:17:47.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.803+0000 7f520b7fe640 1 -- 172.21.15.88:0/4191749736 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f52040af240 con 0x7f52141033d0 2024-09-17T04:17:47.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.803+0000 7f521a9e2640 1 --2- 172.21.15.88:0/4191749736 >> [v2:172.21.15.88:6810/1101608666,v1:172.21.15.88:6811/1101608666] conn(0x7f52000740a0 0x7f52000764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:47.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.804+0000 7f521a1e1640 1 --2- 172.21.15.88:0/4191749736 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f520006e2b0 0x7f5200070770 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f521419abc0 tx=0x7f521000b390 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:47.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.804+0000 7f521a9e2640 1 --2- 172.21.15.88:0/4191749736 >> [v2:172.21.15.88:6810/1101608666,v1:172.21.15.88:6811/1101608666] conn(0x7f52000740a0 0x7f52000764c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:47.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.804+0000 7f520b7fe640 1 -- 172.21.15.88:0/4191749736 <== osd.1 v2:172.21.15.88:6810/1101608666 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f52040054e0 con 0x7f52000740a0 2024-09-17T04:17:47.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.818+0000 7f521c445640 1 -- 172.21.15.88:0/4191749736 --> [v2:172.21.15.88:6810/1101608666,v1:172.21.15.88:6811/1101608666] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f521410b780 con 0x7f52000740a0 2024-09-17T04:17:47.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.818+0000 7f520b7fe640 1 -- 172.21.15.88:0/4191749736 <== osd.1 v2:172.21.15.88:6810/1101608666 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f521410b780 con 0x7f52000740a0 2024-09-17T04:17:47.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.818+0000 7f521c445640 1 -- 172.21.15.88:0/4191749736 >> [v2:172.21.15.88:6810/1101608666,v1:172.21.15.88:6811/1101608666] conn(0x7f52000740a0 msgr2=0x7f52000764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:47.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.818+0000 7f521c445640 1 --2- 172.21.15.88:0/4191749736 >> [v2:172.21.15.88:6810/1101608666,v1:172.21.15.88:6811/1101608666] conn(0x7f52000740a0 0x7f52000764c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:47.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.818+0000 7f521c445640 1 -- 172.21.15.88:0/4191749736 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f520006e2b0 msgr2=0x7f5200070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:47.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.818+0000 7f521c445640 1 --2- 172.21.15.88:0/4191749736 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f520006e2b0 0x7f5200070770 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f521419abc0 tx=0x7f521000b390 comp rx=0 tx=0).stop 2024-09-17T04:17:47.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.818+0000 7f521c445640 1 -- 172.21.15.88:0/4191749736 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52141033d0 msgr2=0x7f521419fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:47.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.818+0000 7f521c445640 1 --2- 172.21.15.88:0/4191749736 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52141033d0 0x7f521419fe00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5204031460 tx=0x7f5204004530 comp rx=0 tx=0).stop 2024-09-17T04:17:47.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.819+0000 7f521c445640 1 -- 172.21.15.88:0/4191749736 shutdown_connections 2024-09-17T04:17:47.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.819+0000 7f521c445640 1 --2- 172.21.15.88:0/4191749736 >> [v2:172.21.15.88:6810/1101608666,v1:172.21.15.88:6811/1101608666] conn(0x7f52000740a0 0x7f52000764c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:47.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.819+0000 7f521c445640 1 --2- 172.21.15.88:0/4191749736 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f520006e2b0 0x7f5200070770 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:47.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.819+0000 7f521c445640 1 --2- 172.21.15.88:0/4191749736 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52141033d0 0x7f521419fe00 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:47.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.819+0000 7f521c445640 1 --2- 172.21.15.88:0/4191749736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5214102ab0 0x7f521419f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:47.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.819+0000 7f521c445640 1 -- 172.21.15.88:0/4191749736 >> 172.21.15.88:0/4191749736 conn(0x7f52140fc550 msgr2=0x7f521410ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:47.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.819+0000 7f521c445640 1 -- 172.21.15.88:0/4191749736 shutdown_connections 2024-09-17T04:17:47.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.819+0000 7f521c445640 1 -- 172.21.15.88:0/4191749736 wait complete. 2024-09-17T04:17:47.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.689+0000 7fa3d44b3640 1 -- 172.21.15.88:0/2604381898 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3cc1007f0 msgr2=0x7fa3cc100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:47.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.689+0000 7fa3d44b3640 1 --2- 172.21.15.88:0/2604381898 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3cc1007f0 0x7fa3cc100c50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8009880 tx=0x7fa3c802a4a0 comp rx=0 tx=0).stop 2024-09-17T04:17:47.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.689+0000 7fa3d44b3640 1 -- 172.21.15.88:0/2604381898 shutdown_connections 2024-09-17T04:17:47.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.689+0000 7fa3d44b3640 1 --2- 172.21.15.88:0/2604381898 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3cc1007f0 0x7fa3cc100c50 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:47.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.689+0000 7fa3d44b3640 1 --2- 172.21.15.88:0/2604381898 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3cc1067f0 0x7fa3cc106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:47.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.689+0000 7fa3d44b3640 1 -- 172.21.15.88:0/2604381898 >> 172.21.15.88:0/2604381898 conn(0x7fa3cc0fc550 msgr2=0x7fa3cc0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:47.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.689+0000 7fa3d44b3640 1 -- 172.21.15.88:0/2604381898 shutdown_connections 2024-09-17T04:17:47.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.689+0000 7fa3d44b3640 1 -- 172.21.15.88:0/2604381898 wait complete. 2024-09-17T04:17:47.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.689+0000 7fa3d44b3640 1 Processor -- start 2024-09-17T04:17:47.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.689+0000 7fa3d44b3640 1 -- start start 2024-09-17T04:17:47.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.689+0000 7fa3d44b3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3cc1007f0 0x7fa3cc19d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:47.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.690+0000 7fa3d44b3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3cc1067f0 0x7fa3cc19dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:47.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.690+0000 7fa3d44b3640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa3cc10dca0 con 0x7fa3cc1007f0 2024-09-17T04:17:47.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.690+0000 7fa3d44b3640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa3cc10db20 con 0x7fa3cc1067f0 2024-09-17T04:17:47.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.690+0000 7fa3d224f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3cc1007f0 0x7fa3cc19d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:47.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.690+0000 7fa3d224f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3cc1007f0 0x7fa3cc19d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56184/0 (socket says 172.21.15.88:56184) 2024-09-17T04:17:47.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.690+0000 7fa3d224f640 1 -- 172.21.15.88:0/2292475318 learned_addr learned my addr 172.21.15.88:0/2292475318 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:17:47.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.690+0000 7fa3d224f640 1 -- 172.21.15.88:0/2292475318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3cc1067f0 msgr2=0x7fa3cc19dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:47.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.690+0000 7fa3d224f640 1 --2- 172.21.15.88:0/2292475318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3cc1067f0 0x7fa3cc19dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:47.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.690+0000 7fa3d224f640 1 -- 172.21.15.88:0/2292475318 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3cc197770 con 0x7fa3cc1007f0 2024-09-17T04:17:47.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.690+0000 7fa3d224f640 1 --2- 172.21.15.88:0/2292475318 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3cc1007f0 0x7fa3cc19d6a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa3c000c8a0 tx=0x7fa3c000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:47.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.690+0000 7fa3bf7fe640 1 -- 172.21.15.88:0/2292475318 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa3c00079b0 con 0x7fa3cc1007f0 2024-09-17T04:17:47.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.690+0000 7fa3bf7fe640 1 -- 172.21.15.88:0/2292475318 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa3c0007b50 con 0x7fa3cc1007f0 2024-09-17T04:17:47.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.690+0000 7fa3d44b3640 1 -- 172.21.15.88:0/2292475318 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3cc197a60 con 0x7fa3cc1007f0 2024-09-17T04:17:47.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.690+0000 7fa3bf7fe640 1 -- 172.21.15.88:0/2292475318 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa3c0018700 con 0x7fa3cc1007f0 2024-09-17T04:17:47.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.690+0000 7fa3d44b3640 1 -- 172.21.15.88:0/2292475318 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3cc197ff0 con 0x7fa3cc1007f0 2024-09-17T04:17:47.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.691+0000 7fa3d44b3640 1 -- 172.21.15.88:0/2292475318 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3cc101f30 con 0x7fa3cc1007f0 2024-09-17T04:17:47.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.692+0000 7fa3bf7fe640 1 -- 172.21.15.88:0/2292475318 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fa3c0007d00 con 0x7fa3cc1007f0 2024-09-17T04:17:47.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.692+0000 7fa3bf7fe640 1 --2- 172.21.15.88:0/2292475318 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fa3b806e2b0 0x7fa3b8070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:47.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.692+0000 7fa3bf7fe640 1 -- 172.21.15.88:0/2292475318 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fa3c008e110 con 0x7fa3cc1007f0 2024-09-17T04:17:47.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.692+0000 7fa3d1a4e640 1 --2- 172.21.15.88:0/2292475318 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fa3b806e2b0 0x7fa3b8070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:47.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.693+0000 7fa3d1a4e640 1 --2- 172.21.15.88:0/2292475318 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fa3b806e2b0 0x7fa3b8070770 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa3c80096c0 tx=0x7fa3c8000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:47.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.696+0000 7fa3bf7fe640 1 -- 172.21.15.88:0/2292475318 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa3c0014030 con 0x7fa3cc1007f0 2024-09-17T04:17:47.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.875+0000 7fa3d44b3640 1 -- 172.21.15.88:0/2292475318 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fa3cc198300 con 0x7fa3cc1007f0 2024-09-17T04:17:47.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.875+0000 7fa3bf7fe640 1 -- 172.21.15.88:0/2292475318 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa3c0016300 con 0x7fa3cc1007f0 2024-09-17T04:17:47.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.878+0000 7fa3d44b3640 1 -- 172.21.15.88:0/2292475318 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fa3b806e2b0 msgr2=0x7fa3b8070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:47.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.878+0000 7fa3d44b3640 1 --2- 172.21.15.88:0/2292475318 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fa3b806e2b0 0x7fa3b8070770 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa3c80096c0 tx=0x7fa3c8000bc0 comp rx=0 tx=0).stop 2024-09-17T04:17:47.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.878+0000 7fa3d44b3640 1 -- 172.21.15.88:0/2292475318 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3cc1007f0 msgr2=0x7fa3cc19d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:47.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.878+0000 7fa3d44b3640 1 --2- 172.21.15.88:0/2292475318 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3cc1007f0 0x7fa3cc19d6a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa3c000c8a0 tx=0x7fa3c000cd60 comp rx=0 tx=0).stop 2024-09-17T04:17:47.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.878+0000 7fa3d44b3640 1 -- 172.21.15.88:0/2292475318 shutdown_connections 2024-09-17T04:17:47.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.878+0000 7fa3d44b3640 1 --2- 172.21.15.88:0/2292475318 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fa3b806e2b0 0x7fa3b8070770 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:47.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.878+0000 7fa3d44b3640 1 --2- 172.21.15.88:0/2292475318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3cc1067f0 0x7fa3cc19dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:47.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.878+0000 7fa3d44b3640 1 --2- 172.21.15.88:0/2292475318 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3cc1007f0 0x7fa3cc19d6a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:47.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.878+0000 7fa3d44b3640 1 -- 172.21.15.88:0/2292475318 >> 172.21.15.88:0/2292475318 conn(0x7fa3cc0fc550 msgr2=0x7fa3cc104560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:47.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.878+0000 7fa3d44b3640 1 -- 172.21.15.88:0/2292475318 shutdown_connections 2024-09-17T04:17:47.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:47.878+0000 7fa3d44b3640 1 -- 172.21.15.88:0/2292475318 wait complete. 2024-09-17T04:17:47.945 INFO:teuthology.orchestra.run.smithi088.stdout:141733920780 2024-09-17T04:17:48.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:47 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/2292475318' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-17T04:17:48.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:47 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/2292475318' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-17T04:17:48.584 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920779 got 141733920780 for osd.4 2024-09-17T04:17:48.584 DEBUG:teuthology.parallel:result is None 2024-09-17T04:17:48.750 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:17:49.145 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:48 smithi088 ceph-mon[27811]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:17:49.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:48 smithi134 ceph-mon[35201]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:17:49.169 INFO:teuthology.orchestra.run.smithi088.stdout:38654705698 2024-09-17T04:17:49.169 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-17T04:17:49.579 INFO:teuthology.orchestra.run.smithi088.stdout:60129542173 2024-09-17T04:17:49.580 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-17T04:17:49.598 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:17:50.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.248+0000 7f444243a640 1 -- 172.21.15.88:0/3061869862 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f443c1007f0 msgr2=0x7f443c100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:50.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.248+0000 7f444243a640 1 --2- 172.21.15.88:0/3061869862 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f443c1007f0 0x7f443c100c50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f44300097e0 tx=0x7f443002a3f0 comp rx=0 tx=0).stop 2024-09-17T04:17:50.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.248+0000 7f444243a640 1 -- 172.21.15.88:0/3061869862 shutdown_connections 2024-09-17T04:17:50.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.248+0000 7f444243a640 1 --2- 172.21.15.88:0/3061869862 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f443c1007f0 0x7f443c100c50 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:50.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.248+0000 7f444243a640 1 --2- 172.21.15.88:0/3061869862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f443c1067f0 0x7f443c106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:50.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.248+0000 7f444243a640 1 -- 172.21.15.88:0/3061869862 >> 172.21.15.88:0/3061869862 conn(0x7f443c0fc4d0 msgr2=0x7f443c0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:50.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.248+0000 7f444243a640 1 -- 172.21.15.88:0/3061869862 shutdown_connections 2024-09-17T04:17:50.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.248+0000 7f444243a640 1 -- 172.21.15.88:0/3061869862 wait complete. 2024-09-17T04:17:50.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.249+0000 7f444243a640 1 Processor -- start 2024-09-17T04:17:50.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.249+0000 7f444243a640 1 -- start start 2024-09-17T04:17:50.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.250+0000 7f444243a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f443c1007f0 0x7f443c19c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:50.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.250+0000 7f444243a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f443c1067f0 0x7f443c19cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:50.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.250+0000 7f444243a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f443c10dcc0 con 0x7f443c1007f0 2024-09-17T04:17:50.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.250+0000 7f444243a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f443c10db40 con 0x7f443c1067f0 2024-09-17T04:17:50.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.250+0000 7f443bfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f443c1007f0 0x7f443c19c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:50.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.250+0000 7f443bfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f443c1007f0 0x7f443c19c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56220/0 (socket says 172.21.15.88:56220) 2024-09-17T04:17:50.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.250+0000 7f443bfff640 1 -- 172.21.15.88:0/1134962425 learned_addr learned my addr 172.21.15.88:0/1134962425 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:17:50.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.250+0000 7f443b7fe640 1 --2- 172.21.15.88:0/1134962425 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f443c1067f0 0x7f443c19cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:50.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.250+0000 7f443bfff640 1 -- 172.21.15.88:0/1134962425 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f443c1067f0 msgr2=0x7f443c19cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:50.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.250+0000 7f443bfff640 1 --2- 172.21.15.88:0/1134962425 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f443c1067f0 0x7f443c19cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:50.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.250+0000 7f443bfff640 1 -- 172.21.15.88:0/1134962425 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f443c196710 con 0x7f443c1007f0 2024-09-17T04:17:50.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.250+0000 7f443bfff640 1 --2- 172.21.15.88:0/1134962425 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f443c1007f0 0x7f443c19c640 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f442c00e970 tx=0x7f442c00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:50.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.250+0000 7f44397fa640 1 -- 172.21.15.88:0/1134962425 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f442c00cac0 con 0x7f443c1007f0 2024-09-17T04:17:50.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.250+0000 7f44397fa640 1 -- 172.21.15.88:0/1134962425 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f442c0054e0 con 0x7f443c1007f0 2024-09-17T04:17:50.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.250+0000 7f444243a640 1 -- 172.21.15.88:0/1134962425 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f443c196a00 con 0x7f443c1007f0 2024-09-17T04:17:50.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.250+0000 7f44397fa640 1 -- 172.21.15.88:0/1134962425 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f442c004d70 con 0x7f443c1007f0 2024-09-17T04:17:50.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.250+0000 7f444243a640 1 -- 172.21.15.88:0/1134962425 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f443c196f60 con 0x7f443c1007f0 2024-09-17T04:17:50.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.251+0000 7f444243a640 1 -- 172.21.15.88:0/1134962425 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f443c101f30 con 0x7f443c1007f0 2024-09-17T04:17:50.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.252+0000 7f44397fa640 1 -- 172.21.15.88:0/1134962425 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f442c010480 con 0x7f443c1007f0 2024-09-17T04:17:50.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.252+0000 7f44397fa640 1 --2- 172.21.15.88:0/1134962425 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f442406e300 0x7f44240707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:50.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.252+0000 7f44397fa640 1 -- 172.21.15.88:0/1134962425 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f442c08e410 con 0x7f443c1007f0 2024-09-17T04:17:50.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.252+0000 7f443b7fe640 1 --2- 172.21.15.88:0/1134962425 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f442406e300 0x7f44240707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:50.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.253+0000 7f443b7fe640 1 --2- 172.21.15.88:0/1134962425 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f442406e300 0x7f44240707c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4430030980 tx=0x7f4430030910 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:50.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.257+0000 7f44397fa640 1 -- 172.21.15.88:0/1134962425 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f442c05c130 con 0x7f443c1007f0 2024-09-17T04:17:50.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.426+0000 7f444243a640 1 -- 172.21.15.88:0/1134962425 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f443c108d60 con 0x7f443c1007f0 2024-09-17T04:17:50.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.427+0000 7f44397fa640 1 -- 172.21.15.88:0/1134962425 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f442c05fde0 con 0x7f443c1007f0 2024-09-17T04:17:50.427 INFO:teuthology.orchestra.run.smithi088.stdout:81604378648 2024-09-17T04:17:50.429 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.429+0000 7f444243a640 1 -- 172.21.15.88:0/1134962425 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f442406e300 msgr2=0x7f44240707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:50.429 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.429+0000 7f444243a640 1 --2- 172.21.15.88:0/1134962425 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f442406e300 0x7f44240707c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4430030980 tx=0x7f4430030910 comp rx=0 tx=0).stop 2024-09-17T04:17:50.429 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.429+0000 7f444243a640 1 -- 172.21.15.88:0/1134962425 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f443c1007f0 msgr2=0x7f443c19c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:50.429 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.429+0000 7f444243a640 1 --2- 172.21.15.88:0/1134962425 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f443c1007f0 0x7f443c19c640 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f442c00e970 tx=0x7f442c00ee30 comp rx=0 tx=0).stop 2024-09-17T04:17:50.429 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.429+0000 7f444243a640 1 -- 172.21.15.88:0/1134962425 shutdown_connections 2024-09-17T04:17:50.430 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.429+0000 7f444243a640 1 --2- 172.21.15.88:0/1134962425 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f442406e300 0x7f44240707c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:50.430 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.429+0000 7f444243a640 1 --2- 172.21.15.88:0/1134962425 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f443c1067f0 0x7f443c19cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:50.430 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.429+0000 7f444243a640 1 --2- 172.21.15.88:0/1134962425 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f443c1007f0 0x7f443c19c640 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:50.430 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.429+0000 7f444243a640 1 -- 172.21.15.88:0/1134962425 >> 172.21.15.88:0/1134962425 conn(0x7f443c0fc4d0 msgr2=0x7f443c0fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:50.430 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.429+0000 7f444243a640 1 -- 172.21.15.88:0/1134962425 shutdown_connections 2024-09-17T04:17:50.430 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.429+0000 7f444243a640 1 -- 172.21.15.88:0/1134962425 wait complete. 2024-09-17T04:17:50.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.452+0000 7f4f1fb29640 1 -- 172.21.15.88:0/3040655157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f18102ab0 msgr2=0x7f4f18102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:50.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.452+0000 7f4f1fb29640 1 --2- 172.21.15.88:0/3040655157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f18102ab0 0x7f4f18102e90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4f08009880 tx=0x7f4f0802a540 comp rx=0 tx=0).stop 2024-09-17T04:17:50.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.452+0000 7f4f1fb29640 1 -- 172.21.15.88:0/3040655157 shutdown_connections 2024-09-17T04:17:50.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.452+0000 7f4f1fb29640 1 --2- 172.21.15.88:0/3040655157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f181033d0 0x7f4f1810b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:50.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.452+0000 7f4f1fb29640 1 --2- 172.21.15.88:0/3040655157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f18102ab0 0x7f4f18102e90 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:50.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.452+0000 7f4f1fb29640 1 -- 172.21.15.88:0/3040655157 >> 172.21.15.88:0/3040655157 conn(0x7f4f180fc550 msgr2=0x7f4f180fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:50.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.452+0000 7f4f1fb29640 1 -- 172.21.15.88:0/3040655157 shutdown_connections 2024-09-17T04:17:50.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.452+0000 7f4f1fb29640 1 -- 172.21.15.88:0/3040655157 wait complete. 2024-09-17T04:17:50.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.453+0000 7f4f1fb29640 1 Processor -- start 2024-09-17T04:17:50.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.453+0000 7f4f1fb29640 1 -- start start 2024-09-17T04:17:50.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.453+0000 7f4f1fb29640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f18102ab0 0x7f4f1819d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:50.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.453+0000 7f4f1fb29640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f181033d0 0x7f4f1819db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:50.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.453+0000 7f4f1fb29640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f4f1810edc0 con 0x7f4f18102ab0 2024-09-17T04:17:50.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.453+0000 7f4f1fb29640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4f1810ec40 con 0x7f4f181033d0 2024-09-17T04:17:50.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.454+0000 7f4f1d8c5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f18102ab0 0x7f4f1819d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:50.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.454+0000 7f4f1d8c5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f18102ab0 0x7f4f1819d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56236/0 (socket says 172.21.15.88:56236) 2024-09-17T04:17:50.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.454+0000 7f4f1d8c5640 1 -- 172.21.15.88:0/22548217 learned_addr learned my addr 172.21.15.88:0/22548217 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:17:50.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.454+0000 7f4f1d0c4640 1 --2- 172.21.15.88:0/22548217 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f181033d0 0x7f4f1819db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:50.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.454+0000 7f4f1d8c5640 1 -- 172.21.15.88:0/22548217 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f181033d0 msgr2=0x7f4f1819db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:50.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.454+0000 7f4f1d8c5640 1 --2- 172.21.15.88:0/22548217 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f181033d0 0x7f4f1819db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:50.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.454+0000 7f4f1d8c5640 1 -- 172.21.15.88:0/22548217 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f181977b0 con 0x7f4f18102ab0 2024-09-17T04:17:50.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.454+0000 7f4f1d0c4640 1 --2- 172.21.15.88:0/22548217 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f181033d0 0x7f4f1819db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:17:50.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.454+0000 7f4f1d8c5640 1 --2- 172.21.15.88:0/22548217 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f18102ab0 0x7f4f1819d630 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4f08031460 tx=0x7f4f080045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:50.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.454+0000 7f4f0effd640 1 -- 172.21.15.88:0/22548217 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4f0803f070 con 0x7f4f18102ab0 2024-09-17T04:17:50.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.454+0000 7f4f0effd640 1 -- 172.21.15.88:0/22548217 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4f080035f0 con 0x7f4f18102ab0 2024-09-17T04:17:50.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.454+0000 7f4f1fb29640 1 -- 172.21.15.88:0/22548217 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f18197a40 con 0x7f4f18102ab0 2024-09-17T04:17:50.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.454+0000 7f4f0effd640 1 -- 172.21.15.88:0/22548217 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4f08035030 con 0x7f4f18102ab0 2024-09-17T04:17:50.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.454+0000 7f4f1fb29640 1 -- 172.21.15.88:0/22548217 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f18197f70 con 0x7f4f18102ab0 2024-09-17T04:17:50.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.456+0000 7f4f1fb29640 1 -- 172.21.15.88:0/22548217 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f1806a580 con 0x7f4f18102ab0 2024-09-17T04:17:50.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.456+0000 7f4f0effd640 1 -- 172.21.15.88:0/22548217 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f4f08042070 con 0x7f4f18102ab0 2024-09-17T04:17:50.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.457+0000 7f4f0effd640 1 --2- 172.21.15.88:0/22548217 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f4f0406e2b0 0x7f4f04070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:50.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.457+0000 7f4f0effd640 1 -- 172.21.15.88:0/22548217 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f4f080ae7f0 con 0x7f4f18102ab0 2024-09-17T04:17:50.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.457+0000 7f4f1d0c4640 1 --2- 172.21.15.88:0/22548217 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f4f0406e2b0 0x7f4f04070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:50.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.457+0000 7f4f1d0c4640 1 --2- 172.21.15.88:0/22548217 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f4f0406e2b0 0x7f4f04070770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4f140058c0 tx=0x7f4f14005850 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:50.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.462+0000 7f4f0effd640 1 -- 172.21.15.88:0/22548217 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4f0807c490 con 0x7f4f18102ab0 2024-09-17T04:17:50.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.631+0000 7f4f1fb29640 1 -- 172.21.15.88:0/22548217 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f4f18105f80 con 0x7f4f18102ab0 2024-09-17T04:17:50.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.632+0000 7f4f0effd640 1 -- 172.21.15.88:0/22548217 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f4f08080140 con 0x7f4f18102ab0 2024-09-17T04:17:50.632 INFO:teuthology.orchestra.run.smithi088.stdout:111669149714 2024-09-17T04:17:50.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.634+0000 7f4f1fb29640 1 -- 172.21.15.88:0/22548217 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f4f0406e2b0 msgr2=0x7f4f04070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:50.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.634+0000 7f4f1fb29640 1 --2- 172.21.15.88:0/22548217 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f4f0406e2b0 0x7f4f04070770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4f140058c0 tx=0x7f4f14005850 comp rx=0 tx=0).stop 2024-09-17T04:17:50.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.634+0000 7f4f1fb29640 1 -- 172.21.15.88:0/22548217 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f18102ab0 msgr2=0x7f4f1819d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:50.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.634+0000 7f4f1fb29640 1 --2- 172.21.15.88:0/22548217 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f18102ab0 0x7f4f1819d630 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4f08031460 tx=0x7f4f080045e0 comp rx=0 tx=0).stop 2024-09-17T04:17:50.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.634+0000 7f4f1fb29640 1 -- 172.21.15.88:0/22548217 shutdown_connections 2024-09-17T04:17:50.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.634+0000 7f4f1fb29640 1 --2- 172.21.15.88:0/22548217 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f4f0406e2b0 0x7f4f04070770 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:50.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.634+0000 7f4f1fb29640 1 --2- 172.21.15.88:0/22548217 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f181033d0 0x7f4f1819db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:50.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.634+0000 7f4f1fb29640 1 --2- 172.21.15.88:0/22548217 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f18102ab0 0x7f4f1819d630 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:50.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.634+0000 7f4f1fb29640 1 -- 172.21.15.88:0/22548217 >> 172.21.15.88:0/22548217 conn(0x7f4f180fc550 msgr2=0x7f4f18108ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:50.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.634+0000 7f4f1fb29640 1 -- 172.21.15.88:0/22548217 shutdown_connections 2024-09-17T04:17:50.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:50.634+0000 7f4f1fb29640 1 -- 172.21.15.88:0/22548217 wait complete. 2024-09-17T04:17:51.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:50 smithi088 ceph-mon[27811]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:17:51.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:50 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/1134962425' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-17T04:17:51.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:50 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/22548217' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-17T04:17:51.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:50 smithi134 ceph-mon[35201]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:17:51.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:50 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/1134962425' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-17T04:17:51.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:50 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/22548217' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-17T04:17:51.397 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378647 got 81604378648 for osd.2 2024-09-17T04:17:51.398 DEBUG:teuthology.parallel:result is None 2024-09-17T04:17:51.805 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:17:51.838 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149713 got 111669149714 for osd.3 2024-09-17T04:17:51.838 DEBUG:teuthology.parallel:result is None 2024-09-17T04:17:51.841 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:17:52.091 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:51 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:17:52.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:51 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:17:52.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.553+0000 7f50b373c640 1 -- 172.21.15.88:0/2975439967 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50ac1003c0 msgr2=0x7f50ac1007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:52.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.553+0000 7f50b373c640 1 --2- 172.21.15.88:0/2975439967 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50ac1003c0 0x7f50ac1007a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f50a8009880 tx=0x7f50a802a4a0 comp rx=0 tx=0).stop 2024-09-17T04:17:52.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.553+0000 7f50b373c640 1 -- 172.21.15.88:0/2975439967 shutdown_connections 2024-09-17T04:17:52.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.553+0000 7f50b373c640 1 --2- 172.21.15.88:0/2975439967 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50ac100d70 0x7f50ac1065c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:52.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.553+0000 7f50b373c640 1 --2- 172.21.15.88:0/2975439967 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50ac1003c0 0x7f50ac1007a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:52.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.553+0000 7f50b373c640 1 -- 172.21.15.88:0/2975439967 >> 172.21.15.88:0/2975439967 conn(0x7f50ac077150 msgr2=0x7f50ac077560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:52.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.553+0000 7f50b373c640 1 -- 172.21.15.88:0/2975439967 shutdown_connections 2024-09-17T04:17:52.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.553+0000 7f50b373c640 1 -- 172.21.15.88:0/2975439967 wait complete. 2024-09-17T04:17:52.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.553+0000 7f50b373c640 1 Processor -- start 2024-09-17T04:17:52.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.553+0000 7f50b373c640 1 -- start start 2024-09-17T04:17:52.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.553+0000 7f50b373c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50ac1003c0 0x7f50ac19d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:52.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.553+0000 7f50b373c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50ac100d70 0x7f50ac19dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:52.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.553+0000 7f50b373c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f50ac10ee40 con 0x7f50ac1003c0 2024-09-17T04:17:52.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.553+0000 7f50b373c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f50ac10ecc0 con 0x7f50ac100d70 2024-09-17T04:17:52.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.554+0000 7f50b14d8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50ac1003c0 0x7f50ac19d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:52.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.554+0000 7f50b14d8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50ac1003c0 0x7f50ac19d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53304/0 (socket says 172.21.15.88:53304) 2024-09-17T04:17:52.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.554+0000 7f50b14d8640 1 -- 172.21.15.88:0/3442274994 learned_addr learned my addr 172.21.15.88:0/3442274994 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:17:52.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.554+0000 7f50b0cd7640 1 --2- 172.21.15.88:0/3442274994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50ac100d70 0x7f50ac19dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:52.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.554+0000 7f50b14d8640 1 -- 172.21.15.88:0/3442274994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50ac100d70 msgr2=0x7f50ac19dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:52.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.554+0000 7f50b14d8640 1 --2- 172.21.15.88:0/3442274994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50ac100d70 0x7f50ac19dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:52.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.554+0000 7f50b14d8640 1 -- 172.21.15.88:0/3442274994 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50ac1977f0 con 0x7f50ac1003c0 2024-09-17T04:17:52.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.554+0000 7f50b14d8640 1 --2- 172.21.15.88:0/3442274994 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50ac1003c0 0x7f50ac19d670 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f50a8031460 tx=0x7f50a80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:52.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.554+0000 7f50a27fc640 1 -- 172.21.15.88:0/3442274994 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f50a803f070 con 0x7f50ac1003c0 2024-09-17T04:17:52.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.554+0000 7f50a27fc640 1 -- 172.21.15.88:0/3442274994 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f50a8004cf0 con 0x7f50ac1003c0 2024-09-17T04:17:52.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.554+0000 7f50b373c640 1 -- 172.21.15.88:0/3442274994 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50ac197a80 con 0x7f50ac1003c0 2024-09-17T04:17:52.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.554+0000 7f50a27fc640 1 -- 172.21.15.88:0/3442274994 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f50a8035030 con 0x7f50ac1003c0 2024-09-17T04:17:52.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.554+0000 7f50b373c640 1 -- 172.21.15.88:0/3442274994 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50ac198030 con 0x7f50ac1003c0 2024-09-17T04:17:52.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.555+0000 7f50b373c640 1 -- 172.21.15.88:0/3442274994 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50ac069d90 con 0x7f50ac1003c0 2024-09-17T04:17:52.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.556+0000 7f50a27fc640 1 -- 172.21.15.88:0/3442274994 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f50a8042070 con 0x7f50ac1003c0 2024-09-17T04:17:52.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.556+0000 7f50a27fc640 1 --2- 172.21.15.88:0/3442274994 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f509806e2b0 0x7f5098070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:52.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.556+0000 7f50a27fc640 1 -- 172.21.15.88:0/3442274994 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f50a80ae910 con 0x7f50ac1003c0 2024-09-17T04:17:52.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.556+0000 7f50b0cd7640 1 --2- 172.21.15.88:0/3442274994 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f509806e2b0 0x7f5098070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:52.576 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.557+0000 7f50b0cd7640 1 --2- 172.21.15.88:0/3442274994 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f509806e2b0 0x7f5098070770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f50ac0ffc50 tx=0x7f509c008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:52.576 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.561+0000 7f50a27fc640 1 -- 172.21.15.88:0/3442274994 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f50a807c5b0 con 0x7f50ac1003c0 2024-09-17T04:17:52.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.733+0000 7f50b373c640 1 -- 172.21.15.88:0/3442274994 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f50ac109ea0 con 0x7f50ac1003c0 2024-09-17T04:17:52.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.733+0000 7f50a27fc640 1 -- 172.21.15.88:0/3442274994 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f50a8080260 con 0x7f50ac1003c0 2024-09-17T04:17:52.733 INFO:teuthology.orchestra.run.smithi088.stdout:38654705700 2024-09-17T04:17:52.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.735+0000 7f50b373c640 1 -- 172.21.15.88:0/3442274994 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f509806e2b0 msgr2=0x7f5098070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:52.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.735+0000 7f50b373c640 1 --2- 172.21.15.88:0/3442274994 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f509806e2b0 0x7f5098070770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f50ac0ffc50 tx=0x7f509c008040 comp rx=0 tx=0).stop 2024-09-17T04:17:52.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.735+0000 7f50b373c640 1 -- 172.21.15.88:0/3442274994 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50ac1003c0 msgr2=0x7f50ac19d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:52.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.735+0000 7f50b373c640 1 --2- 172.21.15.88:0/3442274994 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50ac1003c0 0x7f50ac19d670 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f50a8031460 tx=0x7f50a80048f0 comp rx=0 tx=0).stop 2024-09-17T04:17:52.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.735+0000 7f50b373c640 1 -- 172.21.15.88:0/3442274994 shutdown_connections 2024-09-17T04:17:52.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.735+0000 7f50b373c640 1 --2- 172.21.15.88:0/3442274994 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f509806e2b0 0x7f5098070770 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:52.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.735+0000 7f50b373c640 1 --2- 172.21.15.88:0/3442274994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50ac100d70 0x7f50ac19dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:52.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.735+0000 7f50b373c640 1 --2- 172.21.15.88:0/3442274994 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50ac1003c0 0x7f50ac19d670 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:52.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.735+0000 7f50b373c640 1 -- 172.21.15.88:0/3442274994 >> 172.21.15.88:0/3442274994 conn(0x7f50ac077150 msgr2=0x7f50ac0fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:52.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.735+0000 7f50b373c640 1 -- 172.21.15.88:0/3442274994 shutdown_connections 2024-09-17T04:17:52.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.735+0000 7f50b373c640 1 -- 172.21.15.88:0/3442274994 wait complete. 2024-09-17T04:17:52.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.774+0000 7f20c3b7f640 1 -- 172.21.15.88:0/451818232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20bc1007f0 msgr2=0x7f20bc100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:52.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.774+0000 7f20c3b7f640 1 --2- 172.21.15.88:0/451818232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20bc1007f0 0x7f20bc100c50 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f20b0009880 tx=0x7f20b002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:17:52.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.775+0000 7f20c3b7f640 1 -- 172.21.15.88:0/451818232 shutdown_connections 2024-09-17T04:17:52.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.775+0000 7f20c3b7f640 1 --2- 172.21.15.88:0/451818232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20bc1007f0 0x7f20bc100c50 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:52.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.775+0000 7f20c3b7f640 1 --2- 172.21.15.88:0/451818232 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20bc1067f0 0x7f20bc106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:52.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.775+0000 7f20c3b7f640 1 -- 172.21.15.88:0/451818232 >> 172.21.15.88:0/451818232 conn(0x7f20bc0fc4d0 msgr2=0x7f20bc0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:52.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.775+0000 7f20c3b7f640 1 -- 172.21.15.88:0/451818232 shutdown_connections 2024-09-17T04:17:52.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.775+0000 7f20c3b7f640 1 -- 172.21.15.88:0/451818232 wait complete. 2024-09-17T04:17:52.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.775+0000 7f20c3b7f640 1 Processor -- start 2024-09-17T04:17:52.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.775+0000 7f20c3b7f640 1 -- start start 2024-09-17T04:17:52.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.775+0000 7f20c3b7f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20bc1007f0 0x7f20bc1987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:52.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.775+0000 7f20c3b7f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20bc1067f0 0x7f20bc198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:52.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.775+0000 7f20c3b7f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f20bc10dcc0 con 0x7f20bc1007f0 2024-09-17T04:17:52.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.775+0000 7f20c3b7f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f20bc10db40 con 0x7f20bc1067f0 2024-09-17T04:17:52.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.776+0000 7f20c191b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20bc1007f0 0x7f20bc1987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:52.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.776+0000 7f20c191b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20bc1007f0 0x7f20bc1987d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53334/0 (socket says 172.21.15.88:53334) 2024-09-17T04:17:52.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.776+0000 7f20c191b640 1 -- 172.21.15.88:0/2642088528 learned_addr learned my addr 172.21.15.88:0/2642088528 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:17:52.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.776+0000 7f20c111a640 1 --2- 172.21.15.88:0/2642088528 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20bc1067f0 0x7f20bc198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:52.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.776+0000 7f20c191b640 1 -- 172.21.15.88:0/2642088528 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20bc1067f0 msgr2=0x7f20bc198d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:52.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.776+0000 7f20c191b640 1 --2- 172.21.15.88:0/2642088528 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20bc1067f0 0x7f20bc198d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:52.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.776+0000 7f20c191b640 1 -- 172.21.15.88:0/2642088528 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20bc199360 con 0x7f20bc1007f0 2024-09-17T04:17:52.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.776+0000 7f20c191b640 1 --2- 172.21.15.88:0/2642088528 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20bc1007f0 0x7f20bc1987d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f20b400d6f0 tx=0x7f20b400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:52.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.776+0000 7f20baffd640 1 -- 172.21.15.88:0/2642088528 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f20b4017070 con 0x7f20bc1007f0 2024-09-17T04:17:52.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.776+0000 7f20c3b7f640 1 -- 172.21.15.88:0/2642088528 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20bc1a1840 con 0x7f20bc1007f0 2024-09-17T04:17:52.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.776+0000 7f20baffd640 1 -- 172.21.15.88:0/2642088528 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f20b400de00 con 0x7f20bc1007f0 2024-09-17T04:17:52.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.776+0000 7f20c3b7f640 1 -- 172.21.15.88:0/2642088528 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20bc1a1c40 con 0x7f20bc1007f0 2024-09-17T04:17:52.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.776+0000 7f20baffd640 1 -- 172.21.15.88:0/2642088528 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f20b4004bb0 con 0x7f20bc1007f0 2024-09-17T04:17:52.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.777+0000 7f20c3b7f640 1 -- 172.21.15.88:0/2642088528 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20bc101f30 con 0x7f20bc1007f0 2024-09-17T04:17:52.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.778+0000 7f20baffd640 1 -- 172.21.15.88:0/2642088528 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f20b4004e60 con 0x7f20bc1007f0 2024-09-17T04:17:52.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.778+0000 7f20baffd640 1 --2- 172.21.15.88:0/2642088528 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f20a406e4b0 0x7f20a4070970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:52.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.778+0000 7f20baffd640 1 -- 172.21.15.88:0/2642088528 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f20b408d890 con 0x7f20bc1007f0 2024-09-17T04:17:52.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.778+0000 7f20c111a640 1 --2- 172.21.15.88:0/2642088528 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f20a406e4b0 0x7f20a4070970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:52.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.779+0000 7f20c111a640 1 --2- 172.21.15.88:0/2642088528 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f20a406e4b0 0x7f20a4070970 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f20bc06b050 tx=0x7f20b0031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:52.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.783+0000 7f20baffd640 1 -- 172.21.15.88:0/2642088528 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f20b405b530 con 0x7f20bc1007f0 2024-09-17T04:17:52.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.950+0000 7f20c3b7f640 1 -- 172.21.15.88:0/2642088528 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f20bc108d60 con 0x7f20bc1007f0 2024-09-17T04:17:52.951 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:52 smithi088 ceph-mon[27811]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:17:52.951 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:52 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/3442274994' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-17T04:17:52.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.951+0000 7f20baffd640 1 -- 172.21.15.88:0/2642088528 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f20b405f1e0 con 0x7f20bc1007f0 2024-09-17T04:17:52.951 INFO:teuthology.orchestra.run.smithi088.stdout:60129542174 2024-09-17T04:17:52.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.953+0000 7f20c3b7f640 1 -- 172.21.15.88:0/2642088528 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f20a406e4b0 msgr2=0x7f20a4070970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:52.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.953+0000 7f20c3b7f640 1 --2- 172.21.15.88:0/2642088528 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f20a406e4b0 0x7f20a4070970 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f20bc06b050 tx=0x7f20b0031400 comp rx=0 tx=0).stop 2024-09-17T04:17:52.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.953+0000 7f20c3b7f640 1 -- 172.21.15.88:0/2642088528 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20bc1007f0 msgr2=0x7f20bc1987d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:52.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.953+0000 7f20c3b7f640 1 --2- 172.21.15.88:0/2642088528 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20bc1007f0 0x7f20bc1987d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f20b400d6f0 tx=0x7f20b400dbb0 comp rx=0 tx=0).stop 2024-09-17T04:17:52.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.953+0000 7f20c3b7f640 1 -- 172.21.15.88:0/2642088528 shutdown_connections 2024-09-17T04:17:52.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.953+0000 7f20c3b7f640 1 --2- 172.21.15.88:0/2642088528 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f20a406e4b0 0x7f20a4070970 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:52.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.953+0000 7f20c3b7f640 1 --2- 172.21.15.88:0/2642088528 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20bc1067f0 0x7f20bc198d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:52.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.953+0000 7f20c3b7f640 1 --2- 172.21.15.88:0/2642088528 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20bc1007f0 0x7f20bc1987d0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:52.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.953+0000 7f20c3b7f640 1 -- 172.21.15.88:0/2642088528 >> 172.21.15.88:0/2642088528 conn(0x7f20bc0fc4d0 msgr2=0x7f20bc0fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:52.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.953+0000 7f20c3b7f640 1 -- 172.21.15.88:0/2642088528 shutdown_connections 2024-09-17T04:17:52.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:52.953+0000 7f20c3b7f640 1 -- 172.21.15.88:0/2642088528 wait complete. 2024-09-17T04:17:53.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:52 smithi134 ceph-mon[35201]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:17:53.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:52 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/3442274994' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-17T04:17:53.652 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542173 got 60129542174 for osd.1 2024-09-17T04:17:53.653 DEBUG:teuthology.parallel:result is None 2024-09-17T04:17:54.055 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705698 got 38654705700 for osd.0 2024-09-17T04:17:54.056 DEBUG:teuthology.parallel:result is None 2024-09-17T04:17:54.056 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-17T04:17:54.056 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-17T04:17:54.310 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:17:54.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:53 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/2642088528' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-17T04:17:54.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:53 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/2642088528' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-17T04:17:54.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:54.754+0000 7fbe1cbf2640 1 -- 172.21.15.88:0/914392626 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe181007f0 msgr2=0x7fbe18100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:54.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:54.754+0000 7fbe1cbf2640 1 --2- 172.21.15.88:0/914392626 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe181007f0 0x7fbe18100c50 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c009880 tx=0x7fbe0c02a4a0 comp rx=0 tx=0).stop 2024-09-17T04:17:54.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:54.754+0000 7fbe1cbf2640 1 -- 172.21.15.88:0/914392626 shutdown_connections 2024-09-17T04:17:54.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:54.754+0000 7fbe1cbf2640 1 --2- 172.21.15.88:0/914392626 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe181007f0 0x7fbe18100c50 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:54.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:54.754+0000 7fbe1cbf2640 1 --2- 172.21.15.88:0/914392626 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe181067f0 0x7fbe18106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:54.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:54.754+0000 7fbe1cbf2640 1 -- 172.21.15.88:0/914392626 >> 172.21.15.88:0/914392626 conn(0x7fbe180fc550 msgr2=0x7fbe180fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:54.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:54.754+0000 7fbe1cbf2640 1 -- 172.21.15.88:0/914392626 shutdown_connections 2024-09-17T04:17:54.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:54.754+0000 7fbe1cbf2640 1 -- 172.21.15.88:0/914392626 wait complete. 2024-09-17T04:17:54.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:54.755+0000 7fbe1cbf2640 1 Processor -- start 2024-09-17T04:17:54.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:54.755+0000 7fbe1cbf2640 1 -- start start 2024-09-17T04:17:54.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:54.755+0000 7fbe1cbf2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe181007f0 0x7fbe1819d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:54.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:54.755+0000 7fbe1cbf2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe181067f0 0x7fbe1819dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:54.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:54.755+0000 7fbe1cbf2640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1810dcc0 con 0x7fbe181067f0 2024-09-17T04:17:54.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:54.755+0000 7fbe1cbf2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1810db40 con 0x7fbe181007f0 2024-09-17T04:17:54.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:54.755+0000 7fbe15d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe181067f0 0x7fbe1819dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:54.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:54.755+0000 7fbe15d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe181067f0 0x7fbe1819dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53354/0 (socket says 172.21.15.88:53354) 2024-09-17T04:17:54.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:54.756+0000 7fbe15d9b640 1 -- 172.21.15.88:0/532276565 learned_addr learned my addr 172.21.15.88:0/532276565 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:17:54.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:54.756+0000 7fbe1659c640 1 --2- 172.21.15.88:0/532276565 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe181007f0 0x7fbe1819d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:54.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:54.756+0000 7fbe15d9b640 1 -- 172.21.15.88:0/532276565 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe181007f0 msgr2=0x7fbe1819d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:54.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:54.756+0000 7fbe15d9b640 1 --2- 172.21.15.88:0/532276565 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe181007f0 0x7fbe1819d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:54.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:54.756+0000 7fbe15d9b640 1 -- 172.21.15.88:0/532276565 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe181977e0 con 0x7fbe181067f0 2024-09-17T04:17:54.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:54.756+0000 7fbe15d9b640 1 --2- 172.21.15.88:0/532276565 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe181067f0 0x7fbe1819dba0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c031460 tx=0x7fbe0c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:54.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:54.756+0000 7fbe077fe640 1 -- 172.21.15.88:0/532276565 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbe0c03f070 con 0x7fbe181067f0 2024-09-17T04:17:54.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:54.756+0000 7fbe077fe640 1 -- 172.21.15.88:0/532276565 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbe0c0035f0 con 0x7fbe181067f0 2024-09-17T04:17:54.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:54.756+0000 7fbe1cbf2640 1 -- 172.21.15.88:0/532276565 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe18197a70 con 0x7fbe181067f0 2024-09-17T04:17:54.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:54.756+0000 7fbe077fe640 1 -- 172.21.15.88:0/532276565 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbe0c035030 con 0x7fbe181067f0 2024-09-17T04:17:54.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:54.756+0000 7fbe1cbf2640 1 -- 172.21.15.88:0/532276565 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe18197fa0 con 0x7fbe181067f0 2024-09-17T04:17:54.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:54.757+0000 7fbe1cbf2640 1 -- 172.21.15.88:0/532276565 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe18101f30 con 0x7fbe181067f0 2024-09-17T04:17:54.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:54.758+0000 7fbe077fe640 1 -- 172.21.15.88:0/532276565 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fbe0c042070 con 0x7fbe181067f0 2024-09-17T04:17:54.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:54.758+0000 7fbe077fe640 1 --2- 172.21.15.88:0/532276565 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fbe0006e310 0x7fbe000707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:54.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:54.758+0000 7fbe077fe640 1 -- 172.21.15.88:0/532276565 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fbe0c0ae670 con 0x7fbe181067f0 2024-09-17T04:17:54.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:54.758+0000 7fbe1659c640 1 --2- 172.21.15.88:0/532276565 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fbe0006e310 0x7fbe000707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:54.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:54.759+0000 7fbe1659c640 1 --2- 172.21.15.88:0/532276565 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fbe0006e310 0x7fbe000707d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbe08005fd0 tx=0x7fbe0800b390 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:54.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:54.763+0000 7fbe077fe640 1 -- 172.21.15.88:0/532276565 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbe0c080040 con 0x7fbe181067f0 2024-09-17T04:17:54.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:54.926+0000 7fbe1cbf2640 1 -- 172.21.15.88:0/532276565 --> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbe18198310 con 0x7fbe0006e310 2024-09-17T04:17:54.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:54.927+0000 7fbe077fe640 1 -- 172.21.15.88:0/532276565 <== mgr.14217 v2:172.21.15.88:6800/1666801150 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+12321 (secure 0 0 0) 0x7fbe18198310 con 0x7fbe0006e310 2024-09-17T04:17:54.927 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:17:54.927 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-09-17T04:17:54.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:54.929+0000 7fbe1cbf2640 1 -- 172.21.15.88:0/532276565 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fbe0006e310 msgr2=0x7fbe000707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:54.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:54.929+0000 7fbe1cbf2640 1 --2- 172.21.15.88:0/532276565 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fbe0006e310 0x7fbe000707d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbe08005fd0 tx=0x7fbe0800b390 comp rx=0 tx=0).stop 2024-09-17T04:17:54.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:54.929+0000 7fbe1cbf2640 1 -- 172.21.15.88:0/532276565 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe181067f0 msgr2=0x7fbe1819dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:54.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:54.929+0000 7fbe1cbf2640 1 --2- 172.21.15.88:0/532276565 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe181067f0 0x7fbe1819dba0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c031460 tx=0x7fbe0c0045e0 comp rx=0 tx=0).stop 2024-09-17T04:17:54.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:54.929+0000 7fbe1cbf2640 1 -- 172.21.15.88:0/532276565 shutdown_connections 2024-09-17T04:17:54.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:54.929+0000 7fbe1cbf2640 1 --2- 172.21.15.88:0/532276565 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fbe0006e310 0x7fbe000707d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:54.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:54.929+0000 7fbe1cbf2640 1 --2- 172.21.15.88:0/532276565 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe181067f0 0x7fbe1819dba0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:54.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:54.929+0000 7fbe1cbf2640 1 --2- 172.21.15.88:0/532276565 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe181007f0 0x7fbe1819d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:54.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:54.929+0000 7fbe1cbf2640 1 -- 172.21.15.88:0/532276565 >> 172.21.15.88:0/532276565 conn(0x7fbe180fc550 msgr2=0x7fbe18069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:54.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:54.930+0000 7fbe1cbf2640 1 -- 172.21.15.88:0/532276565 shutdown_connections 2024-09-17T04:17:54.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:54.930+0000 7fbe1cbf2640 1 -- 172.21.15.88:0/532276565 wait complete. 2024-09-17T04:17:55.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:54 smithi088 ceph-mon[27811]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:17:55.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:54 smithi134 ceph-mon[35201]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:17:55.555 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":163,"stamp":"2024-09-17T04:17:53.796986+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":182640,"kb_used_data":3828,"kb_used_omap":9,"kb_used_meta":178678,"kb_avail":562288272,"statfs":{"total":575970213888,"available":575783190528,"internally_reserved":0,"allocated":3919872,"data_stored":2585772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":182966944},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002147"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":191,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T04:17:25.563525+0000","last_change":"2024-09-17T04:16:57.359463+0000","last_active":"2024-09-17T04:17:25.563525+0000","last_peered":"2024-09-17T04:17:25.563525+0000","last_clean":"2024-09-17T04:17:25.563525+0000","last_became_active":"2024-09-17T04:16:57.359085+0000","last_became_peered":"2024-09-17T04:16:57.359085+0000","last_unstale":"2024-09-17T04:17:25.563525+0000","last_undegraded":"2024-09-17T04:17:25.563525+0000","last_fullsized":"2024-09-17T04:17:25.563525+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:16:08.259650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:16:08.259650+0000","last_clean_scrub_stamp":"2024-09-17T04:16:08.259650+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:13:59.662134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":38,"seq":163208757257,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31536,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713616,"statfs":{"total":95995035648,"available":95962742784,"internally_reserved":0,"allocated":356352,"data_stored":135778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920782,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717776,"statfs":{"total":95995035648,"available":95967002624,"internally_reserved":0,"allocated":356352,"data_stored":135778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149715,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32116,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713036,"statfs":{"total":95995035648,"available":95962148864,"internally_reserved":0,"allocated":950272,"data_stored":726146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378649,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31536,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713616,"statfs":{"total":95995035648,"available":95962742784,"internally_reserved":0,"allocated":356352,"data_stored":135778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542175,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32116,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713036,"statfs":{"total":95995035648,"available":95962148864,"internally_reserved":0,"allocated":950272,"data_stored":726146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705700,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":950272,"data_stored":726146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T04:17:55.556 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-17T04:17:55.801 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:17:56.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:55 smithi088 ceph-mon[27811]: from='client.14528 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T04:17:56.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:56.233+0000 7f0660dd8640 1 -- 172.21.15.88:0/2765766419 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f065c1007f0 msgr2=0x7f065c100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:56.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:56.233+0000 7f0660dd8640 1 --2- 172.21.15.88:0/2765766419 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f065c1007f0 0x7f065c100c50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0650009880 tx=0x7f065002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:17:56.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:56.233+0000 7f0660dd8640 1 -- 172.21.15.88:0/2765766419 shutdown_connections 2024-09-17T04:17:56.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:56.233+0000 7f0660dd8640 1 --2- 172.21.15.88:0/2765766419 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f065c1007f0 0x7f065c100c50 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:56.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:56.233+0000 7f0660dd8640 1 --2- 172.21.15.88:0/2765766419 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f065c1067f0 0x7f065c106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:56.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:56.233+0000 7f0660dd8640 1 -- 172.21.15.88:0/2765766419 >> 172.21.15.88:0/2765766419 conn(0x7f065c0fc550 msgr2=0x7f065c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:56.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:56.233+0000 7f0660dd8640 1 -- 172.21.15.88:0/2765766419 shutdown_connections 2024-09-17T04:17:56.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:56.233+0000 7f0660dd8640 1 -- 172.21.15.88:0/2765766419 wait complete. 2024-09-17T04:17:56.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:56.234+0000 7f0660dd8640 1 Processor -- start 2024-09-17T04:17:56.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:56.234+0000 7f0660dd8640 1 -- start start 2024-09-17T04:17:56.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:56.234+0000 7f0660dd8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f065c1007f0 0x7f065c19d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:56.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:56.234+0000 7f0660dd8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f065c1067f0 0x7f065c19dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:56.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:56.234+0000 7f0660dd8640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f065c10dd20 con 0x7f065c1067f0 2024-09-17T04:17:56.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:56.234+0000 7f0660dd8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f065c10dba0 con 0x7f065c1007f0 2024-09-17T04:17:56.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:56.234+0000 7f0659d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f065c1067f0 0x7f065c19dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:56.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:56.234+0000 7f0659d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f065c1067f0 0x7f065c19dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53364/0 (socket says 172.21.15.88:53364) 2024-09-17T04:17:56.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:56.234+0000 7f0659d9b640 1 -- 172.21.15.88:0/1740789844 learned_addr learned my addr 172.21.15.88:0/1740789844 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:17:56.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:56.234+0000 7f065a59c640 1 --2- 172.21.15.88:0/1740789844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f065c1007f0 0x7f065c19d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:56.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:56.234+0000 7f0659d9b640 1 -- 172.21.15.88:0/1740789844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f065c1007f0 msgr2=0x7f065c19d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:56.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:56.234+0000 7f0659d9b640 1 --2- 172.21.15.88:0/1740789844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f065c1007f0 0x7f065c19d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:56.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:56.234+0000 7f0659d9b640 1 -- 172.21.15.88:0/1740789844 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f065c1978d0 con 0x7f065c1067f0 2024-09-17T04:17:56.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:56.235+0000 7f0659d9b640 1 --2- 172.21.15.88:0/1740789844 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f065c1067f0 0x7f065c19dc50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0650031460 tx=0x7f06500048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:56.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:56.235+0000 7f064b7fe640 1 -- 172.21.15.88:0/1740789844 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f065003f070 con 0x7f065c1067f0 2024-09-17T04:17:56.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:56.235+0000 7f064b7fe640 1 -- 172.21.15.88:0/1740789844 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0650004cf0 con 0x7f065c1067f0 2024-09-17T04:17:56.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:56.235+0000 7f0660dd8640 1 -- 172.21.15.88:0/1740789844 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f065c197b60 con 0x7f065c1067f0 2024-09-17T04:17:56.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:56.235+0000 7f064b7fe640 1 -- 172.21.15.88:0/1740789844 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0650035030 con 0x7f065c1067f0 2024-09-17T04:17:56.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:56.235+0000 7f0660dd8640 1 -- 172.21.15.88:0/1740789844 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f065c198090 con 0x7f065c1067f0 2024-09-17T04:17:56.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:56.236+0000 7f0660dd8640 1 -- 172.21.15.88:0/1740789844 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f065c101f30 con 0x7f065c1067f0 2024-09-17T04:17:56.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:56.236+0000 7f064b7fe640 1 -- 172.21.15.88:0/1740789844 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f0650042070 con 0x7f065c1067f0 2024-09-17T04:17:56.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:56.237+0000 7f064b7fe640 1 --2- 172.21.15.88:0/1740789844 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f064406e2b0 0x7f0644070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:56.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:56.237+0000 7f065a59c640 1 --2- 172.21.15.88:0/1740789844 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f064406e2b0 0x7f0644070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:56.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:56.237+0000 7f064b7fe640 1 -- 172.21.15.88:0/1740789844 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f06500ae860 con 0x7f065c1067f0 2024-09-17T04:17:56.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:56.237+0000 7f065a59c640 1 --2- 172.21.15.88:0/1740789844 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f064406e2b0 0x7f0644070770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f065c198a10 tx=0x7f064c009110 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:56.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:56.241+0000 7f064b7fe640 1 -- 172.21.15.88:0/1740789844 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f065007c500 con 0x7f065c1067f0 2024-09-17T04:17:56.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:55 smithi134 ceph-mon[35201]: from='client.14528 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T04:17:56.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:56.405+0000 7f0660dd8640 1 -- 172.21.15.88:0/1740789844 --> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f065c198e00 con 0x7f064406e2b0 2024-09-17T04:17:56.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:56.405+0000 7f064b7fe640 1 -- 172.21.15.88:0/1740789844 <== mgr.14217 v2:172.21.15.88:6800/1666801150 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+12321 (secure 0 0 0) 0x7f065c198e00 con 0x7f064406e2b0 2024-09-17T04:17:56.405 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:17:56.406 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-09-17T04:17:56.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:56.407+0000 7f0660dd8640 1 -- 172.21.15.88:0/1740789844 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f064406e2b0 msgr2=0x7f0644070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:56.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:56.407+0000 7f0660dd8640 1 --2- 172.21.15.88:0/1740789844 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f064406e2b0 0x7f0644070770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f065c198a10 tx=0x7f064c009110 comp rx=0 tx=0).stop 2024-09-17T04:17:56.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:56.407+0000 7f0660dd8640 1 -- 172.21.15.88:0/1740789844 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f065c1067f0 msgr2=0x7f065c19dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:56.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:56.407+0000 7f0660dd8640 1 --2- 172.21.15.88:0/1740789844 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f065c1067f0 0x7f065c19dc50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0650031460 tx=0x7f06500048f0 comp rx=0 tx=0).stop 2024-09-17T04:17:56.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:56.407+0000 7f0660dd8640 1 -- 172.21.15.88:0/1740789844 shutdown_connections 2024-09-17T04:17:56.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:56.407+0000 7f0660dd8640 1 --2- 172.21.15.88:0/1740789844 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f064406e2b0 0x7f0644070770 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:56.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:56.407+0000 7f0660dd8640 1 --2- 172.21.15.88:0/1740789844 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f065c1067f0 0x7f065c19dc50 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:56.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:56.407+0000 7f0660dd8640 1 --2- 172.21.15.88:0/1740789844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f065c1007f0 0x7f065c19d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:56.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:56.407+0000 7f0660dd8640 1 -- 172.21.15.88:0/1740789844 >> 172.21.15.88:0/1740789844 conn(0x7f065c0fc550 msgr2=0x7f065c069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:56.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:56.407+0000 7f0660dd8640 1 -- 172.21.15.88:0/1740789844 shutdown_connections 2024-09-17T04:17:56.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:56.408+0000 7f0660dd8640 1 -- 172.21.15.88:0/1740789844 wait complete. 2024-09-17T04:17:56.996 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":164,"stamp":"2024-09-17T04:17:55.797347+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":182640,"kb_used_data":3828,"kb_used_omap":9,"kb_used_meta":178678,"kb_avail":562288272,"statfs":{"total":575970213888,"available":575783190528,"internally_reserved":0,"allocated":3919872,"data_stored":2585772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":182966944},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002208"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":191,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T04:17:25.563525+0000","last_change":"2024-09-17T04:16:57.359463+0000","last_active":"2024-09-17T04:17:25.563525+0000","last_peered":"2024-09-17T04:17:25.563525+0000","last_clean":"2024-09-17T04:17:25.563525+0000","last_became_active":"2024-09-17T04:16:57.359085+0000","last_became_peered":"2024-09-17T04:16:57.359085+0000","last_unstale":"2024-09-17T04:17:25.563525+0000","last_undegraded":"2024-09-17T04:17:25.563525+0000","last_fullsized":"2024-09-17T04:17:25.563525+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:16:08.259650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:16:08.259650+0000","last_clean_scrub_stamp":"2024-09-17T04:16:08.259650+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:13:59.662134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":38,"seq":163208757258,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31536,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713616,"statfs":{"total":95995035648,"available":95962742784,"internally_reserved":0,"allocated":356352,"data_stored":135778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920782,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717776,"statfs":{"total":95995035648,"available":95967002624,"internally_reserved":0,"allocated":356352,"data_stored":135778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149715,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32116,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713036,"statfs":{"total":95995035648,"available":95962148864,"internally_reserved":0,"allocated":950272,"data_stored":726146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378649,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31536,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713616,"statfs":{"total":95995035648,"available":95962742784,"internally_reserved":0,"allocated":356352,"data_stored":135778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542175,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32116,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713036,"statfs":{"total":95995035648,"available":95962148864,"internally_reserved":0,"allocated":950272,"data_stored":726146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705700,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":950272,"data_stored":726146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T04:17:56.997 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-17T04:17:56.997 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-17T04:17:56.997 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-17T04:17:56.997 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-17T04:17:57.242 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:17:57.363 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:56 smithi088 ceph-mon[27811]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:17:57.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:56 smithi134 ceph-mon[35201]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:17:57.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:57.692+0000 7fc33177a640 1 -- 172.21.15.88:0/140167341 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc32c1007f0 msgr2=0x7fc32c100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:57.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:57.692+0000 7fc33177a640 1 --2- 172.21.15.88:0/140167341 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc32c1007f0 0x7fc32c100c50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc314009880 tx=0x7fc31402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:17:57.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:57.692+0000 7fc33177a640 1 -- 172.21.15.88:0/140167341 shutdown_connections 2024-09-17T04:17:57.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:57.692+0000 7fc33177a640 1 --2- 172.21.15.88:0/140167341 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc32c1007f0 0x7fc32c100c50 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:57.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:57.692+0000 7fc33177a640 1 --2- 172.21.15.88:0/140167341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc32c1067f0 0x7fc32c106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:57.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:57.692+0000 7fc33177a640 1 -- 172.21.15.88:0/140167341 >> 172.21.15.88:0/140167341 conn(0x7fc32c0fc550 msgr2=0x7fc32c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:57.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:57.692+0000 7fc33177a640 1 -- 172.21.15.88:0/140167341 shutdown_connections 2024-09-17T04:17:57.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:57.692+0000 7fc33177a640 1 -- 172.21.15.88:0/140167341 wait complete. 2024-09-17T04:17:57.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:57.692+0000 7fc33177a640 1 Processor -- start 2024-09-17T04:17:57.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:57.693+0000 7fc33177a640 1 -- start start 2024-09-17T04:17:57.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:57.693+0000 7fc33177a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc32c1007f0 0x7fc32c196760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:57.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:57.693+0000 7fc33177a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc32c1067f0 0x7fc32c196ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:57.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:57.693+0000 7fc33177a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc32c10dd20 con 0x7fc32c1067f0 2024-09-17T04:17:57.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:57.693+0000 7fc33177a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc32c10dba0 con 0x7fc32c1007f0 2024-09-17T04:17:57.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:57.693+0000 7fc323fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc32c1067f0 0x7fc32c196ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:57.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:57.693+0000 7fc323fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc32c1067f0 0x7fc32c196ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53382/0 (socket says 172.21.15.88:53382) 2024-09-17T04:17:57.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:57.693+0000 7fc323fff640 1 -- 172.21.15.88:0/647408059 learned_addr learned my addr 172.21.15.88:0/647408059 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:17:57.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:57.693+0000 7fc32affd640 1 --2- 172.21.15.88:0/647408059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc32c1007f0 0x7fc32c196760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:57.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:57.693+0000 7fc323fff640 1 -- 172.21.15.88:0/647408059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc32c1007f0 msgr2=0x7fc32c196760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:57.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:57.693+0000 7fc323fff640 1 --2- 172.21.15.88:0/647408059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc32c1007f0 0x7fc32c196760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:57.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:57.693+0000 7fc323fff640 1 -- 172.21.15.88:0/647408059 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc32c1971e0 con 0x7fc32c1067f0 2024-09-17T04:17:57.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:57.693+0000 7fc323fff640 1 --2- 172.21.15.88:0/647408059 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc32c1067f0 0x7fc32c196ca0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc314031460 tx=0x7fc3140048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:57.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:57.694+0000 7fc328ff9640 1 -- 172.21.15.88:0/647408059 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc31403f070 con 0x7fc32c1067f0 2024-09-17T04:17:57.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:57.694+0000 7fc328ff9640 1 -- 172.21.15.88:0/647408059 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc314004cf0 con 0x7fc32c1067f0 2024-09-17T04:17:57.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:57.694+0000 7fc328ff9640 1 -- 172.21.15.88:0/647408059 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc314035030 con 0x7fc32c1067f0 2024-09-17T04:17:57.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:57.694+0000 7fc33177a640 1 -- 172.21.15.88:0/647408059 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc32c197470 con 0x7fc32c1067f0 2024-09-17T04:17:57.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:57.694+0000 7fc33177a640 1 -- 172.21.15.88:0/647408059 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc32c1a3fa0 con 0x7fc32c1067f0 2024-09-17T04:17:57.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:57.695+0000 7fc33177a640 1 -- 172.21.15.88:0/647408059 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc32c101f30 con 0x7fc32c1067f0 2024-09-17T04:17:57.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:57.695+0000 7fc328ff9640 1 -- 172.21.15.88:0/647408059 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fc314042070 con 0x7fc32c1067f0 2024-09-17T04:17:57.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:57.696+0000 7fc328ff9640 1 --2- 172.21.15.88:0/647408059 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fc31806e2b0 0x7fc318070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:57.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:57.696+0000 7fc328ff9640 1 -- 172.21.15.88:0/647408059 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fc3140ae860 con 0x7fc32c1067f0 2024-09-17T04:17:57.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:57.696+0000 7fc32affd640 1 --2- 172.21.15.88:0/647408059 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fc31806e2b0 0x7fc318070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:57.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:57.696+0000 7fc32affd640 1 --2- 172.21.15.88:0/647408059 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fc31806e2b0 0x7fc318070770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc31c009990 tx=0x7fc31c009110 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:57.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:57.700+0000 7fc328ff9640 1 -- 172.21.15.88:0/647408059 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc31407c500 con 0x7fc32c1067f0 2024-09-17T04:17:57.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:57.905+0000 7fc33177a640 1 -- 172.21.15.88:0/647408059 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc32c108d80 con 0x7fc32c1067f0 2024-09-17T04:17:57.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:57.906+0000 7fc328ff9640 1 -- 172.21.15.88:0/647408059 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fc3140801b0 con 0x7fc32c1067f0 2024-09-17T04:17:57.906 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:17:57.906 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-17T04:17:57.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:57.908+0000 7fc33177a640 1 -- 172.21.15.88:0/647408059 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fc31806e2b0 msgr2=0x7fc318070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:57.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:57.908+0000 7fc33177a640 1 --2- 172.21.15.88:0/647408059 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fc31806e2b0 0x7fc318070770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc31c009990 tx=0x7fc31c009110 comp rx=0 tx=0).stop 2024-09-17T04:17:57.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:57.908+0000 7fc33177a640 1 -- 172.21.15.88:0/647408059 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc32c1067f0 msgr2=0x7fc32c196ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:57.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:57.908+0000 7fc33177a640 1 --2- 172.21.15.88:0/647408059 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc32c1067f0 0x7fc32c196ca0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc314031460 tx=0x7fc3140048f0 comp rx=0 tx=0).stop 2024-09-17T04:17:57.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:57.908+0000 7fc33177a640 1 -- 172.21.15.88:0/647408059 shutdown_connections 2024-09-17T04:17:57.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:57.908+0000 7fc33177a640 1 --2- 172.21.15.88:0/647408059 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fc31806e2b0 0x7fc318070770 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:57.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:57.908+0000 7fc33177a640 1 --2- 172.21.15.88:0/647408059 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc32c1067f0 0x7fc32c196ca0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:57.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:57.908+0000 7fc33177a640 1 --2- 172.21.15.88:0/647408059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc32c1007f0 0x7fc32c196760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:57.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:57.908+0000 7fc33177a640 1 -- 172.21.15.88:0/647408059 >> 172.21.15.88:0/647408059 conn(0x7fc32c0fc550 msgr2=0x7fc32c0fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:57.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:57.908+0000 7fc33177a640 1 -- 172.21.15.88:0/647408059 shutdown_connections 2024-09-17T04:17:57.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:57.908+0000 7fc33177a640 1 -- 172.21.15.88:0/647408059 wait complete. 2024-09-17T04:17:58.251 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:57 smithi088 ceph-mon[27811]: from='client.14532 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T04:17:58.251 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:57 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/647408059' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-17T04:17:58.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:57 smithi134 ceph-mon[35201]: from='client.14532 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T04:17:58.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:57 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/647408059' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-17T04:17:58.520 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-17T04:17:58.521 INFO:tasks.cephadm:Setup complete, yielding 2024-09-17T04:17:58.521 INFO:teuthology.run_tasks:Running task print... 2024-09-17T04:17:58.530 INFO:teuthology.task.print:**** done end installing squid cephadm ... 2024-09-17T04:17:58.531 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T04:17:58.546 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi088.front.sepia.ceph.com 2024-09-17T04:17:58.546 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-09-17T04:17:58.793 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:17:59.239 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:17:58 smithi088 ceph-mon[27811]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:17:59.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:59.239+0000 7f9c960b1640 1 -- 172.21.15.88:0/46115156 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c90101960 msgr2=0x7f9c90101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:59.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:59.239+0000 7f9c960b1640 1 --2- 172.21.15.88:0/46115156 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c90101960 0x7f9c90101d60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f9c80009880 tx=0x7f9c8002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:17:59.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:59.239+0000 7f9c960b1640 1 -- 172.21.15.88:0/46115156 shutdown_connections 2024-09-17T04:17:59.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:59.239+0000 7f9c960b1640 1 --2- 172.21.15.88:0/46115156 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c90102b60 0x7f9c90102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:59.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:59.239+0000 7f9c960b1640 1 --2- 172.21.15.88:0/46115156 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c90101960 0x7f9c90101d60 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:59.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:59.240+0000 7f9c960b1640 1 -- 172.21.15.88:0/46115156 >> 172.21.15.88:0/46115156 conn(0x7f9c900fd110 msgr2=0x7f9c900ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:59.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:59.240+0000 7f9c960b1640 1 -- 172.21.15.88:0/46115156 shutdown_connections 2024-09-17T04:17:59.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:59.240+0000 7f9c960b1640 1 -- 172.21.15.88:0/46115156 wait complete. 2024-09-17T04:17:59.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:59.240+0000 7f9c960b1640 1 Processor -- start 2024-09-17T04:17:59.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:59.240+0000 7f9c960b1640 1 -- start start 2024-09-17T04:17:59.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:59.240+0000 7f9c960b1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c90101960 0x7f9c90193780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:59.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:59.240+0000 7f9c960b1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c90102b60 0x7f9c90193cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:59.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:59.240+0000 7f9c960b1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f9c9010a780 con 0x7f9c90101960 2024-09-17T04:17:59.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:59.240+0000 7f9c960b1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9c9010a600 con 0x7f9c90102b60 2024-09-17T04:17:59.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:59.240+0000 7f9c8f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c90101960 0x7f9c90193780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:59.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:59.240+0000 7f9c8f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c90101960 0x7f9c90193780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53386/0 (socket says 172.21.15.88:53386) 2024-09-17T04:17:59.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:59.240+0000 7f9c8f7fe640 1 -- 172.21.15.88:0/1613621370 learned_addr learned my addr 172.21.15.88:0/1613621370 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:17:59.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:59.241+0000 7f9c87fff640 1 --2- 172.21.15.88:0/1613621370 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c90102b60 0x7f9c90193cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:59.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:59.241+0000 7f9c8f7fe640 1 -- 172.21.15.88:0/1613621370 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c90102b60 msgr2=0x7f9c90193cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:59.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:59.241+0000 7f9c8f7fe640 1 --2- 172.21.15.88:0/1613621370 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c90102b60 0x7f9c90193cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:59.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:59.241+0000 7f9c8f7fe640 1 -- 172.21.15.88:0/1613621370 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c90190280 con 0x7f9c90101960 2024-09-17T04:17:59.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:59.241+0000 7f9c8f7fe640 1 --2- 172.21.15.88:0/1613621370 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c90101960 0x7f9c90193780 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9c80006010 tx=0x7f9c800048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:59.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:59.241+0000 7f9c8d7fa640 1 -- 172.21.15.88:0/1613621370 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9c8003f070 con 0x7f9c90101960 2024-09-17T04:17:59.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:59.241+0000 7f9c8d7fa640 1 -- 172.21.15.88:0/1613621370 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9c800044d0 con 0x7f9c90101960 2024-09-17T04:17:59.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:59.241+0000 7f9c8d7fa640 1 -- 172.21.15.88:0/1613621370 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9c80035030 con 0x7f9c90101960 2024-09-17T04:17:59.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:59.241+0000 7f9c960b1640 1 -- 172.21.15.88:0/1613621370 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c90190510 con 0x7f9c90101960 2024-09-17T04:17:59.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:59.241+0000 7f9c960b1640 1 -- 172.21.15.88:0/1613621370 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c901909e0 con 0x7f9c90101960 2024-09-17T04:17:59.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:59.242+0000 7f9c960b1640 1 -- 172.21.15.88:0/1613621370 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c90101d60 con 0x7f9c90101960 2024-09-17T04:17:59.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:59.242+0000 7f9c8d7fa640 1 -- 172.21.15.88:0/1613621370 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f9c80042070 con 0x7f9c90101960 2024-09-17T04:17:59.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:59.243+0000 7f9c8d7fa640 1 --2- 172.21.15.88:0/1613621370 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f9c7c06e2b0 0x7f9c7c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:17:59.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:59.243+0000 7f9c8d7fa640 1 -- 172.21.15.88:0/1613621370 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f9c800aeb60 con 0x7f9c90101960 2024-09-17T04:17:59.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:59.243+0000 7f9c87fff640 1 --2- 172.21.15.88:0/1613621370 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f9c7c06e2b0 0x7f9c7c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:17:59.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:59.243+0000 7f9c87fff640 1 --2- 172.21.15.88:0/1613621370 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f9c7c06e2b0 0x7f9c7c070770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9c78005e10 tx=0x7f9c78005da0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:17:59.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:59.247+0000 7f9c8d7fa640 1 -- 172.21.15.88:0/1613621370 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9c8007c800 con 0x7f9c90101960 2024-09-17T04:17:59.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:17:58 smithi134 ceph-mon[35201]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:17:59.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:59.415+0000 7f9c960b1640 1 -- 172.21.15.88:0/1613621370 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) -- 0x7f9c901a3d90 con 0x7f9c90101960 2024-09-17T04:17:59.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:59.418+0000 7f9c8d7fa640 1 -- 172.21.15.88:0/1613621370 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v44)=0 v44) ==== 143+0+0 (secure 0 0 0) 0x7f9c800804b0 con 0x7f9c90101960 2024-09-17T04:17:59.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:59.421+0000 7f9c960b1640 1 -- 172.21.15.88:0/1613621370 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f9c7c06e2b0 msgr2=0x7f9c7c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:59.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:59.421+0000 7f9c960b1640 1 --2- 172.21.15.88:0/1613621370 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f9c7c06e2b0 0x7f9c7c070770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9c78005e10 tx=0x7f9c78005da0 comp rx=0 tx=0).stop 2024-09-17T04:17:59.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:59.421+0000 7f9c960b1640 1 -- 172.21.15.88:0/1613621370 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c90101960 msgr2=0x7f9c90193780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:17:59.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:59.421+0000 7f9c960b1640 1 --2- 172.21.15.88:0/1613621370 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c90101960 0x7f9c90193780 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9c80006010 tx=0x7f9c800048f0 comp rx=0 tx=0).stop 2024-09-17T04:17:59.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:59.421+0000 7f9c960b1640 1 -- 172.21.15.88:0/1613621370 shutdown_connections 2024-09-17T04:17:59.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:59.421+0000 7f9c960b1640 1 --2- 172.21.15.88:0/1613621370 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f9c7c06e2b0 0x7f9c7c070770 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:59.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:59.421+0000 7f9c960b1640 1 --2- 172.21.15.88:0/1613621370 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c90102b60 0x7f9c90193cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:59.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:59.421+0000 7f9c960b1640 1 --2- 172.21.15.88:0/1613621370 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c90101960 0x7f9c90193780 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:17:59.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:59.421+0000 7f9c960b1640 1 -- 172.21.15.88:0/1613621370 >> 172.21.15.88:0/1613621370 conn(0x7f9c900fd110 msgr2=0x7f9c900746b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:17:59.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:59.421+0000 7f9c960b1640 1 -- 172.21.15.88:0/1613621370 shutdown_connections 2024-09-17T04:17:59.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:17:59.421+0000 7f9c960b1640 1 -- 172.21.15.88:0/1613621370 wait complete. 2024-09-17T04:18:00.083 INFO:teuthology.run_tasks:Running task print... 2024-09-17T04:18:00.092 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-09-17T04:18:00.092 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T04:18:00.100 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi088.front.sepia.ceph.com 2024-09-17T04:18:00.100 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-17T04:18:00.351 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:18:00.717 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:00 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/1613621370' entity='client.admin' 2024-09-17T04:18:00.717 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:00 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:18:00.717 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:00 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:18:00.717 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:00 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:18:00.717 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:00 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:00.717 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:00 smithi088 ceph-mon[27811]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:18:00.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:00.797+0000 7fc8f665f640 1 -- 172.21.15.88:0/63264602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8f0102b80 msgr2=0x7fc8f0103000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:00.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:00.797+0000 7fc8f665f640 1 --2- 172.21.15.88:0/63264602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8f0102b80 0x7fc8f0103000 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc8d8009880 tx=0x7fc8d802a4a0 comp rx=0 tx=0).stop 2024-09-17T04:18:00.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:00.797+0000 7fc8f665f640 1 -- 172.21.15.88:0/63264602 shutdown_connections 2024-09-17T04:18:00.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:00.797+0000 7fc8f665f640 1 --2- 172.21.15.88:0/63264602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8f0102b80 0x7fc8f0103000 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:00.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:00.797+0000 7fc8f665f640 1 --2- 172.21.15.88:0/63264602 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8f0101980 0x7fc8f0101d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:00.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:00.797+0000 7fc8f665f640 1 -- 172.21.15.88:0/63264602 >> 172.21.15.88:0/63264602 conn(0x7fc8f00fd110 msgr2=0x7fc8f00ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:00.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:00.797+0000 7fc8f665f640 1 -- 172.21.15.88:0/63264602 shutdown_connections 2024-09-17T04:18:00.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:00.798+0000 7fc8f665f640 1 -- 172.21.15.88:0/63264602 wait complete. 2024-09-17T04:18:00.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:00.798+0000 7fc8f665f640 1 Processor -- start 2024-09-17T04:18:00.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:00.798+0000 7fc8f665f640 1 -- start start 2024-09-17T04:18:00.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:00.798+0000 7fc8f665f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8f0101980 0x7fc8f0197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:00.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:00.798+0000 7fc8f665f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8f0102b80 0x7fc8f0197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:00.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:00.798+0000 7fc8f665f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f010a840 con 0x7fc8f0101980 2024-09-17T04:18:00.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:00.798+0000 7fc8f665f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f010a6c0 con 0x7fc8f0102b80 2024-09-17T04:18:00.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:00.798+0000 7fc8effff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8f0101980 0x7fc8f0197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:00.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:00.798+0000 7fc8effff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8f0101980 0x7fc8f0197520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53414/0 (socket says 172.21.15.88:53414) 2024-09-17T04:18:00.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:00.798+0000 7fc8effff640 1 -- 172.21.15.88:0/428903888 learned_addr learned my addr 172.21.15.88:0/428903888 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:18:00.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:00.798+0000 7fc8e7fff640 1 --2- 172.21.15.88:0/428903888 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8f0102b80 0x7fc8f0197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:00.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:00.799+0000 7fc8effff640 1 -- 172.21.15.88:0/428903888 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8f0102b80 msgr2=0x7fc8f0197a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:00.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:00.799+0000 7fc8effff640 1 --2- 172.21.15.88:0/428903888 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8f0102b80 0x7fc8f0197a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:00.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:00.799+0000 7fc8effff640 1 -- 172.21.15.88:0/428903888 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8f01980e0 con 0x7fc8f0101980 2024-09-17T04:18:00.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:00.799+0000 7fc8effff640 1 --2- 172.21.15.88:0/428903888 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8f0101980 0x7fc8f0197520 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc8e000b3d0 tx=0x7fc8e000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:00.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:00.799+0000 7fc8edffb640 1 -- 172.21.15.88:0/428903888 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc8e0015020 con 0x7fc8f0101980 2024-09-17T04:18:00.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:00.799+0000 7fc8f665f640 1 -- 172.21.15.88:0/428903888 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8f019cb20 con 0x7fc8f0101980 2024-09-17T04:18:00.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:00.799+0000 7fc8edffb640 1 -- 172.21.15.88:0/428903888 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc8e0011af0 con 0x7fc8f0101980 2024-09-17T04:18:00.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:00.799+0000 7fc8edffb640 1 -- 172.21.15.88:0/428903888 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc8e0010da0 con 0x7fc8f0101980 2024-09-17T04:18:00.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:00.799+0000 7fc8f665f640 1 -- 172.21.15.88:0/428903888 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8f019d080 con 0x7fc8f0101980 2024-09-17T04:18:00.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:00.800+0000 7fc8f665f640 1 -- 172.21.15.88:0/428903888 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8f0101d80 con 0x7fc8f0101980 2024-09-17T04:18:00.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:00.800+0000 7fc8edffb640 1 -- 172.21.15.88:0/428903888 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fc8e0018020 con 0x7fc8f0101980 2024-09-17T04:18:00.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:00.801+0000 7fc8edffb640 1 --2- 172.21.15.88:0/428903888 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fc8dc06e2b0 0x7fc8dc070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:00.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:00.801+0000 7fc8edffb640 1 -- 172.21.15.88:0/428903888 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fc8e008d950 con 0x7fc8f0101980 2024-09-17T04:18:00.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:00.801+0000 7fc8e7fff640 1 --2- 172.21.15.88:0/428903888 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fc8dc06e2b0 0x7fc8dc070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:00.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:00.801+0000 7fc8e7fff640 1 --2- 172.21.15.88:0/428903888 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fc8dc06e2b0 0x7fc8dc070770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc8d8000c00 tx=0x7fc8d80058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:00.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:00.805+0000 7fc8edffb640 1 -- 172.21.15.88:0/428903888 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc8e001f020 con 0x7fc8f0101980 2024-09-17T04:18:00.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:00 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/1613621370' entity='client.admin' 2024-09-17T04:18:00.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:00 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:18:00.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:00 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:18:00.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:00 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:18:00.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:00 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:00.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:00 smithi134 ceph-mon[35201]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:18:00.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:00.990+0000 7fc8f665f640 1 -- 172.21.15.88:0/428903888 --> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fc8f00626f0 con 0x7fc8dc06e2b0 2024-09-17T04:18:00.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:00.991+0000 7fc8edffb640 1 -- 172.21.15.88:0/428903888 <== mgr.14217 v2:172.21.15.88:6800/1666801150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fc8f00626f0 con 0x7fc8dc06e2b0 2024-09-17T04:18:00.990 INFO:teuthology.orchestra.run.smithi088.stdout:Backend: cephadm 2024-09-17T04:18:00.991 INFO:teuthology.orchestra.run.smithi088.stdout:Available: Yes 2024-09-17T04:18:00.991 INFO:teuthology.orchestra.run.smithi088.stdout:Paused: No 2024-09-17T04:18:00.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:00.993+0000 7fc8f665f640 1 -- 172.21.15.88:0/428903888 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fc8dc06e2b0 msgr2=0x7fc8dc070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:00.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:00.993+0000 7fc8f665f640 1 --2- 172.21.15.88:0/428903888 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fc8dc06e2b0 0x7fc8dc070770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc8d8000c00 tx=0x7fc8d80058d0 comp rx=0 tx=0).stop 2024-09-17T04:18:00.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:00.993+0000 7fc8f665f640 1 -- 172.21.15.88:0/428903888 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8f0101980 msgr2=0x7fc8f0197520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:00.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:00.993+0000 7fc8f665f640 1 --2- 172.21.15.88:0/428903888 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8f0101980 0x7fc8f0197520 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc8e000b3d0 tx=0x7fc8e000b890 comp rx=0 tx=0).stop 2024-09-17T04:18:00.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:00.993+0000 7fc8f665f640 1 -- 172.21.15.88:0/428903888 shutdown_connections 2024-09-17T04:18:00.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:00.993+0000 7fc8f665f640 1 --2- 172.21.15.88:0/428903888 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fc8dc06e2b0 0x7fc8dc070770 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:00.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:00.993+0000 7fc8f665f640 1 --2- 172.21.15.88:0/428903888 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8f0102b80 0x7fc8f0197a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:00.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:00.993+0000 7fc8f665f640 1 --2- 172.21.15.88:0/428903888 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8f0101980 0x7fc8f0197520 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:00.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:00.993+0000 7fc8f665f640 1 -- 172.21.15.88:0/428903888 >> 172.21.15.88:0/428903888 conn(0x7fc8f00fd110 msgr2=0x7fc8f0106090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:00.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:00.993+0000 7fc8f665f640 1 -- 172.21.15.88:0/428903888 shutdown_connections 2024-09-17T04:18:00.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:00.993+0000 7fc8f665f640 1 -- 172.21.15.88:0/428903888 wait complete. 2024-09-17T04:18:01.684 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-17T04:18:01.708 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:01 smithi088 ceph-mon[27811]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:18:01.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:01 smithi134 ceph-mon[35201]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:18:01.931 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:18:02.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:02.364+0000 7ff2c26b1640 1 -- 172.21.15.88:0/2799376104 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2bc102b60 msgr2=0x7ff2bc102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:02.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:02.364+0000 7ff2c26b1640 1 --2- 172.21.15.88:0/2799376104 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2bc102b60 0x7ff2bc102fe0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0009880 tx=0x7ff2b002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:18:02.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:02.364+0000 7ff2c26b1640 1 -- 172.21.15.88:0/2799376104 shutdown_connections 2024-09-17T04:18:02.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:02.364+0000 7ff2c26b1640 1 --2- 172.21.15.88:0/2799376104 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2bc102b60 0x7ff2bc102fe0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:02.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:02.364+0000 7ff2c26b1640 1 --2- 172.21.15.88:0/2799376104 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2bc101960 0x7ff2bc101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:02.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:02.364+0000 7ff2c26b1640 1 -- 172.21.15.88:0/2799376104 >> 172.21.15.88:0/2799376104 conn(0x7ff2bc0fd0f0 msgr2=0x7ff2bc0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:02.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:02.364+0000 7ff2c26b1640 1 -- 172.21.15.88:0/2799376104 shutdown_connections 2024-09-17T04:18:02.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:02.364+0000 7ff2c26b1640 1 -- 172.21.15.88:0/2799376104 wait complete. 2024-09-17T04:18:02.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:02.365+0000 7ff2c26b1640 1 Processor -- start 2024-09-17T04:18:02.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:02.365+0000 7ff2c26b1640 1 -- start start 2024-09-17T04:18:02.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:02.365+0000 7ff2c26b1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2bc101960 0x7ff2bc197470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:02.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:02.365+0000 7ff2c26b1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2bc102b60 0x7ff2bc1979b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:02.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:02.365+0000 7ff2c26b1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ff2bc10a780 con 0x7ff2bc101960 2024-09-17T04:18:02.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:02.365+0000 7ff2c26b1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff2bc10a600 con 0x7ff2bc102b60 2024-09-17T04:18:02.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:02.365+0000 7ff2bbfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2bc101960 0x7ff2bc197470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:02.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:02.365+0000 7ff2bbfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2bc101960 0x7ff2bc197470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53904/0 (socket says 172.21.15.88:53904) 2024-09-17T04:18:02.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:02.365+0000 7ff2bbfff640 1 -- 172.21.15.88:0/4215841695 learned_addr learned my addr 172.21.15.88:0/4215841695 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:18:02.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:02.365+0000 7ff2bb7fe640 1 --2- 172.21.15.88:0/4215841695 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2bc102b60 0x7ff2bc1979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:02.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:02.365+0000 7ff2bbfff640 1 -- 172.21.15.88:0/4215841695 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2bc102b60 msgr2=0x7ff2bc1979b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:02.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:02.365+0000 7ff2bbfff640 1 --2- 172.21.15.88:0/4215841695 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2bc102b60 0x7ff2bc1979b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:02.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:02.365+0000 7ff2bbfff640 1 -- 172.21.15.88:0/4215841695 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2bc197fa0 con 0x7ff2bc101960 2024-09-17T04:18:02.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:02.366+0000 7ff2bbfff640 1 --2- 172.21.15.88:0/4215841695 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2bc101960 0x7ff2bc197470 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac00c8f0 tx=0x7ff2ac00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:02.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:02.366+0000 7ff2b97fa640 1 -- 172.21.15.88:0/4215841695 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff2ac004020 con 0x7ff2bc101960 2024-09-17T04:18:02.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:02.366+0000 7ff2b97fa640 1 -- 172.21.15.88:0/4215841695 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff2ac007e10 con 0x7ff2bc101960 2024-09-17T04:18:02.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:02.366+0000 7ff2b97fa640 1 -- 172.21.15.88:0/4215841695 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff2ac003e10 con 0x7ff2bc101960 2024-09-17T04:18:02.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:02.366+0000 7ff2c26b1640 1 -- 172.21.15.88:0/4215841695 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2bc19ca10 con 0x7ff2bc101960 2024-09-17T04:18:02.387 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:02.366+0000 7ff2c26b1640 1 -- 172.21.15.88:0/4215841695 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2bc19cf20 con 0x7ff2bc101960 2024-09-17T04:18:02.387 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:02.367+0000 7ff2c26b1640 1 -- 172.21.15.88:0/4215841695 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2bc10af90 con 0x7ff2bc101960 2024-09-17T04:18:02.387 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:02.367+0000 7ff2b97fa640 1 -- 172.21.15.88:0/4215841695 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7ff2ac0041c0 con 0x7ff2bc101960 2024-09-17T04:18:02.387 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:02.368+0000 7ff2b97fa640 1 --2- 172.21.15.88:0/4215841695 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7ff2a406e2b0 0x7ff2a4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:02.387 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:02.368+0000 7ff2b97fa640 1 -- 172.21.15.88:0/4215841695 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7ff2ac08df20 con 0x7ff2bc101960 2024-09-17T04:18:02.387 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:02.368+0000 7ff2bb7fe640 1 --2- 172.21.15.88:0/4215841695 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7ff2a406e2b0 0x7ff2a4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:02.387 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:02.368+0000 7ff2bb7fe640 1 --2- 172.21.15.88:0/4215841695 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7ff2a406e2b0 0x7ff2a4070770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0000c00 tx=0x7ff2b00058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:02.387 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:02.372+0000 7ff2b97fa640 1 -- 172.21.15.88:0/4215841695 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff2bc10af90 con 0x7ff2bc101960 2024-09-17T04:18:02.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:02.547+0000 7ff2c26b1640 1 -- 172.21.15.88:0/4215841695 --> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7ff2bc02c640 con 0x7ff2a406e2b0 2024-09-17T04:18:02.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:02.555+0000 7ff2b97fa640 1 -- 172.21.15.88:0/4215841695 <== mgr.14217 v2:172.21.15.88:6800/1666801150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3120 (secure 0 0 0) 0x7ff2bc02c640 con 0x7ff2a406e2b0 2024-09-17T04:18:02.555 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T04:18:02.555 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (3m) 119s ago 5m 26.5M - 0.25.0 c8568f914cd2 f2dbac7e939f 2024-09-17T04:18:02.556 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi088 smithi088 running (5m) 119s ago 5m 7721k - 19.1.1-330-gc2ddf972 ebb0615149de 6ec56b3c8d6d 2024-09-17T04:18:02.556 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi134 smithi134 running (4m) 41s ago 4m 5272k - 19.1.1-330-gc2ddf972 ebb0615149de 6c2b7072b682 2024-09-17T04:18:02.556 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (5m) 119s ago 5m 6903k - 19.1.1-330-gc2ddf972 ebb0615149de de17f5571330 2024-09-17T04:18:02.556 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi134 smithi134 running (4m) 41s ago 4m 6899k - 19.1.1-330-gc2ddf972 ebb0615149de 27f7ef172a1c 2024-09-17T04:18:02.556 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (3m) 119s ago 4m 76.0M - 9.4.12 2bacad6d85d8 a6cff57a23f9 2024-09-17T04:18:02.556 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.wmndiv smithi088 *:9283,8765,8443 running (6m) 119s ago 6m 490M - 19.1.1-330-gc2ddf972 ebb0615149de 2067eec66468 2024-09-17T04:18:02.556 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi134.vwdxcb smithi134 *:8443,9283,8765 running (4m) 41s ago 4m 441M - 19.1.1-330-gc2ddf972 ebb0615149de cdff532c8290 2024-09-17T04:18:02.556 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (6m) 119s ago 6m 44.3M 2048M 19.1.1-330-gc2ddf972 ebb0615149de bbeb722f42bc 2024-09-17T04:18:02.556 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi134 smithi134 running (4m) 41s ago 4m 40.0M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 89de63fb6386 2024-09-17T04:18:02.556 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (5m) 119s ago 5m 16.3M - 1.5.0 0da6a335fe13 9ba03800993b 2024-09-17T04:18:02.556 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi134 smithi134 *:9100 running (4m) 41s ago 4m 17.1M - 1.5.0 0da6a335fe13 6deac483827f 2024-09-17T04:18:02.556 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (3m) 119s ago 3m 37.7M 3946M 19.1.1-330-gc2ddf972 ebb0615149de e309427ee12c 2024-09-17T04:18:02.556 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (2m) 119s ago 2m 48.5M 3946M 19.1.1-330-gc2ddf972 ebb0615149de cc68d92b3333 2024-09-17T04:18:02.557 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (2m) 119s ago 2m 11.5M 3946M 19.1.1-330-gc2ddf972 ebb0615149de 1ba92f2bfce6 2024-09-17T04:18:02.557 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi134 running (101s) 41s ago 100s 49.7M 4970M 19.1.1-330-gc2ddf972 ebb0615149de ebd528c3ce1b 2024-09-17T04:18:02.557 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi134 running (74s) 41s ago 73s 37.1M 4970M 19.1.1-330-gc2ddf972 ebb0615149de eacc25537b3a 2024-09-17T04:18:02.557 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi134 running (47s) 41s ago 46s 11.1M 4970M 19.1.1-330-gc2ddf972 ebb0615149de bc1b434a92a8 2024-09-17T04:18:02.557 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (3m) 119s ago 4m 42.7M - 2.43.0 a07b618ecd1d 3c7fe8c3d4b0 2024-09-17T04:18:02.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:02.558+0000 7ff2c26b1640 1 -- 172.21.15.88:0/4215841695 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7ff2a406e2b0 msgr2=0x7ff2a4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:02.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:02.558+0000 7ff2c26b1640 1 --2- 172.21.15.88:0/4215841695 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7ff2a406e2b0 0x7ff2a4070770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0000c00 tx=0x7ff2b00058d0 comp rx=0 tx=0).stop 2024-09-17T04:18:02.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:02.558+0000 7ff2c26b1640 1 -- 172.21.15.88:0/4215841695 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2bc101960 msgr2=0x7ff2bc197470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:02.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:02.558+0000 7ff2c26b1640 1 --2- 172.21.15.88:0/4215841695 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2bc101960 0x7ff2bc197470 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac00c8f0 tx=0x7ff2ac00cdb0 comp rx=0 tx=0).stop 2024-09-17T04:18:02.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:02.558+0000 7ff2c26b1640 1 -- 172.21.15.88:0/4215841695 shutdown_connections 2024-09-17T04:18:02.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:02.558+0000 7ff2c26b1640 1 --2- 172.21.15.88:0/4215841695 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7ff2a406e2b0 0x7ff2a4070770 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:02.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:02.558+0000 7ff2c26b1640 1 --2- 172.21.15.88:0/4215841695 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2bc102b60 0x7ff2bc1979b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:02.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:02.558+0000 7ff2c26b1640 1 --2- 172.21.15.88:0/4215841695 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2bc101960 0x7ff2bc197470 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:02.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:02.558+0000 7ff2c26b1640 1 -- 172.21.15.88:0/4215841695 >> 172.21.15.88:0/4215841695 conn(0x7ff2bc0fd0f0 msgr2=0x7ff2bc106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:02.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:02.558+0000 7ff2c26b1640 1 -- 172.21.15.88:0/4215841695 shutdown_connections 2024-09-17T04:18:02.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:02.558+0000 7ff2c26b1640 1 -- 172.21.15.88:0/4215841695 wait complete. 2024-09-17T04:18:02.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:02 smithi088 ceph-mon[27811]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:18:02.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:02 smithi134 ceph-mon[35201]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:18:03.357 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-17T04:18:03.643 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:18:03.763 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:03 smithi088 ceph-mon[27811]: from='client.14548 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:18:03.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:03 smithi134 ceph-mon[35201]: from='client.14548 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:18:04.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:04.112+0000 7f9c41244640 1 -- 172.21.15.88:0/120590983 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c3c100860 msgr2=0x7f9c3c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:04.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:04.112+0000 7f9c41244640 1 --2- 172.21.15.88:0/120590983 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c3c100860 0x7f9c3c100c60 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c009880 tx=0x7f9c2c02a4a0 comp rx=0 tx=0).stop 2024-09-17T04:18:04.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:04.112+0000 7f9c41244640 1 -- 172.21.15.88:0/120590983 shutdown_connections 2024-09-17T04:18:04.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:04.112+0000 7f9c41244640 1 --2- 172.21.15.88:0/120590983 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c3c101a60 0x7f9c3c101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:04.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:04.112+0000 7f9c41244640 1 --2- 172.21.15.88:0/120590983 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c3c100860 0x7f9c3c100c60 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:04.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:04.112+0000 7f9c41244640 1 -- 172.21.15.88:0/120590983 >> 172.21.15.88:0/120590983 conn(0x7f9c3c0fc010 msgr2=0x7f9c3c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:04.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:04.112+0000 7f9c41244640 1 -- 172.21.15.88:0/120590983 shutdown_connections 2024-09-17T04:18:04.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:04.112+0000 7f9c41244640 1 -- 172.21.15.88:0/120590983 wait complete. 2024-09-17T04:18:04.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:04.113+0000 7f9c41244640 1 Processor -- start 2024-09-17T04:18:04.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:04.113+0000 7f9c41244640 1 -- start start 2024-09-17T04:18:04.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:04.113+0000 7f9c41244640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c3c100860 0x7f9c3c1963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:04.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:04.113+0000 7f9c41244640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c3c101a60 0x7f9c3c196920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:04.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:04.113+0000 7f9c41244640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f9c3c1096a0 con 0x7f9c3c101a60 2024-09-17T04:18:04.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:04.113+0000 7f9c41244640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9c3c109520 con 0x7f9c3c100860 2024-09-17T04:18:04.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:04.113+0000 7f9c3a59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c3c101a60 0x7f9c3c196920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:04.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:04.113+0000 7f9c3a59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c3c101a60 0x7f9c3c196920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53918/0 (socket says 172.21.15.88:53918) 2024-09-17T04:18:04.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:04.113+0000 7f9c3a59c640 1 -- 172.21.15.88:0/64207287 learned_addr learned my addr 172.21.15.88:0/64207287 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:18:04.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:04.113+0000 7f9c3ad9d640 1 --2- 172.21.15.88:0/64207287 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c3c100860 0x7f9c3c1963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:04.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:04.113+0000 7f9c3a59c640 1 -- 172.21.15.88:0/64207287 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c3c100860 msgr2=0x7f9c3c1963e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:04.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:04.113+0000 7f9c3a59c640 1 --2- 172.21.15.88:0/64207287 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c3c100860 0x7f9c3c1963e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:04.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:04.113+0000 7f9c3a59c640 1 -- 172.21.15.88:0/64207287 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c3c196fa0 con 0x7f9c3c101a60 2024-09-17T04:18:04.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:04.114+0000 7f9c3a59c640 1 --2- 172.21.15.88:0/64207287 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c3c101a60 0x7f9c3c196920 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9c24009860 tx=0x7f9c24009d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:04.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:04.114+0000 7f9c33fff640 1 -- 172.21.15.88:0/64207287 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9c24005020 con 0x7f9c3c101a60 2024-09-17T04:18:04.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:04.114+0000 7f9c41244640 1 -- 172.21.15.88:0/64207287 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c3c06a210 con 0x7f9c3c101a60 2024-09-17T04:18:04.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:04.114+0000 7f9c33fff640 1 -- 172.21.15.88:0/64207287 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9c240047a0 con 0x7f9c3c101a60 2024-09-17T04:18:04.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:04.114+0000 7f9c33fff640 1 -- 172.21.15.88:0/64207287 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9c24007b00 con 0x7f9c3c101a60 2024-09-17T04:18:04.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:04.114+0000 7f9c41244640 1 -- 172.21.15.88:0/64207287 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c3c06a7a0 con 0x7f9c3c101a60 2024-09-17T04:18:04.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:04.115+0000 7f9c41244640 1 -- 172.21.15.88:0/64207287 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c3c100c60 con 0x7f9c3c101a60 2024-09-17T04:18:04.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:04.115+0000 7f9c33fff640 1 -- 172.21.15.88:0/64207287 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f9c24004950 con 0x7f9c3c101a60 2024-09-17T04:18:04.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:04.116+0000 7f9c33fff640 1 --2- 172.21.15.88:0/64207287 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f9c2806e2b0 0x7f9c28070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:04.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:04.116+0000 7f9c33fff640 1 -- 172.21.15.88:0/64207287 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f9c24013030 con 0x7f9c3c101a60 2024-09-17T04:18:04.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:04.116+0000 7f9c3ad9d640 1 --2- 172.21.15.88:0/64207287 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f9c2806e2b0 0x7f9c28070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:04.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:04.116+0000 7f9c3ad9d640 1 --2- 172.21.15.88:0/64207287 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f9c2806e2b0 0x7f9c28070770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c009230 tx=0x7f9c2c0058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:04.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:04.120+0000 7f9c33fff640 1 -- 172.21.15.88:0/64207287 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9c24060f80 con 0x7f9c3c101a60 2024-09-17T04:18:04.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:04.295+0000 7f9c41244640 1 -- 172.21.15.88:0/64207287 --> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f9c3c06aab0 con 0x7f9c2806e2b0 2024-09-17T04:18:04.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:04.299+0000 7f9c33fff640 1 -- 172.21.15.88:0/64207287 <== mgr.14217 v2:172.21.15.88:6800/1666801150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+1300 (secure 0 0 0) 0x7f9c3c06aab0 con 0x7f9c2806e2b0 2024-09-17T04:18:04.299 INFO:teuthology.orchestra.run.smithi088.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-17T04:18:04.299 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager ?:9093,9094 1/1 2m ago 5m count:1 2024-09-17T04:18:04.299 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter 2/2 2m ago 5m * 2024-09-17T04:18:04.299 INFO:teuthology.orchestra.run.smithi088.stdout:crash 2/2 2m ago 5m * 2024-09-17T04:18:04.299 INFO:teuthology.orchestra.run.smithi088.stdout:grafana ?:3000 1/1 2m ago 5m count:1 2024-09-17T04:18:04.299 INFO:teuthology.orchestra.run.smithi088.stdout:mgr 2/2 2m ago 5m count:2 2024-09-17T04:18:04.299 INFO:teuthology.orchestra.run.smithi088.stdout:mon 2/2 2m ago 5m smithi088:172.21.15.88=smithi088;smithi134:172.21.15.134=smithi134;count:2 2024-09-17T04:18:04.299 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter ?:9100 2/2 2m ago 5m * 2024-09-17T04:18:04.300 INFO:teuthology.orchestra.run.smithi088.stdout:osd 6 2m ago - 2024-09-17T04:18:04.300 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus ?:9095 1/1 2m ago 5m count:1 2024-09-17T04:18:04.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:04.301+0000 7f9c41244640 1 -- 172.21.15.88:0/64207287 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f9c2806e2b0 msgr2=0x7f9c28070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:04.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:04.301+0000 7f9c41244640 1 --2- 172.21.15.88:0/64207287 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f9c2806e2b0 0x7f9c28070770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c009230 tx=0x7f9c2c0058d0 comp rx=0 tx=0).stop 2024-09-17T04:18:04.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:04.301+0000 7f9c41244640 1 -- 172.21.15.88:0/64207287 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c3c101a60 msgr2=0x7f9c3c196920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:04.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:04.301+0000 7f9c41244640 1 --2- 172.21.15.88:0/64207287 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c3c101a60 0x7f9c3c196920 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9c24009860 tx=0x7f9c24009d20 comp rx=0 tx=0).stop 2024-09-17T04:18:04.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:04.301+0000 7f9c41244640 1 -- 172.21.15.88:0/64207287 shutdown_connections 2024-09-17T04:18:04.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:04.301+0000 7f9c41244640 1 --2- 172.21.15.88:0/64207287 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f9c2806e2b0 0x7f9c28070770 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:04.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:04.301+0000 7f9c41244640 1 --2- 172.21.15.88:0/64207287 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c3c101a60 0x7f9c3c196920 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:04.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:04.301+0000 7f9c41244640 1 --2- 172.21.15.88:0/64207287 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c3c100860 0x7f9c3c1963e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:04.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:04.301+0000 7f9c41244640 1 -- 172.21.15.88:0/64207287 >> 172.21.15.88:0/64207287 conn(0x7f9c3c0fc010 msgr2=0x7f9c3c104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:04.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:04.301+0000 7f9c41244640 1 -- 172.21.15.88:0/64207287 shutdown_connections 2024-09-17T04:18:04.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:04.301+0000 7f9c41244640 1 -- 172.21.15.88:0/64207287 wait complete. 2024-09-17T04:18:04.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:04 smithi088 ceph-mon[27811]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:18:04.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:04 smithi134 ceph-mon[35201]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:18:05.114 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-17T04:18:05.360 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:18:05.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:05 smithi088 ceph-mon[27811]: from='client.14552 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:18:05.797 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:05 smithi134 ceph-mon[35201]: from='client.14552 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:18:05.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:05.813+0000 7f594961c640 1 -- 172.21.15.88:0/3946058721 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5944104d20 msgr2=0x7f5944107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:05.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:05.813+0000 7f594961c640 1 --2- 172.21.15.88:0/3946058721 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5944104d20 0x7f5944107110 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f592c0098b0 tx=0x7f592c02a4d0 comp rx=0 tx=0).stop 2024-09-17T04:18:05.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:05.813+0000 7f594961c640 1 -- 172.21.15.88:0/3946058721 shutdown_connections 2024-09-17T04:18:05.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:05.813+0000 7f594961c640 1 --2- 172.21.15.88:0/3946058721 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5944104d20 0x7f5944107110 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:05.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:05.813+0000 7f594961c640 1 --2- 172.21.15.88:0/3946058721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59441023f0 0x7f59441047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:05.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:05.813+0000 7f594961c640 1 -- 172.21.15.88:0/3946058721 >> 172.21.15.88:0/3946058721 conn(0x7f59440fc010 msgr2=0x7f59440fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:05.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:05.813+0000 7f594961c640 1 -- 172.21.15.88:0/3946058721 shutdown_connections 2024-09-17T04:18:05.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:05.813+0000 7f594961c640 1 -- 172.21.15.88:0/3946058721 wait complete. 2024-09-17T04:18:05.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:05.814+0000 7f594961c640 1 Processor -- start 2024-09-17T04:18:05.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:05.814+0000 7f594961c640 1 -- start start 2024-09-17T04:18:05.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:05.814+0000 7f594961c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59441023f0 0x7f5944199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:05.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:05.814+0000 7f594961c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5944104d20 0x7f5944199c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:05.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:05.814+0000 7f594961c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f594410a790 con 0x7f59441023f0 2024-09-17T04:18:05.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:05.814+0000 7f594961c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f594410a610 con 0x7f5944104d20 2024-09-17T04:18:05.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:05.814+0000 7f5942ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59441023f0 0x7f5944199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:05.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:05.814+0000 7f5942ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59441023f0 0x7f5944199700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53936/0 (socket says 172.21.15.88:53936) 2024-09-17T04:18:05.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:05.814+0000 7f5942ffd640 1 -- 172.21.15.88:0/2608037006 learned_addr learned my addr 172.21.15.88:0/2608037006 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:18:05.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:05.815+0000 7f59427fc640 1 --2- 172.21.15.88:0/2608037006 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5944104d20 0x7f5944199c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:05.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:05.815+0000 7f5942ffd640 1 -- 172.21.15.88:0/2608037006 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5944104d20 msgr2=0x7f5944199c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:05.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:05.815+0000 7f5942ffd640 1 --2- 172.21.15.88:0/2608037006 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5944104d20 0x7f5944199c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:05.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:05.815+0000 7f5942ffd640 1 -- 172.21.15.88:0/2608037006 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f594419a2c0 con 0x7f59441023f0 2024-09-17T04:18:05.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:05.815+0000 7f5942ffd640 1 --2- 172.21.15.88:0/2608037006 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59441023f0 0x7f5944199700 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f593400ea30 tx=0x7f593400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:05.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:05.815+0000 7f593bfff640 1 -- 172.21.15.88:0/2608037006 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f593400cbe0 con 0x7f59441023f0 2024-09-17T04:18:05.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:05.815+0000 7f593bfff640 1 -- 172.21.15.88:0/2608037006 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f593400cd80 con 0x7f59441023f0 2024-09-17T04:18:05.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:05.815+0000 7f594961c640 1 -- 172.21.15.88:0/2608037006 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f594419ed00 con 0x7f59441023f0 2024-09-17T04:18:05.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:05.815+0000 7f593bfff640 1 -- 172.21.15.88:0/2608037006 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f593401a920 con 0x7f59441023f0 2024-09-17T04:18:05.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:05.815+0000 7f594961c640 1 -- 172.21.15.88:0/2608037006 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f594419f1b0 con 0x7f59441023f0 2024-09-17T04:18:05.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:05.816+0000 7f594961c640 1 -- 172.21.15.88:0/2608037006 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59441027d0 con 0x7f59441023f0 2024-09-17T04:18:05.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:05.817+0000 7f593bfff640 1 -- 172.21.15.88:0/2608037006 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f593401aac0 con 0x7f59441023f0 2024-09-17T04:18:05.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:05.817+0000 7f593bfff640 1 --2- 172.21.15.88:0/2608037006 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f593006e310 0x7f59300707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:05.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:05.817+0000 7f593bfff640 1 -- 172.21.15.88:0/2608037006 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f593408e450 con 0x7f59441023f0 2024-09-17T04:18:05.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:05.817+0000 7f59427fc640 1 --2- 172.21.15.88:0/2608037006 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f593006e310 0x7f59300707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:05.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:05.817+0000 7f59427fc640 1 --2- 172.21.15.88:0/2608037006 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f593006e310 0x7f59300707d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f592c009880 tx=0x7f592c0058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:05.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:05.821+0000 7f593bfff640 1 -- 172.21.15.88:0/2608037006 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5934016030 con 0x7f59441023f0 2024-09-17T04:18:05.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:05.993+0000 7f594961c640 1 -- 172.21.15.88:0/2608037006 --> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f5944062630 con 0x7f593006e310 2024-09-17T04:18:05.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:05.994+0000 7f593bfff640 1 -- 172.21.15.88:0/2608037006 <== mgr.14217 v2:172.21.15.88:6800/1666801150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+148 (secure 0 0 0) 0x7f5944062630 con 0x7f593006e310 2024-09-17T04:18:05.994 INFO:teuthology.orchestra.run.smithi088.stdout:HOST ADDR LABELS STATUS 2024-09-17T04:18:05.994 INFO:teuthology.orchestra.run.smithi088.stdout:smithi088 172.21.15.88 2024-09-17T04:18:05.994 INFO:teuthology.orchestra.run.smithi088.stdout:smithi134 172.21.15.134 2024-09-17T04:18:05.994 INFO:teuthology.orchestra.run.smithi088.stdout:2 hosts in cluster 2024-09-17T04:18:05.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:05.996+0000 7f594961c640 1 -- 172.21.15.88:0/2608037006 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f593006e310 msgr2=0x7f59300707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:05.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:05.996+0000 7f594961c640 1 --2- 172.21.15.88:0/2608037006 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f593006e310 0x7f59300707d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f592c009880 tx=0x7f592c0058d0 comp rx=0 tx=0).stop 2024-09-17T04:18:05.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:05.996+0000 7f594961c640 1 -- 172.21.15.88:0/2608037006 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59441023f0 msgr2=0x7f5944199700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:05.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:05.996+0000 7f594961c640 1 --2- 172.21.15.88:0/2608037006 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59441023f0 0x7f5944199700 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f593400ea30 tx=0x7f593400eef0 comp rx=0 tx=0).stop 2024-09-17T04:18:05.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:05.996+0000 7f594961c640 1 -- 172.21.15.88:0/2608037006 shutdown_connections 2024-09-17T04:18:05.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:05.996+0000 7f594961c640 1 --2- 172.21.15.88:0/2608037006 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f593006e310 0x7f59300707d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:05.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:05.996+0000 7f594961c640 1 --2- 172.21.15.88:0/2608037006 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5944104d20 0x7f5944199c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:05.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:05.996+0000 7f594961c640 1 --2- 172.21.15.88:0/2608037006 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59441023f0 0x7f5944199700 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:05.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:05.996+0000 7f594961c640 1 -- 172.21.15.88:0/2608037006 >> 172.21.15.88:0/2608037006 conn(0x7f59440fc010 msgr2=0x7f5944101950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:05.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:05.996+0000 7f594961c640 1 -- 172.21.15.88:0/2608037006 shutdown_connections 2024-09-17T04:18:05.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:05.996+0000 7f594961c640 1 -- 172.21.15.88:0/2608037006 wait complete. 2024-09-17T04:18:06.577 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:06 smithi088 ceph-mon[27811]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:18:06.577 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:06 smithi088 ceph-mon[27811]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:18:06.606 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-17T04:18:06.853 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:18:06.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:06 smithi134 ceph-mon[35201]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:18:06.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:06 smithi134 ceph-mon[35201]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:18:07.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:07.352+0000 7f96de831640 1 -- 172.21.15.88:0/1371856474 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96d8104dc0 msgr2=0x7f96d81071b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:07.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:07.352+0000 7f96de831640 1 --2- 172.21.15.88:0/1371856474 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96d8104dc0 0x7f96d81071b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f96cc009880 tx=0x7f96cc02a4a0 comp rx=0 tx=0).stop 2024-09-17T04:18:07.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:07.352+0000 7f96de831640 1 -- 172.21.15.88:0/1371856474 shutdown_connections 2024-09-17T04:18:07.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:07.352+0000 7f96de831640 1 --2- 172.21.15.88:0/1371856474 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96d8104dc0 0x7f96d81071b0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:07.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:07.352+0000 7f96de831640 1 --2- 172.21.15.88:0/1371856474 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96d8102490 0x7f96d8104880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:07.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:07.352+0000 7f96de831640 1 -- 172.21.15.88:0/1371856474 >> 172.21.15.88:0/1371856474 conn(0x7f96d80fc010 msgr2=0x7f96d80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:07.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:07.352+0000 7f96de831640 1 -- 172.21.15.88:0/1371856474 shutdown_connections 2024-09-17T04:18:07.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:07.352+0000 7f96de831640 1 -- 172.21.15.88:0/1371856474 wait complete. 2024-09-17T04:18:07.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:07.353+0000 7f96de831640 1 Processor -- start 2024-09-17T04:18:07.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:07.353+0000 7f96de831640 1 -- start start 2024-09-17T04:18:07.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:07.353+0000 7f96de831640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96d8102490 0x7f96d8101d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:07.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:07.353+0000 7f96de831640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96d8104dc0 0x7f96d8100440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:07.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:07.353+0000 7f96de831640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f96d810a780 con 0x7f96d8102490 2024-09-17T04:18:07.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:07.353+0000 7f96de831640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f96d810a600 con 0x7f96d8104dc0 2024-09-17T04:18:07.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:07.353+0000 7f96d7fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96d8102490 0x7f96d8101d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:07.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:07.353+0000 7f96d7fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96d8102490 0x7f96d8101d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53954/0 (socket says 172.21.15.88:53954) 2024-09-17T04:18:07.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:07.353+0000 7f96d7fff640 1 -- 172.21.15.88:0/1140102465 learned_addr learned my addr 172.21.15.88:0/1140102465 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:18:07.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:07.354+0000 7f96d7fff640 1 -- 172.21.15.88:0/1140102465 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96d8104dc0 msgr2=0x7f96d8100440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:07.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:07.354+0000 7f96d7fff640 1 --2- 172.21.15.88:0/1140102465 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96d8104dc0 0x7f96d8100440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:07.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:07.354+0000 7f96d7fff640 1 -- 172.21.15.88:0/1140102465 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96d8100980 con 0x7f96d8102490 2024-09-17T04:18:07.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:07.354+0000 7f96d7fff640 1 --2- 172.21.15.88:0/1140102465 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96d8102490 0x7f96d8101d80 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f96c800c8a0 tx=0x7f96c800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:07.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:07.354+0000 7f96d57fa640 1 -- 172.21.15.88:0/1140102465 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f96c80079b0 con 0x7f96d8102490 2024-09-17T04:18:07.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:07.354+0000 7f96de831640 1 -- 172.21.15.88:0/1140102465 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96d8100c70 con 0x7f96d8102490 2024-09-17T04:18:07.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:07.354+0000 7f96d57fa640 1 -- 172.21.15.88:0/1140102465 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f96c8007b50 con 0x7f96d8102490 2024-09-17T04:18:07.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:07.354+0000 7f96d57fa640 1 -- 172.21.15.88:0/1140102465 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f96c8018700 con 0x7f96d8102490 2024-09-17T04:18:07.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:07.354+0000 7f96de831640 1 -- 172.21.15.88:0/1140102465 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96d8101200 con 0x7f96d8102490 2024-09-17T04:18:07.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:07.355+0000 7f96de831640 1 -- 172.21.15.88:0/1140102465 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96d8102870 con 0x7f96d8102490 2024-09-17T04:18:07.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:07.355+0000 7f96d57fa640 1 -- 172.21.15.88:0/1140102465 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f96c8007d00 con 0x7f96d8102490 2024-09-17T04:18:07.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:07.356+0000 7f96d57fa640 1 --2- 172.21.15.88:0/1140102465 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f96c006e2b0 0x7f96c0070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:07.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:07.356+0000 7f96d57fa640 1 -- 172.21.15.88:0/1140102465 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f96c808e110 con 0x7f96d8102490 2024-09-17T04:18:07.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:07.356+0000 7f96d77fe640 1 --2- 172.21.15.88:0/1140102465 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f96c006e2b0 0x7f96c0070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:07.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:07.356+0000 7f96d77fe640 1 --2- 172.21.15.88:0/1140102465 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f96c006e2b0 0x7f96c0070770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f96cc02a9c0 tx=0x7f96cc000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:07.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:07.360+0000 7f96d57fa640 1 -- 172.21.15.88:0/1140102465 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f96c8014030 con 0x7f96d8102490 2024-09-17T04:18:07.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:07.535+0000 7f96de831640 1 -- 172.21.15.88:0/1140102465 --> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f96d81058a0 con 0x7f96c006e2b0 2024-09-17T04:18:07.535 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:07 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:18:07.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:07.537+0000 7f96d57fa640 1 -- 172.21.15.88:0/1140102465 <== mgr.14217 v2:172.21.15.88:6800/1666801150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+399 (secure 0 0 0) 0x7f96d81058a0 con 0x7f96c006e2b0 2024-09-17T04:18:07.537 INFO:teuthology.orchestra.run.smithi088.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-17T04:18:07.537 INFO:teuthology.orchestra.run.smithi088.stdout:smithi088 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400XD400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-17T04:18:07.537 INFO:teuthology.orchestra.run.smithi088.stdout:smithi134 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT62420002400BGN 372G No 43s ago Has a FileSystem, LVM detected 2024-09-17T04:18:07.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:07.539+0000 7f96de831640 1 -- 172.21.15.88:0/1140102465 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f96c006e2b0 msgr2=0x7f96c0070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:07.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:07.539+0000 7f96de831640 1 --2- 172.21.15.88:0/1140102465 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f96c006e2b0 0x7f96c0070770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f96cc02a9c0 tx=0x7f96cc000bc0 comp rx=0 tx=0).stop 2024-09-17T04:18:07.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:07.539+0000 7f96de831640 1 -- 172.21.15.88:0/1140102465 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96d8102490 msgr2=0x7f96d8101d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:07.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:07.539+0000 7f96de831640 1 --2- 172.21.15.88:0/1140102465 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96d8102490 0x7f96d8101d80 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f96c800c8a0 tx=0x7f96c800cd60 comp rx=0 tx=0).stop 2024-09-17T04:18:07.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:07.539+0000 7f96de831640 1 -- 172.21.15.88:0/1140102465 shutdown_connections 2024-09-17T04:18:07.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:07.539+0000 7f96de831640 1 --2- 172.21.15.88:0/1140102465 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f96c006e2b0 0x7f96c0070770 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:07.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:07.539+0000 7f96de831640 1 --2- 172.21.15.88:0/1140102465 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96d8104dc0 0x7f96d8100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:07.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:07.539+0000 7f96de831640 1 --2- 172.21.15.88:0/1140102465 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96d8102490 0x7f96d8101d80 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:07.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:07.539+0000 7f96de831640 1 -- 172.21.15.88:0/1140102465 >> 172.21.15.88:0/1140102465 conn(0x7f96d80fc010 msgr2=0x7f96d80fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:07.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:07.539+0000 7f96de831640 1 -- 172.21.15.88:0/1140102465 shutdown_connections 2024-09-17T04:18:07.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:07.539+0000 7f96de831640 1 -- 172.21.15.88:0/1140102465 wait complete. 2024-09-17T04:18:07.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:07 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:18:08.215 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T04:18:08.225 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi088.front.sepia.ceph.com 2024-09-17T04:18:08.225 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-09-17T04:18:08.469 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:18:08.590 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:08 smithi088 ceph-mon[27811]: from='client.14560 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:18:08.590 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:08 smithi088 ceph-mon[27811]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:18:08.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:08 smithi134 ceph-mon[35201]: from='client.14560 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:18:08.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:08 smithi134 ceph-mon[35201]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:18:08.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:08.904+0000 7ff56eb85640 1 -- 172.21.15.88:0/734581094 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff568101a60 msgr2=0x7ff568101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:08.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:08.904+0000 7ff56eb85640 1 --2- 172.21.15.88:0/734581094 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff568101a60 0x7ff568101ee0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff554009880 tx=0x7ff55402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:18:08.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:08.904+0000 7ff56eb85640 1 -- 172.21.15.88:0/734581094 shutdown_connections 2024-09-17T04:18:08.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:08.904+0000 7ff56eb85640 1 --2- 172.21.15.88:0/734581094 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff568101a60 0x7ff568101ee0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:08.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:08.904+0000 7ff56eb85640 1 --2- 172.21.15.88:0/734581094 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff568100860 0x7ff568100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:08.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:08.904+0000 7ff56eb85640 1 -- 172.21.15.88:0/734581094 >> 172.21.15.88:0/734581094 conn(0x7ff5680fc010 msgr2=0x7ff5680fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:08.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:08.904+0000 7ff56eb85640 1 -- 172.21.15.88:0/734581094 shutdown_connections 2024-09-17T04:18:08.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:08.904+0000 7ff56eb85640 1 -- 172.21.15.88:0/734581094 wait complete. 2024-09-17T04:18:08.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:08.904+0000 7ff56eb85640 1 Processor -- start 2024-09-17T04:18:08.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:08.904+0000 7ff56eb85640 1 -- start start 2024-09-17T04:18:08.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:08.905+0000 7ff56eb85640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff568100860 0x7ff568197540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:08.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:08.905+0000 7ff56eb85640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff568101a60 0x7ff568197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:08.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:08.905+0000 7ff56eb85640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ff5681096a0 con 0x7ff568101a60 2024-09-17T04:18:08.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:08.905+0000 7ff56eb85640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff568109520 con 0x7ff568100860 2024-09-17T04:18:08.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:08.905+0000 7ff567fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff568101a60 0x7ff568197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:08.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:08.905+0000 7ff567fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff568101a60 0x7ff568197a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53972/0 (socket says 172.21.15.88:53972) 2024-09-17T04:18:08.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:08.905+0000 7ff567fff640 1 -- 172.21.15.88:0/3552360510 learned_addr learned my addr 172.21.15.88:0/3552360510 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:18:08.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:08.905+0000 7ff56c921640 1 --2- 172.21.15.88:0/3552360510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff568100860 0x7ff568197540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:08.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:08.905+0000 7ff567fff640 1 -- 172.21.15.88:0/3552360510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff568100860 msgr2=0x7ff568197540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:08.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:08.905+0000 7ff567fff640 1 --2- 172.21.15.88:0/3552360510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff568100860 0x7ff568197540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:08.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:08.905+0000 7ff567fff640 1 -- 172.21.15.88:0/3552360510 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff568198100 con 0x7ff568101a60 2024-09-17T04:18:08.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:08.905+0000 7ff567fff640 1 --2- 172.21.15.88:0/3552360510 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff568101a60 0x7ff568197a80 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff554006010 tx=0x7ff5540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:08.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:08.905+0000 7ff565ffb640 1 -- 172.21.15.88:0/3552360510 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff55403f070 con 0x7ff568101a60 2024-09-17T04:18:08.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:08.905+0000 7ff565ffb640 1 -- 172.21.15.88:0/3552360510 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff554004ac0 con 0x7ff568101a60 2024-09-17T04:18:08.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:08.905+0000 7ff56eb85640 1 -- 172.21.15.88:0/3552360510 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff56819cae0 con 0x7ff568101a60 2024-09-17T04:18:08.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:08.905+0000 7ff565ffb640 1 -- 172.21.15.88:0/3552360510 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff554035030 con 0x7ff568101a60 2024-09-17T04:18:08.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:08.906+0000 7ff56eb85640 1 -- 172.21.15.88:0/3552360510 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff56819d070 con 0x7ff568101a60 2024-09-17T04:18:08.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:08.907+0000 7ff56eb85640 1 -- 172.21.15.88:0/3552360510 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff568100c60 con 0x7ff568101a60 2024-09-17T04:18:08.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:08.907+0000 7ff565ffb640 1 -- 172.21.15.88:0/3552360510 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7ff554042070 con 0x7ff568101a60 2024-09-17T04:18:08.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:08.907+0000 7ff565ffb640 1 --2- 172.21.15.88:0/3552360510 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7ff55806e2b0 0x7ff558070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:08.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:08.908+0000 7ff565ffb640 1 -- 172.21.15.88:0/3552360510 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7ff5540aea90 con 0x7ff568101a60 2024-09-17T04:18:08.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:08.908+0000 7ff56c921640 1 --2- 172.21.15.88:0/3552360510 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7ff55806e2b0 0x7ff558070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:08.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:08.908+0000 7ff56c921640 1 --2- 172.21.15.88:0/3552360510 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7ff55806e2b0 0x7ff558070770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff55c005fd0 tx=0x7ff55c005850 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:08.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:08.912+0000 7ff565ffb640 1 -- 172.21.15.88:0/3552360510 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff55407c730 con 0x7ff568101a60 2024-09-17T04:18:09.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:09.101+0000 7ff56eb85640 1 -- 172.21.15.88:0/3552360510 --> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) -- 0x7ff56806a460 con 0x7ff55806e2b0 2024-09-17T04:18:09.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:09 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-17T04:18:09.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:09 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-17T04:18:10.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:10.503+0000 7ff565ffb640 1 -- 172.21.15.88:0/3552360510 <== mgr.14217 v2:172.21.15.88:6800/1666801150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff56806a460 con 0x7ff55806e2b0 2024-09-17T04:18:10.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:10.506+0000 7ff56eb85640 1 -- 172.21.15.88:0/3552360510 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7ff55806e2b0 msgr2=0x7ff558070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:10.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:10.506+0000 7ff56eb85640 1 --2- 172.21.15.88:0/3552360510 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7ff55806e2b0 0x7ff558070770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff55c005fd0 tx=0x7ff55c005850 comp rx=0 tx=0).stop 2024-09-17T04:18:10.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:10.506+0000 7ff56eb85640 1 -- 172.21.15.88:0/3552360510 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff568101a60 msgr2=0x7ff568197a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:10.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:10.506+0000 7ff56eb85640 1 --2- 172.21.15.88:0/3552360510 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff568101a60 0x7ff568197a80 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff554006010 tx=0x7ff5540046c0 comp rx=0 tx=0).stop 2024-09-17T04:18:10.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:10.506+0000 7ff56eb85640 1 -- 172.21.15.88:0/3552360510 shutdown_connections 2024-09-17T04:18:10.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:10.506+0000 7ff56eb85640 1 --2- 172.21.15.88:0/3552360510 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7ff55806e2b0 0x7ff558070770 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:10.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:10.506+0000 7ff56eb85640 1 --2- 172.21.15.88:0/3552360510 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff568101a60 0x7ff568197a80 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:10.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:10.506+0000 7ff56eb85640 1 --2- 172.21.15.88:0/3552360510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff568100860 0x7ff568197540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:10.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:10.506+0000 7ff56eb85640 1 -- 172.21.15.88:0/3552360510 >> 172.21.15.88:0/3552360510 conn(0x7ff5680fc010 msgr2=0x7ff568069d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:10.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:10.506+0000 7ff56eb85640 1 -- 172.21.15.88:0/3552360510 shutdown_connections 2024-09-17T04:18:10.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:10.506+0000 7ff56eb85640 1 -- 172.21.15.88:0/3552360510 wait complete. 2024-09-17T04:18:10.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:10 smithi088 ceph-mon[27811]: from='client.14564 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:18:10.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:10 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-17T04:18:10.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:10 smithi088 ceph-mon[27811]: osdmap e40: 6 total, 6 up, 6 in 2024-09-17T04:18:10.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:10 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-17T04:18:10.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:10 smithi088 ceph-mon[27811]: pgmap v172: 33 pgs: 5 creating+peering, 27 unknown, 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:18:10.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:10 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-mon-smithi088[27807]: 2024-09-17T04:18:10.479+0000 7f6999534640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T04:18:10.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:10 smithi134 ceph-mon[35201]: from='client.14564 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:18:10.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:10 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-17T04:18:10.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:10 smithi134 ceph-mon[35201]: osdmap e40: 6 total, 6 up, 6 in 2024-09-17T04:18:10.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:10 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-17T04:18:10.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:10 smithi134 ceph-mon[35201]: pgmap v172: 33 pgs: 5 creating+peering, 27 unknown, 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:18:11.237 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-17T04:18:11.770 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:11 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-17T04:18:11.770 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:11 smithi088 ceph-mon[27811]: osdmap e41: 6 total, 6 up, 6 in 2024-09-17T04:18:11.770 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:11 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-17T04:18:11.770 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:11 smithi088 ceph-mon[27811]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T04:18:11.771 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:11 smithi088 ceph-mon[27811]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-17T04:18:11.771 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:11 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-17T04:18:11.771 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:11 smithi088 ceph-mon[27811]: osdmap e42: 6 total, 6 up, 6 in 2024-09-17T04:18:11.771 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:11 smithi088 ceph-mon[27811]: fsmap cephfs:0 2024-09-17T04:18:11.771 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:11 smithi088 ceph-mon[27811]: Saving service mds.cephfs spec with placement count:4 2024-09-17T04:18:11.771 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:11 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:11.771 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:11 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:18:11.771 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:11 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:18:11.771 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:11 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:18:11.771 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:11 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:11.772 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:11 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi088.lgavsv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T04:18:11.772 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:11 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi088.lgavsv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-17T04:18:11.772 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:11 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:18:11.772 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:11 smithi088 ceph-mon[27811]: Deploying daemon mds.cephfs.smithi088.lgavsv on smithi088 2024-09-17T04:18:11.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:11 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-17T04:18:11.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:11 smithi134 ceph-mon[35201]: osdmap e41: 6 total, 6 up, 6 in 2024-09-17T04:18:11.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:11 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-17T04:18:11.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:11 smithi134 ceph-mon[35201]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T04:18:11.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:11 smithi134 ceph-mon[35201]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-17T04:18:11.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:11 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-17T04:18:11.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:11 smithi134 ceph-mon[35201]: osdmap e42: 6 total, 6 up, 6 in 2024-09-17T04:18:11.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:11 smithi134 ceph-mon[35201]: fsmap cephfs:0 2024-09-17T04:18:11.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:11 smithi134 ceph-mon[35201]: Saving service mds.cephfs spec with placement count:4 2024-09-17T04:18:11.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:11 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:11.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:11 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:18:11.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:11 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:18:11.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:11 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:18:11.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:11 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:11.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:11 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi088.lgavsv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T04:18:11.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:11 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi088.lgavsv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-17T04:18:11.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:11 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:18:11.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:11 smithi134 ceph-mon[35201]: Deploying daemon mds.cephfs.smithi088.lgavsv on smithi088 2024-09-17T04:18:12.645 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:18:12.767 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:12 smithi088 ceph-mon[27811]: osdmap e43: 6 total, 6 up, 6 in 2024-09-17T04:18:12.767 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:12 smithi088 ceph-mon[27811]: pgmap v176: 65 pgs: 13 active+clean, 17 creating+peering, 35 unknown; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:18:12.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:12 smithi134 ceph-mon[35201]: osdmap e43: 6 total, 6 up, 6 in 2024-09-17T04:18:12.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:12 smithi134 ceph-mon[35201]: pgmap v176: 65 pgs: 13 active+clean, 17 creating+peering, 35 unknown; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:18:13.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:13.176+0000 7f970dd77640 1 -- 172.21.15.88:0/2430582806 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9708100860 msgr2=0x7f9708100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:13.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:13.176+0000 7f970dd77640 1 --2- 172.21.15.88:0/2430582806 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9708100860 0x7f9708100c60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f96f8009880 tx=0x7f96f802a4a0 comp rx=0 tx=0).stop 2024-09-17T04:18:13.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:13.176+0000 7f970dd77640 1 -- 172.21.15.88:0/2430582806 shutdown_connections 2024-09-17T04:18:13.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:13.176+0000 7f970dd77640 1 --2- 172.21.15.88:0/2430582806 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9708101a60 0x7f9708101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:13.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:13.176+0000 7f970dd77640 1 --2- 172.21.15.88:0/2430582806 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9708100860 0x7f9708100c60 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:13.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:13.176+0000 7f970dd77640 1 -- 172.21.15.88:0/2430582806 >> 172.21.15.88:0/2430582806 conn(0x7f97080fc010 msgr2=0x7f97080fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:13.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:13.176+0000 7f970dd77640 1 -- 172.21.15.88:0/2430582806 shutdown_connections 2024-09-17T04:18:13.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:13.176+0000 7f970dd77640 1 -- 172.21.15.88:0/2430582806 wait complete. 2024-09-17T04:18:13.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:13.176+0000 7f970dd77640 1 Processor -- start 2024-09-17T04:18:13.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:13.177+0000 7f970dd77640 1 -- start start 2024-09-17T04:18:13.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:13.177+0000 7f970dd77640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9708100860 0x7f9708104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:13.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:13.177+0000 7f970dd77640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9708101a60 0x7f9708102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:13.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:13.177+0000 7f970dd77640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f97081096a0 con 0x7f9708100860 2024-09-17T04:18:13.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:13.177+0000 7f970dd77640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9708109520 con 0x7f9708101a60 2024-09-17T04:18:13.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:13.177+0000 7f97077fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9708100860 0x7f9708104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:13.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:13.177+0000 7f97077fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9708100860 0x7f9708104780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51344/0 (socket says 172.21.15.88:51344) 2024-09-17T04:18:13.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:13.177+0000 7f97077fe640 1 -- 172.21.15.88:0/1965501829 learned_addr learned my addr 172.21.15.88:0/1965501829 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:18:13.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:13.177+0000 7f9706ffd640 1 --2- 172.21.15.88:0/1965501829 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9708101a60 0x7f9708102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:13.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:13.177+0000 7f97077fe640 1 -- 172.21.15.88:0/1965501829 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9708101a60 msgr2=0x7f9708102e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:13.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:13.177+0000 7f97077fe640 1 --2- 172.21.15.88:0/1965501829 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9708101a60 0x7f9708102e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:13.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:13.177+0000 7f97077fe640 1 -- 172.21.15.88:0/1965501829 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9708103380 con 0x7f9708100860 2024-09-17T04:18:13.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:13.178+0000 7f97077fe640 1 --2- 172.21.15.88:0/1965501829 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9708100860 0x7f9708104780 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f96f8006010 tx=0x7f96f80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:13.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:13.178+0000 7f9704ff9640 1 -- 172.21.15.88:0/1965501829 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f96f803f070 con 0x7f9708100860 2024-09-17T04:18:13.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:13.178+0000 7f970dd77640 1 -- 172.21.15.88:0/1965501829 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9708103610 con 0x7f9708100860 2024-09-17T04:18:13.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:13.178+0000 7f9704ff9640 1 -- 172.21.15.88:0/1965501829 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f96f8004a50 con 0x7f9708100860 2024-09-17T04:18:13.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:13.178+0000 7f9704ff9640 1 -- 172.21.15.88:0/1965501829 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f96f8035030 con 0x7f9708100860 2024-09-17T04:18:13.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:13.178+0000 7f970dd77640 1 -- 172.21.15.88:0/1965501829 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9708103b40 con 0x7f9708100860 2024-09-17T04:18:13.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:13.179+0000 7f970dd77640 1 -- 172.21.15.88:0/1965501829 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9708100c60 con 0x7f9708100860 2024-09-17T04:18:13.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:13.179+0000 7f9704ff9640 1 -- 172.21.15.88:0/1965501829 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f96f8042070 con 0x7f9708100860 2024-09-17T04:18:13.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:13.180+0000 7f9704ff9640 1 --2- 172.21.15.88:0/1965501829 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f96f006e2b0 0x7f96f0070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:13.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:13.180+0000 7f9704ff9640 1 -- 172.21.15.88:0/1965501829 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7f96f80aec70 con 0x7f9708100860 2024-09-17T04:18:13.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:13.180+0000 7f9706ffd640 1 --2- 172.21.15.88:0/1965501829 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f96f006e2b0 0x7f96f0070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:13.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:13.180+0000 7f9706ffd640 1 --2- 172.21.15.88:0/1965501829 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f96f006e2b0 0x7f96f0070770 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9708104500 tx=0x7f96fc00b390 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:13.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:13.184+0000 7f9704ff9640 1 -- 172.21.15.88:0/1965501829 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f96f8004c00 con 0x7f9708100860 2024-09-17T04:18:13.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:13.402+0000 7f970dd77640 1 -- 172.21.15.88:0/1965501829 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f970819fb30 con 0x7f9708100860 2024-09-17T04:18:13.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:13.402+0000 7f9704ff9640 1 -- 172.21.15.88:0/1965501829 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) ==== 75+0+1272 (secure 0 0 0) 0x7f96f8080280 con 0x7f9708100860 2024-09-17T04:18:13.404 INFO:teuthology.orchestra.run.smithi088.stdout:e2 2024-09-17T04:18:13.404 INFO:teuthology.orchestra.run.smithi088.stdout:btime 2024-09-17T04:18:10:480636+0000 2024-09-17T04:18:13.404 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T04:18:13.404 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:18:13.404 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2024-09-17T04:18:13.404 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:18:13.404 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2024-09-17T04:18:13.404 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2024-09-17T04:18:13.404 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 2 2024-09-17T04:18:13.404 INFO:teuthology.orchestra.run.smithi088.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-17T04:18:13.404 INFO:teuthology.orchestra.run.smithi088.stdout:created 2024-09-17T04:18:10.480573+0000 2024-09-17T04:18:13.404 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2024-09-17T04:18:10.480573+0000 2024-09-17T04:18:13.405 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2024-09-17T04:18:13.405 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2024-09-17T04:18:13.405 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2024-09-17T04:18:13.405 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2024-09-17T04:18:13.405 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2024-09-17T04:18:13.405 INFO:teuthology.orchestra.run.smithi088.stdout:max_xattr_size 65536 2024-09-17T04:18:13.405 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2024-09-17T04:18:13.405 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2024-09-17T04:18:13.405 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 0 2024-09-17T04:18:13.405 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:18:13.405 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 1 2024-09-17T04:18:13.405 INFO:teuthology.orchestra.run.smithi088.stdout:in 2024-09-17T04:18:13.405 INFO:teuthology.orchestra.run.smithi088.stdout:up {} 2024-09-17T04:18:13.406 INFO:teuthology.orchestra.run.smithi088.stdout:failed 2024-09-17T04:18:13.406 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2024-09-17T04:18:13.406 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2024-09-17T04:18:13.406 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2024-09-17T04:18:13.406 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2024-09-17T04:18:13.406 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data disabled 2024-09-17T04:18:13.406 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2024-09-17T04:18:13.406 INFO:teuthology.orchestra.run.smithi088.stdout:bal_rank_mask -1 2024-09-17T04:18:13.406 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 0 2024-09-17T04:18:13.406 INFO:teuthology.orchestra.run.smithi088.stdout:qdb_cluster leader: 0 members: 2024-09-17T04:18:13.406 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:18:13.406 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:18:13.407 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 2 2024-09-17T04:18:13.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:13.404+0000 7f970dd77640 1 -- 172.21.15.88:0/1965501829 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f96f006e2b0 msgr2=0x7f96f0070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:13.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:13.404+0000 7f970dd77640 1 --2- 172.21.15.88:0/1965501829 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f96f006e2b0 0x7f96f0070770 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9708104500 tx=0x7f96fc00b390 comp rx=0 tx=0).stop 2024-09-17T04:18:13.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:13.404+0000 7f970dd77640 1 -- 172.21.15.88:0/1965501829 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9708100860 msgr2=0x7f9708104780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:13.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:13.404+0000 7f970dd77640 1 --2- 172.21.15.88:0/1965501829 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9708100860 0x7f9708104780 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f96f8006010 tx=0x7f96f80045e0 comp rx=0 tx=0).stop 2024-09-17T04:18:13.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:13.405+0000 7f970dd77640 1 -- 172.21.15.88:0/1965501829 shutdown_connections 2024-09-17T04:18:13.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:13.405+0000 7f970dd77640 1 --2- 172.21.15.88:0/1965501829 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f96f006e2b0 0x7f96f0070770 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:13.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:13.405+0000 7f970dd77640 1 --2- 172.21.15.88:0/1965501829 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9708101a60 0x7f9708102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:13.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:13.405+0000 7f970dd77640 1 --2- 172.21.15.88:0/1965501829 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9708100860 0x7f9708104780 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:13.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:13.405+0000 7f970dd77640 1 -- 172.21.15.88:0/1965501829 >> 172.21.15.88:0/1965501829 conn(0x7f97080fc010 msgr2=0x7f970806a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:13.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:13.405+0000 7f970dd77640 1 -- 172.21.15.88:0/1965501829 shutdown_connections 2024-09-17T04:18:13.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:13.405+0000 7f970dd77640 1 -- 172.21.15.88:0/1965501829 wait complete. 2024-09-17T04:18:13.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:13 smithi088 ceph-mon[27811]: osdmap e44: 6 total, 6 up, 6 in 2024-09-17T04:18:13.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:13 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/1965501829' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T04:18:13.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:13 smithi134 ceph-mon[35201]: osdmap e44: 6 total, 6 up, 6 in 2024-09-17T04:18:13.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:13 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/1965501829' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T04:18:14.147 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T04:18:14.157 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi088.front.sepia.ceph.com 2024-09-17T04:18:14.158 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 1' 2024-09-17T04:18:14.448 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:18:14.569 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:14 smithi088 ceph-mon[27811]: pgmap v178: 65 pgs: 40 active+clean, 17 creating+peering, 8 unknown; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:18:14.570 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:14 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:14.570 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:14 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:14.570 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:14 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:14.570 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:14 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.ktuhce", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T04:18:14.570 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:14 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.ktuhce", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-17T04:18:14.570 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:14 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:18:14.874 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:14 smithi134 ceph-mon[35201]: pgmap v178: 65 pgs: 40 active+clean, 17 creating+peering, 8 unknown; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:18:14.874 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:14 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:14.874 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:14 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:14.874 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:14 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:14.874 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:14 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.ktuhce", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T04:18:14.875 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:14 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.ktuhce", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-17T04:18:14.875 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:14 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:18:14.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:14.972+0000 7fddf514e640 1 -- 172.21.15.88:0/702192969 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddf0100860 msgr2=0x7fddf0100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:14.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:14.972+0000 7fddf514e640 1 --2- 172.21.15.88:0/702192969 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddf0100860 0x7fddf0100c60 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fdde0009880 tx=0x7fdde002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:18:14.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:14.972+0000 7fddf514e640 1 -- 172.21.15.88:0/702192969 shutdown_connections 2024-09-17T04:18:14.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:14.972+0000 7fddf514e640 1 --2- 172.21.15.88:0/702192969 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddf0101a60 0x7fddf0101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:14.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:14.972+0000 7fddf514e640 1 --2- 172.21.15.88:0/702192969 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddf0100860 0x7fddf0100c60 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:14.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:14.972+0000 7fddf514e640 1 -- 172.21.15.88:0/702192969 >> 172.21.15.88:0/702192969 conn(0x7fddf00fc010 msgr2=0x7fddf00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:14.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:14.973+0000 7fddf514e640 1 -- 172.21.15.88:0/702192969 shutdown_connections 2024-09-17T04:18:14.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:14.973+0000 7fddf514e640 1 -- 172.21.15.88:0/702192969 wait complete. 2024-09-17T04:18:14.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:14.973+0000 7fddf514e640 1 Processor -- start 2024-09-17T04:18:14.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:14.973+0000 7fddf514e640 1 -- start start 2024-09-17T04:18:14.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:14.974+0000 7fddf514e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddf0100860 0x7fddf01963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:14.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:14.974+0000 7fddf514e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddf0101a60 0x7fddf0196910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:14.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:14.974+0000 7fddf514e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fddf01096a0 con 0x7fddf0100860 2024-09-17T04:18:14.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:14.974+0000 7fddf514e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fddf0109520 con 0x7fddf0101a60 2024-09-17T04:18:14.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:14.974+0000 7fddeed9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddf0100860 0x7fddf01963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:14.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:14.974+0000 7fddeed9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddf0100860 0x7fddf01963d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51370/0 (socket says 172.21.15.88:51370) 2024-09-17T04:18:14.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:14.974+0000 7fddeed9d640 1 -- 172.21.15.88:0/157026872 learned_addr learned my addr 172.21.15.88:0/157026872 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:18:14.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:14.974+0000 7fddee59c640 1 --2- 172.21.15.88:0/157026872 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddf0101a60 0x7fddf0196910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:14.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:14.974+0000 7fddeed9d640 1 -- 172.21.15.88:0/157026872 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddf0101a60 msgr2=0x7fddf0196910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:14.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:14.974+0000 7fddeed9d640 1 --2- 172.21.15.88:0/157026872 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddf0101a60 0x7fddf0196910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:14.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:14.974+0000 7fddeed9d640 1 -- 172.21.15.88:0/157026872 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddf0196f90 con 0x7fddf0100860 2024-09-17T04:18:14.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:14.974+0000 7fddeed9d640 1 --2- 172.21.15.88:0/157026872 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddf0100860 0x7fddf01963d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdde0006010 tx=0x7fdde00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:14.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:14.974+0000 7fddd7fff640 1 -- 172.21.15.88:0/157026872 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdde003f070 con 0x7fddf0100860 2024-09-17T04:18:14.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:14.974+0000 7fddf514e640 1 -- 172.21.15.88:0/157026872 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddf019b970 con 0x7fddf0100860 2024-09-17T04:18:14.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:14.974+0000 7fddd7fff640 1 -- 172.21.15.88:0/157026872 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdde00044d0 con 0x7fddf0100860 2024-09-17T04:18:14.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:14.974+0000 7fddd7fff640 1 -- 172.21.15.88:0/157026872 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdde0035030 con 0x7fddf0100860 2024-09-17T04:18:14.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:14.974+0000 7fddf514e640 1 -- 172.21.15.88:0/157026872 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddf019bf00 con 0x7fddf0100860 2024-09-17T04:18:14.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:14.975+0000 7fddf514e640 1 -- 172.21.15.88:0/157026872 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddf0100c60 con 0x7fddf0100860 2024-09-17T04:18:14.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:14.976+0000 7fddd7fff640 1 -- 172.21.15.88:0/157026872 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fdde0042070 con 0x7fddf0100860 2024-09-17T04:18:14.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:14.976+0000 7fddd7fff640 1 --2- 172.21.15.88:0/157026872 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fddd806e2b0 0x7fddd8070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:14.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:14.976+0000 7fddd7fff640 1 -- 172.21.15.88:0/157026872 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7fdde00aed70 con 0x7fddf0100860 2024-09-17T04:18:14.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:14.976+0000 7fddee59c640 1 --2- 172.21.15.88:0/157026872 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fddd806e2b0 0x7fddd8070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:14.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:14.977+0000 7fddee59c640 1 --2- 172.21.15.88:0/157026872 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fddd806e2b0 0x7fddd8070770 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fddf0197880 tx=0x7fdde400a250 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:14.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:14.981+0000 7fddd7fff640 1 -- 172.21.15.88:0/157026872 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdde0080380 con 0x7fddf0100860 2024-09-17T04:18:15.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:15.182+0000 7fddf514e640 1 -- 172.21.15.88:0/157026872 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) -- 0x7fddf002d7c0 con 0x7fddf0100860 2024-09-17T04:18:15.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:15.506+0000 7fddd7fff640 1 -- 172.21.15.88:0/157026872 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v5) ==== 105+0+0 (secure 0 0 0) 0x7fdde0084bb0 con 0x7fddf0100860 2024-09-17T04:18:15.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:15.508+0000 7fddf514e640 1 -- 172.21.15.88:0/157026872 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fddd806e2b0 msgr2=0x7fddd8070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:15.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:15.508+0000 7fddf514e640 1 --2- 172.21.15.88:0/157026872 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fddd806e2b0 0x7fddd8070770 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fddf0197880 tx=0x7fdde400a250 comp rx=0 tx=0).stop 2024-09-17T04:18:15.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:15.508+0000 7fddf514e640 1 -- 172.21.15.88:0/157026872 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddf0100860 msgr2=0x7fddf01963d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:15.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:15.508+0000 7fddf514e640 1 --2- 172.21.15.88:0/157026872 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddf0100860 0x7fddf01963d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdde0006010 tx=0x7fdde00048f0 comp rx=0 tx=0).stop 2024-09-17T04:18:15.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:15.508+0000 7fddf514e640 1 -- 172.21.15.88:0/157026872 shutdown_connections 2024-09-17T04:18:15.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:15.508+0000 7fddf514e640 1 --2- 172.21.15.88:0/157026872 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fddd806e2b0 0x7fddd8070770 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:15.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:15.508+0000 7fddf514e640 1 --2- 172.21.15.88:0/157026872 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddf0101a60 0x7fddf0196910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:15.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:15.508+0000 7fddf514e640 1 --2- 172.21.15.88:0/157026872 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddf0100860 0x7fddf01963d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:15.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:15.508+0000 7fddf514e640 1 -- 172.21.15.88:0/157026872 >> 172.21.15.88:0/157026872 conn(0x7fddf00fc010 msgr2=0x7fddf0104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:15.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:15.508+0000 7fddf514e640 1 -- 172.21.15.88:0/157026872 shutdown_connections 2024-09-17T04:18:15.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:15.509+0000 7fddf514e640 1 -- 172.21.15.88:0/157026872 wait complete. 2024-09-17T04:18:15.885 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:15 smithi088 ceph-mon[27811]: Deploying daemon mds.cephfs.smithi134.ktuhce on smithi134 2024-09-17T04:18:15.885 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:15 smithi088 ceph-mon[27811]: mds.? [v2:172.21.15.88:6826/2023184789,v1:172.21.15.88:6827/2023184789] up:boot 2024-09-17T04:18:15.885 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:15 smithi088 ceph-mon[27811]: daemon mds.cephfs.smithi088.lgavsv assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-17T04:18:15.885 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:15 smithi088 ceph-mon[27811]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-17T04:18:15.885 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:15 smithi088 ceph-mon[27811]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-17T04:18:15.885 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:15 smithi088 ceph-mon[27811]: Cluster is now healthy 2024-09-17T04:18:15.885 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:15 smithi088 ceph-mon[27811]: fsmap cephfs:0 1 up:standby 2024-09-17T04:18:15.886 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:15 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.lgavsv"}]: dispatch 2024-09-17T04:18:15.886 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:15 smithi088 ceph-mon[27811]: fsmap cephfs:1 {0=cephfs.smithi088.lgavsv=up:creating} 2024-09-17T04:18:15.886 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:15 smithi088 ceph-mon[27811]: daemon mds.cephfs.smithi088.lgavsv is now active in filesystem cephfs as rank 0 2024-09-17T04:18:15.886 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:15 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/157026872' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-17T04:18:15.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:15 smithi134 ceph-mon[35201]: Deploying daemon mds.cephfs.smithi134.ktuhce on smithi134 2024-09-17T04:18:15.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:15 smithi134 ceph-mon[35201]: mds.? [v2:172.21.15.88:6826/2023184789,v1:172.21.15.88:6827/2023184789] up:boot 2024-09-17T04:18:15.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:15 smithi134 ceph-mon[35201]: daemon mds.cephfs.smithi088.lgavsv assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-17T04:18:15.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:15 smithi134 ceph-mon[35201]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-17T04:18:15.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:15 smithi134 ceph-mon[35201]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-17T04:18:15.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:15 smithi134 ceph-mon[35201]: Cluster is now healthy 2024-09-17T04:18:15.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:15 smithi134 ceph-mon[35201]: fsmap cephfs:0 1 up:standby 2024-09-17T04:18:15.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:15 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.lgavsv"}]: dispatch 2024-09-17T04:18:15.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:15 smithi134 ceph-mon[35201]: fsmap cephfs:1 {0=cephfs.smithi088.lgavsv=up:creating} 2024-09-17T04:18:15.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:15 smithi134 ceph-mon[35201]: daemon mds.cephfs.smithi088.lgavsv is now active in filesystem cephfs as rank 0 2024-09-17T04:18:15.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:15 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/157026872' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-17T04:18:16.315 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T04:18:16.324 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi088.front.sepia.ceph.com 2024-09-17T04:18:16.325 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay true' 2024-09-17T04:18:16.579 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:18:16.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:16 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/157026872' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-17T04:18:16.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:16 smithi088 ceph-mon[27811]: mds.? [v2:172.21.15.88:6826/2023184789,v1:172.21.15.88:6827/2023184789] up:active 2024-09-17T04:18:16.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:16 smithi088 ceph-mon[27811]: fsmap cephfs:1 {0=cephfs.smithi088.lgavsv=up:active} 2024-09-17T04:18:16.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:16 smithi088 ceph-mon[27811]: pgmap v179: 65 pgs: 53 active+clean, 12 creating+peering; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:18:16.772 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:16 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/157026872' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-17T04:18:16.772 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:16 smithi134 ceph-mon[35201]: mds.? [v2:172.21.15.88:6826/2023184789,v1:172.21.15.88:6827/2023184789] up:active 2024-09-17T04:18:16.773 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:16 smithi134 ceph-mon[35201]: fsmap cephfs:1 {0=cephfs.smithi088.lgavsv=up:active} 2024-09-17T04:18:16.773 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:16 smithi134 ceph-mon[35201]: pgmap v179: 65 pgs: 53 active+clean, 12 creating+peering; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:18:17.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:17.067+0000 7f5f74e6b640 1 -- 172.21.15.88:0/1406908243 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f70101a80 msgr2=0x7f5f70101f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:17.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:17.067+0000 7f5f74e6b640 1 --2- 172.21.15.88:0/1406908243 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f70101a80 0x7f5f70101f00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5f58009880 tx=0x7f5f5802a4a0 comp rx=0 tx=0).stop 2024-09-17T04:18:17.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:17.067+0000 7f5f74e6b640 1 -- 172.21.15.88:0/1406908243 shutdown_connections 2024-09-17T04:18:17.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:17.067+0000 7f5f74e6b640 1 --2- 172.21.15.88:0/1406908243 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f70101a80 0x7f5f70101f00 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:17.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:17.067+0000 7f5f74e6b640 1 --2- 172.21.15.88:0/1406908243 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f70100880 0x7f5f70100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:17.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:17.067+0000 7f5f74e6b640 1 -- 172.21.15.88:0/1406908243 >> 172.21.15.88:0/1406908243 conn(0x7f5f700fc010 msgr2=0x7f5f700fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:17.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:17.067+0000 7f5f74e6b640 1 -- 172.21.15.88:0/1406908243 shutdown_connections 2024-09-17T04:18:17.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:17.067+0000 7f5f74e6b640 1 -- 172.21.15.88:0/1406908243 wait complete. 2024-09-17T04:18:17.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:17.068+0000 7f5f74e6b640 1 Processor -- start 2024-09-17T04:18:17.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:17.068+0000 7f5f74e6b640 1 -- start start 2024-09-17T04:18:17.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:17.068+0000 7f5f74e6b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f70100880 0x7f5f70196400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:17.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:17.068+0000 7f5f74e6b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f70101a80 0x7f5f70196940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:17.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:17.068+0000 7f5f74e6b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f5f701096a0 con 0x7f5f70100880 2024-09-17T04:18:17.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:17.068+0000 7f5f74e6b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5f70109520 con 0x7f5f70101a80 2024-09-17T04:18:17.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:17.069+0000 7f5f6e59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f70100880 0x7f5f70196400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:17.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:17.069+0000 7f5f6e59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f70100880 0x7f5f70196400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51386/0 (socket says 172.21.15.88:51386) 2024-09-17T04:18:17.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:17.069+0000 7f5f6e59c640 1 -- 172.21.15.88:0/3639576515 learned_addr learned my addr 172.21.15.88:0/3639576515 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:18:17.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:17.069+0000 7f5f67fff640 1 --2- 172.21.15.88:0/3639576515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f70101a80 0x7f5f70196940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:17.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:17.069+0000 7f5f6e59c640 1 -- 172.21.15.88:0/3639576515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f70101a80 msgr2=0x7f5f70196940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:17.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:17.069+0000 7f5f6e59c640 1 --2- 172.21.15.88:0/3639576515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f70101a80 0x7f5f70196940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:17.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:17.069+0000 7f5f6e59c640 1 -- 172.21.15.88:0/3639576515 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f70196fc0 con 0x7f5f70100880 2024-09-17T04:18:17.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:17.069+0000 7f5f67fff640 1 --2- 172.21.15.88:0/3639576515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f70101a80 0x7f5f70196940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:18:17.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:17.069+0000 7f5f6e59c640 1 --2- 172.21.15.88:0/3639576515 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f70100880 0x7f5f70196400 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5f6000d6f0 tx=0x7f5f6000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:17.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:17.069+0000 7f5f677fe640 1 -- 172.21.15.88:0/3639576515 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5f60017070 con 0x7f5f70100880 2024-09-17T04:18:17.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:17.069+0000 7f5f74e6b640 1 -- 172.21.15.88:0/3639576515 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f7019ba00 con 0x7f5f70100880 2024-09-17T04:18:17.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:17.069+0000 7f5f677fe640 1 -- 172.21.15.88:0/3639576515 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5f6000de00 con 0x7f5f70100880 2024-09-17T04:18:17.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:17.069+0000 7f5f677fe640 1 -- 172.21.15.88:0/3639576515 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5f60003bc0 con 0x7f5f70100880 2024-09-17T04:18:17.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:17.069+0000 7f5f74e6b640 1 -- 172.21.15.88:0/3639576515 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f7019bf90 con 0x7f5f70100880 2024-09-17T04:18:17.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:17.070+0000 7f5f74e6b640 1 -- 172.21.15.88:0/3639576515 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f70100c80 con 0x7f5f70100880 2024-09-17T04:18:17.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:17.071+0000 7f5f677fe640 1 -- 172.21.15.88:0/3639576515 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f5f60003e70 con 0x7f5f70100880 2024-09-17T04:18:17.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:17.071+0000 7f5f677fe640 1 --2- 172.21.15.88:0/3639576515 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f5f5c06e2b0 0x7f5f5c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:17.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:17.071+0000 7f5f677fe640 1 -- 172.21.15.88:0/3639576515 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7f5f6008dd30 con 0x7f5f70100880 2024-09-17T04:18:17.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:17.072+0000 7f5f67fff640 1 --2- 172.21.15.88:0/3639576515 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f5f5c06e2b0 0x7f5f5c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:17.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:17.072+0000 7f5f67fff640 1 --2- 172.21.15.88:0/3639576515 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f5f5c06e2b0 0x7f5f5c070770 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5f701978b0 tx=0x7f5f58005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:17.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:17.076+0000 7f5f677fe640 1 -- 172.21.15.88:0/3639576515 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5f6005b690 con 0x7f5f70100880 2024-09-17T04:18:17.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:17.289+0000 7f5f74e6b640 1 -- 172.21.15.88:0/3639576515 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f5f701904b0 con 0x7f5f70100880 2024-09-17T04:18:17.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:17.512+0000 7f5f677fe640 1 -- 172.21.15.88:0/3639576515 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v6) ==== 121+0+0 (secure 0 0 0) 0x7f5f6005f340 con 0x7f5f70100880 2024-09-17T04:18:17.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:17.514+0000 7f5f74e6b640 1 -- 172.21.15.88:0/3639576515 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f5f5c06e2b0 msgr2=0x7f5f5c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:17.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:17.514+0000 7f5f74e6b640 1 --2- 172.21.15.88:0/3639576515 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f5f5c06e2b0 0x7f5f5c070770 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5f701978b0 tx=0x7f5f58005a20 comp rx=0 tx=0).stop 2024-09-17T04:18:17.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:17.514+0000 7f5f74e6b640 1 -- 172.21.15.88:0/3639576515 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f70100880 msgr2=0x7f5f70196400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:17.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:17.514+0000 7f5f74e6b640 1 --2- 172.21.15.88:0/3639576515 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f70100880 0x7f5f70196400 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5f6000d6f0 tx=0x7f5f6000dbb0 comp rx=0 tx=0).stop 2024-09-17T04:18:17.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:17.514+0000 7f5f74e6b640 1 -- 172.21.15.88:0/3639576515 shutdown_connections 2024-09-17T04:18:17.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:17.514+0000 7f5f74e6b640 1 --2- 172.21.15.88:0/3639576515 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f5f5c06e2b0 0x7f5f5c070770 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:17.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:17.514+0000 7f5f74e6b640 1 --2- 172.21.15.88:0/3639576515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f70101a80 0x7f5f70196940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:17.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:17.514+0000 7f5f74e6b640 1 --2- 172.21.15.88:0/3639576515 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f70100880 0x7f5f70196400 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:17.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:17.514+0000 7f5f74e6b640 1 -- 172.21.15.88:0/3639576515 >> 172.21.15.88:0/3639576515 conn(0x7f5f700fc010 msgr2=0x7f5f70104f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:17.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:17.515+0000 7f5f74e6b640 1 -- 172.21.15.88:0/3639576515 shutdown_connections 2024-09-17T04:18:17.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:17.515+0000 7f5f74e6b640 1 -- 172.21.15.88:0/3639576515 wait complete. 2024-09-17T04:18:18.136 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:18 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:18.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:18 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:18.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:18 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:18.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:18 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi088.giqrgt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T04:18:18.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:18 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi088.giqrgt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-17T04:18:18.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:18 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:18:18.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:18 smithi088 ceph-mon[27811]: Deploying daemon mds.cephfs.smithi088.giqrgt on smithi088 2024-09-17T04:18:18.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:18 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/3639576515' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-17T04:18:18.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:18 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/3639576515' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-17T04:18:18.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:18 smithi088 ceph-mon[27811]: mds.? [v2:172.21.15.134:6824/3383516639,v1:172.21.15.134:6825/3383516639] up:boot 2024-09-17T04:18:18.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:18 smithi088 ceph-mon[27811]: fsmap cephfs:1 {0=cephfs.smithi088.lgavsv=up:active} 1 up:standby 2024-09-17T04:18:18.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:18 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.ktuhce"}]: dispatch 2024-09-17T04:18:18.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:18 smithi088 ceph-mon[27811]: fsmap cephfs:1 {0=cephfs.smithi088.lgavsv=up:active} 1 up:standby-replay 2024-09-17T04:18:18.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:18 smithi088 ceph-mon[27811]: pgmap v180: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-17T04:18:18.165 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T04:18:18.174 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi088.front.sepia.ceph.com 2024-09-17T04:18:18.174 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data true --yes-i-really-really-mean-it' 2024-09-17T04:18:18.364 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:18 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:18.364 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:18 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:18.364 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:18 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:18.364 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:18 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi088.giqrgt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T04:18:18.364 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:18 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi088.giqrgt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-17T04:18:18.365 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:18 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:18:18.365 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:18 smithi134 ceph-mon[35201]: Deploying daemon mds.cephfs.smithi088.giqrgt on smithi088 2024-09-17T04:18:18.365 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:18 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/3639576515' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-17T04:18:18.365 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:18 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/3639576515' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-17T04:18:18.365 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:18 smithi134 ceph-mon[35201]: mds.? [v2:172.21.15.134:6824/3383516639,v1:172.21.15.134:6825/3383516639] up:boot 2024-09-17T04:18:18.365 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:18 smithi134 ceph-mon[35201]: fsmap cephfs:1 {0=cephfs.smithi088.lgavsv=up:active} 1 up:standby 2024-09-17T04:18:18.365 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:18 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.ktuhce"}]: dispatch 2024-09-17T04:18:18.365 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:18 smithi134 ceph-mon[35201]: fsmap cephfs:1 {0=cephfs.smithi088.lgavsv=up:active} 1 up:standby-replay 2024-09-17T04:18:18.365 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:18 smithi134 ceph-mon[35201]: pgmap v180: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-17T04:18:19.166 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:18:19.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:19.829+0000 7fd0c6eb7640 1 -- 172.21.15.88:0/4185529799 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0c0100860 msgr2=0x7fd0c0100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:19.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:19.829+0000 7fd0c6eb7640 1 --2- 172.21.15.88:0/4185529799 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0c0100860 0x7fd0c0100c60 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4009880 tx=0x7fd0b402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:18:19.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:19.829+0000 7fd0c6eb7640 1 -- 172.21.15.88:0/4185529799 shutdown_connections 2024-09-17T04:18:19.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:19.829+0000 7fd0c6eb7640 1 --2- 172.21.15.88:0/4185529799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0c0101a60 0x7fd0c0101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:19.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:19.829+0000 7fd0c6eb7640 1 --2- 172.21.15.88:0/4185529799 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0c0100860 0x7fd0c0100c60 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:19.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:19.829+0000 7fd0c6eb7640 1 -- 172.21.15.88:0/4185529799 >> 172.21.15.88:0/4185529799 conn(0x7fd0c00fc010 msgr2=0x7fd0c00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:19.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:19.829+0000 7fd0c6eb7640 1 -- 172.21.15.88:0/4185529799 shutdown_connections 2024-09-17T04:18:19.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:19.829+0000 7fd0c6eb7640 1 -- 172.21.15.88:0/4185529799 wait complete. 2024-09-17T04:18:19.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:19.829+0000 7fd0c6eb7640 1 Processor -- start 2024-09-17T04:18:19.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:19.830+0000 7fd0c6eb7640 1 -- start start 2024-09-17T04:18:19.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:19.830+0000 7fd0c6eb7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0c0100860 0x7fd0c0197590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:19.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:19.830+0000 7fd0c6eb7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0c0101a60 0x7fd0c0197ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:19.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:19.830+0000 7fd0c6eb7640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c01096a0 con 0x7fd0c0100860 2024-09-17T04:18:19.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:19.830+0000 7fd0c6eb7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c0109520 con 0x7fd0c0101a60 2024-09-17T04:18:19.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:19.830+0000 7fd0c4c53640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0c0100860 0x7fd0c0197590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:19.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:19.830+0000 7fd0c4c53640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0c0100860 0x7fd0c0197590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51406/0 (socket says 172.21.15.88:51406) 2024-09-17T04:18:19.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:19.830+0000 7fd0c4c53640 1 -- 172.21.15.88:0/2283831035 learned_addr learned my addr 172.21.15.88:0/2283831035 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:18:19.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:19.830+0000 7fd0bffff640 1 --2- 172.21.15.88:0/2283831035 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0c0101a60 0x7fd0c0197ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:19.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:19.830+0000 7fd0c4c53640 1 -- 172.21.15.88:0/2283831035 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0c0101a60 msgr2=0x7fd0c0197ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:19.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:19.830+0000 7fd0c4c53640 1 --2- 172.21.15.88:0/2283831035 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0c0101a60 0x7fd0c0197ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:19.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:19.830+0000 7fd0c4c53640 1 -- 172.21.15.88:0/2283831035 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0c0198150 con 0x7fd0c0100860 2024-09-17T04:18:19.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:19.830+0000 7fd0c4c53640 1 --2- 172.21.15.88:0/2283831035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0c0100860 0x7fd0c0197590 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4006010 tx=0x7fd0b40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:19.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:19.830+0000 7fd0bdffb640 1 -- 172.21.15.88:0/2283831035 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd0b403f070 con 0x7fd0c0100860 2024-09-17T04:18:19.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:19.830+0000 7fd0c6eb7640 1 -- 172.21.15.88:0/2283831035 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0c019cae0 con 0x7fd0c0100860 2024-09-17T04:18:19.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:19.830+0000 7fd0bdffb640 1 -- 172.21.15.88:0/2283831035 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd0b4004a50 con 0x7fd0c0100860 2024-09-17T04:18:19.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:19.830+0000 7fd0bdffb640 1 -- 172.21.15.88:0/2283831035 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd0b4035030 con 0x7fd0c0100860 2024-09-17T04:18:19.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:19.831+0000 7fd0c6eb7640 1 -- 172.21.15.88:0/2283831035 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0c019d070 con 0x7fd0c0100860 2024-09-17T04:18:19.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:19.832+0000 7fd0c6eb7640 1 -- 172.21.15.88:0/2283831035 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0c0100c60 con 0x7fd0c0100860 2024-09-17T04:18:19.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:19.832+0000 7fd0bdffb640 1 -- 172.21.15.88:0/2283831035 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fd0b4042070 con 0x7fd0c0100860 2024-09-17T04:18:19.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:19.833+0000 7fd0bdffb640 1 --2- 172.21.15.88:0/2283831035 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fd0b006e2b0 0x7fd0b0070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:19.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:19.833+0000 7fd0bffff640 1 --2- 172.21.15.88:0/2283831035 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fd0b006e2b0 0x7fd0b0070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:19.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:19.833+0000 7fd0bdffb640 1 -- 172.21.15.88:0/2283831035 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7fd0b40aec70 con 0x7fd0c0100860 2024-09-17T04:18:19.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:19.833+0000 7fd0bffff640 1 --2- 172.21.15.88:0/2283831035 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fd0b006e2b0 0x7fd0b0070770 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd0c01989f0 tx=0x7fd0ac00b390 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:19.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:19.837+0000 7fd0bdffb640 1 -- 172.21.15.88:0/2283831035 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd0b4004c00 con 0x7fd0c0100860 2024-09-17T04:18:20.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:20.050+0000 7fd0c6eb7640 1 -- 172.21.15.88:0/2283831035 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd0c019d2a0 con 0x7fd0c0100860 2024-09-17T04:18:20.855 INFO:teuthology.orchestra.run.smithi088.stderr:inline data enabled 2024-09-17T04:18:20.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:20.853+0000 7fd0bdffb640 1 -- 172.21.15.88:0/2283831035 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]=0 inline data enabled v8) ==== 168+0+0 (secure 0 0 0) 0x7fd0b4080280 con 0x7fd0c0100860 2024-09-17T04:18:20.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:20.855+0000 7fd0c6eb7640 1 -- 172.21.15.88:0/2283831035 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fd0b006e2b0 msgr2=0x7fd0b0070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:20.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:20.855+0000 7fd0c6eb7640 1 --2- 172.21.15.88:0/2283831035 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fd0b006e2b0 0x7fd0b0070770 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd0c01989f0 tx=0x7fd0ac00b390 comp rx=0 tx=0).stop 2024-09-17T04:18:20.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:20.855+0000 7fd0c6eb7640 1 -- 172.21.15.88:0/2283831035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0c0100860 msgr2=0x7fd0c0197590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:20.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:20.855+0000 7fd0c6eb7640 1 --2- 172.21.15.88:0/2283831035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0c0100860 0x7fd0c0197590 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4006010 tx=0x7fd0b40045e0 comp rx=0 tx=0).stop 2024-09-17T04:18:20.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:20.856+0000 7fd0c6eb7640 1 -- 172.21.15.88:0/2283831035 shutdown_connections 2024-09-17T04:18:20.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:20.856+0000 7fd0c6eb7640 1 --2- 172.21.15.88:0/2283831035 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fd0b006e2b0 0x7fd0b0070770 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:20.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:20.856+0000 7fd0c6eb7640 1 --2- 172.21.15.88:0/2283831035 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0c0101a60 0x7fd0c0197ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:20.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:20.856+0000 7fd0c6eb7640 1 --2- 172.21.15.88:0/2283831035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0c0100860 0x7fd0c0197590 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:20.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:20.856+0000 7fd0c6eb7640 1 -- 172.21.15.88:0/2283831035 >> 172.21.15.88:0/2283831035 conn(0x7fd0c00fc010 msgr2=0x7fd0c006a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:20.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:20.856+0000 7fd0c6eb7640 1 -- 172.21.15.88:0/2283831035 shutdown_connections 2024-09-17T04:18:20.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:20.856+0000 7fd0c6eb7640 1 -- 172.21.15.88:0/2283831035 wait complete. 2024-09-17T04:18:21.121 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:20 smithi134 ceph-mon[35201]: pgmap v181: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 123 B/s rd, 1.7 KiB/s wr, 5 op/s 2024-09-17T04:18:21.121 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:20 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/2283831035' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-17T04:18:21.121 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:20 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:21.121 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:20 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:21.121 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:20 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:21.121 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:20 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.psnynp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T04:18:21.121 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:20 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.psnynp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-17T04:18:21.121 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:20 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:18:21.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:20 smithi088 ceph-mon[27811]: pgmap v181: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 123 B/s rd, 1.7 KiB/s wr, 5 op/s 2024-09-17T04:18:21.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:20 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/2283831035' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-17T04:18:21.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:20 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:21.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:20 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:21.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:20 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:21.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:20 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.psnynp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T04:18:21.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:20 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.psnynp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-17T04:18:21.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:20 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:18:21.455 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T04:18:21.465 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi088.front.sepia.ceph.com 2024-09-17T04:18:21.465 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-17T04:18:21.716 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:18:21.913 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:21 smithi134 ceph-mon[35201]: Deploying daemon mds.cephfs.smithi134.psnynp on smithi134 2024-09-17T04:18:21.914 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:21 smithi134 ceph-mon[35201]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-09-17T04:18:21.914 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:21 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/2283831035' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-09-17T04:18:21.914 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:21 smithi134 ceph-mon[35201]: mds.? [v2:172.21.15.88:6828/1714846518,v1:172.21.15.88:6829/1714846518] up:boot 2024-09-17T04:18:21.914 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:21 smithi134 ceph-mon[35201]: fsmap cephfs:1 {0=cephfs.smithi088.lgavsv=up:active} 1 up:standby-replay 1 up:standby 2024-09-17T04:18:21.914 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:21 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.giqrgt"}]: dispatch 2024-09-17T04:18:21.914 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:21 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:21.914 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:21 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:18:21.914 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:21 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:22.114 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:21 smithi088 ceph-mon[27811]: Deploying daemon mds.cephfs.smithi134.psnynp on smithi134 2024-09-17T04:18:22.114 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:21 smithi088 ceph-mon[27811]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-09-17T04:18:22.114 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:21 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/2283831035' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-09-17T04:18:22.114 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:21 smithi088 ceph-mon[27811]: mds.? [v2:172.21.15.88:6828/1714846518,v1:172.21.15.88:6829/1714846518] up:boot 2024-09-17T04:18:22.114 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:21 smithi088 ceph-mon[27811]: fsmap cephfs:1 {0=cephfs.smithi088.lgavsv=up:active} 1 up:standby-replay 1 up:standby 2024-09-17T04:18:22.114 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:21 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.giqrgt"}]: dispatch 2024-09-17T04:18:22.114 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:21 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:22.114 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:21 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:18:22.115 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:21 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:22.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:22.195+0000 7f44a9260640 1 -- 172.21.15.88:0/1023915569 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44a4100860 msgr2=0x7f44a4100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:22.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:22.195+0000 7f44a9260640 1 --2- 172.21.15.88:0/1023915569 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44a4100860 0x7f44a4100c60 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4494009c20 tx=0x7f449402a970 comp rx=0 tx=0).stop 2024-09-17T04:18:22.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:22.195+0000 7f44a9260640 1 -- 172.21.15.88:0/1023915569 shutdown_connections 2024-09-17T04:18:22.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:22.195+0000 7f44a9260640 1 --2- 172.21.15.88:0/1023915569 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44a4101a60 0x7f44a4101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:22.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:22.195+0000 7f44a9260640 1 --2- 172.21.15.88:0/1023915569 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44a4100860 0x7f44a4100c60 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:22.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:22.195+0000 7f44a9260640 1 -- 172.21.15.88:0/1023915569 >> 172.21.15.88:0/1023915569 conn(0x7f44a40fc010 msgr2=0x7f44a40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:22.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:22.195+0000 7f44a9260640 1 -- 172.21.15.88:0/1023915569 shutdown_connections 2024-09-17T04:18:22.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:22.195+0000 7f44a9260640 1 -- 172.21.15.88:0/1023915569 wait complete. 2024-09-17T04:18:22.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:22.196+0000 7f44a9260640 1 Processor -- start 2024-09-17T04:18:22.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:22.196+0000 7f44a9260640 1 -- start start 2024-09-17T04:18:22.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:22.196+0000 7f44a9260640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44a4100860 0x7f44a4104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:22.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:22.196+0000 7f44a9260640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44a4101a60 0x7f44a4102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:22.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:22.196+0000 7f44a9260640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f44a4109680 con 0x7f44a4101a60 2024-09-17T04:18:22.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:22.196+0000 7f44a9260640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f44a4109500 con 0x7f44a4100860 2024-09-17T04:18:22.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:22.197+0000 7f44a259c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44a4101a60 0x7f44a4102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:22.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:22.197+0000 7f44a259c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44a4101a60 0x7f44a4102e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51428/0 (socket says 172.21.15.88:51428) 2024-09-17T04:18:22.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:22.197+0000 7f44a259c640 1 -- 172.21.15.88:0/3991533342 learned_addr learned my addr 172.21.15.88:0/3991533342 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:18:22.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:22.197+0000 7f44a2d9d640 1 --2- 172.21.15.88:0/3991533342 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44a4100860 0x7f44a4104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:22.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:22.197+0000 7f44a259c640 1 -- 172.21.15.88:0/3991533342 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44a4100860 msgr2=0x7f44a4104780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:22.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:22.197+0000 7f44a259c640 1 --2- 172.21.15.88:0/3991533342 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44a4100860 0x7f44a4104780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:22.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:22.197+0000 7f44a259c640 1 -- 172.21.15.88:0/3991533342 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44a4103380 con 0x7f44a4101a60 2024-09-17T04:18:22.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:22.197+0000 7f44a259c640 1 --2- 172.21.15.88:0/3991533342 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44a4101a60 0x7f44a4102e40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f449800c810 tx=0x7f449800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:22.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:22.197+0000 7f448bfff640 1 -- 172.21.15.88:0/3991533342 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4498004020 con 0x7f44a4101a60 2024-09-17T04:18:22.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:22.197+0000 7f44a9260640 1 -- 172.21.15.88:0/3991533342 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44a4103670 con 0x7f44a4101a60 2024-09-17T04:18:22.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:22.197+0000 7f448bfff640 1 -- 172.21.15.88:0/3991533342 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f44980041c0 con 0x7f44a4101a60 2024-09-17T04:18:22.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:22.197+0000 7f448bfff640 1 -- 172.21.15.88:0/3991533342 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f44980047a0 con 0x7f44a4101a60 2024-09-17T04:18:22.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:22.197+0000 7f44a9260640 1 -- 172.21.15.88:0/3991533342 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44a4103c80 con 0x7f44a4101a60 2024-09-17T04:18:22.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:22.198+0000 7f44a9260640 1 -- 172.21.15.88:0/3991533342 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44a4100c60 con 0x7f44a4101a60 2024-09-17T04:18:22.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:22.199+0000 7f448bfff640 1 -- 172.21.15.88:0/3991533342 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f44980079b0 con 0x7f44a4101a60 2024-09-17T04:18:22.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:22.199+0000 7f448bfff640 1 --2- 172.21.15.88:0/3991533342 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f448c06e2b0 0x7f448c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:22.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:22.199+0000 7f448bfff640 1 -- 172.21.15.88:0/3991533342 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7f449808df80 con 0x7f44a4101a60 2024-09-17T04:18:22.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:22.199+0000 7f44a2d9d640 1 --2- 172.21.15.88:0/3991533342 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f448c06e2b0 0x7f448c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:22.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:22.200+0000 7f44a2d9d640 1 --2- 172.21.15.88:0/3991533342 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f448c06e2b0 0x7f448c070770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4494000f80 tx=0x7f449403c040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:22.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:22.204+0000 7f448bfff640 1 -- 172.21.15.88:0/3991533342 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4498014030 con 0x7f44a4101a60 2024-09-17T04:18:22.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:22.407+0000 7f44a9260640 1 -- 172.21.15.88:0/3991533342 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f44a419f5c0 con 0x7f44a4101a60 2024-09-17T04:18:22.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:22.407+0000 7f448bfff640 1 -- 172.21.15.88:0/3991533342 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 8 v8) ==== 75+0+1826 (secure 0 0 0) 0x7f449805f590 con 0x7f44a4101a60 2024-09-17T04:18:22.408 INFO:teuthology.orchestra.run.smithi088.stdout:e8 2024-09-17T04:18:22.408 INFO:teuthology.orchestra.run.smithi088.stdout:btime 2024-09-17T04:18:20:853465+0000 2024-09-17T04:18:22.408 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T04:18:22.408 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:18:22.408 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2024-09-17T04:18:22.408 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:18:22.409 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2024-09-17T04:18:22.409 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2024-09-17T04:18:22.409 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 8 2024-09-17T04:18:22.409 INFO:teuthology.orchestra.run.smithi088.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T04:18:22.409 INFO:teuthology.orchestra.run.smithi088.stdout:created 2024-09-17T04:18:10.480573+0000 2024-09-17T04:18:22.409 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2024-09-17T04:18:20.052324+0000 2024-09-17T04:18:22.409 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2024-09-17T04:18:22.409 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2024-09-17T04:18:22.409 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2024-09-17T04:18:22.409 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2024-09-17T04:18:22.409 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2024-09-17T04:18:22.409 INFO:teuthology.orchestra.run.smithi088.stdout:max_xattr_size 65536 2024-09-17T04:18:22.410 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2024-09-17T04:18:22.410 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2024-09-17T04:18:22.410 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 0 2024-09-17T04:18:22.410 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:18:22.410 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 1 2024-09-17T04:18:22.410 INFO:teuthology.orchestra.run.smithi088.stdout:in 0 2024-09-17T04:18:22.410 INFO:teuthology.orchestra.run.smithi088.stdout:up {0=14572} 2024-09-17T04:18:22.410 INFO:teuthology.orchestra.run.smithi088.stdout:failed 2024-09-17T04:18:22.410 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2024-09-17T04:18:22.410 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2024-09-17T04:18:22.410 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2024-09-17T04:18:22.410 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2024-09-17T04:18:22.410 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data enabled 2024-09-17T04:18:22.410 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2024-09-17T04:18:22.410 INFO:teuthology.orchestra.run.smithi088.stdout:bal_rank_mask -1 2024-09-17T04:18:22.411 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 1 2024-09-17T04:18:22.411 INFO:teuthology.orchestra.run.smithi088.stdout:qdb_cluster leader: 14572 members: 14572 2024-09-17T04:18:22.411 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.lgavsv{0:14572} state up:active seq 2 addr [v2:172.21.15.88:6826/2023184789,v1:172.21.15.88:6827/2023184789] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:18:22.411 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi134.ktuhce{0:24307} state up:standby-replay seq 1 addr [v2:172.21.15.134:6824/3383516639,v1:172.21.15.134:6825/3383516639] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:18:22.411 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:18:22.411 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:18:22.411 INFO:teuthology.orchestra.run.smithi088.stdout:Standby daemons: 2024-09-17T04:18:22.411 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:18:22.411 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.giqrgt{-1:14590} state up:standby seq 1 addr [v2:172.21.15.88:6828/1714846518,v1:172.21.15.88:6829/1714846518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:18:22.412 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 8 2024-09-17T04:18:22.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:22.409+0000 7f44a9260640 1 -- 172.21.15.88:0/3991533342 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f448c06e2b0 msgr2=0x7f448c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:22.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:22.409+0000 7f44a9260640 1 --2- 172.21.15.88:0/3991533342 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f448c06e2b0 0x7f448c070770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4494000f80 tx=0x7f449403c040 comp rx=0 tx=0).stop 2024-09-17T04:18:22.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:22.409+0000 7f44a9260640 1 -- 172.21.15.88:0/3991533342 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44a4101a60 msgr2=0x7f44a4102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:22.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:22.409+0000 7f44a9260640 1 --2- 172.21.15.88:0/3991533342 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44a4101a60 0x7f44a4102e40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f449800c810 tx=0x7f449800ccd0 comp rx=0 tx=0).stop 2024-09-17T04:18:22.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:22.409+0000 7f44a9260640 1 -- 172.21.15.88:0/3991533342 shutdown_connections 2024-09-17T04:18:22.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:22.409+0000 7f44a9260640 1 --2- 172.21.15.88:0/3991533342 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f448c06e2b0 0x7f448c070770 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:22.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:22.409+0000 7f44a9260640 1 --2- 172.21.15.88:0/3991533342 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44a4101a60 0x7f44a4102e40 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:22.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:22.409+0000 7f44a9260640 1 --2- 172.21.15.88:0/3991533342 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44a4100860 0x7f44a4104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:22.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:22.409+0000 7f44a9260640 1 -- 172.21.15.88:0/3991533342 >> 172.21.15.88:0/3991533342 conn(0x7f44a40fc010 msgr2=0x7f44a4069ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:22.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:22.410+0000 7f44a9260640 1 -- 172.21.15.88:0/3991533342 shutdown_connections 2024-09-17T04:18:22.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:22.410+0000 7f44a9260640 1 -- 172.21.15.88:0/3991533342 wait complete. 2024-09-17T04:18:22.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:22 smithi134 ceph-mon[35201]: pgmap v182: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-17T04:18:22.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:22 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/3991533342' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T04:18:23.029 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-09-17T04:18:23.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:22 smithi088 ceph-mon[27811]: pgmap v182: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-17T04:18:23.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:22 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/3991533342' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T04:18:23.307 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:18:23.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:23.826+0000 7fb6a6645640 1 -- 172.21.15.88:0/2194457920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6a0102b60 msgr2=0x7fb6a0102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:23.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:23.826+0000 7fb6a6645640 1 --2- 172.21.15.88:0/2194457920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6a0102b60 0x7fb6a0102fe0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb694009880 tx=0x7fb69402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:18:23.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:23.826+0000 7fb6a6645640 1 -- 172.21.15.88:0/2194457920 shutdown_connections 2024-09-17T04:18:23.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:23.826+0000 7fb6a6645640 1 --2- 172.21.15.88:0/2194457920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6a0102b60 0x7fb6a0102fe0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:23.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:23.826+0000 7fb6a6645640 1 --2- 172.21.15.88:0/2194457920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6a0101960 0x7fb6a0101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:23.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:23.826+0000 7fb6a6645640 1 -- 172.21.15.88:0/2194457920 >> 172.21.15.88:0/2194457920 conn(0x7fb6a00fd0f0 msgr2=0x7fb6a00ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:23.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:23.826+0000 7fb6a6645640 1 -- 172.21.15.88:0/2194457920 shutdown_connections 2024-09-17T04:18:23.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:23.826+0000 7fb6a6645640 1 -- 172.21.15.88:0/2194457920 wait complete. 2024-09-17T04:18:23.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:23.827+0000 7fb6a6645640 1 Processor -- start 2024-09-17T04:18:23.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:23.827+0000 7fb6a6645640 1 -- start start 2024-09-17T04:18:23.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:23.827+0000 7fb6a6645640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6a0101960 0x7fb6a0075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:23.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:23.827+0000 7fb6a6645640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6a0102b60 0x7fb6a00745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:23.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:23.827+0000 7fb6a6645640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fb6a010a780 con 0x7fb6a0101960 2024-09-17T04:18:23.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:23.827+0000 7fb6a6645640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb6a010a600 con 0x7fb6a0102b60 2024-09-17T04:18:23.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:23.827+0000 7fb69ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6a0101960 0x7fb6a0075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:23.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:23.827+0000 7fb69ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6a0101960 0x7fb6a0075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47628/0 (socket says 172.21.15.88:47628) 2024-09-17T04:18:23.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:23.827+0000 7fb69ffff640 1 -- 172.21.15.88:0/2376336561 learned_addr learned my addr 172.21.15.88:0/2376336561 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:18:23.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:23.827+0000 7fb69f7fe640 1 --2- 172.21.15.88:0/2376336561 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6a0102b60 0x7fb6a00745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:23.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:23.827+0000 7fb69ffff640 1 -- 172.21.15.88:0/2376336561 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6a0102b60 msgr2=0x7fb6a00745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:23.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:23.827+0000 7fb69ffff640 1 --2- 172.21.15.88:0/2376336561 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6a0102b60 0x7fb6a00745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:23.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:23.827+0000 7fb69ffff640 1 -- 172.21.15.88:0/2376336561 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6a0074b20 con 0x7fb6a0101960 2024-09-17T04:18:23.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:23.827+0000 7fb69f7fe640 1 --2- 172.21.15.88:0/2376336561 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6a0102b60 0x7fb6a00745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:18:23.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:23.828+0000 7fb69ffff640 1 --2- 172.21.15.88:0/2376336561 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6a0101960 0x7fb6a0075f20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb69000c8f0 tx=0x7fb69000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:23.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:23.828+0000 7fb69d7fa640 1 -- 172.21.15.88:0/2376336561 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb690004020 con 0x7fb6a0101960 2024-09-17T04:18:23.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:23.828+0000 7fb69d7fa640 1 -- 172.21.15.88:0/2376336561 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb690007e10 con 0x7fb6a0101960 2024-09-17T04:18:23.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:23.828+0000 7fb6a6645640 1 -- 172.21.15.88:0/2376336561 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6a0074e10 con 0x7fb6a0101960 2024-09-17T04:18:23.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:23.828+0000 7fb69d7fa640 1 -- 172.21.15.88:0/2376336561 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb690003e10 con 0x7fb6a0101960 2024-09-17T04:18:23.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:23.828+0000 7fb6a6645640 1 -- 172.21.15.88:0/2376336561 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6a00753a0 con 0x7fb6a0101960 2024-09-17T04:18:23.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:23.829+0000 7fb6a6645640 1 -- 172.21.15.88:0/2376336561 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6a0101d60 con 0x7fb6a0101960 2024-09-17T04:18:23.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:23.829+0000 7fb69d7fa640 1 -- 172.21.15.88:0/2376336561 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fb6900041c0 con 0x7fb6a0101960 2024-09-17T04:18:23.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:23.830+0000 7fb69d7fa640 1 --2- 172.21.15.88:0/2376336561 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fb68806e2b0 0x7fb688070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:23.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:23.830+0000 7fb69d7fa640 1 -- 172.21.15.88:0/2376336561 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7fb69008e350 con 0x7fb6a0101960 2024-09-17T04:18:23.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:23.830+0000 7fb69f7fe640 1 --2- 172.21.15.88:0/2376336561 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fb68806e2b0 0x7fb688070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:23.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:23.830+0000 7fb69f7fe640 1 --2- 172.21.15.88:0/2376336561 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fb68806e2b0 0x7fb688070770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb6940096c0 tx=0x7fb694009650 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:23.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:23.834+0000 7fb69d7fa640 1 -- 172.21.15.88:0/2376336561 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb690015330 con 0x7fb6a0101960 2024-09-17T04:18:24.030 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:24 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:24.030 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:24 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:24.030 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:24 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:24.030 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:24 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:24.030 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:24 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:24.030 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:24 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:18:24.030 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:24 smithi088 ceph-mon[27811]: mds.? [v2:172.21.15.134:6826/2137586894,v1:172.21.15.134:6827/2137586894] up:boot 2024-09-17T04:18:24.030 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:24 smithi088 ceph-mon[27811]: fsmap cephfs:1 {0=cephfs.smithi088.lgavsv=up:active} 1 up:standby-replay 2 up:standby 2024-09-17T04:18:24.030 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:24 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.psnynp"}]: dispatch 2024-09-17T04:18:24.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:24.057+0000 7fb6a6645640 1 -- 172.21.15.88:0/2376336561 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb6a0062df0 con 0x7fb6a0101960 2024-09-17T04:18:24.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:24.058+0000 7fb69d7fa640 1 -- 172.21.15.88:0/2376336561 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5328 (secure 0 0 0) 0x7fb69005bc50 con 0x7fb6a0101960 2024-09-17T04:18:24.059 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 9 2024-09-17T04:18:24.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:24.060+0000 7fb6a6645640 1 -- 172.21.15.88:0/2376336561 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fb68806e2b0 msgr2=0x7fb688070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:24.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:24.060+0000 7fb6a6645640 1 --2- 172.21.15.88:0/2376336561 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fb68806e2b0 0x7fb688070770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb6940096c0 tx=0x7fb694009650 comp rx=0 tx=0).stop 2024-09-17T04:18:24.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:24.060+0000 7fb6a6645640 1 -- 172.21.15.88:0/2376336561 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6a0101960 msgr2=0x7fb6a0075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:24.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:24.060+0000 7fb6a6645640 1 --2- 172.21.15.88:0/2376336561 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6a0101960 0x7fb6a0075f20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb69000c8f0 tx=0x7fb69000cdb0 comp rx=0 tx=0).stop 2024-09-17T04:18:24.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:24.060+0000 7fb6a6645640 1 -- 172.21.15.88:0/2376336561 shutdown_connections 2024-09-17T04:18:24.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:24.060+0000 7fb6a6645640 1 --2- 172.21.15.88:0/2376336561 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fb68806e2b0 0x7fb688070770 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:24.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:24.060+0000 7fb6a6645640 1 --2- 172.21.15.88:0/2376336561 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6a0102b60 0x7fb6a00745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:24.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:24.060+0000 7fb6a6645640 1 --2- 172.21.15.88:0/2376336561 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6a0101960 0x7fb6a0075f20 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:24.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:24.060+0000 7fb6a6645640 1 -- 172.21.15.88:0/2376336561 >> 172.21.15.88:0/2376336561 conn(0x7fb6a00fd0f0 msgr2=0x7fb6a0106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:24.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:24.060+0000 7fb6a6645640 1 -- 172.21.15.88:0/2376336561 shutdown_connections 2024-09-17T04:18:24.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:24.060+0000 7fb6a6645640 1 -- 172.21.15.88:0/2376336561 wait complete. 2024-09-17T04:18:24.070 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-09-17T04:18:24.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:24 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:24.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:24 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:24.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:24 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:24.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:24 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:24.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:24 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:24.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:24 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:18:24.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:24 smithi134 ceph-mon[35201]: mds.? [v2:172.21.15.134:6826/2137586894,v1:172.21.15.134:6827/2137586894] up:boot 2024-09-17T04:18:24.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:24 smithi134 ceph-mon[35201]: fsmap cephfs:1 {0=cephfs.smithi088.lgavsv=up:active} 1 up:standby-replay 2 up:standby 2024-09-17T04:18:24.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:24 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.psnynp"}]: dispatch 2024-09-17T04:18:24.777 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-09-17T04:18:25.356 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:18:25.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:25 smithi088 ceph-mon[27811]: pgmap v183: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-17T04:18:25.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:25 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/2376336561' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-17T04:18:25.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:25 smithi088 ceph-mon[27811]: Dropping low affinity standby-replay daemon mds.cephfs.smithi134.ktuhce in favor of higher affinity standby. 2024-09-17T04:18:25.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:25 smithi088 ceph-mon[27811]: mds.? [v2:172.21.15.88:6828/1714846518,v1:172.21.15.88:6829/1714846518] up:standby 2024-09-17T04:18:25.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:25 smithi088 ceph-mon[27811]: Dropping low affinity active daemon mds.cephfs.smithi088.lgavsv in favor of higher affinity standby. 2024-09-17T04:18:25.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:25 smithi088 ceph-mon[27811]: Replacing daemon mds.cephfs.smithi088.lgavsv as rank 0 with standby daemon mds.cephfs.smithi088.giqrgt 2024-09-17T04:18:25.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:25 smithi088 ceph-mon[27811]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-17T04:18:25.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:25 smithi088 ceph-mon[27811]: fsmap cephfs:1 {0=cephfs.smithi088.lgavsv=up:active} 1 up:standby-replay 1 up:standby 2024-09-17T04:18:25.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:25 smithi088 ceph-mon[27811]: osdmap e45: 6 total, 6 up, 6 in 2024-09-17T04:18:25.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:25 smithi088 ceph-mon[27811]: fsmap cephfs:1/1 {0=cephfs.smithi088.giqrgt=up:replay} 1 up:standby 2024-09-17T04:18:25.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:25 smithi134 ceph-mon[35201]: pgmap v183: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-17T04:18:25.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:25 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/2376336561' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-17T04:18:25.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:25 smithi134 ceph-mon[35201]: Dropping low affinity standby-replay daemon mds.cephfs.smithi134.ktuhce in favor of higher affinity standby. 2024-09-17T04:18:25.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:25 smithi134 ceph-mon[35201]: mds.? [v2:172.21.15.88:6828/1714846518,v1:172.21.15.88:6829/1714846518] up:standby 2024-09-17T04:18:25.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:25 smithi134 ceph-mon[35201]: Dropping low affinity active daemon mds.cephfs.smithi088.lgavsv in favor of higher affinity standby. 2024-09-17T04:18:25.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:25 smithi134 ceph-mon[35201]: Replacing daemon mds.cephfs.smithi088.lgavsv as rank 0 with standby daemon mds.cephfs.smithi088.giqrgt 2024-09-17T04:18:25.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:25 smithi134 ceph-mon[35201]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-17T04:18:25.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:25 smithi134 ceph-mon[35201]: fsmap cephfs:1 {0=cephfs.smithi088.lgavsv=up:active} 1 up:standby-replay 1 up:standby 2024-09-17T04:18:25.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:25 smithi134 ceph-mon[35201]: osdmap e45: 6 total, 6 up, 6 in 2024-09-17T04:18:25.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:25 smithi134 ceph-mon[35201]: fsmap cephfs:1/1 {0=cephfs.smithi088.giqrgt=up:replay} 1 up:standby 2024-09-17T04:18:25.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:25.806+0000 7fb014f94640 1 -- 172.21.15.88:0/2523133247 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb010102b60 msgr2=0x7fb010102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:25.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:25.806+0000 7fb014f94640 1 --2- 172.21.15.88:0/2523133247 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb010102b60 0x7fb010102fe0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb004009880 tx=0x7fb00402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:18:25.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:25.806+0000 7fb014f94640 1 -- 172.21.15.88:0/2523133247 shutdown_connections 2024-09-17T04:18:25.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:25.806+0000 7fb014f94640 1 --2- 172.21.15.88:0/2523133247 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb010102b60 0x7fb010102fe0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:25.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:25.806+0000 7fb014f94640 1 --2- 172.21.15.88:0/2523133247 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb010101960 0x7fb010101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:25.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:25.806+0000 7fb014f94640 1 -- 172.21.15.88:0/2523133247 >> 172.21.15.88:0/2523133247 conn(0x7fb0100fd0f0 msgr2=0x7fb0100ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:25.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:25.806+0000 7fb014f94640 1 -- 172.21.15.88:0/2523133247 shutdown_connections 2024-09-17T04:18:25.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:25.806+0000 7fb014f94640 1 -- 172.21.15.88:0/2523133247 wait complete. 2024-09-17T04:18:25.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:25.807+0000 7fb014f94640 1 Processor -- start 2024-09-17T04:18:25.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:25.807+0000 7fb014f94640 1 -- start start 2024-09-17T04:18:25.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:25.807+0000 7fb014f94640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb010101960 0x7fb010075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:25.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:25.807+0000 7fb014f94640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb010102b60 0x7fb0100745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:25.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:25.807+0000 7fb014f94640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fb01010a7a0 con 0x7fb010101960 2024-09-17T04:18:25.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:25.807+0000 7fb014f94640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb01010a620 con 0x7fb010102b60 2024-09-17T04:18:25.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:25.807+0000 7fb00e59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb010101960 0x7fb010075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:25.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:25.807+0000 7fb00e59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb010101960 0x7fb010075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47678/0 (socket says 172.21.15.88:47678) 2024-09-17T04:18:25.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:25.807+0000 7fb00e59c640 1 -- 172.21.15.88:0/3760669295 learned_addr learned my addr 172.21.15.88:0/3760669295 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:18:25.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:25.807+0000 7fb00dd9b640 1 --2- 172.21.15.88:0/3760669295 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb010102b60 0x7fb0100745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:25.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:25.807+0000 7fb00e59c640 1 -- 172.21.15.88:0/3760669295 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb010102b60 msgr2=0x7fb0100745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:25.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:25.807+0000 7fb00e59c640 1 --2- 172.21.15.88:0/3760669295 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb010102b60 0x7fb0100745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:25.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:25.807+0000 7fb00e59c640 1 -- 172.21.15.88:0/3760669295 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb010074b20 con 0x7fb010101960 2024-09-17T04:18:25.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:25.808+0000 7fb00e59c640 1 --2- 172.21.15.88:0/3760669295 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb010101960 0x7fb010075f20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb00000d8d0 tx=0x7fb00000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:25.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:25.808+0000 7fafff7fe640 1 -- 172.21.15.88:0/3760669295 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb000017070 con 0x7fb010101960 2024-09-17T04:18:25.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:25.808+0000 7fafff7fe640 1 -- 172.21.15.88:0/3760669295 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb00000be10 con 0x7fb010101960 2024-09-17T04:18:25.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:25.808+0000 7fb014f94640 1 -- 172.21.15.88:0/3760669295 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb010074e10 con 0x7fb010101960 2024-09-17T04:18:25.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:25.808+0000 7fafff7fe640 1 -- 172.21.15.88:0/3760669295 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb00000f3c0 con 0x7fb010101960 2024-09-17T04:18:25.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:25.808+0000 7fb014f94640 1 -- 172.21.15.88:0/3760669295 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb010075370 con 0x7fb010101960 2024-09-17T04:18:25.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:25.809+0000 7fb014f94640 1 -- 172.21.15.88:0/3760669295 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb010101d60 con 0x7fb010101960 2024-09-17T04:18:25.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:25.809+0000 7fafff7fe640 1 -- 172.21.15.88:0/3760669295 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fb00001a070 con 0x7fb010101960 2024-09-17T04:18:25.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:25.810+0000 7fafff7fe640 1 --2- 172.21.15.88:0/3760669295 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7faff806e310 0x7faff80707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:25.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:25.810+0000 7fafff7fe640 1 -- 172.21.15.88:0/3760669295 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7fb00008dc80 con 0x7fb010101960 2024-09-17T04:18:25.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:25.810+0000 7fb00dd9b640 1 --2- 172.21.15.88:0/3760669295 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7faff806e310 0x7faff80707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:25.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:25.810+0000 7fb00dd9b640 1 --2- 172.21.15.88:0/3760669295 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7faff806e310 0x7faff80707d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb004000c00 tx=0x7fb0040058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:25.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:25.814+0000 7fafff7fe640 1 -- 172.21.15.88:0/3760669295 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb00005f2b0 con 0x7fb010101960 2024-09-17T04:18:26.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:26.052+0000 7fb014f94640 1 -- 172.21.15.88:0/3760669295 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) -- 0x7fb01002db50 con 0x7fb010101960 2024-09-17T04:18:26.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:26.052+0000 7fafff7fe640 1 -- 172.21.15.88:0/3760669295 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v12) ==== 78+0+98 (secure 0 0 0) 0x7fb000063ae0 con 0x7fb010101960 2024-09-17T04:18:26.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:26.054+0000 7fb014f94640 1 -- 172.21.15.88:0/3760669295 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7faff806e310 msgr2=0x7faff80707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:26.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:26.054+0000 7fb014f94640 1 --2- 172.21.15.88:0/3760669295 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7faff806e310 0x7faff80707d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb004000c00 tx=0x7fb0040058d0 comp rx=0 tx=0).stop 2024-09-17T04:18:26.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:26.054+0000 7fb014f94640 1 -- 172.21.15.88:0/3760669295 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb010101960 msgr2=0x7fb010075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:26.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:26.054+0000 7fb014f94640 1 --2- 172.21.15.88:0/3760669295 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb010101960 0x7fb010075f20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb00000d8d0 tx=0x7fb00000dd90 comp rx=0 tx=0).stop 2024-09-17T04:18:26.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:26.054+0000 7fb014f94640 1 -- 172.21.15.88:0/3760669295 shutdown_connections 2024-09-17T04:18:26.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:26.054+0000 7fb014f94640 1 --2- 172.21.15.88:0/3760669295 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7faff806e310 0x7faff80707d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:26.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:26.054+0000 7fb014f94640 1 --2- 172.21.15.88:0/3760669295 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb010102b60 0x7fb0100745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:26.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:26.055+0000 7fb014f94640 1 --2- 172.21.15.88:0/3760669295 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb010101960 0x7fb010075f20 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:26.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:26.055+0000 7fb014f94640 1 -- 172.21.15.88:0/3760669295 >> 172.21.15.88:0/3760669295 conn(0x7fb0100fd0f0 msgr2=0x7fb010106070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:26.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:26.055+0000 7fb014f94640 1 -- 172.21.15.88:0/3760669295 shutdown_connections 2024-09-17T04:18:26.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:26.055+0000 7fb014f94640 1 -- 172.21.15.88:0/3760669295 wait complete. 2024-09-17T04:18:26.063 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-09-17T04:18:26.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:26 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:26.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:26 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:26.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:26 smithi088 ceph-mon[27811]: mds.? [v2:172.21.15.88:6828/1714846518,v1:172.21.15.88:6829/1714846518] up:reconnect 2024-09-17T04:18:26.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:26 smithi088 ceph-mon[27811]: mds.? [v2:172.21.15.134:6824/967997022,v1:172.21.15.134:6825/967997022] up:boot 2024-09-17T04:18:26.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:26 smithi088 ceph-mon[27811]: mds.? [v2:172.21.15.88:6826/1425146180,v1:172.21.15.88:6827/1425146180] up:boot 2024-09-17T04:18:26.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:26 smithi088 ceph-mon[27811]: fsmap cephfs:1/1 {0=cephfs.smithi088.giqrgt=up:reconnect} 3 up:standby 2024-09-17T04:18:26.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:26 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.ktuhce"}]: dispatch 2024-09-17T04:18:26.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:26 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.lgavsv"}]: dispatch 2024-09-17T04:18:26.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:26 smithi088 ceph-mon[27811]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-17T04:18:26.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:26 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/3760669295' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-17T04:18:26.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:26 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:26.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:26 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:26.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:26 smithi134 ceph-mon[35201]: mds.? [v2:172.21.15.88:6828/1714846518,v1:172.21.15.88:6829/1714846518] up:reconnect 2024-09-17T04:18:26.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:26 smithi134 ceph-mon[35201]: mds.? [v2:172.21.15.134:6824/967997022,v1:172.21.15.134:6825/967997022] up:boot 2024-09-17T04:18:26.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:26 smithi134 ceph-mon[35201]: mds.? [v2:172.21.15.88:6826/1425146180,v1:172.21.15.88:6827/1425146180] up:boot 2024-09-17T04:18:26.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:26 smithi134 ceph-mon[35201]: fsmap cephfs:1/1 {0=cephfs.smithi088.giqrgt=up:reconnect} 3 up:standby 2024-09-17T04:18:26.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:26 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.ktuhce"}]: dispatch 2024-09-17T04:18:26.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:26 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.lgavsv"}]: dispatch 2024-09-17T04:18:26.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:26 smithi134 ceph-mon[35201]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-17T04:18:26.398 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:26 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/3760669295' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-17T04:18:26.767 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-09-17T04:18:26.782 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-17T04:18:27.680 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:18:27.800 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:27 smithi088 ceph-mon[27811]: mds.? [v2:172.21.15.88:6828/1714846518,v1:172.21.15.88:6829/1714846518] up:rejoin 2024-09-17T04:18:27.800 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:27 smithi088 ceph-mon[27811]: fsmap cephfs:1/1 {0=cephfs.smithi088.giqrgt=up:rejoin} 3 up:standby 2024-09-17T04:18:27.801 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:27 smithi088 ceph-mon[27811]: daemon mds.cephfs.smithi088.giqrgt is now active in filesystem cephfs as rank 0 2024-09-17T04:18:27.801 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:27 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:28.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:27 smithi134 ceph-mon[35201]: mds.? [v2:172.21.15.88:6828/1714846518,v1:172.21.15.88:6829/1714846518] up:rejoin 2024-09-17T04:18:28.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:27 smithi134 ceph-mon[35201]: fsmap cephfs:1/1 {0=cephfs.smithi088.giqrgt=up:rejoin} 3 up:standby 2024-09-17T04:18:28.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:27 smithi134 ceph-mon[35201]: daemon mds.cephfs.smithi088.giqrgt is now active in filesystem cephfs as rank 0 2024-09-17T04:18:28.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:27 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:28.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:28.417+0000 7f3662d26640 1 -- 172.21.15.88:0/4253726542 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f365c101900 msgr2=0x7f365c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:28.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:28.417+0000 7f3662d26640 1 --2- 172.21.15.88:0/4253726542 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f365c101900 0x7f365c101d60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3648009880 tx=0x7f364802a4a0 comp rx=0 tx=0).stop 2024-09-17T04:18:28.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:28.417+0000 7f3662d26640 1 -- 172.21.15.88:0/4253726542 shutdown_connections 2024-09-17T04:18:28.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:28.417+0000 7f3662d26640 1 --2- 172.21.15.88:0/4253726542 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f365c101900 0x7f365c101d60 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:28.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:28.417+0000 7f3662d26640 1 --2- 172.21.15.88:0/4253726542 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f365c107900 0x7f365c107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:28.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:28.417+0000 7f3662d26640 1 -- 172.21.15.88:0/4253726542 >> 172.21.15.88:0/4253726542 conn(0x7f365c0fd600 msgr2=0x7f365c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:28.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:28.417+0000 7f3662d26640 1 -- 172.21.15.88:0/4253726542 shutdown_connections 2024-09-17T04:18:28.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:28.417+0000 7f3662d26640 1 -- 172.21.15.88:0/4253726542 wait complete. 2024-09-17T04:18:28.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:28.418+0000 7f3662d26640 1 Processor -- start 2024-09-17T04:18:28.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:28.418+0000 7f3662d26640 1 -- start start 2024-09-17T04:18:28.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:28.418+0000 7f3662d26640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f365c101900 0x7f365c19d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:28.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:28.418+0000 7f3662d26640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f365c107900 0x7f365c19dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:28.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:28.418+0000 7f3662d26640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f365c10ee30 con 0x7f365c107900 2024-09-17T04:18:28.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:28.418+0000 7f3662d26640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f365c10ecb0 con 0x7f365c101900 2024-09-17T04:18:28.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:28.418+0000 7f365bfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f365c107900 0x7f365c19dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:28.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:28.418+0000 7f365bfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f365c107900 0x7f365c19dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47686/0 (socket says 172.21.15.88:47686) 2024-09-17T04:18:28.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:28.418+0000 7f365bfff640 1 -- 172.21.15.88:0/1910955280 learned_addr learned my addr 172.21.15.88:0/1910955280 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:18:28.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:28.419+0000 7f3660ac2640 1 --2- 172.21.15.88:0/1910955280 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f365c101900 0x7f365c19d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:28.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:28.419+0000 7f365bfff640 1 -- 172.21.15.88:0/1910955280 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f365c101900 msgr2=0x7f365c19d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:28.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:28.419+0000 7f365bfff640 1 --2- 172.21.15.88:0/1910955280 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f365c101900 0x7f365c19d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:28.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:28.419+0000 7f365bfff640 1 -- 172.21.15.88:0/1910955280 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f365c197840 con 0x7f365c107900 2024-09-17T04:18:28.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:28.419+0000 7f365bfff640 1 --2- 172.21.15.88:0/1910955280 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f365c107900 0x7f365c19dc00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3648031460 tx=0x7f36480048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:28.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:28.419+0000 7f3659ffb640 1 -- 172.21.15.88:0/1910955280 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f364803f070 con 0x7f365c107900 2024-09-17T04:18:28.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:28.419+0000 7f3659ffb640 1 -- 172.21.15.88:0/1910955280 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3648004cf0 con 0x7f365c107900 2024-09-17T04:18:28.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:28.419+0000 7f3659ffb640 1 -- 172.21.15.88:0/1910955280 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3648035030 con 0x7f365c107900 2024-09-17T04:18:28.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:28.419+0000 7f3662d26640 1 -- 172.21.15.88:0/1910955280 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f365c197ad0 con 0x7f365c107900 2024-09-17T04:18:28.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:28.419+0000 7f3662d26640 1 -- 172.21.15.88:0/1910955280 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f365c198000 con 0x7f365c107900 2024-09-17T04:18:28.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:28.420+0000 7f3662d26640 1 -- 172.21.15.88:0/1910955280 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f365c103040 con 0x7f365c107900 2024-09-17T04:18:28.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:28.421+0000 7f3659ffb640 1 -- 172.21.15.88:0/1910955280 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f3648042070 con 0x7f365c107900 2024-09-17T04:18:28.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:28.421+0000 7f3659ffb640 1 --2- 172.21.15.88:0/1910955280 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f364c06e2b0 0x7f364c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:28.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:28.421+0000 7f3659ffb640 1 -- 172.21.15.88:0/1910955280 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f36480aecb0 con 0x7f365c107900 2024-09-17T04:18:28.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:28.421+0000 7f3660ac2640 1 --2- 172.21.15.88:0/1910955280 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f364c06e2b0 0x7f364c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:28.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:28.422+0000 7f3660ac2640 1 --2- 172.21.15.88:0/1910955280 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f364c06e2b0 0x7f364c070770 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3650009890 tx=0x7f3650008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:28.429 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:28.425+0000 7f3659ffb640 1 -- 172.21.15.88:0/1910955280 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f364807c5b0 con 0x7f365c107900 2024-09-17T04:18:28.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:28.634+0000 7f3662d26640 1 -- 172.21.15.88:0/1910955280 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f365c109e90 con 0x7f365c107900 2024-09-17T04:18:28.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:28.635+0000 7f3659ffb640 1 -- 172.21.15.88:0/1910955280 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5327 (secure 0 0 0) 0x7f3648080260 con 0x7f365c107900 2024-09-17T04:18:28.635 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:18:28.635 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":15,"btime":"2024-09-17T04:18:27:750910+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24325,"name":"cephfs.smithi134.ktuhce","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6825/967997022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":967997022},{"type":"v1","addr":"172.21.15.134:6825","nonce":967997022}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24329,"name":"cephfs.smithi088.lgavsv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6827/1425146180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1425146180},{"type":"v1","addr":"172.21.15.88:6827","nonce":1425146180}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T04:18:10.480573+0000","modified":"2024-09-17T04:18:27.750896+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":45,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14590},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14590":{"gid":14590,"name":"cephfs.smithi088.giqrgt","rank":0,"incarnation":11,"state":"up:active","state_seq":5,"addr":"172.21.15.88:6829/1714846518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1714846518},{"type":"v1","addr":"172.21.15.88:6829","nonce":1714846518}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24321":{"gid":24321,"name":"cephfs.smithi134.psnynp","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.134:6827/2137586894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2137586894},{"type":"v1","addr":"172.21.15.134:6827","nonce":2137586894}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14590,"qdb_cluster":[14590]},"id":1}]} 2024-09-17T04:18:28.635 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 15 2024-09-17T04:18:28.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:28.637+0000 7f3662d26640 1 -- 172.21.15.88:0/1910955280 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f364c06e2b0 msgr2=0x7f364c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:28.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:28.637+0000 7f3662d26640 1 --2- 172.21.15.88:0/1910955280 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f364c06e2b0 0x7f364c070770 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3650009890 tx=0x7f3650008040 comp rx=0 tx=0).stop 2024-09-17T04:18:28.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:28.637+0000 7f3662d26640 1 -- 172.21.15.88:0/1910955280 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f365c107900 msgr2=0x7f365c19dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:28.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:28.637+0000 7f3662d26640 1 --2- 172.21.15.88:0/1910955280 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f365c107900 0x7f365c19dc00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3648031460 tx=0x7f36480048f0 comp rx=0 tx=0).stop 2024-09-17T04:18:28.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:28.637+0000 7f3662d26640 1 -- 172.21.15.88:0/1910955280 shutdown_connections 2024-09-17T04:18:28.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:28.637+0000 7f3662d26640 1 --2- 172.21.15.88:0/1910955280 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f364c06e2b0 0x7f364c070770 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:28.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:28.637+0000 7f3662d26640 1 --2- 172.21.15.88:0/1910955280 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f365c107900 0x7f365c19dc00 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:28.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:28.637+0000 7f3662d26640 1 --2- 172.21.15.88:0/1910955280 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f365c101900 0x7f365c19d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:28.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:28.637+0000 7f3662d26640 1 -- 172.21.15.88:0/1910955280 >> 172.21.15.88:0/1910955280 conn(0x7f365c0fd600 msgr2=0x7f365c0fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:28.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:28.637+0000 7f3662d26640 1 -- 172.21.15.88:0/1910955280 shutdown_connections 2024-09-17T04:18:28.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:28.637+0000 7f3662d26640 1 -- 172.21.15.88:0/1910955280 wait complete. 2024-09-17T04:18:28.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:28 smithi088 ceph-mon[27811]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-17T04:18:28.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:28 smithi088 ceph-mon[27811]: mds.? [v2:172.21.15.88:6828/1714846518,v1:172.21.15.88:6829/1714846518] up:active 2024-09-17T04:18:28.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:28 smithi088 ceph-mon[27811]: mds.? [v2:172.21.15.134:6826/2137586894,v1:172.21.15.134:6827/2137586894] up:standby 2024-09-17T04:18:28.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:28 smithi088 ceph-mon[27811]: fsmap cephfs:1 {0=cephfs.smithi088.giqrgt=up:active} 3 up:standby 2024-09-17T04:18:28.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:28 smithi088 ceph-mon[27811]: fsmap cephfs:1 {0=cephfs.smithi088.giqrgt=up:active} 1 up:standby-replay 2 up:standby 2024-09-17T04:18:28.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:28 smithi088 ceph-mon[27811]: pgmap v186: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 204 B/s wr, 4 op/s 2024-09-17T04:18:28.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:28 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/1910955280' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-17T04:18:29.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:28 smithi134 ceph-mon[35201]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-17T04:18:29.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:28 smithi134 ceph-mon[35201]: mds.? [v2:172.21.15.88:6828/1714846518,v1:172.21.15.88:6829/1714846518] up:active 2024-09-17T04:18:29.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:28 smithi134 ceph-mon[35201]: mds.? [v2:172.21.15.134:6826/2137586894,v1:172.21.15.134:6827/2137586894] up:standby 2024-09-17T04:18:29.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:28 smithi134 ceph-mon[35201]: fsmap cephfs:1 {0=cephfs.smithi088.giqrgt=up:active} 3 up:standby 2024-09-17T04:18:29.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:28 smithi134 ceph-mon[35201]: fsmap cephfs:1 {0=cephfs.smithi088.giqrgt=up:active} 1 up:standby-replay 2 up:standby 2024-09-17T04:18:29.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:28 smithi134 ceph-mon[35201]: pgmap v186: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 204 B/s wr, 4 op/s 2024-09-17T04:18:29.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:28 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/1910955280' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-17T04:18:29.386 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 15, 'max_mds': 1, 'flags': 50} 2024-09-17T04:18:29.386 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-17T04:18:29.414 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-17T04:18:29.414 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-09-17T04:18:29.414 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-17T04:18:29.415 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T04:18:29.415 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T04:18:29.415 INFO:tasks.ceph_fuse:client.1 config is {} 2024-09-17T04:18:29.415 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T04:18:29.415 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T04:18:29.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:18:29.415 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2024-09-17T04:18:29.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:18:29.432 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link delete ceph-brx 2024-09-17T04:18:29.500 INFO:teuthology.orchestra.run.smithi088.stderr:Cannot find device "ceph-brx" 2024-09-17T04:18:29.501 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T04:18:29.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:18:29.502 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2024-09-17T04:18:29.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:18:29.521 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link delete ceph-brx 2024-09-17T04:18:29.591 INFO:teuthology.orchestra.run.smithi134.stderr:Cannot find device "ceph-brx" 2024-09-17T04:18:29.592 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T04:18:29.593 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-17T04:18:29.593 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-17T04:18:29.593 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-17T04:18:30.479 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:18:30.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:30.907+0000 7efea5bba640 1 -- 172.21.15.88:0/2505452512 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efea0102b20 msgr2=0x7efea0102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:30.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:30.907+0000 7efea5bba640 1 --2- 172.21.15.88:0/2505452512 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efea0102b20 0x7efea0102f00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7efe900098b0 tx=0x7efe9002a560 comp rx=0 tx=0).stop 2024-09-17T04:18:30.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:30.907+0000 7efea5bba640 1 -- 172.21.15.88:0/2505452512 shutdown_connections 2024-09-17T04:18:30.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:30.907+0000 7efea5bba640 1 --2- 172.21.15.88:0/2505452512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efea0103440 0x7efea010b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:30.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:30.907+0000 7efea5bba640 1 --2- 172.21.15.88:0/2505452512 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efea0102b20 0x7efea0102f00 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:30.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:30.907+0000 7efea5bba640 1 -- 172.21.15.88:0/2505452512 >> 172.21.15.88:0/2505452512 conn(0x7efea00fc520 msgr2=0x7efea00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:30.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:30.907+0000 7efea5bba640 1 -- 172.21.15.88:0/2505452512 shutdown_connections 2024-09-17T04:18:30.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:30.907+0000 7efea5bba640 1 -- 172.21.15.88:0/2505452512 wait complete. 2024-09-17T04:18:30.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:30.908+0000 7efea5bba640 1 Processor -- start 2024-09-17T04:18:30.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:30.908+0000 7efea5bba640 1 -- start start 2024-09-17T04:18:30.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:30.908+0000 7efea5bba640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efea0102b20 0x7efea019d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:30.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:30.908+0000 7efea5bba640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efea0103440 0x7efea019dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:30.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:30.908+0000 7efea5bba640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7efea010ee50 con 0x7efea0102b20 2024-09-17T04:18:30.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:30.908+0000 7efea5bba640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7efea010ecd0 con 0x7efea0103440 2024-09-17T04:18:30.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:30.908+0000 7efe9f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efea0102b20 0x7efea019d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:30.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:30.908+0000 7efe9f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efea0102b20 0x7efea019d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47702/0 (socket says 172.21.15.88:47702) 2024-09-17T04:18:30.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:30.908+0000 7efe9f7fe640 1 -- 172.21.15.88:0/38788136 learned_addr learned my addr 172.21.15.88:0/38788136 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:18:30.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:30.908+0000 7efe96ffd640 1 --2- 172.21.15.88:0/38788136 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efea0103440 0x7efea019dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:30.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:30.908+0000 7efe9f7fe640 1 -- 172.21.15.88:0/38788136 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efea0103440 msgr2=0x7efea019dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:30.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:30.908+0000 7efe9f7fe640 1 --2- 172.21.15.88:0/38788136 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efea0103440 0x7efea019dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:30.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:30.908+0000 7efe9f7fe640 1 -- 172.21.15.88:0/38788136 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efea0197880 con 0x7efea0102b20 2024-09-17T04:18:30.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:30.908+0000 7efe96ffd640 1 --2- 172.21.15.88:0/38788136 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efea0103440 0x7efea019dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:18:30.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:30.908+0000 7efe9f7fe640 1 --2- 172.21.15.88:0/38788136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efea0102b20 0x7efea019d6c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7efe90031460 tx=0x7efe900048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:30.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:30.909+0000 7efe9d7fa640 1 -- 172.21.15.88:0/38788136 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efe9003f070 con 0x7efea0102b20 2024-09-17T04:18:30.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:30.909+0000 7efe9d7fa640 1 -- 172.21.15.88:0/38788136 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efe900044d0 con 0x7efea0102b20 2024-09-17T04:18:30.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:30.909+0000 7efea5bba640 1 -- 172.21.15.88:0/38788136 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efea0197b10 con 0x7efea0102b20 2024-09-17T04:18:30.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:30.909+0000 7efe9d7fa640 1 -- 172.21.15.88:0/38788136 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efe90035030 con 0x7efea0102b20 2024-09-17T04:18:30.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:30.909+0000 7efea5bba640 1 -- 172.21.15.88:0/38788136 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efea0198040 con 0x7efea0102b20 2024-09-17T04:18:30.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:30.910+0000 7efea5bba640 1 -- 172.21.15.88:0/38788136 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efea006aa30 con 0x7efea0102b20 2024-09-17T04:18:30.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:30.910+0000 7efe9d7fa640 1 -- 172.21.15.88:0/38788136 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7efe90042070 con 0x7efea0102b20 2024-09-17T04:18:30.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:30.911+0000 7efe9d7fa640 1 --2- 172.21.15.88:0/38788136 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7efe8c06e2b0 0x7efe8c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:30.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:30.911+0000 7efe9d7fa640 1 -- 172.21.15.88:0/38788136 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7efe900aec30 con 0x7efea0102b20 2024-09-17T04:18:30.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:30.911+0000 7efe96ffd640 1 --2- 172.21.15.88:0/38788136 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7efe8c06e2b0 0x7efe8c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:30.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:30.911+0000 7efe96ffd640 1 --2- 172.21.15.88:0/38788136 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7efe8c06e2b0 0x7efe8c070770 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efe88006fd0 tx=0x7efe88008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:30.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:30.915+0000 7efe9d7fa640 1 -- 172.21.15.88:0/38788136 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efe9007c530 con 0x7efea0102b20 2024-09-17T04:18:31.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:31.126+0000 7efea5bba640 1 -- 172.21.15.88:0/38788136 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7efea0198db0 con 0x7efea0102b20 2024-09-17T04:18:31.126 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:30 smithi088 ceph-mon[27811]: pgmap v187: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 3.5 KiB/s rd, 4 op/s 2024-09-17T04:18:31.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:31.126+0000 7efe9d7fa640 1 -- 172.21.15.88:0/38788136 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) ==== 53+0+83 (secure 0 0 0) 0x7efe90004cf0 con 0x7efea0102b20 2024-09-17T04:18:31.127 INFO:teuthology.orchestra.run.smithi088.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-17T04:18:31.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:31.129+0000 7efea5bba640 1 -- 172.21.15.88:0/38788136 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7efe8c06e2b0 msgr2=0x7efe8c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:31.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:31.129+0000 7efea5bba640 1 --2- 172.21.15.88:0/38788136 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7efe8c06e2b0 0x7efe8c070770 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efe88006fd0 tx=0x7efe88008040 comp rx=0 tx=0).stop 2024-09-17T04:18:31.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:31.129+0000 7efea5bba640 1 -- 172.21.15.88:0/38788136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efea0102b20 msgr2=0x7efea019d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:31.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:31.129+0000 7efea5bba640 1 --2- 172.21.15.88:0/38788136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efea0102b20 0x7efea019d6c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7efe90031460 tx=0x7efe900048f0 comp rx=0 tx=0).stop 2024-09-17T04:18:31.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:31.129+0000 7efea5bba640 1 -- 172.21.15.88:0/38788136 shutdown_connections 2024-09-17T04:18:31.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:31.129+0000 7efea5bba640 1 --2- 172.21.15.88:0/38788136 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7efe8c06e2b0 0x7efe8c070770 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:31.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:31.129+0000 7efea5bba640 1 --2- 172.21.15.88:0/38788136 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efea0103440 0x7efea019dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:31.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:31.129+0000 7efea5bba640 1 --2- 172.21.15.88:0/38788136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efea0102b20 0x7efea019d6c0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:31.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:31.129+0000 7efea5bba640 1 -- 172.21.15.88:0/38788136 >> 172.21.15.88:0/38788136 conn(0x7efea00fc520 msgr2=0x7efea0103da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:31.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:31.129+0000 7efea5bba640 1 -- 172.21.15.88:0/38788136 shutdown_connections 2024-09-17T04:18:31.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:31.129+0000 7efea5bba640 1 -- 172.21.15.88:0/38788136 wait complete. 2024-09-17T04:18:31.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:30 smithi134 ceph-mon[35201]: pgmap v187: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 3.5 KiB/s rd, 4 op/s 2024-09-17T04:18:31.775 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T04:18:31.775 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T04:18:31.776 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi088.front.sepia.ceph.com 2024-09-17T04:18:31.776 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T04:18:31.776 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T04:18:31.776 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T04:18:31.776 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T04:18:31.776 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T04:18:31.776 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T04:18:31.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:18:31.776 DEBUG:teuthology.orchestra.run.smithi088:> ip addr 2024-09-17T04:18:31.792 INFO:teuthology.orchestra.run.smithi088.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T04:18:31.792 INFO:teuthology.orchestra.run.smithi088.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T04:18:31.792 INFO:teuthology.orchestra.run.smithi088.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T04:18:31.793 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:18:31.793 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 ::1/128 scope host 2024-09-17T04:18:31.793 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:18:31.793 INFO:teuthology.orchestra.run.smithi088.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T04:18:31.793 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f0 brd ff:ff:ff:ff:ff:ff 2024-09-17T04:18:31.793 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f0 2024-09-17T04:18:31.793 INFO:teuthology.orchestra.run.smithi088.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T04:18:31.793 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f1 brd ff:ff:ff:ff:ff:ff 2024-09-17T04:18:31.793 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f1 2024-09-17T04:18:31.793 INFO:teuthology.orchestra.run.smithi088.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T04:18:31.793 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2c brd ff:ff:ff:ff:ff:ff 2024-09-17T04:18:31.793 INFO:teuthology.orchestra.run.smithi088.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T04:18:31.793 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2d brd ff:ff:ff:ff:ff:ff 2024-09-17T04:18:31.794 INFO:teuthology.orchestra.run.smithi088.stdout: inet 172.21.15.88/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T04:18:31.794 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft 42328sec preferred_lft 42328sec 2024-09-17T04:18:31.794 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::ec4:7aff:fe8f:d42d/64 scope link noprefixroute 2024-09-17T04:18:31.794 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:18:31.794 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-17T04:18:31.794 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:18:31.794 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2024-09-17T04:18:31.795 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link add name ceph-brx type bridge 2024-09-17T04:18:31.795 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip addr flush dev ceph-brx 2024-09-17T04:18:31.795 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set ceph-brx up 2024-09-17T04:18:31.795 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-17T04:18:31.795 DEBUG:teuthology.orchestra.run.smithi088:> ') 2024-09-17T04:18:31.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:18:32.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:18:32.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:18:32.015 DEBUG:teuthology.orchestra.run.smithi088:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T04:18:32.040 INFO:teuthology.orchestra.run.smithi088.stdout:1 2024-09-17T04:18:32.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:18:32.041 DEBUG:teuthology.orchestra.run.smithi088:> route 2024-09-17T04:18:32.123 INFO:teuthology.orchestra.run.smithi088.stdout:Kernel IP routing table 2024-09-17T04:18:32.123 INFO:teuthology.orchestra.run.smithi088.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T04:18:32.123 INFO:teuthology.orchestra.run.smithi088.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T04:18:32.123 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T04:18:32.123 INFO:teuthology.orchestra.run.smithi088.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T04:18:32.124 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:18:32.124 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2024-09-17T04:18:32.124 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T04:18:32.124 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T04:18:32.124 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T04:18:32.124 DEBUG:teuthology.orchestra.run.smithi088:> ') 2024-09-17T04:18:32.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:18:32.269 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:32 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:32.269 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:32 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:32.269 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:32 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/38788136' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-17T04:18:32.269 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:32 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:18:32.269 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:32 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:18:32.269 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:32 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:32.269 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:32 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:18:32.269 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:32 smithi088 ceph-mon[27811]: pgmap v188: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 6.3 KiB/s rd, 6 op/s 2024-09-17T04:18:32.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:32 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:32.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:32 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:32.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:32 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/38788136' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-17T04:18:32.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:32 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:18:32.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:32 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:18:32.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:32 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:32.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:32 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:18:32.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:32 smithi134 ceph-mon[35201]: pgmap v188: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 6.3 KiB/s rd, 6 op/s 2024-09-17T04:18:32.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:18:32.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:18:32.657 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2024-09-17T04:18:32.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:18:32.673 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list-id 2024-09-17T04:18:32.730 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:18:32.730 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2024-09-17T04:18:32.730 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T04:18:32.731 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-17T04:18:32.731 DEBUG:teuthology.orchestra.run.smithi088:> ') 2024-09-17T04:18:32.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:18:32.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:18:32.856 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-17T04:18:32.856 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:18:32.856 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2024-09-17T04:18:32.856 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-17T04:18:32.856 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-17T04:18:32.856 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-17T04:18:32.856 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-17T04:18:32.857 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-17T04:18:32.857 DEBUG:teuthology.orchestra.run.smithi088:> ') 2024-09-17T04:18:32.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:18:33.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:18:33.038 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:18:33.039 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2024-09-17T04:18:33.039 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set brx.0 up 2024-09-17T04:18:33.039 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set dev brx.0 master ceph-brx 2024-09-17T04:18:33.039 DEBUG:teuthology.orchestra.run.smithi088:> ') 2024-09-17T04:18:33.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:18:33.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:18:33.116 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-17T04:18:33.116 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T04:18:33.116 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T04:18:33.131 INFO:teuthology.orchestra.run.smithi088.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T04:18:33.131 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T04:18:33.131 DEBUG:teuthology.orchestra.run.smithi088:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T04:18:33.187 DEBUG:teuthology.orchestra.run.smithi088:> sudo modprobe fuse 2024-09-17T04:18:33.254 DEBUG:teuthology.orchestra.run.smithi088:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T04:18:33.311 INFO:teuthology.orchestra.run.smithi088.stdout:/proc 2024-09-17T04:18:33.311 INFO:teuthology.orchestra.run.smithi088.stdout:/sys 2024-09-17T04:18:33.311 INFO:teuthology.orchestra.run.smithi088.stdout:/dev 2024-09-17T04:18:33.311 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/security 2024-09-17T04:18:33.311 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/shm 2024-09-17T04:18:33.311 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/pts 2024-09-17T04:18:33.311 INFO:teuthology.orchestra.run.smithi088.stdout:/run 2024-09-17T04:18:33.311 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/cgroup 2024-09-17T04:18:33.311 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/pstore 2024-09-17T04:18:33.312 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/bpf 2024-09-17T04:18:33.312 INFO:teuthology.orchestra.run.smithi088.stdout:/ 2024-09-17T04:18:33.312 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/selinux 2024-09-17T04:18:33.312 INFO:teuthology.orchestra.run.smithi088.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T04:18:33.312 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/mqueue 2024-09-17T04:18:33.312 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/hugepages 2024-09-17T04:18:33.312 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/debug 2024-09-17T04:18:33.312 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/tracing 2024-09-17T04:18:33.312 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/fuse/connections 2024-09-17T04:18:33.312 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/config 2024-09-17T04:18:33.312 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T04:18:33.312 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T04:18:33.313 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T04:18:33.313 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T04:18:33.313 INFO:teuthology.orchestra.run.smithi088.stdout:/run/user/1000 2024-09-17T04:18:33.313 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph 2024-09-17T04:18:33.313 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/containers/storage/overlay 2024-09-17T04:18:33.313 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/containers/storage/overlay/4c86ac6c6167cbabdf106226fd50fec9a97b22f872a19a49013d7603eeb7be6a/merged 2024-09-17T04:18:33.313 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/containers/storage/overlay/bea264852c5c459de31836c748e934b19d434c50ee8a6f8c9c1fbbf2d4566321/merged 2024-09-17T04:18:33.313 INFO:teuthology.orchestra.run.smithi088.stdout:/run/user/0 2024-09-17T04:18:33.313 INFO:teuthology.orchestra.run.smithi088.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T04:18:33.313 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/containers/storage/overlay/c0ad192d91ebb992e2c22bc72040ea95549fea3deec1796c2afe3ed81950e462/merged 2024-09-17T04:18:33.313 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/containers/storage/overlay/98b746f9f5a32de123cfa85b6dffa36799901bee9618c010190a50a9da9c31af/merged 2024-09-17T04:18:33.313 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/containers/storage/overlay/5ca035b45af92c237230111a60ade9719d0205a867325767f65d2fd2297cbeea/merged 2024-09-17T04:18:33.313 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/containers/storage/overlay/18d876510b0290ef88687d04eb05dca88f76eb763f0e05a995fd3ff8aa1ab30f/merged 2024-09-17T04:18:33.313 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/containers/storage/overlay/6dbe1868cc03baf88040ca9189819183d3cb11fdff9f7965da0964912bf16bb2/merged 2024-09-17T04:18:33.314 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/containers/storage/overlay/c3e69b3b1505f74a6008a5544bf40aa9c736ced342dd6a3b0b33714fd331e852/merged 2024-09-17T04:18:33.314 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/containers/storage/overlay/8fbecbfb460e6abdead44f14c601a62e9be0016e4d448fa88cf0acbaa2ce8311/merged 2024-09-17T04:18:33.314 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/containers/storage/overlay/40f0c39e7358c284d87b081f60f76150ddafbe5238ec96d76194a5447579d991/merged 2024-09-17T04:18:33.314 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/containers/storage/overlay/46e182a5c66e79a4c10639558526d9e17970ccc3e8f2aad1b1cc0359a2095b67/merged 2024-09-17T04:18:33.314 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/containers/storage/overlay/e583521070f09051bff1d2bc0f19c01c0e5d3400dd0ff249cec47136b713da0c/merged 2024-09-17T04:18:33.314 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/containers/storage/overlay/3cb7a888a8af82f4fa2bb11337fde99fee90674369a41c66f1c57ae3b8962051/merged 2024-09-17T04:18:33.314 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns 2024-09-17T04:18:33.314 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T04:18:33.314 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T04:18:33.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:18:33.314 DEBUG:teuthology.orchestra.run.smithi088:> ls /sys/fs/fuse/connections 2024-09-17T04:18:33.367 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-17T04:18:33.367 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-17T04:18:33.409 DEBUG:teuthology.orchestra.run.smithi088:> sudo modprobe fuse 2024-09-17T04:18:33.433 DEBUG:teuthology.orchestra.run.smithi088:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T04:18:33.489 INFO:teuthology.orchestra.run.smithi088.stdout:/proc 2024-09-17T04:18:33.490 INFO:teuthology.orchestra.run.smithi088.stdout:/sys 2024-09-17T04:18:33.490 INFO:teuthology.orchestra.run.smithi088.stdout:/dev 2024-09-17T04:18:33.490 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/security 2024-09-17T04:18:33.490 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/shm 2024-09-17T04:18:33.490 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/pts 2024-09-17T04:18:33.490 INFO:teuthology.orchestra.run.smithi088.stdout:/run 2024-09-17T04:18:33.490 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/cgroup 2024-09-17T04:18:33.490 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/pstore 2024-09-17T04:18:33.490 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/bpf 2024-09-17T04:18:33.490 INFO:teuthology.orchestra.run.smithi088.stdout:/ 2024-09-17T04:18:33.490 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/selinux 2024-09-17T04:18:33.490 INFO:teuthology.orchestra.run.smithi088.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T04:18:33.491 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/mqueue 2024-09-17T04:18:33.491 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/hugepages 2024-09-17T04:18:33.491 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/debug 2024-09-17T04:18:33.491 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/tracing 2024-09-17T04:18:33.491 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/fuse/connections 2024-09-17T04:18:33.491 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/config 2024-09-17T04:18:33.491 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T04:18:33.491 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T04:18:33.491 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T04:18:33.491 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T04:18:33.491 INFO:teuthology.orchestra.run.smithi088.stdout:/run/user/1000 2024-09-17T04:18:33.491 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph 2024-09-17T04:18:33.491 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/containers/storage/overlay 2024-09-17T04:18:33.491 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/containers/storage/overlay/4c86ac6c6167cbabdf106226fd50fec9a97b22f872a19a49013d7603eeb7be6a/merged 2024-09-17T04:18:33.492 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/containers/storage/overlay/bea264852c5c459de31836c748e934b19d434c50ee8a6f8c9c1fbbf2d4566321/merged 2024-09-17T04:18:33.492 INFO:teuthology.orchestra.run.smithi088.stdout:/run/user/0 2024-09-17T04:18:33.492 INFO:teuthology.orchestra.run.smithi088.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T04:18:33.492 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/containers/storage/overlay/c0ad192d91ebb992e2c22bc72040ea95549fea3deec1796c2afe3ed81950e462/merged 2024-09-17T04:18:33.492 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/containers/storage/overlay/98b746f9f5a32de123cfa85b6dffa36799901bee9618c010190a50a9da9c31af/merged 2024-09-17T04:18:33.492 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/containers/storage/overlay/5ca035b45af92c237230111a60ade9719d0205a867325767f65d2fd2297cbeea/merged 2024-09-17T04:18:33.492 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/containers/storage/overlay/18d876510b0290ef88687d04eb05dca88f76eb763f0e05a995fd3ff8aa1ab30f/merged 2024-09-17T04:18:33.492 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/containers/storage/overlay/6dbe1868cc03baf88040ca9189819183d3cb11fdff9f7965da0964912bf16bb2/merged 2024-09-17T04:18:33.492 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/containers/storage/overlay/c3e69b3b1505f74a6008a5544bf40aa9c736ced342dd6a3b0b33714fd331e852/merged 2024-09-17T04:18:33.493 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/containers/storage/overlay/8fbecbfb460e6abdead44f14c601a62e9be0016e4d448fa88cf0acbaa2ce8311/merged 2024-09-17T04:18:33.493 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/containers/storage/overlay/40f0c39e7358c284d87b081f60f76150ddafbe5238ec96d76194a5447579d991/merged 2024-09-17T04:18:33.493 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/containers/storage/overlay/46e182a5c66e79a4c10639558526d9e17970ccc3e8f2aad1b1cc0359a2095b67/merged 2024-09-17T04:18:33.493 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/containers/storage/overlay/e583521070f09051bff1d2bc0f19c01c0e5d3400dd0ff249cec47136b713da0c/merged 2024-09-17T04:18:33.493 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/containers/storage/overlay/3cb7a888a8af82f4fa2bb11337fde99fee90674369a41c66f1c57ae3b8962051/merged 2024-09-17T04:18:33.493 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns 2024-09-17T04:18:33.493 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T04:18:33.493 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T04:18:33.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:18:33.493 DEBUG:teuthology.orchestra.run.smithi088:> ls /sys/fs/fuse/connections 2024-09-17T04:18:33.578 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi088.stderr:2024-09-17T04:18:33.578+0000 7fba2dfe0480 -1 init, newargv = 0x55ab5a9acec0 newargc=15 2024-09-17T04:18:33.579 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi088.stderr:ceph-fuse[76499]: starting ceph client 2024-09-17T04:18:33.583 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi088.stderr:ceph-fuse[76499]: starting fuse 2024-09-17T04:18:34.646 DEBUG:teuthology.orchestra.run.smithi088:> sudo modprobe fuse 2024-09-17T04:18:34.674 DEBUG:teuthology.orchestra.run.smithi088:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T04:18:34.730 INFO:teuthology.orchestra.run.smithi088.stdout:/proc 2024-09-17T04:18:34.730 INFO:teuthology.orchestra.run.smithi088.stdout:/sys 2024-09-17T04:18:34.730 INFO:teuthology.orchestra.run.smithi088.stdout:/dev 2024-09-17T04:18:34.730 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/security 2024-09-17T04:18:34.730 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/shm 2024-09-17T04:18:34.730 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/pts 2024-09-17T04:18:34.731 INFO:teuthology.orchestra.run.smithi088.stdout:/run 2024-09-17T04:18:34.731 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/cgroup 2024-09-17T04:18:34.731 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/pstore 2024-09-17T04:18:34.731 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/bpf 2024-09-17T04:18:34.731 INFO:teuthology.orchestra.run.smithi088.stdout:/ 2024-09-17T04:18:34.731 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/selinux 2024-09-17T04:18:34.731 INFO:teuthology.orchestra.run.smithi088.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T04:18:34.731 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/mqueue 2024-09-17T04:18:34.731 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/hugepages 2024-09-17T04:18:34.731 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/debug 2024-09-17T04:18:34.731 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/tracing 2024-09-17T04:18:34.731 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/fuse/connections 2024-09-17T04:18:34.731 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/config 2024-09-17T04:18:34.731 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T04:18:34.732 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T04:18:34.732 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T04:18:34.732 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T04:18:34.732 INFO:teuthology.orchestra.run.smithi088.stdout:/run/user/1000 2024-09-17T04:18:34.732 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph 2024-09-17T04:18:34.732 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/containers/storage/overlay 2024-09-17T04:18:34.732 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/containers/storage/overlay/4c86ac6c6167cbabdf106226fd50fec9a97b22f872a19a49013d7603eeb7be6a/merged 2024-09-17T04:18:34.732 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/containers/storage/overlay/bea264852c5c459de31836c748e934b19d434c50ee8a6f8c9c1fbbf2d4566321/merged 2024-09-17T04:18:34.732 INFO:teuthology.orchestra.run.smithi088.stdout:/run/user/0 2024-09-17T04:18:34.732 INFO:teuthology.orchestra.run.smithi088.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T04:18:34.732 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/containers/storage/overlay/c0ad192d91ebb992e2c22bc72040ea95549fea3deec1796c2afe3ed81950e462/merged 2024-09-17T04:18:34.732 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/containers/storage/overlay/98b746f9f5a32de123cfa85b6dffa36799901bee9618c010190a50a9da9c31af/merged 2024-09-17T04:18:34.732 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/containers/storage/overlay/5ca035b45af92c237230111a60ade9719d0205a867325767f65d2fd2297cbeea/merged 2024-09-17T04:18:34.732 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/containers/storage/overlay/18d876510b0290ef88687d04eb05dca88f76eb763f0e05a995fd3ff8aa1ab30f/merged 2024-09-17T04:18:34.733 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/containers/storage/overlay/6dbe1868cc03baf88040ca9189819183d3cb11fdff9f7965da0964912bf16bb2/merged 2024-09-17T04:18:34.733 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/containers/storage/overlay/c3e69b3b1505f74a6008a5544bf40aa9c736ced342dd6a3b0b33714fd331e852/merged 2024-09-17T04:18:34.733 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/containers/storage/overlay/8fbecbfb460e6abdead44f14c601a62e9be0016e4d448fa88cf0acbaa2ce8311/merged 2024-09-17T04:18:34.733 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/containers/storage/overlay/40f0c39e7358c284d87b081f60f76150ddafbe5238ec96d76194a5447579d991/merged 2024-09-17T04:18:34.733 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/containers/storage/overlay/46e182a5c66e79a4c10639558526d9e17970ccc3e8f2aad1b1cc0359a2095b67/merged 2024-09-17T04:18:34.733 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/containers/storage/overlay/e583521070f09051bff1d2bc0f19c01c0e5d3400dd0ff249cec47136b713da0c/merged 2024-09-17T04:18:34.733 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/containers/storage/overlay/3cb7a888a8af82f4fa2bb11337fde99fee90674369a41c66f1c57ae3b8962051/merged 2024-09-17T04:18:34.733 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns 2024-09-17T04:18:34.733 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T04:18:34.733 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T04:18:34.733 INFO:teuthology.orchestra.run.smithi088.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-17T04:18:34.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:18:34.734 DEBUG:teuthology.orchestra.run.smithi088:> ls /sys/fs/fuse/connections 2024-09-17T04:18:34.790 INFO:teuthology.orchestra.run.smithi088.stdout:136 2024-09-17T04:18:34.790 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [136] 2024-09-17T04:18:34.790 DEBUG:teuthology.orchestra.run.smithi088:> sudo stdin-killer -- python3 -c ' 2024-09-17T04:18:34.791 DEBUG:teuthology.orchestra.run.smithi088:> import glob 2024-09-17T04:18:34.791 DEBUG:teuthology.orchestra.run.smithi088:> import re 2024-09-17T04:18:34.791 DEBUG:teuthology.orchestra.run.smithi088:> import os 2024-09-17T04:18:34.791 DEBUG:teuthology.orchestra.run.smithi088:> import subprocess 2024-09-17T04:18:34.791 DEBUG:teuthology.orchestra.run.smithi088:> 2024-09-17T04:18:34.791 DEBUG:teuthology.orchestra.run.smithi088:> def _find_admin_socket(client_name): 2024-09-17T04:18:34.791 DEBUG:teuthology.orchestra.run.smithi088:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-17T04:18:34.791 DEBUG:teuthology.orchestra.run.smithi088:> files = glob.glob(asok_path) 2024-09-17T04:18:34.791 DEBUG:teuthology.orchestra.run.smithi088:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-17T04:18:34.791 DEBUG:teuthology.orchestra.run.smithi088:> 2024-09-17T04:18:34.791 DEBUG:teuthology.orchestra.run.smithi088:> # Given a non-glob path, it better be there 2024-09-17T04:18:34.791 DEBUG:teuthology.orchestra.run.smithi088:> if "*" not in asok_path: 2024-09-17T04:18:34.791 DEBUG:teuthology.orchestra.run.smithi088:> assert(len(files) == 1) 2024-09-17T04:18:34.792 DEBUG:teuthology.orchestra.run.smithi088:> return files[0] 2024-09-17T04:18:34.792 DEBUG:teuthology.orchestra.run.smithi088:> 2024-09-17T04:18:34.792 DEBUG:teuthology.orchestra.run.smithi088:> for f in files: 2024-09-17T04:18:34.792 DEBUG:teuthology.orchestra.run.smithi088:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-17T04:18:34.792 DEBUG:teuthology.orchestra.run.smithi088:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-17T04:18:34.792 DEBUG:teuthology.orchestra.run.smithi088:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-17T04:18:34.792 DEBUG:teuthology.orchestra.run.smithi088:> contents = proc_f.read() 2024-09-17T04:18:34.792 DEBUG:teuthology.orchestra.run.smithi088:> if mountpoint in contents: 2024-09-17T04:18:34.792 DEBUG:teuthology.orchestra.run.smithi088:> return f 2024-09-17T04:18:34.792 DEBUG:teuthology.orchestra.run.smithi088:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-17T04:18:34.792 DEBUG:teuthology.orchestra.run.smithi088:> 2024-09-17T04:18:34.792 DEBUG:teuthology.orchestra.run.smithi088:> print(_find_admin_socket("client.0")) 2024-09-17T04:18:34.792 DEBUG:teuthology.orchestra.run.smithi088:> ' 2024-09-17T04:18:34.852 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:34 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:34.852 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:34 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:34.852 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:34 smithi088 ceph-mon[27811]: pgmap v189: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 9.9 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-17T04:18:34.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:34 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:34.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:34 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:34.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:34 smithi134 ceph-mon[35201]: pgmap v189: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 9.9 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-17T04:18:34.908 INFO:teuthology.orchestra.run.smithi088.stdout:/var/run/ceph/ceph-client.0.76499.asok 2024-09-17T04:18:34.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:18:34.918 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.76499.asok 2024-09-17T04:18:34.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:18:34.918 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.76499.asok status 2024-09-17T04:18:35.052 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-17T04:18:35.052 INFO:teuthology.orchestra.run.smithi088.stdout: "metadata": { 2024-09-17T04:18:35.052 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_sha1": "8e98666cb045318799c9328f1ae906cc2d724fd2", 2024-09-17T04:18:35.052 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_version": "ceph version 19.2.0 (8e98666cb045318799c9328f1ae906cc2d724fd2) squid (stable)", 2024-09-17T04:18:35.052 INFO:teuthology.orchestra.run.smithi088.stdout: "entity_id": "0", 2024-09-17T04:18:35.052 INFO:teuthology.orchestra.run.smithi088.stdout: "hostname": "smithi088", 2024-09-17T04:18:35.052 INFO:teuthology.orchestra.run.smithi088.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-17T04:18:35.052 INFO:teuthology.orchestra.run.smithi088.stdout: "pid": "76499", 2024-09-17T04:18:35.052 INFO:teuthology.orchestra.run.smithi088.stdout: "root": "/" 2024-09-17T04:18:35.053 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:18:35.053 INFO:teuthology.orchestra.run.smithi088.stdout: "dentry_count": 0, 2024-09-17T04:18:35.053 INFO:teuthology.orchestra.run.smithi088.stdout: "dentry_pinned_count": 0, 2024-09-17T04:18:35.053 INFO:teuthology.orchestra.run.smithi088.stdout: "id": 14626, 2024-09-17T04:18:35.053 INFO:teuthology.orchestra.run.smithi088.stdout: "inst": { 2024-09-17T04:18:35.053 INFO:teuthology.orchestra.run.smithi088.stdout: "name": { 2024-09-17T04:18:35.053 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "client", 2024-09-17T04:18:35.053 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 14626 2024-09-17T04:18:35.053 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:18:35.053 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": { 2024-09-17T04:18:35.053 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-17T04:18:35.053 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "192.168.0.1:0", 2024-09-17T04:18:35.054 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 3146504306 2024-09-17T04:18:35.054 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-17T04:18:35.054 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:18:35.054 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": { 2024-09-17T04:18:35.054 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-17T04:18:35.054 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "192.168.0.1:0", 2024-09-17T04:18:35.054 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 3146504306 2024-09-17T04:18:35.054 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:18:35.055 INFO:teuthology.orchestra.run.smithi088.stdout: "inst_str": "client.14626 192.168.0.1:0/3146504306", 2024-09-17T04:18:35.055 INFO:teuthology.orchestra.run.smithi088.stdout: "addr_str": "192.168.0.1:0/3146504306", 2024-09-17T04:18:35.055 INFO:teuthology.orchestra.run.smithi088.stdout: "inode_count": 1, 2024-09-17T04:18:35.055 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_epoch": 15, 2024-09-17T04:18:35.055 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_epoch": 45, 2024-09-17T04:18:35.055 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_epoch_barrier": 0, 2024-09-17T04:18:35.055 INFO:teuthology.orchestra.run.smithi088.stdout: "blocklisted": false, 2024-09-17T04:18:35.055 INFO:teuthology.orchestra.run.smithi088.stdout: "fs_name": "cephfs" 2024-09-17T04:18:35.055 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-17T04:18:35.060 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-17T04:18:35.061 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-17T04:18:36.023 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:18:36.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:36.449+0000 7fc0cb38a640 1 -- 172.21.15.88:0/3451246768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0c4102ac0 msgr2=0x7fc0c4102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:36.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:36.449+0000 7fc0cb38a640 1 --2- 172.21.15.88:0/3451246768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0c4102ac0 0x7fc0c4102ea0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc0c0009880 tx=0x7fc0c002a530 comp rx=0 tx=0).stop 2024-09-17T04:18:36.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:36.449+0000 7fc0cb38a640 1 -- 172.21.15.88:0/3451246768 shutdown_connections 2024-09-17T04:18:36.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:36.449+0000 7fc0cb38a640 1 --2- 172.21.15.88:0/3451246768 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0c41033e0 0x7fc0c410b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:36.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:36.450+0000 7fc0cb38a640 1 --2- 172.21.15.88:0/3451246768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0c4102ac0 0x7fc0c4102ea0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:36.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:36.450+0000 7fc0cb38a640 1 -- 172.21.15.88:0/3451246768 >> 172.21.15.88:0/3451246768 conn(0x7fc0c40fc520 msgr2=0x7fc0c40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:36.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:36.450+0000 7fc0cb38a640 1 -- 172.21.15.88:0/3451246768 shutdown_connections 2024-09-17T04:18:36.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:36.450+0000 7fc0cb38a640 1 -- 172.21.15.88:0/3451246768 wait complete. 2024-09-17T04:18:36.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:36.450+0000 7fc0cb38a640 1 Processor -- start 2024-09-17T04:18:36.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:36.450+0000 7fc0cb38a640 1 -- start start 2024-09-17T04:18:36.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:36.451+0000 7fc0cb38a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0c4102ac0 0x7fc0c419d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:36.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:36.451+0000 7fc0cb38a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0c41033e0 0x7fc0c419db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:36.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:36.451+0000 7fc0cb38a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c410edf0 con 0x7fc0c4102ac0 2024-09-17T04:18:36.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:36.451+0000 7fc0cb38a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c410ec70 con 0x7fc0c41033e0 2024-09-17T04:18:36.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:36.451+0000 7fc0c9126640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0c4102ac0 0x7fc0c419d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:36.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:36.451+0000 7fc0c9126640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0c4102ac0 0x7fc0c419d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47620/0 (socket says 172.21.15.88:47620) 2024-09-17T04:18:36.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:36.451+0000 7fc0c9126640 1 -- 172.21.15.88:0/3860206124 learned_addr learned my addr 172.21.15.88:0/3860206124 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:18:36.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:36.451+0000 7fc0c8925640 1 --2- 172.21.15.88:0/3860206124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0c41033e0 0x7fc0c419db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:36.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:36.451+0000 7fc0c9126640 1 -- 172.21.15.88:0/3860206124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0c41033e0 msgr2=0x7fc0c419db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:36.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:36.451+0000 7fc0c9126640 1 --2- 172.21.15.88:0/3860206124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0c41033e0 0x7fc0c419db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:36.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:36.451+0000 7fc0c9126640 1 -- 172.21.15.88:0/3860206124 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0c41977c0 con 0x7fc0c4102ac0 2024-09-17T04:18:36.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:36.451+0000 7fc0c9126640 1 --2- 172.21.15.88:0/3860206124 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0c4102ac0 0x7fc0c419d640 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc0c0031460 tx=0x7fc0c00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:36.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:36.451+0000 7fc0ba7fc640 1 -- 172.21.15.88:0/3860206124 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc0c003f070 con 0x7fc0c4102ac0 2024-09-17T04:18:36.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:36.452+0000 7fc0ba7fc640 1 -- 172.21.15.88:0/3860206124 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc0c00035f0 con 0x7fc0c4102ac0 2024-09-17T04:18:36.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:36.452+0000 7fc0cb38a640 1 -- 172.21.15.88:0/3860206124 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0c4197a50 con 0x7fc0c4102ac0 2024-09-17T04:18:36.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:36.452+0000 7fc0ba7fc640 1 -- 172.21.15.88:0/3860206124 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc0c0035030 con 0x7fc0c4102ac0 2024-09-17T04:18:36.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:36.452+0000 7fc0cb38a640 1 -- 172.21.15.88:0/3860206124 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0c4197f80 con 0x7fc0c4102ac0 2024-09-17T04:18:36.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:36.453+0000 7fc0cb38a640 1 -- 172.21.15.88:0/3860206124 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0c406aa90 con 0x7fc0c4102ac0 2024-09-17T04:18:36.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:36.453+0000 7fc0ba7fc640 1 -- 172.21.15.88:0/3860206124 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fc0c0042070 con 0x7fc0c4102ac0 2024-09-17T04:18:36.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:36.454+0000 7fc0ba7fc640 1 --2- 172.21.15.88:0/3860206124 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fc0b006e2b0 0x7fc0b0070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:36.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:36.454+0000 7fc0ba7fc640 1 -- 172.21.15.88:0/3860206124 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7fc0c00aeae0 con 0x7fc0c4102ac0 2024-09-17T04:18:36.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:36.454+0000 7fc0c8925640 1 --2- 172.21.15.88:0/3860206124 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fc0b006e2b0 0x7fc0b0070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:36.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:36.454+0000 7fc0c8925640 1 --2- 172.21.15.88:0/3860206124 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fc0b006e2b0 0x7fc0b0070770 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc0c4108900 tx=0x7fc0b400b2e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:36.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:36.458+0000 7fc0ba7fc640 1 -- 172.21.15.88:0/3860206124 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc0c0080090 con 0x7fc0c4102ac0 2024-09-17T04:18:36.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:36.680+0000 7fc0cb38a640 1 -- 172.21.15.88:0/3860206124 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc0c4198230 con 0x7fc0c4102ac0 2024-09-17T04:18:36.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:36.680+0000 7fc0ba7fc640 1 -- 172.21.15.88:0/3860206124 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) ==== 53+0+83 (secure 0 0 0) 0x7fc0c00848c0 con 0x7fc0c4102ac0 2024-09-17T04:18:36.680 INFO:teuthology.orchestra.run.smithi088.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-17T04:18:36.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:36.683+0000 7fc0cb38a640 1 -- 172.21.15.88:0/3860206124 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fc0b006e2b0 msgr2=0x7fc0b0070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:36.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:36.683+0000 7fc0cb38a640 1 --2- 172.21.15.88:0/3860206124 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fc0b006e2b0 0x7fc0b0070770 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc0c4108900 tx=0x7fc0b400b2e0 comp rx=0 tx=0).stop 2024-09-17T04:18:36.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:36.683+0000 7fc0cb38a640 1 -- 172.21.15.88:0/3860206124 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0c4102ac0 msgr2=0x7fc0c419d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:36.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:36.683+0000 7fc0cb38a640 1 --2- 172.21.15.88:0/3860206124 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0c4102ac0 0x7fc0c419d640 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc0c0031460 tx=0x7fc0c00045e0 comp rx=0 tx=0).stop 2024-09-17T04:18:36.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:36.683+0000 7fc0cb38a640 1 -- 172.21.15.88:0/3860206124 shutdown_connections 2024-09-17T04:18:36.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:36.683+0000 7fc0cb38a640 1 --2- 172.21.15.88:0/3860206124 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fc0b006e2b0 0x7fc0b0070770 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:36.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:36.683+0000 7fc0cb38a640 1 --2- 172.21.15.88:0/3860206124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0c41033e0 0x7fc0c419db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:36.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:36.683+0000 7fc0cb38a640 1 --2- 172.21.15.88:0/3860206124 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0c4102ac0 0x7fc0c419d640 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:36.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:36.683+0000 7fc0cb38a640 1 -- 172.21.15.88:0/3860206124 >> 172.21.15.88:0/3860206124 conn(0x7fc0c40fc520 msgr2=0x7fc0c410aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:36.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:36.683+0000 7fc0cb38a640 1 -- 172.21.15.88:0/3860206124 shutdown_connections 2024-09-17T04:18:36.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:36.683+0000 7fc0cb38a640 1 -- 172.21.15.88:0/3860206124 wait complete. 2024-09-17T04:18:37.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:36 smithi088 ceph-mon[27811]: pgmap v190: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 8.9 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-17T04:18:37.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:36 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:37.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:36 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:37.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:36 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:18:37.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:36 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:18:37.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:36 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:37.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:36 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/3860206124' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-17T04:18:37.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:36 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:18:37.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:36 smithi134 ceph-mon[35201]: pgmap v190: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 8.9 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-17T04:18:37.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:36 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:37.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:36 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:37.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:36 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:18:37.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:36 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:18:37.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:36 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:37.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:36 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/3860206124' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-17T04:18:37.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:36 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:18:37.302 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T04:18:37.302 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T04:18:37.302 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi134.front.sepia.ceph.com 2024-09-17T04:18:37.302 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T04:18:37.302 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T04:18:37.303 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T04:18:37.303 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T04:18:37.303 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T04:18:37.303 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T04:18:37.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:18:37.303 DEBUG:teuthology.orchestra.run.smithi134:> ip addr 2024-09-17T04:18:37.319 INFO:teuthology.orchestra.run.smithi134.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T04:18:37.320 INFO:teuthology.orchestra.run.smithi134.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T04:18:37.320 INFO:teuthology.orchestra.run.smithi134.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T04:18:37.320 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:18:37.320 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 ::1/128 scope host 2024-09-17T04:18:37.320 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:18:37.320 INFO:teuthology.orchestra.run.smithi134.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T04:18:37.320 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e6 brd ff:ff:ff:ff:ff:ff 2024-09-17T04:18:37.320 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f0 2024-09-17T04:18:37.320 INFO:teuthology.orchestra.run.smithi134.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T04:18:37.320 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e7 brd ff:ff:ff:ff:ff:ff 2024-09-17T04:18:37.320 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f1 2024-09-17T04:18:37.320 INFO:teuthology.orchestra.run.smithi134.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T04:18:37.321 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e8 brd ff:ff:ff:ff:ff:ff 2024-09-17T04:18:37.321 INFO:teuthology.orchestra.run.smithi134.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T04:18:37.321 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e9 brd ff:ff:ff:ff:ff:ff 2024-09-17T04:18:37.321 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.21.15.134/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T04:18:37.321 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft 42302sec preferred_lft 42302sec 2024-09-17T04:18:37.321 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::ec4:7aff:fe88:6de9/64 scope link noprefixroute 2024-09-17T04:18:37.321 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:18:37.321 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-17T04:18:37.321 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:18:37.322 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-09-17T04:18:37.322 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link add name ceph-brx type bridge 2024-09-17T04:18:37.322 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip addr flush dev ceph-brx 2024-09-17T04:18:37.322 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set ceph-brx up 2024-09-17T04:18:37.322 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-17T04:18:37.322 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-09-17T04:18:37.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:18:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:18:37.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:18:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:18:37.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:18:37.518 DEBUG:teuthology.orchestra.run.smithi134:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T04:18:37.544 INFO:teuthology.orchestra.run.smithi134.stdout:1 2024-09-17T04:18:37.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:18:37.545 DEBUG:teuthology.orchestra.run.smithi134:> route 2024-09-17T04:18:37.614 INFO:teuthology.orchestra.run.smithi134.stdout:Kernel IP routing table 2024-09-17T04:18:37.614 INFO:teuthology.orchestra.run.smithi134.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T04:18:37.614 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T04:18:37.614 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T04:18:37.614 INFO:teuthology.orchestra.run.smithi134.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T04:18:37.615 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:18:37.615 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-09-17T04:18:37.615 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T04:18:37.615 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T04:18:37.615 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T04:18:37.615 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-09-17T04:18:37.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:18:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:18:37.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:18:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:18:37.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:18:37.923 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2024-09-17T04:18:37.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:18:37.939 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list-id 2024-09-17T04:18:37.994 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:18:37.995 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-09-17T04:18:37.995 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T04:18:37.995 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-17T04:18:37.995 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-09-17T04:18:38.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:18:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:18:38.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:18:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:18:38.112 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-17T04:18:38.112 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:18:38.112 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-09-17T04:18:38.113 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-17T04:18:38.113 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-17T04:18:38.113 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-17T04:18:38.113 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-17T04:18:38.113 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-17T04:18:38.113 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-09-17T04:18:38.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:18:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:18:38.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:18:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:18:38.238 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:18:38.238 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-09-17T04:18:38.238 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set brx.0 up 2024-09-17T04:18:38.238 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set dev brx.0 master ceph-brx 2024-09-17T04:18:38.238 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-09-17T04:18:38.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:18:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:18:38.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:18:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:18:38.314 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-17T04:18:38.314 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T04:18:38.314 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T04:18:38.329 INFO:teuthology.orchestra.run.smithi134.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T04:18:38.330 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T04:18:38.330 DEBUG:teuthology.orchestra.run.smithi134:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T04:18:38.386 DEBUG:teuthology.orchestra.run.smithi134:> sudo modprobe fuse 2024-09-17T04:18:38.451 DEBUG:teuthology.orchestra.run.smithi134:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T04:18:38.508 INFO:teuthology.orchestra.run.smithi134.stdout:/proc 2024-09-17T04:18:38.509 INFO:teuthology.orchestra.run.smithi134.stdout:/sys 2024-09-17T04:18:38.509 INFO:teuthology.orchestra.run.smithi134.stdout:/dev 2024-09-17T04:18:38.509 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/kernel/security 2024-09-17T04:18:38.509 INFO:teuthology.orchestra.run.smithi134.stdout:/dev/shm 2024-09-17T04:18:38.509 INFO:teuthology.orchestra.run.smithi134.stdout:/dev/pts 2024-09-17T04:18:38.509 INFO:teuthology.orchestra.run.smithi134.stdout:/run 2024-09-17T04:18:38.509 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/fs/cgroup 2024-09-17T04:18:38.510 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/fs/pstore 2024-09-17T04:18:38.510 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/fs/bpf 2024-09-17T04:18:38.510 INFO:teuthology.orchestra.run.smithi134.stdout:/ 2024-09-17T04:18:38.510 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/fs/selinux 2024-09-17T04:18:38.510 INFO:teuthology.orchestra.run.smithi134.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T04:18:38.510 INFO:teuthology.orchestra.run.smithi134.stdout:/dev/mqueue 2024-09-17T04:18:38.510 INFO:teuthology.orchestra.run.smithi134.stdout:/dev/hugepages 2024-09-17T04:18:38.510 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/kernel/debug 2024-09-17T04:18:38.511 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/kernel/tracing 2024-09-17T04:18:38.511 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/fs/fuse/connections 2024-09-17T04:18:38.511 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/kernel/config 2024-09-17T04:18:38.511 INFO:teuthology.orchestra.run.smithi134.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T04:18:38.511 INFO:teuthology.orchestra.run.smithi134.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T04:18:38.511 INFO:teuthology.orchestra.run.smithi134.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T04:18:38.511 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T04:18:38.512 INFO:teuthology.orchestra.run.smithi134.stdout:/run/user/1000 2024-09-17T04:18:38.512 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/ceph 2024-09-17T04:18:38.512 INFO:teuthology.orchestra.run.smithi134.stdout:/run/user/0 2024-09-17T04:18:38.512 INFO:teuthology.orchestra.run.smithi134.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T04:18:38.512 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/containers/storage/overlay 2024-09-17T04:18:38.512 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/containers/storage/overlay/3a79e9e53f8f8d7ab8b797fc3332882e471012b82efd681b103684cf1e0ba6a0/merged 2024-09-17T04:18:38.513 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/containers/storage/overlay/d43ce1a8e544b49198f9d068c8575d077e1c8c7aa7e303559ff185f596906faa/merged 2024-09-17T04:18:38.513 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/containers/storage/overlay/c85f19ce34d56d74a9ab73cde0c0b2ace39fede970e303fccca3a9f29109f30c/merged 2024-09-17T04:18:38.513 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/containers/storage/overlay/8f5690fb24730ae9f9b35e9de7cd6c33b202e3a7ce00e7771adb437cdeb418e8/merged 2024-09-17T04:18:38.513 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/containers/storage/overlay/2b4cf2dc307604f0c214bdd841ba662f5c4352eee1272596d21d23d5c7012032/merged 2024-09-17T04:18:38.513 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/containers/storage/overlay/610868eb2ca1802fd52759b534d3c9bed22968d4d36648353b368c543559fde6/merged 2024-09-17T04:18:38.513 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/containers/storage/overlay/a102f18abaff2986091f309ea1260b254eca76a9e7ccdebb091c01459a5118ed/merged 2024-09-17T04:18:38.513 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/containers/storage/overlay/87d3bd07602daa048e06bcc538a74392cfca59d4e734a79fee8fa99e6617dd5b/merged 2024-09-17T04:18:38.513 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/containers/storage/overlay/882c63dfbf4e6dd4d3490b24b5d188d465a718d3e1f3d749bd94f25f36245a27/merged 2024-09-17T04:18:38.514 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/containers/storage/overlay/b092825fc03f7c2dd2dabb6c8790fa5c22e92544db7bb0a6a2e885326f4b01f5/merged 2024-09-17T04:18:38.514 INFO:teuthology.orchestra.run.smithi134.stdout:/run/netns 2024-09-17T04:18:38.514 INFO:teuthology.orchestra.run.smithi134.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T04:18:38.514 INFO:teuthology.orchestra.run.smithi134.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T04:18:38.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:18:38.514 DEBUG:teuthology.orchestra.run.smithi134:> ls /sys/fs/fuse/connections 2024-09-17T04:18:38.564 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-17T04:18:38.564 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-17T04:18:38.607 DEBUG:teuthology.orchestra.run.smithi134:> sudo modprobe fuse 2024-09-17T04:18:38.632 DEBUG:teuthology.orchestra.run.smithi134:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T04:18:38.688 INFO:teuthology.orchestra.run.smithi134.stdout:/proc 2024-09-17T04:18:38.688 INFO:teuthology.orchestra.run.smithi134.stdout:/sys 2024-09-17T04:18:38.688 INFO:teuthology.orchestra.run.smithi134.stdout:/dev 2024-09-17T04:18:38.688 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/kernel/security 2024-09-17T04:18:38.688 INFO:teuthology.orchestra.run.smithi134.stdout:/dev/shm 2024-09-17T04:18:38.688 INFO:teuthology.orchestra.run.smithi134.stdout:/dev/pts 2024-09-17T04:18:38.688 INFO:teuthology.orchestra.run.smithi134.stdout:/run 2024-09-17T04:18:38.688 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/fs/cgroup 2024-09-17T04:18:38.688 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/fs/pstore 2024-09-17T04:18:38.688 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/fs/bpf 2024-09-17T04:18:38.689 INFO:teuthology.orchestra.run.smithi134.stdout:/ 2024-09-17T04:18:38.689 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/fs/selinux 2024-09-17T04:18:38.689 INFO:teuthology.orchestra.run.smithi134.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T04:18:38.689 INFO:teuthology.orchestra.run.smithi134.stdout:/dev/mqueue 2024-09-17T04:18:38.689 INFO:teuthology.orchestra.run.smithi134.stdout:/dev/hugepages 2024-09-17T04:18:38.689 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/kernel/debug 2024-09-17T04:18:38.689 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/kernel/tracing 2024-09-17T04:18:38.689 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/fs/fuse/connections 2024-09-17T04:18:38.689 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/kernel/config 2024-09-17T04:18:38.689 INFO:teuthology.orchestra.run.smithi134.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T04:18:38.690 INFO:teuthology.orchestra.run.smithi134.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T04:18:38.690 INFO:teuthology.orchestra.run.smithi134.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T04:18:38.690 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T04:18:38.690 INFO:teuthology.orchestra.run.smithi134.stdout:/run/user/1000 2024-09-17T04:18:38.691 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/ceph 2024-09-17T04:18:38.691 INFO:teuthology.orchestra.run.smithi134.stdout:/run/user/0 2024-09-17T04:18:38.691 INFO:teuthology.orchestra.run.smithi134.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T04:18:38.692 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/containers/storage/overlay 2024-09-17T04:18:38.692 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/containers/storage/overlay/3a79e9e53f8f8d7ab8b797fc3332882e471012b82efd681b103684cf1e0ba6a0/merged 2024-09-17T04:18:38.692 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/containers/storage/overlay/d43ce1a8e544b49198f9d068c8575d077e1c8c7aa7e303559ff185f596906faa/merged 2024-09-17T04:18:38.692 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/containers/storage/overlay/c85f19ce34d56d74a9ab73cde0c0b2ace39fede970e303fccca3a9f29109f30c/merged 2024-09-17T04:18:38.692 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/containers/storage/overlay/8f5690fb24730ae9f9b35e9de7cd6c33b202e3a7ce00e7771adb437cdeb418e8/merged 2024-09-17T04:18:38.692 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/containers/storage/overlay/2b4cf2dc307604f0c214bdd841ba662f5c4352eee1272596d21d23d5c7012032/merged 2024-09-17T04:18:38.693 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/containers/storage/overlay/610868eb2ca1802fd52759b534d3c9bed22968d4d36648353b368c543559fde6/merged 2024-09-17T04:18:38.693 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/containers/storage/overlay/a102f18abaff2986091f309ea1260b254eca76a9e7ccdebb091c01459a5118ed/merged 2024-09-17T04:18:38.693 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/containers/storage/overlay/87d3bd07602daa048e06bcc538a74392cfca59d4e734a79fee8fa99e6617dd5b/merged 2024-09-17T04:18:38.693 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/containers/storage/overlay/882c63dfbf4e6dd4d3490b24b5d188d465a718d3e1f3d749bd94f25f36245a27/merged 2024-09-17T04:18:38.693 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/containers/storage/overlay/b092825fc03f7c2dd2dabb6c8790fa5c22e92544db7bb0a6a2e885326f4b01f5/merged 2024-09-17T04:18:38.693 INFO:teuthology.orchestra.run.smithi134.stdout:/run/netns 2024-09-17T04:18:38.694 INFO:teuthology.orchestra.run.smithi134.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T04:18:38.694 INFO:teuthology.orchestra.run.smithi134.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T04:18:38.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:18:38.694 DEBUG:teuthology.orchestra.run.smithi134:> ls /sys/fs/fuse/connections 2024-09-17T04:18:38.757 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi134.stderr:2024-09-17T04:18:38.758+0000 7f58f1f1f480 -1 init, newargv = 0x560682ae6fa0 newargc=15 2024-09-17T04:18:38.757 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi134.stderr:ceph-fuse[61624]: starting ceph client 2024-09-17T04:18:38.762 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi134.stderr:ceph-fuse[61624]: starting fuse 2024-09-17T04:18:39.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:38 smithi088 ceph-mon[27811]: pgmap v191: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 8.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-17T04:18:39.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:38 smithi134 ceph-mon[35201]: pgmap v191: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 8.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-17T04:18:39.844 DEBUG:teuthology.orchestra.run.smithi134:> sudo modprobe fuse 2024-09-17T04:18:39.876 DEBUG:teuthology.orchestra.run.smithi134:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T04:18:39.935 INFO:teuthology.orchestra.run.smithi134.stdout:/proc 2024-09-17T04:18:39.935 INFO:teuthology.orchestra.run.smithi134.stdout:/sys 2024-09-17T04:18:39.935 INFO:teuthology.orchestra.run.smithi134.stdout:/dev 2024-09-17T04:18:39.935 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/kernel/security 2024-09-17T04:18:39.936 INFO:teuthology.orchestra.run.smithi134.stdout:/dev/shm 2024-09-17T04:18:39.936 INFO:teuthology.orchestra.run.smithi134.stdout:/dev/pts 2024-09-17T04:18:39.936 INFO:teuthology.orchestra.run.smithi134.stdout:/run 2024-09-17T04:18:39.936 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/fs/cgroup 2024-09-17T04:18:39.936 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/fs/pstore 2024-09-17T04:18:39.936 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/fs/bpf 2024-09-17T04:18:39.936 INFO:teuthology.orchestra.run.smithi134.stdout:/ 2024-09-17T04:18:39.936 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/fs/selinux 2024-09-17T04:18:39.936 INFO:teuthology.orchestra.run.smithi134.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T04:18:39.936 INFO:teuthology.orchestra.run.smithi134.stdout:/dev/mqueue 2024-09-17T04:18:39.936 INFO:teuthology.orchestra.run.smithi134.stdout:/dev/hugepages 2024-09-17T04:18:39.936 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/kernel/debug 2024-09-17T04:18:39.937 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/kernel/tracing 2024-09-17T04:18:39.937 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/fs/fuse/connections 2024-09-17T04:18:39.937 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/kernel/config 2024-09-17T04:18:39.937 INFO:teuthology.orchestra.run.smithi134.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T04:18:39.937 INFO:teuthology.orchestra.run.smithi134.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T04:18:39.937 INFO:teuthology.orchestra.run.smithi134.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T04:18:39.937 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T04:18:39.937 INFO:teuthology.orchestra.run.smithi134.stdout:/run/user/1000 2024-09-17T04:18:39.937 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/ceph 2024-09-17T04:18:39.937 INFO:teuthology.orchestra.run.smithi134.stdout:/run/user/0 2024-09-17T04:18:39.937 INFO:teuthology.orchestra.run.smithi134.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T04:18:39.937 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/containers/storage/overlay 2024-09-17T04:18:39.937 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/containers/storage/overlay/3a79e9e53f8f8d7ab8b797fc3332882e471012b82efd681b103684cf1e0ba6a0/merged 2024-09-17T04:18:39.937 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/containers/storage/overlay/d43ce1a8e544b49198f9d068c8575d077e1c8c7aa7e303559ff185f596906faa/merged 2024-09-17T04:18:39.938 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/containers/storage/overlay/c85f19ce34d56d74a9ab73cde0c0b2ace39fede970e303fccca3a9f29109f30c/merged 2024-09-17T04:18:39.938 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/containers/storage/overlay/8f5690fb24730ae9f9b35e9de7cd6c33b202e3a7ce00e7771adb437cdeb418e8/merged 2024-09-17T04:18:39.938 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/containers/storage/overlay/2b4cf2dc307604f0c214bdd841ba662f5c4352eee1272596d21d23d5c7012032/merged 2024-09-17T04:18:39.938 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/containers/storage/overlay/610868eb2ca1802fd52759b534d3c9bed22968d4d36648353b368c543559fde6/merged 2024-09-17T04:18:39.938 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/containers/storage/overlay/a102f18abaff2986091f309ea1260b254eca76a9e7ccdebb091c01459a5118ed/merged 2024-09-17T04:18:39.938 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/containers/storage/overlay/87d3bd07602daa048e06bcc538a74392cfca59d4e734a79fee8fa99e6617dd5b/merged 2024-09-17T04:18:39.938 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/containers/storage/overlay/882c63dfbf4e6dd4d3490b24b5d188d465a718d3e1f3d749bd94f25f36245a27/merged 2024-09-17T04:18:39.938 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/containers/storage/overlay/b092825fc03f7c2dd2dabb6c8790fa5c22e92544db7bb0a6a2e885326f4b01f5/merged 2024-09-17T04:18:39.938 INFO:teuthology.orchestra.run.smithi134.stdout:/run/netns 2024-09-17T04:18:39.938 INFO:teuthology.orchestra.run.smithi134.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T04:18:39.938 INFO:teuthology.orchestra.run.smithi134.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T04:18:39.939 INFO:teuthology.orchestra.run.smithi134.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-17T04:18:39.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:18:39.939 DEBUG:teuthology.orchestra.run.smithi134:> ls /sys/fs/fuse/connections 2024-09-17T04:18:39.994 INFO:teuthology.orchestra.run.smithi134.stdout:129 2024-09-17T04:18:39.994 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [129] 2024-09-17T04:18:39.994 DEBUG:teuthology.orchestra.run.smithi134:> sudo stdin-killer -- python3 -c ' 2024-09-17T04:18:39.994 DEBUG:teuthology.orchestra.run.smithi134:> import glob 2024-09-17T04:18:39.994 DEBUG:teuthology.orchestra.run.smithi134:> import re 2024-09-17T04:18:39.994 DEBUG:teuthology.orchestra.run.smithi134:> import os 2024-09-17T04:18:39.995 DEBUG:teuthology.orchestra.run.smithi134:> import subprocess 2024-09-17T04:18:39.995 DEBUG:teuthology.orchestra.run.smithi134:> 2024-09-17T04:18:39.995 DEBUG:teuthology.orchestra.run.smithi134:> def _find_admin_socket(client_name): 2024-09-17T04:18:39.995 DEBUG:teuthology.orchestra.run.smithi134:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-17T04:18:39.995 DEBUG:teuthology.orchestra.run.smithi134:> files = glob.glob(asok_path) 2024-09-17T04:18:39.995 DEBUG:teuthology.orchestra.run.smithi134:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-17T04:18:39.995 DEBUG:teuthology.orchestra.run.smithi134:> 2024-09-17T04:18:39.995 DEBUG:teuthology.orchestra.run.smithi134:> # Given a non-glob path, it better be there 2024-09-17T04:18:39.995 DEBUG:teuthology.orchestra.run.smithi134:> if "*" not in asok_path: 2024-09-17T04:18:39.995 DEBUG:teuthology.orchestra.run.smithi134:> assert(len(files) == 1) 2024-09-17T04:18:39.995 DEBUG:teuthology.orchestra.run.smithi134:> return files[0] 2024-09-17T04:18:39.995 DEBUG:teuthology.orchestra.run.smithi134:> 2024-09-17T04:18:39.995 DEBUG:teuthology.orchestra.run.smithi134:> for f in files: 2024-09-17T04:18:39.995 DEBUG:teuthology.orchestra.run.smithi134:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-17T04:18:39.995 DEBUG:teuthology.orchestra.run.smithi134:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-17T04:18:39.996 DEBUG:teuthology.orchestra.run.smithi134:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-17T04:18:39.996 DEBUG:teuthology.orchestra.run.smithi134:> contents = proc_f.read() 2024-09-17T04:18:39.996 DEBUG:teuthology.orchestra.run.smithi134:> if mountpoint in contents: 2024-09-17T04:18:39.996 DEBUG:teuthology.orchestra.run.smithi134:> return f 2024-09-17T04:18:39.996 DEBUG:teuthology.orchestra.run.smithi134:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-17T04:18:39.996 DEBUG:teuthology.orchestra.run.smithi134:> 2024-09-17T04:18:39.996 DEBUG:teuthology.orchestra.run.smithi134:> print(_find_admin_socket("client.1")) 2024-09-17T04:18:39.996 DEBUG:teuthology.orchestra.run.smithi134:> ' 2024-09-17T04:18:40.119 INFO:teuthology.orchestra.run.smithi134.stdout:/var/run/ceph/ceph-client.1.61624.asok 2024-09-17T04:18:40.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T04:18:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:18:40.130 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.61624.asok 2024-09-17T04:18:40.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:18:40.130 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.61624.asok status 2024-09-17T04:18:40.263 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T04:18:40.263 INFO:teuthology.orchestra.run.smithi134.stdout: "metadata": { 2024-09-17T04:18:40.264 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_sha1": "8e98666cb045318799c9328f1ae906cc2d724fd2", 2024-09-17T04:18:40.264 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_version": "ceph version 19.2.0 (8e98666cb045318799c9328f1ae906cc2d724fd2) squid (stable)", 2024-09-17T04:18:40.264 INFO:teuthology.orchestra.run.smithi134.stdout: "entity_id": "1", 2024-09-17T04:18:40.264 INFO:teuthology.orchestra.run.smithi134.stdout: "hostname": "smithi134", 2024-09-17T04:18:40.264 INFO:teuthology.orchestra.run.smithi134.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-17T04:18:40.264 INFO:teuthology.orchestra.run.smithi134.stdout: "pid": "61624", 2024-09-17T04:18:40.264 INFO:teuthology.orchestra.run.smithi134.stdout: "root": "/" 2024-09-17T04:18:40.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T04:18:40.264 INFO:teuthology.orchestra.run.smithi134.stdout: "dentry_count": 0, 2024-09-17T04:18:40.264 INFO:teuthology.orchestra.run.smithi134.stdout: "dentry_pinned_count": 0, 2024-09-17T04:18:40.264 INFO:teuthology.orchestra.run.smithi134.stdout: "id": 24347, 2024-09-17T04:18:40.264 INFO:teuthology.orchestra.run.smithi134.stdout: "inst": { 2024-09-17T04:18:40.265 INFO:teuthology.orchestra.run.smithi134.stdout: "name": { 2024-09-17T04:18:40.265 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "client", 2024-09-17T04:18:40.265 INFO:teuthology.orchestra.run.smithi134.stdout: "num": 24347 2024-09-17T04:18:40.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T04:18:40.265 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": { 2024-09-17T04:18:40.265 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-17T04:18:40.265 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "192.168.0.1:0", 2024-09-17T04:18:40.265 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 981223485 2024-09-17T04:18:40.265 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T04:18:40.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T04:18:40.265 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": { 2024-09-17T04:18:40.265 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-09-17T04:18:40.266 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "192.168.0.1:0", 2024-09-17T04:18:40.266 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 981223485 2024-09-17T04:18:40.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T04:18:40.266 INFO:teuthology.orchestra.run.smithi134.stdout: "inst_str": "client.24347 192.168.0.1:0/981223485", 2024-09-17T04:18:40.266 INFO:teuthology.orchestra.run.smithi134.stdout: "addr_str": "192.168.0.1:0/981223485", 2024-09-17T04:18:40.266 INFO:teuthology.orchestra.run.smithi134.stdout: "inode_count": 1, 2024-09-17T04:18:40.266 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_epoch": 15, 2024-09-17T04:18:40.266 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_epoch": 45, 2024-09-17T04:18:40.266 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_epoch_barrier": 0, 2024-09-17T04:18:40.266 INFO:teuthology.orchestra.run.smithi134.stdout: "blocklisted": false, 2024-09-17T04:18:40.266 INFO:teuthology.orchestra.run.smithi134.stdout: "fs_name": "cephfs" 2024-09-17T04:18:40.266 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T04:18:40.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:18:40.272 DEBUG:teuthology.orchestra.run.smithi088:> stat --file-system '--printf=%T 2024-09-17T04:18:40.272 DEBUG:teuthology.orchestra.run.smithi088:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-17T04:18:40.292 INFO:teuthology.orchestra.run.smithi088.stdout:fuseblk 2024-09-17T04:18:40.293 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-17T04:18:40.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:18:40.293 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T04:18:40.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:18:40.364 DEBUG:teuthology.orchestra.run.smithi134:> stat --file-system '--printf=%T 2024-09-17T04:18:40.364 DEBUG:teuthology.orchestra.run.smithi134:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-17T04:18:40.380 INFO:teuthology.orchestra.run.smithi134.stdout:fuseblk 2024-09-17T04:18:40.381 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-17T04:18:40.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:18:40.381 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T04:18:40.448 INFO:teuthology.run_tasks:Running task print... 2024-09-17T04:18:40.459 INFO:teuthology.task.print:**** done client 2024-09-17T04:18:40.460 INFO:teuthology.run_tasks:Running task parallel... 2024-09-17T04:18:40.469 INFO:teuthology.task.parallel:starting parallel... 2024-09-17T04:18:40.470 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-17T04:18:40.470 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-17T04:18:40.471 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi088.front.sepia.ceph.com 2024-09-17T04:18:40.471 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -e sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs false || true' 2024-09-17T04:18:40.471 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-17T04:18:40.471 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-09-17T04:18:40.477 INFO:tasks.workunit:Pulling workunits from ref ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T04:18:40.477 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-17T04:18:40.477 INFO:tasks.workunit:timeout=3h 2024-09-17T04:18:40.477 INFO:tasks.workunit:cleanup=True 2024-09-17T04:18:40.478 DEBUG:teuthology.orchestra.run.smithi088:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-17T04:18:40.496 INFO:teuthology.orchestra.run.smithi088.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-17T04:18:40.496 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-17T04:18:40.496 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 88h/136d Inode: 1 Links: 2 2024-09-17T04:18:40.496 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T04:18:40.496 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-17T04:18:40.496 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-17T04:18:40.496 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2024-09-17 04:18:14.509162036 +0000 2024-09-17T04:18:40.496 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2024-09-17 04:18:40.362401330 +0000 2024-09-17T04:18:40.496 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: - 2024-09-17T04:18:40.497 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-17T04:18:40.497 DEBUG:teuthology.orchestra.run.smithi088:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-17T04:18:40.566 DEBUG:teuthology.orchestra.run.smithi134:> stat -- /home/ubuntu/cephtest/mnt.1 2024-09-17T04:18:40.583 INFO:teuthology.orchestra.run.smithi134.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-09-17T04:18:40.583 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-17T04:18:40.583 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 81h/129d Inode: 1 Links: 3 2024-09-17T04:18:40.584 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T04:18:40.584 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-17T04:18:40.584 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-17T04:18:40.584 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-17 04:18:40.562126296 +0000 2024-09-17T04:18:40.584 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-17 04:18:40.562126296 +0000 2024-09-17T04:18:40.585 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2024-09-17T04:18:40.585 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-09-17T04:18:40.585 DEBUG:teuthology.orchestra.run.smithi134:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-09-17T04:18:40.653 DEBUG:teuthology.orchestra.run.smithi088:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T04:18:40.654 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T04:18:40.671 INFO:tasks.workunit.client.0.smithi088.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-17T04:18:40.710 INFO:tasks.workunit.client.1.smithi134.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-09-17T04:18:40.738 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:18:40.986 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:40 smithi088 ceph-mon[27811]: pgmap v192: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 7.7 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-17T04:18:41.148 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:40 smithi134 ceph-mon[35201]: pgmap v192: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 7.7 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-17T04:18:41.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:41.186+0000 7fce6446d640 1 -- 172.21.15.88:0/351014166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce5c100860 msgr2=0x7fce5c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:41.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:41.186+0000 7fce6446d640 1 --2- 172.21.15.88:0/351014166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce5c100860 0x7fce5c100c60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fce58009880 tx=0x7fce5802a4a0 comp rx=0 tx=0).stop 2024-09-17T04:18:41.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:41.187+0000 7fce6446d640 1 -- 172.21.15.88:0/351014166 shutdown_connections 2024-09-17T04:18:41.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:41.187+0000 7fce6446d640 1 --2- 172.21.15.88:0/351014166 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce5c101a60 0x7fce5c101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:41.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:41.187+0000 7fce6446d640 1 --2- 172.21.15.88:0/351014166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce5c100860 0x7fce5c100c60 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:41.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:41.187+0000 7fce6446d640 1 -- 172.21.15.88:0/351014166 >> 172.21.15.88:0/351014166 conn(0x7fce5c0fc010 msgr2=0x7fce5c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:41.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:41.187+0000 7fce6446d640 1 -- 172.21.15.88:0/351014166 shutdown_connections 2024-09-17T04:18:41.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:41.187+0000 7fce6446d640 1 -- 172.21.15.88:0/351014166 wait complete. 2024-09-17T04:18:41.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:41.187+0000 7fce6446d640 1 Processor -- start 2024-09-17T04:18:41.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:41.187+0000 7fce6446d640 1 -- start start 2024-09-17T04:18:41.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:41.187+0000 7fce6446d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce5c100860 0x7fce5c197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:41.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:41.187+0000 7fce6446d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce5c101a60 0x7fce5c197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:41.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:41.187+0000 7fce6446d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fce5c109700 con 0x7fce5c100860 2024-09-17T04:18:41.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:41.187+0000 7fce6446d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fce5c109580 con 0x7fce5c101a60 2024-09-17T04:18:41.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:41.187+0000 7fce62209640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce5c100860 0x7fce5c197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:41.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:41.187+0000 7fce62209640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce5c100860 0x7fce5c197530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47634/0 (socket says 172.21.15.88:47634) 2024-09-17T04:18:41.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:41.187+0000 7fce62209640 1 -- 172.21.15.88:0/2614398707 learned_addr learned my addr 172.21.15.88:0/2614398707 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:18:41.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:41.188+0000 7fce61a08640 1 --2- 172.21.15.88:0/2614398707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce5c101a60 0x7fce5c197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:41.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:41.188+0000 7fce62209640 1 -- 172.21.15.88:0/2614398707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce5c101a60 msgr2=0x7fce5c197a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:41.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:41.188+0000 7fce62209640 1 --2- 172.21.15.88:0/2614398707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce5c101a60 0x7fce5c197a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:41.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:41.188+0000 7fce62209640 1 -- 172.21.15.88:0/2614398707 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce5c1980f0 con 0x7fce5c100860 2024-09-17T04:18:41.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:41.188+0000 7fce62209640 1 --2- 172.21.15.88:0/2614398707 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce5c100860 0x7fce5c197530 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fce58006010 tx=0x7fce580048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:41.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:41.188+0000 7fce537fe640 1 -- 172.21.15.88:0/2614398707 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fce5803f070 con 0x7fce5c100860 2024-09-17T04:18:41.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:41.188+0000 7fce537fe640 1 -- 172.21.15.88:0/2614398707 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fce580044d0 con 0x7fce5c100860 2024-09-17T04:18:41.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:41.188+0000 7fce6446d640 1 -- 172.21.15.88:0/2614398707 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce5c19cad0 con 0x7fce5c100860 2024-09-17T04:18:41.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:41.188+0000 7fce537fe640 1 -- 172.21.15.88:0/2614398707 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fce58035030 con 0x7fce5c100860 2024-09-17T04:18:41.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:41.188+0000 7fce6446d640 1 -- 172.21.15.88:0/2614398707 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce5c19d060 con 0x7fce5c100860 2024-09-17T04:18:41.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:41.189+0000 7fce6446d640 1 -- 172.21.15.88:0/2614398707 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce5c100c60 con 0x7fce5c100860 2024-09-17T04:18:41.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:41.190+0000 7fce537fe640 1 -- 172.21.15.88:0/2614398707 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fce58042070 con 0x7fce5c100860 2024-09-17T04:18:41.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:41.190+0000 7fce537fe640 1 --2- 172.21.15.88:0/2614398707 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fce4806e2b0 0x7fce48070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:41.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:41.190+0000 7fce537fe640 1 -- 172.21.15.88:0/2614398707 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7fce580aee80 con 0x7fce5c100860 2024-09-17T04:18:41.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:41.190+0000 7fce61a08640 1 --2- 172.21.15.88:0/2614398707 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fce4806e2b0 0x7fce48070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:41.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:41.190+0000 7fce61a08640 1 --2- 172.21.15.88:0/2614398707 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fce4806e2b0 0x7fce48070770 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fce5c1989e0 tx=0x7fce4c008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:41.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:41.194+0000 7fce537fe640 1 -- 172.21.15.88:0/2614398707 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fce5807c780 con 0x7fce5c100860 2024-09-17T04:18:41.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:41.361+0000 7fce6446d640 1 -- 172.21.15.88:0/2614398707 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) -- 0x7fce5c106880 con 0x7fce5c100860 2024-09-17T04:18:41.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:41.364+0000 7fce537fe640 1 -- 172.21.15.88:0/2614398707 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v46)=0 v46) ==== 126+0+0 (secure 0 0 0) 0x7fce58080430 con 0x7fce5c100860 2024-09-17T04:18:41.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:41.366+0000 7fce6446d640 1 -- 172.21.15.88:0/2614398707 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fce4806e2b0 msgr2=0x7fce48070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:41.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:41.366+0000 7fce6446d640 1 --2- 172.21.15.88:0/2614398707 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fce4806e2b0 0x7fce48070770 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fce5c1989e0 tx=0x7fce4c008040 comp rx=0 tx=0).stop 2024-09-17T04:18:41.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:41.366+0000 7fce6446d640 1 -- 172.21.15.88:0/2614398707 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce5c100860 msgr2=0x7fce5c197530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:41.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:41.366+0000 7fce6446d640 1 --2- 172.21.15.88:0/2614398707 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce5c100860 0x7fce5c197530 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fce58006010 tx=0x7fce580048f0 comp rx=0 tx=0).stop 2024-09-17T04:18:41.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:41.367+0000 7fce6446d640 1 -- 172.21.15.88:0/2614398707 shutdown_connections 2024-09-17T04:18:41.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:41.367+0000 7fce6446d640 1 --2- 172.21.15.88:0/2614398707 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fce4806e2b0 0x7fce48070770 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:41.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:41.367+0000 7fce6446d640 1 --2- 172.21.15.88:0/2614398707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce5c101a60 0x7fce5c197a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:41.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:41.367+0000 7fce6446d640 1 --2- 172.21.15.88:0/2614398707 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce5c100860 0x7fce5c197530 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:41.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:41.367+0000 7fce6446d640 1 -- 172.21.15.88:0/2614398707 >> 172.21.15.88:0/2614398707 conn(0x7fce5c0fc010 msgr2=0x7fce5c0fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:41.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:41.367+0000 7fce6446d640 1 -- 172.21.15.88:0/2614398707 shutdown_connections 2024-09-17T04:18:41.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:41.367+0000 7fce6446d640 1 -- 172.21.15.88:0/2614398707 wait complete. 2024-09-17T04:18:41.991 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-17T04:18:41.992 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi088.front.sepia.ceph.com 2024-09-17T04:18:41.992 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -e sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-17T04:18:42.284 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:18:42.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:42 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/2614398707' entity='client.admin' 2024-09-17T04:18:42.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:42 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:18:42.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:42 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:18:42.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:42 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:18:42.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:42 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:42.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:42 smithi088 ceph-mon[27811]: pgmap v193: 65 pgs: 65 active+clean; 585 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 7.7 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-17T04:18:42.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:42 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/2614398707' entity='client.admin' 2024-09-17T04:18:42.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:42 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:18:42.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:42 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:18:42.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:42 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:18:42.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:42 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:42.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:42 smithi134 ceph-mon[35201]: pgmap v193: 65 pgs: 65 active+clean; 585 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 7.7 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-17T04:18:42.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:42.696+0000 7f210b37c640 1 -- 172.21.15.88:0/2777464926 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2104101a60 msgr2=0x7f2104101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:42.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:42.696+0000 7f210b37c640 1 --2- 172.21.15.88:0/2777464926 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2104101a60 0x7f2104101ee0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f20f8009c20 tx=0x7f20f802a970 comp rx=0 tx=0).stop 2024-09-17T04:18:42.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:42.696+0000 7f210b37c640 1 -- 172.21.15.88:0/2777464926 shutdown_connections 2024-09-17T04:18:42.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:42.696+0000 7f210b37c640 1 --2- 172.21.15.88:0/2777464926 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2104101a60 0x7f2104101ee0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:42.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:42.696+0000 7f210b37c640 1 --2- 172.21.15.88:0/2777464926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2104100860 0x7f2104100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:42.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:42.696+0000 7f210b37c640 1 -- 172.21.15.88:0/2777464926 >> 172.21.15.88:0/2777464926 conn(0x7f21040fc010 msgr2=0x7f21040fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:42.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:42.696+0000 7f210b37c640 1 -- 172.21.15.88:0/2777464926 shutdown_connections 2024-09-17T04:18:42.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:42.696+0000 7f210b37c640 1 -- 172.21.15.88:0/2777464926 wait complete. 2024-09-17T04:18:42.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:42.696+0000 7f210b37c640 1 Processor -- start 2024-09-17T04:18:42.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:42.696+0000 7f210b37c640 1 -- start start 2024-09-17T04:18:42.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:42.697+0000 7f210b37c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2104100860 0x7f21041975e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:42.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:42.697+0000 7f210b37c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2104101a60 0x7f2104197b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:42.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:42.697+0000 7f210b37c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f2104109720 con 0x7f2104101a60 2024-09-17T04:18:42.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:42.697+0000 7f210b37c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f21041095a0 con 0x7f2104100860 2024-09-17T04:18:42.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:42.697+0000 7f2108917640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2104101a60 0x7f2104197b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:42.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:42.697+0000 7f2108917640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2104101a60 0x7f2104197b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55714/0 (socket says 172.21.15.88:55714) 2024-09-17T04:18:42.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:42.697+0000 7f2108917640 1 -- 172.21.15.88:0/3832020240 learned_addr learned my addr 172.21.15.88:0/3832020240 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:18:42.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:42.697+0000 7f2109118640 1 --2- 172.21.15.88:0/3832020240 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2104100860 0x7f21041975e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:42.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:42.697+0000 7f2108917640 1 -- 172.21.15.88:0/3832020240 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2104100860 msgr2=0x7f21041975e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:42.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:42.697+0000 7f2108917640 1 --2- 172.21.15.88:0/3832020240 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2104100860 0x7f21041975e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:42.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:42.697+0000 7f2108917640 1 -- 172.21.15.88:0/3832020240 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21041981a0 con 0x7f2104101a60 2024-09-17T04:18:42.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:42.697+0000 7f2108917640 1 --2- 172.21.15.88:0/3832020240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2104101a60 0x7f2104197b20 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f20f802f900 tx=0x7f20f802f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:42.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:42.697+0000 7f21027fc640 1 -- 172.21.15.88:0/3832020240 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f20f8047070 con 0x7f2104101a60 2024-09-17T04:18:42.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:42.697+0000 7f21027fc640 1 -- 172.21.15.88:0/3832020240 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f20f8003e30 con 0x7f2104101a60 2024-09-17T04:18:42.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:42.697+0000 7f21027fc640 1 -- 172.21.15.88:0/3832020240 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f20f8034070 con 0x7f2104101a60 2024-09-17T04:18:42.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:42.697+0000 7f210b37c640 1 -- 172.21.15.88:0/3832020240 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f210419cb80 con 0x7f2104101a60 2024-09-17T04:18:42.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:42.697+0000 7f210b37c640 1 -- 172.21.15.88:0/3832020240 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f210419d190 con 0x7f2104101a60 2024-09-17T04:18:42.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:42.698+0000 7f210b37c640 1 -- 172.21.15.88:0/3832020240 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2104100ce0 con 0x7f2104101a60 2024-09-17T04:18:42.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:42.699+0000 7f21027fc640 1 -- 172.21.15.88:0/3832020240 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f20f804a070 con 0x7f2104101a60 2024-09-17T04:18:42.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:42.699+0000 7f21027fc640 1 --2- 172.21.15.88:0/3832020240 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f20ec06e2b0 0x7f20ec070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:42.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:42.699+0000 7f21027fc640 1 -- 172.21.15.88:0/3832020240 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f20f80af0c0 con 0x7f2104101a60 2024-09-17T04:18:42.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:42.699+0000 7f2109118640 1 --2- 172.21.15.88:0/3832020240 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f20ec06e2b0 0x7f20ec070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:42.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:42.700+0000 7f2109118640 1 --2- 172.21.15.88:0/3832020240 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f20ec06e2b0 0x7f20ec070770 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f21041018c0 tx=0x7f20f4008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:42.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:42.704+0000 7f21027fc640 1 -- 172.21.15.88:0/3832020240 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f20f803f070 con 0x7f2104101a60 2024-09-17T04:18:42.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:42.871+0000 7f210b37c640 1 -- 172.21.15.88:0/3832020240 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) -- 0x7f210419d9e0 con 0x7f2104101a60 2024-09-17T04:18:42.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:42.871+0000 7f21027fc640 1 -- 172.21.15.88:0/3832020240 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v46)=0 v46) ==== 155+0+0 (secure 0 0 0) 0x7f20f802fe40 con 0x7f2104101a60 2024-09-17T04:18:42.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:42.873+0000 7f210b37c640 1 -- 172.21.15.88:0/3832020240 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f20ec06e2b0 msgr2=0x7f20ec070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:42.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:42.873+0000 7f210b37c640 1 --2- 172.21.15.88:0/3832020240 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f20ec06e2b0 0x7f20ec070770 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f21041018c0 tx=0x7f20f4008040 comp rx=0 tx=0).stop 2024-09-17T04:18:42.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:42.873+0000 7f210b37c640 1 -- 172.21.15.88:0/3832020240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2104101a60 msgr2=0x7f2104197b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:42.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:42.873+0000 7f210b37c640 1 --2- 172.21.15.88:0/3832020240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2104101a60 0x7f2104197b20 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f20f802f900 tx=0x7f20f802f730 comp rx=0 tx=0).stop 2024-09-17T04:18:42.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:42.873+0000 7f210b37c640 1 -- 172.21.15.88:0/3832020240 shutdown_connections 2024-09-17T04:18:42.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:42.873+0000 7f210b37c640 1 --2- 172.21.15.88:0/3832020240 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f20ec06e2b0 0x7f20ec070770 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:42.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:42.873+0000 7f210b37c640 1 --2- 172.21.15.88:0/3832020240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2104101a60 0x7f2104197b20 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:42.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:42.873+0000 7f210b37c640 1 --2- 172.21.15.88:0/3832020240 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2104100860 0x7f21041975e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:42.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:42.873+0000 7f210b37c640 1 -- 172.21.15.88:0/3832020240 >> 172.21.15.88:0/3832020240 conn(0x7f21040fc010 msgr2=0x7f2104069ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:42.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:42.873+0000 7f210b37c640 1 -- 172.21.15.88:0/3832020240 shutdown_connections 2024-09-17T04:18:42.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:42.873+0000 7f210b37c640 1 -- 172.21.15.88:0/3832020240 wait complete. 2024-09-17T04:18:43.484 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -e sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-17T04:18:43.745 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:18:44.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:44.203+0000 7f384ff69640 1 -- 172.21.15.88:0/2708837111 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3848101960 msgr2=0x7f3848101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:44.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:44.203+0000 7f384ff69640 1 --2- 172.21.15.88:0/2708837111 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3848101960 0x7f3848101d60 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3844009880 tx=0x7f384402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:18:44.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:44.204+0000 7f384ff69640 1 -- 172.21.15.88:0/2708837111 shutdown_connections 2024-09-17T04:18:44.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:44.204+0000 7f384ff69640 1 --2- 172.21.15.88:0/2708837111 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3848102b60 0x7f3848102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:44.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:44.204+0000 7f384ff69640 1 --2- 172.21.15.88:0/2708837111 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3848101960 0x7f3848101d60 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:44.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:44.204+0000 7f384ff69640 1 -- 172.21.15.88:0/2708837111 >> 172.21.15.88:0/2708837111 conn(0x7f38480fd0f0 msgr2=0x7f38480ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:44.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:44.204+0000 7f384ff69640 1 -- 172.21.15.88:0/2708837111 shutdown_connections 2024-09-17T04:18:44.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:44.204+0000 7f384ff69640 1 -- 172.21.15.88:0/2708837111 wait complete. 2024-09-17T04:18:44.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:44.204+0000 7f384ff69640 1 Processor -- start 2024-09-17T04:18:44.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:44.204+0000 7f384ff69640 1 -- start start 2024-09-17T04:18:44.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:44.204+0000 7f384ff69640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3848101960 0x7f38481974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:44.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:44.204+0000 7f384ff69640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3848102b60 0x7f3848197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:44.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:44.204+0000 7f384ff69640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f384810a7a0 con 0x7f3848102b60 2024-09-17T04:18:44.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:44.204+0000 7f384ff69640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f384810a620 con 0x7f3848101960 2024-09-17T04:18:44.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:44.205+0000 7f384d504640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3848102b60 0x7f3848197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:44.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:44.205+0000 7f384d504640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3848102b60 0x7f3848197a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55736/0 (socket says 172.21.15.88:55736) 2024-09-17T04:18:44.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:44.205+0000 7f384d504640 1 -- 172.21.15.88:0/1019979066 learned_addr learned my addr 172.21.15.88:0/1019979066 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:18:44.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:44.205+0000 7f384dd05640 1 --2- 172.21.15.88:0/1019979066 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3848101960 0x7f38481974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:44.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:44.205+0000 7f384d504640 1 -- 172.21.15.88:0/1019979066 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3848101960 msgr2=0x7f38481974d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:44.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:44.205+0000 7f384d504640 1 --2- 172.21.15.88:0/1019979066 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3848101960 0x7f38481974d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:44.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:44.205+0000 7f384d504640 1 -- 172.21.15.88:0/1019979066 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3848198090 con 0x7f3848102b60 2024-09-17T04:18:44.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:44.205+0000 7f384dd05640 1 --2- 172.21.15.88:0/1019979066 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3848101960 0x7f38481974d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:18:44.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:44.205+0000 7f384d504640 1 --2- 172.21.15.88:0/1019979066 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3848102b60 0x7f3848197a10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f383800d6f0 tx=0x7f383800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:44.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:44.205+0000 7f383effd640 1 -- 172.21.15.88:0/1019979066 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3838017070 con 0x7f3848102b60 2024-09-17T04:18:44.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:44.205+0000 7f384ff69640 1 -- 172.21.15.88:0/1019979066 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f384819cad0 con 0x7f3848102b60 2024-09-17T04:18:44.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:44.205+0000 7f383effd640 1 -- 172.21.15.88:0/1019979066 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f383800de00 con 0x7f3848102b60 2024-09-17T04:18:44.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:44.205+0000 7f383effd640 1 -- 172.21.15.88:0/1019979066 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3838004bb0 con 0x7f3848102b60 2024-09-17T04:18:44.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:44.205+0000 7f384ff69640 1 -- 172.21.15.88:0/1019979066 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f384819d060 con 0x7f3848102b60 2024-09-17T04:18:44.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:44.206+0000 7f384ff69640 1 -- 172.21.15.88:0/1019979066 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3848101d60 con 0x7f3848102b60 2024-09-17T04:18:44.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:44.207+0000 7f383effd640 1 -- 172.21.15.88:0/1019979066 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f3838009a30 con 0x7f3848102b60 2024-09-17T04:18:44.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:44.207+0000 7f383effd640 1 --2- 172.21.15.88:0/1019979066 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f383406e2b0 0x7f3834070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:44.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:44.207+0000 7f383effd640 1 -- 172.21.15.88:0/1019979066 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f383808de10 con 0x7f3848102b60 2024-09-17T04:18:44.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:44.207+0000 7f384dd05640 1 --2- 172.21.15.88:0/1019979066 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f383406e2b0 0x7f3834070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:44.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:44.208+0000 7f384dd05640 1 --2- 172.21.15.88:0/1019979066 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f383406e2b0 0x7f3834070770 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3844000c00 tx=0x7f3844005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:44.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:44.212+0000 7f383effd640 1 -- 172.21.15.88:0/1019979066 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f383805b710 con 0x7f3848102b60 2024-09-17T04:18:44.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:44.381+0000 7f384ff69640 1 -- 172.21.15.88:0/1019979066 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) -- 0x7f3848062df0 con 0x7f3848102b60 2024-09-17T04:18:44.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:44.382+0000 7f383effd640 1 -- 172.21.15.88:0/1019979066 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v46)=0 v46) ==== 163+0+0 (secure 0 0 0) 0x7f383805f3c0 con 0x7f3848102b60 2024-09-17T04:18:44.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:44.384+0000 7f384ff69640 1 -- 172.21.15.88:0/1019979066 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f383406e2b0 msgr2=0x7f3834070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:44.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:44.384+0000 7f384ff69640 1 --2- 172.21.15.88:0/1019979066 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f383406e2b0 0x7f3834070770 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3844000c00 tx=0x7f3844005a20 comp rx=0 tx=0).stop 2024-09-17T04:18:44.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:44.384+0000 7f384ff69640 1 -- 172.21.15.88:0/1019979066 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3848102b60 msgr2=0x7f3848197a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:44.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:44.384+0000 7f384ff69640 1 --2- 172.21.15.88:0/1019979066 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3848102b60 0x7f3848197a10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f383800d6f0 tx=0x7f383800dbb0 comp rx=0 tx=0).stop 2024-09-17T04:18:44.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:44.384+0000 7f384ff69640 1 -- 172.21.15.88:0/1019979066 shutdown_connections 2024-09-17T04:18:44.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:44.384+0000 7f384ff69640 1 --2- 172.21.15.88:0/1019979066 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f383406e2b0 0x7f3834070770 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:44.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:44.384+0000 7f384ff69640 1 --2- 172.21.15.88:0/1019979066 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3848102b60 0x7f3848197a10 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:44.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:44.384+0000 7f384ff69640 1 --2- 172.21.15.88:0/1019979066 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3848101960 0x7f38481974d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:44.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:44.384+0000 7f384ff69640 1 -- 172.21.15.88:0/1019979066 >> 172.21.15.88:0/1019979066 conn(0x7f38480fd0f0 msgr2=0x7f3848106070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:44.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:44.384+0000 7f384ff69640 1 -- 172.21.15.88:0/1019979066 shutdown_connections 2024-09-17T04:18:44.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:44.384+0000 7f384ff69640 1 -- 172.21.15.88:0/1019979066 wait complete. 2024-09-17T04:18:44.961 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:44 smithi088 ceph-mon[27811]: pgmap v194: 65 pgs: 65 active+clean; 585 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 4.5 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-17T04:18:44.988 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -e sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-17T04:18:45.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:44 smithi134 ceph-mon[35201]: pgmap v194: 65 pgs: 65 active+clean; 585 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 4.5 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-17T04:18:45.235 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:18:45.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:45.676+0000 7f0d7632c640 1 -- 172.21.15.88:0/4065525046 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d70100860 msgr2=0x7f0d70100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:45.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:45.676+0000 7f0d7632c640 1 --2- 172.21.15.88:0/4065525046 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d70100860 0x7f0d70100c60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0d60009880 tx=0x7f0d6002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:18:45.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:45.676+0000 7f0d7632c640 1 -- 172.21.15.88:0/4065525046 shutdown_connections 2024-09-17T04:18:45.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:45.676+0000 7f0d7632c640 1 --2- 172.21.15.88:0/4065525046 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d70101a60 0x7f0d70101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:45.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:45.676+0000 7f0d7632c640 1 --2- 172.21.15.88:0/4065525046 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d70100860 0x7f0d70100c60 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:45.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:45.676+0000 7f0d7632c640 1 -- 172.21.15.88:0/4065525046 >> 172.21.15.88:0/4065525046 conn(0x7f0d700fc010 msgr2=0x7f0d700fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:45.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:45.676+0000 7f0d7632c640 1 -- 172.21.15.88:0/4065525046 shutdown_connections 2024-09-17T04:18:45.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:45.676+0000 7f0d7632c640 1 -- 172.21.15.88:0/4065525046 wait complete. 2024-09-17T04:18:45.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:45.676+0000 7f0d7632c640 1 Processor -- start 2024-09-17T04:18:45.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:45.676+0000 7f0d7632c640 1 -- start start 2024-09-17T04:18:45.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:45.677+0000 7f0d7632c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d70100860 0x7f0d70197540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:45.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:45.677+0000 7f0d7632c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d70101a60 0x7f0d70197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:45.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:45.677+0000 7f0d7632c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f0d70109700 con 0x7f0d70101a60 2024-09-17T04:18:45.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:45.677+0000 7f0d7632c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0d70109580 con 0x7f0d70100860 2024-09-17T04:18:45.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:45.677+0000 7f0d67fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d70101a60 0x7f0d70197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:45.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:45.677+0000 7f0d67fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d70101a60 0x7f0d70197a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55746/0 (socket says 172.21.15.88:55746) 2024-09-17T04:18:45.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:45.677+0000 7f0d67fff640 1 -- 172.21.15.88:0/541994799 learned_addr learned my addr 172.21.15.88:0/541994799 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:18:45.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:45.677+0000 7f0d6ffff640 1 --2- 172.21.15.88:0/541994799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d70100860 0x7f0d70197540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:45.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:45.677+0000 7f0d67fff640 1 -- 172.21.15.88:0/541994799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d70100860 msgr2=0x7f0d70197540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:45.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:45.677+0000 7f0d67fff640 1 --2- 172.21.15.88:0/541994799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d70100860 0x7f0d70197540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:45.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:45.677+0000 7f0d67fff640 1 -- 172.21.15.88:0/541994799 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d70198100 con 0x7f0d70101a60 2024-09-17T04:18:45.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:45.677+0000 7f0d67fff640 1 --2- 172.21.15.88:0/541994799 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d70101a60 0x7f0d70197a80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0d5800b420 tx=0x7f0d5800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:45.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:45.677+0000 7f0d6dffb640 1 -- 172.21.15.88:0/541994799 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0d58011630 con 0x7f0d70101a60 2024-09-17T04:18:45.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:45.677+0000 7f0d6dffb640 1 -- 172.21.15.88:0/541994799 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0d58016070 con 0x7f0d70101a60 2024-09-17T04:18:45.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:45.677+0000 7f0d7632c640 1 -- 172.21.15.88:0/541994799 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d7019cb40 con 0x7f0d70101a60 2024-09-17T04:18:45.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:45.677+0000 7f0d6dffb640 1 -- 172.21.15.88:0/541994799 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0d58010d40 con 0x7f0d70101a60 2024-09-17T04:18:45.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:45.677+0000 7f0d7632c640 1 -- 172.21.15.88:0/541994799 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d7019d150 con 0x7f0d70101a60 2024-09-17T04:18:45.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:45.678+0000 7f0d7632c640 1 -- 172.21.15.88:0/541994799 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d70100c60 con 0x7f0d70101a60 2024-09-17T04:18:45.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:45.679+0000 7f0d6dffb640 1 -- 172.21.15.88:0/541994799 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f0d5801b460 con 0x7f0d70101a60 2024-09-17T04:18:45.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:45.679+0000 7f0d6dffb640 1 --2- 172.21.15.88:0/541994799 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f0d5c06e2b0 0x7f0d5c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:45.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:45.679+0000 7f0d6dffb640 1 -- 172.21.15.88:0/541994799 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f0d5808da00 con 0x7f0d70101a60 2024-09-17T04:18:45.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:45.679+0000 7f0d6ffff640 1 --2- 172.21.15.88:0/541994799 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f0d5c06e2b0 0x7f0d5c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:45.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:45.680+0000 7f0d6ffff640 1 --2- 172.21.15.88:0/541994799 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f0d5c06e2b0 0x7f0d5c070770 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0d60009230 tx=0x7f0d600058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:45.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:45.684+0000 7f0d6dffb640 1 -- 172.21.15.88:0/541994799 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0d5805b300 con 0x7f0d70101a60 2024-09-17T04:18:45.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:45.853+0000 7f0d7632c640 1 -- 172.21.15.88:0/541994799 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) -- 0x7f0d7019d440 con 0x7f0d70101a60 2024-09-17T04:18:45.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:45.853+0000 7f0d6dffb640 1 -- 172.21.15.88:0/541994799 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v46)=0 v46) ==== 135+0+0 (secure 0 0 0) 0x7f0d5805efb0 con 0x7f0d70101a60 2024-09-17T04:18:45.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:45.855+0000 7f0d7632c640 1 -- 172.21.15.88:0/541994799 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f0d5c06e2b0 msgr2=0x7f0d5c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:45.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:45.855+0000 7f0d7632c640 1 --2- 172.21.15.88:0/541994799 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f0d5c06e2b0 0x7f0d5c070770 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0d60009230 tx=0x7f0d600058d0 comp rx=0 tx=0).stop 2024-09-17T04:18:45.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:45.855+0000 7f0d7632c640 1 -- 172.21.15.88:0/541994799 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d70101a60 msgr2=0x7f0d70197a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:45.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:45.855+0000 7f0d7632c640 1 --2- 172.21.15.88:0/541994799 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d70101a60 0x7f0d70197a80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0d5800b420 tx=0x7f0d5800b8e0 comp rx=0 tx=0).stop 2024-09-17T04:18:45.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:45.855+0000 7f0d7632c640 1 -- 172.21.15.88:0/541994799 shutdown_connections 2024-09-17T04:18:45.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:45.855+0000 7f0d7632c640 1 --2- 172.21.15.88:0/541994799 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f0d5c06e2b0 0x7f0d5c070770 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:45.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:45.855+0000 7f0d7632c640 1 --2- 172.21.15.88:0/541994799 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d70101a60 0x7f0d70197a80 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:45.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:45.855+0000 7f0d7632c640 1 --2- 172.21.15.88:0/541994799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d70100860 0x7f0d70197540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:45.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:45.855+0000 7f0d7632c640 1 -- 172.21.15.88:0/541994799 >> 172.21.15.88:0/541994799 conn(0x7f0d700fc010 msgr2=0x7f0d7006a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:45.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:45.856+0000 7f0d7632c640 1 -- 172.21.15.88:0/541994799 shutdown_connections 2024-09-17T04:18:45.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:45.856+0000 7f0d7632c640 1 -- 172.21.15.88:0/541994799 wait complete. 2024-09-17T04:18:46.549 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -e sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-09-17T04:18:46.799 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:18:47.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:46 smithi088 ceph-mon[27811]: pgmap v195: 65 pgs: 65 active+clean; 585 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-17T04:18:47.143 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:46 smithi134 ceph-mon[35201]: pgmap v195: 65 pgs: 65 active+clean; 585 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-17T04:18:47.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:47.239+0000 7f9607904640 1 -- 172.21.15.88:0/3302368817 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9600101a60 msgr2=0x7f9600101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:47.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:47.239+0000 7f9607904640 1 --2- 172.21.15.88:0/3302368817 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9600101a60 0x7f9600101ee0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f95f0009880 tx=0x7f95f002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:18:47.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:47.239+0000 7f9607904640 1 -- 172.21.15.88:0/3302368817 shutdown_connections 2024-09-17T04:18:47.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:47.239+0000 7f9607904640 1 --2- 172.21.15.88:0/3302368817 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9600101a60 0x7f9600101ee0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:47.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:47.239+0000 7f9607904640 1 --2- 172.21.15.88:0/3302368817 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9600100860 0x7f9600100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:47.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:47.239+0000 7f9607904640 1 -- 172.21.15.88:0/3302368817 >> 172.21.15.88:0/3302368817 conn(0x7f96000fc010 msgr2=0x7f96000fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:47.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:47.239+0000 7f9607904640 1 -- 172.21.15.88:0/3302368817 shutdown_connections 2024-09-17T04:18:47.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:47.239+0000 7f9607904640 1 -- 172.21.15.88:0/3302368817 wait complete. 2024-09-17T04:18:47.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:47.239+0000 7f9607904640 1 Processor -- start 2024-09-17T04:18:47.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:47.239+0000 7f9607904640 1 -- start start 2024-09-17T04:18:47.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:47.240+0000 7f9607904640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9600100860 0x7f9600104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:47.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:47.240+0000 7f9607904640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9600101a60 0x7f9600102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:47.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:47.240+0000 7f9607904640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f9600109720 con 0x7f9600100860 2024-09-17T04:18:47.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:47.240+0000 7f9607904640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f96001095a0 con 0x7f9600101a60 2024-09-17T04:18:47.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:47.240+0000 7f96056a0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9600100860 0x7f9600104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:47.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:47.240+0000 7f96056a0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9600100860 0x7f9600104780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55764/0 (socket says 172.21.15.88:55764) 2024-09-17T04:18:47.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:47.240+0000 7f96056a0640 1 -- 172.21.15.88:0/4195526850 learned_addr learned my addr 172.21.15.88:0/4195526850 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:18:47.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:47.240+0000 7f9604e9f640 1 --2- 172.21.15.88:0/4195526850 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9600101a60 0x7f9600102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:47.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:47.240+0000 7f96056a0640 1 -- 172.21.15.88:0/4195526850 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9600101a60 msgr2=0x7f9600102e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:47.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:47.240+0000 7f96056a0640 1 --2- 172.21.15.88:0/4195526850 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9600101a60 0x7f9600102e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:47.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:47.240+0000 7f96056a0640 1 -- 172.21.15.88:0/4195526850 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9600103380 con 0x7f9600100860 2024-09-17T04:18:47.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:47.240+0000 7f9604e9f640 1 --2- 172.21.15.88:0/4195526850 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9600101a60 0x7f9600102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:18:47.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:47.240+0000 7f96056a0640 1 --2- 172.21.15.88:0/4195526850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9600100860 0x7f9600104780 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f95fc00b3d0 tx=0x7f95fc00b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:47.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:47.240+0000 7f95f67fc640 1 -- 172.21.15.88:0/4195526850 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f95fc015020 con 0x7f9600100860 2024-09-17T04:18:47.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:47.240+0000 7f9607904640 1 -- 172.21.15.88:0/4195526850 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9600103670 con 0x7f9600100860 2024-09-17T04:18:47.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:47.240+0000 7f95f67fc640 1 -- 172.21.15.88:0/4195526850 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f95fc011af0 con 0x7f9600100860 2024-09-17T04:18:47.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:47.240+0000 7f95f67fc640 1 -- 172.21.15.88:0/4195526850 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f95fc010da0 con 0x7f9600100860 2024-09-17T04:18:47.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:47.240+0000 7f9607904640 1 -- 172.21.15.88:0/4195526850 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9600103c80 con 0x7f9600100860 2024-09-17T04:18:47.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:47.241+0000 7f9607904640 1 -- 172.21.15.88:0/4195526850 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9600100c60 con 0x7f9600100860 2024-09-17T04:18:47.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:47.242+0000 7f95f67fc640 1 -- 172.21.15.88:0/4195526850 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f95fc018020 con 0x7f9600100860 2024-09-17T04:18:47.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:47.242+0000 7f95f67fc640 1 --2- 172.21.15.88:0/4195526850 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f95ec06e2b0 0x7f95ec070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:47.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:47.242+0000 7f95f67fc640 1 -- 172.21.15.88:0/4195526850 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f95fc08dd10 con 0x7f9600100860 2024-09-17T04:18:47.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:47.243+0000 7f9604e9f640 1 --2- 172.21.15.88:0/4195526850 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f95ec06e2b0 0x7f95ec070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:47.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:47.243+0000 7f9604e9f640 1 --2- 172.21.15.88:0/4195526850 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f95ec06e2b0 0x7f95ec070770 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9600104500 tx=0x7f95f0005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:47.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:47.247+0000 7f95f67fc640 1 -- 172.21.15.88:0/4195526850 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f95fc01f020 con 0x7f9600100860 2024-09-17T04:18:47.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:47.428+0000 7f9607904640 1 -- 172.21.15.88:0/4195526850 --> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:ce1b342bf8c6349a8c90cd607f83bff2443f21cf", "target": ["mon-mgr", ""]}) -- 0x7f960006a970 con 0x7f95ec06e2b0 2024-09-17T04:18:47.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:47.433+0000 7f95f67fc640 1 -- 172.21.15.88:0/4195526850 <== mgr.14217 v2:172.21.15.88:6800/1666801150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+89 (secure 0 0 0) 0x7f960006a970 con 0x7f95ec06e2b0 2024-09-17T04:18:47.433 INFO:teuthology.orchestra.run.smithi088.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T04:18:47.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:47.435+0000 7f9607904640 1 -- 172.21.15.88:0/4195526850 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f95ec06e2b0 msgr2=0x7f95ec070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:47.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:47.435+0000 7f9607904640 1 --2- 172.21.15.88:0/4195526850 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f95ec06e2b0 0x7f95ec070770 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9600104500 tx=0x7f95f0005a20 comp rx=0 tx=0).stop 2024-09-17T04:18:47.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:47.435+0000 7f9607904640 1 -- 172.21.15.88:0/4195526850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9600100860 msgr2=0x7f9600104780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:47.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:47.435+0000 7f9607904640 1 --2- 172.21.15.88:0/4195526850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9600100860 0x7f9600104780 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f95fc00b3d0 tx=0x7f95fc00b890 comp rx=0 tx=0).stop 2024-09-17T04:18:47.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:47.436+0000 7f9607904640 1 -- 172.21.15.88:0/4195526850 shutdown_connections 2024-09-17T04:18:47.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:47.436+0000 7f9607904640 1 --2- 172.21.15.88:0/4195526850 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f95ec06e2b0 0x7f95ec070770 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:47.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:47.436+0000 7f9607904640 1 --2- 172.21.15.88:0/4195526850 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9600101a60 0x7f9600102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:47.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:47.436+0000 7f9607904640 1 --2- 172.21.15.88:0/4195526850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9600100860 0x7f9600104780 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:47.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:47.436+0000 7f9607904640 1 -- 172.21.15.88:0/4195526850 >> 172.21.15.88:0/4195526850 conn(0x7f96000fc010 msgr2=0x7f960006a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:47.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:47.436+0000 7f9607904640 1 -- 172.21.15.88:0/4195526850 shutdown_connections 2024-09-17T04:18:47.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:47.436+0000 7f9607904640 1 -- 172.21.15.88:0/4195526850 wait complete. 2024-09-17T04:18:48.113 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-17T04:18:48.113 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi088.front.sepia.ceph.com 2024-09-17T04:18:48.113 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -e sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-09-17T04:18:48.367 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:18:48.771 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:48 smithi088 ceph-mon[27811]: from='client.14652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:ce1b342bf8c6349a8c90cd607f83bff2443f21cf", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:18:48.772 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:48 smithi088 ceph-mon[27811]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T04:18:48.772 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:48 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:48.772 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:48 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:18:48.772 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:48 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:18:48.772 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:48 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:18:48.772 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:48 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:48.772 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:48 smithi088 ceph-mon[27811]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T04:18:48.772 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:48 smithi088 ceph-mon[27811]: pgmap v196: 65 pgs: 65 active+clean; 585 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-17T04:18:48.888 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:48.861+0000 7f8a6efb1640 1 -- 172.21.15.88:0/4252759722 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a68101960 msgr2=0x7f8a68101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:48.888 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:48.861+0000 7f8a6efb1640 1 --2- 172.21.15.88:0/4252759722 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a68101960 0x7f8a68101d60 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c009880 tx=0x7f8a5c02a4a0 comp rx=0 tx=0).stop 2024-09-17T04:18:48.888 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:48.861+0000 7f8a6efb1640 1 -- 172.21.15.88:0/4252759722 shutdown_connections 2024-09-17T04:18:48.888 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:48.861+0000 7f8a6efb1640 1 --2- 172.21.15.88:0/4252759722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a68102b60 0x7f8a68102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:48.888 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:48.861+0000 7f8a6efb1640 1 --2- 172.21.15.88:0/4252759722 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a68101960 0x7f8a68101d60 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:48.888 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:48.861+0000 7f8a6efb1640 1 -- 172.21.15.88:0/4252759722 >> 172.21.15.88:0/4252759722 conn(0x7f8a680fd110 msgr2=0x7f8a680ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:48.888 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:48.861+0000 7f8a6efb1640 1 -- 172.21.15.88:0/4252759722 shutdown_connections 2024-09-17T04:18:48.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:48.861+0000 7f8a6efb1640 1 -- 172.21.15.88:0/4252759722 wait complete. 2024-09-17T04:18:48.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:48.862+0000 7f8a6efb1640 1 Processor -- start 2024-09-17T04:18:48.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:48.862+0000 7f8a6efb1640 1 -- start start 2024-09-17T04:18:48.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:48.862+0000 7f8a6efb1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a68101960 0x7f8a68197540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:48.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:48.862+0000 7f8a6efb1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a68102b60 0x7f8a68197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:48.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:48.862+0000 7f8a6efb1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6810a800 con 0x7f8a68101960 2024-09-17T04:18:48.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:48.862+0000 7f8a6efb1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6810a680 con 0x7f8a68102b60 2024-09-17T04:18:48.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:48.862+0000 7f8a6cd4d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a68101960 0x7f8a68197540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:48.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:48.862+0000 7f8a6cd4d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a68101960 0x7f8a68197540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55786/0 (socket says 172.21.15.88:55786) 2024-09-17T04:18:48.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:48.862+0000 7f8a6cd4d640 1 -- 172.21.15.88:0/1868707596 learned_addr learned my addr 172.21.15.88:0/1868707596 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:18:48.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:48.862+0000 7f8a67fff640 1 --2- 172.21.15.88:0/1868707596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a68102b60 0x7f8a68197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:48.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:48.862+0000 7f8a6cd4d640 1 -- 172.21.15.88:0/1868707596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a68102b60 msgr2=0x7f8a68197a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:48.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:48.862+0000 7f8a6cd4d640 1 --2- 172.21.15.88:0/1868707596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a68102b60 0x7f8a68197a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:48.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:48.862+0000 7f8a6cd4d640 1 -- 172.21.15.88:0/1868707596 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a68198100 con 0x7f8a68101960 2024-09-17T04:18:48.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:48.862+0000 7f8a67fff640 1 --2- 172.21.15.88:0/1868707596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a68102b60 0x7f8a68197a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:18:48.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:48.863+0000 7f8a6cd4d640 1 --2- 172.21.15.88:0/1868707596 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a68101960 0x7f8a68197540 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c006010 tx=0x7f8a5c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:48.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:48.863+0000 7f8a65ffb640 1 -- 172.21.15.88:0/1868707596 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8a5c03f070 con 0x7f8a68101960 2024-09-17T04:18:48.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:48.863+0000 7f8a6efb1640 1 -- 172.21.15.88:0/1868707596 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a6819cae0 con 0x7f8a68101960 2024-09-17T04:18:48.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:48.863+0000 7f8a65ffb640 1 -- 172.21.15.88:0/1868707596 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8a5c0044d0 con 0x7f8a68101960 2024-09-17T04:18:48.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:48.863+0000 7f8a65ffb640 1 -- 172.21.15.88:0/1868707596 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8a5c035030 con 0x7f8a68101960 2024-09-17T04:18:48.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:48.863+0000 7f8a6efb1640 1 -- 172.21.15.88:0/1868707596 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a6819d070 con 0x7f8a68101960 2024-09-17T04:18:48.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:48.864+0000 7f8a6efb1640 1 -- 172.21.15.88:0/1868707596 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a68101d60 con 0x7f8a68101960 2024-09-17T04:18:48.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:48.865+0000 7f8a65ffb640 1 -- 172.21.15.88:0/1868707596 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f8a5c042070 con 0x7f8a68101960 2024-09-17T04:18:48.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:48.865+0000 7f8a65ffb640 1 --2- 172.21.15.88:0/1868707596 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f8a5806e2b0 0x7f8a58070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:48.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:48.865+0000 7f8a65ffb640 1 -- 172.21.15.88:0/1868707596 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f8a5c0aee60 con 0x7f8a68101960 2024-09-17T04:18:48.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:48.865+0000 7f8a67fff640 1 --2- 172.21.15.88:0/1868707596 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f8a5806e2b0 0x7f8a58070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:48.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:48.866+0000 7f8a67fff640 1 --2- 172.21.15.88:0/1868707596 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f8a5806e2b0 0x7f8a58070770 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8a681989f0 tx=0x7f8a54008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:48.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:48.870+0000 7f8a65ffb640 1 -- 172.21.15.88:0/1868707596 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8a5c07c760 con 0x7f8a68101960 2024-09-17T04:18:48.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:48 smithi134 ceph-mon[35201]: from='client.14652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:ce1b342bf8c6349a8c90cd607f83bff2443f21cf", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:18:48.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:48 smithi134 ceph-mon[35201]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T04:18:48.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:48 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:48.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:48 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:18:48.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:48 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:18:48.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:48 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:18:48.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:48 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:18:48.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:48 smithi134 ceph-mon[35201]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T04:18:48.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:48 smithi134 ceph-mon[35201]: pgmap v196: 65 pgs: 65 active+clean; 585 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-17T04:18:49.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.089+0000 7f8a6efb1640 1 -- 172.21.15.88:0/1868707596 --> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8a68062630 con 0x7f8a5806e2b0 2024-09-17T04:18:49.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.090+0000 7f8a65ffb640 1 -- 172.21.15.88:0/1868707596 <== mgr.14217 v2:172.21.15.88:6800/1666801150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+358 (secure 0 0 0) 0x7f8a68062630 con 0x7f8a5806e2b0 2024-09-17T04:18:49.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.093+0000 7f8a6efb1640 1 -- 172.21.15.88:0/1868707596 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f8a5806e2b0 msgr2=0x7f8a58070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:49.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.093+0000 7f8a6efb1640 1 --2- 172.21.15.88:0/1868707596 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f8a5806e2b0 0x7f8a58070770 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8a681989f0 tx=0x7f8a54008040 comp rx=0 tx=0).stop 2024-09-17T04:18:49.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.093+0000 7f8a6efb1640 1 -- 172.21.15.88:0/1868707596 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a68101960 msgr2=0x7f8a68197540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:49.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.093+0000 7f8a6efb1640 1 --2- 172.21.15.88:0/1868707596 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a68101960 0x7f8a68197540 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c006010 tx=0x7f8a5c0048f0 comp rx=0 tx=0).stop 2024-09-17T04:18:49.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.093+0000 7f8a6efb1640 1 -- 172.21.15.88:0/1868707596 shutdown_connections 2024-09-17T04:18:49.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.093+0000 7f8a6efb1640 1 --2- 172.21.15.88:0/1868707596 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f8a5806e2b0 0x7f8a58070770 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:49.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.093+0000 7f8a6efb1640 1 --2- 172.21.15.88:0/1868707596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a68102b60 0x7f8a68197a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:49.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.093+0000 7f8a6efb1640 1 --2- 172.21.15.88:0/1868707596 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a68101960 0x7f8a68197540 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:49.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.093+0000 7f8a6efb1640 1 -- 172.21.15.88:0/1868707596 >> 172.21.15.88:0/1868707596 conn(0x7f8a680fd110 msgr2=0x7f8a68106090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:49.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.093+0000 7f8a6efb1640 1 -- 172.21.15.88:0/1868707596 shutdown_connections 2024-09-17T04:18:49.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.093+0000 7f8a6efb1640 1 -- 172.21.15.88:0/1868707596 wait complete. 2024-09-17T04:18:49.101 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-09-17T04:18:49.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.183+0000 7f228cc1b640 1 -- 172.21.15.88:0/3533394011 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2288101a60 msgr2=0x7f2288101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:49.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.183+0000 7f228cc1b640 1 --2- 172.21.15.88:0/3533394011 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2288101a60 0x7f2288101ee0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f227c009880 tx=0x7f227c02a4a0 comp rx=0 tx=0).stop 2024-09-17T04:18:49.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.183+0000 7f228cc1b640 1 -- 172.21.15.88:0/3533394011 shutdown_connections 2024-09-17T04:18:49.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.183+0000 7f228cc1b640 1 --2- 172.21.15.88:0/3533394011 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2288101a60 0x7f2288101ee0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:49.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.183+0000 7f228cc1b640 1 --2- 172.21.15.88:0/3533394011 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2288100860 0x7f2288100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:49.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.183+0000 7f228cc1b640 1 -- 172.21.15.88:0/3533394011 >> 172.21.15.88:0/3533394011 conn(0x7f22880fc010 msgr2=0x7f22880fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:49.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.183+0000 7f228cc1b640 1 -- 172.21.15.88:0/3533394011 shutdown_connections 2024-09-17T04:18:49.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.183+0000 7f228cc1b640 1 -- 172.21.15.88:0/3533394011 wait complete. 2024-09-17T04:18:49.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.184+0000 7f228cc1b640 1 Processor -- start 2024-09-17T04:18:49.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.184+0000 7f228cc1b640 1 -- start start 2024-09-17T04:18:49.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.184+0000 7f228cc1b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2288100860 0x7f22881974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:49.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.184+0000 7f228cc1b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2288101a60 0x7f2288197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:49.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.184+0000 7f228cc1b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f22881096a0 con 0x7f2288100860 2024-09-17T04:18:49.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.184+0000 7f228cc1b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2288109520 con 0x7f2288101a60 2024-09-17T04:18:49.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.184+0000 7f228659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2288100860 0x7f22881974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:49.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.184+0000 7f228659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2288100860 0x7f22881974f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55800/0 (socket says 172.21.15.88:55800) 2024-09-17T04:18:49.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.184+0000 7f228659c640 1 -- 172.21.15.88:0/1218917224 learned_addr learned my addr 172.21.15.88:0/1218917224 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:18:49.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.184+0000 7f2285d9b640 1 --2- 172.21.15.88:0/1218917224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2288101a60 0x7f2288197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:49.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.185+0000 7f228659c640 1 -- 172.21.15.88:0/1218917224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2288101a60 msgr2=0x7f2288197a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:49.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.185+0000 7f228659c640 1 --2- 172.21.15.88:0/1218917224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2288101a60 0x7f2288197a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:49.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.185+0000 7f228659c640 1 -- 172.21.15.88:0/1218917224 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22881980b0 con 0x7f2288100860 2024-09-17T04:18:49.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.185+0000 7f228659c640 1 --2- 172.21.15.88:0/1218917224 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2288100860 0x7f22881974f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f227800d8d0 tx=0x7f227800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:49.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.185+0000 7f22777fe640 1 -- 172.21.15.88:0/1218917224 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2278017070 con 0x7f2288100860 2024-09-17T04:18:49.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.185+0000 7f22777fe640 1 -- 172.21.15.88:0/1218917224 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f227800be10 con 0x7f2288100860 2024-09-17T04:18:49.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.185+0000 7f228cc1b640 1 -- 172.21.15.88:0/1218917224 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f228819caf0 con 0x7f2288100860 2024-09-17T04:18:49.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.185+0000 7f22777fe640 1 -- 172.21.15.88:0/1218917224 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f227800f3c0 con 0x7f2288100860 2024-09-17T04:18:49.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.185+0000 7f228cc1b640 1 -- 172.21.15.88:0/1218917224 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f228819d050 con 0x7f2288100860 2024-09-17T04:18:49.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.186+0000 7f228cc1b640 1 -- 172.21.15.88:0/1218917224 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2288100c60 con 0x7f2288100860 2024-09-17T04:18:49.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.187+0000 7f22777fe640 1 -- 172.21.15.88:0/1218917224 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f227801a070 con 0x7f2288100860 2024-09-17T04:18:49.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.187+0000 7f22777fe640 1 --2- 172.21.15.88:0/1218917224 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f227006e2b0 0x7f2270070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:49.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.187+0000 7f22777fe640 1 -- 172.21.15.88:0/1218917224 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f227808dd50 con 0x7f2288100860 2024-09-17T04:18:49.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.187+0000 7f2285d9b640 1 --2- 172.21.15.88:0/1218917224 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f227006e2b0 0x7f2270070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:49.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.188+0000 7f2285d9b640 1 --2- 172.21.15.88:0/1218917224 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f227006e2b0 0x7f2270070770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f227c000c00 tx=0x7f227c0058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:49.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.192+0000 7f22777fe640 1 -- 172.21.15.88:0/1218917224 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f227805f300 con 0x7f2288100860 2024-09-17T04:18:49.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.399+0000 7f228cc1b640 1 -- 172.21.15.88:0/1218917224 --> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f22880626f0 con 0x7f227006e2b0 2024-09-17T04:18:49.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.401+0000 7f22777fe640 1 -- 172.21.15.88:0/1218917224 <== mgr.14217 v2:172.21.15.88:6800/1666801150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+358 (secure 0 0 0) 0x7f22880626f0 con 0x7f227006e2b0 2024-09-17T04:18:49.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.403+0000 7f228cc1b640 1 -- 172.21.15.88:0/1218917224 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f227006e2b0 msgr2=0x7f2270070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:49.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.403+0000 7f228cc1b640 1 --2- 172.21.15.88:0/1218917224 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f227006e2b0 0x7f2270070770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f227c000c00 tx=0x7f227c0058d0 comp rx=0 tx=0).stop 2024-09-17T04:18:49.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.403+0000 7f228cc1b640 1 -- 172.21.15.88:0/1218917224 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2288100860 msgr2=0x7f22881974f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:49.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.403+0000 7f228cc1b640 1 --2- 172.21.15.88:0/1218917224 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2288100860 0x7f22881974f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f227800d8d0 tx=0x7f227800dd90 comp rx=0 tx=0).stop 2024-09-17T04:18:49.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.403+0000 7f228cc1b640 1 -- 172.21.15.88:0/1218917224 shutdown_connections 2024-09-17T04:18:49.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.403+0000 7f228cc1b640 1 --2- 172.21.15.88:0/1218917224 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f227006e2b0 0x7f2270070770 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:49.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.403+0000 7f228cc1b640 1 --2- 172.21.15.88:0/1218917224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2288101a60 0x7f2288197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:49.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.403+0000 7f228cc1b640 1 --2- 172.21.15.88:0/1218917224 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2288100860 0x7f22881974f0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:49.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.403+0000 7f228cc1b640 1 -- 172.21.15.88:0/1218917224 >> 172.21.15.88:0/1218917224 conn(0x7f22880fc010 msgr2=0x7f22880fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:49.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.403+0000 7f228cc1b640 1 -- 172.21.15.88:0/1218917224 shutdown_connections 2024-09-17T04:18:49.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.403+0000 7f228cc1b640 1 -- 172.21.15.88:0/1218917224 wait complete. 2024-09-17T04:18:49.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.492+0000 7f24e2c98640 1 -- 172.21.15.88:0/1540629666 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24dc101970 msgr2=0x7f24dc101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:49.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.492+0000 7f24e2c98640 1 --2- 172.21.15.88:0/1540629666 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24dc101970 0x7f24dc101d70 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f24d0009880 tx=0x7f24d002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:18:49.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.492+0000 7f24e2c98640 1 -- 172.21.15.88:0/1540629666 shutdown_connections 2024-09-17T04:18:49.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.492+0000 7f24e2c98640 1 --2- 172.21.15.88:0/1540629666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24dc102b70 0x7f24dc102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:49.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.492+0000 7f24e2c98640 1 --2- 172.21.15.88:0/1540629666 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24dc101970 0x7f24dc101d70 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:49.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.492+0000 7f24e2c98640 1 -- 172.21.15.88:0/1540629666 >> 172.21.15.88:0/1540629666 conn(0x7f24dc0fd140 msgr2=0x7f24dc0ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:49.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.492+0000 7f24e2c98640 1 -- 172.21.15.88:0/1540629666 shutdown_connections 2024-09-17T04:18:49.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.493+0000 7f24e2c98640 1 -- 172.21.15.88:0/1540629666 wait complete. 2024-09-17T04:18:49.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.493+0000 7f24e2c98640 1 Processor -- start 2024-09-17T04:18:49.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.493+0000 7f24e2c98640 1 -- start start 2024-09-17T04:18:49.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.493+0000 7f24e2c98640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24dc101970 0x7f24dc075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:49.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.493+0000 7f24e2c98640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24dc102b70 0x7f24dc0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:49.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.493+0000 7f24e2c98640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f24dc10a7b0 con 0x7f24dc102b70 2024-09-17T04:18:49.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.493+0000 7f24e2c98640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f24dc10a630 con 0x7f24dc101970 2024-09-17T04:18:49.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.494+0000 7f24dbfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24dc102b70 0x7f24dc0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:49.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.494+0000 7f24dbfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24dc102b70 0x7f24dc0745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55810/0 (socket says 172.21.15.88:55810) 2024-09-17T04:18:49.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.494+0000 7f24dbfff640 1 -- 172.21.15.88:0/3446932889 learned_addr learned my addr 172.21.15.88:0/3446932889 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:18:49.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.494+0000 7f24e0a34640 1 --2- 172.21.15.88:0/3446932889 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24dc101970 0x7f24dc075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:49.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.494+0000 7f24dbfff640 1 -- 172.21.15.88:0/3446932889 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24dc101970 msgr2=0x7f24dc075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:49.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.494+0000 7f24dbfff640 1 --2- 172.21.15.88:0/3446932889 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24dc101970 0x7f24dc075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:49.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.494+0000 7f24dbfff640 1 -- 172.21.15.88:0/3446932889 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24dc074b20 con 0x7f24dc102b70 2024-09-17T04:18:49.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.494+0000 7f24dbfff640 1 --2- 172.21.15.88:0/3446932889 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24dc102b70 0x7f24dc0745e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f24c800d6f0 tx=0x7f24c800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:49.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.494+0000 7f24d9ffb640 1 -- 172.21.15.88:0/3446932889 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f24c8017070 con 0x7f24dc102b70 2024-09-17T04:18:49.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.494+0000 7f24d9ffb640 1 -- 172.21.15.88:0/3446932889 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f24c800de00 con 0x7f24dc102b70 2024-09-17T04:18:49.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.494+0000 7f24d9ffb640 1 -- 172.21.15.88:0/3446932889 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f24c8004bb0 con 0x7f24dc102b70 2024-09-17T04:18:49.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.494+0000 7f24e2c98640 1 -- 172.21.15.88:0/3446932889 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24dc074e10 con 0x7f24dc102b70 2024-09-17T04:18:49.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.495+0000 7f24e2c98640 1 -- 172.21.15.88:0/3446932889 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24dc0753a0 con 0x7f24dc102b70 2024-09-17T04:18:49.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.496+0000 7f24e2c98640 1 -- 172.21.15.88:0/3446932889 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24dc101d70 con 0x7f24dc102b70 2024-09-17T04:18:49.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.496+0000 7f24d9ffb640 1 -- 172.21.15.88:0/3446932889 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f24c8004e60 con 0x7f24dc102b70 2024-09-17T04:18:49.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.496+0000 7f24d9ffb640 1 --2- 172.21.15.88:0/3446932889 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f24cc06e2b0 0x7f24cc070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:49.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.497+0000 7f24d9ffb640 1 -- 172.21.15.88:0/3446932889 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f24c808dd10 con 0x7f24dc102b70 2024-09-17T04:18:49.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.497+0000 7f24e0a34640 1 --2- 172.21.15.88:0/3446932889 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f24cc06e2b0 0x7f24cc070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:49.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.497+0000 7f24e0a34640 1 --2- 172.21.15.88:0/3446932889 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f24cc06e2b0 0x7f24cc070770 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f24d0009230 tx=0x7f24d00058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:49.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.501+0000 7f24d9ffb640 1 -- 172.21.15.88:0/3446932889 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f24c805f2c0 con 0x7f24dc102b70 2024-09-17T04:18:49.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.715+0000 7f24e2c98640 1 -- 172.21.15.88:0/3446932889 --> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f24dc062630 con 0x7f24cc06e2b0 2024-09-17T04:18:49.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.725+0000 7f24d9ffb640 1 -- 172.21.15.88:0/3446932889 <== mgr.14217 v2:172.21.15.88:6800/1666801150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3792 (secure 0 0 0) 0x7f24dc062630 con 0x7f24cc06e2b0 2024-09-17T04:18:49.725 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T04:18:49.726 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (4m) 13s ago 5m 25.6M - 0.25.0 c8568f914cd2 f2dbac7e939f 2024-09-17T04:18:49.726 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi088 smithi088 running (6m) 13s ago 6m 8238k - 19.1.1-330-gc2ddf972 ebb0615149de 6ec56b3c8d6d 2024-09-17T04:18:49.726 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi134 smithi134 running (5m) 16s ago 5m 5272k - 19.1.1-330-gc2ddf972 ebb0615149de 6c2b7072b682 2024-09-17T04:18:49.726 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (6m) 13s ago 6m 6903k - 19.1.1-330-gc2ddf972 ebb0615149de de17f5571330 2024-09-17T04:18:49.726 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi134 smithi134 running (5m) 16s ago 5m 6899k - 19.1.1-330-gc2ddf972 ebb0615149de 27f7ef172a1c 2024-09-17T04:18:49.727 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (4m) 13s ago 5m 81.3M - 9.4.12 2bacad6d85d8 a6cff57a23f9 2024-09-17T04:18:49.727 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.giqrgt smithi088 running (29s) 13s ago 29s 19.0M - 19.1.1-330-gc2ddf972 ebb0615149de f724660799a1 2024-09-17T04:18:49.727 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.lgavsv smithi088 running (36s) 13s ago 35s 11.8M - 19.1.1-330-gc2ddf972 ebb0615149de 6cc0fe8a6aa9 2024-09-17T04:18:49.727 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi134.ktuhce smithi134 running (33s) 16s ago 32s 11.3M - 19.1.1-330-gc2ddf972 ebb0615149de 7ff5b70ca9cb 2024-09-17T04:18:49.727 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi134.psnynp smithi134 running (27s) 16s ago 26s 13.1M - 19.1.1-330-gc2ddf972 ebb0615149de 5326974fa3dd 2024-09-17T04:18:49.728 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.wmndiv smithi088 *:9283,8765,8443 running (7m) 13s ago 7m 500M - 19.1.1-330-gc2ddf972 ebb0615149de 2067eec66468 2024-09-17T04:18:49.728 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi134.vwdxcb smithi134 *:8443,9283,8765 running (5m) 16s ago 5m 441M - 19.1.1-330-gc2ddf972 ebb0615149de cdff532c8290 2024-09-17T04:18:49.728 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (7m) 13s ago 7m 46.0M 2048M 19.1.1-330-gc2ddf972 ebb0615149de bbeb722f42bc 2024-09-17T04:18:49.728 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi134 smithi134 running (5m) 16s ago 5m 34.5M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 89de63fb6386 2024-09-17T04:18:49.728 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (6m) 13s ago 6m 15.9M - 1.5.0 0da6a335fe13 9ba03800993b 2024-09-17T04:18:49.728 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi134 smithi134 *:9100 running (5m) 16s ago 5m 17.2M - 1.5.0 0da6a335fe13 6deac483827f 2024-09-17T04:18:49.729 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (3m) 13s ago 3m 47.9M 3946M 19.1.1-330-gc2ddf972 ebb0615149de e309427ee12c 2024-09-17T04:18:49.729 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (3m) 13s ago 3m 57.0M 3946M 19.1.1-330-gc2ddf972 ebb0615149de cc68d92b3333 2024-09-17T04:18:49.729 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (2m) 13s ago 2m 54.0M 3946M 19.1.1-330-gc2ddf972 ebb0615149de 1ba92f2bfce6 2024-09-17T04:18:49.729 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi134 running (2m) 16s ago 2m 54.7M 4970M 19.1.1-330-gc2ddf972 ebb0615149de ebd528c3ce1b 2024-09-17T04:18:49.729 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi134 running (2m) 16s ago 2m 42.9M 4970M 19.1.1-330-gc2ddf972 ebb0615149de eacc25537b3a 2024-09-17T04:18:49.730 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi134 running (94s) 16s ago 94s 48.6M 4970M 19.1.1-330-gc2ddf972 ebb0615149de bc1b434a92a8 2024-09-17T04:18:49.730 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (4m) 13s ago 5m 59.2M - 2.43.0 a07b618ecd1d 3c7fe8c3d4b0 2024-09-17T04:18:49.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.727+0000 7f24e2c98640 1 -- 172.21.15.88:0/3446932889 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f24cc06e2b0 msgr2=0x7f24cc070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:49.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.727+0000 7f24e2c98640 1 --2- 172.21.15.88:0/3446932889 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f24cc06e2b0 0x7f24cc070770 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f24d0009230 tx=0x7f24d00058d0 comp rx=0 tx=0).stop 2024-09-17T04:18:49.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.728+0000 7f24e2c98640 1 -- 172.21.15.88:0/3446932889 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24dc102b70 msgr2=0x7f24dc0745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:49.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.728+0000 7f24e2c98640 1 --2- 172.21.15.88:0/3446932889 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24dc102b70 0x7f24dc0745e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f24c800d6f0 tx=0x7f24c800dbb0 comp rx=0 tx=0).stop 2024-09-17T04:18:49.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.728+0000 7f24e2c98640 1 -- 172.21.15.88:0/3446932889 shutdown_connections 2024-09-17T04:18:49.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.728+0000 7f24e2c98640 1 --2- 172.21.15.88:0/3446932889 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f24cc06e2b0 0x7f24cc070770 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:49.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.728+0000 7f24e2c98640 1 --2- 172.21.15.88:0/3446932889 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24dc102b70 0x7f24dc0745e0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:49.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.728+0000 7f24e2c98640 1 --2- 172.21.15.88:0/3446932889 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24dc101970 0x7f24dc075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:49.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.728+0000 7f24e2c98640 1 -- 172.21.15.88:0/3446932889 >> 172.21.15.88:0/3446932889 conn(0x7f24dc0fd140 msgr2=0x7f24dc106080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:49.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.728+0000 7f24e2c98640 1 -- 172.21.15.88:0/3446932889 shutdown_connections 2024-09-17T04:18:49.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.728+0000 7f24e2c98640 1 -- 172.21.15.88:0/3446932889 wait complete. 2024-09-17T04:18:49.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.814+0000 7fa054e14640 1 -- 172.21.15.88:0/1860425624 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa050101a60 msgr2=0x7fa050101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:49.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.814+0000 7fa054e14640 1 --2- 172.21.15.88:0/1860425624 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa050101a60 0x7fa050101ee0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa044009880 tx=0x7fa04402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:18:49.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.814+0000 7fa054e14640 1 -- 172.21.15.88:0/1860425624 shutdown_connections 2024-09-17T04:18:49.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.814+0000 7fa054e14640 1 --2- 172.21.15.88:0/1860425624 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa050101a60 0x7fa050101ee0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:49.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.814+0000 7fa054e14640 1 --2- 172.21.15.88:0/1860425624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa050100860 0x7fa050100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:49.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.814+0000 7fa054e14640 1 -- 172.21.15.88:0/1860425624 >> 172.21.15.88:0/1860425624 conn(0x7fa0500fc010 msgr2=0x7fa0500fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:49.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.814+0000 7fa054e14640 1 -- 172.21.15.88:0/1860425624 shutdown_connections 2024-09-17T04:18:49.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.814+0000 7fa054e14640 1 -- 172.21.15.88:0/1860425624 wait complete. 2024-09-17T04:18:49.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.815+0000 7fa054e14640 1 Processor -- start 2024-09-17T04:18:49.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.815+0000 7fa054e14640 1 -- start start 2024-09-17T04:18:49.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.815+0000 7fa054e14640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa050100860 0x7fa05006a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:49.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.815+0000 7fa054e14640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa050101a60 0x7fa05019c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:49.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.815+0000 7fa054e14640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa050109720 con 0x7fa050100860 2024-09-17T04:18:49.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.815+0000 7fa054e14640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa0501095a0 con 0x7fa050101a60 2024-09-17T04:18:49.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.815+0000 7fa04e59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa050100860 0x7fa05006a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:49.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.816+0000 7fa04e59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa050100860 0x7fa05006a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55826/0 (socket says 172.21.15.88:55826) 2024-09-17T04:18:49.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.816+0000 7fa04e59c640 1 -- 172.21.15.88:0/1092604922 learned_addr learned my addr 172.21.15.88:0/1092604922 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:18:49.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.816+0000 7fa04dd9b640 1 --2- 172.21.15.88:0/1092604922 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa050101a60 0x7fa05019c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:49.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.816+0000 7fa04e59c640 1 -- 172.21.15.88:0/1092604922 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa050101a60 msgr2=0x7fa05019c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:49.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.816+0000 7fa04e59c640 1 --2- 172.21.15.88:0/1092604922 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa050101a60 0x7fa05019c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:49.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.816+0000 7fa04e59c640 1 -- 172.21.15.88:0/1092604922 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa05019c880 con 0x7fa050100860 2024-09-17T04:18:49.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.816+0000 7fa04e59c640 1 --2- 172.21.15.88:0/1092604922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa050100860 0x7fa05006a790 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa04000b3d0 tx=0x7fa04000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:49.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.816+0000 7fa03f7fe640 1 -- 172.21.15.88:0/1092604922 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa040015020 con 0x7fa050100860 2024-09-17T04:18:49.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.816+0000 7fa03f7fe640 1 -- 172.21.15.88:0/1092604922 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa040011af0 con 0x7fa050100860 2024-09-17T04:18:49.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.816+0000 7fa054e14640 1 -- 172.21.15.88:0/1092604922 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa05019cb70 con 0x7fa050100860 2024-09-17T04:18:49.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.816+0000 7fa03f7fe640 1 -- 172.21.15.88:0/1092604922 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa040010d90 con 0x7fa050100860 2024-09-17T04:18:49.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.816+0000 7fa054e14640 1 -- 172.21.15.88:0/1092604922 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa05019d100 con 0x7fa050100860 2024-09-17T04:18:49.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.817+0000 7fa054e14640 1 -- 172.21.15.88:0/1092604922 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa050100c60 con 0x7fa050100860 2024-09-17T04:18:49.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.818+0000 7fa03f7fe640 1 -- 172.21.15.88:0/1092604922 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fa040018020 con 0x7fa050100860 2024-09-17T04:18:49.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.819+0000 7fa03f7fe640 1 --2- 172.21.15.88:0/1092604922 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fa03806e2b0 0x7fa038070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:49.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.819+0000 7fa04dd9b640 1 --2- 172.21.15.88:0/1092604922 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fa03806e2b0 0x7fa038070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:49.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.819+0000 7fa03f7fe640 1 -- 172.21.15.88:0/1092604922 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7fa04008dd20 con 0x7fa050100860 2024-09-17T04:18:49.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.819+0000 7fa04dd9b640 1 --2- 172.21.15.88:0/1092604922 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fa03806e2b0 0x7fa038070770 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa05006a510 tx=0x7fa044005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:49.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:49.824+0000 7fa03f7fe640 1 -- 172.21.15.88:0/1092604922 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa04001f020 con 0x7fa050100860 2024-09-17T04:18:50.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.088+0000 7fa054e14640 1 -- 172.21.15.88:0/1092604922 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fa050062df0 con 0x7fa050100860 2024-09-17T04:18:50.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.089+0000 7fa03f7fe640 1 -- 172.21.15.88:0/1092604922 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+633 (secure 0 0 0) 0x7fa04005b610 con 0x7fa050100860 2024-09-17T04:18:50.089 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-17T04:18:50.089 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-09-17T04:18:50.089 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T04:18:50.089 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:18:50.089 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-09-17T04:18:50.089 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T04:18:50.089 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:18:50.089 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-09-17T04:18:50.089 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-17T04:18:50.090 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:18:50.090 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2024-09-17T04:18:50.090 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T04:18:50.090 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:18:50.090 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-09-17T04:18:50.090 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 14 2024-09-17T04:18:50.090 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-17T04:18:50.090 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-17T04:18:50.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.091+0000 7fa054e14640 1 -- 172.21.15.88:0/1092604922 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fa03806e2b0 msgr2=0x7fa038070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:50.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.091+0000 7fa054e14640 1 --2- 172.21.15.88:0/1092604922 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fa03806e2b0 0x7fa038070770 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa05006a510 tx=0x7fa044005a20 comp rx=0 tx=0).stop 2024-09-17T04:18:50.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.091+0000 7fa054e14640 1 -- 172.21.15.88:0/1092604922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa050100860 msgr2=0x7fa05006a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:50.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.091+0000 7fa054e14640 1 --2- 172.21.15.88:0/1092604922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa050100860 0x7fa05006a790 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa04000b3d0 tx=0x7fa04000b890 comp rx=0 tx=0).stop 2024-09-17T04:18:50.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.091+0000 7fa054e14640 1 -- 172.21.15.88:0/1092604922 shutdown_connections 2024-09-17T04:18:50.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.091+0000 7fa054e14640 1 --2- 172.21.15.88:0/1092604922 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fa03806e2b0 0x7fa038070770 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:50.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.091+0000 7fa054e14640 1 --2- 172.21.15.88:0/1092604922 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa050101a60 0x7fa05019c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:50.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.091+0000 7fa054e14640 1 --2- 172.21.15.88:0/1092604922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa050100860 0x7fa05006a790 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:50.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.091+0000 7fa054e14640 1 -- 172.21.15.88:0/1092604922 >> 172.21.15.88:0/1092604922 conn(0x7fa0500fc010 msgr2=0x7fa050104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:50.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.091+0000 7fa054e14640 1 -- 172.21.15.88:0/1092604922 shutdown_connections 2024-09-17T04:18:50.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.091+0000 7fa054e14640 1 -- 172.21.15.88:0/1092604922 wait complete. 2024-09-17T04:18:50.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.182+0000 7fc7609b6640 1 -- 172.21.15.88:0/1809033196 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc75c102b60 msgr2=0x7fc75c102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:50.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.182+0000 7fc7609b6640 1 --2- 172.21.15.88:0/1809033196 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc75c102b60 0x7fc75c102fe0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc744009880 tx=0x7fc74402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:18:50.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.182+0000 7fc7609b6640 1 -- 172.21.15.88:0/1809033196 shutdown_connections 2024-09-17T04:18:50.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.182+0000 7fc7609b6640 1 --2- 172.21.15.88:0/1809033196 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc75c102b60 0x7fc75c102fe0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:50.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.182+0000 7fc7609b6640 1 --2- 172.21.15.88:0/1809033196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc75c101960 0x7fc75c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:50.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.182+0000 7fc7609b6640 1 -- 172.21.15.88:0/1809033196 >> 172.21.15.88:0/1809033196 conn(0x7fc75c0fd110 msgr2=0x7fc75c0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:50.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.182+0000 7fc7609b6640 1 -- 172.21.15.88:0/1809033196 shutdown_connections 2024-09-17T04:18:50.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.182+0000 7fc7609b6640 1 -- 172.21.15.88:0/1809033196 wait complete. 2024-09-17T04:18:50.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.183+0000 7fc7609b6640 1 Processor -- start 2024-09-17T04:18:50.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.183+0000 7fc7609b6640 1 -- start start 2024-09-17T04:18:50.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.183+0000 7fc7609b6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc75c101960 0x7fc75c199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:50.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.183+0000 7fc7609b6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc75c102b60 0x7fc75c199c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:50.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.183+0000 7fc7609b6640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc75c10a820 con 0x7fc75c102b60 2024-09-17T04:18:50.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.183+0000 7fc7609b6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc75c10a6a0 con 0x7fc75c101960 2024-09-17T04:18:50.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.184+0000 7fc753fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc75c102b60 0x7fc75c199c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:50.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.184+0000 7fc753fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc75c102b60 0x7fc75c199c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55846/0 (socket says 172.21.15.88:55846) 2024-09-17T04:18:50.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.184+0000 7fc753fff640 1 -- 172.21.15.88:0/3561117872 learned_addr learned my addr 172.21.15.88:0/3561117872 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:18:50.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.184+0000 7fc75a59c640 1 --2- 172.21.15.88:0/3561117872 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc75c101960 0x7fc75c199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:50.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.184+0000 7fc753fff640 1 -- 172.21.15.88:0/3561117872 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc75c101960 msgr2=0x7fc75c199730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:50.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.184+0000 7fc753fff640 1 --2- 172.21.15.88:0/3561117872 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc75c101960 0x7fc75c199730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:50.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.184+0000 7fc753fff640 1 -- 172.21.15.88:0/3561117872 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc75c19a2f0 con 0x7fc75c102b60 2024-09-17T04:18:50.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.184+0000 7fc753fff640 1 --2- 172.21.15.88:0/3561117872 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc75c102b60 0x7fc75c199c70 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc744006010 tx=0x7fc7440048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:50.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.184+0000 7fc7537fe640 1 -- 172.21.15.88:0/3561117872 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc74403f070 con 0x7fc75c102b60 2024-09-17T04:18:50.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.184+0000 7fc7537fe640 1 -- 172.21.15.88:0/3561117872 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc7440044d0 con 0x7fc75c102b60 2024-09-17T04:18:50.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.184+0000 7fc7609b6640 1 -- 172.21.15.88:0/3561117872 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc75c19ecd0 con 0x7fc75c102b60 2024-09-17T04:18:50.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.184+0000 7fc7537fe640 1 -- 172.21.15.88:0/3561117872 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc744035030 con 0x7fc75c102b60 2024-09-17T04:18:50.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.184+0000 7fc7609b6640 1 -- 172.21.15.88:0/3561117872 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc75c19f280 con 0x7fc75c102b60 2024-09-17T04:18:50.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.186+0000 7fc7609b6640 1 -- 172.21.15.88:0/3561117872 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc75c101d40 con 0x7fc75c102b60 2024-09-17T04:18:50.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.186+0000 7fc7537fe640 1 -- 172.21.15.88:0/3561117872 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fc744042070 con 0x7fc75c102b60 2024-09-17T04:18:50.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.187+0000 7fc7537fe640 1 --2- 172.21.15.88:0/3561117872 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fc74806e2b0 0x7fc748070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:50.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.187+0000 7fc7537fe640 1 -- 172.21.15.88:0/3561117872 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7fc7440aeed0 con 0x7fc75c102b60 2024-09-17T04:18:50.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.187+0000 7fc75a59c640 1 --2- 172.21.15.88:0/3561117872 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fc74806e2b0 0x7fc748070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:50.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.187+0000 7fc75a59c640 1 --2- 172.21.15.88:0/3561117872 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fc74806e2b0 0x7fc748070770 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc75c1029c0 tx=0x7fc74c008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:50.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.191+0000 7fc7537fe640 1 -- 172.21.15.88:0/3561117872 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc74407c7d0 con 0x7fc75c102b60 2024-09-17T04:18:50.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.428+0000 7fc7609b6640 1 -- 172.21.15.88:0/3561117872 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fc75c19fb70 con 0x7fc75c102b60 2024-09-17T04:18:50.429 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.429+0000 7fc7537fe640 1 -- 172.21.15.88:0/3561117872 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) ==== 76+0+2045 (secure 0 0 0) 0x7fc744080480 con 0x7fc75c102b60 2024-09-17T04:18:50.429 INFO:teuthology.orchestra.run.smithi088.stdout:e15 2024-09-17T04:18:50.429 INFO:teuthology.orchestra.run.smithi088.stdout:btime 2024-09-17T04:18:27:750910+0000 2024-09-17T04:18:50.429 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T04:18:50.429 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:18:50.429 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2024-09-17T04:18:50.429 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:18:50.430 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2024-09-17T04:18:50.430 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2024-09-17T04:18:50.430 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 15 2024-09-17T04:18:50.430 INFO:teuthology.orchestra.run.smithi088.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T04:18:50.430 INFO:teuthology.orchestra.run.smithi088.stdout:created 2024-09-17T04:18:10.480573+0000 2024-09-17T04:18:50.430 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2024-09-17T04:18:27.750896+0000 2024-09-17T04:18:50.430 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2024-09-17T04:18:50.430 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2024-09-17T04:18:50.430 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2024-09-17T04:18:50.430 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2024-09-17T04:18:50.430 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2024-09-17T04:18:50.430 INFO:teuthology.orchestra.run.smithi088.stdout:max_xattr_size 65536 2024-09-17T04:18:50.431 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2024-09-17T04:18:50.431 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2024-09-17T04:18:50.431 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 45 2024-09-17T04:18:50.431 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:18:50.431 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 1 2024-09-17T04:18:50.431 INFO:teuthology.orchestra.run.smithi088.stdout:in 0 2024-09-17T04:18:50.431 INFO:teuthology.orchestra.run.smithi088.stdout:up {0=14590} 2024-09-17T04:18:50.431 INFO:teuthology.orchestra.run.smithi088.stdout:failed 2024-09-17T04:18:50.431 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2024-09-17T04:18:50.431 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2024-09-17T04:18:50.431 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2024-09-17T04:18:50.432 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2024-09-17T04:18:50.432 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data enabled 2024-09-17T04:18:50.432 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2024-09-17T04:18:50.432 INFO:teuthology.orchestra.run.smithi088.stdout:bal_rank_mask -1 2024-09-17T04:18:50.432 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 1 2024-09-17T04:18:50.432 INFO:teuthology.orchestra.run.smithi088.stdout:qdb_cluster leader: 14590 members: 14590 2024-09-17T04:18:50.432 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.giqrgt{0:14590} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.88:6828/1714846518,v1:172.21.15.88:6829/1714846518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:18:50.432 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi134.psnynp{0:24321} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.134:6826/2137586894,v1:172.21.15.134:6827/2137586894] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:18:50.432 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:18:50.432 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:18:50.432 INFO:teuthology.orchestra.run.smithi088.stdout:Standby daemons: 2024-09-17T04:18:50.432 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:18:50.432 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi134.ktuhce{-1:24325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/967997022,v1:172.21.15.134:6825/967997022] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:18:50.432 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.lgavsv{-1:24329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/1425146180,v1:172.21.15.88:6827/1425146180] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:18:50.433 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 15 2024-09-17T04:18:50.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.431+0000 7fc7609b6640 1 -- 172.21.15.88:0/3561117872 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fc74806e2b0 msgr2=0x7fc748070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:50.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.431+0000 7fc7609b6640 1 --2- 172.21.15.88:0/3561117872 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fc74806e2b0 0x7fc748070770 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc75c1029c0 tx=0x7fc74c008040 comp rx=0 tx=0).stop 2024-09-17T04:18:50.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.431+0000 7fc7609b6640 1 -- 172.21.15.88:0/3561117872 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc75c102b60 msgr2=0x7fc75c199c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:50.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.431+0000 7fc7609b6640 1 --2- 172.21.15.88:0/3561117872 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc75c102b60 0x7fc75c199c70 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc744006010 tx=0x7fc7440048f0 comp rx=0 tx=0).stop 2024-09-17T04:18:50.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.431+0000 7fc7609b6640 1 -- 172.21.15.88:0/3561117872 shutdown_connections 2024-09-17T04:18:50.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.431+0000 7fc7609b6640 1 --2- 172.21.15.88:0/3561117872 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fc74806e2b0 0x7fc748070770 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:50.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.431+0000 7fc7609b6640 1 --2- 172.21.15.88:0/3561117872 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc75c102b60 0x7fc75c199c70 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:50.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.431+0000 7fc7609b6640 1 --2- 172.21.15.88:0/3561117872 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc75c101960 0x7fc75c199730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:50.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.431+0000 7fc7609b6640 1 -- 172.21.15.88:0/3561117872 >> 172.21.15.88:0/3561117872 conn(0x7fc75c0fd110 msgr2=0x7fc75c0746b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:50.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.431+0000 7fc7609b6640 1 -- 172.21.15.88:0/3561117872 shutdown_connections 2024-09-17T04:18:50.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.431+0000 7fc7609b6640 1 -- 172.21.15.88:0/3561117872 wait complete. 2024-09-17T04:18:50.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.523+0000 7f2d96d33640 1 -- 172.21.15.88:0/1083803049 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d90104d60 msgr2=0x7f2d901051e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:50.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.523+0000 7f2d96d33640 1 --2- 172.21.15.88:0/1083803049 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d90104d60 0x7f2d901051e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c009880 tx=0x7f2d7c02a4a0 comp rx=0 tx=0).stop 2024-09-17T04:18:50.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.523+0000 7f2d96d33640 1 -- 172.21.15.88:0/1083803049 shutdown_connections 2024-09-17T04:18:50.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.523+0000 7f2d96d33640 1 --2- 172.21.15.88:0/1083803049 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d90104d60 0x7f2d901051e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:50.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.523+0000 7f2d96d33640 1 --2- 172.21.15.88:0/1083803049 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d90103b60 0x7f2d90103f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:50.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.523+0000 7f2d96d33640 1 -- 172.21.15.88:0/1083803049 >> 172.21.15.88:0/1083803049 conn(0x7f2d900ff2f0 msgr2=0x7f2d90101730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:50.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.523+0000 7f2d96d33640 1 -- 172.21.15.88:0/1083803049 shutdown_connections 2024-09-17T04:18:50.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.523+0000 7f2d96d33640 1 -- 172.21.15.88:0/1083803049 wait complete. 2024-09-17T04:18:50.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.523+0000 7f2d96d33640 1 Processor -- start 2024-09-17T04:18:50.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.523+0000 7f2d96d33640 1 -- start start 2024-09-17T04:18:50.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.523+0000 7f2d96d33640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d90103b60 0x7f2d90199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:50.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.523+0000 7f2d96d33640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d90104d60 0x7f2d90199c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:50.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.523+0000 7f2d96d33640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f2d9010ca20 con 0x7f2d90103b60 2024-09-17T04:18:50.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.523+0000 7f2d96d33640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2d9010c8a0 con 0x7f2d90104d60 2024-09-17T04:18:50.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.524+0000 7f2d94acf640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d90103b60 0x7f2d90199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:50.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.524+0000 7f2d94acf640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d90103b60 0x7f2d90199750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55872/0 (socket says 172.21.15.88:55872) 2024-09-17T04:18:50.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.524+0000 7f2d94acf640 1 -- 172.21.15.88:0/1837976605 learned_addr learned my addr 172.21.15.88:0/1837976605 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:18:50.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.524+0000 7f2d8ffff640 1 --2- 172.21.15.88:0/1837976605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d90104d60 0x7f2d90199c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:50.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.524+0000 7f2d94acf640 1 -- 172.21.15.88:0/1837976605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d90104d60 msgr2=0x7f2d90199c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:50.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.524+0000 7f2d94acf640 1 --2- 172.21.15.88:0/1837976605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d90104d60 0x7f2d90199c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:50.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.524+0000 7f2d94acf640 1 -- 172.21.15.88:0/1837976605 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d9019a310 con 0x7f2d90103b60 2024-09-17T04:18:50.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.524+0000 7f2d8ffff640 1 --2- 172.21.15.88:0/1837976605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d90104d60 0x7f2d90199c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:18:50.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.524+0000 7f2d94acf640 1 --2- 172.21.15.88:0/1837976605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d90103b60 0x7f2d90199750 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2d8400b3d0 tx=0x7f2d8400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:50.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.524+0000 7f2d8dffb640 1 -- 172.21.15.88:0/1837976605 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2d84015020 con 0x7f2d90103b60 2024-09-17T04:18:50.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.524+0000 7f2d8dffb640 1 -- 172.21.15.88:0/1837976605 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2d84011af0 con 0x7f2d90103b60 2024-09-17T04:18:50.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.524+0000 7f2d96d33640 1 -- 172.21.15.88:0/1837976605 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d9019ed50 con 0x7f2d90103b60 2024-09-17T04:18:50.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.524+0000 7f2d8dffb640 1 -- 172.21.15.88:0/1837976605 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2d84010da0 con 0x7f2d90103b60 2024-09-17T04:18:50.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.525+0000 7f2d96d33640 1 -- 172.21.15.88:0/1837976605 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d9019f2d0 con 0x7f2d90103b60 2024-09-17T04:18:50.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.526+0000 7f2d96d33640 1 -- 172.21.15.88:0/1837976605 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d90103f60 con 0x7f2d90103b60 2024-09-17T04:18:50.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.526+0000 7f2d8dffb640 1 -- 172.21.15.88:0/1837976605 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f2d84018020 con 0x7f2d90103b60 2024-09-17T04:18:50.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.527+0000 7f2d8dffb640 1 --2- 172.21.15.88:0/1837976605 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f2d8006e2b0 0x7f2d80070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:50.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.527+0000 7f2d8dffb640 1 -- 172.21.15.88:0/1837976605 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f2d8408dd80 con 0x7f2d90103b60 2024-09-17T04:18:50.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.527+0000 7f2d8ffff640 1 --2- 172.21.15.88:0/1837976605 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f2d8006e2b0 0x7f2d80070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:50.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.527+0000 7f2d8ffff640 1 --2- 172.21.15.88:0/1837976605 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f2d8006e2b0 0x7f2d80070770 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c0096c0 tx=0x7f2d7c009650 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:50.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.532+0000 7f2d8dffb640 1 -- 172.21.15.88:0/1837976605 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2d8401f020 con 0x7f2d90103b60 2024-09-17T04:18:50.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.740+0000 7f2d96d33640 1 -- 172.21.15.88:0/1837976605 --> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2d900626f0 con 0x7f2d8006e2b0 2024-09-17T04:18:50.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.742+0000 7f2d8dffb640 1 -- 172.21.15.88:0/1837976605 <== mgr.14217 v2:172.21.15.88:6800/1666801150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+358 (secure 0 0 0) 0x7f2d900626f0 con 0x7f2d8006e2b0 2024-09-17T04:18:50.742 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-17T04:18:50.742 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:ce1b342bf8c6349a8c90cd607f83bff2443f21cf", 2024-09-17T04:18:50.742 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-09-17T04:18:50.742 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T04:18:50.742 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [], 2024-09-17T04:18:50.742 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "", 2024-09-17T04:18:50.742 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:ce1b342bf8c6349a8c90cd607f83bff2443f21cf image", 2024-09-17T04:18:50.742 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-09-17T04:18:50.743 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-17T04:18:50.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.744+0000 7f2d96d33640 1 -- 172.21.15.88:0/1837976605 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f2d8006e2b0 msgr2=0x7f2d80070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:50.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.744+0000 7f2d96d33640 1 --2- 172.21.15.88:0/1837976605 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f2d8006e2b0 0x7f2d80070770 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c0096c0 tx=0x7f2d7c009650 comp rx=0 tx=0).stop 2024-09-17T04:18:50.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.744+0000 7f2d96d33640 1 -- 172.21.15.88:0/1837976605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d90103b60 msgr2=0x7f2d90199750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:50.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.744+0000 7f2d96d33640 1 --2- 172.21.15.88:0/1837976605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d90103b60 0x7f2d90199750 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2d8400b3d0 tx=0x7f2d8400b890 comp rx=0 tx=0).stop 2024-09-17T04:18:50.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.744+0000 7f2d96d33640 1 -- 172.21.15.88:0/1837976605 shutdown_connections 2024-09-17T04:18:50.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.744+0000 7f2d96d33640 1 --2- 172.21.15.88:0/1837976605 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f2d8006e2b0 0x7f2d80070770 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:50.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.744+0000 7f2d96d33640 1 --2- 172.21.15.88:0/1837976605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d90104d60 0x7f2d90199c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:50.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.744+0000 7f2d96d33640 1 --2- 172.21.15.88:0/1837976605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d90103b60 0x7f2d90199750 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:50.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.744+0000 7f2d96d33640 1 -- 172.21.15.88:0/1837976605 >> 172.21.15.88:0/1837976605 conn(0x7f2d900ff2f0 msgr2=0x7f2d90108270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:50.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.744+0000 7f2d96d33640 1 -- 172.21.15.88:0/1837976605 shutdown_connections 2024-09-17T04:18:50.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.744+0000 7f2d96d33640 1 -- 172.21.15.88:0/1837976605 wait complete. 2024-09-17T04:18:50.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.831+0000 7f70f38ad640 1 -- 172.21.15.88:0/1959755763 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70ec102c20 msgr2=0x7f70ec1030a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:50.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.831+0000 7f70f38ad640 1 --2- 172.21.15.88:0/1959755763 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70ec102c20 0x7f70ec1030a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f70dc009880 tx=0x7f70dc02a4a0 comp rx=0 tx=0).stop 2024-09-17T04:18:50.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.832+0000 7f70f38ad640 1 -- 172.21.15.88:0/1959755763 shutdown_connections 2024-09-17T04:18:50.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.832+0000 7f70f38ad640 1 --2- 172.21.15.88:0/1959755763 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70ec102c20 0x7f70ec1030a0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:50.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.832+0000 7f70f38ad640 1 --2- 172.21.15.88:0/1959755763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70ec0ffc40 0x7f70ec100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:50.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.832+0000 7f70f38ad640 1 -- 172.21.15.88:0/1959755763 >> 172.21.15.88:0/1959755763 conn(0x7f70ec0fb790 msgr2=0x7f70ec0fdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:50.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.832+0000 7f70f38ad640 1 -- 172.21.15.88:0/1959755763 shutdown_connections 2024-09-17T04:18:50.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.832+0000 7f70f38ad640 1 -- 172.21.15.88:0/1959755763 wait complete. 2024-09-17T04:18:50.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.832+0000 7f70f38ad640 1 Processor -- start 2024-09-17T04:18:50.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.832+0000 7f70f38ad640 1 -- start start 2024-09-17T04:18:50.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.832+0000 7f70f38ad640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70ec0ffc40 0x7f70ec197590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:50.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.832+0000 7f70f38ad640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70ec102c20 0x7f70ec197ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:50.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.832+0000 7f70f38ad640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f70ec10a7c0 con 0x7f70ec0ffc40 2024-09-17T04:18:50.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.832+0000 7f70f38ad640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f70ec10a640 con 0x7f70ec102c20 2024-09-17T04:18:50.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.833+0000 7f70f1649640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70ec0ffc40 0x7f70ec197590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:50.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.833+0000 7f70f1649640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70ec0ffc40 0x7f70ec197590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55888/0 (socket says 172.21.15.88:55888) 2024-09-17T04:18:50.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.833+0000 7f70f1649640 1 -- 172.21.15.88:0/459513253 learned_addr learned my addr 172.21.15.88:0/459513253 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:18:50.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.833+0000 7f70f1649640 1 -- 172.21.15.88:0/459513253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70ec102c20 msgr2=0x7f70ec197ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:50.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.833+0000 7f70f1649640 1 --2- 172.21.15.88:0/459513253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70ec102c20 0x7f70ec197ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:50.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.833+0000 7f70f1649640 1 -- 172.21.15.88:0/459513253 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70ec198150 con 0x7f70ec0ffc40 2024-09-17T04:18:50.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.833+0000 7f70f1649640 1 --2- 172.21.15.88:0/459513253 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70ec0ffc40 0x7f70ec197590 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f70e800d8d0 tx=0x7f70e800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:50.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.833+0000 7f70e27fc640 1 -- 172.21.15.88:0/459513253 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f70e8017070 con 0x7f70ec0ffc40 2024-09-17T04:18:50.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.833+0000 7f70e27fc640 1 -- 172.21.15.88:0/459513253 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f70e800be10 con 0x7f70ec0ffc40 2024-09-17T04:18:50.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.833+0000 7f70f38ad640 1 -- 172.21.15.88:0/459513253 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70ec19cb20 con 0x7f70ec0ffc40 2024-09-17T04:18:50.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.833+0000 7f70e27fc640 1 -- 172.21.15.88:0/459513253 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f70e800f3c0 con 0x7f70ec0ffc40 2024-09-17T04:18:50.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.833+0000 7f70f38ad640 1 -- 172.21.15.88:0/459513253 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70ec19d0b0 con 0x7f70ec0ffc40 2024-09-17T04:18:50.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.834+0000 7f70f38ad640 1 -- 172.21.15.88:0/459513253 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70ec100040 con 0x7f70ec0ffc40 2024-09-17T04:18:50.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.835+0000 7f70e27fc640 1 -- 172.21.15.88:0/459513253 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f70e801a070 con 0x7f70ec0ffc40 2024-09-17T04:18:50.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.835+0000 7f70e27fc640 1 --2- 172.21.15.88:0/459513253 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f70d806e310 0x7f70d80707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:18:50.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.835+0000 7f70e27fc640 1 -- 172.21.15.88:0/459513253 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f70e808dd20 con 0x7f70ec0ffc40 2024-09-17T04:18:50.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.835+0000 7f70f0e48640 1 --2- 172.21.15.88:0/459513253 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f70d806e310 0x7f70d80707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:18:50.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.836+0000 7f70f0e48640 1 --2- 172.21.15.88:0/459513253 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f70d806e310 0x7f70d80707d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f70dc0096c0 tx=0x7f70dc000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:18:50.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:50.839+0000 7f70e27fc640 1 -- 172.21.15.88:0/459513253 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f70e805b6a0 con 0x7f70ec0ffc40 2024-09-17T04:18:51.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:51.105+0000 7f70f38ad640 1 -- 172.21.15.88:0/459513253 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f70ec062df0 con 0x7f70ec0ffc40 2024-09-17T04:18:51.105 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:50 smithi088 ceph-mon[27811]: from='client.14656 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:18:51.106 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:50 smithi088 ceph-mon[27811]: from='client.14660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:18:51.106 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:50 smithi088 ceph-mon[27811]: from='client.14664 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:18:51.106 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:50 smithi088 ceph-mon[27811]: pgmap v197: 65 pgs: 65 active+clean; 585 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-17T04:18:51.106 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:50 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/1092604922' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T04:18:51.106 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:50 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/3561117872' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T04:18:51.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:51.105+0000 7f70e27fc640 1 -- 172.21.15.88:0/459513253 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f70e805f350 con 0x7f70ec0ffc40 2024-09-17T04:18:51.106 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T04:18:51.107 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T04:18:51.107 INFO:teuthology.orchestra.run.smithi088.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T04:18:51.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:51.108+0000 7f70f38ad640 1 -- 172.21.15.88:0/459513253 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f70d806e310 msgr2=0x7f70d80707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:51.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:51.108+0000 7f70f38ad640 1 --2- 172.21.15.88:0/459513253 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f70d806e310 0x7f70d80707d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f70dc0096c0 tx=0x7f70dc000bc0 comp rx=0 tx=0).stop 2024-09-17T04:18:51.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:51.108+0000 7f70f38ad640 1 -- 172.21.15.88:0/459513253 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70ec0ffc40 msgr2=0x7f70ec197590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:18:51.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:51.108+0000 7f70f38ad640 1 --2- 172.21.15.88:0/459513253 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70ec0ffc40 0x7f70ec197590 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f70e800d8d0 tx=0x7f70e800dd90 comp rx=0 tx=0).stop 2024-09-17T04:18:51.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:51.108+0000 7f70f38ad640 1 -- 172.21.15.88:0/459513253 shutdown_connections 2024-09-17T04:18:51.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:51.108+0000 7f70f38ad640 1 --2- 172.21.15.88:0/459513253 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f70d806e310 0x7f70d80707d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:51.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:51.108+0000 7f70f38ad640 1 --2- 172.21.15.88:0/459513253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70ec102c20 0x7f70ec197ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:51.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:51.108+0000 7f70f38ad640 1 --2- 172.21.15.88:0/459513253 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70ec0ffc40 0x7f70ec197590 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:18:51.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:51.108+0000 7f70f38ad640 1 -- 172.21.15.88:0/459513253 >> 172.21.15.88:0/459513253 conn(0x7f70ec0fb790 msgr2=0x7f70ec106180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:18:51.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:51.108+0000 7f70f38ad640 1 -- 172.21.15.88:0/459513253 shutdown_connections 2024-09-17T04:18:51.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:18:51.108+0000 7f70f38ad640 1 -- 172.21.15.88:0/459513253 wait complete. 2024-09-17T04:18:51.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:50 smithi134 ceph-mon[35201]: from='client.14656 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:18:51.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:50 smithi134 ceph-mon[35201]: from='client.14660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:18:51.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:50 smithi134 ceph-mon[35201]: from='client.14664 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:18:51.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:50 smithi134 ceph-mon[35201]: pgmap v197: 65 pgs: 65 active+clean; 585 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-17T04:18:51.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:50 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/1092604922' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T04:18:51.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:50 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/3561117872' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T04:18:52.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:51 smithi088 ceph-mon[27811]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:18:52.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:51 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/459513253' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T04:18:52.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:51 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:18:52.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:51 smithi134 ceph-mon[35201]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:18:52.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:51 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/459513253' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T04:18:52.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:51 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:18:53.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:52 smithi088 ceph-mon[27811]: pgmap v198: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-17T04:18:53.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:52 smithi134 ceph-mon[35201]: pgmap v198: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-17T04:18:55.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:54 smithi088 ceph-mon[27811]: pgmap v199: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-17T04:18:55.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:54 smithi134 ceph-mon[35201]: pgmap v199: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-17T04:18:57.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:56 smithi088 ceph-mon[27811]: pgmap v200: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-17T04:18:57.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:56 smithi134 ceph-mon[35201]: pgmap v200: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-17T04:18:59.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:18:58 smithi088 ceph-mon[27811]: pgmap v201: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 597 B/s wr, 3 op/s 2024-09-17T04:18:59.149 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:18:58 smithi134 ceph-mon[35201]: pgmap v201: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 597 B/s wr, 3 op/s 2024-09-17T04:19:01.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:00 smithi088 ceph-mon[27811]: pgmap v202: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-17T04:19:01.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:00 smithi134 ceph-mon[35201]: pgmap v202: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-17T04:19:03.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:02 smithi088 ceph-mon[27811]: pgmap v203: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-17T04:19:03.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:02 smithi134 ceph-mon[35201]: pgmap v203: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-17T04:19:05.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:04 smithi088 ceph-mon[27811]: pgmap v204: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:19:05.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:04 smithi134 ceph-mon[35201]: pgmap v204: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:19:07.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:06 smithi088 ceph-mon[27811]: pgmap v205: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:19:07.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:06 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:19:07.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:06 smithi134 ceph-mon[35201]: pgmap v205: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:19:07.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:06 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:19:09.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:08 smithi088 ceph-mon[27811]: pgmap v206: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:19:09.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:08 smithi134 ceph-mon[35201]: pgmap v206: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:19:11.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:10 smithi088 ceph-mon[27811]: pgmap v207: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:19:11.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:10 smithi134 ceph-mon[35201]: pgmap v207: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:19:13.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:12 smithi134 ceph-mon[35201]: pgmap v208: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:19:13.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:12 smithi088 ceph-mon[27811]: pgmap v208: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:19:15.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:14 smithi088 ceph-mon[27811]: pgmap v209: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:19:15.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:14 smithi134 ceph-mon[35201]: pgmap v209: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:19:17.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:16 smithi134 ceph-mon[35201]: pgmap v210: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:19:17.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:16 smithi088 ceph-mon[27811]: pgmap v210: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:19:19.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:18 smithi088 ceph-mon[27811]: pgmap v211: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:19:19.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:18 smithi134 ceph-mon[35201]: pgmap v211: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:19:21.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:20 smithi088 ceph-mon[27811]: pgmap v212: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:19:21.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:20 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:19:21.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:20 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:19:21.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.219+0000 7f05487da640 1 -- 172.21.15.88:0/959114883 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0540104d20 msgr2=0x7f0540107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:21.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.219+0000 7f05487da640 1 --2- 172.21.15.88:0/959114883 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0540104d20 0x7f0540107110 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f05300098b0 tx=0x7f053002a4d0 comp rx=0 tx=0).stop 2024-09-17T04:19:21.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.219+0000 7f05487da640 1 -- 172.21.15.88:0/959114883 shutdown_connections 2024-09-17T04:19:21.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.219+0000 7f05487da640 1 --2- 172.21.15.88:0/959114883 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0540104d20 0x7f0540107110 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:21.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.219+0000 7f05487da640 1 --2- 172.21.15.88:0/959114883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05401023f0 0x7f05401047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:21.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.219+0000 7f05487da640 1 -- 172.21.15.88:0/959114883 >> 172.21.15.88:0/959114883 conn(0x7f05400fc010 msgr2=0x7f05400fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:19:21.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.219+0000 7f05487da640 1 -- 172.21.15.88:0/959114883 shutdown_connections 2024-09-17T04:19:21.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.219+0000 7f05487da640 1 -- 172.21.15.88:0/959114883 wait complete. 2024-09-17T04:19:21.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.220+0000 7f05487da640 1 Processor -- start 2024-09-17T04:19:21.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.220+0000 7f05487da640 1 -- start start 2024-09-17T04:19:21.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.220+0000 7f05487da640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05401023f0 0x7f0540197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:19:21.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.220+0000 7f05487da640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0540104d20 0x7f0540197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:19:21.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.220+0000 7f05487da640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f054010a790 con 0x7f0540104d20 2024-09-17T04:19:21.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.220+0000 7f05487da640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f054010a610 con 0x7f05401023f0 2024-09-17T04:19:21.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.220+0000 7f0545d75640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0540104d20 0x7f0540197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:19:21.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.220+0000 7f0545d75640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0540104d20 0x7f0540197a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33712/0 (socket says 172.21.15.88:33712) 2024-09-17T04:19:21.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.220+0000 7f0545d75640 1 -- 172.21.15.88:0/3685868554 learned_addr learned my addr 172.21.15.88:0/3685868554 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:19:21.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.221+0000 7f0546576640 1 --2- 172.21.15.88:0/3685868554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05401023f0 0x7f0540197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:19:21.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.221+0000 7f0545d75640 1 -- 172.21.15.88:0/3685868554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05401023f0 msgr2=0x7f0540197510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:21.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.221+0000 7f0545d75640 1 --2- 172.21.15.88:0/3685868554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05401023f0 0x7f0540197510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:21.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.221+0000 7f0545d75640 1 -- 172.21.15.88:0/3685868554 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05401980d0 con 0x7f0540104d20 2024-09-17T04:19:21.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.221+0000 7f0545d75640 1 --2- 172.21.15.88:0/3685868554 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0540104d20 0x7f0540197a50 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f0530009230 tx=0x7f05300045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:19:21.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.221+0000 7f05377fe640 1 -- 172.21.15.88:0/3685868554 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f053003f070 con 0x7f0540104d20 2024-09-17T04:19:21.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.221+0000 7f05377fe640 1 -- 172.21.15.88:0/3685868554 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0530004a50 con 0x7f0540104d20 2024-09-17T04:19:21.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.221+0000 7f05377fe640 1 -- 172.21.15.88:0/3685868554 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0530035030 con 0x7f0540104d20 2024-09-17T04:19:21.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.222+0000 7f05487da640 1 -- 172.21.15.88:0/3685868554 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f054019cab0 con 0x7f0540104d20 2024-09-17T04:19:21.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.222+0000 7f05487da640 1 -- 172.21.15.88:0/3685868554 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f054019d040 con 0x7f0540104d20 2024-09-17T04:19:21.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.223+0000 7f05487da640 1 -- 172.21.15.88:0/3685868554 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05401027d0 con 0x7f0540104d20 2024-09-17T04:19:21.225 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.224+0000 7f05377fe640 1 -- 172.21.15.88:0/3685868554 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f0530042070 con 0x7f0540104d20 2024-09-17T04:19:21.225 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.224+0000 7f05377fe640 1 --2- 172.21.15.88:0/3685868554 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f052c06e310 0x7f052c0707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:19:21.225 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.225+0000 7f05377fe640 1 -- 172.21.15.88:0/3685868554 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f05300aebb0 con 0x7f0540104d20 2024-09-17T04:19:21.225 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.225+0000 7f0546576640 1 --2- 172.21.15.88:0/3685868554 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f052c06e310 0x7f052c0707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:19:21.225 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.225+0000 7f0546576640 1 --2- 172.21.15.88:0/3685868554 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f052c06e310 0x7f052c0707d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f053c005d00 tx=0x7f053c00b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:19:21.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.229+0000 7f05377fe640 1 -- 172.21.15.88:0/3685868554 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f05300b5080 con 0x7f0540104d20 2024-09-17T04:19:21.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:20 smithi134 ceph-mon[35201]: pgmap v212: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:19:21.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:20 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:19:21.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:20 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:19:21.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.421+0000 7f05487da640 1 -- 172.21.15.88:0/3685868554 --> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0540105780 con 0x7f052c06e310 2024-09-17T04:19:21.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.422+0000 7f05377fe640 1 -- 172.21.15.88:0/3685868554 <== mgr.14217 v2:172.21.15.88:6800/1666801150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+447 (secure 0 0 0) 0x7f0540105780 con 0x7f052c06e310 2024-09-17T04:19:21.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.425+0000 7f05487da640 1 -- 172.21.15.88:0/3685868554 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f052c06e310 msgr2=0x7f052c0707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:21.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.425+0000 7f05487da640 1 --2- 172.21.15.88:0/3685868554 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f052c06e310 0x7f052c0707d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f053c005d00 tx=0x7f053c00b410 comp rx=0 tx=0).stop 2024-09-17T04:19:21.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.425+0000 7f05487da640 1 -- 172.21.15.88:0/3685868554 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0540104d20 msgr2=0x7f0540197a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:21.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.425+0000 7f05487da640 1 --2- 172.21.15.88:0/3685868554 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0540104d20 0x7f0540197a50 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f0530009230 tx=0x7f05300045e0 comp rx=0 tx=0).stop 2024-09-17T04:19:21.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.425+0000 7f05487da640 1 -- 172.21.15.88:0/3685868554 shutdown_connections 2024-09-17T04:19:21.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.425+0000 7f05487da640 1 --2- 172.21.15.88:0/3685868554 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f052c06e310 0x7f052c0707d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:21.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.425+0000 7f05487da640 1 --2- 172.21.15.88:0/3685868554 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0540104d20 0x7f0540197a50 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:21.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.425+0000 7f05487da640 1 --2- 172.21.15.88:0/3685868554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05401023f0 0x7f0540197510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:21.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.425+0000 7f05487da640 1 -- 172.21.15.88:0/3685868554 >> 172.21.15.88:0/3685868554 conn(0x7f05400fc010 msgr2=0x7f05400fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:19:21.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.425+0000 7f05487da640 1 -- 172.21.15.88:0/3685868554 shutdown_connections 2024-09-17T04:19:21.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.425+0000 7f05487da640 1 -- 172.21.15.88:0/3685868554 wait complete. 2024-09-17T04:19:21.437 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-09-17T04:19:21.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.516+0000 7f857552a640 1 -- 172.21.15.88:0/1048132707 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8570101960 msgr2=0x7f8570101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:21.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.516+0000 7f857552a640 1 --2- 172.21.15.88:0/1048132707 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8570101960 0x7f8570101d60 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8560009880 tx=0x7f856002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:19:21.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.516+0000 7f857552a640 1 -- 172.21.15.88:0/1048132707 shutdown_connections 2024-09-17T04:19:21.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.516+0000 7f857552a640 1 --2- 172.21.15.88:0/1048132707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8570102b60 0x7f8570102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:21.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.516+0000 7f857552a640 1 --2- 172.21.15.88:0/1048132707 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8570101960 0x7f8570101d60 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:21.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.516+0000 7f857552a640 1 -- 172.21.15.88:0/1048132707 >> 172.21.15.88:0/1048132707 conn(0x7f85700fd110 msgr2=0x7f85700ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:19:21.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.516+0000 7f857552a640 1 -- 172.21.15.88:0/1048132707 shutdown_connections 2024-09-17T04:19:21.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.516+0000 7f857552a640 1 -- 172.21.15.88:0/1048132707 wait complete. 2024-09-17T04:19:21.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.517+0000 7f857552a640 1 Processor -- start 2024-09-17T04:19:21.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.518+0000 7f857552a640 1 -- start start 2024-09-17T04:19:21.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.518+0000 7f857552a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8570101960 0x7f85701974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:19:21.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.518+0000 7f857552a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8570102b60 0x7f8570197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:19:21.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.518+0000 7f857552a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f857010a7a0 con 0x7f8570101960 2024-09-17T04:19:21.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.518+0000 7f857552a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f857010a620 con 0x7f8570102b60 2024-09-17T04:19:21.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.518+0000 7f856effd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8570101960 0x7f85701974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:19:21.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.518+0000 7f856effd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8570101960 0x7f85701974d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33738/0 (socket says 172.21.15.88:33738) 2024-09-17T04:19:21.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.518+0000 7f856effd640 1 -- 172.21.15.88:0/423940863 learned_addr learned my addr 172.21.15.88:0/423940863 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:19:21.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.518+0000 7f856e7fc640 1 --2- 172.21.15.88:0/423940863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8570102b60 0x7f8570197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:19:21.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.518+0000 7f856effd640 1 -- 172.21.15.88:0/423940863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8570102b60 msgr2=0x7f8570197a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:21.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.518+0000 7f856effd640 1 --2- 172.21.15.88:0/423940863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8570102b60 0x7f8570197a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:21.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.518+0000 7f856effd640 1 -- 172.21.15.88:0/423940863 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8570198090 con 0x7f8570101960 2024-09-17T04:19:21.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.519+0000 7f856effd640 1 --2- 172.21.15.88:0/423940863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8570101960 0x7f85701974d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8560009230 tx=0x7f85600045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:19:21.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.519+0000 7f8557fff640 1 -- 172.21.15.88:0/423940863 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f856003f070 con 0x7f8570101960 2024-09-17T04:19:21.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.519+0000 7f8557fff640 1 -- 172.21.15.88:0/423940863 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f85600049d0 con 0x7f8570101960 2024-09-17T04:19:21.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.519+0000 7f8557fff640 1 -- 172.21.15.88:0/423940863 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8560035030 con 0x7f8570101960 2024-09-17T04:19:21.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.519+0000 7f857552a640 1 -- 172.21.15.88:0/423940863 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f857019ca70 con 0x7f8570101960 2024-09-17T04:19:21.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.519+0000 7f857552a640 1 -- 172.21.15.88:0/423940863 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f857019d000 con 0x7f8570101960 2024-09-17T04:19:21.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.520+0000 7f857552a640 1 -- 172.21.15.88:0/423940863 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8570101d60 con 0x7f8570101960 2024-09-17T04:19:21.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.522+0000 7f8557fff640 1 -- 172.21.15.88:0/423940863 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f8560042070 con 0x7f8570101960 2024-09-17T04:19:21.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.522+0000 7f8557fff640 1 --2- 172.21.15.88:0/423940863 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f855806e350 0x7f8558070810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:19:21.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.523+0000 7f8557fff640 1 -- 172.21.15.88:0/423940863 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f85600aeff0 con 0x7f8570101960 2024-09-17T04:19:21.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.523+0000 7f856e7fc640 1 --2- 172.21.15.88:0/423940863 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f855806e350 0x7f8558070810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:19:21.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.523+0000 7f856e7fc640 1 --2- 172.21.15.88:0/423940863 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f855806e350 0x7f8558070810 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8570198980 tx=0x7f8564005f90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:19:21.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.530+0000 7f8557fff640 1 -- 172.21.15.88:0/423940863 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8560080600 con 0x7f8570101960 2024-09-17T04:19:21.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.723+0000 7f857552a640 1 -- 172.21.15.88:0/423940863 --> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8570107130 con 0x7f855806e350 2024-09-17T04:19:21.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.725+0000 7f8557fff640 1 -- 172.21.15.88:0/423940863 <== mgr.14217 v2:172.21.15.88:6800/1666801150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+447 (secure 0 0 0) 0x7f8570107130 con 0x7f855806e350 2024-09-17T04:19:21.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.727+0000 7f857552a640 1 -- 172.21.15.88:0/423940863 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f855806e350 msgr2=0x7f8558070810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:21.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.727+0000 7f857552a640 1 --2- 172.21.15.88:0/423940863 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f855806e350 0x7f8558070810 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8570198980 tx=0x7f8564005f90 comp rx=0 tx=0).stop 2024-09-17T04:19:21.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.727+0000 7f857552a640 1 -- 172.21.15.88:0/423940863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8570101960 msgr2=0x7f85701974d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:21.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.727+0000 7f857552a640 1 --2- 172.21.15.88:0/423940863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8570101960 0x7f85701974d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8560009230 tx=0x7f85600045e0 comp rx=0 tx=0).stop 2024-09-17T04:19:21.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.728+0000 7f857552a640 1 -- 172.21.15.88:0/423940863 shutdown_connections 2024-09-17T04:19:21.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.728+0000 7f857552a640 1 --2- 172.21.15.88:0/423940863 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f855806e350 0x7f8558070810 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:21.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.728+0000 7f857552a640 1 --2- 172.21.15.88:0/423940863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8570102b60 0x7f8570197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:21.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.728+0000 7f857552a640 1 --2- 172.21.15.88:0/423940863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8570101960 0x7f85701974d0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:21.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.728+0000 7f857552a640 1 -- 172.21.15.88:0/423940863 >> 172.21.15.88:0/423940863 conn(0x7f85700fd110 msgr2=0x7f85700ff310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:19:21.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.728+0000 7f857552a640 1 -- 172.21.15.88:0/423940863 shutdown_connections 2024-09-17T04:19:21.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.728+0000 7f857552a640 1 -- 172.21.15.88:0/423940863 wait complete. 2024-09-17T04:19:21.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.841+0000 7f0d1fd0e640 1 -- 172.21.15.88:0/2353075030 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d18104d40 msgr2=0x7f0d18107130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:21.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.841+0000 7f0d1fd0e640 1 --2- 172.21.15.88:0/2353075030 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d18104d40 0x7f0d18107130 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0d080098b0 tx=0x7f0d0802a4d0 comp rx=0 tx=0).stop 2024-09-17T04:19:21.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.841+0000 7f0d1fd0e640 1 -- 172.21.15.88:0/2353075030 shutdown_connections 2024-09-17T04:19:21.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.841+0000 7f0d1fd0e640 1 --2- 172.21.15.88:0/2353075030 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d18104d40 0x7f0d18107130 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:21.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.841+0000 7f0d1fd0e640 1 --2- 172.21.15.88:0/2353075030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d18102410 0x7f0d18104800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:21.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.841+0000 7f0d1fd0e640 1 -- 172.21.15.88:0/2353075030 >> 172.21.15.88:0/2353075030 conn(0x7f0d180fc030 msgr2=0x7f0d180fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:19:21.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.842+0000 7f0d1fd0e640 1 -- 172.21.15.88:0/2353075030 shutdown_connections 2024-09-17T04:19:21.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.842+0000 7f0d1fd0e640 1 -- 172.21.15.88:0/2353075030 wait complete. 2024-09-17T04:19:21.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.842+0000 7f0d1fd0e640 1 Processor -- start 2024-09-17T04:19:21.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.843+0000 7f0d1fd0e640 1 -- start start 2024-09-17T04:19:21.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.843+0000 7f0d1fd0e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d18102410 0x7f0d18197590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:19:21.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.843+0000 7f0d1fd0e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d18104d40 0x7f0d18197ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:19:21.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.843+0000 7f0d1fd0e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f0d1810a7b0 con 0x7f0d18104d40 2024-09-17T04:19:21.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.843+0000 7f0d1fd0e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0d1810a630 con 0x7f0d18102410 2024-09-17T04:19:21.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.843+0000 7f0d1d2a9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d18104d40 0x7f0d18197ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:19:21.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.843+0000 7f0d1daaa640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d18102410 0x7f0d18197590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:19:21.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.843+0000 7f0d1d2a9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d18104d40 0x7f0d18197ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33764/0 (socket says 172.21.15.88:33764) 2024-09-17T04:19:21.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.843+0000 7f0d1d2a9640 1 -- 172.21.15.88:0/2502137674 learned_addr learned my addr 172.21.15.88:0/2502137674 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:19:21.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.844+0000 7f0d1d2a9640 1 -- 172.21.15.88:0/2502137674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d18102410 msgr2=0x7f0d18197590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:21.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.844+0000 7f0d1d2a9640 1 --2- 172.21.15.88:0/2502137674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d18102410 0x7f0d18197590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:21.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.844+0000 7f0d1d2a9640 1 -- 172.21.15.88:0/2502137674 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d18198150 con 0x7f0d18104d40 2024-09-17T04:19:21.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.844+0000 7f0d1d2a9640 1 --2- 172.21.15.88:0/2502137674 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d18104d40 0x7f0d18197ad0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0d08009880 tx=0x7f0d080045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:19:21.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.844+0000 7f0d0effd640 1 -- 172.21.15.88:0/2502137674 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0d0803f070 con 0x7f0d18104d40 2024-09-17T04:19:21.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.844+0000 7f0d0effd640 1 -- 172.21.15.88:0/2502137674 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0d080035f0 con 0x7f0d18104d40 2024-09-17T04:19:21.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.845+0000 7f0d0effd640 1 -- 172.21.15.88:0/2502137674 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0d08035030 con 0x7f0d18104d40 2024-09-17T04:19:21.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.845+0000 7f0d1fd0e640 1 -- 172.21.15.88:0/2502137674 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d18100200 con 0x7f0d18104d40 2024-09-17T04:19:21.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.845+0000 7f0d1fd0e640 1 -- 172.21.15.88:0/2502137674 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d18100760 con 0x7f0d18104d40 2024-09-17T04:19:21.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.847+0000 7f0d1fd0e640 1 -- 172.21.15.88:0/2502137674 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d181027f0 con 0x7f0d18104d40 2024-09-17T04:19:21.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.848+0000 7f0d0effd640 1 -- 172.21.15.88:0/2502137674 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f0d08042070 con 0x7f0d18104d40 2024-09-17T04:19:21.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.849+0000 7f0d0effd640 1 --2- 172.21.15.88:0/2502137674 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f0d0406e350 0x7f0d04070810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:19:21.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.849+0000 7f0d1daaa640 1 --2- 172.21.15.88:0/2502137674 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f0d0406e350 0x7f0d04070810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:19:21.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.849+0000 7f0d0effd640 1 -- 172.21.15.88:0/2502137674 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f0d080ae790 con 0x7f0d18104d40 2024-09-17T04:19:21.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.849+0000 7f0d1daaa640 1 --2- 172.21.15.88:0/2502137674 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f0d0406e350 0x7f0d04070810 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0d14009bd0 tx=0x7f0d14005f90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:19:21.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:21.857+0000 7f0d0effd640 1 -- 172.21.15.88:0/2502137674 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0d0807c070 con 0x7f0d18104d40 2024-09-17T04:19:22.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.080+0000 7f0d1fd0e640 1 -- 172.21.15.88:0/2502137674 --> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f0d181057a0 con 0x7f0d0406e350 2024-09-17T04:19:22.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.097+0000 7f0d0effd640 1 -- 172.21.15.88:0/2502137674 <== mgr.14217 v2:172.21.15.88:6800/1666801150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3792 (secure 0 0 0) 0x7f0d181057a0 con 0x7f0d0406e350 2024-09-17T04:19:22.097 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T04:19:22.097 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (4m) 45s ago 6m 25.6M - 0.25.0 c8568f914cd2 f2dbac7e939f 2024-09-17T04:19:22.097 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi088 smithi088 running (6m) 45s ago 6m 8238k - 19.1.1-330-gc2ddf972 ebb0615149de 6ec56b3c8d6d 2024-09-17T04:19:22.098 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi134 smithi134 running (5m) 48s ago 5m 5272k - 19.1.1-330-gc2ddf972 ebb0615149de 6c2b7072b682 2024-09-17T04:19:22.098 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (6m) 45s ago 6m 6903k - 19.1.1-330-gc2ddf972 ebb0615149de de17f5571330 2024-09-17T04:19:22.098 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi134 smithi134 running (5m) 48s ago 5m 6899k - 19.1.1-330-gc2ddf972 ebb0615149de 27f7ef172a1c 2024-09-17T04:19:22.098 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (4m) 45s ago 6m 81.3M - 9.4.12 2bacad6d85d8 a6cff57a23f9 2024-09-17T04:19:22.098 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.giqrgt smithi088 running (62s) 45s ago 61s 19.0M - 19.1.1-330-gc2ddf972 ebb0615149de f724660799a1 2024-09-17T04:19:22.098 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.lgavsv smithi088 running (68s) 45s ago 67s 11.8M - 19.1.1-330-gc2ddf972 ebb0615149de 6cc0fe8a6aa9 2024-09-17T04:19:22.098 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi134.ktuhce smithi134 running (65s) 48s ago 65s 11.3M - 19.1.1-330-gc2ddf972 ebb0615149de 7ff5b70ca9cb 2024-09-17T04:19:22.098 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi134.psnynp smithi134 running (59s) 48s ago 59s 13.1M - 19.1.1-330-gc2ddf972 ebb0615149de 5326974fa3dd 2024-09-17T04:19:22.098 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.wmndiv smithi088 *:9283,8765,8443 running (7m) 45s ago 7m 500M - 19.1.1-330-gc2ddf972 ebb0615149de 2067eec66468 2024-09-17T04:19:22.098 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi134.vwdxcb smithi134 *:8443,9283,8765 running (5m) 48s ago 5m 441M - 19.1.1-330-gc2ddf972 ebb0615149de cdff532c8290 2024-09-17T04:19:22.098 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (7m) 45s ago 7m 46.0M 2048M 19.1.1-330-gc2ddf972 ebb0615149de bbeb722f42bc 2024-09-17T04:19:22.098 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi134 smithi134 running (5m) 48s ago 5m 34.5M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 89de63fb6386 2024-09-17T04:19:22.098 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (6m) 45s ago 6m 15.9M - 1.5.0 0da6a335fe13 9ba03800993b 2024-09-17T04:19:22.098 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi134 smithi134 *:9100 running (5m) 48s ago 5m 17.2M - 1.5.0 0da6a335fe13 6deac483827f 2024-09-17T04:19:22.099 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (4m) 45s ago 4m 47.9M 3946M 19.1.1-330-gc2ddf972 ebb0615149de e309427ee12c 2024-09-17T04:19:22.099 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (3m) 45s ago 3m 57.0M 3946M 19.1.1-330-gc2ddf972 ebb0615149de cc68d92b3333 2024-09-17T04:19:22.099 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (3m) 45s ago 3m 54.0M 3946M 19.1.1-330-gc2ddf972 ebb0615149de 1ba92f2bfce6 2024-09-17T04:19:22.099 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi134 running (3m) 48s ago 3m 54.7M 4970M 19.1.1-330-gc2ddf972 ebb0615149de ebd528c3ce1b 2024-09-17T04:19:22.099 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi134 running (2m) 48s ago 2m 42.9M 4970M 19.1.1-330-gc2ddf972 ebb0615149de eacc25537b3a 2024-09-17T04:19:22.099 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi134 running (2m) 48s ago 2m 48.6M 4970M 19.1.1-330-gc2ddf972 ebb0615149de bc1b434a92a8 2024-09-17T04:19:22.099 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (4m) 45s ago 6m 59.2M - 2.43.0 a07b618ecd1d 3c7fe8c3d4b0 2024-09-17T04:19:22.099 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:21 smithi088 ceph-mon[27811]: Upgrade: Target is version 19.3.0-4989-gce1b342b (squid) 2024-09-17T04:19:22.099 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:21 smithi088 ceph-mon[27811]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, digests ['quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f'] 2024-09-17T04:19:22.099 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:21 smithi088 ceph-mon[27811]: Upgrade: Need to upgrade myself (mgr.smithi088.wmndiv) 2024-09-17T04:19:22.100 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:21 smithi088 ceph-mon[27811]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f on smithi134 2024-09-17T04:19:22.100 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:21 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:19:22.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.099+0000 7f0d1fd0e640 1 -- 172.21.15.88:0/2502137674 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f0d0406e350 msgr2=0x7f0d04070810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:22.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.100+0000 7f0d1fd0e640 1 --2- 172.21.15.88:0/2502137674 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f0d0406e350 0x7f0d04070810 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0d14009bd0 tx=0x7f0d14005f90 comp rx=0 tx=0).stop 2024-09-17T04:19:22.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.100+0000 7f0d1fd0e640 1 -- 172.21.15.88:0/2502137674 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d18104d40 msgr2=0x7f0d18197ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:22.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.100+0000 7f0d1fd0e640 1 --2- 172.21.15.88:0/2502137674 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d18104d40 0x7f0d18197ad0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0d08009880 tx=0x7f0d080045e0 comp rx=0 tx=0).stop 2024-09-17T04:19:22.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.100+0000 7f0d1fd0e640 1 -- 172.21.15.88:0/2502137674 shutdown_connections 2024-09-17T04:19:22.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.100+0000 7f0d1fd0e640 1 --2- 172.21.15.88:0/2502137674 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f0d0406e350 0x7f0d04070810 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:22.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.100+0000 7f0d1fd0e640 1 --2- 172.21.15.88:0/2502137674 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d18104d40 0x7f0d18197ad0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:22.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.100+0000 7f0d1fd0e640 1 --2- 172.21.15.88:0/2502137674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d18102410 0x7f0d18197590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:22.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.100+0000 7f0d1fd0e640 1 -- 172.21.15.88:0/2502137674 >> 172.21.15.88:0/2502137674 conn(0x7f0d180fc030 msgr2=0x7f0d180fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:19:22.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.100+0000 7f0d1fd0e640 1 -- 172.21.15.88:0/2502137674 shutdown_connections 2024-09-17T04:19:22.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.100+0000 7f0d1fd0e640 1 -- 172.21.15.88:0/2502137674 wait complete. 2024-09-17T04:19:22.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.185+0000 7efcdfc7a640 1 -- 172.21.15.88:0/713670611 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcd8102b60 msgr2=0x7efcd8102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:22.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.185+0000 7efcdfc7a640 1 --2- 172.21.15.88:0/713670611 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcd8102b60 0x7efcd8102fe0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7efcc8009880 tx=0x7efcc802a4a0 comp rx=0 tx=0).stop 2024-09-17T04:19:22.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.185+0000 7efcdfc7a640 1 -- 172.21.15.88:0/713670611 shutdown_connections 2024-09-17T04:19:22.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.185+0000 7efcdfc7a640 1 --2- 172.21.15.88:0/713670611 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcd8102b60 0x7efcd8102fe0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:22.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.185+0000 7efcdfc7a640 1 --2- 172.21.15.88:0/713670611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efcd8101960 0x7efcd8101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:22.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.185+0000 7efcdfc7a640 1 -- 172.21.15.88:0/713670611 >> 172.21.15.88:0/713670611 conn(0x7efcd80fd110 msgr2=0x7efcd80ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:19:22.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.186+0000 7efcdfc7a640 1 -- 172.21.15.88:0/713670611 shutdown_connections 2024-09-17T04:19:22.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.186+0000 7efcdfc7a640 1 -- 172.21.15.88:0/713670611 wait complete. 2024-09-17T04:19:22.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.186+0000 7efcdfc7a640 1 Processor -- start 2024-09-17T04:19:22.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.186+0000 7efcdfc7a640 1 -- start start 2024-09-17T04:19:22.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.186+0000 7efcdfc7a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efcd8101960 0x7efcd81974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:19:22.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.186+0000 7efcdfc7a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcd8102b60 0x7efcd81979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:19:22.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.186+0000 7efcdfc7a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7efcd810a7a0 con 0x7efcd8102b60 2024-09-17T04:19:22.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.186+0000 7efcdfc7a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7efcd810a620 con 0x7efcd8101960 2024-09-17T04:19:22.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.187+0000 7efcdd215640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcd8102b60 0x7efcd81979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:19:22.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.187+0000 7efcdd215640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcd8102b60 0x7efcd81979e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33784/0 (socket says 172.21.15.88:33784) 2024-09-17T04:19:22.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.187+0000 7efcdd215640 1 -- 172.21.15.88:0/976182902 learned_addr learned my addr 172.21.15.88:0/976182902 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:19:22.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.187+0000 7efcdda16640 1 --2- 172.21.15.88:0/976182902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efcd8101960 0x7efcd81974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:19:22.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.187+0000 7efcdd215640 1 -- 172.21.15.88:0/976182902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efcd8101960 msgr2=0x7efcd81974a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:22.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.187+0000 7efcdd215640 1 --2- 172.21.15.88:0/976182902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efcd8101960 0x7efcd81974a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:22.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.187+0000 7efcdd215640 1 -- 172.21.15.88:0/976182902 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcd8198060 con 0x7efcd8102b60 2024-09-17T04:19:22.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.187+0000 7efcdd215640 1 --2- 172.21.15.88:0/976182902 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcd8102b60 0x7efcd81979e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7efcc8009230 tx=0x7efcc8004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:19:22.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.188+0000 7efcceffd640 1 -- 172.21.15.88:0/976182902 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efcc803f070 con 0x7efcd8102b60 2024-09-17T04:19:22.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.188+0000 7efcceffd640 1 -- 172.21.15.88:0/976182902 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efcc8004a90 con 0x7efcd8102b60 2024-09-17T04:19:22.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.188+0000 7efcceffd640 1 -- 172.21.15.88:0/976182902 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efcc8035030 con 0x7efcd8102b60 2024-09-17T04:19:22.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.188+0000 7efcdfc7a640 1 -- 172.21.15.88:0/976182902 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcd8074420 con 0x7efcd8102b60 2024-09-17T04:19:22.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.188+0000 7efcdfc7a640 1 -- 172.21.15.88:0/976182902 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcd80749b0 con 0x7efcd8102b60 2024-09-17T04:19:22.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.189+0000 7efcceffd640 1 -- 172.21.15.88:0/976182902 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7efcc8042070 con 0x7efcd8102b60 2024-09-17T04:19:22.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.190+0000 7efcceffd640 1 --2- 172.21.15.88:0/976182902 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7efcc4072760 0x7efcc4074c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:19:22.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.190+0000 7efcceffd640 1 -- 172.21.15.88:0/976182902 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7efcc80aebc0 con 0x7efcd8102b60 2024-09-17T04:19:22.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.190+0000 7efcdda16640 1 --2- 172.21.15.88:0/976182902 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7efcc4072760 0x7efcc4074c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:19:22.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.191+0000 7efcdda16640 1 --2- 172.21.15.88:0/976182902 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7efcc4072760 0x7efcc4074c20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7efcd81029c0 tx=0x7efcd4005f90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:19:22.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.191+0000 7efcdfc7a640 1 -- 172.21.15.88:0/976182902 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcd8101d60 con 0x7efcd8102b60 2024-09-17T04:19:22.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.195+0000 7efcceffd640 1 -- 172.21.15.88:0/976182902 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efcc807c5e0 con 0x7efcd8102b60 2024-09-17T04:19:22.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:21 smithi134 ceph-mon[35201]: Upgrade: Target is version 19.3.0-4989-gce1b342b (squid) 2024-09-17T04:19:22.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:21 smithi134 ceph-mon[35201]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, digests ['quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f'] 2024-09-17T04:19:22.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:21 smithi134 ceph-mon[35201]: Upgrade: Need to upgrade myself (mgr.smithi088.wmndiv) 2024-09-17T04:19:22.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:21 smithi134 ceph-mon[35201]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f on smithi134 2024-09-17T04:19:22.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:21 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:19:22.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.440+0000 7efcdfc7a640 1 -- 172.21.15.88:0/976182902 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7efcd81915b0 con 0x7efcd8102b60 2024-09-17T04:19:22.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.441+0000 7efcceffd640 1 -- 172.21.15.88:0/976182902 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+633 (secure 0 0 0) 0x7efcc8080290 con 0x7efcd8102b60 2024-09-17T04:19:22.441 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-17T04:19:22.441 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-09-17T04:19:22.441 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T04:19:22.441 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:19:22.441 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-09-17T04:19:22.441 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T04:19:22.441 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:19:22.441 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-09-17T04:19:22.441 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-17T04:19:22.441 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:19:22.441 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2024-09-17T04:19:22.441 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T04:19:22.441 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:19:22.442 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-09-17T04:19:22.442 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 14 2024-09-17T04:19:22.442 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-17T04:19:22.442 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-17T04:19:22.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.443+0000 7efcdfc7a640 1 -- 172.21.15.88:0/976182902 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7efcc4072760 msgr2=0x7efcc4074c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:22.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.443+0000 7efcdfc7a640 1 --2- 172.21.15.88:0/976182902 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7efcc4072760 0x7efcc4074c20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7efcd81029c0 tx=0x7efcd4005f90 comp rx=0 tx=0).stop 2024-09-17T04:19:22.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.443+0000 7efcdfc7a640 1 -- 172.21.15.88:0/976182902 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcd8102b60 msgr2=0x7efcd81979e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:22.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.443+0000 7efcdfc7a640 1 --2- 172.21.15.88:0/976182902 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcd8102b60 0x7efcd81979e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7efcc8009230 tx=0x7efcc8004570 comp rx=0 tx=0).stop 2024-09-17T04:19:22.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.443+0000 7efcdfc7a640 1 -- 172.21.15.88:0/976182902 shutdown_connections 2024-09-17T04:19:22.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.443+0000 7efcdfc7a640 1 --2- 172.21.15.88:0/976182902 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7efcc4072760 0x7efcc4074c20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:22.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.443+0000 7efcdfc7a640 1 --2- 172.21.15.88:0/976182902 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcd8102b60 0x7efcd81979e0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:22.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.443+0000 7efcdfc7a640 1 --2- 172.21.15.88:0/976182902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efcd8101960 0x7efcd81974a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:22.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.443+0000 7efcdfc7a640 1 -- 172.21.15.88:0/976182902 >> 172.21.15.88:0/976182902 conn(0x7efcd80fd110 msgr2=0x7efcd8106070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:19:22.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.443+0000 7efcdfc7a640 1 -- 172.21.15.88:0/976182902 shutdown_connections 2024-09-17T04:19:22.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.443+0000 7efcdfc7a640 1 -- 172.21.15.88:0/976182902 wait complete. 2024-09-17T04:19:22.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.531+0000 7fbf999cb640 1 -- 172.21.15.88:0/1808271354 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf94103920 msgr2=0x7fbf940ff9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:22.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.531+0000 7fbf999cb640 1 --2- 172.21.15.88:0/1808271354 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf94103920 0x7fbf940ff9d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fbf88009880 tx=0x7fbf8802a4a0 comp rx=0 tx=0).stop 2024-09-17T04:19:22.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.531+0000 7fbf999cb640 1 -- 172.21.15.88:0/1808271354 shutdown_connections 2024-09-17T04:19:22.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.531+0000 7fbf999cb640 1 --2- 172.21.15.88:0/1808271354 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf94103920 0x7fbf940ff9d0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:22.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.531+0000 7fbf999cb640 1 --2- 172.21.15.88:0/1808271354 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf94102f50 0x7fbf94103350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:22.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.531+0000 7fbf999cb640 1 -- 172.21.15.88:0/1808271354 >> 172.21.15.88:0/1808271354 conn(0x7fbf940fb760 msgr2=0x7fbf940fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:19:22.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.531+0000 7fbf999cb640 1 -- 172.21.15.88:0/1808271354 shutdown_connections 2024-09-17T04:19:22.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.531+0000 7fbf999cb640 1 -- 172.21.15.88:0/1808271354 wait complete. 2024-09-17T04:19:22.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.531+0000 7fbf999cb640 1 Processor -- start 2024-09-17T04:19:22.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.532+0000 7fbf999cb640 1 -- start start 2024-09-17T04:19:22.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.532+0000 7fbf999cb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf94102f50 0x7fbf941974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:19:22.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.532+0000 7fbf999cb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf94103920 0x7fbf94197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:19:22.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.532+0000 7fbf999cb640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fbf9410a7b0 con 0x7fbf94102f50 2024-09-17T04:19:22.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.532+0000 7fbf999cb640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbf9410a630 con 0x7fbf94103920 2024-09-17T04:19:22.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.532+0000 7fbf92ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf94102f50 0x7fbf941974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:19:22.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.532+0000 7fbf92ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf94102f50 0x7fbf941974d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52336/0 (socket says 172.21.15.88:52336) 2024-09-17T04:19:22.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.532+0000 7fbf92ffd640 1 -- 172.21.15.88:0/3315732666 learned_addr learned my addr 172.21.15.88:0/3315732666 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:19:22.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.532+0000 7fbf927fc640 1 --2- 172.21.15.88:0/3315732666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf94103920 0x7fbf94197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:19:22.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.532+0000 7fbf92ffd640 1 -- 172.21.15.88:0/3315732666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf94103920 msgr2=0x7fbf94197a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:22.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.532+0000 7fbf92ffd640 1 --2- 172.21.15.88:0/3315732666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf94103920 0x7fbf94197a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:22.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.532+0000 7fbf92ffd640 1 -- 172.21.15.88:0/3315732666 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf94198090 con 0x7fbf94102f50 2024-09-17T04:19:22.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.533+0000 7fbf92ffd640 1 --2- 172.21.15.88:0/3315732666 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf94102f50 0x7fbf941974d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fbf8400e940 tx=0x7fbf8400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:19:22.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.533+0000 7fbf989c9640 1 -- 172.21.15.88:0/3315732666 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbf8400cac0 con 0x7fbf94102f50 2024-09-17T04:19:22.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.533+0000 7fbf989c9640 1 -- 172.21.15.88:0/3315732666 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbf8400cc60 con 0x7fbf94102f50 2024-09-17T04:19:22.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.533+0000 7fbf999cb640 1 -- 172.21.15.88:0/3315732666 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf94100b40 con 0x7fbf94102f50 2024-09-17T04:19:22.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.533+0000 7fbf989c9640 1 -- 172.21.15.88:0/3315732666 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbf84003e30 con 0x7fbf94102f50 2024-09-17T04:19:22.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.533+0000 7fbf999cb640 1 -- 172.21.15.88:0/3315732666 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf941010d0 con 0x7fbf94102f50 2024-09-17T04:19:22.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.534+0000 7fbf999cb640 1 -- 172.21.15.88:0/3315732666 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf94103350 con 0x7fbf94102f50 2024-09-17T04:19:22.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.535+0000 7fbf989c9640 1 -- 172.21.15.88:0/3315732666 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fbf84004000 con 0x7fbf94102f50 2024-09-17T04:19:22.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.536+0000 7fbf989c9640 1 --2- 172.21.15.88:0/3315732666 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fbf7c06e310 0x7fbf7c0707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:19:22.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.536+0000 7fbf989c9640 1 -- 172.21.15.88:0/3315732666 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7fbf8408e760 con 0x7fbf94102f50 2024-09-17T04:19:22.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.536+0000 7fbf927fc640 1 --2- 172.21.15.88:0/3315732666 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fbf7c06e310 0x7fbf7c0707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:19:22.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.537+0000 7fbf927fc640 1 --2- 172.21.15.88:0/3315732666 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fbf7c06e310 0x7fbf7c0707d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbf88006010 tx=0x7fbf88000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:19:22.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.544+0000 7fbf989c9640 1 -- 172.21.15.88:0/3315732666 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbf8405c0e0 con 0x7fbf94102f50 2024-09-17T04:19:22.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.755+0000 7fbf999cb640 1 -- 172.21.15.88:0/3315732666 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fbf94101c30 con 0x7fbf94102f50 2024-09-17T04:19:22.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.762+0000 7fbf989c9640 1 -- 172.21.15.88:0/3315732666 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) ==== 76+0+2045 (secure 0 0 0) 0x7fbf8405fd90 con 0x7fbf94102f50 2024-09-17T04:19:22.762 INFO:teuthology.orchestra.run.smithi088.stdout:e15 2024-09-17T04:19:22.762 INFO:teuthology.orchestra.run.smithi088.stdout:btime 2024-09-17T04:18:27:750910+0000 2024-09-17T04:19:22.762 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T04:19:22.762 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:19:22.762 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2024-09-17T04:19:22.762 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:19:22.762 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2024-09-17T04:19:22.762 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2024-09-17T04:19:22.762 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 15 2024-09-17T04:19:22.763 INFO:teuthology.orchestra.run.smithi088.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T04:19:22.763 INFO:teuthology.orchestra.run.smithi088.stdout:created 2024-09-17T04:18:10.480573+0000 2024-09-17T04:19:22.763 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2024-09-17T04:18:27.750896+0000 2024-09-17T04:19:22.763 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2024-09-17T04:19:22.763 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2024-09-17T04:19:22.763 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2024-09-17T04:19:22.763 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2024-09-17T04:19:22.763 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2024-09-17T04:19:22.763 INFO:teuthology.orchestra.run.smithi088.stdout:max_xattr_size 65536 2024-09-17T04:19:22.763 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2024-09-17T04:19:22.763 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2024-09-17T04:19:22.763 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 45 2024-09-17T04:19:22.763 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:19:22.763 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 1 2024-09-17T04:19:22.764 INFO:teuthology.orchestra.run.smithi088.stdout:in 0 2024-09-17T04:19:22.764 INFO:teuthology.orchestra.run.smithi088.stdout:up {0=14590} 2024-09-17T04:19:22.764 INFO:teuthology.orchestra.run.smithi088.stdout:failed 2024-09-17T04:19:22.764 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2024-09-17T04:19:22.764 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2024-09-17T04:19:22.764 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2024-09-17T04:19:22.764 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2024-09-17T04:19:22.764 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data enabled 2024-09-17T04:19:22.764 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2024-09-17T04:19:22.764 INFO:teuthology.orchestra.run.smithi088.stdout:bal_rank_mask -1 2024-09-17T04:19:22.764 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 1 2024-09-17T04:19:22.764 INFO:teuthology.orchestra.run.smithi088.stdout:qdb_cluster leader: 14590 members: 14590 2024-09-17T04:19:22.765 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.giqrgt{0:14590} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.88:6828/1714846518,v1:172.21.15.88:6829/1714846518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:19:22.765 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi134.psnynp{0:24321} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.134:6826/2137586894,v1:172.21.15.134:6827/2137586894] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:19:22.765 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:19:22.765 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:19:22.765 INFO:teuthology.orchestra.run.smithi088.stdout:Standby daemons: 2024-09-17T04:19:22.765 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:19:22.765 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi134.ktuhce{-1:24325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/967997022,v1:172.21.15.134:6825/967997022] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:19:22.765 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.lgavsv{-1:24329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/1425146180,v1:172.21.15.88:6827/1425146180] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:19:22.766 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 15 2024-09-17T04:19:22.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.764+0000 7fbf999cb640 1 -- 172.21.15.88:0/3315732666 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fbf7c06e310 msgr2=0x7fbf7c0707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:22.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.764+0000 7fbf999cb640 1 --2- 172.21.15.88:0/3315732666 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fbf7c06e310 0x7fbf7c0707d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbf88006010 tx=0x7fbf88000bc0 comp rx=0 tx=0).stop 2024-09-17T04:19:22.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.764+0000 7fbf999cb640 1 -- 172.21.15.88:0/3315732666 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf94102f50 msgr2=0x7fbf941974d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:22.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.764+0000 7fbf999cb640 1 --2- 172.21.15.88:0/3315732666 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf94102f50 0x7fbf941974d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fbf8400e940 tx=0x7fbf8400ee00 comp rx=0 tx=0).stop 2024-09-17T04:19:22.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.765+0000 7fbf999cb640 1 -- 172.21.15.88:0/3315732666 shutdown_connections 2024-09-17T04:19:22.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.765+0000 7fbf999cb640 1 --2- 172.21.15.88:0/3315732666 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fbf7c06e310 0x7fbf7c0707d0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:22.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.765+0000 7fbf999cb640 1 --2- 172.21.15.88:0/3315732666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf94103920 0x7fbf94197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:22.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.765+0000 7fbf999cb640 1 --2- 172.21.15.88:0/3315732666 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf94102f50 0x7fbf941974d0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:22.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.765+0000 7fbf999cb640 1 -- 172.21.15.88:0/3315732666 >> 172.21.15.88:0/3315732666 conn(0x7fbf940fb760 msgr2=0x7fbf940fd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:19:22.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.765+0000 7fbf999cb640 1 -- 172.21.15.88:0/3315732666 shutdown_connections 2024-09-17T04:19:22.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.765+0000 7fbf999cb640 1 -- 172.21.15.88:0/3315732666 wait complete. 2024-09-17T04:19:22.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.852+0000 7fd50df36640 1 -- 172.21.15.88:0/288527525 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5080ffc10 msgr2=0x7fd508100010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:22.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.852+0000 7fd50df36640 1 --2- 172.21.15.88:0/288527525 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5080ffc10 0x7fd508100010 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8009880 tx=0x7fd4f802a4a0 comp rx=0 tx=0).stop 2024-09-17T04:19:22.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.852+0000 7fd50df36640 1 -- 172.21.15.88:0/288527525 shutdown_connections 2024-09-17T04:19:22.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.852+0000 7fd50df36640 1 --2- 172.21.15.88:0/288527525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd508102bf0 0x7fd508103070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:22.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.852+0000 7fd50df36640 1 --2- 172.21.15.88:0/288527525 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5080ffc10 0x7fd508100010 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:22.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.852+0000 7fd50df36640 1 -- 172.21.15.88:0/288527525 >> 172.21.15.88:0/288527525 conn(0x7fd5080fb760 msgr2=0x7fd5080fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:19:22.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.852+0000 7fd50df36640 1 -- 172.21.15.88:0/288527525 shutdown_connections 2024-09-17T04:19:22.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.852+0000 7fd50df36640 1 -- 172.21.15.88:0/288527525 wait complete. 2024-09-17T04:19:22.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.853+0000 7fd50df36640 1 Processor -- start 2024-09-17T04:19:22.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.853+0000 7fd50df36640 1 -- start start 2024-09-17T04:19:22.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.853+0000 7fd50df36640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5080ffc10 0x7fd5081974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:19:22.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.853+0000 7fd50df36640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd508102bf0 0x7fd508197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:19:22.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.853+0000 7fd50df36640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fd50810a7a0 con 0x7fd5080ffc10 2024-09-17T04:19:22.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.853+0000 7fd50df36640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd50810a620 con 0x7fd508102bf0 2024-09-17T04:19:22.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.853+0000 7fd5077fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5080ffc10 0x7fd5081974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:19:22.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.853+0000 7fd506ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd508102bf0 0x7fd508197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:19:22.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.853+0000 7fd5077fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5080ffc10 0x7fd5081974d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52362/0 (socket says 172.21.15.88:52362) 2024-09-17T04:19:22.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.853+0000 7fd5077fe640 1 -- 172.21.15.88:0/2053270485 learned_addr learned my addr 172.21.15.88:0/2053270485 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:19:22.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.854+0000 7fd506ffd640 1 -- 172.21.15.88:0/2053270485 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5080ffc10 msgr2=0x7fd5081974d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:22.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.854+0000 7fd506ffd640 1 --2- 172.21.15.88:0/2053270485 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5080ffc10 0x7fd5081974d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:22.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.854+0000 7fd506ffd640 1 -- 172.21.15.88:0/2053270485 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd508198090 con 0x7fd508102bf0 2024-09-17T04:19:22.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.854+0000 7fd5077fe640 1 --2- 172.21.15.88:0/2053270485 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5080ffc10 0x7fd5081974d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:19:22.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.854+0000 7fd506ffd640 1 --2- 172.21.15.88:0/2053270485 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd508102bf0 0x7fd508197a10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc009b50 tx=0x7fd4fc00b690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:19:22.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.855+0000 7fd504ff9640 1 -- 172.21.15.88:0/2053270485 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd4fc01e070 con 0x7fd508102bf0 2024-09-17T04:19:22.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.855+0000 7fd504ff9640 1 -- 172.21.15.88:0/2053270485 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd4fc009e50 con 0x7fd508102bf0 2024-09-17T04:19:22.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.856+0000 7fd504ff9640 1 -- 172.21.15.88:0/2053270485 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd4fc019450 con 0x7fd508102bf0 2024-09-17T04:19:22.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.856+0000 7fd50df36640 1 -- 172.21.15.88:0/2053270485 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd508100a40 con 0x7fd508102bf0 2024-09-17T04:19:22.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.856+0000 7fd50df36640 1 -- 172.21.15.88:0/2053270485 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd508100fa0 con 0x7fd508102bf0 2024-09-17T04:19:22.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.857+0000 7fd50df36640 1 -- 172.21.15.88:0/2053270485 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd50810af80 con 0x7fd508102bf0 2024-09-17T04:19:22.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.858+0000 7fd504ff9640 1 -- 172.21.15.88:0/2053270485 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fd4fc021070 con 0x7fd508102bf0 2024-09-17T04:19:22.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.859+0000 7fd504ff9640 1 --2- 172.21.15.88:0/2053270485 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fd4f006e310 0x7fd4f00707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:19:22.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.859+0000 7fd504ff9640 1 -- 172.21.15.88:0/2053270485 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7fd4fc016070 con 0x7fd508102bf0 2024-09-17T04:19:22.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.859+0000 7fd5077fe640 1 --2- 172.21.15.88:0/2053270485 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fd4f006e310 0x7fd4f00707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:19:22.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.859+0000 7fd5077fe640 1 --2- 172.21.15.88:0/2053270485 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fd4f006e310 0x7fd4f00707d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd4f80096c0 tx=0x7fd4f80058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:19:22.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:22.868+0000 7fd504ff9640 1 -- 172.21.15.88:0/2053270485 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd4fc063330 con 0x7fd508102bf0 2024-09-17T04:19:23.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:22 smithi088 ceph-mon[27811]: from='client.14684 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:19:23.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:22 smithi088 ceph-mon[27811]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:19:23.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:22 smithi088 ceph-mon[27811]: pgmap v213: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:19:23.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:22 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/976182902' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T04:19:23.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:22 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/3315732666' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T04:19:23.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.248+0000 7fd50df36640 1 -- 172.21.15.88:0/2053270485 --> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fd5081071c0 con 0x7fd4f006e310 2024-09-17T04:19:23.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.250+0000 7fd504ff9640 1 -- 172.21.15.88:0/2053270485 <== mgr.14217 v2:172.21.15.88:6800/1666801150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+447 (secure 0 0 0) 0x7fd5081071c0 con 0x7fd4f006e310 2024-09-17T04:19:23.250 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-17T04:19:23.250 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f", 2024-09-17T04:19:23.250 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-09-17T04:19:23.250 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T04:19:23.250 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [], 2024-09-17T04:19:23.250 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "0/23 daemons upgraded", 2024-09-17T04:19:23.250 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f image on host smithi134", 2024-09-17T04:19:23.250 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-09-17T04:19:23.251 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-17T04:19:23.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.253+0000 7fd50df36640 1 -- 172.21.15.88:0/2053270485 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fd4f006e310 msgr2=0x7fd4f00707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:23.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.253+0000 7fd50df36640 1 --2- 172.21.15.88:0/2053270485 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fd4f006e310 0x7fd4f00707d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd4f80096c0 tx=0x7fd4f80058d0 comp rx=0 tx=0).stop 2024-09-17T04:19:23.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.253+0000 7fd50df36640 1 -- 172.21.15.88:0/2053270485 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd508102bf0 msgr2=0x7fd508197a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:23.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.253+0000 7fd50df36640 1 --2- 172.21.15.88:0/2053270485 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd508102bf0 0x7fd508197a10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc009b50 tx=0x7fd4fc00b690 comp rx=0 tx=0).stop 2024-09-17T04:19:23.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.253+0000 7fd50df36640 1 -- 172.21.15.88:0/2053270485 shutdown_connections 2024-09-17T04:19:23.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.253+0000 7fd50df36640 1 --2- 172.21.15.88:0/2053270485 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fd4f006e310 0x7fd4f00707d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:23.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.253+0000 7fd50df36640 1 --2- 172.21.15.88:0/2053270485 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd508102bf0 0x7fd508197a10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:23.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.253+0000 7fd50df36640 1 --2- 172.21.15.88:0/2053270485 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5080ffc10 0x7fd5081974d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:23.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.253+0000 7fd50df36640 1 -- 172.21.15.88:0/2053270485 >> 172.21.15.88:0/2053270485 conn(0x7fd5080fb760 msgr2=0x7fd5080fd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:19:23.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.254+0000 7fd50df36640 1 -- 172.21.15.88:0/2053270485 shutdown_connections 2024-09-17T04:19:23.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.254+0000 7fd50df36640 1 -- 172.21.15.88:0/2053270485 wait complete. 2024-09-17T04:19:23.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.376+0000 7fdd40d6d640 1 -- 172.21.15.88:0/338488300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd3c101960 msgr2=0x7fdd3c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:23.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.376+0000 7fdd40d6d640 1 --2- 172.21.15.88:0/338488300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd3c101960 0x7fdd3c101d60 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c009880 tx=0x7fdd2c02a4a0 comp rx=0 tx=0).stop 2024-09-17T04:19:23.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.377+0000 7fdd40d6d640 1 -- 172.21.15.88:0/338488300 shutdown_connections 2024-09-17T04:19:23.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.377+0000 7fdd40d6d640 1 --2- 172.21.15.88:0/338488300 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdd3c102b60 0x7fdd3c102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:23.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.377+0000 7fdd40d6d640 1 --2- 172.21.15.88:0/338488300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd3c101960 0x7fdd3c101d60 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:23.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.377+0000 7fdd40d6d640 1 -- 172.21.15.88:0/338488300 >> 172.21.15.88:0/338488300 conn(0x7fdd3c0fd110 msgr2=0x7fdd3c0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:19:23.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.377+0000 7fdd40d6d640 1 -- 172.21.15.88:0/338488300 shutdown_connections 2024-09-17T04:19:23.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.377+0000 7fdd40d6d640 1 -- 172.21.15.88:0/338488300 wait complete. 2024-09-17T04:19:23.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.378+0000 7fdd40d6d640 1 Processor -- start 2024-09-17T04:19:23.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.378+0000 7fdd40d6d640 1 -- start start 2024-09-17T04:19:23.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.378+0000 7fdd40d6d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdd3c101960 0x7fdd3c1974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:19:23.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.378+0000 7fdd40d6d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd3c102b60 0x7fdd3c197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:19:23.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.378+0000 7fdd40d6d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3c10a7a0 con 0x7fdd3c102b60 2024-09-17T04:19:23.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.378+0000 7fdd40d6d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3c10a620 con 0x7fdd3c101960 2024-09-17T04:19:23.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.378+0000 7fdd39d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd3c102b60 0x7fdd3c197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:19:23.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.379+0000 7fdd39d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd3c102b60 0x7fdd3c197a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52378/0 (socket says 172.21.15.88:52378) 2024-09-17T04:19:23.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.379+0000 7fdd39d9b640 1 -- 172.21.15.88:0/339044464 learned_addr learned my addr 172.21.15.88:0/339044464 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:19:23.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.379+0000 7fdd3a59c640 1 --2- 172.21.15.88:0/339044464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdd3c101960 0x7fdd3c1974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:19:23.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.379+0000 7fdd39d9b640 1 -- 172.21.15.88:0/339044464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdd3c101960 msgr2=0x7fdd3c1974d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:23.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.379+0000 7fdd39d9b640 1 --2- 172.21.15.88:0/339044464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdd3c101960 0x7fdd3c1974d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:23.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.379+0000 7fdd39d9b640 1 -- 172.21.15.88:0/339044464 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd3c198090 con 0x7fdd3c102b60 2024-09-17T04:19:23.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.379+0000 7fdd39d9b640 1 --2- 172.21.15.88:0/339044464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd3c102b60 0x7fdd3c197a10 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fdd3000d6f0 tx=0x7fdd3000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:19:23.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.379+0000 7fdd2b7fe640 1 -- 172.21.15.88:0/339044464 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdd30017070 con 0x7fdd3c102b60 2024-09-17T04:19:23.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.379+0000 7fdd40d6d640 1 -- 172.21.15.88:0/339044464 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd3c19cad0 con 0x7fdd3c102b60 2024-09-17T04:19:23.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.380+0000 7fdd2b7fe640 1 -- 172.21.15.88:0/339044464 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdd3000de00 con 0x7fdd3c102b60 2024-09-17T04:19:23.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.380+0000 7fdd40d6d640 1 -- 172.21.15.88:0/339044464 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd3c19d060 con 0x7fdd3c102b60 2024-09-17T04:19:23.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.380+0000 7fdd2b7fe640 1 -- 172.21.15.88:0/339044464 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdd30020060 con 0x7fdd3c102b60 2024-09-17T04:19:23.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.381+0000 7fdd40d6d640 1 -- 172.21.15.88:0/339044464 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd3c101d60 con 0x7fdd3c102b60 2024-09-17T04:19:23.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.382+0000 7fdd2b7fe640 1 -- 172.21.15.88:0/339044464 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fdd30005020 con 0x7fdd3c102b60 2024-09-17T04:19:23.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.383+0000 7fdd2b7fe640 1 --2- 172.21.15.88:0/339044464 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fdd2406e2b0 0x7fdd24070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:19:23.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.383+0000 7fdd2b7fe640 1 -- 172.21.15.88:0/339044464 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7fdd3008dba0 con 0x7fdd3c102b60 2024-09-17T04:19:23.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.383+0000 7fdd3a59c640 1 --2- 172.21.15.88:0/339044464 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fdd2406e2b0 0x7fdd24070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:19:23.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.383+0000 7fdd3a59c640 1 --2- 172.21.15.88:0/339044464 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fdd2406e2b0 0x7fdd24070770 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c009230 tx=0x7fdd2c0058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:19:23.387 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.387+0000 7fdd2b7fe640 1 -- 172.21.15.88:0/339044464 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdd3005f150 con 0x7fdd3c102b60 2024-09-17T04:19:23.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:22 smithi134 ceph-mon[35201]: from='client.14684 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:19:23.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:22 smithi134 ceph-mon[35201]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:19:23.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:22 smithi134 ceph-mon[35201]: pgmap v213: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:19:23.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:22 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/976182902' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T04:19:23.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:22 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/3315732666' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T04:19:23.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.869+0000 7fdd40d6d640 1 -- 172.21.15.88:0/339044464 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fdd3c02d7c0 con 0x7fdd3c102b60 2024-09-17T04:19:23.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.869+0000 7fdd2b7fe640 1 -- 172.21.15.88:0/339044464 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7fdd30063980 con 0x7fdd3c102b60 2024-09-17T04:19:23.869 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T04:19:23.869 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T04:19:23.869 INFO:teuthology.orchestra.run.smithi088.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T04:19:23.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.872+0000 7fdd40d6d640 1 -- 172.21.15.88:0/339044464 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fdd2406e2b0 msgr2=0x7fdd24070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:23.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.872+0000 7fdd40d6d640 1 --2- 172.21.15.88:0/339044464 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fdd2406e2b0 0x7fdd24070770 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c009230 tx=0x7fdd2c0058d0 comp rx=0 tx=0).stop 2024-09-17T04:19:23.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.872+0000 7fdd40d6d640 1 -- 172.21.15.88:0/339044464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd3c102b60 msgr2=0x7fdd3c197a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:23.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.872+0000 7fdd40d6d640 1 --2- 172.21.15.88:0/339044464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd3c102b60 0x7fdd3c197a10 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fdd3000d6f0 tx=0x7fdd3000dbb0 comp rx=0 tx=0).stop 2024-09-17T04:19:23.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.872+0000 7fdd40d6d640 1 -- 172.21.15.88:0/339044464 shutdown_connections 2024-09-17T04:19:23.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.872+0000 7fdd40d6d640 1 --2- 172.21.15.88:0/339044464 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fdd2406e2b0 0x7fdd24070770 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:23.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.872+0000 7fdd40d6d640 1 --2- 172.21.15.88:0/339044464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd3c102b60 0x7fdd3c197a10 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:23.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.872+0000 7fdd40d6d640 1 --2- 172.21.15.88:0/339044464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdd3c101960 0x7fdd3c1974d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:23.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.872+0000 7fdd40d6d640 1 -- 172.21.15.88:0/339044464 >> 172.21.15.88:0/339044464 conn(0x7fdd3c0fd110 msgr2=0x7fdd3c106060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:19:23.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.873+0000 7fdd40d6d640 1 -- 172.21.15.88:0/339044464 shutdown_connections 2024-09-17T04:19:23.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:23.873+0000 7fdd40d6d640 1 -- 172.21.15.88:0/339044464 wait complete. 2024-09-17T04:19:24.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:23 smithi088 ceph-mon[27811]: from='client.14692 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:19:24.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:23 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/339044464' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T04:19:24.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:23 smithi134 ceph-mon[35201]: from='client.14692 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:19:24.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:23 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/339044464' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T04:19:25.083 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:24 smithi088 ceph-mon[27811]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:19:25.083 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:24 smithi088 ceph-mon[27811]: pgmap v214: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:19:25.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:24 smithi134 ceph-mon[35201]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:19:25.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:24 smithi134 ceph-mon[35201]: pgmap v214: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:19:27.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:26 smithi088 ceph-mon[27811]: pgmap v215: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:19:27.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:26 smithi134 ceph-mon[35201]: pgmap v215: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:19:29.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:28 smithi088 ceph-mon[27811]: pgmap v216: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:19:29.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:28 smithi134 ceph-mon[35201]: pgmap v216: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:19:31.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:30 smithi088 ceph-mon[27811]: pgmap v217: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:19:31.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:30 smithi134 ceph-mon[35201]: pgmap v217: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:19:33.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:32 smithi088 ceph-mon[27811]: pgmap v218: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:19:33.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:32 smithi134 ceph-mon[35201]: pgmap v218: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:19:35.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:34 smithi088 ceph-mon[27811]: pgmap v219: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:19:35.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:34 smithi134 ceph-mon[35201]: pgmap v219: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:19:37.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:36 smithi088 ceph-mon[27811]: pgmap v220: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:19:37.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:36 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:19:37.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:36 smithi134 ceph-mon[35201]: pgmap v220: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:19:37.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:36 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:19:39.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:38 smithi088 ceph-mon[27811]: pgmap v221: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:19:39.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:38 smithi134 ceph-mon[35201]: pgmap v221: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:19:41.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:40 smithi088 ceph-mon[27811]: pgmap v222: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:19:41.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:40 smithi134 ceph-mon[35201]: pgmap v222: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:19:43.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:42 smithi088 ceph-mon[27811]: pgmap v223: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:19:43.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:42 smithi134 ceph-mon[35201]: pgmap v223: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:19:45.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:44 smithi088 ceph-mon[27811]: pgmap v224: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:19:45.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:44 smithi134 ceph-mon[35201]: pgmap v224: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:19:45.350 INFO:tasks.workunit.client.0.smithi088.stderr:Updating files: 96% (12293/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-17T04:19:46.100 INFO:tasks.workunit.client.0.smithi088.stderr:Note: switching to 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'. 2024-09-17T04:19:46.101 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-09-17T04:19:46.101 INFO:tasks.workunit.client.0.smithi088.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-17T04:19:46.101 INFO:tasks.workunit.client.0.smithi088.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-17T04:19:46.101 INFO:tasks.workunit.client.0.smithi088.stderr:state without impacting any branches by switching back to a branch. 2024-09-17T04:19:46.101 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-09-17T04:19:46.101 INFO:tasks.workunit.client.0.smithi088.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-17T04:19:46.101 INFO:tasks.workunit.client.0.smithi088.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-17T04:19:46.101 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-09-17T04:19:46.101 INFO:tasks.workunit.client.0.smithi088.stderr: git switch -c 2024-09-17T04:19:46.101 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-09-17T04:19:46.101 INFO:tasks.workunit.client.0.smithi088.stderr:Or undo this operation with: 2024-09-17T04:19:46.101 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-09-17T04:19:46.101 INFO:tasks.workunit.client.0.smithi088.stderr: git switch - 2024-09-17T04:19:46.102 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-09-17T04:19:46.102 INFO:tasks.workunit.client.0.smithi088.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-17T04:19:46.102 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-09-17T04:19:46.102 INFO:tasks.workunit.client.0.smithi088.stderr:HEAD is now at ce1b342bf8c Merge PR #55006 into wip-pdonnell-testing-20240916.200549-debug 2024-09-17T04:19:46.107 DEBUG:teuthology.orchestra.run.smithi088:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-17T04:19:46.305 INFO:tasks.workunit.client.0.smithi088.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-17T04:19:46.307 INFO:tasks.workunit.client.0.smithi088.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-17T04:19:46.308 INFO:tasks.workunit.client.0.smithi088.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-17T04:19:46.929 INFO:tasks.workunit.client.1.smithi134.stderr:Updating files: 93% (11818/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-17T04:19:47.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:46 smithi088 ceph-mon[27811]: pgmap v225: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:19:47.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:46 smithi134 ceph-mon[35201]: pgmap v225: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:19:47.850 INFO:tasks.workunit.client.1.smithi134.stderr:Note: switching to 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'. 2024-09-17T04:19:47.851 INFO:tasks.workunit.client.1.smithi134.stderr: 2024-09-17T04:19:47.851 INFO:tasks.workunit.client.1.smithi134.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-17T04:19:47.851 INFO:tasks.workunit.client.1.smithi134.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-17T04:19:47.851 INFO:tasks.workunit.client.1.smithi134.stderr:state without impacting any branches by switching back to a branch. 2024-09-17T04:19:47.851 INFO:tasks.workunit.client.1.smithi134.stderr: 2024-09-17T04:19:47.851 INFO:tasks.workunit.client.1.smithi134.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-17T04:19:47.851 INFO:tasks.workunit.client.1.smithi134.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-17T04:19:47.851 INFO:tasks.workunit.client.1.smithi134.stderr: 2024-09-17T04:19:47.851 INFO:tasks.workunit.client.1.smithi134.stderr: git switch -c 2024-09-17T04:19:47.851 INFO:tasks.workunit.client.1.smithi134.stderr: 2024-09-17T04:19:47.851 INFO:tasks.workunit.client.1.smithi134.stderr:Or undo this operation with: 2024-09-17T04:19:47.851 INFO:tasks.workunit.client.1.smithi134.stderr: 2024-09-17T04:19:47.851 INFO:tasks.workunit.client.1.smithi134.stderr: git switch - 2024-09-17T04:19:47.851 INFO:tasks.workunit.client.1.smithi134.stderr: 2024-09-17T04:19:47.852 INFO:tasks.workunit.client.1.smithi134.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-17T04:19:47.852 INFO:tasks.workunit.client.1.smithi134.stderr: 2024-09-17T04:19:47.852 INFO:tasks.workunit.client.1.smithi134.stderr:HEAD is now at ce1b342bf8c Merge PR #55006 into wip-pdonnell-testing-20240916.200549-debug 2024-09-17T04:19:47.856 DEBUG:teuthology.orchestra.run.smithi134:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-09-17T04:19:47.922 INFO:tasks.workunit.client.1.smithi134.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-17T04:19:47.924 INFO:tasks.workunit.client.1.smithi134.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-17T04:19:47.924 INFO:tasks.workunit.client.1.smithi134.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-17T04:19:48.841 INFO:tasks.workunit.client.1.smithi134.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-17T04:19:48.914 INFO:tasks.workunit.client.1.smithi134.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-17T04:19:48.959 INFO:tasks.workunit.client.1.smithi134.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-17T04:19:48.960 INFO:tasks.workunit.client.1.smithi134.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-17T04:19:48.960 INFO:tasks.workunit.client.1.smithi134.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-17T04:19:49.005 INFO:tasks.workunit.client.1.smithi134.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-17T04:19:49.008 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-17T04:19:49.008 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-09-17T04:19:49.065 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-09-17T04:19:49.066 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-17T04:19:49.067 DEBUG:teuthology.orchestra.run.smithi134:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ce1b342bf8c6349a8c90cd607f83bff2443f21cf TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-09-17T04:19:49.133 INFO:tasks.workunit.client.1.smithi134.stderr:+ mkdir -p fsstress 2024-09-17T04:19:49.135 INFO:tasks.workunit.client.1.smithi134.stderr:+ pushd fsstress 2024-09-17T04:19:49.137 INFO:tasks.workunit.client.1.smithi134.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-17T04:19:49.137 INFO:tasks.workunit.client.1.smithi134.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-17T04:19:49.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:48 smithi134 ceph-mon[35201]: pgmap v226: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:19:49.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:48 smithi088 ceph-mon[27811]: pgmap v226: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:19:49.720 INFO:tasks.workunit.client.1.smithi134.stderr:+ tar xzf ltp-full.tgz 2024-09-17T04:19:51.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:50 smithi134 ceph-mon[35201]: pgmap v227: 65 pgs: 65 active+clean; 4.6 MiB data, 185 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 341 KiB/s wr, 1 op/s 2024-09-17T04:19:51.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:50 smithi088 ceph-mon[27811]: pgmap v227: 65 pgs: 65 active+clean; 4.6 MiB data, 185 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 341 KiB/s wr, 1 op/s 2024-09-17T04:19:52.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:51 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:19:52.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:51 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:19:52.618 INFO:tasks.workunit.client.0.smithi088.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-17T04:19:52.931 INFO:tasks.workunit.client.0.smithi088.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-17T04:19:53.167 INFO:tasks.workunit.client.0.smithi088.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-17T04:19:53.169 INFO:tasks.workunit.client.0.smithi088.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-17T04:19:53.169 INFO:tasks.workunit.client.0.smithi088.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-17T04:19:53.251 INFO:tasks.workunit.client.0.smithi088.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-17T04:19:53.254 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-17T04:19:53.254 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-17T04:19:53.270 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-09-17T04:19:53.271 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-17T04:19:53.272 DEBUG:teuthology.orchestra.run.smithi088:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ce1b342bf8c6349a8c90cd607f83bff2443f21cf TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-09-17T04:19:53.335 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir -p fsstress 2024-09-17T04:19:53.338 INFO:tasks.workunit.client.0.smithi088.stderr:+ pushd fsstress 2024-09-17T04:19:53.339 INFO:tasks.workunit.client.0.smithi088.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-17T04:19:53.339 INFO:tasks.workunit.client.0.smithi088.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-17T04:19:53.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:52 smithi088 ceph-mon[27811]: pgmap v228: 65 pgs: 65 active+clean; 5.5 MiB data, 192 MiB used, 536 GiB / 536 GiB avail; 41 KiB/s rd, 420 KiB/s wr, 8 op/s 2024-09-17T04:19:53.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:52 smithi134 ceph-mon[35201]: pgmap v228: 65 pgs: 65 active+clean; 5.5 MiB data, 192 MiB used, 536 GiB / 536 GiB avail; 41 KiB/s rd, 420 KiB/s wr, 8 op/s 2024-09-17T04:19:53.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:53.966+0000 7fd9a103c640 1 -- 172.21.15.88:0/141107993 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd99c100860 msgr2=0x7fd99c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:53.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:53.966+0000 7fd9a103c640 1 --2- 172.21.15.88:0/141107993 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd99c100860 0x7fd99c100c60 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd994009880 tx=0x7fd99402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:19:53.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:53.966+0000 7fd9a103c640 1 -- 172.21.15.88:0/141107993 shutdown_connections 2024-09-17T04:19:53.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:53.966+0000 7fd9a103c640 1 --2- 172.21.15.88:0/141107993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd99c101a60 0x7fd99c101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:53.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:53.966+0000 7fd9a103c640 1 --2- 172.21.15.88:0/141107993 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd99c100860 0x7fd99c100c60 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:53.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:53.966+0000 7fd9a103c640 1 -- 172.21.15.88:0/141107993 >> 172.21.15.88:0/141107993 conn(0x7fd99c0fc010 msgr2=0x7fd99c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:19:53.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:53.966+0000 7fd9a103c640 1 -- 172.21.15.88:0/141107993 shutdown_connections 2024-09-17T04:19:53.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:53.967+0000 7fd9a103c640 1 -- 172.21.15.88:0/141107993 wait complete. 2024-09-17T04:19:53.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:53.967+0000 7fd9a103c640 1 Processor -- start 2024-09-17T04:19:53.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:53.968+0000 7fd9a103c640 1 -- start start 2024-09-17T04:19:53.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:53.968+0000 7fd9a103c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd99c100860 0x7fd99c06aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:19:53.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:53.968+0000 7fd9a103c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd99c101a60 0x7fd99c19c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:19:53.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:53.968+0000 7fd9a103c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fd99c1096a0 con 0x7fd99c100860 2024-09-17T04:19:53.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:53.968+0000 7fd9a103c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd99c109520 con 0x7fd99c101a60 2024-09-17T04:19:53.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:53.968+0000 7fd99ad9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd99c100860 0x7fd99c06aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:19:53.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:53.968+0000 7fd99ad9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd99c100860 0x7fd99c06aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38238/0 (socket says 172.21.15.88:38238) 2024-09-17T04:19:53.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:53.968+0000 7fd99ad9d640 1 -- 172.21.15.88:0/1630915420 learned_addr learned my addr 172.21.15.88:0/1630915420 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:19:53.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:53.968+0000 7fd99a59c640 1 --2- 172.21.15.88:0/1630915420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd99c101a60 0x7fd99c19c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:19:53.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:53.968+0000 7fd99ad9d640 1 -- 172.21.15.88:0/1630915420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd99c101a60 msgr2=0x7fd99c19c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:53.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:53.968+0000 7fd99ad9d640 1 --2- 172.21.15.88:0/1630915420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd99c101a60 0x7fd99c19c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:53.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:53.968+0000 7fd99ad9d640 1 -- 172.21.15.88:0/1630915420 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd99c19c7f0 con 0x7fd99c100860 2024-09-17T04:19:53.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:53.968+0000 7fd99ad9d640 1 --2- 172.21.15.88:0/1630915420 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd99c100860 0x7fd99c06aca0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd994006010 tx=0x7fd9940045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:19:53.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:53.969+0000 7fd993fff640 1 -- 172.21.15.88:0/1630915420 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd99403f070 con 0x7fd99c100860 2024-09-17T04:19:53.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:53.969+0000 7fd993fff640 1 -- 172.21.15.88:0/1630915420 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd994004a50 con 0x7fd99c100860 2024-09-17T04:19:53.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:53.969+0000 7fd9a103c640 1 -- 172.21.15.88:0/1630915420 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd99c19ca80 con 0x7fd99c100860 2024-09-17T04:19:53.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:53.969+0000 7fd993fff640 1 -- 172.21.15.88:0/1630915420 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd994035030 con 0x7fd99c100860 2024-09-17T04:19:53.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:53.969+0000 7fd9a103c640 1 -- 172.21.15.88:0/1630915420 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd99c19cfb0 con 0x7fd99c100860 2024-09-17T04:19:53.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:53.970+0000 7fd9a103c640 1 -- 172.21.15.88:0/1630915420 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd99c100c60 con 0x7fd99c100860 2024-09-17T04:19:53.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:53.970+0000 7fd993fff640 1 -- 172.21.15.88:0/1630915420 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fd994042070 con 0x7fd99c100860 2024-09-17T04:19:53.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:53.971+0000 7fd993fff640 1 --2- 172.21.15.88:0/1630915420 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fd98806e310 0x7fd9880707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:19:53.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:53.971+0000 7fd993fff640 1 -- 172.21.15.88:0/1630915420 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7fd9940aecf0 con 0x7fd99c100860 2024-09-17T04:19:53.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:53.971+0000 7fd99a59c640 1 --2- 172.21.15.88:0/1630915420 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fd98806e310 0x7fd9880707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:19:53.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:53.972+0000 7fd99a59c640 1 --2- 172.21.15.88:0/1630915420 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fd98806e310 0x7fd9880707d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd99c06aa20 tx=0x7fd98400b390 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:19:53.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:53.976+0000 7fd993fff640 1 -- 172.21.15.88:0/1630915420 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd994080290 con 0x7fd99c100860 2024-09-17T04:19:54.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.173+0000 7fd9a103c640 1 -- 172.21.15.88:0/1630915420 --> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fd99c062630 con 0x7fd98806e310 2024-09-17T04:19:54.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.174+0000 7fd993fff640 1 -- 172.21.15.88:0/1630915420 <== mgr.14217 v2:172.21.15.88:6800/1666801150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+447 (secure 0 0 0) 0x7fd99c062630 con 0x7fd98806e310 2024-09-17T04:19:54.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.176+0000 7fd9a103c640 1 -- 172.21.15.88:0/1630915420 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fd98806e310 msgr2=0x7fd9880707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:54.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.176+0000 7fd9a103c640 1 --2- 172.21.15.88:0/1630915420 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fd98806e310 0x7fd9880707d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd99c06aa20 tx=0x7fd98400b390 comp rx=0 tx=0).stop 2024-09-17T04:19:54.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.176+0000 7fd9a103c640 1 -- 172.21.15.88:0/1630915420 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd99c100860 msgr2=0x7fd99c06aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:54.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.176+0000 7fd9a103c640 1 --2- 172.21.15.88:0/1630915420 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd99c100860 0x7fd99c06aca0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd994006010 tx=0x7fd9940045e0 comp rx=0 tx=0).stop 2024-09-17T04:19:54.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.176+0000 7fd9a103c640 1 -- 172.21.15.88:0/1630915420 shutdown_connections 2024-09-17T04:19:54.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.176+0000 7fd9a103c640 1 --2- 172.21.15.88:0/1630915420 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fd98806e310 0x7fd9880707d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:54.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.176+0000 7fd9a103c640 1 --2- 172.21.15.88:0/1630915420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd99c101a60 0x7fd99c19c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:54.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.176+0000 7fd9a103c640 1 --2- 172.21.15.88:0/1630915420 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd99c100860 0x7fd99c06aca0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:54.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.176+0000 7fd9a103c640 1 -- 172.21.15.88:0/1630915420 >> 172.21.15.88:0/1630915420 conn(0x7fd99c0fc010 msgr2=0x7fd99c104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:19:54.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.177+0000 7fd9a103c640 1 -- 172.21.15.88:0/1630915420 shutdown_connections 2024-09-17T04:19:54.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.177+0000 7fd9a103c640 1 -- 172.21.15.88:0/1630915420 wait complete. 2024-09-17T04:19:54.186 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-09-17T04:19:54.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.277+0000 7f0b0011e640 1 -- 172.21.15.88:0/2490803469 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0af8101a60 msgr2=0x7f0af8101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:54.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.277+0000 7f0b0011e640 1 --2- 172.21.15.88:0/2490803469 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0af8101a60 0x7f0af8101ee0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8009880 tx=0x7f0ae802a4a0 comp rx=0 tx=0).stop 2024-09-17T04:19:54.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.277+0000 7f0b0011e640 1 -- 172.21.15.88:0/2490803469 shutdown_connections 2024-09-17T04:19:54.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.277+0000 7f0b0011e640 1 --2- 172.21.15.88:0/2490803469 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0af8101a60 0x7f0af8101ee0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:54.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.277+0000 7f0b0011e640 1 --2- 172.21.15.88:0/2490803469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0af8100860 0x7f0af8100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:54.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.277+0000 7f0b0011e640 1 -- 172.21.15.88:0/2490803469 >> 172.21.15.88:0/2490803469 conn(0x7f0af80fc010 msgr2=0x7f0af80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:19:54.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.277+0000 7f0b0011e640 1 -- 172.21.15.88:0/2490803469 shutdown_connections 2024-09-17T04:19:54.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.277+0000 7f0b0011e640 1 -- 172.21.15.88:0/2490803469 wait complete. 2024-09-17T04:19:54.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.278+0000 7f0b0011e640 1 Processor -- start 2024-09-17T04:19:54.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.278+0000 7f0b0011e640 1 -- start start 2024-09-17T04:19:54.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.278+0000 7f0b0011e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0af8100860 0x7f0af81963c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:19:54.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.278+0000 7f0b0011e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0af8101a60 0x7f0af8196900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:19:54.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.278+0000 7f0b0011e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f0af8109680 con 0x7f0af8101a60 2024-09-17T04:19:54.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.278+0000 7f0b0011e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0af8109500 con 0x7f0af8100860 2024-09-17T04:19:54.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.278+0000 7f0afd6b9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0af8101a60 0x7f0af8196900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:19:54.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.278+0000 7f0afd6b9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0af8101a60 0x7f0af8196900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38242/0 (socket says 172.21.15.88:38242) 2024-09-17T04:19:54.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.278+0000 7f0afd6b9640 1 -- 172.21.15.88:0/2972485937 learned_addr learned my addr 172.21.15.88:0/2972485937 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:19:54.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.278+0000 7f0afdeba640 1 --2- 172.21.15.88:0/2972485937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0af8100860 0x7f0af81963c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:19:54.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.278+0000 7f0afd6b9640 1 -- 172.21.15.88:0/2972485937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0af8100860 msgr2=0x7f0af81963c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:54.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.278+0000 7f0afd6b9640 1 --2- 172.21.15.88:0/2972485937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0af8100860 0x7f0af81963c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:54.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.278+0000 7f0afd6b9640 1 -- 172.21.15.88:0/2972485937 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0af8196f80 con 0x7f0af8101a60 2024-09-17T04:19:54.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.279+0000 7f0afd6b9640 1 --2- 172.21.15.88:0/2972485937 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0af8101a60 0x7f0af8196900 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8006010 tx=0x7f0ae80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:19:54.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.279+0000 7f0aeeffd640 1 -- 172.21.15.88:0/2972485937 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0ae8035070 con 0x7f0af8101a60 2024-09-17T04:19:54.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.279+0000 7f0aeeffd640 1 -- 172.21.15.88:0/2972485937 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0ae8004a40 con 0x7f0af8101a60 2024-09-17T04:19:54.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.279+0000 7f0aeeffd640 1 -- 172.21.15.88:0/2972485937 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0ae8031970 con 0x7f0af8101a60 2024-09-17T04:19:54.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.279+0000 7f0b0011e640 1 -- 172.21.15.88:0/2972485937 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0af8069ca0 con 0x7f0af8101a60 2024-09-17T04:19:54.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.279+0000 7f0b0011e640 1 -- 172.21.15.88:0/2972485937 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0af806a230 con 0x7f0af8101a60 2024-09-17T04:19:54.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.280+0000 7f0b0011e640 1 -- 172.21.15.88:0/2972485937 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0af8100c60 con 0x7f0af8101a60 2024-09-17T04:19:54.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.280+0000 7f0aeeffd640 1 -- 172.21.15.88:0/2972485937 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f0ae8003cd0 con 0x7f0af8101a60 2024-09-17T04:19:54.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.281+0000 7f0aeeffd640 1 --2- 172.21.15.88:0/2972485937 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f0ae406e310 0x7f0ae40707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:19:54.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.281+0000 7f0aeeffd640 1 -- 172.21.15.88:0/2972485937 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f0ae803e070 con 0x7f0af8101a60 2024-09-17T04:19:54.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.281+0000 7f0afdeba640 1 --2- 172.21.15.88:0/2972485937 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f0ae406e310 0x7f0ae40707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:19:54.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.281+0000 7f0afdeba640 1 --2- 172.21.15.88:0/2972485937 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f0ae406e310 0x7f0ae40707d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0af4005fd0 tx=0x7f0af400b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:19:54.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.287+0000 7f0aeeffd640 1 -- 172.21.15.88:0/2972485937 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0ae8004bf0 con 0x7f0af8101a60 2024-09-17T04:19:54.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.497+0000 7f0b0011e640 1 -- 172.21.15.88:0/2972485937 --> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0af806a550 con 0x7f0ae406e310 2024-09-17T04:19:54.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.499+0000 7f0aeeffd640 1 -- 172.21.15.88:0/2972485937 <== mgr.14217 v2:172.21.15.88:6800/1666801150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+447 (secure 0 0 0) 0x7f0af806a550 con 0x7f0ae406e310 2024-09-17T04:19:54.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.502+0000 7f0b0011e640 1 -- 172.21.15.88:0/2972485937 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f0ae406e310 msgr2=0x7f0ae40707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:54.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.502+0000 7f0b0011e640 1 --2- 172.21.15.88:0/2972485937 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f0ae406e310 0x7f0ae40707d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0af4005fd0 tx=0x7f0af400b410 comp rx=0 tx=0).stop 2024-09-17T04:19:54.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.502+0000 7f0b0011e640 1 -- 172.21.15.88:0/2972485937 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0af8101a60 msgr2=0x7f0af8196900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:54.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.502+0000 7f0b0011e640 1 --2- 172.21.15.88:0/2972485937 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0af8101a60 0x7f0af8196900 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8006010 tx=0x7f0ae80046c0 comp rx=0 tx=0).stop 2024-09-17T04:19:54.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.502+0000 7f0b0011e640 1 -- 172.21.15.88:0/2972485937 shutdown_connections 2024-09-17T04:19:54.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.502+0000 7f0b0011e640 1 --2- 172.21.15.88:0/2972485937 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f0ae406e310 0x7f0ae40707d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:54.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.502+0000 7f0b0011e640 1 --2- 172.21.15.88:0/2972485937 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0af8101a60 0x7f0af8196900 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:54.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.502+0000 7f0b0011e640 1 --2- 172.21.15.88:0/2972485937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0af8100860 0x7f0af81963c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:54.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.502+0000 7f0b0011e640 1 -- 172.21.15.88:0/2972485937 >> 172.21.15.88:0/2972485937 conn(0x7f0af80fc010 msgr2=0x7f0af8104f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:19:54.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.502+0000 7f0b0011e640 1 -- 172.21.15.88:0/2972485937 shutdown_connections 2024-09-17T04:19:54.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.502+0000 7f0b0011e640 1 -- 172.21.15.88:0/2972485937 wait complete. 2024-09-17T04:19:54.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.610+0000 7fe54a56a640 1 -- 172.21.15.88:0/808544086 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe544100880 msgr2=0x7fe544100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:54.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.610+0000 7fe54a56a640 1 --2- 172.21.15.88:0/808544086 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe544100880 0x7fe544100c80 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe534009880 tx=0x7fe53402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:19:54.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.610+0000 7fe54a56a640 1 -- 172.21.15.88:0/808544086 shutdown_connections 2024-09-17T04:19:54.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.610+0000 7fe54a56a640 1 --2- 172.21.15.88:0/808544086 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe544101a80 0x7fe544101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:54.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.610+0000 7fe54a56a640 1 --2- 172.21.15.88:0/808544086 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe544100880 0x7fe544100c80 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:54.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.610+0000 7fe54a56a640 1 -- 172.21.15.88:0/808544086 >> 172.21.15.88:0/808544086 conn(0x7fe5440fc010 msgr2=0x7fe5440fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:19:54.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.610+0000 7fe54a56a640 1 -- 172.21.15.88:0/808544086 shutdown_connections 2024-09-17T04:19:54.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.611+0000 7fe54a56a640 1 -- 172.21.15.88:0/808544086 wait complete. 2024-09-17T04:19:54.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.611+0000 7fe54a56a640 1 Processor -- start 2024-09-17T04:19:54.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.612+0000 7fe54a56a640 1 -- start start 2024-09-17T04:19:54.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.612+0000 7fe54a56a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe544100880 0x7fe5441974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:19:54.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.612+0000 7fe54a56a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe544101a80 0x7fe544197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:19:54.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.612+0000 7fe53b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe544101a80 0x7fe544197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:19:54.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.612+0000 7fe53b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe544101a80 0x7fe544197a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38250/0 (socket says 172.21.15.88:38250) 2024-09-17T04:19:54.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.612+0000 7fe53b7fe640 1 -- 172.21.15.88:0/214121323 learned_addr learned my addr 172.21.15.88:0/214121323 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:19:54.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.612+0000 7fe54a56a640 1 -- 172.21.15.88:0/214121323 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fe54410a7d0 con 0x7fe544101a80 2024-09-17T04:19:54.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.612+0000 7fe54a56a640 1 -- 172.21.15.88:0/214121323 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe54410a650 con 0x7fe544100880 2024-09-17T04:19:54.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.613+0000 7fe543fff640 1 --2- 172.21.15.88:0/214121323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe544100880 0x7fe5441974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:19:54.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.613+0000 7fe53b7fe640 1 -- 172.21.15.88:0/214121323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe544100880 msgr2=0x7fe5441974f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:54.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.613+0000 7fe53b7fe640 1 --2- 172.21.15.88:0/214121323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe544100880 0x7fe5441974f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:54.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.613+0000 7fe53b7fe640 1 -- 172.21.15.88:0/214121323 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5441980b0 con 0x7fe544101a80 2024-09-17T04:19:54.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.613+0000 7fe543fff640 1 --2- 172.21.15.88:0/214121323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe544100880 0x7fe5441974f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:19:54.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.613+0000 7fe53b7fe640 1 --2- 172.21.15.88:0/214121323 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe544101a80 0x7fe544197a30 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe52c00e970 tx=0x7fe52c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:19:54.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.614+0000 7fe541ffb640 1 -- 172.21.15.88:0/214121323 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe52c00cac0 con 0x7fe544101a80 2024-09-17T04:19:54.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.614+0000 7fe54a56a640 1 -- 172.21.15.88:0/214121323 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe54419caf0 con 0x7fe544101a80 2024-09-17T04:19:54.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.614+0000 7fe541ffb640 1 -- 172.21.15.88:0/214121323 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe52c0054e0 con 0x7fe544101a80 2024-09-17T04:19:54.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.614+0000 7fe54a56a640 1 -- 172.21.15.88:0/214121323 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe54419d080 con 0x7fe544101a80 2024-09-17T04:19:54.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.614+0000 7fe541ffb640 1 -- 172.21.15.88:0/214121323 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe52c010430 con 0x7fe544101a80 2024-09-17T04:19:54.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.615+0000 7fe54a56a640 1 -- 172.21.15.88:0/214121323 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5240052c0 con 0x7fe544101a80 2024-09-17T04:19:54.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.616+0000 7fe541ffb640 1 -- 172.21.15.88:0/214121323 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fe52c0106e0 con 0x7fe544101a80 2024-09-17T04:19:54.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.616+0000 7fe541ffb640 1 --2- 172.21.15.88:0/214121323 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fe53006e310 0x7fe5300707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:19:54.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.617+0000 7fe543fff640 1 --2- 172.21.15.88:0/214121323 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fe53006e310 0x7fe5300707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:19:54.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.617+0000 7fe541ffb640 1 -- 172.21.15.88:0/214121323 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7fe52c08e680 con 0x7fe544101a80 2024-09-17T04:19:54.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.617+0000 7fe543fff640 1 --2- 172.21.15.88:0/214121323 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fe53006e310 0x7fe5300707d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe534009230 tx=0x7fe5340058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:19:54.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.623+0000 7fe541ffb640 1 -- 172.21.15.88:0/214121323 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe52c05d090 con 0x7fe544101a80 2024-09-17T04:19:54.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.892+0000 7fe54a56a640 1 -- 172.21.15.88:0/214121323 --> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fe524000bf0 con 0x7fe53006e310 2024-09-17T04:19:54.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.904+0000 7fe541ffb640 1 -- 172.21.15.88:0/214121323 <== mgr.14217 v2:172.21.15.88:6800/1666801150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7fe524000bf0 con 0x7fe53006e310 2024-09-17T04:19:54.906 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T04:19:54.906 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (5m) 78s ago 6m 25.6M - 0.25.0 c8568f914cd2 f2dbac7e939f 2024-09-17T04:19:54.906 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi088 smithi088 running (7m) 78s ago 7m 8238k - 19.1.1-330-gc2ddf972 ebb0615149de 6ec56b3c8d6d 2024-09-17T04:19:54.906 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi134 smithi134 running (6m) 81s ago 6m 5272k - 19.1.1-330-gc2ddf972 ebb0615149de 6c2b7072b682 2024-09-17T04:19:54.906 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (7m) 78s ago 7m 6903k - 19.1.1-330-gc2ddf972 ebb0615149de de17f5571330 2024-09-17T04:19:54.907 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi134 smithi134 running (6m) 81s ago 6m 6899k - 19.1.1-330-gc2ddf972 ebb0615149de 27f7ef172a1c 2024-09-17T04:19:54.907 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (5m) 78s ago 6m 81.3M - 9.4.12 2bacad6d85d8 a6cff57a23f9 2024-09-17T04:19:54.907 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.giqrgt smithi088 running (94s) 78s ago 94s 19.0M - 19.1.1-330-gc2ddf972 ebb0615149de f724660799a1 2024-09-17T04:19:54.907 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.lgavsv smithi088 running (101s) 78s ago 100s 11.8M - 19.1.1-330-gc2ddf972 ebb0615149de 6cc0fe8a6aa9 2024-09-17T04:19:54.907 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi134.ktuhce smithi134 running (98s) 81s ago 97s 11.3M - 19.1.1-330-gc2ddf972 ebb0615149de 7ff5b70ca9cb 2024-09-17T04:19:54.907 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi134.psnynp smithi134 running (92s) 81s ago 91s 13.1M - 19.1.1-330-gc2ddf972 ebb0615149de 5326974fa3dd 2024-09-17T04:19:54.908 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.wmndiv smithi088 *:9283,8765,8443 running (8m) 78s ago 8m 500M - 19.1.1-330-gc2ddf972 ebb0615149de 2067eec66468 2024-09-17T04:19:54.908 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi134.vwdxcb smithi134 *:8443,9283,8765 running (6m) 81s ago 6m 441M - 19.1.1-330-gc2ddf972 ebb0615149de cdff532c8290 2024-09-17T04:19:54.908 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (8m) 78s ago 8m 46.0M 2048M 19.1.1-330-gc2ddf972 ebb0615149de bbeb722f42bc 2024-09-17T04:19:54.908 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi134 smithi134 running (6m) 81s ago 6m 34.5M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 89de63fb6386 2024-09-17T04:19:54.908 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (7m) 78s ago 7m 15.9M - 1.5.0 0da6a335fe13 9ba03800993b 2024-09-17T04:19:54.909 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi134 smithi134 *:9100 running (6m) 81s ago 6m 17.2M - 1.5.0 0da6a335fe13 6deac483827f 2024-09-17T04:19:54.909 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (4m) 78s ago 4m 47.9M 3946M 19.1.1-330-gc2ddf972 ebb0615149de e309427ee12c 2024-09-17T04:19:54.909 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (4m) 78s ago 4m 57.0M 3946M 19.1.1-330-gc2ddf972 ebb0615149de cc68d92b3333 2024-09-17T04:19:54.909 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (3m) 78s ago 3m 54.0M 3946M 19.1.1-330-gc2ddf972 ebb0615149de 1ba92f2bfce6 2024-09-17T04:19:54.909 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi134 running (3m) 81s ago 3m 54.7M 4970M 19.1.1-330-gc2ddf972 ebb0615149de ebd528c3ce1b 2024-09-17T04:19:54.910 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi134 running (3m) 81s ago 3m 42.9M 4970M 19.1.1-330-gc2ddf972 ebb0615149de eacc25537b3a 2024-09-17T04:19:54.910 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi134 running (2m) 81s ago 2m 48.6M 4970M 19.1.1-330-gc2ddf972 ebb0615149de bc1b434a92a8 2024-09-17T04:19:54.910 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (5m) 78s ago 6m 59.2M - 2.43.0 a07b618ecd1d 3c7fe8c3d4b0 2024-09-17T04:19:54.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.906+0000 7fe54a56a640 1 -- 172.21.15.88:0/214121323 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fe53006e310 msgr2=0x7fe5300707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:54.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.906+0000 7fe54a56a640 1 --2- 172.21.15.88:0/214121323 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fe53006e310 0x7fe5300707d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe534009230 tx=0x7fe5340058d0 comp rx=0 tx=0).stop 2024-09-17T04:19:54.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.906+0000 7fe54a56a640 1 -- 172.21.15.88:0/214121323 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe544101a80 msgr2=0x7fe544197a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:54.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.906+0000 7fe54a56a640 1 --2- 172.21.15.88:0/214121323 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe544101a80 0x7fe544197a30 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe52c00e970 tx=0x7fe52c00ed70 comp rx=0 tx=0).stop 2024-09-17T04:19:54.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.907+0000 7fe54a56a640 1 -- 172.21.15.88:0/214121323 shutdown_connections 2024-09-17T04:19:54.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.907+0000 7fe54a56a640 1 --2- 172.21.15.88:0/214121323 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fe53006e310 0x7fe5300707d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:54.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.907+0000 7fe54a56a640 1 --2- 172.21.15.88:0/214121323 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe544101a80 0x7fe544197a30 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:54.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.907+0000 7fe54a56a640 1 --2- 172.21.15.88:0/214121323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe544100880 0x7fe5441974f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:54.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.907+0000 7fe54a56a640 1 -- 172.21.15.88:0/214121323 >> 172.21.15.88:0/214121323 conn(0x7fe5440fc010 msgr2=0x7fe5440fe220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:19:54.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.907+0000 7fe54a56a640 1 -- 172.21.15.88:0/214121323 shutdown_connections 2024-09-17T04:19:54.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:54.907+0000 7fe54a56a640 1 -- 172.21.15.88:0/214121323 wait complete. 2024-09-17T04:19:54.914 INFO:tasks.workunit.client.0.smithi088.stderr:+ tar xzf ltp-full.tgz 2024-09-17T04:19:55.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.012+0000 7fe6ade44640 1 -- 172.21.15.88:0/1837012197 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6a8100240 msgr2=0x7fe6a8100640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:55.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.012+0000 7fe6ade44640 1 --2- 172.21.15.88:0/1837012197 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6a8100240 0x7fe6a8100640 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe698009880 tx=0x7fe69802a4a0 comp rx=0 tx=0).stop 2024-09-17T04:19:55.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.013+0000 7fe6ade44640 1 -- 172.21.15.88:0/1837012197 shutdown_connections 2024-09-17T04:19:55.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.013+0000 7fe6ade44640 1 --2- 172.21.15.88:0/1837012197 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6a8100b80 0x7fe6a8100fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:55.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.013+0000 7fe6ade44640 1 --2- 172.21.15.88:0/1837012197 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6a8100240 0x7fe6a8100640 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:55.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.013+0000 7fe6ade44640 1 -- 172.21.15.88:0/1837012197 >> 172.21.15.88:0/1837012197 conn(0x7fe6a80fc010 msgr2=0x7fe6a80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:19:55.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.013+0000 7fe6ade44640 1 -- 172.21.15.88:0/1837012197 shutdown_connections 2024-09-17T04:19:55.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.013+0000 7fe6ade44640 1 -- 172.21.15.88:0/1837012197 wait complete. 2024-09-17T04:19:55.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.013+0000 7fe6ade44640 1 Processor -- start 2024-09-17T04:19:55.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.014+0000 7fe6ade44640 1 -- start start 2024-09-17T04:19:55.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.014+0000 7fe6ade44640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6a8100240 0x7fe6a81996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:19:55.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.014+0000 7fe6ade44640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6a8100b80 0x7fe6a8199c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:19:55.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.014+0000 7fe6ade44640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a810c990 con 0x7fe6a8100240 2024-09-17T04:19:55.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.014+0000 7fe6ade44640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a810c810 con 0x7fe6a8100b80 2024-09-17T04:19:55.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.014+0000 7fe6a77fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6a8100240 0x7fe6a81996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:19:55.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.014+0000 7fe6a77fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6a8100240 0x7fe6a81996d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38264/0 (socket says 172.21.15.88:38264) 2024-09-17T04:19:55.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.014+0000 7fe6a77fe640 1 -- 172.21.15.88:0/3605050192 learned_addr learned my addr 172.21.15.88:0/3605050192 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:19:55.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.014+0000 7fe6a6ffd640 1 --2- 172.21.15.88:0/3605050192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6a8100b80 0x7fe6a8199c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:19:55.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.014+0000 7fe6a77fe640 1 -- 172.21.15.88:0/3605050192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6a8100b80 msgr2=0x7fe6a8199c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:55.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.014+0000 7fe6a77fe640 1 --2- 172.21.15.88:0/3605050192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6a8100b80 0x7fe6a8199c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:55.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.014+0000 7fe6a77fe640 1 -- 172.21.15.88:0/3605050192 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6a819a290 con 0x7fe6a8100240 2024-09-17T04:19:55.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.014+0000 7fe6a6ffd640 1 --2- 172.21.15.88:0/3605050192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6a8100b80 0x7fe6a8199c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:19:55.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.015+0000 7fe6a77fe640 1 --2- 172.21.15.88:0/3605050192 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6a8100240 0x7fe6a81996d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe698009230 tx=0x7fe698004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:19:55.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.015+0000 7fe6a4ff9640 1 -- 172.21.15.88:0/3605050192 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe69803f070 con 0x7fe6a8100240 2024-09-17T04:19:55.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.015+0000 7fe6ade44640 1 -- 172.21.15.88:0/3605050192 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6a819ec70 con 0x7fe6a8100240 2024-09-17T04:19:55.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.015+0000 7fe6ade44640 1 -- 172.21.15.88:0/3605050192 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6a819f140 con 0x7fe6a8100240 2024-09-17T04:19:55.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.015+0000 7fe6a4ff9640 1 -- 172.21.15.88:0/3605050192 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe6980054e0 con 0x7fe6a8100240 2024-09-17T04:19:55.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.015+0000 7fe6a4ff9640 1 -- 172.21.15.88:0/3605050192 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe698049060 con 0x7fe6a8100240 2024-09-17T04:19:55.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.016+0000 7fe6ade44640 1 -- 172.21.15.88:0/3605050192 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6940052c0 con 0x7fe6a8100240 2024-09-17T04:19:55.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.017+0000 7fe6a4ff9640 1 -- 172.21.15.88:0/3605050192 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fe698042070 con 0x7fe6a8100240 2024-09-17T04:19:55.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.018+0000 7fe6a4ff9640 1 --2- 172.21.15.88:0/3605050192 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fe69006e300 0x7fe6900707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:19:55.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.018+0000 7fe6a4ff9640 1 -- 172.21.15.88:0/3605050192 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7fe6980aeab0 con 0x7fe6a8100240 2024-09-17T04:19:55.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.018+0000 7fe6a6ffd640 1 --2- 172.21.15.88:0/3605050192 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fe69006e300 0x7fe6900707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:19:55.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.018+0000 7fe6a6ffd640 1 --2- 172.21.15.88:0/3605050192 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fe69006e300 0x7fe6900707c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe6a819ab80 tx=0x7fe69c005f90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:19:55.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.023+0000 7fe6a4ff9640 1 -- 172.21.15.88:0/3605050192 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe698080040 con 0x7fe6a8100240 2024-09-17T04:19:55.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.345+0000 7fe6ade44640 1 -- 172.21.15.88:0/3605050192 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fe694005dc0 con 0x7fe6a8100240 2024-09-17T04:19:55.346 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:54 smithi088 ceph-mon[27811]: pgmap v229: 65 pgs: 65 active+clean; 13 MiB data, 215 MiB used, 536 GiB / 536 GiB avail; 40 KiB/s rd, 1.0 MiB/s wr, 19 op/s 2024-09-17T04:19:55.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.346+0000 7fe6a4ff9640 1 -- 172.21.15.88:0/3605050192 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+633 (secure 0 0 0) 0x7fe6980aee20 con 0x7fe6a8100240 2024-09-17T04:19:55.347 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-17T04:19:55.347 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-09-17T04:19:55.347 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T04:19:55.347 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:19:55.347 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-09-17T04:19:55.347 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T04:19:55.347 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:19:55.347 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-09-17T04:19:55.347 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-17T04:19:55.347 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:19:55.348 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2024-09-17T04:19:55.348 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T04:19:55.348 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:19:55.348 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-09-17T04:19:55.348 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 14 2024-09-17T04:19:55.348 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-17T04:19:55.348 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-17T04:19:55.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.349+0000 7fe6ade44640 1 -- 172.21.15.88:0/3605050192 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fe69006e300 msgr2=0x7fe6900707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:55.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.349+0000 7fe6ade44640 1 --2- 172.21.15.88:0/3605050192 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fe69006e300 0x7fe6900707c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe6a819ab80 tx=0x7fe69c005f90 comp rx=0 tx=0).stop 2024-09-17T04:19:55.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.349+0000 7fe6ade44640 1 -- 172.21.15.88:0/3605050192 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6a8100240 msgr2=0x7fe6a81996d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:55.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.349+0000 7fe6ade44640 1 --2- 172.21.15.88:0/3605050192 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6a8100240 0x7fe6a81996d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe698009230 tx=0x7fe698004570 comp rx=0 tx=0).stop 2024-09-17T04:19:55.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.349+0000 7fe6ade44640 1 -- 172.21.15.88:0/3605050192 shutdown_connections 2024-09-17T04:19:55.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.349+0000 7fe6ade44640 1 --2- 172.21.15.88:0/3605050192 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fe69006e300 0x7fe6900707c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:55.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.349+0000 7fe6ade44640 1 --2- 172.21.15.88:0/3605050192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6a8100b80 0x7fe6a8199c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:55.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.349+0000 7fe6ade44640 1 --2- 172.21.15.88:0/3605050192 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6a8100240 0x7fe6a81996d0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:55.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.349+0000 7fe6ade44640 1 -- 172.21.15.88:0/3605050192 >> 172.21.15.88:0/3605050192 conn(0x7fe6a80fc010 msgr2=0x7fe6a8108af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:19:55.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.349+0000 7fe6ade44640 1 -- 172.21.15.88:0/3605050192 shutdown_connections 2024-09-17T04:19:55.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.349+0000 7fe6ade44640 1 -- 172.21.15.88:0/3605050192 wait complete. 2024-09-17T04:19:55.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:54 smithi134 ceph-mon[35201]: pgmap v229: 65 pgs: 65 active+clean; 13 MiB data, 215 MiB used, 536 GiB / 536 GiB avail; 40 KiB/s rd, 1.0 MiB/s wr, 19 op/s 2024-09-17T04:19:55.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.458+0000 7f2601767640 1 -- 172.21.15.88:0/380317648 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25fc100240 msgr2=0x7f25fc100640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:55.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.458+0000 7f2601767640 1 --2- 172.21.15.88:0/380317648 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25fc100240 0x7f25fc100640 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f25ec009880 tx=0x7f25ec02a4a0 comp rx=0 tx=0).stop 2024-09-17T04:19:55.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.458+0000 7f2601767640 1 -- 172.21.15.88:0/380317648 shutdown_connections 2024-09-17T04:19:55.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.458+0000 7f2601767640 1 --2- 172.21.15.88:0/380317648 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25fc100b80 0x7f25fc100fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:55.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.458+0000 7f2601767640 1 --2- 172.21.15.88:0/380317648 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25fc100240 0x7f25fc100640 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:55.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.458+0000 7f2601767640 1 -- 172.21.15.88:0/380317648 >> 172.21.15.88:0/380317648 conn(0x7f25fc0fc010 msgr2=0x7f25fc0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:19:55.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.458+0000 7f2601767640 1 -- 172.21.15.88:0/380317648 shutdown_connections 2024-09-17T04:19:55.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.458+0000 7f2601767640 1 -- 172.21.15.88:0/380317648 wait complete. 2024-09-17T04:19:55.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.459+0000 7f2601767640 1 Processor -- start 2024-09-17T04:19:55.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.459+0000 7f2601767640 1 -- start start 2024-09-17T04:19:55.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.459+0000 7f2601767640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25fc100240 0x7f25fc1996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:19:55.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.459+0000 7f2601767640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25fc100b80 0x7f25fc199c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:19:55.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.459+0000 7f2601767640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f25fc10c990 con 0x7f25fc100b80 2024-09-17T04:19:55.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.459+0000 7f2601767640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f25fc10c810 con 0x7f25fc100240 2024-09-17T04:19:55.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.460+0000 7f25fa7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25fc100b80 0x7f25fc199c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:19:55.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.460+0000 7f25faffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25fc100240 0x7f25fc1996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:19:55.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.460+0000 7f25fa7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25fc100b80 0x7f25fc199c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38288/0 (socket says 172.21.15.88:38288) 2024-09-17T04:19:55.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.460+0000 7f25fa7fc640 1 -- 172.21.15.88:0/805355168 learned_addr learned my addr 172.21.15.88:0/805355168 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:19:55.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.460+0000 7f25faffd640 1 -- 172.21.15.88:0/805355168 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25fc100b80 msgr2=0x7f25fc199c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:55.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.460+0000 7f25faffd640 1 --2- 172.21.15.88:0/805355168 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25fc100b80 0x7f25fc199c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:55.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.460+0000 7f25faffd640 1 -- 172.21.15.88:0/805355168 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25fc19a290 con 0x7f25fc100240 2024-09-17T04:19:55.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.460+0000 7f25faffd640 1 --2- 172.21.15.88:0/805355168 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25fc100240 0x7f25fc1996d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f25ec009850 tx=0x7f25ec032a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:19:55.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.460+0000 7f25e3fff640 1 -- 172.21.15.88:0/805355168 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f25ec03f030 con 0x7f25fc100240 2024-09-17T04:19:55.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.461+0000 7f25e3fff640 1 -- 172.21.15.88:0/805355168 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f25ec032e50 con 0x7f25fc100240 2024-09-17T04:19:55.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.461+0000 7f2601767640 1 -- 172.21.15.88:0/805355168 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25fc19ec70 con 0x7f25fc100240 2024-09-17T04:19:55.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.461+0000 7f25e3fff640 1 -- 172.21.15.88:0/805355168 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f25ec035070 con 0x7f25fc100240 2024-09-17T04:19:55.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.461+0000 7f2601767640 1 -- 172.21.15.88:0/805355168 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25fc19f1b0 con 0x7f25fc100240 2024-09-17T04:19:55.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.462+0000 7f2601767640 1 -- 172.21.15.88:0/805355168 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25fc100640 con 0x7f25fc100240 2024-09-17T04:19:55.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.463+0000 7f25e3fff640 1 -- 172.21.15.88:0/805355168 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f25ec042030 con 0x7f25fc100240 2024-09-17T04:19:55.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.464+0000 7f25e3fff640 1 --2- 172.21.15.88:0/805355168 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f25e406e2b0 0x7f25e4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:19:55.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.464+0000 7f25e3fff640 1 -- 172.21.15.88:0/805355168 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f25ec040070 con 0x7f25fc100240 2024-09-17T04:19:55.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.464+0000 7f25fa7fc640 1 --2- 172.21.15.88:0/805355168 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f25e406e2b0 0x7f25e4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:19:55.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.464+0000 7f25fa7fc640 1 --2- 172.21.15.88:0/805355168 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f25e406e2b0 0x7f25e4070770 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f25fc19ab80 tx=0x7f25f0005f90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:19:55.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.467+0000 7f25e3fff640 1 -- 172.21.15.88:0/805355168 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f25ec080610 con 0x7f25fc100240 2024-09-17T04:19:55.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.780+0000 7f2601767640 1 -- 172.21.15.88:0/805355168 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f25fc02d7c0 con 0x7f25fc100240 2024-09-17T04:19:55.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.780+0000 7f25e3fff640 1 -- 172.21.15.88:0/805355168 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) ==== 76+0+2045 (secure 0 0 0) 0x7f25ec084e40 con 0x7f25fc100240 2024-09-17T04:19:55.781 INFO:teuthology.orchestra.run.smithi088.stdout:e15 2024-09-17T04:19:55.781 INFO:teuthology.orchestra.run.smithi088.stdout:btime 2024-09-17T04:18:27:750910+0000 2024-09-17T04:19:55.781 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T04:19:55.781 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:19:55.781 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2024-09-17T04:19:55.782 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:19:55.782 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2024-09-17T04:19:55.782 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2024-09-17T04:19:55.782 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 15 2024-09-17T04:19:55.782 INFO:teuthology.orchestra.run.smithi088.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T04:19:55.782 INFO:teuthology.orchestra.run.smithi088.stdout:created 2024-09-17T04:18:10.480573+0000 2024-09-17T04:19:55.782 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2024-09-17T04:18:27.750896+0000 2024-09-17T04:19:55.782 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2024-09-17T04:19:55.782 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2024-09-17T04:19:55.782 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2024-09-17T04:19:55.782 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2024-09-17T04:19:55.782 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2024-09-17T04:19:55.782 INFO:teuthology.orchestra.run.smithi088.stdout:max_xattr_size 65536 2024-09-17T04:19:55.782 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2024-09-17T04:19:55.783 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2024-09-17T04:19:55.783 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 45 2024-09-17T04:19:55.783 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:19:55.783 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 1 2024-09-17T04:19:55.783 INFO:teuthology.orchestra.run.smithi088.stdout:in 0 2024-09-17T04:19:55.783 INFO:teuthology.orchestra.run.smithi088.stdout:up {0=14590} 2024-09-17T04:19:55.783 INFO:teuthology.orchestra.run.smithi088.stdout:failed 2024-09-17T04:19:55.783 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2024-09-17T04:19:55.783 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2024-09-17T04:19:55.783 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2024-09-17T04:19:55.783 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2024-09-17T04:19:55.783 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data enabled 2024-09-17T04:19:55.783 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2024-09-17T04:19:55.784 INFO:teuthology.orchestra.run.smithi088.stdout:bal_rank_mask -1 2024-09-17T04:19:55.784 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 1 2024-09-17T04:19:55.784 INFO:teuthology.orchestra.run.smithi088.stdout:qdb_cluster leader: 14590 members: 14590 2024-09-17T04:19:55.784 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.giqrgt{0:14590} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.88:6828/1714846518,v1:172.21.15.88:6829/1714846518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:19:55.784 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi134.psnynp{0:24321} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.134:6826/2137586894,v1:172.21.15.134:6827/2137586894] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:19:55.784 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:19:55.784 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:19:55.784 INFO:teuthology.orchestra.run.smithi088.stdout:Standby daemons: 2024-09-17T04:19:55.784 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:19:55.784 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi134.ktuhce{-1:24325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/967997022,v1:172.21.15.134:6825/967997022] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:19:55.784 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.lgavsv{-1:24329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/1425146180,v1:172.21.15.88:6827/1425146180] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:19:55.785 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 15 2024-09-17T04:19:55.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.782+0000 7f2601767640 1 -- 172.21.15.88:0/805355168 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f25e406e2b0 msgr2=0x7f25e4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:55.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.782+0000 7f2601767640 1 --2- 172.21.15.88:0/805355168 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f25e406e2b0 0x7f25e4070770 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f25fc19ab80 tx=0x7f25f0005f90 comp rx=0 tx=0).stop 2024-09-17T04:19:55.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.782+0000 7f2601767640 1 -- 172.21.15.88:0/805355168 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25fc100240 msgr2=0x7f25fc1996d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:55.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.782+0000 7f2601767640 1 --2- 172.21.15.88:0/805355168 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25fc100240 0x7f25fc1996d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f25ec009850 tx=0x7f25ec032a50 comp rx=0 tx=0).stop 2024-09-17T04:19:55.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.782+0000 7f2601767640 1 -- 172.21.15.88:0/805355168 shutdown_connections 2024-09-17T04:19:55.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.782+0000 7f2601767640 1 --2- 172.21.15.88:0/805355168 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7f25e406e2b0 0x7f25e4070770 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:55.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.782+0000 7f2601767640 1 --2- 172.21.15.88:0/805355168 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25fc100b80 0x7f25fc199c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:55.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.782+0000 7f2601767640 1 --2- 172.21.15.88:0/805355168 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25fc100240 0x7f25fc1996d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:55.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.782+0000 7f2601767640 1 -- 172.21.15.88:0/805355168 >> 172.21.15.88:0/805355168 conn(0x7f25fc0fc010 msgr2=0x7f25fc108af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:19:55.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.783+0000 7f2601767640 1 -- 172.21.15.88:0/805355168 shutdown_connections 2024-09-17T04:19:55.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.783+0000 7f2601767640 1 -- 172.21.15.88:0/805355168 wait complete. 2024-09-17T04:19:55.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.888+0000 7fa8e90db640 1 -- 172.21.15.88:0/990698917 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8e4101a60 msgr2=0x7fa8e4101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:55.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.888+0000 7fa8e90db640 1 --2- 172.21.15.88:0/990698917 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8e4101a60 0x7fa8e4101ee0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa8d8009880 tx=0x7fa8d802a4a0 comp rx=0 tx=0).stop 2024-09-17T04:19:55.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.888+0000 7fa8e90db640 1 -- 172.21.15.88:0/990698917 shutdown_connections 2024-09-17T04:19:55.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.888+0000 7fa8e90db640 1 --2- 172.21.15.88:0/990698917 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8e4101a60 0x7fa8e4101ee0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:55.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.888+0000 7fa8e90db640 1 --2- 172.21.15.88:0/990698917 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8e4100860 0x7fa8e4100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:55.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.888+0000 7fa8e90db640 1 -- 172.21.15.88:0/990698917 >> 172.21.15.88:0/990698917 conn(0x7fa8e40fc010 msgr2=0x7fa8e40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:19:55.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.889+0000 7fa8e90db640 1 -- 172.21.15.88:0/990698917 shutdown_connections 2024-09-17T04:19:55.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.889+0000 7fa8e90db640 1 -- 172.21.15.88:0/990698917 wait complete. 2024-09-17T04:19:55.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.889+0000 7fa8e90db640 1 Processor -- start 2024-09-17T04:19:55.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.890+0000 7fa8e90db640 1 -- start start 2024-09-17T04:19:55.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.890+0000 7fa8e90db640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8e4100860 0x7fa8e4197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:19:55.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.890+0000 7fa8e90db640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8e4101a60 0x7fa8e4197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:19:55.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.890+0000 7fa8e90db640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e4109680 con 0x7fa8e4101a60 2024-09-17T04:19:55.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.890+0000 7fa8e90db640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e4109500 con 0x7fa8e4100860 2024-09-17T04:19:55.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.890+0000 7fa8e259c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8e4101a60 0x7fa8e4197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:19:55.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.890+0000 7fa8e259c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8e4101a60 0x7fa8e4197a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38316/0 (socket says 172.21.15.88:38316) 2024-09-17T04:19:55.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.890+0000 7fa8e259c640 1 -- 172.21.15.88:0/142586341 learned_addr learned my addr 172.21.15.88:0/142586341 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:19:55.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.890+0000 7fa8e2d9d640 1 --2- 172.21.15.88:0/142586341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8e4100860 0x7fa8e4197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:19:55.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.890+0000 7fa8e259c640 1 -- 172.21.15.88:0/142586341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8e4100860 msgr2=0x7fa8e4197520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:55.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.890+0000 7fa8e259c640 1 --2- 172.21.15.88:0/142586341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8e4100860 0x7fa8e4197520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:55.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.890+0000 7fa8e259c640 1 -- 172.21.15.88:0/142586341 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8e41980e0 con 0x7fa8e4101a60 2024-09-17T04:19:55.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.891+0000 7fa8e259c640 1 --2- 172.21.15.88:0/142586341 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8e4101a60 0x7fa8e4197a60 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa8d8009230 tx=0x7fa8d80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:19:55.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.891+0000 7fa8cbfff640 1 -- 172.21.15.88:0/142586341 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa8d803f070 con 0x7fa8e4101a60 2024-09-17T04:19:55.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.891+0000 7fa8e90db640 1 -- 172.21.15.88:0/142586341 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8e419cac0 con 0x7fa8e4101a60 2024-09-17T04:19:55.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.891+0000 7fa8e90db640 1 -- 172.21.15.88:0/142586341 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8e419d050 con 0x7fa8e4101a60 2024-09-17T04:19:55.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.891+0000 7fa8cbfff640 1 -- 172.21.15.88:0/142586341 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa8d80044d0 con 0x7fa8e4101a60 2024-09-17T04:19:55.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.891+0000 7fa8cbfff640 1 -- 172.21.15.88:0/142586341 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa8d8035030 con 0x7fa8e4101a60 2024-09-17T04:19:55.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.892+0000 7fa8e90db640 1 -- 172.21.15.88:0/142586341 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8d0005290 con 0x7fa8e4101a60 2024-09-17T04:19:55.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.893+0000 7fa8cbfff640 1 -- 172.21.15.88:0/142586341 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fa8d8042070 con 0x7fa8e4101a60 2024-09-17T04:19:55.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.893+0000 7fa8cbfff640 1 --2- 172.21.15.88:0/142586341 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fa8cc06e300 0x7fa8cc0707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:19:55.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.893+0000 7fa8cbfff640 1 -- 172.21.15.88:0/142586341 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7fa8d80aed80 con 0x7fa8e4101a60 2024-09-17T04:19:55.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.894+0000 7fa8e2d9d640 1 --2- 172.21.15.88:0/142586341 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fa8cc06e300 0x7fa8cc0707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:19:55.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.894+0000 7fa8e2d9d640 1 --2- 172.21.15.88:0/142586341 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fa8cc06e300 0x7fa8cc0707c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa8e41018c0 tx=0x7fa8d400a2d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:19:55.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:55.898+0000 7fa8cbfff640 1 -- 172.21.15.88:0/142586341 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa8d80803b0 con 0x7fa8e4101a60 2024-09-17T04:19:55.999 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:55 smithi134 ceph-mon[35201]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:19:56.000 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:55 smithi134 ceph-mon[35201]: from='client.14716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:19:56.000 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:55 smithi134 ceph-mon[35201]: from='client.14720 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:19:56.000 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:55 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/3605050192' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T04:19:56.000 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:55 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/805355168' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T04:19:56.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.130+0000 7fa8e90db640 1 -- 172.21.15.88:0/142586341 --> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa8d0000bc0 con 0x7fa8cc06e300 2024-09-17T04:19:56.131 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:55 smithi088 ceph-mon[27811]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:19:56.131 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:55 smithi088 ceph-mon[27811]: from='client.14716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:19:56.131 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:55 smithi088 ceph-mon[27811]: from='client.14720 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:19:56.131 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:55 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/3605050192' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T04:19:56.131 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:55 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/805355168' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T04:19:56.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.132+0000 7fa8cbfff640 1 -- 172.21.15.88:0/142586341 <== mgr.14217 v2:172.21.15.88:6800/1666801150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+447 (secure 0 0 0) 0x7fa8d0000bc0 con 0x7fa8cc06e300 2024-09-17T04:19:56.132 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-17T04:19:56.132 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f", 2024-09-17T04:19:56.132 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-09-17T04:19:56.132 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T04:19:56.133 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [], 2024-09-17T04:19:56.133 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "0/23 daemons upgraded", 2024-09-17T04:19:56.133 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f image on host smithi134", 2024-09-17T04:19:56.133 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-09-17T04:19:56.133 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-17T04:19:56.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.134+0000 7fa8e90db640 1 -- 172.21.15.88:0/142586341 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fa8cc06e300 msgr2=0x7fa8cc0707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:56.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.134+0000 7fa8e90db640 1 --2- 172.21.15.88:0/142586341 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fa8cc06e300 0x7fa8cc0707c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa8e41018c0 tx=0x7fa8d400a2d0 comp rx=0 tx=0).stop 2024-09-17T04:19:56.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.134+0000 7fa8e90db640 1 -- 172.21.15.88:0/142586341 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8e4101a60 msgr2=0x7fa8e4197a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:56.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.134+0000 7fa8e90db640 1 --2- 172.21.15.88:0/142586341 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8e4101a60 0x7fa8e4197a60 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa8d8009230 tx=0x7fa8d80048f0 comp rx=0 tx=0).stop 2024-09-17T04:19:56.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.135+0000 7fa8e90db640 1 -- 172.21.15.88:0/142586341 shutdown_connections 2024-09-17T04:19:56.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.135+0000 7fa8e90db640 1 --2- 172.21.15.88:0/142586341 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fa8cc06e300 0x7fa8cc0707c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:56.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.135+0000 7fa8e90db640 1 --2- 172.21.15.88:0/142586341 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8e4101a60 0x7fa8e4197a60 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:56.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.135+0000 7fa8e90db640 1 --2- 172.21.15.88:0/142586341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8e4100860 0x7fa8e4197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:56.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.135+0000 7fa8e90db640 1 -- 172.21.15.88:0/142586341 >> 172.21.15.88:0/142586341 conn(0x7fa8e40fc010 msgr2=0x7fa8e4069d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:19:56.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.135+0000 7fa8e90db640 1 -- 172.21.15.88:0/142586341 shutdown_connections 2024-09-17T04:19:56.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.135+0000 7fa8e90db640 1 -- 172.21.15.88:0/142586341 wait complete. 2024-09-17T04:19:56.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.236+0000 7ff004b8f640 1 -- 172.21.15.88:0/932441407 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff000100860 msgr2=0x7ff000100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:56.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.236+0000 7ff004b8f640 1 --2- 172.21.15.88:0/932441407 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff000100860 0x7ff000100c60 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7feff0009880 tx=0x7feff002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:19:56.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.236+0000 7ff004b8f640 1 -- 172.21.15.88:0/932441407 shutdown_connections 2024-09-17T04:19:56.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.236+0000 7ff004b8f640 1 --2- 172.21.15.88:0/932441407 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff000101a60 0x7ff000101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:56.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.236+0000 7ff004b8f640 1 --2- 172.21.15.88:0/932441407 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff000100860 0x7ff000100c60 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:56.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.236+0000 7ff004b8f640 1 -- 172.21.15.88:0/932441407 >> 172.21.15.88:0/932441407 conn(0x7ff0000fc010 msgr2=0x7ff0000fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:19:56.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.236+0000 7ff004b8f640 1 -- 172.21.15.88:0/932441407 shutdown_connections 2024-09-17T04:19:56.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.236+0000 7ff004b8f640 1 -- 172.21.15.88:0/932441407 wait complete. 2024-09-17T04:19:56.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.237+0000 7ff004b8f640 1 Processor -- start 2024-09-17T04:19:56.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.237+0000 7ff004b8f640 1 -- start start 2024-09-17T04:19:56.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.237+0000 7ff004b8f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff000100860 0x7ff000197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:19:56.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.237+0000 7ff004b8f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff000101a60 0x7ff000197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:19:56.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.237+0000 7ff004b8f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ff0001096a0 con 0x7ff000101a60 2024-09-17T04:19:56.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.237+0000 7ff004b8f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff000109520 con 0x7ff000100860 2024-09-17T04:19:56.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.238+0000 7feffdd9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff000101a60 0x7ff000197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:19:56.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.238+0000 7feffdd9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff000101a60 0x7ff000197a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38326/0 (socket says 172.21.15.88:38326) 2024-09-17T04:19:56.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.238+0000 7feffdd9b640 1 -- 172.21.15.88:0/2069695814 learned_addr learned my addr 172.21.15.88:0/2069695814 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:19:56.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.238+0000 7feffe59c640 1 --2- 172.21.15.88:0/2069695814 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff000100860 0x7ff000197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:19:56.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.238+0000 7feffdd9b640 1 -- 172.21.15.88:0/2069695814 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff000100860 msgr2=0x7ff000197520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:56.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.238+0000 7feffdd9b640 1 --2- 172.21.15.88:0/2069695814 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff000100860 0x7ff000197520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:56.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.238+0000 7feffdd9b640 1 -- 172.21.15.88:0/2069695814 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0001980e0 con 0x7ff000101a60 2024-09-17T04:19:56.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.238+0000 7feffdd9b640 1 --2- 172.21.15.88:0/2069695814 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff000101a60 0x7ff000197a60 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7feff400e970 tx=0x7feff400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:19:56.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.238+0000 7fefef7fe640 1 -- 172.21.15.88:0/2069695814 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feff400cac0 con 0x7ff000101a60 2024-09-17T04:19:56.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.238+0000 7ff004b8f640 1 -- 172.21.15.88:0/2069695814 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff00019cb20 con 0x7ff000101a60 2024-09-17T04:19:56.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.238+0000 7fefef7fe640 1 -- 172.21.15.88:0/2069695814 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7feff40054e0 con 0x7ff000101a60 2024-09-17T04:19:56.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.239+0000 7ff004b8f640 1 -- 172.21.15.88:0/2069695814 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff00019d0b0 con 0x7ff000101a60 2024-09-17T04:19:56.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.238+0000 7fefef7fe640 1 -- 172.21.15.88:0/2069695814 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feff4010430 con 0x7ff000101a60 2024-09-17T04:19:56.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.240+0000 7ff004b8f640 1 -- 172.21.15.88:0/2069695814 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff000100c60 con 0x7ff000101a60 2024-09-17T04:19:56.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.240+0000 7fefef7fe640 1 -- 172.21.15.88:0/2069695814 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7feff4004ec0 con 0x7ff000101a60 2024-09-17T04:19:56.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.241+0000 7fefef7fe640 1 --2- 172.21.15.88:0/2069695814 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fefe806e2b0 0x7fefe8070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:19:56.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.241+0000 7fefef7fe640 1 -- 172.21.15.88:0/2069695814 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7feff408e840 con 0x7ff000101a60 2024-09-17T04:19:56.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.241+0000 7feffe59c640 1 --2- 172.21.15.88:0/2069695814 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fefe806e2b0 0x7fefe8070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:19:56.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.242+0000 7feffe59c640 1 --2- 172.21.15.88:0/2069695814 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fefe806e2b0 0x7fefe8070770 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7feff0009230 tx=0x7feff00058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:19:56.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.247+0000 7fefef7fe640 1 -- 172.21.15.88:0/2069695814 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7feff405c140 con 0x7ff000101a60 2024-09-17T04:19:56.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.560+0000 7ff004b8f640 1 -- 172.21.15.88:0/2069695814 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7ff00019da30 con 0x7ff000101a60 2024-09-17T04:19:56.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.560+0000 7fefef7fe640 1 -- 172.21.15.88:0/2069695814 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7feff405fdf0 con 0x7ff000101a60 2024-09-17T04:19:56.561 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T04:19:56.562 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T04:19:56.562 INFO:teuthology.orchestra.run.smithi088.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T04:19:56.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.563+0000 7ff004b8f640 1 -- 172.21.15.88:0/2069695814 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fefe806e2b0 msgr2=0x7fefe8070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:56.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.563+0000 7ff004b8f640 1 --2- 172.21.15.88:0/2069695814 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fefe806e2b0 0x7fefe8070770 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7feff0009230 tx=0x7feff00058d0 comp rx=0 tx=0).stop 2024-09-17T04:19:56.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.563+0000 7ff004b8f640 1 -- 172.21.15.88:0/2069695814 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff000101a60 msgr2=0x7ff000197a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:19:56.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.563+0000 7ff004b8f640 1 --2- 172.21.15.88:0/2069695814 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff000101a60 0x7ff000197a60 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7feff400e970 tx=0x7feff400ed70 comp rx=0 tx=0).stop 2024-09-17T04:19:56.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.563+0000 7ff004b8f640 1 -- 172.21.15.88:0/2069695814 shutdown_connections 2024-09-17T04:19:56.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.563+0000 7ff004b8f640 1 --2- 172.21.15.88:0/2069695814 >> [v2:172.21.15.88:6800/1666801150,v1:172.21.15.88:6801/1666801150] conn(0x7fefe806e2b0 0x7fefe8070770 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:56.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.563+0000 7ff004b8f640 1 --2- 172.21.15.88:0/2069695814 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff000101a60 0x7ff000197a60 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:56.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.563+0000 7ff004b8f640 1 --2- 172.21.15.88:0/2069695814 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff000100860 0x7ff000197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:19:56.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.563+0000 7ff004b8f640 1 -- 172.21.15.88:0/2069695814 >> 172.21.15.88:0/2069695814 conn(0x7ff0000fc010 msgr2=0x7ff000069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:19:56.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.563+0000 7ff004b8f640 1 -- 172.21.15.88:0/2069695814 shutdown_connections 2024-09-17T04:19:56.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:19:56.563+0000 7ff004b8f640 1 -- 172.21.15.88:0/2069695814 wait complete. 2024-09-17T04:19:57.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:56 smithi088 ceph-mon[27811]: pgmap v230: 65 pgs: 65 active+clean; 13 MiB data, 218 MiB used, 536 GiB / 536 GiB avail; 40 KiB/s rd, 1.1 MiB/s wr, 31 op/s 2024-09-17T04:19:57.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:56 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/2069695814' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T04:19:57.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:56 smithi134 ceph-mon[35201]: pgmap v230: 65 pgs: 65 active+clean; 13 MiB data, 218 MiB used, 536 GiB / 536 GiB avail; 40 KiB/s rd, 1.1 MiB/s wr, 31 op/s 2024-09-17T04:19:57.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:56 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/2069695814' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T04:19:58.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:57 smithi134 ceph-mon[35201]: from='client.14732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:19:58.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:57 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:19:58.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:57 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.vwdxcb", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T04:19:58.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:57 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T04:19:58.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:57 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:19:58.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:57 smithi088 ceph-mon[27811]: from='client.14732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:19:58.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:57 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:19:58.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:57 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.vwdxcb", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T04:19:58.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:57 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T04:19:58.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:57 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:19:59.235 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:58 smithi134 ceph-mon[35201]: Upgrade: Updating mgr.smithi134.vwdxcb 2024-09-17T04:19:59.236 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:58 smithi134 ceph-mon[35201]: Deploying daemon mgr.smithi134.vwdxcb on smithi134 2024-09-17T04:19:59.236 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:19:58 smithi134 ceph-mon[35201]: pgmap v231: 65 pgs: 65 active+clean; 25 MiB data, 251 MiB used, 536 GiB / 536 GiB avail; 298 KiB/s rd, 2.1 MiB/s wr, 68 op/s 2024-09-17T04:19:59.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:58 smithi088 ceph-mon[27811]: Upgrade: Updating mgr.smithi134.vwdxcb 2024-09-17T04:19:59.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:58 smithi088 ceph-mon[27811]: Deploying daemon mgr.smithi134.vwdxcb on smithi134 2024-09-17T04:19:59.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:19:58 smithi088 ceph-mon[27811]: pgmap v231: 65 pgs: 65 active+clean; 25 MiB data, 251 MiB used, 536 GiB / 536 GiB avail; 298 KiB/s rd, 2.1 MiB/s wr, 68 op/s 2024-09-17T04:20:01.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:00 smithi088 ceph-mon[27811]: pgmap v232: 65 pgs: 65 active+clean; 36 MiB data, 290 MiB used, 536 GiB / 536 GiB avail; 639 KiB/s rd, 3.0 MiB/s wr, 98 op/s 2024-09-17T04:20:01.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:00 smithi088 ceph-mon[27811]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T04:20:01.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:00 smithi088 ceph-mon[27811]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T04:20:01.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:00 smithi088 ceph-mon[27811]: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T04:20:01.183 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:00 smithi134 ceph-mon[35201]: pgmap v232: 65 pgs: 65 active+clean; 36 MiB data, 290 MiB used, 536 GiB / 536 GiB avail; 639 KiB/s rd, 3.0 MiB/s wr, 98 op/s 2024-09-17T04:20:01.183 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:00 smithi134 ceph-mon[35201]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T04:20:01.183 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:00 smithi134 ceph-mon[35201]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T04:20:01.183 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:00 smithi134 ceph-mon[35201]: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T04:20:03.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:02 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:20:03.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:02 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:20:03.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:02 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:20:03.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:02 smithi134 ceph-mon[35201]: pgmap v233: 65 pgs: 65 active+clean; 45 MiB data, 319 MiB used, 536 GiB / 536 GiB avail; 1.2 MiB/s rd, 3.4 MiB/s wr, 128 op/s 2024-09-17T04:20:03.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:02 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:20:03.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:02 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:20:03.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:02 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:20:03.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:02 smithi088 ceph-mon[27811]: pgmap v233: 65 pgs: 65 active+clean; 45 MiB data, 319 MiB used, 536 GiB / 536 GiB avail; 1.2 MiB/s rd, 3.4 MiB/s wr, 128 op/s 2024-09-17T04:20:05.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:04 smithi088 ceph-mon[27811]: pgmap v234: 65 pgs: 65 active+clean; 47 MiB data, 344 MiB used, 536 GiB / 536 GiB avail; 1.2 MiB/s rd, 3.5 MiB/s wr, 141 op/s 2024-09-17T04:20:05.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:04 smithi134 ceph-mon[35201]: pgmap v234: 65 pgs: 65 active+clean; 47 MiB data, 344 MiB used, 536 GiB / 536 GiB avail; 1.2 MiB/s rd, 3.5 MiB/s wr, 141 op/s 2024-09-17T04:20:07.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:06 smithi088 ceph-mon[27811]: pgmap v235: 65 pgs: 65 active+clean; 50 MiB data, 359 MiB used, 536 GiB / 536 GiB avail; 1.2 MiB/s rd, 3.2 MiB/s wr, 150 op/s 2024-09-17T04:20:07.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:06 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:20:07.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:06 smithi134 ceph-mon[35201]: pgmap v235: 65 pgs: 65 active+clean; 50 MiB data, 359 MiB used, 536 GiB / 536 GiB avail; 1.2 MiB/s rd, 3.2 MiB/s wr, 150 op/s 2024-09-17T04:20:07.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:06 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:20:08.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:07 smithi088 ceph-mon[27811]: Standby manager daemon smithi134.vwdxcb restarted 2024-09-17T04:20:08.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:07 smithi088 ceph-mon[27811]: Standby manager daemon smithi134.vwdxcb started 2024-09-17T04:20:08.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:07 smithi088 ceph-mon[27811]: from='mgr.? 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.vwdxcb/crt"}]: dispatch 2024-09-17T04:20:08.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:07 smithi088 ceph-mon[27811]: from='mgr.? 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T04:20:08.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:07 smithi088 ceph-mon[27811]: from='mgr.? 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.vwdxcb/key"}]: dispatch 2024-09-17T04:20:08.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:07 smithi088 ceph-mon[27811]: from='mgr.? 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T04:20:08.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:07 smithi134 ceph-mon[35201]: Standby manager daemon smithi134.vwdxcb restarted 2024-09-17T04:20:08.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:07 smithi134 ceph-mon[35201]: Standby manager daemon smithi134.vwdxcb started 2024-09-17T04:20:08.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:07 smithi134 ceph-mon[35201]: from='mgr.? 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.vwdxcb/crt"}]: dispatch 2024-09-17T04:20:08.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:07 smithi134 ceph-mon[35201]: from='mgr.? 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T04:20:08.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:07 smithi134 ceph-mon[35201]: from='mgr.? 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.vwdxcb/key"}]: dispatch 2024-09-17T04:20:08.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:07 smithi134 ceph-mon[35201]: from='mgr.? 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T04:20:09.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:08 smithi088 ceph-mon[27811]: pgmap v236: 65 pgs: 65 active+clean; 69 MiB data, 407 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.7 MiB/s wr, 197 op/s 2024-09-17T04:20:09.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:08 smithi088 ceph-mon[27811]: mgrmap e20: smithi088.wmndiv(active, since 6m), standbys: smithi134.vwdxcb 2024-09-17T04:20:09.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:08 smithi134 ceph-mon[35201]: pgmap v236: 65 pgs: 65 active+clean; 69 MiB data, 407 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.7 MiB/s wr, 197 op/s 2024-09-17T04:20:09.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:08 smithi134 ceph-mon[35201]: mgrmap e20: smithi088.wmndiv(active, since 6m), standbys: smithi134.vwdxcb 2024-09-17T04:20:10.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:09 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:20:10.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:09 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:20:10.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:09 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:20:10.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:09 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:20:10.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:09 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:20:10.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:09 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:20:10.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:09 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:20:10.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:09 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:20:11.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:10 smithi088 ceph-mon[27811]: pgmap v237: 65 pgs: 65 active+clean; 76 MiB data, 430 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 4.3 MiB/s wr, 187 op/s 2024-09-17T04:20:11.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:10 smithi134 ceph-mon[35201]: pgmap v237: 65 pgs: 65 active+clean; 76 MiB data, 430 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 4.3 MiB/s wr, 187 op/s 2024-09-17T04:20:13.189 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:12 smithi088 ceph-mon[27811]: pgmap v238: 65 pgs: 65 active+clean; 91 MiB data, 469 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 4.7 MiB/s wr, 188 op/s 2024-09-17T04:20:13.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:12 smithi134 ceph-mon[35201]: pgmap v238: 65 pgs: 65 active+clean; 91 MiB data, 469 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 4.7 MiB/s wr, 188 op/s 2024-09-17T04:20:15.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:14 smithi088 ceph-mon[27811]: pgmap v239: 65 pgs: 65 active+clean; 94 MiB data, 511 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 4.2 MiB/s wr, 188 op/s 2024-09-17T04:20:15.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:14 smithi134 ceph-mon[35201]: pgmap v239: 65 pgs: 65 active+clean; 94 MiB data, 511 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 4.2 MiB/s wr, 188 op/s 2024-09-17T04:20:17.275 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:16 smithi134 ceph-mon[35201]: pgmap v240: 65 pgs: 65 active+clean; 99 MiB data, 521 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s rd, 4.4 MiB/s wr, 189 op/s 2024-09-17T04:20:17.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:16 smithi088 ceph-mon[27811]: pgmap v240: 65 pgs: 65 active+clean; 99 MiB data, 521 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s rd, 4.4 MiB/s wr, 189 op/s 2024-09-17T04:20:19.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:18 smithi088 ceph-mon[27811]: pgmap v241: 65 pgs: 65 active+clean; 108 MiB data, 561 MiB used, 536 GiB / 536 GiB avail; 3.1 MiB/s rd, 4.9 MiB/s wr, 201 op/s 2024-09-17T04:20:19.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:18 smithi134 ceph-mon[35201]: pgmap v241: 65 pgs: 65 active+clean; 108 MiB data, 561 MiB used, 536 GiB / 536 GiB avail; 3.1 MiB/s rd, 4.9 MiB/s wr, 201 op/s 2024-09-17T04:20:21.315 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:20 smithi134 ceph-mon[35201]: pgmap v242: 65 pgs: 65 active+clean; 112 MiB data, 576 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 3.7 MiB/s wr, 174 op/s 2024-09-17T04:20:21.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:20 smithi088 ceph-mon[27811]: pgmap v242: 65 pgs: 65 active+clean; 112 MiB data, 576 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 3.7 MiB/s wr, 174 op/s 2024-09-17T04:20:22.254 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:21 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:20:22.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:21 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:20:23.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:22 smithi088 ceph-mon[27811]: pgmap v243: 65 pgs: 65 active+clean; 118 MiB data, 602 MiB used, 536 GiB / 536 GiB avail; 2.6 MiB/s rd, 3.6 MiB/s wr, 177 op/s 2024-09-17T04:20:23.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:22 smithi134 ceph-mon[35201]: pgmap v243: 65 pgs: 65 active+clean; 118 MiB data, 602 MiB used, 536 GiB / 536 GiB avail; 2.6 MiB/s rd, 3.6 MiB/s wr, 177 op/s 2024-09-17T04:20:25.043 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:24 smithi088 ceph-mon[27811]: pgmap v244: 65 pgs: 65 active+clean; 124 MiB data, 612 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.9 MiB/s wr, 174 op/s 2024-09-17T04:20:25.043 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:24 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:20:25.043 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:24 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:20:25.044 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:24 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:20:25.044 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:24 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:20:25.044 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:24 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:20:25.044 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:24 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:20:25.044 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:24 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mgr fail", "who": "smithi088.wmndiv"}]: dispatch 2024-09-17T04:20:25.044 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:24 smithi088 ceph-mon[27811]: Activating manager daemon smithi134.vwdxcb 2024-09-17T04:20:25.044 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:24 smithi088 ceph-mon[27811]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "mgr fail", "who": "smithi088.wmndiv"}]': finished 2024-09-17T04:20:25.044 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:24 smithi088 ceph-mon[27811]: osdmap e46: 6 total, 6 up, 6 in 2024-09-17T04:20:25.045 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:24 smithi088 ceph-mon[27811]: mgrmap e21: smithi134.vwdxcb(active, starting, since 0.00789595s) 2024-09-17T04:20:25.045 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:24 smithi088 ceph-mon[27811]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2024-09-17T04:20:25.045 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:24 smithi088 ceph-mon[27811]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-09-17T04:20:25.045 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:24 smithi088 ceph-mon[27811]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.giqrgt"}]: dispatch 2024-09-17T04:20:25.045 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:24 smithi088 ceph-mon[27811]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.psnynp"}]: dispatch 2024-09-17T04:20:25.045 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:24 smithi088 ceph-mon[27811]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.ktuhce"}]: dispatch 2024-09-17T04:20:25.045 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:24 smithi088 ceph-mon[27811]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.lgavsv"}]: dispatch 2024-09-17T04:20:25.045 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:24 smithi088 ceph-mon[27811]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "mgr metadata", "who": "smithi134.vwdxcb", "id": "smithi134.vwdxcb"}]: dispatch 2024-09-17T04:20:25.046 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:24 smithi088 ceph-mon[27811]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T04:20:25.046 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:24 smithi088 ceph-mon[27811]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T04:20:25.046 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:24 smithi088 ceph-mon[27811]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T04:20:25.046 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:24 smithi088 ceph-mon[27811]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T04:20:25.046 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:24 smithi088 ceph-mon[27811]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T04:20:25.046 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:24 smithi088 ceph-mon[27811]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T04:20:25.046 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:24 smithi088 ceph-mon[27811]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T04:20:25.046 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:24 smithi088 ceph-mon[27811]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T04:20:25.047 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:24 smithi088 ceph-mon[27811]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T04:20:25.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:24 smithi134 ceph-mon[35201]: pgmap v244: 65 pgs: 65 active+clean; 124 MiB data, 612 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.9 MiB/s wr, 174 op/s 2024-09-17T04:20:25.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:24 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:20:25.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:24 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:20:25.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:24 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:20:25.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:24 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:20:25.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:24 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' 2024-09-17T04:20:25.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:24 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:20:25.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:24 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mgr fail", "who": "smithi088.wmndiv"}]: dispatch 2024-09-17T04:20:25.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:24 smithi134 ceph-mon[35201]: Activating manager daemon smithi134.vwdxcb 2024-09-17T04:20:25.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:24 smithi134 ceph-mon[35201]: from='mgr.14217 172.21.15.88:0/933999449' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "mgr fail", "who": "smithi088.wmndiv"}]': finished 2024-09-17T04:20:25.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:24 smithi134 ceph-mon[35201]: osdmap e46: 6 total, 6 up, 6 in 2024-09-17T04:20:25.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:24 smithi134 ceph-mon[35201]: mgrmap e21: smithi134.vwdxcb(active, starting, since 0.00789595s) 2024-09-17T04:20:25.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:24 smithi134 ceph-mon[35201]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2024-09-17T04:20:25.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:24 smithi134 ceph-mon[35201]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-09-17T04:20:25.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:24 smithi134 ceph-mon[35201]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.giqrgt"}]: dispatch 2024-09-17T04:20:25.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:24 smithi134 ceph-mon[35201]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.psnynp"}]: dispatch 2024-09-17T04:20:25.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:24 smithi134 ceph-mon[35201]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.ktuhce"}]: dispatch 2024-09-17T04:20:25.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:24 smithi134 ceph-mon[35201]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.lgavsv"}]: dispatch 2024-09-17T04:20:25.398 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:24 smithi134 ceph-mon[35201]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "mgr metadata", "who": "smithi134.vwdxcb", "id": "smithi134.vwdxcb"}]: dispatch 2024-09-17T04:20:25.398 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:24 smithi134 ceph-mon[35201]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T04:20:25.398 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:24 smithi134 ceph-mon[35201]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T04:20:25.398 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:24 smithi134 ceph-mon[35201]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T04:20:25.398 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:24 smithi134 ceph-mon[35201]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T04:20:25.398 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:24 smithi134 ceph-mon[35201]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T04:20:25.398 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:24 smithi134 ceph-mon[35201]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T04:20:25.398 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:24 smithi134 ceph-mon[35201]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T04:20:25.398 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:24 smithi134 ceph-mon[35201]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T04:20:25.398 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:24 smithi134 ceph-mon[35201]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T04:20:26.002 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:25 smithi134 ceph-mon[35201]: Manager daemon smithi134.vwdxcb is now available 2024-09-17T04:20:26.002 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:25 smithi134 ceph-mon[35201]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:20:26.002 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:25 smithi134 ceph-mon[35201]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:20:26.002 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:25 smithi134 ceph-mon[35201]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:20:26.003 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:25 smithi134 ceph-mon[35201]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:20:26.003 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:25 smithi134 ceph-mon[35201]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:20:26.003 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:25 smithi134 ceph-mon[35201]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-17T04:20:26.003 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:25 smithi134 ceph-mon[35201]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.vwdxcb/mirror_snapshot_schedule"}]: dispatch 2024-09-17T04:20:26.003 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:25 smithi134 ceph-mon[35201]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.vwdxcb/mirror_snapshot_schedule"}]: dispatch 2024-09-17T04:20:26.003 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:25 smithi134 ceph-mon[35201]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.vwdxcb/trash_purge_schedule"}]: dispatch 2024-09-17T04:20:26.003 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:25 smithi134 ceph-mon[35201]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.vwdxcb/trash_purge_schedule"}]: dispatch 2024-09-17T04:20:26.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:25 smithi088 ceph-mon[27811]: Manager daemon smithi134.vwdxcb is now available 2024-09-17T04:20:26.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:25 smithi088 ceph-mon[27811]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:20:26.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:25 smithi088 ceph-mon[27811]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:20:26.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:25 smithi088 ceph-mon[27811]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:20:26.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:25 smithi088 ceph-mon[27811]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:20:26.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:25 smithi088 ceph-mon[27811]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:20:26.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:25 smithi088 ceph-mon[27811]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-17T04:20:26.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:25 smithi088 ceph-mon[27811]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.vwdxcb/mirror_snapshot_schedule"}]: dispatch 2024-09-17T04:20:26.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:25 smithi088 ceph-mon[27811]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.vwdxcb/mirror_snapshot_schedule"}]: dispatch 2024-09-17T04:20:26.140 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:25 smithi088 ceph-mon[27811]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.vwdxcb/trash_purge_schedule"}]: dispatch 2024-09-17T04:20:26.140 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:25 smithi088 ceph-mon[27811]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.vwdxcb/trash_purge_schedule"}]: dispatch 2024-09-17T04:20:26.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:26.693+0000 7f89d6c8e640 1 -- 172.21.15.88:0/2545619713 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89d0101a60 msgr2=0x7f89d0101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:20:26.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:26.693+0000 7f89d6c8e640 1 --2- 172.21.15.88:0/2545619713 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89d0101a60 0x7f89d0101ee0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f89bc009880 tx=0x7f89bc02a4a0 comp rx=0 tx=0).stop 2024-09-17T04:20:26.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:26.693+0000 7f89d6c8e640 1 -- 172.21.15.88:0/2545619713 shutdown_connections 2024-09-17T04:20:26.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:26.693+0000 7f89d6c8e640 1 --2- 172.21.15.88:0/2545619713 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89d0101a60 0x7f89d0101ee0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:20:26.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:26.693+0000 7f89d6c8e640 1 --2- 172.21.15.88:0/2545619713 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89d0100860 0x7f89d0100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:20:26.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:26.693+0000 7f89d6c8e640 1 -- 172.21.15.88:0/2545619713 >> 172.21.15.88:0/2545619713 conn(0x7f89d00fc010 msgr2=0x7f89d00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:20:26.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:26.693+0000 7f89d6c8e640 1 -- 172.21.15.88:0/2545619713 shutdown_connections 2024-09-17T04:20:26.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:26.693+0000 7f89d6c8e640 1 -- 172.21.15.88:0/2545619713 wait complete. 2024-09-17T04:20:26.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:26.694+0000 7f89d6c8e640 1 Processor -- start 2024-09-17T04:20:26.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:26.694+0000 7f89d6c8e640 1 -- start start 2024-09-17T04:20:26.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:26.694+0000 7f89d6c8e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89d0100860 0x7f89d006a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:20:26.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:26.694+0000 7f89d6c8e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89d0101a60 0x7f89d0199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:20:26.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:26.694+0000 7f89d6c8e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f89d0109680 con 0x7f89d0100860 2024-09-17T04:20:26.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:26.694+0000 7f89d6c8e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f89d0109500 con 0x7f89d0101a60 2024-09-17T04:20:26.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:26.695+0000 7f89d4a2a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89d0100860 0x7f89d006a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:20:26.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:26.695+0000 7f89d4a2a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89d0100860 0x7f89d006a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57844/0 (socket says 172.21.15.88:57844) 2024-09-17T04:20:26.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:26.695+0000 7f89d4a2a640 1 -- 172.21.15.88:0/2396021535 learned_addr learned my addr 172.21.15.88:0/2396021535 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:20:26.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:26.695+0000 7f89cffff640 1 --2- 172.21.15.88:0/2396021535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89d0101a60 0x7f89d0199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:20:26.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:26.695+0000 7f89cffff640 1 -- 172.21.15.88:0/2396021535 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89d0100860 msgr2=0x7f89d006a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:20:26.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:26.695+0000 7f89cffff640 1 --2- 172.21.15.88:0/2396021535 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89d0100860 0x7f89d006a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:20:26.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:26.695+0000 7f89cffff640 1 -- 172.21.15.88:0/2396021535 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89d019a5c0 con 0x7f89d0101a60 2024-09-17T04:20:26.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:26.695+0000 7f89d4a2a640 1 --2- 172.21.15.88:0/2396021535 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89d0100860 0x7f89d006a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:20:26.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:26.695+0000 7f89cffff640 1 --2- 172.21.15.88:0/2396021535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89d0101a60 0x7f89d0199fd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f89bc006010 tx=0x7f89bc0045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:20:26.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:26.696+0000 7f89cdffb640 1 -- 172.21.15.88:0/2396021535 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f89bc03f070 con 0x7f89d0101a60 2024-09-17T04:20:26.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:26.696+0000 7f89d6c8e640 1 -- 172.21.15.88:0/2396021535 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89d019a850 con 0x7f89d0101a60 2024-09-17T04:20:26.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:26.696+0000 7f89cdffb640 1 -- 172.21.15.88:0/2396021535 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f89bc0049d0 con 0x7f89d0101a60 2024-09-17T04:20:26.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:26.696+0000 7f89cdffb640 1 -- 172.21.15.88:0/2396021535 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f89bc03f070 con 0x7f89d0101a60 2024-09-17T04:20:26.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:26.696+0000 7f89d6c8e640 1 -- 172.21.15.88:0/2396021535 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89d019ad80 con 0x7f89d0101a60 2024-09-17T04:20:26.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:26.697+0000 7f89cdffb640 1 -- 172.21.15.88:0/2396021535 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 22) ==== 51778+0+0 (secure 0 0 0) 0x7f89bc042070 con 0x7f89d0101a60 2024-09-17T04:20:26.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:26.698+0000 7f89d6c8e640 1 -- 172.21.15.88:0/2396021535 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89b40052c0 con 0x7f89d0101a60 2024-09-17T04:20:26.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:26.698+0000 7f89cdffb640 1 --2- 172.21.15.88:0/2396021535 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f89c003f980 0x7f89c0041e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:20:26.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:26.698+0000 7f89cdffb640 1 -- 172.21.15.88:0/2396021535 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f89bc076950 con 0x7f89d0101a60 2024-09-17T04:20:26.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:26.698+0000 7f89d4a2a640 1 --2- 172.21.15.88:0/2396021535 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f89c003f980 0x7f89c0041e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:20:26.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:26.699+0000 7f89d4a2a640 1 --2- 172.21.15.88:0/2396021535 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f89c003f980 0x7f89c0041e40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f89c40095f0 tx=0x7f89c4005f90 comp rx=0 tx=0).ready entity=mgr.24431 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:20:26.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:26.704+0000 7f89cdffb640 1 -- 172.21.15.88:0/2396021535 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f89bc076080 con 0x7f89d0101a60 2024-09-17T04:20:27.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.130+0000 7f89d6c8e640 1 -- 172.21.15.88:0/2396021535 --> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f89b4000bf0 con 0x7f89c003f980 2024-09-17T04:20:27.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.136+0000 7f89cdffb640 1 -- 172.21.15.88:0/2396021535 <== mgr.24431 v2:172.21.15.134:6828/1122341233 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+318 (secure 0 0 0) 0x7f89b4000bf0 con 0x7f89c003f980 2024-09-17T04:20:27.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.139+0000 7f89d6c8e640 1 -- 172.21.15.88:0/2396021535 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f89c003f980 msgr2=0x7f89c0041e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:20:27.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.139+0000 7f89d6c8e640 1 --2- 172.21.15.88:0/2396021535 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f89c003f980 0x7f89c0041e40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f89c40095f0 tx=0x7f89c4005f90 comp rx=0 tx=0).stop 2024-09-17T04:20:27.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.139+0000 7f89d6c8e640 1 -- 172.21.15.88:0/2396021535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89d0101a60 msgr2=0x7f89d0199fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:20:27.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.139+0000 7f89d6c8e640 1 --2- 172.21.15.88:0/2396021535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89d0101a60 0x7f89d0199fd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f89bc006010 tx=0x7f89bc0045e0 comp rx=0 tx=0).stop 2024-09-17T04:20:27.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.139+0000 7f89d6c8e640 1 -- 172.21.15.88:0/2396021535 shutdown_connections 2024-09-17T04:20:27.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.139+0000 7f89d6c8e640 1 --2- 172.21.15.88:0/2396021535 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f89c003f980 0x7f89c0041e40 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:20:27.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.139+0000 7f89d6c8e640 1 --2- 172.21.15.88:0/2396021535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89d0101a60 0x7f89d0199fd0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:20:27.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.139+0000 7f89d6c8e640 1 --2- 172.21.15.88:0/2396021535 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89d0100860 0x7f89d006a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:20:27.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.139+0000 7f89d6c8e640 1 -- 172.21.15.88:0/2396021535 >> 172.21.15.88:0/2396021535 conn(0x7f89d00fc010 msgr2=0x7f89d0104f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:20:27.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.139+0000 7f89d6c8e640 1 -- 172.21.15.88:0/2396021535 shutdown_connections 2024-09-17T04:20:27.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.139+0000 7f89d6c8e640 1 -- 172.21.15.88:0/2396021535 wait complete. 2024-09-17T04:20:27.151 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-09-17T04:20:27.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.256+0000 7f4c65650640 1 -- 172.21.15.88:0/664205262 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c580953d0 msgr2=0x7f4c580957d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:20:27.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.256+0000 7f4c65650640 1 --2- 172.21.15.88:0/664205262 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c580953d0 0x7f4c580957d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f4c54009880 tx=0x7f4c5402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:20:27.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.256+0000 7f4c65650640 1 -- 172.21.15.88:0/664205262 shutdown_connections 2024-09-17T04:20:27.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.256+0000 7f4c65650640 1 --2- 172.21.15.88:0/664205262 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c580965d0 0x7f4c58096a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:20:27.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.256+0000 7f4c65650640 1 --2- 172.21.15.88:0/664205262 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c580953d0 0x7f4c580957d0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:20:27.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.256+0000 7f4c65650640 1 -- 172.21.15.88:0/664205262 >> 172.21.15.88:0/664205262 conn(0x7f4c58090b60 msgr2=0x7f4c58092fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:20:27.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.256+0000 7f4c65650640 1 -- 172.21.15.88:0/664205262 shutdown_connections 2024-09-17T04:20:27.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.256+0000 7f4c65650640 1 -- 172.21.15.88:0/664205262 wait complete. 2024-09-17T04:20:27.257 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:26 smithi088 ceph-mon[27811]: mgrmap e22: smithi134.vwdxcb(active, since 1.48762s) 2024-09-17T04:20:27.257 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:26 smithi088 ceph-mon[27811]: Deploying cephadm binary to smithi088 2024-09-17T04:20:27.257 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:26 smithi088 ceph-mon[27811]: Deploying cephadm binary to smithi134 2024-09-17T04:20:27.257 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:26 smithi088 ceph-mon[27811]: pgmap v4: 65 pgs: 65 active+clean; 148 MiB data, 662 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:20:27.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.257+0000 7f4c65650640 1 Processor -- start 2024-09-17T04:20:27.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.257+0000 7f4c65650640 1 -- start start 2024-09-17T04:20:27.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.257+0000 7f4c65650640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c580953d0 0x7f4c5809fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:20:27.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.257+0000 7f4c65650640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c580965d0 0x7f4c580a0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:20:27.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.257+0000 7f4c65650640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f4c5809c020 con 0x7f4c580965d0 2024-09-17T04:20:27.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.257+0000 7f4c65650640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4c5809bea0 con 0x7f4c580953d0 2024-09-17T04:20:27.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.257+0000 7f4c5ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c580953d0 0x7f4c5809fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:20:27.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.257+0000 7f4c5ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c580953d0 0x7f4c5809fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.88:60436/0 (socket says 172.21.15.88:60436) 2024-09-17T04:20:27.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.257+0000 7f4c5ffff640 1 -- 172.21.15.88:0/1520223451 learned_addr learned my addr 172.21.15.88:0/1520223451 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:20:27.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.258+0000 7f4c5f7fe640 1 --2- 172.21.15.88:0/1520223451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c580965d0 0x7f4c580a0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:20:27.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.258+0000 7f4c5f7fe640 1 -- 172.21.15.88:0/1520223451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c580953d0 msgr2=0x7f4c5809fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:20:27.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.258+0000 7f4c5f7fe640 1 --2- 172.21.15.88:0/1520223451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c580953d0 0x7f4c5809fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:20:27.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.258+0000 7f4c5f7fe640 1 -- 172.21.15.88:0/1520223451 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c580a0bb0 con 0x7f4c580965d0 2024-09-17T04:20:27.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.259+0000 7f4c5f7fe640 1 --2- 172.21.15.88:0/1520223451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c580965d0 0x7f4c580a0530 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c00e970 tx=0x7f4c4c00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:20:27.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.259+0000 7f4c5d7fa640 1 -- 172.21.15.88:0/1520223451 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4c4c00cac0 con 0x7f4c580965d0 2024-09-17T04:20:27.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.259+0000 7f4c5d7fa640 1 -- 172.21.15.88:0/1520223451 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4c4c00cc60 con 0x7f4c580965d0 2024-09-17T04:20:27.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.259+0000 7f4c65650640 1 -- 172.21.15.88:0/1520223451 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c580a55f0 con 0x7f4c580965d0 2024-09-17T04:20:27.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.259+0000 7f4c5d7fa640 1 -- 172.21.15.88:0/1520223451 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4c4c018720 con 0x7f4c580965d0 2024-09-17T04:20:27.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.259+0000 7f4c65650640 1 -- 172.21.15.88:0/1520223451 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c580a5b80 con 0x7f4c580965d0 2024-09-17T04:20:27.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.261+0000 7f4c65650640 1 -- 172.21.15.88:0/1520223451 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c580957d0 con 0x7f4c580965d0 2024-09-17T04:20:27.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.261+0000 7f4c5d7fa640 1 -- 172.21.15.88:0/1520223451 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 22) ==== 51778+0+0 (secure 0 0 0) 0x7f4c4c010430 con 0x7f4c580965d0 2024-09-17T04:20:27.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.261+0000 7f4c5d7fa640 1 --2- 172.21.15.88:0/1520223451 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f4c5003f810 0x7f4c50041cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:20:27.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.261+0000 7f4c5d7fa640 1 -- 172.21.15.88:0/1520223451 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f4c4c055750 con 0x7f4c580965d0 2024-09-17T04:20:27.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.262+0000 7f4c5ffff640 1 --2- 172.21.15.88:0/1520223451 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f4c5003f810 0x7f4c50041cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:20:27.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.262+0000 7f4c5ffff640 1 --2- 172.21.15.88:0/1520223451 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f4c5003f810 0x7f4c50041cd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4c540096c0 tx=0x7f4c54005690 comp rx=0 tx=0).ready entity=mgr.24431 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:20:27.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.282+0000 7f4c5d7fa640 1 -- 172.21.15.88:0/1520223451 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f4c4c025170 con 0x7f4c580965d0 2024-09-17T04:20:27.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:26 smithi134 ceph-mon[35201]: mgrmap e22: smithi134.vwdxcb(active, since 1.48762s) 2024-09-17T04:20:27.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:26 smithi134 ceph-mon[35201]: Deploying cephadm binary to smithi088 2024-09-17T04:20:27.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:26 smithi134 ceph-mon[35201]: Deploying cephadm binary to smithi134 2024-09-17T04:20:27.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:26 smithi134 ceph-mon[35201]: pgmap v4: 65 pgs: 65 active+clean; 148 MiB data, 662 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:20:27.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.580+0000 7f4c65650640 1 -- 172.21.15.88:0/1520223451 --> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f4c5809f380 con 0x7f4c5003f810 2024-09-17T04:20:27.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.583+0000 7f4c5d7fa640 1 -- 172.21.15.88:0/1520223451 <== mgr.24431 v2:172.21.15.134:6828/1122341233 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+318 (secure 0 0 0) 0x7f4c5809f380 con 0x7f4c5003f810 2024-09-17T04:20:27.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.585+0000 7f4c65650640 1 -- 172.21.15.88:0/1520223451 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f4c5003f810 msgr2=0x7f4c50041cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:20:27.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.585+0000 7f4c65650640 1 --2- 172.21.15.88:0/1520223451 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f4c5003f810 0x7f4c50041cd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4c540096c0 tx=0x7f4c54005690 comp rx=0 tx=0).stop 2024-09-17T04:20:27.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.585+0000 7f4c65650640 1 -- 172.21.15.88:0/1520223451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c580965d0 msgr2=0x7f4c580a0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:20:27.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.585+0000 7f4c65650640 1 --2- 172.21.15.88:0/1520223451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c580965d0 0x7f4c580a0530 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c00e970 tx=0x7f4c4c00ee30 comp rx=0 tx=0).stop 2024-09-17T04:20:27.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.586+0000 7f4c65650640 1 -- 172.21.15.88:0/1520223451 shutdown_connections 2024-09-17T04:20:27.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.586+0000 7f4c65650640 1 --2- 172.21.15.88:0/1520223451 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f4c5003f810 0x7f4c50041cd0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:20:27.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.586+0000 7f4c65650640 1 --2- 172.21.15.88:0/1520223451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c580965d0 0x7f4c580a0530 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:20:27.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.586+0000 7f4c65650640 1 --2- 172.21.15.88:0/1520223451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c580953d0 0x7f4c5809fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:20:27.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.586+0000 7f4c65650640 1 -- 172.21.15.88:0/1520223451 >> 172.21.15.88:0/1520223451 conn(0x7f4c58090b60 msgr2=0x7f4c5809ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:20:27.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.586+0000 7f4c65650640 1 -- 172.21.15.88:0/1520223451 shutdown_connections 2024-09-17T04:20:27.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.586+0000 7f4c65650640 1 -- 172.21.15.88:0/1520223451 wait complete. 2024-09-17T04:20:27.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.708+0000 7f6865191640 1 -- 172.21.15.88:0/1198299722 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6860102b70 msgr2=0x7f6860102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:20:27.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.708+0000 7f6865191640 1 --2- 172.21.15.88:0/1198299722 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6860102b70 0x7f6860102ff0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6854009880 tx=0x7f685402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:20:27.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.708+0000 7f6865191640 1 -- 172.21.15.88:0/1198299722 shutdown_connections 2024-09-17T04:20:27.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.708+0000 7f6865191640 1 --2- 172.21.15.88:0/1198299722 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6860102b70 0x7f6860102ff0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:20:27.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.708+0000 7f6865191640 1 --2- 172.21.15.88:0/1198299722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6860101970 0x7f6860101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:20:27.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.708+0000 7f6865191640 1 -- 172.21.15.88:0/1198299722 >> 172.21.15.88:0/1198299722 conn(0x7f68600fd100 msgr2=0x7f68600ff540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:20:27.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.708+0000 7f6865191640 1 -- 172.21.15.88:0/1198299722 shutdown_connections 2024-09-17T04:20:27.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.708+0000 7f6865191640 1 -- 172.21.15.88:0/1198299722 wait complete. 2024-09-17T04:20:27.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.709+0000 7f6865191640 1 Processor -- start 2024-09-17T04:20:27.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.710+0000 7f6865191640 1 -- start start 2024-09-17T04:20:27.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.710+0000 7f6865191640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6860101970 0x7f6860197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:20:27.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.710+0000 7f6865191640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6860102b70 0x7f68601979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:20:27.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.710+0000 7f6865191640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f686010a7b0 con 0x7f6860101970 2024-09-17T04:20:27.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.710+0000 7f6865191640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f686010a630 con 0x7f6860102b70 2024-09-17T04:20:27.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.710+0000 7f685e59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6860102b70 0x7f68601979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:20:27.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.710+0000 7f685e59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6860102b70 0x7f68601979d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.88:60454/0 (socket says 172.21.15.88:60454) 2024-09-17T04:20:27.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.710+0000 7f685e59c640 1 -- 172.21.15.88:0/4282934549 learned_addr learned my addr 172.21.15.88:0/4282934549 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:20:27.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.710+0000 7f685ed9d640 1 --2- 172.21.15.88:0/4282934549 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6860101970 0x7f6860197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:20:27.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.710+0000 7f685e59c640 1 -- 172.21.15.88:0/4282934549 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6860101970 msgr2=0x7f6860197490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:20:27.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.710+0000 7f685e59c640 1 --2- 172.21.15.88:0/4282934549 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6860101970 0x7f6860197490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:20:27.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.710+0000 7f685e59c640 1 -- 172.21.15.88:0/4282934549 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6860198050 con 0x7f6860102b70 2024-09-17T04:20:27.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.710+0000 7f685ed9d640 1 --2- 172.21.15.88:0/4282934549 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6860101970 0x7f6860197490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:20:27.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.711+0000 7f685e59c640 1 --2- 172.21.15.88:0/4282934549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6860102b70 0x7f68601979d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6854009230 tx=0x7f6854004570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:20:27.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.711+0000 7f6847fff640 1 -- 172.21.15.88:0/4282934549 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f685403f070 con 0x7f6860102b70 2024-09-17T04:20:27.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.711+0000 7f6865191640 1 -- 172.21.15.88:0/4282934549 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f686019ca30 con 0x7f6860102b70 2024-09-17T04:20:27.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.711+0000 7f6847fff640 1 -- 172.21.15.88:0/4282934549 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6854004a90 con 0x7f6860102b70 2024-09-17T04:20:27.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.711+0000 7f6847fff640 1 -- 172.21.15.88:0/4282934549 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6854035030 con 0x7f6860102b70 2024-09-17T04:20:27.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.711+0000 7f6865191640 1 -- 172.21.15.88:0/4282934549 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f686019cfc0 con 0x7f6860102b70 2024-09-17T04:20:27.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.713+0000 7f6847fff640 1 -- 172.21.15.88:0/4282934549 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 22) ==== 51778+0+0 (secure 0 0 0) 0x7f6854042070 con 0x7f6860102b70 2024-09-17T04:20:27.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.713+0000 7f6865191640 1 -- 172.21.15.88:0/4282934549 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6860101d70 con 0x7f6860102b70 2024-09-17T04:20:27.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.713+0000 7f6847fff640 1 --2- 172.21.15.88:0/4282934549 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f684803f7e0 0x7f6848041ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:20:27.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.713+0000 7f6847fff640 1 -- 172.21.15.88:0/4282934549 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f6854075d30 con 0x7f6860102b70 2024-09-17T04:20:27.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.713+0000 7f685ed9d640 1 --2- 172.21.15.88:0/4282934549 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f684803f7e0 0x7f6848041ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:20:27.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.714+0000 7f685ed9d640 1 --2- 172.21.15.88:0/4282934549 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f684803f7e0 0x7f6848041ca0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f68601029d0 tx=0x7f6850005f90 comp rx=0 tx=0).ready entity=mgr.24431 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:20:27.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.718+0000 7f6847fff640 1 -- 172.21.15.88:0/4282934549 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f6854036260 con 0x7f6860102b70 2024-09-17T04:20:27.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:27.975+0000 7f6847fff640 1 -- 172.21.15.88:0/4282934549 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mgrmap(e 23) ==== 52074+0+0 (secure 0 0 0) 0x7f6854003c40 con 0x7f6860102b70 2024-09-17T04:20:28.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.032+0000 7f6865191640 1 -- 172.21.15.88:0/4282934549 --> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f68600626f0 con 0x7f684803f7e0 2024-09-17T04:20:28.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.050+0000 7f6847fff640 1 -- 172.21.15.88:0/4282934549 <== mgr.24431 v2:172.21.15.134:6828/1122341233 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f68600626f0 con 0x7f684803f7e0 2024-09-17T04:20:28.050 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T04:20:28.050 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (6m) 111s ago 7m 25.6M - 0.25.0 c8568f914cd2 f2dbac7e939f 2024-09-17T04:20:28.050 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi088 smithi088 running (7m) 111s ago 7m 8238k - 19.1.1-330-gc2ddf972 ebb0615149de 6ec56b3c8d6d 2024-09-17T04:20:28.050 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi134 smithi134 running (6m) 19s ago 6m 5272k - 19.1.1-330-gc2ddf972 ebb0615149de 6c2b7072b682 2024-09-17T04:20:28.050 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (7m) 111s ago 7m 6903k - 19.1.1-330-gc2ddf972 ebb0615149de de17f5571330 2024-09-17T04:20:28.050 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi134 smithi134 running (6m) 19s ago 6m 6899k - 19.1.1-330-gc2ddf972 ebb0615149de 27f7ef172a1c 2024-09-17T04:20:28.050 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (5m) 111s ago 7m 81.3M - 9.4.12 2bacad6d85d8 a6cff57a23f9 2024-09-17T04:20:28.050 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.giqrgt smithi088 running (2m) 111s ago 2m 19.0M - 19.1.1-330-gc2ddf972 ebb0615149de f724660799a1 2024-09-17T04:20:28.050 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.lgavsv smithi088 running (2m) 111s ago 2m 11.8M - 19.1.1-330-gc2ddf972 ebb0615149de 6cc0fe8a6aa9 2024-09-17T04:20:28.051 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi134.ktuhce smithi134 running (2m) 19s ago 2m 11.8M - 19.1.1-330-gc2ddf972 ebb0615149de 7ff5b70ca9cb 2024-09-17T04:20:28.051 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi134.psnynp smithi134 running (2m) 19s ago 2m 55.6M - 19.1.1-330-gc2ddf972 ebb0615149de 5326974fa3dd 2024-09-17T04:20:28.051 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.wmndiv smithi088 *:9283,8765,8443 running (8m) 111s ago 8m 500M - 19.1.1-330-gc2ddf972 ebb0615149de 2067eec66468 2024-09-17T04:20:28.051 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi134.vwdxcb smithi134 *:8443,9283,8765 running (26s) 19s ago 6m 135M - 19.3.0-4989-gce1b342b 8e039cb7fe1e efa5f0c9df8c 2024-09-17T04:20:28.051 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (8m) 111s ago 8m 46.0M 2048M 19.1.1-330-gc2ddf972 ebb0615149de bbeb722f42bc 2024-09-17T04:20:28.051 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi134 smithi134 running (6m) 19s ago 6m 36.6M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 89de63fb6386 2024-09-17T04:20:28.051 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (7m) 111s ago 7m 15.9M - 1.5.0 0da6a335fe13 9ba03800993b 2024-09-17T04:20:28.051 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi134 smithi134 *:9100 running (6m) 19s ago 6m 17.0M - 1.5.0 0da6a335fe13 6deac483827f 2024-09-17T04:20:28.051 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (5m) 111s ago 5m 47.9M 3946M 19.1.1-330-gc2ddf972 ebb0615149de e309427ee12c 2024-09-17T04:20:28.051 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (5m) 111s ago 5m 57.0M 3946M 19.1.1-330-gc2ddf972 ebb0615149de cc68d92b3333 2024-09-17T04:20:28.051 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (4m) 111s ago 4m 54.0M 3946M 19.1.1-330-gc2ddf972 ebb0615149de 1ba92f2bfce6 2024-09-17T04:20:28.051 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi134 running (4m) 19s ago 4m 70.7M 4970M 19.1.1-330-gc2ddf972 ebb0615149de ebd528c3ce1b 2024-09-17T04:20:28.051 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi134 running (3m) 19s ago 3m 57.9M 4970M 19.1.1-330-gc2ddf972 ebb0615149de eacc25537b3a 2024-09-17T04:20:28.052 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi134 running (3m) 19s ago 3m 64.2M 4970M 19.1.1-330-gc2ddf972 ebb0615149de bc1b434a92a8 2024-09-17T04:20:28.052 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (5m) 111s ago 7m 59.2M - 2.43.0 a07b618ecd1d 3c7fe8c3d4b0 2024-09-17T04:20:28.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.053+0000 7f6865191640 1 -- 172.21.15.88:0/4282934549 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f684803f7e0 msgr2=0x7f6848041ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:20:28.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.053+0000 7f6865191640 1 --2- 172.21.15.88:0/4282934549 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f684803f7e0 0x7f6848041ca0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f68601029d0 tx=0x7f6850005f90 comp rx=0 tx=0).stop 2024-09-17T04:20:28.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.053+0000 7f6865191640 1 -- 172.21.15.88:0/4282934549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6860102b70 msgr2=0x7f68601979d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:20:28.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.053+0000 7f6865191640 1 --2- 172.21.15.88:0/4282934549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6860102b70 0x7f68601979d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6854009230 tx=0x7f6854004570 comp rx=0 tx=0).stop 2024-09-17T04:20:28.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.053+0000 7f6865191640 1 -- 172.21.15.88:0/4282934549 shutdown_connections 2024-09-17T04:20:28.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.053+0000 7f6865191640 1 --2- 172.21.15.88:0/4282934549 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f684803f7e0 0x7f6848041ca0 secure :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f68601029d0 tx=0x7f6850005f90 comp rx=0 tx=0).stop 2024-09-17T04:20:28.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.053+0000 7f6865191640 1 --2- 172.21.15.88:0/4282934549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6860102b70 0x7f68601979d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:20:28.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.053+0000 7f6865191640 1 --2- 172.21.15.88:0/4282934549 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6860101970 0x7f6860197490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:20:28.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.053+0000 7f6865191640 1 -- 172.21.15.88:0/4282934549 >> 172.21.15.88:0/4282934549 conn(0x7f68600fd100 msgr2=0x7f6860105fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:20:28.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.054+0000 7f6865191640 1 -- 172.21.15.88:0/4282934549 shutdown_connections 2024-09-17T04:20:28.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.054+0000 7f6865191640 1 -- 172.21.15.88:0/4282934549 wait complete. 2024-09-17T04:20:28.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.159+0000 7fdf7480f640 1 -- 172.21.15.88:0/2559543704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf70101ed0 msgr2=0x7fdf701022d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:20:28.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.159+0000 7fdf7480f640 1 --2- 172.21.15.88:0/2559543704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf70101ed0 0x7fdf701022d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fdf60009880 tx=0x7fdf6002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:20:28.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.160+0000 7fdf7480f640 1 -- 172.21.15.88:0/2559543704 shutdown_connections 2024-09-17T04:20:28.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.160+0000 7fdf7480f640 1 --2- 172.21.15.88:0/2559543704 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf70100aa0 0x7fdf70100f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:20:28.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.160+0000 7fdf7480f640 1 --2- 172.21.15.88:0/2559543704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf70101ed0 0x7fdf701022d0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:20:28.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.160+0000 7fdf7480f640 1 -- 172.21.15.88:0/2559543704 >> 172.21.15.88:0/2559543704 conn(0x7fdf700fb760 msgr2=0x7fdf700fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:20:28.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.160+0000 7fdf7480f640 1 -- 172.21.15.88:0/2559543704 shutdown_connections 2024-09-17T04:20:28.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.160+0000 7fdf7480f640 1 -- 172.21.15.88:0/2559543704 wait complete. 2024-09-17T04:20:28.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.161+0000 7fdf7480f640 1 Processor -- start 2024-09-17T04:20:28.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.161+0000 7fdf7480f640 1 -- start start 2024-09-17T04:20:28.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.161+0000 7fdf7480f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf70100aa0 0x7fdf701004c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:20:28.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.161+0000 7fdf7480f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf70101ed0 0x7fdf70199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:20:28.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.161+0000 7fdf7480f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fdf70109730 con 0x7fdf70100aa0 2024-09-17T04:20:28.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.161+0000 7fdf7480f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdf701095b0 con 0x7fdf70101ed0 2024-09-17T04:20:28.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.161+0000 7fdf6dd9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf70101ed0 0x7fdf70199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:20:28.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.161+0000 7fdf6dd9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf70101ed0 0x7fdf70199fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.88:60472/0 (socket says 172.21.15.88:60472) 2024-09-17T04:20:28.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.161+0000 7fdf6dd9b640 1 -- 172.21.15.88:0/3473531766 learned_addr learned my addr 172.21.15.88:0/3473531766 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:20:28.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.161+0000 7fdf6e59c640 1 --2- 172.21.15.88:0/3473531766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf70100aa0 0x7fdf701004c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:20:28.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.162+0000 7fdf6dd9b640 1 -- 172.21.15.88:0/3473531766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf70100aa0 msgr2=0x7fdf701004c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:20:28.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.162+0000 7fdf6dd9b640 1 --2- 172.21.15.88:0/3473531766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf70100aa0 0x7fdf701004c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:20:28.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.162+0000 7fdf6dd9b640 1 -- 172.21.15.88:0/3473531766 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf7019a5a0 con 0x7fdf70101ed0 2024-09-17T04:20:28.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.162+0000 7fdf6dd9b640 1 --2- 172.21.15.88:0/3473531766 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf70101ed0 0x7fdf70199fb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fdf6400e940 tx=0x7fdf6400ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:20:28.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.162+0000 7fdf5f7fe640 1 -- 172.21.15.88:0/3473531766 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdf6400cac0 con 0x7fdf70101ed0 2024-09-17T04:20:28.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.162+0000 7fdf5f7fe640 1 -- 172.21.15.88:0/3473531766 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdf6400cc60 con 0x7fdf70101ed0 2024-09-17T04:20:28.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.163+0000 7fdf5f7fe640 1 -- 172.21.15.88:0/3473531766 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdf64003df0 con 0x7fdf70101ed0 2024-09-17T04:20:28.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.163+0000 7fdf7480f640 1 -- 172.21.15.88:0/3473531766 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf7019a890 con 0x7fdf70101ed0 2024-09-17T04:20:28.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.163+0000 7fdf7480f640 1 -- 172.21.15.88:0/3473531766 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf7019ae20 con 0x7fdf70101ed0 2024-09-17T04:20:28.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.164+0000 7fdf7480f640 1 -- 172.21.15.88:0/3473531766 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf70100f20 con 0x7fdf70101ed0 2024-09-17T04:20:28.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.165+0000 7fdf5f7fe640 1 -- 172.21.15.88:0/3473531766 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 23) ==== 52074+0+0 (secure 0 0 0) 0x7fdf64004020 con 0x7fdf70101ed0 2024-09-17T04:20:28.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.165+0000 7fdf5f7fe640 1 --2- 172.21.15.88:0/3473531766 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7fdf5803fbb0 0x7fdf58042070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:20:28.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.165+0000 7fdf5f7fe640 1 -- 172.21.15.88:0/3473531766 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7fdf64055eb0 con 0x7fdf70101ed0 2024-09-17T04:20:28.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.165+0000 7fdf6e59c640 1 --2- 172.21.15.88:0/3473531766 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7fdf5803fbb0 0x7fdf58042070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:20:28.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.166+0000 7fdf6e59c640 1 --2- 172.21.15.88:0/3473531766 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7fdf5803fbb0 0x7fdf58042070 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdf60005ab0 tx=0x7fdf60005a20 comp rx=0 tx=0).ready entity=mgr.24431 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:20:28.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.171+0000 7fdf5f7fe640 1 -- 172.21.15.88:0/3473531766 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7fdf6400ce10 con 0x7fdf70101ed0 2024-09-17T04:20:28.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:27 smithi088 ceph-mon[27811]: [17/Sep/2024:04:20:26] ENGINE Bus STARTING 2024-09-17T04:20:28.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:27 smithi088 ceph-mon[27811]: [17/Sep/2024:04:20:27] ENGINE Serving on https://172.21.15.134:7150 2024-09-17T04:20:28.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:27 smithi088 ceph-mon[27811]: [17/Sep/2024:04:20:27] ENGINE Error in HTTPServer.serve 2024-09-17T04:20:28.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Traceback (most recent call last): 2024-09-17T04:20:28.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T04:20:28.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: self._connections.run(self.expiration_interval) 2024-09-17T04:20:28.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T04:20:28.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: self._run(expiration_interval) 2024-09-17T04:20:28.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T04:20:28.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T04:20:28.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T04:20:28.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T04:20:28.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T04:20:28.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: s = self.context.wrap_socket( 2024-09-17T04:20:28.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T04:20:28.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: return self.sslsocket_class._create( 2024-09-17T04:20:28.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T04:20:28.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: self.do_handshake() 2024-09-17T04:20:28.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T04:20:28.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: self._sslobj.do_handshake() 2024-09-17T04:20:28.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T04:20:28.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:27 smithi088 ceph-mon[27811]: from='client.24457 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:20:28.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:27 smithi088 ceph-mon[27811]: [17/Sep/2024:04:20:27] ENGINE Serving on http://172.21.15.134:8765 2024-09-17T04:20:28.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:27 smithi088 ceph-mon[27811]: [17/Sep/2024:04:20:27] ENGINE Bus STARTED 2024-09-17T04:20:28.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:27 smithi134 ceph-mon[35201]: [17/Sep/2024:04:20:26] ENGINE Bus STARTING 2024-09-17T04:20:28.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:27 smithi134 ceph-mon[35201]: [17/Sep/2024:04:20:27] ENGINE Serving on https://172.21.15.134:7150 2024-09-17T04:20:28.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:27 smithi134 ceph-mon[35201]: [17/Sep/2024:04:20:27] ENGINE Error in HTTPServer.serve 2024-09-17T04:20:28.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Traceback (most recent call last): 2024-09-17T04:20:28.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T04:20:28.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: self._connections.run(self.expiration_interval) 2024-09-17T04:20:28.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T04:20:28.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: self._run(expiration_interval) 2024-09-17T04:20:28.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T04:20:28.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T04:20:28.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T04:20:28.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T04:20:28.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T04:20:28.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: s = self.context.wrap_socket( 2024-09-17T04:20:28.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T04:20:28.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: return self.sslsocket_class._create( 2024-09-17T04:20:28.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T04:20:28.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: self.do_handshake() 2024-09-17T04:20:28.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T04:20:28.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: self._sslobj.do_handshake() 2024-09-17T04:20:28.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T04:20:28.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:27 smithi134 ceph-mon[35201]: from='client.24457 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:20:28.398 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:27 smithi134 ceph-mon[35201]: [17/Sep/2024:04:20:27] ENGINE Serving on http://172.21.15.134:8765 2024-09-17T04:20:28.398 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:27 smithi134 ceph-mon[35201]: [17/Sep/2024:04:20:27] ENGINE Bus STARTED 2024-09-17T04:20:28.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.567+0000 7fdf7480f640 1 -- 172.21.15.88:0/3473531766 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fdf7018ffb0 con 0x7fdf70101ed0 2024-09-17T04:20:28.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.568+0000 7fdf5f7fe640 1 -- 172.21.15.88:0/3473531766 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7fdf64004310 con 0x7fdf70101ed0 2024-09-17T04:20:28.568 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-17T04:20:28.568 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-09-17T04:20:28.568 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T04:20:28.568 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:20:28.569 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-09-17T04:20:28.569 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 1 2024-09-17T04:20:28.569 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:20:28.569 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-09-17T04:20:28.569 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-17T04:20:28.569 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:20:28.569 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2024-09-17T04:20:28.569 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T04:20:28.569 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:20:28.569 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-09-17T04:20:28.569 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 12, 2024-09-17T04:20:28.569 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 1 2024-09-17T04:20:28.569 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-17T04:20:28.569 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-17T04:20:28.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.571+0000 7fdf7480f640 1 -- 172.21.15.88:0/3473531766 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7fdf5803fbb0 msgr2=0x7fdf58042070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:20:28.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.571+0000 7fdf7480f640 1 --2- 172.21.15.88:0/3473531766 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7fdf5803fbb0 0x7fdf58042070 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdf60005ab0 tx=0x7fdf60005a20 comp rx=0 tx=0).stop 2024-09-17T04:20:28.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.571+0000 7fdf7480f640 1 -- 172.21.15.88:0/3473531766 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf70101ed0 msgr2=0x7fdf70199fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:20:28.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.571+0000 7fdf7480f640 1 --2- 172.21.15.88:0/3473531766 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf70101ed0 0x7fdf70199fb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fdf6400e940 tx=0x7fdf6400ee00 comp rx=0 tx=0).stop 2024-09-17T04:20:28.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.571+0000 7fdf7480f640 1 -- 172.21.15.88:0/3473531766 shutdown_connections 2024-09-17T04:20:28.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.571+0000 7fdf7480f640 1 --2- 172.21.15.88:0/3473531766 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7fdf5803fbb0 0x7fdf58042070 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:20:28.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.571+0000 7fdf7480f640 1 --2- 172.21.15.88:0/3473531766 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf70101ed0 0x7fdf70199fb0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:20:28.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.571+0000 7fdf7480f640 1 --2- 172.21.15.88:0/3473531766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf70100aa0 0x7fdf701004c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:20:28.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.571+0000 7fdf7480f640 1 -- 172.21.15.88:0/3473531766 >> 172.21.15.88:0/3473531766 conn(0x7fdf700fb760 msgr2=0x7fdf70104fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:20:28.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.572+0000 7fdf7480f640 1 -- 172.21.15.88:0/3473531766 shutdown_connections 2024-09-17T04:20:28.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.572+0000 7fdf7480f640 1 -- 172.21.15.88:0/3473531766 wait complete. 2024-09-17T04:20:28.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.705+0000 7f58789ab640 1 -- 172.21.15.88:0/2024575403 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58741094e0 msgr2=0x7f58741098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:20:28.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.705+0000 7f58789ab640 1 --2- 172.21.15.88:0/2024575403 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58741094e0 0x7f58741098e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f586400dc90 tx=0x7f586402a080 comp rx=0 tx=0).stop 2024-09-17T04:20:28.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.705+0000 7f58789ab640 1 -- 172.21.15.88:0/2024575403 shutdown_connections 2024-09-17T04:20:28.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.705+0000 7f58789ab640 1 --2- 172.21.15.88:0/2024575403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5874073400 0x7f5874073880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:20:28.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.705+0000 7f58789ab640 1 --2- 172.21.15.88:0/2024575403 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58741094e0 0x7f58741098e0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:20:28.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.705+0000 7f58789ab640 1 -- 172.21.15.88:0/2024575403 >> 172.21.15.88:0/2024575403 conn(0x7f587406eea0 msgr2=0x7f58740712e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:20:28.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.705+0000 7f58789ab640 1 -- 172.21.15.88:0/2024575403 shutdown_connections 2024-09-17T04:20:28.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.706+0000 7f58789ab640 1 -- 172.21.15.88:0/2024575403 wait complete. 2024-09-17T04:20:28.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.706+0000 7f58789ab640 1 Processor -- start 2024-09-17T04:20:28.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.707+0000 7f58789ab640 1 -- start start 2024-09-17T04:20:28.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.707+0000 7f58789ab640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5874073400 0x7f58741aead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:20:28.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.707+0000 7f58789ab640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58741094e0 0x7f58741af010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:20:28.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.707+0000 7f58789ab640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f5874110ea0 con 0x7f5874073400 2024-09-17T04:20:28.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.707+0000 7f58789ab640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5874110d20 con 0x7f58741094e0 2024-09-17T04:20:28.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.707+0000 7f5871d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58741094e0 0x7f58741af010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:20:28.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.707+0000 7f587259c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5874073400 0x7f58741aead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:20:28.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.707+0000 7f587259c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5874073400 0x7f58741aead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57920/0 (socket says 172.21.15.88:57920) 2024-09-17T04:20:28.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.707+0000 7f587259c640 1 -- 172.21.15.88:0/2391179517 learned_addr learned my addr 172.21.15.88:0/2391179517 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:20:28.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.708+0000 7f5871d9b640 1 -- 172.21.15.88:0/2391179517 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5874073400 msgr2=0x7f58741aead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:20:28.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.708+0000 7f5871d9b640 1 --2- 172.21.15.88:0/2391179517 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5874073400 0x7f58741aead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:20:28.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.708+0000 7f5871d9b640 1 -- 172.21.15.88:0/2391179517 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58741af690 con 0x7f58741094e0 2024-09-17T04:20:28.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.708+0000 7f587259c640 1 --2- 172.21.15.88:0/2391179517 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5874073400 0x7f58741aead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:20:28.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.708+0000 7f5871d9b640 1 --2- 172.21.15.88:0/2391179517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58741094e0 0x7f58741af010 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5868009fd0 tx=0x7f5868013f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:20:28.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.708+0000 7f58637fe640 1 -- 172.21.15.88:0/2391179517 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f586800ee80 con 0x7f58741094e0 2024-09-17T04:20:28.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.708+0000 7f58789ab640 1 -- 172.21.15.88:0/2391179517 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58741b40d0 con 0x7f58741094e0 2024-09-17T04:20:28.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.709+0000 7f58789ab640 1 -- 172.21.15.88:0/2391179517 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58741b46e0 con 0x7f58741094e0 2024-09-17T04:20:28.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.709+0000 7f58637fe640 1 -- 172.21.15.88:0/2391179517 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5868017020 con 0x7f58741094e0 2024-09-17T04:20:28.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.709+0000 7f58637fe640 1 -- 172.21.15.88:0/2391179517 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f58680039c0 con 0x7f58741094e0 2024-09-17T04:20:28.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.710+0000 7f58789ab640 1 -- 172.21.15.88:0/2391179517 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58540052c0 con 0x7f58741094e0 2024-09-17T04:20:28.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.710+0000 7f58637fe640 1 -- 172.21.15.88:0/2391179517 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 23) ==== 52074+0+0 (secure 0 0 0) 0x7f5868003c70 con 0x7f58741094e0 2024-09-17T04:20:28.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.710+0000 7f58637fe640 1 --2- 172.21.15.88:0/2391179517 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f585c03fbb0 0x7f585c042070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:20:28.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.710+0000 7f58637fe640 1 -- 172.21.15.88:0/2391179517 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f5868018030 con 0x7f58741094e0 2024-09-17T04:20:28.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.711+0000 7f587259c640 1 --2- 172.21.15.88:0/2391179517 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f585c03fbb0 0x7f585c042070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:20:28.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.711+0000 7f587259c640 1 --2- 172.21.15.88:0/2391179517 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f585c03fbb0 0x7f585c042070 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5864004800 tx=0x7f5864005fd0 comp rx=0 tx=0).ready entity=mgr.24431 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:20:28.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:28.720+0000 7f58637fe640 1 -- 172.21.15.88:0/2391179517 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f5868021020 con 0x7f58741094e0 2024-09-17T04:20:29.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.014+0000 7f58789ab640 1 -- 172.21.15.88:0/2391179517 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f5854005880 con 0x7f58741094e0 2024-09-17T04:20:29.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.014+0000 7f58637fe640 1 -- 172.21.15.88:0/2391179517 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) ==== 76+0+2045 (secure 0 0 0) 0x7f586801c410 con 0x7f58741094e0 2024-09-17T04:20:29.014 INFO:teuthology.orchestra.run.smithi088.stdout:e15 2024-09-17T04:20:29.014 INFO:teuthology.orchestra.run.smithi088.stdout:btime 2024-09-17T04:18:27:750910+0000 2024-09-17T04:20:29.014 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T04:20:29.014 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:20:29.014 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2024-09-17T04:20:29.015 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:20:29.015 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2024-09-17T04:20:29.015 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2024-09-17T04:20:29.015 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 15 2024-09-17T04:20:29.015 INFO:teuthology.orchestra.run.smithi088.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T04:20:29.015 INFO:teuthology.orchestra.run.smithi088.stdout:created 2024-09-17T04:18:10.480573+0000 2024-09-17T04:20:29.015 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2024-09-17T04:18:27.750896+0000 2024-09-17T04:20:29.015 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2024-09-17T04:20:29.015 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2024-09-17T04:20:29.015 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2024-09-17T04:20:29.015 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2024-09-17T04:20:29.015 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2024-09-17T04:20:29.015 INFO:teuthology.orchestra.run.smithi088.stdout:max_xattr_size 65536 2024-09-17T04:20:29.015 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2024-09-17T04:20:29.015 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2024-09-17T04:20:29.016 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 45 2024-09-17T04:20:29.016 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:20:29.016 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 1 2024-09-17T04:20:29.016 INFO:teuthology.orchestra.run.smithi088.stdout:in 0 2024-09-17T04:20:29.016 INFO:teuthology.orchestra.run.smithi088.stdout:up {0=14590} 2024-09-17T04:20:29.016 INFO:teuthology.orchestra.run.smithi088.stdout:failed 2024-09-17T04:20:29.016 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2024-09-17T04:20:29.016 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2024-09-17T04:20:29.016 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2024-09-17T04:20:29.016 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2024-09-17T04:20:29.016 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data enabled 2024-09-17T04:20:29.017 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2024-09-17T04:20:29.017 INFO:teuthology.orchestra.run.smithi088.stdout:bal_rank_mask -1 2024-09-17T04:20:29.017 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 1 2024-09-17T04:20:29.017 INFO:teuthology.orchestra.run.smithi088.stdout:qdb_cluster leader: 14590 members: 14590 2024-09-17T04:20:29.017 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.giqrgt{0:14590} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.88:6828/1714846518,v1:172.21.15.88:6829/1714846518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:20:29.017 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi134.psnynp{0:24321} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.134:6826/2137586894,v1:172.21.15.134:6827/2137586894] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:20:29.017 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:20:29.017 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:20:29.017 INFO:teuthology.orchestra.run.smithi088.stdout:Standby daemons: 2024-09-17T04:20:29.017 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:20:29.017 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi134.ktuhce{-1:24325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/967997022,v1:172.21.15.134:6825/967997022] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:20:29.017 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.lgavsv{-1:24329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/1425146180,v1:172.21.15.88:6827/1425146180] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:20:29.018 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 15 2024-09-17T04:20:29.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.016+0000 7f58789ab640 1 -- 172.21.15.88:0/2391179517 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f585c03fbb0 msgr2=0x7f585c042070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:20:29.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.016+0000 7f58789ab640 1 --2- 172.21.15.88:0/2391179517 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f585c03fbb0 0x7f585c042070 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5864004800 tx=0x7f5864005fd0 comp rx=0 tx=0).stop 2024-09-17T04:20:29.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.016+0000 7f58789ab640 1 -- 172.21.15.88:0/2391179517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58741094e0 msgr2=0x7f58741af010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:20:29.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.016+0000 7f58789ab640 1 --2- 172.21.15.88:0/2391179517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58741094e0 0x7f58741af010 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5868009fd0 tx=0x7f5868013f90 comp rx=0 tx=0).stop 2024-09-17T04:20:29.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.016+0000 7f58789ab640 1 -- 172.21.15.88:0/2391179517 shutdown_connections 2024-09-17T04:20:29.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.016+0000 7f58789ab640 1 --2- 172.21.15.88:0/2391179517 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f585c03fbb0 0x7f585c042070 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:20:29.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.016+0000 7f58789ab640 1 --2- 172.21.15.88:0/2391179517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58741094e0 0x7f58741af010 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:20:29.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.016+0000 7f58789ab640 1 --2- 172.21.15.88:0/2391179517 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5874073400 0x7f58741aead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:20:29.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.016+0000 7f58789ab640 1 -- 172.21.15.88:0/2391179517 >> 172.21.15.88:0/2391179517 conn(0x7f587406eea0 msgr2=0x7f587410e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:20:29.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.017+0000 7f58789ab640 1 -- 172.21.15.88:0/2391179517 shutdown_connections 2024-09-17T04:20:29.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.017+0000 7f58789ab640 1 -- 172.21.15.88:0/2391179517 wait complete. 2024-09-17T04:20:29.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.109+0000 7eff8f71e640 1 -- 172.21.15.88:0/2954557236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff881023f0 msgr2=0x7eff881047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:20:29.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.109+0000 7eff8f71e640 1 --2- 172.21.15.88:0/2954557236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff881023f0 0x7eff881047e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7eff840098b0 tx=0x7eff8402a4d0 comp rx=0 tx=0).stop 2024-09-17T04:20:29.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.109+0000 7eff8f71e640 1 -- 172.21.15.88:0/2954557236 shutdown_connections 2024-09-17T04:20:29.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.109+0000 7eff8f71e640 1 --2- 172.21.15.88:0/2954557236 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff88104d20 0x7eff88107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:20:29.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.109+0000 7eff8f71e640 1 --2- 172.21.15.88:0/2954557236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff881023f0 0x7eff881047e0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:20:29.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.109+0000 7eff8f71e640 1 -- 172.21.15.88:0/2954557236 >> 172.21.15.88:0/2954557236 conn(0x7eff880fbff0 msgr2=0x7eff880fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:20:29.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.109+0000 7eff8f71e640 1 -- 172.21.15.88:0/2954557236 shutdown_connections 2024-09-17T04:20:29.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.109+0000 7eff8f71e640 1 -- 172.21.15.88:0/2954557236 wait complete. 2024-09-17T04:20:29.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.110+0000 7eff8f71e640 1 Processor -- start 2024-09-17T04:20:29.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.110+0000 7eff8f71e640 1 -- start start 2024-09-17T04:20:29.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.110+0000 7eff8f71e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff881023f0 0x7eff88101ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:20:29.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.110+0000 7eff8f71e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff88104d20 0x7eff881003a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:20:29.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.110+0000 7eff8f71e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7eff8810a7e0 con 0x7eff88104d20 2024-09-17T04:20:29.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.110+0000 7eff8f71e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7eff8810a660 con 0x7eff881023f0 2024-09-17T04:20:29.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.110+0000 7eff8ccb9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff88104d20 0x7eff881003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:20:29.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.110+0000 7eff8ccb9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff88104d20 0x7eff881003a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57932/0 (socket says 172.21.15.88:57932) 2024-09-17T04:20:29.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.110+0000 7eff8ccb9640 1 -- 172.21.15.88:0/1493346392 learned_addr learned my addr 172.21.15.88:0/1493346392 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:20:29.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.110+0000 7eff8d4ba640 1 --2- 172.21.15.88:0/1493346392 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff881023f0 0x7eff88101ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:20:29.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.110+0000 7eff8ccb9640 1 -- 172.21.15.88:0/1493346392 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff881023f0 msgr2=0x7eff88101ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:20:29.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.110+0000 7eff8ccb9640 1 --2- 172.21.15.88:0/1493346392 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff881023f0 0x7eff88101ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:20:29.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.110+0000 7eff8ccb9640 1 -- 172.21.15.88:0/1493346392 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff881008e0 con 0x7eff88104d20 2024-09-17T04:20:29.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.110+0000 7eff8d4ba640 1 --2- 172.21.15.88:0/1493346392 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff881023f0 0x7eff88101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:20:29.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.111+0000 7eff8ccb9640 1 --2- 172.21.15.88:0/1493346392 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff88104d20 0x7eff881003a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7eff7800e970 tx=0x7eff7800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:20:29.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.111+0000 7eff7e7fc640 1 -- 172.21.15.88:0/1493346392 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7eff7800cac0 con 0x7eff88104d20 2024-09-17T04:20:29.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.111+0000 7eff8f71e640 1 -- 172.21.15.88:0/1493346392 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff88100bd0 con 0x7eff88104d20 2024-09-17T04:20:29.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.111+0000 7eff7e7fc640 1 -- 172.21.15.88:0/1493346392 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7eff780054e0 con 0x7eff88104d20 2024-09-17T04:20:29.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.112+0000 7eff7e7fc640 1 -- 172.21.15.88:0/1493346392 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7eff78010430 con 0x7eff88104d20 2024-09-17T04:20:29.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.112+0000 7eff8f71e640 1 -- 172.21.15.88:0/1493346392 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff88101160 con 0x7eff88104d20 2024-09-17T04:20:29.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.112+0000 7eff7e7fc640 1 -- 172.21.15.88:0/1493346392 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 23) ==== 52074+0+0 (secure 0 0 0) 0x7eff780106e0 con 0x7eff88104d20 2024-09-17T04:20:29.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.113+0000 7eff7e7fc640 1 --2- 172.21.15.88:0/1493346392 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7eff7403fb10 0x7eff74041fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:20:29.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.113+0000 7eff7e7fc640 1 -- 172.21.15.88:0/1493346392 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7eff780594a0 con 0x7eff88104d20 2024-09-17T04:20:29.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.113+0000 7eff8f71e640 1 -- 172.21.15.88:0/1493346392 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff881027d0 con 0x7eff88104d20 2024-09-17T04:20:29.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.113+0000 7eff8d4ba640 1 --2- 172.21.15.88:0/1493346392 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7eff7403fb10 0x7eff74041fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:20:29.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.114+0000 7eff8d4ba640 1 --2- 172.21.15.88:0/1493346392 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7eff7403fb10 0x7eff74041fd0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7eff84006010 tx=0x7eff840058d0 comp rx=0 tx=0).ready entity=mgr.24431 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:20:29.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.118+0000 7eff7e7fc640 1 -- 172.21.15.88:0/1493346392 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7eff780071c0 con 0x7eff88104d20 2024-09-17T04:20:29.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:28 smithi088 ceph-mon[27811]: from='client.14770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:20:29.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:28 smithi088 ceph-mon[27811]: mgrmap e23: smithi134.vwdxcb(active, since 3s) 2024-09-17T04:20:29.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:28 smithi088 ceph-mon[27811]: from='client.24465 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:20:29.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:28 smithi088 ceph-mon[27811]: pgmap v5: 65 pgs: 65 active+clean; 148 MiB data, 662 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:20:29.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:28 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/3473531766' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T04:20:29.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.350+0000 7eff8f71e640 1 -- 172.21.15.88:0/1493346392 --> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7eff88105700 con 0x7eff7403fb10 2024-09-17T04:20:29.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.351+0000 7eff7e7fc640 1 -- 172.21.15.88:0/1493346392 <== mgr.24431 v2:172.21.15.134:6828/1122341233 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+318 (secure 0 0 0) 0x7eff88105700 con 0x7eff7403fb10 2024-09-17T04:20:29.351 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-17T04:20:29.351 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f", 2024-09-17T04:20:29.351 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-09-17T04:20:29.351 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T04:20:29.351 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [], 2024-09-17T04:20:29.352 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "1/23 daemons upgraded", 2024-09-17T04:20:29.352 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "", 2024-09-17T04:20:29.352 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-09-17T04:20:29.352 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-17T04:20:29.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.354+0000 7eff8f71e640 1 -- 172.21.15.88:0/1493346392 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7eff7403fb10 msgr2=0x7eff74041fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:20:29.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.354+0000 7eff8f71e640 1 --2- 172.21.15.88:0/1493346392 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7eff7403fb10 0x7eff74041fd0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7eff84006010 tx=0x7eff840058d0 comp rx=0 tx=0).stop 2024-09-17T04:20:29.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.354+0000 7eff8f71e640 1 -- 172.21.15.88:0/1493346392 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff88104d20 msgr2=0x7eff881003a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:20:29.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.354+0000 7eff8f71e640 1 --2- 172.21.15.88:0/1493346392 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff88104d20 0x7eff881003a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7eff7800e970 tx=0x7eff7800ee30 comp rx=0 tx=0).stop 2024-09-17T04:20:29.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.354+0000 7eff8f71e640 1 -- 172.21.15.88:0/1493346392 shutdown_connections 2024-09-17T04:20:29.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.354+0000 7eff8f71e640 1 --2- 172.21.15.88:0/1493346392 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7eff7403fb10 0x7eff74041fd0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:20:29.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.354+0000 7eff8f71e640 1 --2- 172.21.15.88:0/1493346392 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff88104d20 0x7eff881003a0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:20:29.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.354+0000 7eff8f71e640 1 --2- 172.21.15.88:0/1493346392 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff881023f0 0x7eff88101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:20:29.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.354+0000 7eff8f71e640 1 -- 172.21.15.88:0/1493346392 >> 172.21.15.88:0/1493346392 conn(0x7eff880fbff0 msgr2=0x7eff880fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:20:29.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.354+0000 7eff8f71e640 1 -- 172.21.15.88:0/1493346392 shutdown_connections 2024-09-17T04:20:29.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.354+0000 7eff8f71e640 1 -- 172.21.15.88:0/1493346392 wait complete. 2024-09-17T04:20:29.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:28 smithi134 ceph-mon[35201]: from='client.14770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:20:29.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:28 smithi134 ceph-mon[35201]: mgrmap e23: smithi134.vwdxcb(active, since 3s) 2024-09-17T04:20:29.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:28 smithi134 ceph-mon[35201]: from='client.24465 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:20:29.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:28 smithi134 ceph-mon[35201]: pgmap v5: 65 pgs: 65 active+clean; 148 MiB data, 662 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:20:29.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:28 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/3473531766' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T04:20:29.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.460+0000 7f0ebd635640 1 -- 172.21.15.88:0/3120404748 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0eb8101960 msgr2=0x7f0eb8101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:20:29.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.460+0000 7f0ebd635640 1 --2- 172.21.15.88:0/3120404748 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0eb8101960 0x7f0eb8101d60 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f0ea8009880 tx=0x7f0ea802a4a0 comp rx=0 tx=0).stop 2024-09-17T04:20:29.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.460+0000 7f0ebd635640 1 -- 172.21.15.88:0/3120404748 shutdown_connections 2024-09-17T04:20:29.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.460+0000 7f0ebd635640 1 --2- 172.21.15.88:0/3120404748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0eb8102b60 0x7f0eb8102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:20:29.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.460+0000 7f0ebd635640 1 --2- 172.21.15.88:0/3120404748 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0eb8101960 0x7f0eb8101d60 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:20:29.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.460+0000 7f0ebd635640 1 -- 172.21.15.88:0/3120404748 >> 172.21.15.88:0/3120404748 conn(0x7f0eb80fd110 msgr2=0x7f0eb80ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:20:29.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.460+0000 7f0ebd635640 1 -- 172.21.15.88:0/3120404748 shutdown_connections 2024-09-17T04:20:29.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.460+0000 7f0ebd635640 1 -- 172.21.15.88:0/3120404748 wait complete. 2024-09-17T04:20:29.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.461+0000 7f0ebd635640 1 Processor -- start 2024-09-17T04:20:29.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.461+0000 7f0ebd635640 1 -- start start 2024-09-17T04:20:29.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.462+0000 7f0ebd635640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0eb8101960 0x7f0eb819db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:20:29.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.462+0000 7f0ebd635640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0eb8102b60 0x7f0eb819e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:20:29.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.462+0000 7f0ebd635640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f0eb810a780 con 0x7f0eb8102b60 2024-09-17T04:20:29.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.462+0000 7f0ebd635640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0eb810a600 con 0x7f0eb8101960 2024-09-17T04:20:29.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.462+0000 7f0eb6ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0eb8101960 0x7f0eb819db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:20:29.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.462+0000 7f0eb67fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0eb8102b60 0x7f0eb819e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:20:29.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.462+0000 7f0eb67fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0eb8102b60 0x7f0eb819e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57956/0 (socket says 172.21.15.88:57956) 2024-09-17T04:20:29.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.462+0000 7f0eb67fc640 1 -- 172.21.15.88:0/1291656351 learned_addr learned my addr 172.21.15.88:0/1291656351 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:20:29.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.462+0000 7f0eb6ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0eb8101960 0x7f0eb819db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.88:60510/0 (socket says 172.21.15.88:60510) 2024-09-17T04:20:29.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.462+0000 7f0eb6ffd640 1 -- 172.21.15.88:0/1291656351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0eb8102b60 msgr2=0x7f0eb819e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:20:29.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.462+0000 7f0eb6ffd640 1 --2- 172.21.15.88:0/1291656351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0eb8102b60 0x7f0eb819e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:20:29.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.462+0000 7f0eb6ffd640 1 -- 172.21.15.88:0/1291656351 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eb819e6c0 con 0x7f0eb8101960 2024-09-17T04:20:29.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.462+0000 7f0eb67fc640 1 --2- 172.21.15.88:0/1291656351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0eb8102b60 0x7f0eb819e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:20:29.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.463+0000 7f0eb6ffd640 1 --2- 172.21.15.88:0/1291656351 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0eb8101960 0x7f0eb819db00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0ea8009230 tx=0x7f0ea80045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:20:29.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.463+0000 7f0e9ffff640 1 -- 172.21.15.88:0/1291656351 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0ea803f070 con 0x7f0eb8101960 2024-09-17T04:20:29.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.463+0000 7f0ebd635640 1 -- 172.21.15.88:0/1291656351 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0eb81a30a0 con 0x7f0eb8101960 2024-09-17T04:20:29.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.463+0000 7f0e9ffff640 1 -- 172.21.15.88:0/1291656351 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0ea8004a50 con 0x7f0eb8101960 2024-09-17T04:20:29.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.463+0000 7f0e9ffff640 1 -- 172.21.15.88:0/1291656351 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0ea8035030 con 0x7f0eb8101960 2024-09-17T04:20:29.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.463+0000 7f0ebd635640 1 -- 172.21.15.88:0/1291656351 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0eb81a3630 con 0x7f0eb8101960 2024-09-17T04:20:29.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.464+0000 7f0e9ffff640 1 -- 172.21.15.88:0/1291656351 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 23) ==== 52074+0+0 (secure 0 0 0) 0x7f0ea8042070 con 0x7f0eb8101960 2024-09-17T04:20:29.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.464+0000 7f0e9ffff640 1 --2- 172.21.15.88:0/1291656351 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f0ea003fb10 0x7f0ea0041fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:20:29.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.464+0000 7f0e9ffff640 1 -- 172.21.15.88:0/1291656351 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f0ea80762a0 con 0x7f0eb8101960 2024-09-17T04:20:29.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.465+0000 7f0eb67fc640 1 --2- 172.21.15.88:0/1291656351 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f0ea003fb10 0x7f0ea0041fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:20:29.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.465+0000 7f0ebd635640 1 -- 172.21.15.88:0/1291656351 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0eb8101d60 con 0x7f0eb8101960 2024-09-17T04:20:29.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.465+0000 7f0eb67fc640 1 --2- 172.21.15.88:0/1291656351 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f0ea003fb10 0x7f0ea0041fd0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0eb819efb0 tx=0x7f0eac00b480 comp rx=0 tx=0).ready entity=mgr.24431 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:20:29.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.470+0000 7f0e9ffff640 1 -- 172.21.15.88:0/1291656351 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f0ea8004c00 con 0x7f0eb8101960 2024-09-17T04:20:29.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.846+0000 7f0ebd635640 1 -- 172.21.15.88:0/1291656351 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f0eb81a3e50 con 0x7f0eb8101960 2024-09-17T04:20:29.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.847+0000 7f0e9ffff640 1 -- 172.21.15.88:0/1291656351 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f0ea802fdc0 con 0x7f0eb8101960 2024-09-17T04:20:29.846 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T04:20:29.847 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T04:20:29.847 INFO:teuthology.orchestra.run.smithi088.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T04:20:29.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.849+0000 7f0ebd635640 1 -- 172.21.15.88:0/1291656351 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f0ea003fb10 msgr2=0x7f0ea0041fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:20:29.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.849+0000 7f0ebd635640 1 --2- 172.21.15.88:0/1291656351 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f0ea003fb10 0x7f0ea0041fd0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0eb819efb0 tx=0x7f0eac00b480 comp rx=0 tx=0).stop 2024-09-17T04:20:29.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.849+0000 7f0ebd635640 1 -- 172.21.15.88:0/1291656351 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0eb8101960 msgr2=0x7f0eb819db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:20:29.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.849+0000 7f0ebd635640 1 --2- 172.21.15.88:0/1291656351 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0eb8101960 0x7f0eb819db00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0ea8009230 tx=0x7f0ea80045e0 comp rx=0 tx=0).stop 2024-09-17T04:20:29.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.849+0000 7f0ebd635640 1 -- 172.21.15.88:0/1291656351 shutdown_connections 2024-09-17T04:20:29.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.850+0000 7f0ebd635640 1 --2- 172.21.15.88:0/1291656351 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f0ea003fb10 0x7f0ea0041fd0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:20:29.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.850+0000 7f0ebd635640 1 --2- 172.21.15.88:0/1291656351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0eb8102b60 0x7f0eb819e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:20:29.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.850+0000 7f0ebd635640 1 --2- 172.21.15.88:0/1291656351 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0eb8101960 0x7f0eb819db00 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:20:29.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.850+0000 7f0ebd635640 1 -- 172.21.15.88:0/1291656351 >> 172.21.15.88:0/1291656351 conn(0x7f0eb80fd110 msgr2=0x7f0eb80746b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:20:29.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.850+0000 7f0ebd635640 1 -- 172.21.15.88:0/1291656351 shutdown_connections 2024-09-17T04:20:29.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:29.850+0000 7f0ebd635640 1 -- 172.21.15.88:0/1291656351 wait complete. 2024-09-17T04:20:30.119 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:29 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/2391179517' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T04:20:30.120 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:29 smithi088 ceph-mon[27811]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:20:30.120 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:29 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/1291656351' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T04:20:30.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:29 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/2391179517' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T04:20:30.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:29 smithi134 ceph-mon[35201]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:20:30.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:29 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/1291656351' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T04:20:31.351 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:30 smithi088 ceph-mon[27811]: mgrmap e24: smithi134.vwdxcb(active, since 5s) 2024-09-17T04:20:31.351 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:30 smithi088 ceph-mon[27811]: pgmap v6: 65 pgs: 65 active+clean; 148 MiB data, 662 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:20:31.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:30 smithi134 ceph-mon[35201]: mgrmap e24: smithi134.vwdxcb(active, since 5s) 2024-09-17T04:20:31.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:30 smithi134 ceph-mon[35201]: pgmap v6: 65 pgs: 65 active+clean; 148 MiB data, 662 MiB used, 536 GiB / 536 GiB avail 2024-09-17T04:20:32.257 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:31 smithi134 ceph-mon[35201]: Standby manager daemon smithi088.wmndiv started 2024-09-17T04:20:32.257 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:31 smithi134 ceph-mon[35201]: from='mgr.? 172.21.15.88:0/1377485336' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi088.wmndiv/crt"}]: dispatch 2024-09-17T04:20:32.257 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:31 smithi134 ceph-mon[35201]: from='mgr.? 172.21.15.88:0/1377485336' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T04:20:32.257 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:31 smithi134 ceph-mon[35201]: from='mgr.? 172.21.15.88:0/1377485336' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi088.wmndiv/key"}]: dispatch 2024-09-17T04:20:32.257 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:31 smithi134 ceph-mon[35201]: from='mgr.? 172.21.15.88:0/1377485336' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T04:20:32.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:31 smithi088 ceph-mon[27811]: Standby manager daemon smithi088.wmndiv started 2024-09-17T04:20:32.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:31 smithi088 ceph-mon[27811]: from='mgr.? 172.21.15.88:0/1377485336' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi088.wmndiv/crt"}]: dispatch 2024-09-17T04:20:32.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:31 smithi088 ceph-mon[27811]: from='mgr.? 172.21.15.88:0/1377485336' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T04:20:32.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:31 smithi088 ceph-mon[27811]: from='mgr.? 172.21.15.88:0/1377485336' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi088.wmndiv/key"}]: dispatch 2024-09-17T04:20:32.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:31 smithi088 ceph-mon[27811]: from='mgr.? 172.21.15.88:0/1377485336' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T04:20:33.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:33 smithi134 ceph-mon[35201]: mgrmap e25: smithi134.vwdxcb(active, since 7s), standbys: smithi088.wmndiv 2024-09-17T04:20:33.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:33 smithi134 ceph-mon[35201]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "mgr metadata", "who": "smithi088.wmndiv", "id": "smithi088.wmndiv"}]: dispatch 2024-09-17T04:20:33.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:33 smithi134 ceph-mon[35201]: pgmap v7: 65 pgs: 65 active+clean; 164 MiB data, 700 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 2.6 MiB/s wr, 224 op/s 2024-09-17T04:20:33.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:33 smithi088 ceph-mon[27811]: mgrmap e25: smithi134.vwdxcb(active, since 7s), standbys: smithi088.wmndiv 2024-09-17T04:20:33.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:33 smithi088 ceph-mon[27811]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "mgr metadata", "who": "smithi088.wmndiv", "id": "smithi088.wmndiv"}]: dispatch 2024-09-17T04:20:33.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:33 smithi088 ceph-mon[27811]: pgmap v7: 65 pgs: 65 active+clean; 164 MiB data, 700 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 2.6 MiB/s wr, 224 op/s 2024-09-17T04:20:35.005 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:34 smithi134 ceph-mon[35201]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:20:35.005 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:34 smithi134 ceph-mon[35201]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:20:35.006 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:34 smithi134 ceph-mon[35201]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:20:35.006 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:34 smithi134 ceph-mon[35201]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:20:35.006 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:34 smithi134 ceph-mon[35201]: pgmap v8: 65 pgs: 65 active+clean; 164 MiB data, 700 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 2.0 MiB/s wr, 171 op/s 2024-09-17T04:20:35.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:34 smithi088 ceph-mon[27811]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:20:35.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:34 smithi088 ceph-mon[27811]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:20:35.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:34 smithi088 ceph-mon[27811]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:20:35.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:34 smithi088 ceph-mon[27811]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:20:35.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:34 smithi088 ceph-mon[27811]: pgmap v8: 65 pgs: 65 active+clean; 164 MiB data, 700 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 2.0 MiB/s wr, 171 op/s 2024-09-17T04:20:36.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:36 smithi134 ceph-mon[35201]: pgmap v9: 65 pgs: 65 active+clean; 179 MiB data, 748 MiB used, 536 GiB / 536 GiB avail; 1.9 MiB/s rd, 3.1 MiB/s wr, 320 op/s 2024-09-17T04:20:36.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:36 smithi088 ceph-mon[27811]: pgmap v9: 65 pgs: 65 active+clean; 179 MiB data, 748 MiB used, 536 GiB / 536 GiB avail; 1.9 MiB/s rd, 3.1 MiB/s wr, 320 op/s 2024-09-17T04:20:39.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:38 smithi088 ceph-mon[27811]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:20:39.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:38 smithi088 ceph-mon[27811]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:20:39.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:38 smithi088 ceph-mon[27811]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T04:20:39.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:38 smithi088 ceph-mon[27811]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T04:20:39.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:38 smithi088 ceph-mon[27811]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T04:20:39.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:38 smithi088 ceph-mon[27811]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T04:20:39.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:38 smithi088 ceph-mon[27811]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T04:20:39.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:38 smithi088 ceph-mon[27811]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T04:20:39.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:38 smithi088 ceph-mon[27811]: Adjusting osd_memory_target on smithi134 to 2240M 2024-09-17T04:20:39.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:38 smithi088 ceph-mon[27811]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:20:39.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:38 smithi088 ceph-mon[27811]: pgmap v10: 65 pgs: 65 active+clean; 179 MiB data, 748 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 2.7 MiB/s wr, 280 op/s 2024-09-17T04:20:39.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:38 smithi134 ceph-mon[35201]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:20:39.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:38 smithi134 ceph-mon[35201]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:20:39.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:38 smithi134 ceph-mon[35201]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T04:20:39.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:38 smithi134 ceph-mon[35201]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T04:20:39.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:38 smithi134 ceph-mon[35201]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T04:20:39.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:38 smithi134 ceph-mon[35201]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T04:20:39.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:38 smithi134 ceph-mon[35201]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T04:20:39.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:38 smithi134 ceph-mon[35201]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T04:20:39.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:38 smithi134 ceph-mon[35201]: Adjusting osd_memory_target on smithi134 to 2240M 2024-09-17T04:20:39.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:38 smithi134 ceph-mon[35201]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:20:39.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:38 smithi134 ceph-mon[35201]: pgmap v10: 65 pgs: 65 active+clean; 179 MiB data, 748 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 2.7 MiB/s wr, 280 op/s 2024-09-17T04:20:40.666 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:40 smithi088 ceph-mon[27811]: pgmap v11: 65 pgs: 65 active+clean; 179 MiB data, 748 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 2.7 MiB/s wr, 280 op/s 2024-09-17T04:20:40.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:40 smithi134 ceph-mon[35201]: pgmap v11: 65 pgs: 65 active+clean; 179 MiB data, 748 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 2.7 MiB/s wr, 280 op/s 2024-09-17T04:20:41.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:41 smithi088 ceph-mon[27811]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:20:41.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:41 smithi134 ceph-mon[35201]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:20:42.297 INFO:tasks.workunit.client.1.smithi134.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-17T04:20:42.303 INFO:tasks.workunit.client.1.smithi134.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-17T04:20:42.303 INFO:tasks.workunit.client.1.smithi134.stderr:+ make 2024-09-17T04:20:42.692 INFO:tasks.workunit.client.1.smithi134.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-17T04:20:43.077 INFO:tasks.workunit.client.1.smithi134.stderr:++ readlink -f fsstress 2024-09-17T04:20:43.079 INFO:tasks.workunit.client.1.smithi134.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-17T04:20:43.079 INFO:tasks.workunit.client.1.smithi134.stderr:+ popd 2024-09-17T04:20:43.080 INFO:tasks.workunit.client.1.smithi134.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-17T04:20:43.080 INFO:tasks.workunit.client.1.smithi134.stderr:+ popd 2024-09-17T04:20:43.080 INFO:tasks.workunit.client.1.smithi134.stdout:~/cephtest/mnt.1/client.1/tmp 2024-09-17T04:20:43.081 INFO:tasks.workunit.client.1.smithi134.stderr:++ mktemp -d -p . 2024-09-17T04:20:43.083 INFO:tasks.workunit.client.1.smithi134.stderr:+ T=./tmp.W7orocEuSc 2024-09-17T04:20:43.083 INFO:tasks.workunit.client.1.smithi134.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.W7orocEuSc -l 1 -n 1000 -p 10 -v 2024-09-17T04:20:43.086 INFO:tasks.workunit.client.1.smithi134.stdout:seed = 1726503906 2024-09-17T04:20:43.090 INFO:tasks.workunit.client.1.smithi134.stdout:0/0: read - no filename 2024-09-17T04:20:43.090 INFO:tasks.workunit.client.1.smithi134.stdout:0/1: link - no file 2024-09-17T04:20:43.091 INFO:tasks.workunit.client.1.smithi134.stdout:0/2: read - no filename 2024-09-17T04:20:43.091 INFO:tasks.workunit.client.1.smithi134.stdout:0/3: read - no filename 2024-09-17T04:20:43.092 INFO:tasks.workunit.client.1.smithi134.stdout:1/0: stat - no entries 2024-09-17T04:20:43.096 INFO:tasks.workunit.client.1.smithi134.stdout:2/0: chown . 1 1 2024-09-17T04:20:43.096 INFO:tasks.workunit.client.1.smithi134.stdout:2/1: dread - no filename 2024-09-17T04:20:43.097 INFO:tasks.workunit.client.1.smithi134.stdout:0/4: creat f0 x:0 0 0 2024-09-17T04:20:43.097 INFO:tasks.workunit.client.1.smithi134.stdout:1/1: mknod c0 0 2024-09-17T04:20:43.097 INFO:tasks.workunit.client.1.smithi134.stdout:1/2: write - no filename 2024-09-17T04:20:43.097 INFO:tasks.workunit.client.1.smithi134.stdout:1/3: write - no filename 2024-09-17T04:20:43.097 INFO:tasks.workunit.client.1.smithi134.stdout:1/4: chown c0 3 1 2024-09-17T04:20:43.098 INFO:tasks.workunit.client.1.smithi134.stdout:1/5: dread - no filename 2024-09-17T04:20:43.098 INFO:tasks.workunit.client.1.smithi134.stdout:1/6: chown c0 1 1 2024-09-17T04:20:43.099 INFO:tasks.workunit.client.1.smithi134.stdout:3/0: write - no filename 2024-09-17T04:20:43.099 INFO:tasks.workunit.client.1.smithi134.stdout:3/1: rename - no filename 2024-09-17T04:20:43.101 INFO:tasks.workunit.client.1.smithi134.stdout:0/5: mknod c1 0 2024-09-17T04:20:43.101 INFO:tasks.workunit.client.1.smithi134.stdout:0/6: dread - f0 zero size 2024-09-17T04:20:43.101 INFO:tasks.workunit.client.1.smithi134.stdout:0/7: chown f0 1317197257 1 2024-09-17T04:20:43.102 INFO:tasks.workunit.client.1.smithi134.stdout:0/8: read - f0 zero size 2024-09-17T04:20:43.103 INFO:tasks.workunit.client.1.smithi134.stdout:0/9: write f0 [542310,115390] 0 2024-09-17T04:20:43.105 INFO:tasks.workunit.client.1.smithi134.stdout:2/2: creat f0 x:0 0 0 2024-09-17T04:20:43.112 INFO:tasks.workunit.client.1.smithi134.stdout:2/3: chown f0 1 1 2024-09-17T04:20:43.112 INFO:tasks.workunit.client.1.smithi134.stdout:3/2: creat f0 x:0 0 0 2024-09-17T04:20:43.112 INFO:tasks.workunit.client.1.smithi134.stdout:5/0: readlink - no filename 2024-09-17T04:20:43.112 INFO:tasks.workunit.client.1.smithi134.stdout:5/1: dwrite - no filename 2024-09-17T04:20:43.112 INFO:tasks.workunit.client.1.smithi134.stdout:1/7: link c0 c1 0 2024-09-17T04:20:43.112 INFO:tasks.workunit.client.1.smithi134.stdout:1/8: dwrite - no filename 2024-09-17T04:20:43.112 INFO:tasks.workunit.client.1.smithi134.stdout:1/9: write - no filename 2024-09-17T04:20:43.113 INFO:tasks.workunit.client.1.smithi134.stdout:1/10: dwrite - no filename 2024-09-17T04:20:43.113 INFO:tasks.workunit.client.1.smithi134.stdout:4/0: mkdir d0 0 2024-09-17T04:20:43.113 INFO:tasks.workunit.client.1.smithi134.stdout:4/1: dread - no filename 2024-09-17T04:20:43.113 INFO:tasks.workunit.client.1.smithi134.stdout:4/2: readlink - no filename 2024-09-17T04:20:43.115 INFO:tasks.workunit.client.1.smithi134.stdout:6/0: dread - no filename 2024-09-17T04:20:43.115 INFO:tasks.workunit.client.1.smithi134.stdout:6/1: link - no file 2024-09-17T04:20:43.115 INFO:tasks.workunit.client.1.smithi134.stdout:6/2: dwrite - no filename 2024-09-17T04:20:43.115 INFO:tasks.workunit.client.1.smithi134.stdout:6/3: stat - no entries 2024-09-17T04:20:43.118 INFO:tasks.workunit.client.1.smithi134.stdout:5/2: mkdir d0 0 2024-09-17T04:20:43.118 INFO:tasks.workunit.client.1.smithi134.stdout:5/3: write - no filename 2024-09-17T04:20:43.118 INFO:tasks.workunit.client.1.smithi134.stdout:5/4: write - no filename 2024-09-17T04:20:43.118 INFO:tasks.workunit.client.1.smithi134.stdout:5/5: rename d0 to d0/d1 22 2024-09-17T04:20:43.118 INFO:tasks.workunit.client.1.smithi134.stdout:5/6: fdatasync - no filename 2024-09-17T04:20:43.118 INFO:tasks.workunit.client.1.smithi134.stdout:5/7: link - no file 2024-09-17T04:20:43.118 INFO:tasks.workunit.client.1.smithi134.stdout:5/8: dwrite - no filename 2024-09-17T04:20:43.119 INFO:tasks.workunit.client.1.smithi134.stdout:1/11: stat c1 0 2024-09-17T04:20:43.120 INFO:tasks.workunit.client.1.smithi134.stdout:8/0: write - no filename 2024-09-17T04:20:43.120 INFO:tasks.workunit.client.1.smithi134.stdout:8/1: rmdir - no directory 2024-09-17T04:20:43.122 INFO:tasks.workunit.client.1.smithi134.stdout:7/0: mkdir d0 0 2024-09-17T04:20:43.122 INFO:tasks.workunit.client.1.smithi134.stdout:7/1: read - no filename 2024-09-17T04:20:43.122 INFO:tasks.workunit.client.1.smithi134.stdout:7/2: fdatasync - no filename 2024-09-17T04:20:43.122 INFO:tasks.workunit.client.1.smithi134.stdout:7/3: chown d0 5 1 2024-09-17T04:20:43.123 INFO:tasks.workunit.client.1.smithi134.stdout:7/4: rename d0 to d0/d1 22 2024-09-17T04:20:43.123 INFO:tasks.workunit.client.1.smithi134.stdout:7/5: dwrite - no filename 2024-09-17T04:20:43.123 INFO:tasks.workunit.client.1.smithi134.stdout:4/3: creat d0/f1 x:0 0 0 2024-09-17T04:20:43.123 INFO:tasks.workunit.client.1.smithi134.stdout:4/4: chown d0 127 1 2024-09-17T04:20:43.123 INFO:tasks.workunit.client.1.smithi134.stdout:4/5: chown d0 123 1 2024-09-17T04:20:43.125 INFO:tasks.workunit.client.1.smithi134.stdout:1/12: mknod c2 0 2024-09-17T04:20:43.128 INFO:tasks.workunit.client.1.smithi134.stdout:6/4: symlink l0 0 2024-09-17T04:20:43.129 INFO:tasks.workunit.client.1.smithi134.stdout:6/5: stat l0 0 2024-09-17T04:20:43.129 INFO:tasks.workunit.client.1.smithi134.stdout:6/6: truncate - no filename 2024-09-17T04:20:43.129 INFO:tasks.workunit.client.1.smithi134.stdout:6/7: fdatasync - no filename 2024-09-17T04:20:43.129 INFO:tasks.workunit.client.1.smithi134.stdout:5/9: creat d0/f2 x:0 0 0 2024-09-17T04:20:43.130 INFO:tasks.workunit.client.1.smithi134.stdout:1/13: mknod c3 0 2024-09-17T04:20:43.130 INFO:tasks.workunit.client.1.smithi134.stdout:1/14: rmdir - no directory 2024-09-17T04:20:43.131 INFO:tasks.workunit.client.1.smithi134.stdout:5/10: write d0/f2 [841297,87753] 0 2024-09-17T04:20:43.137 INFO:tasks.workunit.client.1.smithi134.stdout:8/2: getdents . 0 2024-09-17T04:20:43.137 INFO:tasks.workunit.client.1.smithi134.stdout:8/3: truncate - no filename 2024-09-17T04:20:43.137 INFO:tasks.workunit.client.1.smithi134.stdout:8/4: dwrite - no filename 2024-09-17T04:20:43.137 INFO:tasks.workunit.client.1.smithi134.stdout:5/11: chown d0 910912440 1 2024-09-17T04:20:43.137 INFO:tasks.workunit.client.1.smithi134.stdout:4/6: dwrite d0/f1 [0,4194304] 0 2024-09-17T04:20:43.137 INFO:tasks.workunit.client.1.smithi134.stdout:7/6: symlink d0/l2 0 2024-09-17T04:20:43.137 INFO:tasks.workunit.client.1.smithi134.stdout:7/7: readlink d0/l2 0 2024-09-17T04:20:43.137 INFO:tasks.workunit.client.1.smithi134.stdout:7/8: truncate - no filename 2024-09-17T04:20:43.137 INFO:tasks.workunit.client.1.smithi134.stdout:7/9: readlink d0/l2 0 2024-09-17T04:20:43.137 INFO:tasks.workunit.client.1.smithi134.stdout:7/10: chown d0 68 1 2024-09-17T04:20:43.137 INFO:tasks.workunit.client.1.smithi134.stdout:7/11: fsync - no filename 2024-09-17T04:20:43.137 INFO:tasks.workunit.client.1.smithi134.stdout:7/12: fdatasync - no filename 2024-09-17T04:20:43.138 INFO:tasks.workunit.client.1.smithi134.stdout:7/13: dread - no filename 2024-09-17T04:20:43.138 INFO:tasks.workunit.client.1.smithi134.stdout:6/8: mknod c1 0 2024-09-17T04:20:43.138 INFO:tasks.workunit.client.1.smithi134.stdout:6/9: write - no filename 2024-09-17T04:20:43.138 INFO:tasks.workunit.client.1.smithi134.stdout:1/15: mknod c4 0 2024-09-17T04:20:43.139 INFO:tasks.workunit.client.1.smithi134.stdout:1/16: dread - no filename 2024-09-17T04:20:43.139 INFO:tasks.workunit.client.1.smithi134.stdout:1/17: fdatasync - no filename 2024-09-17T04:20:43.139 INFO:tasks.workunit.client.1.smithi134.stdout:9/0: creat f0 x:0 0 0 2024-09-17T04:20:43.141 INFO:tasks.workunit.client.1.smithi134.stdout:7/14: rmdir d0 39 2024-09-17T04:20:43.141 INFO:tasks.workunit.client.1.smithi134.stdout:4/7: creat d0/f2 x:0 0 0 2024-09-17T04:20:43.141 INFO:tasks.workunit.client.1.smithi134.stdout:7/15: dread - no filename 2024-09-17T04:20:43.141 INFO:tasks.workunit.client.1.smithi134.stdout:7/16: dread - no filename 2024-09-17T04:20:43.142 INFO:tasks.workunit.client.1.smithi134.stdout:6/10: mknod c2 0 2024-09-17T04:20:43.142 INFO:tasks.workunit.client.1.smithi134.stdout:9/1: write f0 [915047,18965] 0 2024-09-17T04:20:43.144 INFO:tasks.workunit.client.1.smithi134.stdout:8/5: creat f0 x:0 0 0 2024-09-17T04:20:43.145 INFO:tasks.workunit.client.1.smithi134.stdout:6/11: stat c1 0 2024-09-17T04:20:43.145 INFO:tasks.workunit.client.1.smithi134.stdout:6/12: dread - no filename 2024-09-17T04:20:43.145 INFO:tasks.workunit.client.1.smithi134.stdout:6/13: truncate - no filename 2024-09-17T04:20:43.145 INFO:tasks.workunit.client.1.smithi134.stdout:4/8: read - d0/f2 zero size 2024-09-17T04:20:43.145 INFO:tasks.workunit.client.1.smithi134.stdout:9/2: chown f0 97 1 2024-09-17T04:20:43.145 INFO:tasks.workunit.client.1.smithi134.stdout:9/3: readlink - no filename 2024-09-17T04:20:43.146 INFO:tasks.workunit.client.1.smithi134.stdout:8/6: dread - f0 zero size 2024-09-17T04:20:43.147 INFO:tasks.workunit.client.1.smithi134.stdout:5/12: dwrite d0/f2 [0,4194304] 0 2024-09-17T04:20:43.148 INFO:tasks.workunit.client.1.smithi134.stdout:6/14: chown c1 1305857 1 2024-09-17T04:20:43.148 INFO:tasks.workunit.client.1.smithi134.stdout:8/7: dread - f0 zero size 2024-09-17T04:20:43.148 INFO:tasks.workunit.client.1.smithi134.stdout:6/15: dwrite - no filename 2024-09-17T04:20:43.148 INFO:tasks.workunit.client.1.smithi134.stdout:6/16: read - no filename 2024-09-17T04:20:43.148 INFO:tasks.workunit.client.1.smithi134.stdout:6/17: truncate - no filename 2024-09-17T04:20:43.148 INFO:tasks.workunit.client.1.smithi134.stdout:6/18: dwrite - no filename 2024-09-17T04:20:43.149 INFO:tasks.workunit.client.1.smithi134.stdout:9/4: symlink l1 0 2024-09-17T04:20:43.149 INFO:tasks.workunit.client.1.smithi134.stdout:4/9: truncate d0/f2 516861 0 2024-09-17T04:20:43.149 INFO:tasks.workunit.client.1.smithi134.stdout:9/5: stat f0 0 2024-09-17T04:20:43.150 INFO:tasks.workunit.client.1.smithi134.stdout:9/6: fdatasync f0 0 2024-09-17T04:20:43.150 INFO:tasks.workunit.client.1.smithi134.stdout:5/13: mknod d0/c3 0 2024-09-17T04:20:43.151 INFO:tasks.workunit.client.1.smithi134.stdout:8/8: mknod c1 0 2024-09-17T04:20:43.153 INFO:tasks.workunit.client.1.smithi134.stdout:8/9: write f0 [849248,19918] 0 2024-09-17T04:20:43.154 INFO:tasks.workunit.client.1.smithi134.stdout:6/19: creat f3 x:0 0 0 2024-09-17T04:20:43.155 INFO:tasks.workunit.client.1.smithi134.stdout:4/10: symlink d0/l3 0 2024-09-17T04:20:43.156 INFO:tasks.workunit.client.1.smithi134.stdout:5/14: rmdir d0 39 2024-09-17T04:20:43.158 INFO:tasks.workunit.client.1.smithi134.stdout:8/10: creat f2 x:0 0 0 2024-09-17T04:20:43.161 INFO:tasks.workunit.client.1.smithi134.stdout:6/20: creat f4 x:0 0 0 2024-09-17T04:20:43.162 INFO:tasks.workunit.client.1.smithi134.stdout:9/7: dwrite f0 [0,4194304] 0 2024-09-17T04:20:43.168 INFO:tasks.workunit.client.1.smithi134.stdout:4/11: dwrite d0/f2 [0,4194304] 0 2024-09-17T04:20:43.168 INFO:tasks.workunit.client.1.smithi134.stdout:9/8: mkdir d2 0 2024-09-17T04:20:43.169 INFO:tasks.workunit.client.1.smithi134.stdout:9/9: chown f0 287 1 2024-09-17T04:20:43.170 INFO:tasks.workunit.client.1.smithi134.stdout:6/21: link c1 c5 0 2024-09-17T04:20:43.170 INFO:tasks.workunit.client.1.smithi134.stdout:6/22: chown f3 2 1 2024-09-17T04:20:43.171 INFO:tasks.workunit.client.1.smithi134.stdout:4/12: rmdir d0 39 2024-09-17T04:20:43.176 INFO:tasks.workunit.client.1.smithi134.stdout:9/10: mknod d2/c3 0 2024-09-17T04:20:43.181 INFO:tasks.workunit.client.1.smithi134.stdout:9/11: dread f0 [0,4194304] 0 2024-09-17T04:20:43.181 INFO:tasks.workunit.client.1.smithi134.stdout:9/12: chown f0 172559855 1 2024-09-17T04:20:43.188 INFO:tasks.workunit.client.1.smithi134.stdout:9/13: dwrite f0 [0,4194304] 0 2024-09-17T04:20:43.194 INFO:tasks.workunit.client.1.smithi134.stdout:9/14: dwrite f0 [0,4194304] 0 2024-09-17T04:20:43.195 INFO:tasks.workunit.client.1.smithi134.stdout:9/15: write f0 [2815916,10398] 0 2024-09-17T04:20:43.196 INFO:tasks.workunit.client.1.smithi134.stdout:9/16: read f0 [445061,4778] 0 2024-09-17T04:20:43.196 INFO:tasks.workunit.client.1.smithi134.stdout:9/17: write f0 [3452531,96472] 0 2024-09-17T04:20:43.202 INFO:tasks.workunit.client.1.smithi134.stdout:9/18: symlink d2/l4 0 2024-09-17T04:20:43.351 INFO:tasks.workunit.client.1.smithi134.stdout:9/19: mkdir d2/d5 0 2024-09-17T04:20:43.351 INFO:tasks.workunit.client.1.smithi134.stdout:9/20: stat d2/d5 0 2024-09-17T04:20:43.351 INFO:tasks.workunit.client.1.smithi134.stdout:9/21: symlink d2/d5/l6 0 2024-09-17T04:20:43.351 INFO:tasks.workunit.client.1.smithi134.stdout:9/22: mkdir d2/d7 0 2024-09-17T04:20:43.351 INFO:tasks.workunit.client.1.smithi134.stdout:9/23: dwrite f0 [0,4194304] 0 2024-09-17T04:20:43.351 INFO:tasks.workunit.client.1.smithi134.stdout:9/24: unlink d2/d5/l6 0 2024-09-17T04:20:43.351 INFO:tasks.workunit.client.1.smithi134.stdout:9/25: mkdir d2/d5/d8 0 2024-09-17T04:20:43.351 INFO:tasks.workunit.client.1.smithi134.stdout:9/26: getdents d2/d7 0 2024-09-17T04:20:43.351 INFO:tasks.workunit.client.1.smithi134.stdout:9/27: mkdir d2/d5/d9 0 2024-09-17T04:20:43.351 INFO:tasks.workunit.client.1.smithi134.stdout:9/28: unlink f0 0 2024-09-17T04:20:43.352 INFO:tasks.workunit.client.1.smithi134.stdout:9/29: mkdir d2/d5/d8/da 0 2024-09-17T04:20:43.448 INFO:tasks.workunit.client.1.smithi134.stdout:0/10: fsync f0 0 2024-09-17T04:20:43.457 INFO:tasks.workunit.client.1.smithi134.stdout:3/3: fsync f0 0 2024-09-17T04:20:43.464 INFO:tasks.workunit.client.1.smithi134.stdout:5/15: stat d0/f2 0 2024-09-17T04:20:43.483 INFO:tasks.workunit.client.1.smithi134.stdout:8/11: fsync f0 0 2024-09-17T04:20:43.556 INFO:tasks.workunit.client.1.smithi134.stdout:9/30: getdents d2/d5/d8 0 2024-09-17T04:20:43.556 INFO:tasks.workunit.client.1.smithi134.stdout:9/31: write - no filename 2024-09-17T04:20:43.557 INFO:tasks.workunit.client.1.smithi134.stdout:9/32: dwrite - no filename 2024-09-17T04:20:43.557 INFO:tasks.workunit.client.1.smithi134.stdout:9/33: dwrite - no filename 2024-09-17T04:20:43.557 INFO:tasks.workunit.client.1.smithi134.stdout:6/23: getdents . 0 2024-09-17T04:20:43.557 INFO:tasks.workunit.client.1.smithi134.stdout:9/34: stat d2/d5 0 2024-09-17T04:20:43.557 INFO:tasks.workunit.client.1.smithi134.stdout:6/24: chown f4 6652 1 2024-09-17T04:20:43.557 INFO:tasks.workunit.client.1.smithi134.stdout:6/25: fsync f4 0 2024-09-17T04:20:43.557 INFO:tasks.workunit.client.1.smithi134.stdout:9/35: chown d2/d5/d8 1882588 1 2024-09-17T04:20:43.558 INFO:tasks.workunit.client.1.smithi134.stdout:9/36: dread - no filename 2024-09-17T04:20:43.595 INFO:tasks.workunit.client.1.smithi134.stdout:3/4: mknod c1 0 2024-09-17T04:20:43.596 INFO:tasks.workunit.client.1.smithi134.stdout:4/13: rename d0/l3 to d0/l4 0 2024-09-17T04:20:43.596 INFO:tasks.workunit.client.1.smithi134.stdout:5/16: creat d0/f4 x:0 0 0 2024-09-17T04:20:43.597 INFO:tasks.workunit.client.1.smithi134.stdout:7/17: mknod d0/c3 0 2024-09-17T04:20:43.597 INFO:tasks.workunit.client.1.smithi134.stdout:7/18: fdatasync - no filename 2024-09-17T04:20:43.599 INFO:tasks.workunit.client.1.smithi134.stdout:8/12: unlink c1 0 2024-09-17T04:20:43.600 INFO:tasks.workunit.client.1.smithi134.stdout:5/17: dread d0/f2 [0,4194304] 0 2024-09-17T04:20:43.602 INFO:tasks.workunit.client.1.smithi134.stdout:3/5: symlink l2 0 2024-09-17T04:20:43.602 INFO:tasks.workunit.client.1.smithi134.stdout:3/6: chown l2 0 1 2024-09-17T04:20:43.602 INFO:tasks.workunit.client.1.smithi134.stdout:4/14: creat d0/f5 x:0 0 0 2024-09-17T04:20:43.604 INFO:tasks.workunit.client.1.smithi134.stdout:8/13: dread f0 [0,4194304] 0 2024-09-17T04:20:43.604 INFO:tasks.workunit.client.1.smithi134.stdout:8/14: readlink - no filename 2024-09-17T04:20:43.606 INFO:tasks.workunit.client.1.smithi134.stdout:5/18: dread d0/f2 [0,4194304] 0 2024-09-17T04:20:43.606 INFO:tasks.workunit.client.1.smithi134.stdout:7/19: unlink d0/c3 0 2024-09-17T04:20:43.608 INFO:tasks.workunit.client.1.smithi134.stdout:6/26: getdents . 0 2024-09-17T04:20:43.609 INFO:tasks.workunit.client.1.smithi134.stdout:0/11: link c1 c2 0 2024-09-17T04:20:43.610 INFO:tasks.workunit.client.1.smithi134.stdout:3/7: creat f3 x:0 0 0 2024-09-17T04:20:43.611 INFO:tasks.workunit.client.1.smithi134.stdout:3/8: dread - f3 zero size 2024-09-17T04:20:43.611 INFO:tasks.workunit.client.1.smithi134.stdout:3/9: read - f0 zero size 2024-09-17T04:20:43.612 INFO:tasks.workunit.client.1.smithi134.stdout:4/15: dwrite d0/f5 [0,4194304] 0 2024-09-17T04:20:43.612 INFO:tasks.workunit.client.1.smithi134.stdout:8/15: creat f3 x:0 0 0 2024-09-17T04:20:43.612 INFO:tasks.workunit.client.1.smithi134.stdout:3/10: read - f0 zero size 2024-09-17T04:20:43.613 INFO:tasks.workunit.client.1.smithi134.stdout:8/16: dread - f2 zero size 2024-09-17T04:20:43.613 INFO:tasks.workunit.client.1.smithi134.stdout:8/17: fsync f2 0 2024-09-17T04:20:43.614 INFO:tasks.workunit.client.1.smithi134.stdout:5/19: creat d0/f5 x:0 0 0 2024-09-17T04:20:43.615 INFO:tasks.workunit.client.1.smithi134.stdout:9/37: getdents d2/d5/d8 0 2024-09-17T04:20:43.619 INFO:tasks.workunit.client.1.smithi134.stdout:6/27: creat f6 x:0 0 0 2024-09-17T04:20:43.619 INFO:tasks.workunit.client.1.smithi134.stdout:7/20: mkdir d0/d4 0 2024-09-17T04:20:43.621 INFO:tasks.workunit.client.1.smithi134.stdout:8/18: dwrite f2 [0,4194304] 0 2024-09-17T04:20:43.622 INFO:tasks.workunit.client.1.smithi134.stdout:8/19: chown f0 12 1 2024-09-17T04:20:43.623 INFO:tasks.workunit.client.1.smithi134.stdout:8/20: truncate f0 1810344 0 2024-09-17T04:20:43.623 INFO:tasks.workunit.client.1.smithi134.stdout:0/12: creat f3 x:0 0 0 2024-09-17T04:20:43.623 INFO:tasks.workunit.client.1.smithi134.stdout:0/13: rmdir - no directory 2024-09-17T04:20:43.625 INFO:tasks.workunit.client.1.smithi134.stdout:4/16: creat d0/f6 x:0 0 0 2024-09-17T04:20:43.628 INFO:tasks.workunit.client.1.smithi134.stdout:9/38: creat d2/d5/fb x:0 0 0 2024-09-17T04:20:43.629 INFO:tasks.workunit.client.1.smithi134.stdout:9/39: write d2/d5/fb [923725,35470] 0 2024-09-17T04:20:43.631 INFO:tasks.workunit.client.1.smithi134.stdout:6/28: rename f6 to f7 0 2024-09-17T04:20:43.632 INFO:tasks.workunit.client.1.smithi134.stdout:6/29: dread - f4 zero size 2024-09-17T04:20:43.635 INFO:tasks.workunit.client.1.smithi134.stdout:8/21: mkdir d4 0 2024-09-17T04:20:43.637 INFO:tasks.workunit.client.1.smithi134.stdout:4/17: symlink d0/l7 0 2024-09-17T04:20:43.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:43 smithi088 ceph-mon[27811]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:20:43.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:43 smithi088 ceph-mon[27811]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:20:43.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:43 smithi088 ceph-mon[27811]: pgmap v12: 65 pgs: 65 active+clean; 199 MiB data, 814 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 4.5 MiB/s wr, 428 op/s 2024-09-17T04:20:43.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:43 smithi088 ceph-mon[27811]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:20:43.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:43 smithi088 ceph-mon[27811]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:20:43.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:43 smithi088 ceph-mon[27811]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T04:20:43.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:43 smithi088 ceph-mon[27811]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T04:20:43.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:43 smithi088 ceph-mon[27811]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T04:20:43.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:43 smithi088 ceph-mon[27811]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T04:20:43.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:43 smithi088 ceph-mon[27811]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T04:20:43.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:43 smithi088 ceph-mon[27811]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T04:20:43.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:43 smithi088 ceph-mon[27811]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:20:43.639 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:43 smithi088 ceph-mon[27811]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:20:43.639 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:43 smithi088 ceph-mon[27811]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:20:43.639 INFO:tasks.workunit.client.1.smithi134.stdout:9/40: dwrite d2/d5/fb [0,4194304] 0 2024-09-17T04:20:43.639 INFO:tasks.workunit.client.1.smithi134.stdout:4/18: chown d0/f2 6433 1 2024-09-17T04:20:43.640 INFO:tasks.workunit.client.1.smithi134.stdout:4/19: write d0/f6 [966262,28628] 0 2024-09-17T04:20:43.642 INFO:tasks.workunit.client.1.smithi134.stdout:6/30: creat f8 x:0 0 0 2024-09-17T04:20:43.645 INFO:tasks.workunit.client.1.smithi134.stdout:6/31: write f8 [684345,92890] 0 2024-09-17T04:20:43.645 INFO:tasks.workunit.client.1.smithi134.stdout:0/14: truncate f0 109564 0 2024-09-17T04:20:43.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:43 smithi134 ceph-mon[35201]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:20:43.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:43 smithi134 ceph-mon[35201]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:20:43.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:43 smithi134 ceph-mon[35201]: pgmap v12: 65 pgs: 65 active+clean; 199 MiB data, 814 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 4.5 MiB/s wr, 428 op/s 2024-09-17T04:20:43.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:43 smithi134 ceph-mon[35201]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:20:43.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:43 smithi134 ceph-mon[35201]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:20:43.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:43 smithi134 ceph-mon[35201]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T04:20:43.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:43 smithi134 ceph-mon[35201]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T04:20:43.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:43 smithi134 ceph-mon[35201]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T04:20:43.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:43 smithi134 ceph-mon[35201]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T04:20:43.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:43 smithi134 ceph-mon[35201]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T04:20:43.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:43 smithi134 ceph-mon[35201]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T04:20:43.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:43 smithi134 ceph-mon[35201]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:20:43.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:43 smithi134 ceph-mon[35201]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:20:43.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:43 smithi134 ceph-mon[35201]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:20:43.647 INFO:tasks.workunit.client.1.smithi134.stdout:9/41: dread d2/d5/fb [0,4194304] 0 2024-09-17T04:20:43.648 INFO:tasks.workunit.client.1.smithi134.stdout:6/32: dread - f7 zero size 2024-09-17T04:20:43.648 INFO:tasks.workunit.client.1.smithi134.stdout:6/33: rmdir - no directory 2024-09-17T04:20:43.648 INFO:tasks.workunit.client.1.smithi134.stdout:7/21: link d0/l2 d0/l5 0 2024-09-17T04:20:43.649 INFO:tasks.workunit.client.1.smithi134.stdout:6/34: write f4 [848390,54910] 0 2024-09-17T04:20:43.652 INFO:tasks.workunit.client.1.smithi134.stdout:0/15: creat f4 x:0 0 0 2024-09-17T04:20:43.653 INFO:tasks.workunit.client.1.smithi134.stdout:4/20: dwrite d0/f6 [0,4194304] 0 2024-09-17T04:20:43.657 INFO:tasks.workunit.client.1.smithi134.stdout:7/22: chown d0/l2 102702 1 2024-09-17T04:20:43.659 INFO:tasks.workunit.client.1.smithi134.stdout:9/42: getdents d2/d7 0 2024-09-17T04:20:43.659 INFO:tasks.workunit.client.1.smithi134.stdout:6/35: dwrite f4 [0,4194304] 0 2024-09-17T04:20:43.660 INFO:tasks.workunit.client.1.smithi134.stdout:9/43: stat l1 0 2024-09-17T04:20:43.661 INFO:tasks.workunit.client.1.smithi134.stdout:0/16: chown c2 1780 1 2024-09-17T04:20:43.662 INFO:tasks.workunit.client.1.smithi134.stdout:0/17: stat f0 0 2024-09-17T04:20:43.663 INFO:tasks.workunit.client.1.smithi134.stdout:9/44: write d2/d5/fb [1625868,79991] 0 2024-09-17T04:20:43.671 INFO:tasks.workunit.client.1.smithi134.stdout:0/18: link c2 c5 0 2024-09-17T04:20:43.674 INFO:tasks.workunit.client.1.smithi134.stdout:9/45: mkdir d2/d5/d9/dc 0 2024-09-17T04:20:43.678 INFO:tasks.workunit.client.1.smithi134.stdout:9/46: link d2/d5/fb d2/d5/d8/da/fd 0 2024-09-17T04:20:43.680 INFO:tasks.workunit.client.1.smithi134.stdout:9/47: mknod d2/d5/d8/ce 0 2024-09-17T04:20:43.684 INFO:tasks.workunit.client.1.smithi134.stdout:9/48: dread d2/d5/fb [0,4194304] 0 2024-09-17T04:20:43.686 INFO:tasks.workunit.client.1.smithi134.stdout:9/49: write d2/d5/d8/da/fd [795227,54947] 0 2024-09-17T04:20:43.692 INFO:tasks.workunit.client.1.smithi134.stdout:9/50: dwrite d2/d5/d8/da/fd [0,4194304] 0 2024-09-17T04:20:43.694 INFO:tasks.workunit.client.1.smithi134.stdout:9/51: mkdir d2/d5/d9/df 0 2024-09-17T04:20:43.695 INFO:tasks.workunit.client.1.smithi134.stdout:9/52: chown d2/d5/d9 30630 1 2024-09-17T04:20:43.698 INFO:tasks.workunit.client.1.smithi134.stdout:9/53: rename l1 to d2/d5/d8/da/l10 0 2024-09-17T04:20:43.702 INFO:tasks.workunit.client.1.smithi134.stdout:9/54: creat d2/d5/d9/f11 x:0 0 0 2024-09-17T04:20:43.846 INFO:tasks.workunit.client.1.smithi134.stdout:8/22: fsync f3 0 2024-09-17T04:20:43.846 INFO:tasks.workunit.client.1.smithi134.stdout:8/23: stat f0 0 2024-09-17T04:20:43.847 INFO:tasks.workunit.client.1.smithi134.stdout:5/20: fsync d0/f5 0 2024-09-17T04:20:43.851 INFO:tasks.workunit.client.1.smithi134.stdout:4/21: write d0/f5 [4403659,128884] 0 2024-09-17T04:20:43.855 INFO:tasks.workunit.client.1.smithi134.stdout:8/24: dwrite f2 [0,4194304] 0 2024-09-17T04:20:43.858 INFO:tasks.workunit.client.1.smithi134.stdout:6/36: getdents . 0 2024-09-17T04:20:43.859 INFO:tasks.workunit.client.1.smithi134.stdout:5/21: dwrite d0/f2 [0,4194304] 0 2024-09-17T04:20:43.860 INFO:tasks.workunit.client.1.smithi134.stdout:6/37: truncate f7 871918 0 2024-09-17T04:20:43.863 INFO:tasks.workunit.client.1.smithi134.stdout:5/22: mkdir d0/d6 0 2024-09-17T04:20:43.864 INFO:tasks.workunit.client.1.smithi134.stdout:4/22: dwrite d0/f5 [0,4194304] 0 2024-09-17T04:20:43.870 INFO:tasks.workunit.client.1.smithi134.stdout:4/23: readlink d0/l4 0 2024-09-17T04:20:43.871 INFO:tasks.workunit.client.1.smithi134.stdout:6/38: dread f4 [0,4194304] 0 2024-09-17T04:20:43.871 INFO:tasks.workunit.client.1.smithi134.stdout:6/39: rmdir - no directory 2024-09-17T04:20:43.873 INFO:tasks.workunit.client.1.smithi134.stdout:8/25: dread f0 [0,4194304] 0 2024-09-17T04:20:43.874 INFO:tasks.workunit.client.1.smithi134.stdout:8/26: dread - f3 zero size 2024-09-17T04:20:43.875 INFO:tasks.workunit.client.1.smithi134.stdout:6/40: write f7 [1432148,97295] 0 2024-09-17T04:20:43.876 INFO:tasks.workunit.client.1.smithi134.stdout:5/23: dwrite d0/f4 [0,4194304] 0 2024-09-17T04:20:43.878 INFO:tasks.workunit.client.1.smithi134.stdout:5/24: truncate d0/f5 697483 0 2024-09-17T04:20:43.880 INFO:tasks.workunit.client.1.smithi134.stdout:9/55: readlink d2/d5/d8/da/l10 0 2024-09-17T04:20:43.881 INFO:tasks.workunit.client.1.smithi134.stdout:5/25: rmdir d0 39 2024-09-17T04:20:43.885 INFO:tasks.workunit.client.1.smithi134.stdout:9/56: symlink d2/l12 0 2024-09-17T04:20:43.886 INFO:tasks.workunit.client.1.smithi134.stdout:8/27: dwrite f2 [4194304,4194304] 0 2024-09-17T04:20:43.887 INFO:tasks.workunit.client.1.smithi134.stdout:5/26: truncate d0/f5 971904 0 2024-09-17T04:20:43.887 INFO:tasks.workunit.client.1.smithi134.stdout:9/57: chown d2/d5/d9 587064 1 2024-09-17T04:20:43.889 INFO:tasks.workunit.client.1.smithi134.stdout:5/27: read d0/f2 [703508,74003] 0 2024-09-17T04:20:43.889 INFO:tasks.workunit.client.1.smithi134.stdout:6/41: dwrite f4 [0,4194304] 0 2024-09-17T04:20:43.892 INFO:tasks.workunit.client.1.smithi134.stdout:9/58: creat d2/d5/f13 x:0 0 0 2024-09-17T04:20:43.895 INFO:tasks.workunit.client.1.smithi134.stdout:8/28: symlink d4/l5 0 2024-09-17T04:20:43.898 INFO:tasks.workunit.client.1.smithi134.stdout:5/28: symlink d0/l7 0 2024-09-17T04:20:43.898 INFO:tasks.workunit.client.1.smithi134.stdout:4/24: fdatasync d0/f5 0 2024-09-17T04:20:43.900 INFO:tasks.workunit.client.1.smithi134.stdout:6/42: unlink f3 0 2024-09-17T04:20:43.900 INFO:tasks.workunit.client.1.smithi134.stdout:9/59: dread d2/d5/fb [0,4194304] 0 2024-09-17T04:20:43.900 INFO:tasks.workunit.client.1.smithi134.stdout:6/43: fsync f8 0 2024-09-17T04:20:43.901 INFO:tasks.workunit.client.1.smithi134.stdout:9/60: chown d2/d7 298 1 2024-09-17T04:20:43.903 INFO:tasks.workunit.client.1.smithi134.stdout:9/61: dread - d2/d5/f13 zero size 2024-09-17T04:20:43.904 INFO:tasks.workunit.client.1.smithi134.stdout:9/62: rename d2/d5/d8 to d2/d5/d8/da/d14 22 2024-09-17T04:20:43.906 INFO:tasks.workunit.client.1.smithi134.stdout:9/63: dread - d2/d5/f13 zero size 2024-09-17T04:20:43.907 INFO:tasks.workunit.client.1.smithi134.stdout:4/25: dwrite d0/f1 [0,4194304] 0 2024-09-17T04:20:43.908 INFO:tasks.workunit.client.1.smithi134.stdout:9/64: stat d2/d5/d8/ce 0 2024-09-17T04:20:43.914 INFO:tasks.workunit.client.1.smithi134.stdout:6/44: creat f9 x:0 0 0 2024-09-17T04:20:43.914 INFO:tasks.workunit.client.1.smithi134.stdout:8/29: dwrite f0 [0,4194304] 0 2024-09-17T04:20:43.920 INFO:tasks.workunit.client.1.smithi134.stdout:4/26: symlink d0/l8 0 2024-09-17T04:20:43.920 INFO:tasks.workunit.client.1.smithi134.stdout:4/27: stat d0/l8 0 2024-09-17T04:20:43.922 INFO:tasks.workunit.client.1.smithi134.stdout:9/65: fsync d2/d5/fb 0 2024-09-17T04:20:43.927 INFO:tasks.workunit.client.1.smithi134.stdout:6/45: symlink la 0 2024-09-17T04:20:43.929 INFO:tasks.workunit.client.1.smithi134.stdout:8/30: creat d4/f6 x:0 0 0 2024-09-17T04:20:43.930 INFO:tasks.workunit.client.1.smithi134.stdout:8/31: write d4/f6 [1014568,92510] 0 2024-09-17T04:20:43.933 INFO:tasks.workunit.client.1.smithi134.stdout:4/28: symlink d0/l9 0 2024-09-17T04:20:43.933 INFO:tasks.workunit.client.1.smithi134.stdout:4/29: readlink d0/l7 0 2024-09-17T04:20:43.933 INFO:tasks.workunit.client.1.smithi134.stdout:4/30: stat d0/f2 0 2024-09-17T04:20:43.934 INFO:tasks.workunit.client.1.smithi134.stdout:9/66: symlink d2/d5/d9/l15 0 2024-09-17T04:20:43.936 INFO:tasks.workunit.client.1.smithi134.stdout:6/46: stat c5 0 2024-09-17T04:20:43.937 INFO:tasks.workunit.client.1.smithi134.stdout:6/47: fdatasync f4 0 2024-09-17T04:20:43.942 INFO:tasks.workunit.client.1.smithi134.stdout:9/67: rename d2/d5/d8/da to d2/d5/d8/d16 0 2024-09-17T04:20:43.942 INFO:tasks.workunit.client.1.smithi134.stdout:9/68: stat d2/d5/d8 0 2024-09-17T04:20:43.954 INFO:tasks.workunit.client.1.smithi134.stdout:9/69: getdents d2/d5/d8/d16 0 2024-09-17T04:20:43.955 INFO:tasks.workunit.client.1.smithi134.stdout:9/70: write d2/d5/d9/f11 [969904,124518] 0 2024-09-17T04:20:43.956 INFO:tasks.workunit.client.1.smithi134.stdout:5/29: getdents d0 0 2024-09-17T04:20:43.957 INFO:tasks.workunit.client.1.smithi134.stdout:9/71: mknod d2/d5/c17 0 2024-09-17T04:20:43.961 INFO:tasks.workunit.client.1.smithi134.stdout:9/72: write d2/d5/fb [792401,98444] 0 2024-09-17T04:20:43.961 INFO:tasks.workunit.client.1.smithi134.stdout:5/30: creat d0/f8 x:0 0 0 2024-09-17T04:20:43.961 INFO:tasks.workunit.client.1.smithi134.stdout:5/31: mknod d0/d6/c9 0 2024-09-17T04:20:43.962 INFO:tasks.workunit.client.1.smithi134.stdout:5/32: write d0/f4 [4997650,130728] 0 2024-09-17T04:20:43.966 INFO:tasks.workunit.client.1.smithi134.stdout:5/33: mkdir d0/da 0 2024-09-17T04:20:43.971 INFO:tasks.workunit.client.1.smithi134.stdout:6/48: getdents . 0 2024-09-17T04:20:43.975 INFO:tasks.workunit.client.1.smithi134.stdout:6/49: rename f4 to fb 0 2024-09-17T04:20:43.975 INFO:tasks.workunit.client.1.smithi134.stdout:5/34: dwrite d0/f2 [4194304,4194304] 0 2024-09-17T04:20:43.975 INFO:tasks.workunit.client.1.smithi134.stdout:6/50: fdatasync f8 0 2024-09-17T04:20:43.979 INFO:tasks.workunit.client.1.smithi134.stdout:5/35: dread d0/f2 [4194304,4194304] 0 2024-09-17T04:20:43.980 INFO:tasks.workunit.client.1.smithi134.stdout:6/51: symlink lc 0 2024-09-17T04:20:43.981 INFO:tasks.workunit.client.1.smithi134.stdout:6/52: write f8 [668519,79031] 0 2024-09-17T04:20:43.982 INFO:tasks.workunit.client.1.smithi134.stdout:8/32: truncate f2 6227092 0 2024-09-17T04:20:43.985 INFO:tasks.workunit.client.1.smithi134.stdout:4/31: truncate d0/f1 1714717 0 2024-09-17T04:20:43.990 INFO:tasks.workunit.client.1.smithi134.stdout:4/32: creat d0/fa x:0 0 0 2024-09-17T04:20:43.991 INFO:tasks.workunit.client.1.smithi134.stdout:6/53: dwrite fb [0,4194304] 0 2024-09-17T04:20:43.992 INFO:tasks.workunit.client.1.smithi134.stdout:6/54: write f9 [20132,92761] 0 2024-09-17T04:20:43.992 INFO:tasks.workunit.client.1.smithi134.stdout:4/33: creat d0/fb x:0 0 0 2024-09-17T04:20:43.993 INFO:tasks.workunit.client.1.smithi134.stdout:4/34: rename d0 to d0/dc 22 2024-09-17T04:20:43.995 INFO:tasks.workunit.client.1.smithi134.stdout:4/35: write d0/f6 [2307800,129681] 0 2024-09-17T04:20:43.996 INFO:tasks.workunit.client.1.smithi134.stdout:4/36: fsync d0/f5 0 2024-09-17T04:20:43.997 INFO:tasks.workunit.client.1.smithi134.stdout:9/73: truncate d2/d5/d8/d16/fd 3869532 0 2024-09-17T04:20:43.998 INFO:tasks.workunit.client.1.smithi134.stdout:9/74: chown d2/c3 14 1 2024-09-17T04:20:43.999 INFO:tasks.workunit.client.1.smithi134.stdout:6/55: dread f7 [0,4194304] 0 2024-09-17T04:20:44.000 INFO:tasks.workunit.client.1.smithi134.stdout:6/56: write f9 [960559,27457] 0 2024-09-17T04:20:44.001 INFO:tasks.workunit.client.1.smithi134.stdout:4/37: rename d0/l8 to d0/ld 0 2024-09-17T04:20:44.005 INFO:tasks.workunit.client.1.smithi134.stdout:4/38: dread d0/f6 [0,4194304] 0 2024-09-17T04:20:44.006 INFO:tasks.workunit.client.1.smithi134.stdout:6/57: creat fd x:0 0 0 2024-09-17T04:20:44.009 INFO:tasks.workunit.client.1.smithi134.stdout:9/75: chown d2/d5/d8/d16/fd 57721404 1 2024-09-17T04:20:44.010 INFO:tasks.workunit.client.1.smithi134.stdout:4/39: dwrite d0/f5 [4194304,4194304] 0 2024-09-17T04:20:44.010 INFO:tasks.workunit.client.1.smithi134.stdout:9/76: chown d2/d7 63 1 2024-09-17T04:20:44.010 INFO:tasks.workunit.client.1.smithi134.stdout:4/40: chown d0/fb 956624 1 2024-09-17T04:20:44.011 INFO:tasks.workunit.client.1.smithi134.stdout:6/58: mkdir de 0 2024-09-17T04:20:44.018 INFO:tasks.workunit.client.1.smithi134.stdout:5/36: truncate d0/f4 1460560 0 2024-09-17T04:20:44.019 INFO:tasks.workunit.client.1.smithi134.stdout:5/37: read d0/f2 [2347557,7855] 0 2024-09-17T04:20:44.019 INFO:tasks.workunit.client.1.smithi134.stdout:4/41: dwrite d0/fa [0,4194304] 0 2024-09-17T04:20:44.020 INFO:tasks.workunit.client.1.smithi134.stdout:4/42: dread - d0/fb zero size 2024-09-17T04:20:44.021 INFO:tasks.workunit.client.1.smithi134.stdout:4/43: chown d0/f2 7839 1 2024-09-17T04:20:44.023 INFO:tasks.workunit.client.1.smithi134.stdout:6/59: symlink de/lf 0 2024-09-17T04:20:44.027 INFO:tasks.workunit.client.1.smithi134.stdout:5/38: mknod d0/cb 0 2024-09-17T04:20:44.028 INFO:tasks.workunit.client.1.smithi134.stdout:4/44: mknod d0/ce 0 2024-09-17T04:20:44.028 INFO:tasks.workunit.client.1.smithi134.stdout:4/45: write d0/fa [2033250,115957] 0 2024-09-17T04:20:44.034 INFO:tasks.workunit.client.1.smithi134.stdout:4/46: mkdir d0/df 0 2024-09-17T04:20:44.038 INFO:tasks.workunit.client.1.smithi134.stdout:5/39: dwrite d0/f2 [0,4194304] 0 2024-09-17T04:20:44.046 INFO:tasks.workunit.client.1.smithi134.stdout:6/60: getdents de 0 2024-09-17T04:20:44.047 INFO:tasks.workunit.client.1.smithi134.stdout:6/61: truncate f9 1023488 0 2024-09-17T04:20:44.051 INFO:tasks.workunit.client.1.smithi134.stdout:6/62: mknod de/c10 0 2024-09-17T04:20:44.055 INFO:tasks.workunit.client.1.smithi134.stdout:9/77: write d2/d5/fb [4844171,116243] 0 2024-09-17T04:20:44.056 INFO:tasks.workunit.client.1.smithi134.stdout:6/63: dread f9 [0,4194304] 0 2024-09-17T04:20:44.059 INFO:tasks.workunit.client.1.smithi134.stdout:6/64: rename c2 to de/c11 0 2024-09-17T04:20:44.060 INFO:tasks.workunit.client.1.smithi134.stdout:6/65: chown lc 838 1 2024-09-17T04:20:44.098 INFO:tasks.workunit.client.1.smithi134.stdout:4/47: link d0/f1 d0/df/f10 0 2024-09-17T04:20:44.099 INFO:tasks.workunit.client.1.smithi134.stdout:6/66: write fb [870291,116513] 0 2024-09-17T04:20:44.099 INFO:tasks.workunit.client.1.smithi134.stdout:5/40: truncate d0/f5 781730 0 2024-09-17T04:20:44.099 INFO:tasks.workunit.client.1.smithi134.stdout:9/78: dwrite d2/d5/f13 [0,4194304] 0 2024-09-17T04:20:44.101 INFO:tasks.workunit.client.1.smithi134.stdout:6/67: write fb [877935,37305] 0 2024-09-17T04:20:44.106 INFO:tasks.workunit.client.1.smithi134.stdout:6/68: creat de/f12 x:0 0 0 2024-09-17T04:20:44.109 INFO:tasks.workunit.client.1.smithi134.stdout:6/69: rmdir de 39 2024-09-17T04:20:44.109 INFO:tasks.workunit.client.1.smithi134.stdout:5/41: dwrite d0/f8 [0,4194304] 0 2024-09-17T04:20:44.110 INFO:tasks.workunit.client.1.smithi134.stdout:4/48: getdents d0 0 2024-09-17T04:20:44.111 INFO:tasks.workunit.client.1.smithi134.stdout:4/49: chown d0/ld 10880546 1 2024-09-17T04:20:44.113 INFO:tasks.workunit.client.1.smithi134.stdout:9/79: getdents d2/d5 0 2024-09-17T04:20:44.114 INFO:tasks.workunit.client.1.smithi134.stdout:6/70: write f9 [1052499,96040] 0 2024-09-17T04:20:44.117 INFO:tasks.workunit.client.1.smithi134.stdout:4/50: rmdir d0 39 2024-09-17T04:20:44.121 INFO:tasks.workunit.client.1.smithi134.stdout:9/80: creat d2/d5/d9/f18 x:0 0 0 2024-09-17T04:20:44.127 INFO:tasks.workunit.client.1.smithi134.stdout:9/81: creat d2/d5/d8/f19 x:0 0 0 2024-09-17T04:20:44.128 INFO:tasks.workunit.client.1.smithi134.stdout:6/71: creat de/f13 x:0 0 0 2024-09-17T04:20:44.128 INFO:tasks.workunit.client.1.smithi134.stdout:6/72: chown f7 0 1 2024-09-17T04:20:44.131 INFO:tasks.workunit.client.1.smithi134.stdout:4/51: dread d0/f1 [0,4194304] 0 2024-09-17T04:20:44.132 INFO:tasks.workunit.client.1.smithi134.stdout:6/73: mknod de/c14 0 2024-09-17T04:20:44.132 INFO:tasks.workunit.client.1.smithi134.stdout:6/74: fsync f8 0 2024-09-17T04:20:44.138 INFO:tasks.workunit.client.1.smithi134.stdout:6/75: creat de/f15 x:0 0 0 2024-09-17T04:20:44.139 INFO:tasks.workunit.client.1.smithi134.stdout:6/76: dread - fd zero size 2024-09-17T04:20:44.139 INFO:tasks.workunit.client.1.smithi134.stdout:4/52: mknod d0/df/c11 0 2024-09-17T04:20:44.141 INFO:tasks.workunit.client.1.smithi134.stdout:6/77: mknod de/c16 0 2024-09-17T04:20:44.144 INFO:tasks.workunit.client.1.smithi134.stdout:6/78: symlink de/l17 0 2024-09-17T04:20:44.145 INFO:tasks.workunit.client.1.smithi134.stdout:4/53: dwrite d0/f5 [0,4194304] 0 2024-09-17T04:20:44.149 INFO:tasks.workunit.client.1.smithi134.stdout:5/42: fdatasync d0/f5 0 2024-09-17T04:20:44.152 INFO:tasks.workunit.client.1.smithi134.stdout:4/54: rename d0/ce to d0/c12 0 2024-09-17T04:20:44.153 INFO:tasks.workunit.client.1.smithi134.stdout:4/55: dread - d0/fb zero size 2024-09-17T04:20:44.153 INFO:tasks.workunit.client.1.smithi134.stdout:6/79: dwrite f7 [0,4194304] 0 2024-09-17T04:20:44.161 INFO:tasks.workunit.client.1.smithi134.stdout:9/82: truncate d2/d5/fb 673617 0 2024-09-17T04:20:44.161 INFO:tasks.workunit.client.1.smithi134.stdout:6/80: dread f8 [0,4194304] 0 2024-09-17T04:20:44.161 INFO:tasks.workunit.client.1.smithi134.stdout:6/81: stat c5 0 2024-09-17T04:20:44.161 INFO:tasks.workunit.client.1.smithi134.stdout:4/56: mkdir d0/d13 0 2024-09-17T04:20:44.162 INFO:tasks.workunit.client.1.smithi134.stdout:9/83: write d2/d5/d9/f18 [237580,130130] 0 2024-09-17T04:20:44.162 INFO:tasks.workunit.client.1.smithi134.stdout:6/82: symlink de/l18 0 2024-09-17T04:20:44.163 INFO:tasks.workunit.client.1.smithi134.stdout:9/84: write d2/d5/d9/f11 [1099321,115305] 0 2024-09-17T04:20:44.164 INFO:tasks.workunit.client.1.smithi134.stdout:6/83: mkdir de/d19 0 2024-09-17T04:20:44.165 INFO:tasks.workunit.client.1.smithi134.stdout:4/57: dread d0/f5 [4194304,4194304] 0 2024-09-17T04:20:44.169 INFO:tasks.workunit.client.1.smithi134.stdout:4/58: chown d0/c12 64071 1 2024-09-17T04:20:44.170 INFO:tasks.workunit.client.1.smithi134.stdout:6/84: mkdir de/d19/d1a 0 2024-09-17T04:20:44.171 INFO:tasks.workunit.client.1.smithi134.stdout:6/85: write f7 [4819579,31812] 0 2024-09-17T04:20:44.171 INFO:tasks.workunit.client.1.smithi134.stdout:4/59: rename d0/f1 to d0/d13/f14 0 2024-09-17T04:20:44.172 INFO:tasks.workunit.client.1.smithi134.stdout:9/85: rmdir d2/d5/d9/dc 0 2024-09-17T04:20:44.172 INFO:tasks.workunit.client.1.smithi134.stdout:6/86: readlink de/lf 0 2024-09-17T04:20:44.174 INFO:tasks.workunit.client.1.smithi134.stdout:9/86: write d2/d5/d8/f19 [727899,25252] 0 2024-09-17T04:20:44.176 INFO:tasks.workunit.client.1.smithi134.stdout:4/60: mknod d0/df/c15 0 2024-09-17T04:20:44.176 INFO:tasks.workunit.client.1.smithi134.stdout:4/61: fdatasync d0/fa 0 2024-09-17T04:20:44.178 INFO:tasks.workunit.client.1.smithi134.stdout:6/87: mknod de/d19/c1b 0 2024-09-17T04:20:44.179 INFO:tasks.workunit.client.1.smithi134.stdout:4/62: dread d0/f2 [0,4194304] 0 2024-09-17T04:20:44.180 INFO:tasks.workunit.client.1.smithi134.stdout:4/63: read - d0/fb zero size 2024-09-17T04:20:44.181 INFO:tasks.workunit.client.1.smithi134.stdout:9/87: rename d2/d5/d8/ce to d2/d5/d8/c1a 0 2024-09-17T04:20:44.186 INFO:tasks.workunit.client.1.smithi134.stdout:6/88: rename de/c10 to de/c1c 0 2024-09-17T04:20:44.187 INFO:tasks.workunit.client.1.smithi134.stdout:4/64: creat d0/df/f16 x:0 0 0 2024-09-17T04:20:44.187 INFO:tasks.workunit.client.1.smithi134.stdout:4/65: fdatasync d0/df/f16 0 2024-09-17T04:20:44.193 INFO:tasks.workunit.client.1.smithi134.stdout:4/66: mkdir d0/df/d17 0 2024-09-17T04:20:44.197 INFO:tasks.workunit.client.1.smithi134.stdout:6/89: rename de/c11 to de/d19/c1d 0 2024-09-17T04:20:44.204 INFO:tasks.workunit.client.1.smithi134.stdout:4/67: truncate d0/fa 1822454 0 2024-09-17T04:20:44.205 INFO:tasks.workunit.client.1.smithi134.stdout:4/68: write d0/df/f16 [788045,3272] 0 2024-09-17T04:20:44.206 INFO:tasks.workunit.client.1.smithi134.stdout:4/69: truncate d0/fb 349851 0 2024-09-17T04:20:44.211 INFO:tasks.workunit.client.1.smithi134.stdout:9/88: dwrite d2/d5/d8/d16/fd [0,4194304] 0 2024-09-17T04:20:44.215 INFO:tasks.workunit.client.1.smithi134.stdout:4/70: dwrite d0/fb [0,4194304] 0 2024-09-17T04:20:44.220 INFO:tasks.workunit.client.1.smithi134.stdout:9/89: rename d2/d5/d9/l15 to d2/d5/d8/d16/l1b 0 2024-09-17T04:20:44.226 INFO:tasks.workunit.client.1.smithi134.stdout:9/90: getdents d2/d5/d8 0 2024-09-17T04:20:44.233 INFO:tasks.workunit.client.1.smithi134.stdout:9/91: dwrite d2/d5/d9/f11 [0,4194304] 0 2024-09-17T04:20:44.233 INFO:tasks.workunit.client.1.smithi134.stdout:4/71: write d0/d13/f14 [2008677,76861] 0 2024-09-17T04:20:44.237 INFO:tasks.workunit.client.1.smithi134.stdout:4/72: creat d0/df/f18 x:0 0 0 2024-09-17T04:20:44.238 INFO:tasks.workunit.client.1.smithi134.stdout:9/92: creat d2/d5/d9/f1c x:0 0 0 2024-09-17T04:20:44.238 INFO:tasks.workunit.client.1.smithi134.stdout:4/73: chown d0/f2 500225877 1 2024-09-17T04:20:44.239 INFO:tasks.workunit.client.1.smithi134.stdout:9/93: write d2/d5/d9/f18 [263503,36784] 0 2024-09-17T04:20:44.240 INFO:tasks.workunit.client.1.smithi134.stdout:4/74: read - d0/df/f18 zero size 2024-09-17T04:20:44.241 INFO:tasks.workunit.client.1.smithi134.stdout:9/94: mkdir d2/d5/d8/d16/d1d 0 2024-09-17T04:20:44.243 INFO:tasks.workunit.client.1.smithi134.stdout:9/95: mkdir d2/d5/d8/d1e 0 2024-09-17T04:20:44.244 INFO:tasks.workunit.client.1.smithi134.stdout:4/75: dread d0/f2 [0,4194304] 0 2024-09-17T04:20:44.245 INFO:tasks.workunit.client.1.smithi134.stdout:4/76: read d0/f6 [2910410,31553] 0 2024-09-17T04:20:44.245 INFO:tasks.workunit.client.1.smithi134.stdout:4/77: chown d0/fb 91 1 2024-09-17T04:20:44.247 INFO:tasks.workunit.client.1.smithi134.stdout:4/78: unlink d0/df/f10 0 2024-09-17T04:20:44.249 INFO:tasks.workunit.client.1.smithi134.stdout:9/96: link d2/c3 d2/d5/d8/c1f 0 2024-09-17T04:20:44.249 INFO:tasks.workunit.client.1.smithi134.stdout:9/97: readlink d2/l4 0 2024-09-17T04:20:44.251 INFO:tasks.workunit.client.1.smithi134.stdout:4/79: dread d0/fb [0,4194304] 0 2024-09-17T04:20:44.251 INFO:tasks.workunit.client.1.smithi134.stdout:9/98: mknod d2/d5/c20 0 2024-09-17T04:20:44.251 INFO:tasks.workunit.client.1.smithi134.stdout:4/80: dread - d0/df/f18 zero size 2024-09-17T04:20:44.256 INFO:tasks.workunit.client.1.smithi134.stdout:4/81: truncate d0/f6 1977271 0 2024-09-17T04:20:44.262 INFO:tasks.workunit.client.1.smithi134.stdout:9/99: getdents d2/d5/d8/d16 0 2024-09-17T04:20:44.274 INFO:tasks.workunit.client.1.smithi134.stdout:4/82: read d0/f6 [584272,111388] 0 2024-09-17T04:20:44.277 INFO:tasks.workunit.client.1.smithi134.stdout:9/100: truncate d2/d5/f13 2267164 0 2024-09-17T04:20:44.282 INFO:tasks.workunit.client.1.smithi134.stdout:4/83: creat d0/d13/f19 x:0 0 0 2024-09-17T04:20:44.285 INFO:tasks.workunit.client.1.smithi134.stdout:4/84: mkdir d0/d1a 0 2024-09-17T04:20:44.289 INFO:tasks.workunit.client.1.smithi134.stdout:9/101: dread d2/d5/f13 [0,4194304] 0 2024-09-17T04:20:44.291 INFO:tasks.workunit.client.1.smithi134.stdout:4/85: dread d0/fa [0,4194304] 0 2024-09-17T04:20:44.292 INFO:tasks.workunit.client.1.smithi134.stdout:4/86: readlink d0/l4 0 2024-09-17T04:20:44.295 INFO:tasks.workunit.client.1.smithi134.stdout:9/102: dwrite d2/d5/d8/d16/fd [0,4194304] 0 2024-09-17T04:20:44.296 INFO:tasks.workunit.client.1.smithi134.stdout:4/87: dread d0/d13/f14 [0,4194304] 0 2024-09-17T04:20:44.297 INFO:tasks.workunit.client.1.smithi134.stdout:9/103: write d2/d5/d9/f11 [893539,73591] 0 2024-09-17T04:20:44.309 INFO:tasks.workunit.client.1.smithi134.stdout:9/104: mkdir d2/d5/d8/d1e/d21 0 2024-09-17T04:20:44.313 INFO:tasks.workunit.client.1.smithi134.stdout:9/105: symlink d2/l22 0 2024-09-17T04:20:44.313 INFO:tasks.workunit.client.1.smithi134.stdout:9/106: rename d2 to d2/d23 22 2024-09-17T04:20:44.314 INFO:tasks.workunit.client.1.smithi134.stdout:9/107: dread - d2/d5/d9/f1c zero size 2024-09-17T04:20:44.316 INFO:tasks.workunit.client.1.smithi134.stdout:4/88: dwrite d0/f6 [0,4194304] 0 2024-09-17T04:20:44.318 INFO:tasks.workunit.client.1.smithi134.stdout:9/108: mknod d2/d5/d8/d16/c24 0 2024-09-17T04:20:44.318 INFO:tasks.workunit.client.1.smithi134.stdout:9/109: chown d2/d5 57219990 1 2024-09-17T04:20:44.323 INFO:tasks.workunit.client.1.smithi134.stdout:4/89: dwrite d0/f5 [4194304,4194304] 0 2024-09-17T04:20:44.324 INFO:tasks.workunit.client.1.smithi134.stdout:9/110: rename d2/d5/d8/d1e/d21 to d2/d25 0 2024-09-17T04:20:44.329 INFO:tasks.workunit.client.1.smithi134.stdout:4/90: rename d0/f6 to d0/f1b 0 2024-09-17T04:20:44.329 INFO:tasks.workunit.client.1.smithi134.stdout:4/91: readlink d0/ld 0 2024-09-17T04:20:44.331 INFO:tasks.workunit.client.1.smithi134.stdout:9/111: rename d2/d5/c17 to d2/c26 0 2024-09-17T04:20:44.335 INFO:tasks.workunit.client.1.smithi134.stdout:4/92: dwrite d0/f5 [8388608,4194304] 0 2024-09-17T04:20:44.336 INFO:tasks.workunit.client.1.smithi134.stdout:9/112: rename d2/d5/d8/d16/l10 to d2/d5/d8/d16/d1d/l27 0 2024-09-17T04:20:44.337 INFO:tasks.workunit.client.1.smithi134.stdout:9/113: chown d2/d5/fb 137774725 1 2024-09-17T04:20:44.339 INFO:tasks.workunit.client.1.smithi134.stdout:4/93: rmdir d0/df 39 2024-09-17T04:20:44.339 INFO:tasks.workunit.client.1.smithi134.stdout:9/114: write d2/d5/d9/f1c [862824,84454] 0 2024-09-17T04:20:44.340 INFO:tasks.workunit.client.1.smithi134.stdout:9/115: write d2/d5/fb [4473122,73946] 0 2024-09-17T04:20:44.344 INFO:tasks.workunit.client.1.smithi134.stdout:4/94: unlink d0/l4 0 2024-09-17T04:20:44.346 INFO:tasks.workunit.client.1.smithi134.stdout:9/116: creat d2/d5/d9/f28 x:0 0 0 2024-09-17T04:20:44.347 INFO:tasks.workunit.client.1.smithi134.stdout:9/117: fdatasync d2/d5/fb 0 2024-09-17T04:20:44.348 INFO:tasks.workunit.client.1.smithi134.stdout:9/118: chown d2/d5/d9/df 63031 1 2024-09-17T04:20:44.351 INFO:tasks.workunit.client.1.smithi134.stdout:9/119: creat d2/d5/d8/d1e/f29 x:0 0 0 2024-09-17T04:20:44.351 INFO:tasks.workunit.client.1.smithi134.stdout:9/120: dread - d2/d5/d9/f28 zero size 2024-09-17T04:20:44.352 INFO:tasks.workunit.client.1.smithi134.stdout:4/95: rename d0/d13/f19 to d0/df/d17/f1c 0 2024-09-17T04:20:44.363 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:44 smithi088 ceph-mon[27811]: Adjusting osd_memory_target on smithi088 to 1216M 2024-09-17T04:20:44.363 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:44 smithi088 ceph-mon[27811]: Updating smithi088:/etc/ceph/ceph.conf 2024-09-17T04:20:44.363 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:44 smithi088 ceph-mon[27811]: Updating smithi134:/etc/ceph/ceph.conf 2024-09-17T04:20:44.363 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:44 smithi088 ceph-mon[27811]: Updating smithi134:/var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T04:20:44.364 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:44 smithi088 ceph-mon[27811]: Updating smithi088:/var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T04:20:44.364 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:44 smithi088 ceph-mon[27811]: Updating smithi088:/etc/ceph/ceph.client.admin.keyring 2024-09-17T04:20:44.364 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:44 smithi088 ceph-mon[27811]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2024-09-17T04:20:44.364 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:44 smithi088 ceph-mon[27811]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:20:44.364 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:44 smithi088 ceph-mon[27811]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:20:44.364 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:44 smithi088 ceph-mon[27811]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:20:44.364 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:44 smithi088 ceph-mon[27811]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:20:44.364 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:44 smithi088 ceph-mon[27811]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:20:44.364 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:44 smithi088 ceph-mon[27811]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi088", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T04:20:44.364 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:44 smithi088 ceph-mon[27811]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi088", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T04:20:44.364 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:44 smithi088 ceph-mon[27811]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:20:44.365 INFO:tasks.workunit.client.1.smithi134.stdout:4/96: creat d0/d1a/f1d x:0 0 0 2024-09-17T04:20:44.366 INFO:tasks.workunit.client.1.smithi134.stdout:4/97: dread d0/f5 [8388608,4194304] 0 2024-09-17T04:20:44.490 INFO:tasks.workunit.client.1.smithi134.stdout:9/121: link d2/d5/d8/c1f d2/d5/d8/d16/c2a 0 2024-09-17T04:20:44.495 INFO:tasks.workunit.client.1.smithi134.stdout:9/122: link d2/d5/d9/f18 d2/d5/d8/d16/d1d/f2b 0 2024-09-17T04:20:44.496 INFO:tasks.workunit.client.1.smithi134.stdout:9/123: rmdir d2/d5/d9 39 2024-09-17T04:20:44.499 INFO:tasks.workunit.client.1.smithi134.stdout:9/124: link d2/c3 d2/c2c 0 2024-09-17T04:20:44.501 INFO:tasks.workunit.client.1.smithi134.stdout:9/125: symlink d2/d5/d9/df/l2d 0 2024-09-17T04:20:44.504 INFO:tasks.workunit.client.1.smithi134.stdout:9/126: link d2/d5/d9/f28 d2/d5/d9/f2e 0 2024-09-17T04:20:44.504 INFO:tasks.workunit.client.1.smithi134.stdout:9/127: dread - d2/d5/d9/f2e zero size 2024-09-17T04:20:44.508 INFO:tasks.workunit.client.1.smithi134.stdout:9/128: link d2/d5/d8/d16/d1d/f2b d2/d7/f2f 0 2024-09-17T04:20:44.509 INFO:tasks.workunit.client.1.smithi134.stdout:9/129: dread - d2/d5/d8/d1e/f29 zero size 2024-09-17T04:20:44.509 INFO:tasks.workunit.client.1.smithi134.stdout:9/130: stat d2/l12 0 2024-09-17T04:20:44.510 INFO:tasks.workunit.client.1.smithi134.stdout:9/131: chown d2/d5/d8/d16/fd 390934320 1 2024-09-17T04:20:44.512 INFO:tasks.workunit.client.1.smithi134.stdout:9/132: creat d2/d5/d9/f30 x:0 0 0 2024-09-17T04:20:44.515 INFO:tasks.workunit.client.1.smithi134.stdout:4/98: getdents d0/d13 0 2024-09-17T04:20:44.518 INFO:tasks.workunit.client.1.smithi134.stdout:4/99: dread d0/df/f16 [0,4194304] 0 2024-09-17T04:20:44.519 INFO:tasks.workunit.client.1.smithi134.stdout:4/100: chown d0/ld 2270 1 2024-09-17T04:20:44.519 INFO:tasks.workunit.client.1.smithi134.stdout:4/101: fdatasync d0/fb 0 2024-09-17T04:20:44.522 INFO:tasks.workunit.client.1.smithi134.stdout:4/102: rename d0/d1a to d0/df/d1e 0 2024-09-17T04:20:44.524 INFO:tasks.workunit.client.1.smithi134.stdout:4/103: rename d0/df/d17/f1c to d0/d13/f1f 0 2024-09-17T04:20:44.525 INFO:tasks.workunit.client.1.smithi134.stdout:4/104: mkdir d0/df/d1e/d20 0 2024-09-17T04:20:44.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:44 smithi134 ceph-mon[35201]: Adjusting osd_memory_target on smithi088 to 1216M 2024-09-17T04:20:44.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:44 smithi134 ceph-mon[35201]: Updating smithi088:/etc/ceph/ceph.conf 2024-09-17T04:20:44.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:44 smithi134 ceph-mon[35201]: Updating smithi134:/etc/ceph/ceph.conf 2024-09-17T04:20:44.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:44 smithi134 ceph-mon[35201]: Updating smithi134:/var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T04:20:44.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:44 smithi134 ceph-mon[35201]: Updating smithi088:/var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T04:20:44.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:44 smithi134 ceph-mon[35201]: Updating smithi088:/etc/ceph/ceph.client.admin.keyring 2024-09-17T04:20:44.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:44 smithi134 ceph-mon[35201]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2024-09-17T04:20:44.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:44 smithi134 ceph-mon[35201]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:20:44.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:44 smithi134 ceph-mon[35201]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:20:44.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:44 smithi134 ceph-mon[35201]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:20:44.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:44 smithi134 ceph-mon[35201]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:20:44.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:44 smithi134 ceph-mon[35201]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:20:44.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:44 smithi134 ceph-mon[35201]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi088", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T04:20:44.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:44 smithi134 ceph-mon[35201]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi088", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T04:20:44.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:44 smithi134 ceph-mon[35201]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:20:44.715 INFO:tasks.workunit.client.1.smithi134.stdout:9/133: fsync d2/d5/d9/f18 0 2024-09-17T04:20:44.718 INFO:tasks.workunit.client.1.smithi134.stdout:9/134: dread d2/d5/d9/f18 [0,4194304] 0 2024-09-17T04:20:44.719 INFO:tasks.workunit.client.1.smithi134.stdout:4/105: getdents d0/df/d17 0 2024-09-17T04:20:44.723 INFO:tasks.workunit.client.1.smithi134.stdout:4/106: rename d0/f2 to d0/df/d1e/d20/f21 0 2024-09-17T04:20:44.724 INFO:tasks.workunit.client.1.smithi134.stdout:9/135: dwrite d2/d5/fb [0,4194304] 0 2024-09-17T04:20:44.724 INFO:tasks.workunit.client.1.smithi134.stdout:4/107: read d0/fb [2648015,102454] 0 2024-09-17T04:20:44.725 INFO:tasks.workunit.client.1.smithi134.stdout:9/136: rmdir d2 39 2024-09-17T04:20:44.729 INFO:tasks.workunit.client.1.smithi134.stdout:9/137: truncate d2/d5/f13 3286452 0 2024-09-17T04:20:44.731 INFO:tasks.workunit.client.1.smithi134.stdout:4/108: dwrite d0/d13/f1f [0,4194304] 0 2024-09-17T04:20:44.735 INFO:tasks.workunit.client.1.smithi134.stdout:9/138: dread d2/d5/fb [0,4194304] 0 2024-09-17T04:20:44.737 INFO:tasks.workunit.client.1.smithi134.stdout:9/139: mknod d2/d5/d9/c31 0 2024-09-17T04:20:44.738 INFO:tasks.workunit.client.1.smithi134.stdout:9/140: dread - d2/d5/d8/d1e/f29 zero size 2024-09-17T04:20:44.745 INFO:tasks.workunit.client.1.smithi134.stdout:9/141: dwrite d2/d5/d9/f30 [0,4194304] 0 2024-09-17T04:20:44.751 INFO:tasks.workunit.client.1.smithi134.stdout:9/142: unlink d2/d5/d8/d16/l1b 0 2024-09-17T04:20:44.753 INFO:tasks.workunit.client.1.smithi134.stdout:9/143: truncate d2/d5/d8/d16/fd 5114178 0 2024-09-17T04:20:44.756 INFO:tasks.workunit.client.1.smithi134.stdout:9/144: rmdir d2/d7 39 2024-09-17T04:20:44.756 INFO:tasks.workunit.client.1.smithi134.stdout:9/145: chown d2/d5/d9/f2e 998 1 2024-09-17T04:20:44.758 INFO:tasks.workunit.client.1.smithi134.stdout:4/109: write d0/df/d1e/d20/f21 [4614673,78456] 0 2024-09-17T04:20:44.758 INFO:tasks.workunit.client.1.smithi134.stdout:4/110: chown d0/c12 110216 1 2024-09-17T04:20:44.759 INFO:tasks.workunit.client.1.smithi134.stdout:9/146: fsync d2/d5/f13 0 2024-09-17T04:20:44.762 INFO:tasks.workunit.client.1.smithi134.stdout:9/147: dread d2/d5/d8/d16/d1d/f2b [0,4194304] 0 2024-09-17T04:20:44.765 INFO:tasks.workunit.client.1.smithi134.stdout:4/111: dwrite d0/fb [0,4194304] 0 2024-09-17T04:20:44.767 INFO:tasks.workunit.client.1.smithi134.stdout:9/148: dread d2/d5/f13 [0,4194304] 0 2024-09-17T04:20:44.773 INFO:tasks.workunit.client.1.smithi134.stdout:9/149: creat d2/d5/d8/d16/f32 x:0 0 0 2024-09-17T04:20:44.776 INFO:tasks.workunit.client.1.smithi134.stdout:9/150: link d2/d5/d9/f11 d2/d7/f33 0 2024-09-17T04:20:44.781 INFO:tasks.workunit.client.1.smithi134.stdout:4/112: dwrite d0/fa [0,4194304] 0 2024-09-17T04:20:44.782 INFO:tasks.workunit.client.1.smithi134.stdout:9/151: dread d2/d7/f33 [0,4194304] 0 2024-09-17T04:20:44.784 INFO:tasks.workunit.client.1.smithi134.stdout:4/113: truncate d0/f5 2780041 0 2024-09-17T04:20:44.788 INFO:tasks.workunit.client.1.smithi134.stdout:4/114: fsync d0/df/f16 0 2024-09-17T04:20:44.789 INFO:tasks.workunit.client.1.smithi134.stdout:4/115: readlink d0/l7 0 2024-09-17T04:20:44.789 INFO:tasks.workunit.client.1.smithi134.stdout:4/116: chown d0/l7 4 1 2024-09-17T04:20:44.789 INFO:tasks.workunit.client.1.smithi134.stdout:4/117: chown d0/df 3294810 1 2024-09-17T04:20:44.794 INFO:tasks.workunit.client.1.smithi134.stdout:4/118: truncate d0/d13/f14 1781349 0 2024-09-17T04:20:44.794 INFO:tasks.workunit.client.1.smithi134.stdout:9/152: getdents d2/d5/d9/df 0 2024-09-17T04:20:44.796 INFO:tasks.workunit.client.1.smithi134.stdout:4/119: creat d0/f22 x:0 0 0 2024-09-17T04:20:44.797 INFO:tasks.workunit.client.1.smithi134.stdout:4/120: fsync d0/d13/f1f 0 2024-09-17T04:20:44.797 INFO:tasks.workunit.client.1.smithi134.stdout:4/121: stat d0/d13/f1f 0 2024-09-17T04:20:44.800 INFO:tasks.workunit.client.1.smithi134.stdout:4/122: dread d0/d13/f1f [0,4194304] 0 2024-09-17T04:20:44.803 INFO:tasks.workunit.client.1.smithi134.stdout:4/123: symlink d0/l23 0 2024-09-17T04:20:44.872 INFO:tasks.workunit.client.1.smithi134.stdout:9/153: write d2/d5/f13 [3545615,35949] 0 2024-09-17T04:20:44.873 INFO:tasks.workunit.client.1.smithi134.stdout:4/124: dread d0/d13/f14 [0,4194304] 0 2024-09-17T04:20:44.925 INFO:tasks.workunit.client.1.smithi134.stdout:4/125: creat d0/df/d17/f24 x:0 0 0 2024-09-17T04:20:44.926 INFO:tasks.workunit.client.1.smithi134.stdout:4/126: write d0/df/f16 [1382572,88558] 0 2024-09-17T04:20:44.927 INFO:tasks.workunit.client.1.smithi134.stdout:4/127: write d0/df/d1e/f1d [385421,63062] 0 2024-09-17T04:20:44.928 INFO:tasks.workunit.client.1.smithi134.stdout:9/154: rename d2/d5/d9/f28 to d2/f34 0 2024-09-17T04:20:44.932 INFO:tasks.workunit.client.1.smithi134.stdout:4/128: dwrite d0/df/d1e/f1d [0,4194304] 0 2024-09-17T04:20:44.933 INFO:tasks.workunit.client.1.smithi134.stdout:4/129: write d0/d13/f1f [2074502,100971] 0 2024-09-17T04:20:44.935 INFO:tasks.workunit.client.1.smithi134.stdout:9/155: link d2/l22 d2/d25/l35 0 2024-09-17T04:20:44.938 INFO:tasks.workunit.client.1.smithi134.stdout:9/156: write d2/d5/d8/d16/fd [3521338,27658] 0 2024-09-17T04:20:44.940 INFO:tasks.workunit.client.1.smithi134.stdout:4/130: link d0/df/d1e/f1d d0/df/d1e/f25 0 2024-09-17T04:20:44.942 INFO:tasks.workunit.client.1.smithi134.stdout:9/157: truncate d2/d5/d9/f18 350136 0 2024-09-17T04:20:44.943 INFO:tasks.workunit.client.1.smithi134.stdout:9/158: truncate d2/d7/f33 4918234 0 2024-09-17T04:20:44.946 INFO:tasks.workunit.client.1.smithi134.stdout:9/159: read d2/d5/d8/f19 [710536,44538] 0 2024-09-17T04:20:44.957 INFO:tasks.workunit.client.1.smithi134.stdout:9/160: dread d2/d5/d9/f18 [0,4194304] 0 2024-09-17T04:20:44.957 INFO:tasks.workunit.client.1.smithi134.stdout:9/161: chown d2/d25 1858287 1 2024-09-17T04:20:44.957 INFO:tasks.workunit.client.1.smithi134.stdout:4/131: truncate d0/df/d1e/d20/f21 3172703 0 2024-09-17T04:20:44.961 INFO:tasks.workunit.client.1.smithi134.stdout:9/162: dread d2/d5/f13 [0,4194304] 0 2024-09-17T04:20:44.961 INFO:tasks.workunit.client.1.smithi134.stdout:4/132: creat d0/df/d1e/d20/f26 x:0 0 0 2024-09-17T04:20:44.964 INFO:tasks.workunit.client.1.smithi134.stdout:9/163: write d2/d7/f2f [481217,95019] 0 2024-09-17T04:20:44.965 INFO:tasks.workunit.client.1.smithi134.stdout:4/133: mknod d0/df/d1e/d20/c27 0 2024-09-17T04:20:44.970 INFO:tasks.workunit.client.1.smithi134.stdout:9/164: dwrite d2/d5/d9/f1c [0,4194304] 0 2024-09-17T04:20:44.972 INFO:tasks.workunit.client.1.smithi134.stdout:9/165: truncate d2/d5/d8/d16/d1d/f2b 855365 0 2024-09-17T04:20:44.972 INFO:tasks.workunit.client.1.smithi134.stdout:9/166: readlink d2/l12 0 2024-09-17T04:20:44.972 INFO:tasks.workunit.client.1.smithi134.stdout:4/134: getdents d0/df 0 2024-09-17T04:20:44.977 INFO:tasks.workunit.client.1.smithi134.stdout:9/167: creat d2/d5/d9/f36 x:0 0 0 2024-09-17T04:20:44.977 INFO:tasks.workunit.client.1.smithi134.stdout:9/168: chown d2/d5/d9/df/l2d 0 1 2024-09-17T04:20:44.977 INFO:tasks.workunit.client.1.smithi134.stdout:4/135: symlink d0/df/d1e/l28 0 2024-09-17T04:20:44.977 INFO:tasks.workunit.client.1.smithi134.stdout:4/136: fsync d0/df/f18 0 2024-09-17T04:20:44.981 INFO:tasks.workunit.client.1.smithi134.stdout:4/137: rename d0/df/d1e/f1d to d0/df/f29 0 2024-09-17T04:20:44.981 INFO:tasks.workunit.client.1.smithi134.stdout:4/138: stat d0/d13/f14 0 2024-09-17T04:20:44.983 INFO:tasks.workunit.client.1.smithi134.stdout:4/139: creat d0/df/d1e/f2a x:0 0 0 2024-09-17T04:20:44.984 INFO:tasks.workunit.client.1.smithi134.stdout:4/140: dread - d0/df/d1e/d20/f26 zero size 2024-09-17T04:20:44.985 INFO:tasks.workunit.client.1.smithi134.stdout:4/141: creat d0/df/d1e/f2b x:0 0 0 2024-09-17T04:20:44.992 INFO:tasks.workunit.client.1.smithi134.stdout:4/142: dwrite d0/f22 [0,4194304] 0 2024-09-17T04:20:44.994 INFO:tasks.workunit.client.1.smithi134.stdout:4/143: dread d0/d13/f14 [0,4194304] 0 2024-09-17T04:20:44.996 INFO:tasks.workunit.client.1.smithi134.stdout:9/169: write d2/f34 [662131,121243] 0 2024-09-17T04:20:44.996 INFO:tasks.workunit.client.1.smithi134.stdout:4/144: readlink d0/df/d1e/l28 0 2024-09-17T04:20:44.997 INFO:tasks.workunit.client.1.smithi134.stdout:9/170: chown d2/d5/d9/df 47 1 2024-09-17T04:20:44.997 INFO:tasks.workunit.client.1.smithi134.stdout:4/145: rename d0/df to d0/df/d2c 22 2024-09-17T04:20:44.997 INFO:tasks.workunit.client.1.smithi134.stdout:4/146: fsync d0/d13/f1f 0 2024-09-17T04:20:45.000 INFO:tasks.workunit.client.1.smithi134.stdout:4/147: symlink d0/df/d1e/l2d 0 2024-09-17T04:20:45.005 INFO:tasks.workunit.client.1.smithi134.stdout:4/148: creat d0/df/d1e/f2e x:0 0 0 2024-09-17T04:20:45.005 INFO:tasks.workunit.client.1.smithi134.stdout:4/149: chown d0/df 125192 1 2024-09-17T04:20:45.008 INFO:tasks.workunit.client.1.smithi134.stdout:4/150: mknod d0/d13/c2f 0 2024-09-17T04:20:45.009 INFO:tasks.workunit.client.1.smithi134.stdout:9/171: dwrite d2/d7/f33 [0,4194304] 0 2024-09-17T04:20:45.009 INFO:tasks.workunit.client.1.smithi134.stdout:4/151: write d0/df/d1e/f2e [233873,107670] 0 2024-09-17T04:20:45.014 INFO:tasks.workunit.client.1.smithi134.stdout:4/152: symlink d0/l30 0 2024-09-17T04:20:45.015 INFO:tasks.workunit.client.1.smithi134.stdout:9/172: dread d2/d5/d8/d16/fd [0,4194304] 0 2024-09-17T04:20:45.020 INFO:tasks.workunit.client.1.smithi134.stdout:9/173: rename d2/d5/d8/d16/d1d to d2/d5/d37 0 2024-09-17T04:20:45.026 INFO:tasks.workunit.client.1.smithi134.stdout:9/174: dwrite d2/d7/f33 [0,4194304] 0 2024-09-17T04:20:45.030 INFO:tasks.workunit.client.1.smithi134.stdout:4/153: write d0/f5 [1182194,122570] 0 2024-09-17T04:20:45.031 INFO:tasks.workunit.client.1.smithi134.stdout:4/154: stat d0/df/d17 0 2024-09-17T04:20:45.033 INFO:tasks.workunit.client.1.smithi134.stdout:4/155: chown d0/df/d1e 62349 1 2024-09-17T04:20:45.034 INFO:tasks.workunit.client.1.smithi134.stdout:4/156: chown d0/l7 4988227 1 2024-09-17T04:20:45.034 INFO:tasks.workunit.client.1.smithi134.stdout:9/175: dwrite d2/d7/f33 [0,4194304] 0 2024-09-17T04:20:45.037 INFO:tasks.workunit.client.1.smithi134.stdout:9/176: mkdir d2/d5/d9/df/d38 0 2024-09-17T04:20:45.039 INFO:tasks.workunit.client.1.smithi134.stdout:4/157: rename d0/df/d1e/f2a to d0/df/f31 0 2024-09-17T04:20:45.045 INFO:tasks.workunit.client.1.smithi134.stdout:9/177: rename d2/d5/d8/d16/c2a to d2/d5/d37/c39 0 2024-09-17T04:20:45.046 INFO:tasks.workunit.client.1.smithi134.stdout:9/178: fdatasync d2/d5/d9/f30 0 2024-09-17T04:20:45.046 INFO:tasks.workunit.client.1.smithi134.stdout:4/158: dwrite d0/df/d17/f24 [0,4194304] 0 2024-09-17T04:20:45.051 INFO:tasks.workunit.client.1.smithi134.stdout:4/159: dread d0/f5 [0,4194304] 0 2024-09-17T04:20:45.054 INFO:tasks.workunit.client.1.smithi134.stdout:9/179: dwrite d2/d5/d9/f1c [0,4194304] 0 2024-09-17T04:20:45.054 INFO:tasks.workunit.client.1.smithi134.stdout:4/160: rmdir d0/df/d1e/d20 39 2024-09-17T04:20:45.057 INFO:tasks.workunit.client.1.smithi134.stdout:9/180: dread d2/d5/d9/f18 [0,4194304] 0 2024-09-17T04:20:45.060 INFO:tasks.workunit.client.1.smithi134.stdout:4/161: mknod d0/df/d1e/d20/c32 0 2024-09-17T04:20:45.072 INFO:tasks.workunit.client.1.smithi134.stdout:9/181: getdents d2/d25 0 2024-09-17T04:20:45.075 INFO:tasks.workunit.client.1.smithi134.stdout:4/162: dwrite d0/df/d17/f24 [4194304,4194304] 0 2024-09-17T04:20:45.075 INFO:tasks.workunit.client.1.smithi134.stdout:9/182: chown d2/d5/d8/d1e/f29 506 1 2024-09-17T04:20:45.076 INFO:tasks.workunit.client.1.smithi134.stdout:4/163: read d0/df/f29 [229920,86713] 0 2024-09-17T04:20:45.077 INFO:tasks.workunit.client.1.smithi134.stdout:4/164: readlink d0/df/d1e/l28 0 2024-09-17T04:20:45.078 INFO:tasks.workunit.client.1.smithi134.stdout:9/183: mkdir d2/d25/d3a 0 2024-09-17T04:20:45.081 INFO:tasks.workunit.client.1.smithi134.stdout:9/184: unlink d2/d5/d9/f11 0 2024-09-17T04:20:45.085 INFO:tasks.workunit.client.1.smithi134.stdout:4/165: link d0/df/d17/f24 d0/d13/f33 0 2024-09-17T04:20:45.088 INFO:tasks.workunit.client.1.smithi134.stdout:4/166: rename d0/f1b to d0/df/d1e/d20/f34 0 2024-09-17T04:20:45.089 INFO:tasks.workunit.client.1.smithi134.stdout:4/167: read d0/df/d1e/f25 [1683788,43711] 0 2024-09-17T04:20:45.095 INFO:tasks.workunit.client.1.smithi134.stdout:9/185: write d2/d7/f2f [1560206,7265] 0 2024-09-17T04:20:45.096 INFO:tasks.workunit.client.1.smithi134.stdout:9/186: chown d2/f34 61 1 2024-09-17T04:20:45.099 INFO:tasks.workunit.client.1.smithi134.stdout:9/187: mknod d2/d5/c3b 0 2024-09-17T04:20:45.099 INFO:tasks.workunit.client.1.smithi134.stdout:9/188: stat d2/d5/fb 0 2024-09-17T04:20:45.103 INFO:tasks.workunit.client.1.smithi134.stdout:9/189: unlink d2/d7/f33 0 2024-09-17T04:20:45.104 INFO:tasks.workunit.client.1.smithi134.stdout:9/190: write d2/d5/fb [2796554,70910] 0 2024-09-17T04:20:45.106 INFO:tasks.workunit.client.1.smithi134.stdout:9/191: creat d2/d25/f3c x:0 0 0 2024-09-17T04:20:45.107 INFO:tasks.workunit.client.1.smithi134.stdout:9/192: dread - d2/d5/d9/f36 zero size 2024-09-17T04:20:45.110 INFO:tasks.workunit.client.1.smithi134.stdout:9/193: dread d2/d7/f2f [0,4194304] 0 2024-09-17T04:20:45.113 INFO:tasks.workunit.client.1.smithi134.stdout:9/194: symlink d2/d5/d8/l3d 0 2024-09-17T04:20:45.122 INFO:tasks.workunit.client.1.smithi134.stdout:9/195: truncate d2/d5/f13 2792639 0 2024-09-17T04:20:45.124 INFO:tasks.workunit.client.1.smithi134.stdout:9/196: mkdir d2/d5/d9/d3e 0 2024-09-17T04:20:45.126 INFO:tasks.workunit.client.1.smithi134.stdout:9/197: mkdir d2/d5/d37/d3f 0 2024-09-17T04:20:45.127 INFO:tasks.workunit.client.1.smithi134.stdout:9/198: mknod d2/d25/c40 0 2024-09-17T04:20:45.132 INFO:tasks.workunit.client.1.smithi134.stdout:9/199: dwrite d2/d5/d9/f30 [0,4194304] 0 2024-09-17T04:20:45.135 INFO:tasks.workunit.client.1.smithi134.stdout:9/200: rename d2/d5/c20 to d2/d5/d9/c41 0 2024-09-17T04:20:45.137 INFO:tasks.workunit.client.1.smithi134.stdout:9/201: mkdir d2/d5/d8/d1e/d42 0 2024-09-17T04:20:45.141 INFO:tasks.workunit.client.1.smithi134.stdout:9/202: getdents d2/d5/d8 0 2024-09-17T04:20:45.143 INFO:tasks.workunit.client.1.smithi134.stdout:9/203: getdents d2/d5/d8/d1e/d42 0 2024-09-17T04:20:45.150 INFO:tasks.workunit.client.1.smithi134.stdout:9/204: dwrite d2/d5/d37/f2b [0,4194304] 0 2024-09-17T04:20:45.165 INFO:tasks.workunit.client.1.smithi134.stdout:9/205: link d2/d5/d8/d1e/f29 d2/f43 0 2024-09-17T04:20:45.168 INFO:tasks.workunit.client.1.smithi134.stdout:9/206: write d2/f43 [325172,116393] 0 2024-09-17T04:20:45.168 INFO:tasks.workunit.client.1.smithi134.stdout:9/207: readlink d2/d25/l35 0 2024-09-17T04:20:45.170 INFO:tasks.workunit.client.1.smithi134.stdout:9/208: symlink d2/d25/d3a/l44 0 2024-09-17T04:20:45.171 INFO:tasks.workunit.client.1.smithi134.stdout:9/209: chown d2/d5/d8/d1e/d42 42026 1 2024-09-17T04:20:45.171 INFO:tasks.workunit.client.1.smithi134.stdout:9/210: truncate d2/d25/f3c 547439 0 2024-09-17T04:20:45.172 INFO:tasks.workunit.client.1.smithi134.stdout:9/211: chown d2/d5/d8/d1e 444518 1 2024-09-17T04:20:45.172 INFO:tasks.workunit.client.1.smithi134.stdout:9/212: chown d2/d5/d9/d3e 8880 1 2024-09-17T04:20:45.175 INFO:tasks.workunit.client.1.smithi134.stdout:9/213: creat d2/d25/d3a/f45 x:0 0 0 2024-09-17T04:20:45.175 INFO:tasks.workunit.client.1.smithi134.stdout:9/214: chown d2/d7 108 1 2024-09-17T04:20:45.180 INFO:tasks.workunit.client.1.smithi134.stdout:9/215: symlink d2/d5/d37/l46 0 2024-09-17T04:20:45.180 INFO:tasks.workunit.client.1.smithi134.stdout:9/216: write d2/d5/d37/f2b [2556507,90591] 0 2024-09-17T04:20:45.181 INFO:tasks.workunit.client.1.smithi134.stdout:9/217: chown d2/d5/d9/f18 80269 1 2024-09-17T04:20:45.183 INFO:tasks.workunit.client.1.smithi134.stdout:9/218: dread d2/d5/d8/d16/fd [0,4194304] 0 2024-09-17T04:20:45.186 INFO:tasks.workunit.client.1.smithi134.stdout:9/219: dread d2/d5/d9/f2e [0,4194304] 0 2024-09-17T04:20:45.188 INFO:tasks.workunit.client.1.smithi134.stdout:9/220: creat d2/d5/d37/f47 x:0 0 0 2024-09-17T04:20:45.190 INFO:tasks.workunit.client.1.smithi134.stdout:9/221: fdatasync d2/d5/f13 0 2024-09-17T04:20:45.193 INFO:tasks.workunit.client.1.smithi134.stdout:9/222: creat d2/d5/d9/df/f48 x:0 0 0 2024-09-17T04:20:45.193 INFO:tasks.workunit.client.1.smithi134.stdout:9/223: dread - d2/d5/d9/f36 zero size 2024-09-17T04:20:45.194 INFO:tasks.workunit.client.1.smithi134.stdout:9/224: chown d2/d5/d9/df/f48 53319 1 2024-09-17T04:20:45.199 INFO:tasks.workunit.client.1.smithi134.stdout:9/225: dwrite d2/d5/d37/f2b [0,4194304] 0 2024-09-17T04:20:45.200 INFO:tasks.workunit.client.1.smithi134.stdout:9/226: chown d2/d5/d9/f30 430876467 1 2024-09-17T04:20:45.203 INFO:tasks.workunit.client.1.smithi134.stdout:9/227: dread d2/d5/fb [0,4194304] 0 2024-09-17T04:20:45.206 INFO:tasks.workunit.client.1.smithi134.stdout:9/228: symlink d2/d5/l49 0 2024-09-17T04:20:45.207 INFO:tasks.workunit.client.1.smithi134.stdout:9/229: write d2/d5/d9/f30 [3266406,23353] 0 2024-09-17T04:20:45.208 INFO:tasks.workunit.client.1.smithi134.stdout:9/230: chown d2/d5/d37/l46 67 1 2024-09-17T04:20:45.210 INFO:tasks.workunit.client.1.smithi134.stdout:9/231: symlink d2/d5/d9/df/d38/l4a 0 2024-09-17T04:20:45.210 INFO:tasks.workunit.client.1.smithi134.stdout:9/232: read d2/d5/d9/f1c [168582,94092] 0 2024-09-17T04:20:45.212 INFO:tasks.workunit.client.1.smithi134.stdout:9/233: read d2/d5/d8/d1e/f29 [123995,42849] 0 2024-09-17T04:20:45.214 INFO:tasks.workunit.client.1.smithi134.stdout:9/234: creat d2/f4b x:0 0 0 2024-09-17T04:20:45.215 INFO:tasks.workunit.client.1.smithi134.stdout:9/235: getdents d2/d5/d8/d1e/d42 0 2024-09-17T04:20:45.219 INFO:tasks.workunit.client.1.smithi134.stdout:9/236: dread d2/d5/d8/f19 [0,4194304] 0 2024-09-17T04:20:45.225 INFO:tasks.workunit.client.1.smithi134.stdout:9/237: dwrite d2/d5/d9/f2e [0,4194304] 0 2024-09-17T04:20:45.228 INFO:tasks.workunit.client.1.smithi134.stdout:9/238: mkdir d2/d5/d37/d4c 0 2024-09-17T04:20:45.231 INFO:tasks.workunit.client.1.smithi134.stdout:9/239: mknod d2/d5/d9/df/d38/c4d 0 2024-09-17T04:20:45.233 INFO:tasks.workunit.client.1.smithi134.stdout:9/240: write d2/f34 [2751749,1827] 0 2024-09-17T04:20:45.233 INFO:tasks.workunit.client.1.smithi134.stdout:9/241: chown d2/d5/d9/df/d38 685 1 2024-09-17T04:20:45.239 INFO:tasks.workunit.client.1.smithi134.stdout:9/242: dwrite d2/d5/d9/f30 [0,4194304] 0 2024-09-17T04:20:45.243 INFO:tasks.workunit.client.1.smithi134.stdout:9/243: dread d2/d5/d9/f30 [0,4194304] 0 2024-09-17T04:20:45.245 INFO:tasks.workunit.client.1.smithi134.stdout:9/244: mknod d2/d5/d37/d4c/c4e 0 2024-09-17T04:20:45.249 INFO:tasks.workunit.client.1.smithi134.stdout:9/245: dread d2/d5/d9/f2e [0,4194304] 0 2024-09-17T04:20:45.252 INFO:tasks.workunit.client.1.smithi134.stdout:9/246: creat d2/d7/f4f x:0 0 0 2024-09-17T04:20:45.252 INFO:tasks.workunit.client.1.smithi134.stdout:9/247: write d2/f4b [339721,97932] 0 2024-09-17T04:20:45.254 INFO:tasks.workunit.client.1.smithi134.stdout:9/248: write d2/f34 [2497093,113562] 0 2024-09-17T04:20:45.256 INFO:tasks.workunit.client.1.smithi134.stdout:9/249: symlink d2/d5/d37/d4c/l50 0 2024-09-17T04:20:45.263 INFO:tasks.workunit.client.1.smithi134.stdout:9/250: dwrite d2/d5/d9/f30 [0,4194304] 0 2024-09-17T04:20:45.269 INFO:tasks.workunit.client.1.smithi134.stdout:9/251: dwrite d2/d5/fb [0,4194304] 0 2024-09-17T04:20:45.270 INFO:tasks.workunit.client.1.smithi134.stdout:9/252: write d2/d5/d37/f2b [3860943,123254] 0 2024-09-17T04:20:45.274 INFO:tasks.workunit.client.1.smithi134.stdout:9/253: rename d2/d5/l49 to d2/d25/l51 0 2024-09-17T04:20:45.276 INFO:tasks.workunit.client.1.smithi134.stdout:9/254: mknod d2/d5/d9/df/d38/c52 0 2024-09-17T04:20:45.282 INFO:tasks.workunit.client.1.smithi134.stdout:9/255: rmdir d2/d5 39 2024-09-17T04:20:45.291 INFO:tasks.workunit.client.1.smithi134.stdout:9/256: link d2/c2c d2/d5/d37/d4c/c53 0 2024-09-17T04:20:45.292 INFO:tasks.workunit.client.1.smithi134.stdout:9/257: chown d2/d5/d9/df/l2d 1836085816 1 2024-09-17T04:20:45.324 INFO:tasks.workunit.client.1.smithi134.stdout:9/258: truncate d2/d5/d37/f2b 3340130 0 2024-09-17T04:20:45.326 INFO:tasks.workunit.client.1.smithi134.stdout:9/259: mkdir d2/d5/d8/d16/d54 0 2024-09-17T04:20:45.332 INFO:tasks.workunit.client.1.smithi134.stdout:9/260: getdents d2/d5 0 2024-09-17T04:20:45.332 INFO:tasks.workunit.client.1.smithi134.stdout:9/261: fsync d2/d5/d9/df/f48 0 2024-09-17T04:20:45.334 INFO:tasks.workunit.client.1.smithi134.stdout:9/262: mknod d2/c55 0 2024-09-17T04:20:45.336 INFO:tasks.workunit.client.1.smithi134.stdout:9/263: symlink d2/d5/d9/df/d38/l56 0 2024-09-17T04:20:45.425 INFO:tasks.workunit.client.1.smithi134.stdout:9/264: write d2/d5/d37/f2b [81708,127673] 0 2024-09-17T04:20:45.544 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:45 smithi088 ceph-mon[27811]: Updating smithi088:/var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T04:20:45.545 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:45 smithi088 ceph-mon[27811]: Updating smithi134:/var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T04:20:45.545 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:45 smithi088 ceph-mon[27811]: Reconfiguring ceph-exporter.smithi088 (dependencies changed)... 2024-09-17T04:20:45.545 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:45 smithi088 ceph-mon[27811]: Deploying daemon ceph-exporter.smithi088 on smithi088 2024-09-17T04:20:45.545 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:45 smithi088 ceph-mon[27811]: pgmap v13: 65 pgs: 65 active+clean; 199 MiB data, 814 MiB used, 536 GiB / 536 GiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 306 op/s 2024-09-17T04:20:45.645 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:45 smithi134 ceph-mon[35201]: Updating smithi088:/var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T04:20:45.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:45 smithi134 ceph-mon[35201]: Updating smithi134:/var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T04:20:45.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:45 smithi134 ceph-mon[35201]: Reconfiguring ceph-exporter.smithi088 (dependencies changed)... 2024-09-17T04:20:45.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:45 smithi134 ceph-mon[35201]: Deploying daemon ceph-exporter.smithi088 on smithi088 2024-09-17T04:20:45.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:45 smithi134 ceph-mon[35201]: pgmap v13: 65 pgs: 65 active+clean; 199 MiB data, 814 MiB used, 536 GiB / 536 GiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 306 op/s 2024-09-17T04:20:45.648 INFO:tasks.workunit.client.1.smithi134.stdout:9/265: stat d2/d5/d8/c1f 0 2024-09-17T04:20:45.650 INFO:tasks.workunit.client.1.smithi134.stdout:9/266: mkdir d2/d5/d37/d57 0 2024-09-17T04:20:45.652 INFO:tasks.workunit.client.1.smithi134.stdout:9/267: mkdir d2/d5/d58 0 2024-09-17T04:20:45.761 INFO:tasks.workunit.client.1.smithi134.stdout:9/268: chown d2/d5/d9/df 9655 1 2024-09-17T04:20:45.763 INFO:tasks.workunit.client.1.smithi134.stdout:9/269: fdatasync d2/d5/d8/d1e/f29 0 2024-09-17T04:20:45.767 INFO:tasks.workunit.client.1.smithi134.stdout:9/270: mknod d2/d5/d37/d57/c59 0 2024-09-17T04:20:45.773 INFO:tasks.workunit.client.1.smithi134.stdout:9/271: link d2/d5/d37/d4c/c4e d2/d5/c5a 0 2024-09-17T04:20:45.773 INFO:tasks.workunit.client.1.smithi134.stdout:9/272: write d2/d25/f3c [178047,60752] 0 2024-09-17T04:20:45.777 INFO:tasks.workunit.client.1.smithi134.stdout:9/273: symlink d2/d5/d58/l5b 0 2024-09-17T04:20:45.780 INFO:tasks.workunit.client.1.smithi134.stdout:9/274: dread d2/d25/f3c [0,4194304] 0 2024-09-17T04:20:45.783 INFO:tasks.workunit.client.1.smithi134.stdout:9/275: read d2/d5/d9/f30 [425440,72868] 0 2024-09-17T04:20:45.793 INFO:tasks.workunit.client.1.smithi134.stdout:9/276: rmdir d2/d5/d9/d3e 0 2024-09-17T04:20:45.794 INFO:tasks.workunit.client.1.smithi134.stdout:9/277: dread d2/d5/d9/f1c [0,4194304] 0 2024-09-17T04:20:45.798 INFO:tasks.workunit.client.1.smithi134.stdout:9/278: creat d2/d5/d37/d4c/f5c x:0 0 0 2024-09-17T04:20:45.799 INFO:tasks.workunit.client.1.smithi134.stdout:9/279: dread - d2/d5/d9/f36 zero size 2024-09-17T04:20:45.801 INFO:tasks.workunit.client.1.smithi134.stdout:9/280: getdents d2/d7 0 2024-09-17T04:20:45.805 INFO:tasks.workunit.client.1.smithi134.stdout:9/281: getdents d2/d5/d37 0 2024-09-17T04:20:45.807 INFO:tasks.workunit.client.1.smithi134.stdout:9/282: rmdir d2/d5/d37/d4c 39 2024-09-17T04:20:45.812 INFO:tasks.workunit.client.1.smithi134.stdout:9/283: link d2/d25/d3a/l44 d2/d5/d8/d1e/l5d 0 2024-09-17T04:20:45.812 INFO:tasks.workunit.client.1.smithi134.stdout:9/284: dread - d2/d7/f4f zero size 2024-09-17T04:20:45.814 INFO:tasks.workunit.client.1.smithi134.stdout:9/285: mkdir d2/d5/d8/d16/d54/d5e 0 2024-09-17T04:20:45.836 INFO:tasks.workunit.client.1.smithi134.stdout:9/286: truncate d2/d5/d9/f18 718602 0 2024-09-17T04:20:45.837 INFO:tasks.workunit.client.1.smithi134.stdout:9/287: symlink d2/d5/d37/d3f/l5f 0 2024-09-17T04:20:45.839 INFO:tasks.workunit.client.1.smithi134.stdout:9/288: creat d2/d5/d8/f60 x:0 0 0 2024-09-17T04:20:45.841 INFO:tasks.workunit.client.1.smithi134.stdout:9/289: symlink d2/d5/d37/l61 0 2024-09-17T04:20:45.843 INFO:tasks.workunit.client.1.smithi134.stdout:9/290: unlink d2/c3 0 2024-09-17T04:20:45.866 INFO:tasks.workunit.client.1.smithi134.stdout:9/291: truncate d2/d7/f2f 674028 0 2024-09-17T04:20:45.874 INFO:tasks.workunit.client.1.smithi134.stdout:9/292: chown d2/d5/d37/d4c/c4e 5 1 2024-09-17T04:20:45.878 INFO:tasks.workunit.client.1.smithi134.stdout:9/293: dread d2/d5/d9/f30 [0,4194304] 0 2024-09-17T04:20:46.017 INFO:tasks.workunit.client.1.smithi134.stdout:2/4: sync 2024-09-17T04:20:46.018 INFO:tasks.workunit.client.1.smithi134.stdout:2/5: creat f1 x:0 0 0 2024-09-17T04:20:46.020 INFO:tasks.workunit.client.1.smithi134.stdout:2/6: creat f2 x:0 0 0 2024-09-17T04:20:46.020 INFO:tasks.workunit.client.1.smithi134.stdout:2/7: fdatasync f2 0 2024-09-17T04:20:46.021 INFO:tasks.workunit.client.1.smithi134.stdout:2/8: mknod c3 0 2024-09-17T04:20:46.024 INFO:tasks.workunit.client.1.smithi134.stdout:2/9: rename c3 to c4 0 2024-09-17T04:20:46.024 INFO:tasks.workunit.client.1.smithi134.stdout:2/10: chown f0 293 1 2024-09-17T04:20:46.024 INFO:tasks.workunit.client.1.smithi134.stdout:2/11: dread - f1 zero size 2024-09-17T04:20:46.024 INFO:tasks.workunit.client.1.smithi134.stdout:2/12: read - f2 zero size 2024-09-17T04:20:46.026 INFO:tasks.workunit.client.1.smithi134.stdout:2/13: mknod c5 0 2024-09-17T04:20:46.027 INFO:tasks.workunit.client.1.smithi134.stdout:2/14: symlink l6 0 2024-09-17T04:20:46.029 INFO:tasks.workunit.client.1.smithi134.stdout:2/15: rename l6 to l7 0 2024-09-17T04:20:46.029 INFO:tasks.workunit.client.1.smithi134.stdout:2/16: write f1 [416770,94632] 0 2024-09-17T04:20:46.033 INFO:tasks.workunit.client.1.smithi134.stdout:2/17: dread f1 [0,4194304] 0 2024-09-17T04:20:46.074 INFO:tasks.workunit.client.1.smithi134.stdout:2/18: getdents . 0 2024-09-17T04:20:46.076 INFO:tasks.workunit.client.1.smithi134.stdout:2/19: getdents . 0 2024-09-17T04:20:46.077 INFO:tasks.workunit.client.1.smithi134.stdout:2/20: write f2 [457113,78466] 0 2024-09-17T04:20:46.077 INFO:tasks.workunit.client.1.smithi134.stdout:2/21: read f1 [17776,47251] 0 2024-09-17T04:20:46.077 INFO:tasks.workunit.client.1.smithi134.stdout:2/22: rmdir - no directory 2024-09-17T04:20:46.078 INFO:tasks.workunit.client.1.smithi134.stdout:2/23: dread f1 [0,4194304] 0 2024-09-17T04:20:46.082 INFO:tasks.workunit.client.1.smithi134.stdout:2/24: dwrite f2 [0,4194304] 0 2024-09-17T04:20:46.083 INFO:tasks.workunit.client.1.smithi134.stdout:2/25: fsync f0 0 2024-09-17T04:20:46.084 INFO:tasks.workunit.client.1.smithi134.stdout:2/26: write f1 [454538,9646] 0 2024-09-17T04:20:46.087 INFO:tasks.workunit.client.1.smithi134.stdout:2/27: mknod c8 0 2024-09-17T04:20:46.087 INFO:tasks.workunit.client.1.smithi134.stdout:2/28: write f1 [1478857,12327] 0 2024-09-17T04:20:46.093 INFO:tasks.workunit.client.1.smithi134.stdout:2/29: dwrite f1 [0,4194304] 0 2024-09-17T04:20:46.101 INFO:tasks.workunit.client.1.smithi134.stdout:2/30: dwrite f1 [0,4194304] 0 2024-09-17T04:20:46.104 INFO:tasks.workunit.client.1.smithi134.stdout:2/31: symlink l9 0 2024-09-17T04:20:46.104 INFO:tasks.workunit.client.1.smithi134.stdout:2/32: stat c4 0 2024-09-17T04:20:46.105 INFO:tasks.workunit.client.1.smithi134.stdout:3/11: sync 2024-09-17T04:20:46.105 INFO:tasks.workunit.client.1.smithi134.stdout:8/33: sync 2024-09-17T04:20:46.105 INFO:tasks.workunit.client.1.smithi134.stdout:1/18: sync 2024-09-17T04:20:46.105 INFO:tasks.workunit.client.1.smithi134.stdout:0/19: sync 2024-09-17T04:20:46.105 INFO:tasks.workunit.client.1.smithi134.stdout:4/168: sync 2024-09-17T04:20:46.105 INFO:tasks.workunit.client.1.smithi134.stdout:7/23: sync 2024-09-17T04:20:46.105 INFO:tasks.workunit.client.1.smithi134.stdout:6/90: sync 2024-09-17T04:20:46.105 INFO:tasks.workunit.client.1.smithi134.stdout:5/43: sync 2024-09-17T04:20:46.105 INFO:tasks.workunit.client.1.smithi134.stdout:9/294: sync 2024-09-17T04:20:46.106 INFO:tasks.workunit.client.1.smithi134.stdout:6/91: readlink de/lf 0 2024-09-17T04:20:46.108 INFO:tasks.workunit.client.1.smithi134.stdout:2/33: mknod ca 0 2024-09-17T04:20:46.111 INFO:tasks.workunit.client.1.smithi134.stdout:1/19: chown c1 1016563999 1 2024-09-17T04:20:46.111 INFO:tasks.workunit.client.1.smithi134.stdout:1/20: fsync - no filename 2024-09-17T04:20:46.113 INFO:tasks.workunit.client.0.smithi088.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-17T04:20:46.115 INFO:tasks.workunit.client.1.smithi134.stdout:1/21: rename c2 to c5 0 2024-09-17T04:20:46.115 INFO:tasks.workunit.client.1.smithi134.stdout:1/22: rmdir - no directory 2024-09-17T04:20:46.116 INFO:tasks.workunit.client.1.smithi134.stdout:0/20: write f3 [1046519,109455] 0 2024-09-17T04:20:46.116 INFO:tasks.workunit.client.1.smithi134.stdout:8/34: dread f0 [0,4194304] 0 2024-09-17T04:20:46.117 INFO:tasks.workunit.client.1.smithi134.stdout:6/92: chown de/l18 55 1 2024-09-17T04:20:46.118 INFO:tasks.workunit.client.1.smithi134.stdout:2/34: creat fb x:0 0 0 2024-09-17T04:20:46.119 INFO:tasks.workunit.client.1.smithi134.stdout:3/12: dwrite f0 [0,4194304] 0 2024-09-17T04:20:46.120 INFO:tasks.workunit.client.0.smithi088.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-17T04:20:46.120 INFO:tasks.workunit.client.0.smithi088.stderr:+ make 2024-09-17T04:20:46.120 INFO:tasks.workunit.client.1.smithi134.stdout:4/169: dwrite d0/df/f18 [0,4194304] 0 2024-09-17T04:20:46.120 INFO:tasks.workunit.client.1.smithi134.stdout:6/93: chown de/lf 14744 1 2024-09-17T04:20:46.120 INFO:tasks.workunit.client.1.smithi134.stdout:5/44: creat d0/d6/fc x:0 0 0 2024-09-17T04:20:46.121 INFO:tasks.workunit.client.1.smithi134.stdout:6/94: fdatasync f7 0 2024-09-17T04:20:46.122 INFO:tasks.workunit.client.1.smithi134.stdout:7/24: creat d0/f6 x:0 0 0 2024-09-17T04:20:46.125 INFO:tasks.workunit.client.1.smithi134.stdout:9/295: write d2/d5/fb [6101155,82614] 0 2024-09-17T04:20:46.129 INFO:tasks.workunit.client.1.smithi134.stdout:2/35: creat fc x:0 0 0 2024-09-17T04:20:46.130 INFO:tasks.workunit.client.1.smithi134.stdout:3/13: symlink l4 0 2024-09-17T04:20:46.130 INFO:tasks.workunit.client.1.smithi134.stdout:0/21: dread f3 [0,4194304] 0 2024-09-17T04:20:46.131 INFO:tasks.workunit.client.1.smithi134.stdout:3/14: read - f3 zero size 2024-09-17T04:20:46.133 INFO:tasks.workunit.client.1.smithi134.stdout:6/95: dwrite fb [4194304,4194304] 0 2024-09-17T04:20:46.133 INFO:tasks.workunit.client.1.smithi134.stdout:3/15: chown f0 925949291 1 2024-09-17T04:20:46.135 INFO:tasks.workunit.client.1.smithi134.stdout:4/170: mkdir d0/df/d35 0 2024-09-17T04:20:46.135 INFO:tasks.workunit.client.1.smithi134.stdout:3/16: write f0 [3491700,19945] 0 2024-09-17T04:20:46.136 INFO:tasks.workunit.client.1.smithi134.stdout:6/96: rename de/d19/d1a to de/d19/d1a/d1e 22 2024-09-17T04:20:46.139 INFO:tasks.workunit.client.1.smithi134.stdout:2/36: dwrite f0 [0,4194304] 0 2024-09-17T04:20:46.143 INFO:tasks.workunit.client.1.smithi134.stdout:8/35: unlink f2 0 2024-09-17T04:20:46.147 INFO:tasks.workunit.client.1.smithi134.stdout:9/296: symlink d2/d5/d8/d16/l62 0 2024-09-17T04:20:46.147 INFO:tasks.workunit.client.1.smithi134.stdout:4/171: dwrite d0/df/f16 [0,4194304] 0 2024-09-17T04:20:46.147 INFO:tasks.workunit.client.1.smithi134.stdout:7/25: fsync d0/f6 0 2024-09-17T04:20:46.156 INFO:tasks.workunit.client.1.smithi134.stdout:6/97: mkdir de/d19/d1f 0 2024-09-17T04:20:46.157 INFO:tasks.workunit.client.1.smithi134.stdout:2/37: rename c8 to cd 0 2024-09-17T04:20:46.157 INFO:tasks.workunit.client.1.smithi134.stdout:1/23: link c1 c6 0 2024-09-17T04:20:46.157 INFO:tasks.workunit.client.1.smithi134.stdout:1/24: read - no filename 2024-09-17T04:20:46.160 INFO:tasks.workunit.client.1.smithi134.stdout:2/38: fsync fb 0 2024-09-17T04:20:46.160 INFO:tasks.workunit.client.1.smithi134.stdout:7/26: symlink d0/l7 0 2024-09-17T04:20:46.161 INFO:tasks.workunit.client.1.smithi134.stdout:2/39: chown c5 55 1 2024-09-17T04:20:46.161 INFO:tasks.workunit.client.1.smithi134.stdout:0/22: rename c2 to c6 0 2024-09-17T04:20:46.162 INFO:tasks.workunit.client.1.smithi134.stdout:7/27: dread - d0/f6 zero size 2024-09-17T04:20:46.164 INFO:tasks.workunit.client.1.smithi134.stdout:1/25: creat f7 x:0 0 0 2024-09-17T04:20:46.164 INFO:tasks.workunit.client.1.smithi134.stdout:4/172: symlink d0/l36 0 2024-09-17T04:20:46.165 INFO:tasks.workunit.client.1.smithi134.stdout:5/45: getdents d0/d6 0 2024-09-17T04:20:46.166 INFO:tasks.workunit.client.1.smithi134.stdout:1/26: read - f7 zero size 2024-09-17T04:20:46.166 INFO:tasks.workunit.client.1.smithi134.stdout:2/40: creat fe x:0 0 0 2024-09-17T04:20:46.168 INFO:tasks.workunit.client.1.smithi134.stdout:3/17: link l4 l5 0 2024-09-17T04:20:46.169 INFO:tasks.workunit.client.1.smithi134.stdout:0/23: write f3 [1726114,66410] 0 2024-09-17T04:20:46.170 INFO:tasks.workunit.client.1.smithi134.stdout:5/46: mkdir d0/dd 0 2024-09-17T04:20:46.171 INFO:tasks.workunit.client.1.smithi134.stdout:6/98: dwrite de/f12 [0,4194304] 0 2024-09-17T04:20:46.171 INFO:tasks.workunit.client.1.smithi134.stdout:1/27: mknod c8 0 2024-09-17T04:20:46.171 INFO:tasks.workunit.client.1.smithi134.stdout:1/28: rmdir - no directory 2024-09-17T04:20:46.171 INFO:tasks.workunit.client.1.smithi134.stdout:1/29: rmdir - no directory 2024-09-17T04:20:46.172 INFO:tasks.workunit.client.1.smithi134.stdout:3/18: write f3 [872164,85136] 0 2024-09-17T04:20:46.174 INFO:tasks.workunit.client.1.smithi134.stdout:7/28: mkdir d0/d4/d8 0 2024-09-17T04:20:46.174 INFO:tasks.workunit.client.1.smithi134.stdout:0/24: symlink l7 0 2024-09-17T04:20:46.176 INFO:tasks.workunit.client.1.smithi134.stdout:7/29: dread - d0/f6 zero size 2024-09-17T04:20:46.176 INFO:tasks.workunit.client.1.smithi134.stdout:0/25: dread - f4 zero size 2024-09-17T04:20:46.177 INFO:tasks.workunit.client.1.smithi134.stdout:3/19: creat f6 x:0 0 0 2024-09-17T04:20:46.177 INFO:tasks.workunit.client.1.smithi134.stdout:9/297: dwrite d2/d7/f4f [0,4194304] 0 2024-09-17T04:20:46.178 INFO:tasks.workunit.client.1.smithi134.stdout:7/30: truncate d0/f6 52857 0 2024-09-17T04:20:46.180 INFO:tasks.workunit.client.1.smithi134.stdout:5/47: mknod d0/d6/ce 0 2024-09-17T04:20:46.187 INFO:tasks.workunit.client.0.smithi088.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-17T04:20:46.187 INFO:tasks.workunit.client.1.smithi134.stdout:9/298: symlink d2/d5/d8/d16/d54/l63 0 2024-09-17T04:20:46.188 INFO:tasks.workunit.client.1.smithi134.stdout:6/99: creat de/d19/d1a/f20 x:0 0 0 2024-09-17T04:20:46.189 INFO:tasks.workunit.client.1.smithi134.stdout:4/173: getdents d0/df 0 2024-09-17T04:20:46.190 INFO:tasks.workunit.client.1.smithi134.stdout:2/41: getdents . 0 2024-09-17T04:20:46.192 INFO:tasks.workunit.client.1.smithi134.stdout:3/20: dwrite f3 [0,4194304] 0 2024-09-17T04:20:46.193 INFO:tasks.workunit.client.1.smithi134.stdout:3/21: rmdir - no directory 2024-09-17T04:20:46.194 INFO:tasks.workunit.client.1.smithi134.stdout:5/48: creat d0/d6/ff x:0 0 0 2024-09-17T04:20:46.194 INFO:tasks.workunit.client.1.smithi134.stdout:7/31: dwrite d0/f6 [0,4194304] 0 2024-09-17T04:20:46.195 INFO:tasks.workunit.client.1.smithi134.stdout:0/26: fsync f0 0 2024-09-17T04:20:46.198 INFO:tasks.workunit.client.1.smithi134.stdout:2/42: creat ff x:0 0 0 2024-09-17T04:20:46.200 INFO:tasks.workunit.client.1.smithi134.stdout:1/30: getdents . 0 2024-09-17T04:20:46.200 INFO:tasks.workunit.client.1.smithi134.stdout:1/31: rmdir - no directory 2024-09-17T04:20:46.200 INFO:tasks.workunit.client.1.smithi134.stdout:1/32: readlink - no filename 2024-09-17T04:20:46.205 INFO:tasks.workunit.client.1.smithi134.stdout:0/27: write f4 [345252,26836] 0 2024-09-17T04:20:46.205 INFO:tasks.workunit.client.1.smithi134.stdout:2/43: write fc [956460,101375] 0 2024-09-17T04:20:46.206 INFO:tasks.workunit.client.1.smithi134.stdout:7/32: mknod d0/c9 0 2024-09-17T04:20:46.207 INFO:tasks.workunit.client.1.smithi134.stdout:2/44: chown l9 20384 1 2024-09-17T04:20:46.210 INFO:tasks.workunit.client.1.smithi134.stdout:6/100: dwrite de/f15 [0,4194304] 0 2024-09-17T04:20:46.211 INFO:tasks.workunit.client.1.smithi134.stdout:4/174: fsync d0/df/d1e/d20/f21 0 2024-09-17T04:20:46.212 INFO:tasks.workunit.client.1.smithi134.stdout:5/49: dread d0/f4 [0,4194304] 0 2024-09-17T04:20:46.212 INFO:tasks.workunit.client.1.smithi134.stdout:6/101: stat c1 0 2024-09-17T04:20:46.213 INFO:tasks.workunit.client.1.smithi134.stdout:0/28: creat f8 x:0 0 0 2024-09-17T04:20:46.213 INFO:tasks.workunit.client.1.smithi134.stdout:7/33: symlink d0/d4/la 0 2024-09-17T04:20:46.213 INFO:tasks.workunit.client.1.smithi134.stdout:3/22: dread f0 [0,4194304] 0 2024-09-17T04:20:46.215 INFO:tasks.workunit.client.1.smithi134.stdout:2/45: rename ca to c10 0 2024-09-17T04:20:46.217 INFO:tasks.workunit.client.1.smithi134.stdout:6/102: chown de/d19/d1f 50839103 1 2024-09-17T04:20:46.218 INFO:tasks.workunit.client.1.smithi134.stdout:0/29: creat f9 x:0 0 0 2024-09-17T04:20:46.220 INFO:tasks.workunit.client.1.smithi134.stdout:2/46: write fe [146246,80406] 0 2024-09-17T04:20:46.220 INFO:tasks.workunit.client.1.smithi134.stdout:1/33: dwrite f7 [0,4194304] 0 2024-09-17T04:20:46.220 INFO:tasks.workunit.client.1.smithi134.stdout:6/103: read f7 [100049,24733] 0 2024-09-17T04:20:46.222 INFO:tasks.workunit.client.1.smithi134.stdout:4/175: rename d0/df/d1e/d20/c27 to d0/d13/c37 0 2024-09-17T04:20:46.222 INFO:tasks.workunit.client.1.smithi134.stdout:5/50: rmdir d0/dd 0 2024-09-17T04:20:46.224 INFO:tasks.workunit.client.1.smithi134.stdout:0/30: creat fa x:0 0 0 2024-09-17T04:20:46.225 INFO:tasks.workunit.client.1.smithi134.stdout:6/104: mkdir de/d19/d21 0 2024-09-17T04:20:46.228 INFO:tasks.workunit.client.1.smithi134.stdout:2/47: rename f0 to f11 0 2024-09-17T04:20:46.230 INFO:tasks.workunit.client.1.smithi134.stdout:4/176: creat d0/df/d17/f38 x:0 0 0 2024-09-17T04:20:46.230 INFO:tasks.workunit.client.1.smithi134.stdout:0/31: truncate f8 631859 0 2024-09-17T04:20:46.232 INFO:tasks.workunit.client.1.smithi134.stdout:3/23: dread f3 [0,4194304] 0 2024-09-17T04:20:46.232 INFO:tasks.workunit.client.1.smithi134.stdout:6/105: write de/d19/d1a/f20 [989139,6520] 0 2024-09-17T04:20:46.234 INFO:tasks.workunit.client.1.smithi134.stdout:7/34: dwrite d0/f6 [0,4194304] 0 2024-09-17T04:20:46.234 INFO:tasks.workunit.client.1.smithi134.stdout:4/177: read d0/d13/f33 [5794134,72192] 0 2024-09-17T04:20:46.235 INFO:tasks.workunit.client.1.smithi134.stdout:2/48: link fc f12 0 2024-09-17T04:20:46.236 INFO:tasks.workunit.client.1.smithi134.stdout:6/106: truncate fd 342694 0 2024-09-17T04:20:46.237 INFO:tasks.workunit.client.1.smithi134.stdout:7/35: chown d0/d4/d8 811362 1 2024-09-17T04:20:46.240 INFO:tasks.workunit.client.1.smithi134.stdout:1/34: dread f7 [0,4194304] 0 2024-09-17T04:20:46.240 INFO:tasks.workunit.client.1.smithi134.stdout:4/178: chown d0/df/d1e 14206379 1 2024-09-17T04:20:46.240 INFO:tasks.workunit.client.1.smithi134.stdout:0/32: fsync f8 0 2024-09-17T04:20:46.242 INFO:tasks.workunit.client.1.smithi134.stdout:6/107: write de/f12 [1258908,124800] 0 2024-09-17T04:20:46.245 INFO:tasks.workunit.client.1.smithi134.stdout:2/49: unlink fe 0 2024-09-17T04:20:46.247 INFO:tasks.workunit.client.1.smithi134.stdout:9/299: dwrite d2/d5/f13 [0,4194304] 0 2024-09-17T04:20:46.250 INFO:tasks.workunit.client.1.smithi134.stdout:2/50: write f1 [4136185,128349] 0 2024-09-17T04:20:46.255 INFO:tasks.workunit.client.1.smithi134.stdout:5/51: truncate d0/f2 1358164 0 2024-09-17T04:20:46.257 INFO:tasks.workunit.client.1.smithi134.stdout:7/36: dread d0/f6 [0,4194304] 0 2024-09-17T04:20:46.258 INFO:tasks.workunit.client.1.smithi134.stdout:0/33: unlink c5 0 2024-09-17T04:20:46.258 INFO:tasks.workunit.client.1.smithi134.stdout:4/179: dwrite d0/d13/f1f [0,4194304] 0 2024-09-17T04:20:46.260 INFO:tasks.workunit.client.1.smithi134.stdout:9/300: symlink d2/d5/d8/d1e/l64 0 2024-09-17T04:20:46.265 INFO:tasks.workunit.client.1.smithi134.stdout:3/24: dwrite f0 [0,4194304] 0 2024-09-17T04:20:46.267 INFO:tasks.workunit.client.1.smithi134.stdout:3/25: readlink l2 0 2024-09-17T04:20:46.267 INFO:tasks.workunit.client.1.smithi134.stdout:3/26: rmdir - no directory 2024-09-17T04:20:46.268 INFO:tasks.workunit.client.1.smithi134.stdout:9/301: stat d2/d5/d9/df/d38/l4a 0 2024-09-17T04:20:46.268 INFO:tasks.workunit.client.1.smithi134.stdout:4/180: truncate d0/df/f29 4444129 0 2024-09-17T04:20:46.269 INFO:tasks.workunit.client.1.smithi134.stdout:7/37: creat d0/d4/d8/fb x:0 0 0 2024-09-17T04:20:46.271 INFO:tasks.workunit.client.1.smithi134.stdout:3/27: mknod c7 0 2024-09-17T04:20:46.273 INFO:tasks.workunit.client.1.smithi134.stdout:2/51: dwrite f2 [0,4194304] 0 2024-09-17T04:20:46.273 INFO:tasks.workunit.client.1.smithi134.stdout:3/28: symlink l8 0 2024-09-17T04:20:46.275 INFO:tasks.workunit.client.1.smithi134.stdout:7/38: chown d0/c9 2907 1 2024-09-17T04:20:46.278 INFO:tasks.workunit.client.1.smithi134.stdout:3/29: creat f9 x:0 0 0 2024-09-17T04:20:46.278 INFO:tasks.workunit.client.1.smithi134.stdout:5/52: dwrite d0/d6/fc [0,4194304] 0 2024-09-17T04:20:46.279 INFO:tasks.workunit.client.1.smithi134.stdout:0/34: dwrite fa [0,4194304] 0 2024-09-17T04:20:46.282 INFO:tasks.workunit.client.1.smithi134.stdout:6/108: truncate de/d19/d1a/f20 859559 0 2024-09-17T04:20:46.287 INFO:tasks.workunit.client.1.smithi134.stdout:0/35: mknod cb 0 2024-09-17T04:20:46.289 INFO:tasks.workunit.client.1.smithi134.stdout:7/39: write d0/f6 [1629597,87691] 0 2024-09-17T04:20:46.291 INFO:tasks.workunit.client.1.smithi134.stdout:3/30: rename l5 to la 0 2024-09-17T04:20:46.293 INFO:tasks.workunit.client.1.smithi134.stdout:0/36: mknod cc 0 2024-09-17T04:20:46.294 INFO:tasks.workunit.client.1.smithi134.stdout:6/109: creat de/d19/f22 x:0 0 0 2024-09-17T04:20:46.295 INFO:tasks.workunit.client.1.smithi134.stdout:0/37: fsync f9 0 2024-09-17T04:20:46.296 INFO:tasks.workunit.client.1.smithi134.stdout:4/181: dwrite d0/df/d17/f38 [0,4194304] 0 2024-09-17T04:20:46.297 INFO:tasks.workunit.client.1.smithi134.stdout:9/302: dwrite d2/d5/d8/d16/fd [4194304,4194304] 0 2024-09-17T04:20:46.297 INFO:tasks.workunit.client.1.smithi134.stdout:3/31: creat fb x:0 0 0 2024-09-17T04:20:46.298 INFO:tasks.workunit.client.1.smithi134.stdout:6/110: truncate de/f13 984586 0 2024-09-17T04:20:46.298 INFO:tasks.workunit.client.1.smithi134.stdout:7/40: mkdir d0/d4/d8/dc 0 2024-09-17T04:20:46.299 INFO:tasks.workunit.client.1.smithi134.stdout:3/32: truncate f3 4449866 0 2024-09-17T04:20:46.300 INFO:tasks.workunit.client.1.smithi134.stdout:3/33: stat l8 0 2024-09-17T04:20:46.301 INFO:tasks.workunit.client.1.smithi134.stdout:4/182: chown d0/d13/f33 31692421 1 2024-09-17T04:20:46.303 INFO:tasks.workunit.client.1.smithi134.stdout:9/303: write d2/d5/d8/d16/fd [2779225,19750] 0 2024-09-17T04:20:46.305 INFO:tasks.workunit.client.1.smithi134.stdout:4/183: fsync d0/d13/f1f 0 2024-09-17T04:20:46.307 INFO:tasks.workunit.client.1.smithi134.stdout:9/304: chown d2/d5/d9/f1c 7255351 1 2024-09-17T04:20:46.308 INFO:tasks.workunit.client.1.smithi134.stdout:3/34: creat fc x:0 0 0 2024-09-17T04:20:46.309 INFO:tasks.workunit.client.1.smithi134.stdout:2/52: fsync f2 0 2024-09-17T04:20:46.310 INFO:tasks.workunit.client.1.smithi134.stdout:8/36: sync 2024-09-17T04:20:46.311 INFO:tasks.workunit.client.1.smithi134.stdout:3/35: write f6 [959414,71544] 0 2024-09-17T04:20:46.312 INFO:tasks.workunit.client.1.smithi134.stdout:8/37: chown d4 50454 1 2024-09-17T04:20:46.312 INFO:tasks.workunit.client.1.smithi134.stdout:7/41: truncate d0/d4/d8/fb 129307 0 2024-09-17T04:20:46.314 INFO:tasks.workunit.client.1.smithi134.stdout:0/38: dwrite f8 [0,4194304] 0 2024-09-17T04:20:46.316 INFO:tasks.workunit.client.1.smithi134.stdout:8/38: read d4/f6 [578141,86963] 0 2024-09-17T04:20:46.317 INFO:tasks.workunit.client.1.smithi134.stdout:6/111: dread de/f15 [0,4194304] 0 2024-09-17T04:20:46.317 INFO:tasks.workunit.client.1.smithi134.stdout:9/305: creat d2/d5/d37/d4c/f65 x:0 0 0 2024-09-17T04:20:46.321 INFO:tasks.workunit.client.1.smithi134.stdout:5/53: write d0/f4 [2460984,24047] 0 2024-09-17T04:20:46.322 INFO:tasks.workunit.client.1.smithi134.stdout:4/184: dread d0/df/d1e/d20/f21 [0,4194304] 0 2024-09-17T04:20:46.323 INFO:tasks.workunit.client.1.smithi134.stdout:0/39: fdatasync f0 0 2024-09-17T04:20:46.323 INFO:tasks.workunit.client.1.smithi134.stdout:8/39: write f3 [675937,71298] 0 2024-09-17T04:20:46.327 INFO:tasks.workunit.client.1.smithi134.stdout:0/40: stat f9 0 2024-09-17T04:20:46.330 INFO:tasks.workunit.client.1.smithi134.stdout:8/40: write f3 [693628,27921] 0 2024-09-17T04:20:46.334 INFO:tasks.workunit.client.1.smithi134.stdout:2/53: dwrite f11 [0,4194304] 0 2024-09-17T04:20:46.335 INFO:tasks.workunit.client.1.smithi134.stdout:3/36: dwrite f6 [0,4194304] 0 2024-09-17T04:20:46.335 INFO:tasks.workunit.client.1.smithi134.stdout:7/42: dwrite d0/f6 [0,4194304] 0 2024-09-17T04:20:46.338 INFO:tasks.workunit.client.1.smithi134.stdout:1/35: sync 2024-09-17T04:20:46.339 INFO:tasks.workunit.client.1.smithi134.stdout:2/54: write f11 [5039661,113291] 0 2024-09-17T04:20:46.343 INFO:tasks.workunit.client.1.smithi134.stdout:5/54: dwrite d0/f8 [0,4194304] 0 2024-09-17T04:20:46.344 INFO:tasks.workunit.client.1.smithi134.stdout:8/41: dread f0 [0,4194304] 0 2024-09-17T04:20:46.346 INFO:tasks.workunit.client.1.smithi134.stdout:8/42: truncate f3 1669515 0 2024-09-17T04:20:46.348 INFO:tasks.workunit.client.1.smithi134.stdout:7/43: dwrite d0/d4/d8/fb [0,4194304] 0 2024-09-17T04:20:46.411 INFO:tasks.workunit.client.1.smithi134.stdout:0/41: dread f4 [0,4194304] 0 2024-09-17T04:20:46.417 INFO:tasks.workunit.client.1.smithi134.stdout:9/306: creat d2/d5/d8/d16/d54/f66 x:0 0 0 2024-09-17T04:20:46.419 INFO:tasks.workunit.client.1.smithi134.stdout:4/185: write d0/df/d1e/f25 [4048952,54306] 0 2024-09-17T04:20:46.421 INFO:tasks.workunit.client.1.smithi134.stdout:3/37: chown la 9053 1 2024-09-17T04:20:46.421 INFO:tasks.workunit.client.1.smithi134.stdout:3/38: stat fb 0 2024-09-17T04:20:46.425 INFO:tasks.workunit.client.1.smithi134.stdout:1/36: mknod c9 0 2024-09-17T04:20:46.427 INFO:tasks.workunit.client.1.smithi134.stdout:2/55: unlink fb 0 2024-09-17T04:20:46.427 INFO:tasks.workunit.client.1.smithi134.stdout:2/56: rmdir - no directory 2024-09-17T04:20:46.429 INFO:tasks.workunit.client.1.smithi134.stdout:2/57: read f1 [99140,99019] 0 2024-09-17T04:20:46.429 INFO:tasks.workunit.client.1.smithi134.stdout:3/39: fsync fc 0 2024-09-17T04:20:46.429 INFO:tasks.workunit.client.1.smithi134.stdout:5/55: mknod d0/c10 0 2024-09-17T04:20:46.429 INFO:tasks.workunit.client.1.smithi134.stdout:3/40: dread - fc zero size 2024-09-17T04:20:46.429 INFO:tasks.workunit.client.1.smithi134.stdout:5/56: fsync d0/f4 0 2024-09-17T04:20:46.510 INFO:tasks.workunit.client.1.smithi134.stdout:6/112: creat de/d19/d21/f23 x:0 0 0 2024-09-17T04:20:46.510 INFO:tasks.workunit.client.1.smithi134.stdout:0/42: mknod cd 0 2024-09-17T04:20:46.510 INFO:tasks.workunit.client.1.smithi134.stdout:0/43: truncate f9 577404 0 2024-09-17T04:20:46.510 INFO:tasks.workunit.client.1.smithi134.stdout:4/186: rmdir d0/df/d17 39 2024-09-17T04:20:46.512 INFO:tasks.workunit.client.1.smithi134.stdout:1/37: creat fa x:0 0 0 2024-09-17T04:20:46.513 INFO:tasks.workunit.client.1.smithi134.stdout:1/38: write fa [791398,47056] 0 2024-09-17T04:20:46.515 INFO:tasks.workunit.client.1.smithi134.stdout:3/41: rename fb to fd 0 2024-09-17T04:20:46.515 INFO:tasks.workunit.client.1.smithi134.stdout:0/44: dread f8 [0,4194304] 0 2024-09-17T04:20:46.515 INFO:tasks.workunit.client.1.smithi134.stdout:5/57: unlink d0/l7 0 2024-09-17T04:20:46.518 INFO:tasks.workunit.client.1.smithi134.stdout:0/45: dread f3 [0,4194304] 0 2024-09-17T04:20:46.519 INFO:tasks.workunit.client.1.smithi134.stdout:9/307: truncate d2/d5/d37/f2b 760647 0 2024-09-17T04:20:46.520 INFO:tasks.workunit.client.1.smithi134.stdout:1/39: dread fa [0,4194304] 0 2024-09-17T04:20:46.523 INFO:tasks.workunit.client.1.smithi134.stdout:3/42: mkdir de 0 2024-09-17T04:20:46.524 INFO:tasks.workunit.client.1.smithi134.stdout:5/58: creat d0/f11 x:0 0 0 2024-09-17T04:20:46.525 INFO:tasks.workunit.client.1.smithi134.stdout:7/44: rmdir d0/d4/d8/dc 0 2024-09-17T04:20:46.526 INFO:tasks.workunit.client.1.smithi134.stdout:3/43: dread f6 [0,4194304] 0 2024-09-17T04:20:46.527 INFO:tasks.workunit.client.1.smithi134.stdout:0/46: rename fa to fe 0 2024-09-17T04:20:46.527 INFO:tasks.workunit.client.1.smithi134.stdout:4/187: mkdir d0/df/d35/d39 0 2024-09-17T04:20:46.528 INFO:tasks.workunit.client.1.smithi134.stdout:9/308: chown d2/d25/d3a/f45 136 1 2024-09-17T04:20:46.529 INFO:tasks.workunit.client.1.smithi134.stdout:1/40: rename c5 to cb 0 2024-09-17T04:20:46.529 INFO:tasks.workunit.client.1.smithi134.stdout:2/58: link l9 l13 0 2024-09-17T04:20:46.530 INFO:tasks.workunit.client.1.smithi134.stdout:1/41: chown c9 29096 1 2024-09-17T04:20:46.535 INFO:tasks.workunit.client.1.smithi134.stdout:0/47: rename f8 to ff 0 2024-09-17T04:20:46.536 INFO:tasks.workunit.client.1.smithi134.stdout:2/59: dwrite ff [0,4194304] 0 2024-09-17T04:20:46.536 INFO:tasks.workunit.client.1.smithi134.stdout:0/48: chown fe 29 1 2024-09-17T04:20:46.537 INFO:tasks.workunit.client.1.smithi134.stdout:4/188: unlink d0/df/f29 0 2024-09-17T04:20:46.540 INFO:tasks.workunit.client.1.smithi134.stdout:1/42: write fa [645860,52738] 0 2024-09-17T04:20:46.542 INFO:tasks.workunit.client.1.smithi134.stdout:5/59: mkdir d0/da/d12 0 2024-09-17T04:20:46.547 INFO:tasks.workunit.client.1.smithi134.stdout:3/44: creat de/ff x:0 0 0 2024-09-17T04:20:46.548 INFO:tasks.workunit.client.1.smithi134.stdout:2/60: write f1 [4419601,34527] 0 2024-09-17T04:20:46.548 INFO:tasks.workunit.client.1.smithi134.stdout:2/61: rmdir - no directory 2024-09-17T04:20:46.548 INFO:tasks.workunit.client.1.smithi134.stdout:0/49: creat f10 x:0 0 0 2024-09-17T04:20:46.549 INFO:tasks.workunit.client.1.smithi134.stdout:9/309: creat d2/d5/d8/d1e/d42/f67 x:0 0 0 2024-09-17T04:20:46.550 INFO:tasks.workunit.client.1.smithi134.stdout:9/310: stat d2/d5/c5a 0 2024-09-17T04:20:46.551 INFO:tasks.workunit.client.1.smithi134.stdout:4/189: stat d0/df/d17/f24 0 2024-09-17T04:20:46.551 INFO:tasks.workunit.client.1.smithi134.stdout:9/311: dread - d2/d5/d9/f36 zero size 2024-09-17T04:20:46.551 INFO:tasks.workunit.client.1.smithi134.stdout:1/43: mknod cc 0 2024-09-17T04:20:46.552 INFO:tasks.workunit.client.1.smithi134.stdout:4/190: write d0/df/f18 [1888501,49010] 0 2024-09-17T04:20:46.553 INFO:tasks.workunit.client.1.smithi134.stdout:3/45: mkdir de/d10 0 2024-09-17T04:20:46.554 INFO:tasks.workunit.client.1.smithi134.stdout:2/62: mkdir d14 0 2024-09-17T04:20:46.555 INFO:tasks.workunit.client.1.smithi134.stdout:0/50: mkdir d11 0 2024-09-17T04:20:46.557 INFO:tasks.workunit.client.1.smithi134.stdout:9/312: chown d2/l22 544306226 1 2024-09-17T04:20:46.558 INFO:tasks.workunit.client.1.smithi134.stdout:1/44: rename fa to fd 0 2024-09-17T04:20:46.559 INFO:tasks.workunit.client.1.smithi134.stdout:9/313: dread - d2/d5/d37/d4c/f5c zero size 2024-09-17T04:20:46.561 INFO:tasks.workunit.client.1.smithi134.stdout:1/45: dread fd [0,4194304] 0 2024-09-17T04:20:46.561 INFO:tasks.workunit.client.1.smithi134.stdout:3/46: dwrite fc [0,4194304] 0 2024-09-17T04:20:46.563 INFO:tasks.workunit.client.1.smithi134.stdout:9/314: write d2/d5/d9/df/f48 [936853,107707] 0 2024-09-17T04:20:46.567 INFO:tasks.workunit.client.1.smithi134.stdout:2/63: unlink l9 0 2024-09-17T04:20:46.568 INFO:tasks.workunit.client.1.smithi134.stdout:3/47: write de/ff [470397,29231] 0 2024-09-17T04:20:46.569 INFO:tasks.workunit.client.1.smithi134.stdout:1/46: write f7 [1446910,119966] 0 2024-09-17T04:20:46.571 INFO:tasks.workunit.client.1.smithi134.stdout:3/48: truncate f9 822223 0 2024-09-17T04:20:46.572 INFO:tasks.workunit.client.1.smithi134.stdout:0/51: dwrite f3 [0,4194304] 0 2024-09-17T04:20:46.573 INFO:tasks.workunit.client.1.smithi134.stdout:9/315: fdatasync d2/d7/f2f 0 2024-09-17T04:20:46.579 INFO:tasks.workunit.client.1.smithi134.stdout:0/52: unlink f4 0 2024-09-17T04:20:46.581 INFO:tasks.workunit.client.1.smithi134.stdout:9/316: dwrite d2/d5/f13 [0,4194304] 0 2024-09-17T04:20:46.582 INFO:tasks.workunit.client.1.smithi134.stdout:2/64: rmdir d14 0 2024-09-17T04:20:46.586 INFO:tasks.workunit.client.1.smithi134.stdout:2/65: unlink c4 0 2024-09-17T04:20:46.587 INFO:tasks.workunit.client.1.smithi134.stdout:0/53: unlink c6 0 2024-09-17T04:20:46.590 INFO:tasks.workunit.client.1.smithi134.stdout:2/66: symlink l15 0 2024-09-17T04:20:46.593 INFO:tasks.workunit.client.1.smithi134.stdout:2/67: creat f16 x:0 0 0 2024-09-17T04:20:46.593 INFO:tasks.workunit.client.1.smithi134.stdout:2/68: fsync ff 0 2024-09-17T04:20:46.594 INFO:tasks.workunit.client.1.smithi134.stdout:0/54: link fe d11/f12 0 2024-09-17T04:20:46.596 INFO:tasks.workunit.client.1.smithi134.stdout:2/69: symlink l17 0 2024-09-17T04:20:46.597 INFO:tasks.workunit.client.1.smithi134.stdout:0/55: rmdir d11 39 2024-09-17T04:20:46.598 INFO:tasks.workunit.client.1.smithi134.stdout:2/70: fdatasync f12 0 2024-09-17T04:20:46.600 INFO:tasks.workunit.client.1.smithi134.stdout:2/71: symlink l18 0 2024-09-17T04:20:46.602 INFO:tasks.workunit.client.1.smithi134.stdout:2/72: mkdir d19 0 2024-09-17T04:20:46.605 INFO:tasks.workunit.client.1.smithi134.stdout:2/73: creat d19/f1a x:0 0 0 2024-09-17T04:20:46.605 INFO:tasks.workunit.client.1.smithi134.stdout:0/56: dwrite f9 [0,4194304] 0 2024-09-17T04:20:46.607 INFO:tasks.workunit.client.1.smithi134.stdout:0/57: creat d11/f13 x:0 0 0 2024-09-17T04:20:46.609 INFO:tasks.workunit.client.1.smithi134.stdout:2/74: link f2 d19/f1b 0 2024-09-17T04:20:46.610 INFO:tasks.workunit.client.1.smithi134.stdout:0/58: creat d11/f14 x:0 0 0 2024-09-17T04:20:46.612 INFO:tasks.workunit.client.1.smithi134.stdout:0/59: creat d11/f15 x:0 0 0 2024-09-17T04:20:46.614 INFO:tasks.workunit.client.1.smithi134.stdout:0/60: symlink d11/l16 0 2024-09-17T04:20:46.620 INFO:tasks.workunit.client.1.smithi134.stdout:0/61: dwrite d11/f13 [0,4194304] 0 2024-09-17T04:20:46.622 INFO:tasks.workunit.client.1.smithi134.stdout:6/113: sync 2024-09-17T04:20:46.622 INFO:tasks.workunit.client.1.smithi134.stdout:0/62: symlink d11/l17 0 2024-09-17T04:20:46.623 INFO:tasks.workunit.client.1.smithi134.stdout:0/63: fdatasync d11/f14 0 2024-09-17T04:20:46.623 INFO:tasks.workunit.client.1.smithi134.stdout:0/64: dread - f10 zero size 2024-09-17T04:20:46.624 INFO:tasks.workunit.client.1.smithi134.stdout:6/114: creat de/d19/f24 x:0 0 0 2024-09-17T04:20:46.624 INFO:tasks.workunit.client.1.smithi134.stdout:8/43: truncate f0 2974586 0 2024-09-17T04:20:46.626 INFO:tasks.workunit.client.1.smithi134.stdout:0/65: write d11/f12 [5051749,25924] 0 2024-09-17T04:20:46.627 INFO:tasks.workunit.client.1.smithi134.stdout:6/115: creat de/d19/d21/f25 x:0 0 0 2024-09-17T04:20:46.658 INFO:tasks.workunit.client.1.smithi134.stdout:8/44: creat d4/f7 x:0 0 0 2024-09-17T04:20:46.658 INFO:tasks.workunit.client.1.smithi134.stdout:9/317: truncate d2/d7/f2f 955967 0 2024-09-17T04:20:46.659 INFO:tasks.workunit.client.1.smithi134.stdout:8/45: symlink d4/l8 0 2024-09-17T04:20:46.662 INFO:tasks.workunit.client.1.smithi134.stdout:6/116: creat de/d19/d1f/f26 x:0 0 0 2024-09-17T04:20:46.662 INFO:tasks.workunit.client.1.smithi134.stdout:6/117: stat de/f13 0 2024-09-17T04:20:46.663 INFO:tasks.workunit.client.1.smithi134.stdout:6/118: chown c1 7 1 2024-09-17T04:20:46.664 INFO:tasks.workunit.client.1.smithi134.stdout:7/45: rename d0/d4/d8 to d0/dd 0 2024-09-17T04:20:46.666 INFO:tasks.workunit.client.1.smithi134.stdout:8/46: mknod d4/c9 0 2024-09-17T04:20:46.666 INFO:tasks.workunit.client.1.smithi134.stdout:7/46: read d0/f6 [3163757,117085] 0 2024-09-17T04:20:46.666 INFO:tasks.workunit.client.1.smithi134.stdout:6/119: rmdir de 39 2024-09-17T04:20:46.669 INFO:tasks.workunit.client.1.smithi134.stdout:5/60: rename d0/d6/c9 to d0/da/d12/c13 0 2024-09-17T04:20:46.672 INFO:tasks.workunit.client.1.smithi134.stdout:7/47: creat d0/dd/fe x:0 0 0 2024-09-17T04:20:46.677 INFO:tasks.workunit.client.1.smithi134.stdout:6/120: symlink de/d19/d1f/l27 0 2024-09-17T04:20:46.677 INFO:tasks.workunit.client.1.smithi134.stdout:6/121: dread - de/d19/f24 zero size 2024-09-17T04:20:46.677 INFO:tasks.workunit.client.1.smithi134.stdout:6/122: fdatasync f8 0 2024-09-17T04:20:46.679 INFO:tasks.workunit.client.1.smithi134.stdout:6/123: dread fd [0,4194304] 0 2024-09-17T04:20:46.679 INFO:tasks.workunit.client.1.smithi134.stdout:6/124: fdatasync de/f13 0 2024-09-17T04:20:46.682 INFO:tasks.workunit.client.1.smithi134.stdout:9/318: rename d2/d25/d3a/f45 to d2/d5/f68 0 2024-09-17T04:20:46.685 INFO:tasks.workunit.client.1.smithi134.stdout:6/125: creat de/d19/d1f/f28 x:0 0 0 2024-09-17T04:20:46.685 INFO:tasks.workunit.client.1.smithi134.stdout:1/47: fsync fd 0 2024-09-17T04:20:46.687 INFO:tasks.workunit.client.1.smithi134.stdout:9/319: mknod d2/d5/d8/d16/d54/c69 0 2024-09-17T04:20:46.688 INFO:tasks.workunit.client.1.smithi134.stdout:4/191: truncate d0/df/d17/f38 1629262 0 2024-09-17T04:20:46.689 INFO:tasks.workunit.client.1.smithi134.stdout:6/126: mknod de/c29 0 2024-09-17T04:20:46.691 INFO:tasks.workunit.client.1.smithi134.stdout:1/48: stat c1 0 2024-09-17T04:20:46.692 INFO:tasks.workunit.client.1.smithi134.stdout:1/49: fdatasync f7 0 2024-09-17T04:20:46.695 INFO:tasks.workunit.client.1.smithi134.stdout:9/320: dwrite d2/d7/f4f [0,4194304] 0 2024-09-17T04:20:46.697 INFO:tasks.workunit.client.1.smithi134.stdout:9/321: write d2/d5/fb [4353879,45998] 0 2024-09-17T04:20:46.697 INFO:tasks.workunit.client.1.smithi134.stdout:3/49: truncate f0 4127840 0 2024-09-17T04:20:46.699 INFO:tasks.workunit.client.1.smithi134.stdout:1/50: rename f7 to fe 0 2024-09-17T04:20:46.700 INFO:tasks.workunit.client.1.smithi134.stdout:6/127: dwrite de/d19/f24 [0,4194304] 0 2024-09-17T04:20:46.703 INFO:tasks.workunit.client.1.smithi134.stdout:1/51: creat ff x:0 0 0 2024-09-17T04:20:46.703 INFO:tasks.workunit.client.1.smithi134.stdout:3/50: dread de/ff [0,4194304] 0 2024-09-17T04:20:46.704 INFO:tasks.workunit.client.1.smithi134.stdout:6/128: dread f9 [0,4194304] 0 2024-09-17T04:20:46.705 INFO:tasks.workunit.client.1.smithi134.stdout:9/322: getdents d2/d7 0 2024-09-17T04:20:46.708 INFO:tasks.workunit.client.1.smithi134.stdout:2/75: fsync d19/f1a 0 2024-09-17T04:20:46.710 INFO:tasks.workunit.client.1.smithi134.stdout:6/129: creat de/d19/d1f/f2a x:0 0 0 2024-09-17T04:20:46.711 INFO:tasks.workunit.client.1.smithi134.stdout:6/130: fsync f8 0 2024-09-17T04:20:46.712 INFO:tasks.workunit.client.1.smithi134.stdout:9/323: dwrite d2/d5/f13 [0,4194304] 0 2024-09-17T04:20:46.712 INFO:tasks.workunit.client.1.smithi134.stdout:6/131: chown c1 24 1 2024-09-17T04:20:46.713 INFO:tasks.workunit.client.1.smithi134.stdout:6/132: dread - de/d19/d21/f23 zero size 2024-09-17T04:20:46.713 INFO:tasks.workunit.client.1.smithi134.stdout:3/51: creat de/d10/f11 x:0 0 0 2024-09-17T04:20:46.716 INFO:tasks.workunit.client.1.smithi134.stdout:9/324: read d2/f4b [148066,39048] 0 2024-09-17T04:20:46.717 INFO:tasks.workunit.client.1.smithi134.stdout:3/52: mkdir de/d12 0 2024-09-17T04:20:46.718 INFO:tasks.workunit.client.1.smithi134.stdout:9/325: fsync d2/d5/d9/df/f48 0 2024-09-17T04:20:46.719 INFO:tasks.workunit.client.1.smithi134.stdout:0/66: getdents d11 0 2024-09-17T04:20:46.721 INFO:tasks.workunit.client.1.smithi134.stdout:6/133: read de/d19/d1a/f20 [156926,94470] 0 2024-09-17T04:20:46.721 INFO:tasks.workunit.client.1.smithi134.stdout:0/67: write f10 [357864,73330] 0 2024-09-17T04:20:46.722 INFO:tasks.workunit.client.1.smithi134.stdout:2/76: dread f11 [0,4194304] 0 2024-09-17T04:20:46.723 INFO:tasks.workunit.client.1.smithi134.stdout:8/47: fsync f0 0 2024-09-17T04:20:46.723 INFO:tasks.workunit.client.1.smithi134.stdout:0/68: dread - d11/f15 zero size 2024-09-17T04:20:46.724 INFO:tasks.workunit.client.1.smithi134.stdout:8/48: write d4/f7 [944436,122855] 0 2024-09-17T04:20:46.729 INFO:tasks.workunit.client.1.smithi134.stdout:3/53: dwrite de/ff [0,4194304] 0 2024-09-17T04:20:46.730 INFO:tasks.workunit.client.1.smithi134.stdout:3/54: chown l8 26414962 1 2024-09-17T04:20:46.731 INFO:tasks.workunit.client.1.smithi134.stdout:6/134: fsync de/d19/f24 0 2024-09-17T04:20:46.733 INFO:tasks.workunit.client.1.smithi134.stdout:6/135: chown de/d19/d1f/l27 758915025 1 2024-09-17T04:20:46.733 INFO:tasks.workunit.client.1.smithi134.stdout:7/48: getdents d0/dd 0 2024-09-17T04:20:46.734 INFO:tasks.workunit.client.1.smithi134.stdout:8/49: unlink d4/f6 0 2024-09-17T04:20:46.734 INFO:tasks.workunit.client.1.smithi134.stdout:6/136: read de/f15 [166364,126754] 0 2024-09-17T04:20:46.735 INFO:tasks.workunit.client.1.smithi134.stdout:2/77: mkdir d19/d1c 0 2024-09-17T04:20:46.736 INFO:tasks.workunit.client.1.smithi134.stdout:5/61: write d0/f2 [1653319,48846] 0 2024-09-17T04:20:46.738 INFO:tasks.workunit.client.1.smithi134.stdout:7/49: read d0/f6 [1615586,39079] 0 2024-09-17T04:20:46.738 INFO:tasks.workunit.client.1.smithi134.stdout:9/326: rename d2/d25/d3a to d2/d5/d9/d6a 0 2024-09-17T04:20:46.740 INFO:tasks.workunit.client.1.smithi134.stdout:3/55: dread f6 [0,4194304] 0 2024-09-17T04:20:46.742 INFO:tasks.workunit.client.1.smithi134.stdout:5/62: symlink d0/da/l14 0 2024-09-17T04:20:46.744 INFO:tasks.workunit.client.1.smithi134.stdout:5/63: fdatasync d0/f2 0 2024-09-17T04:20:46.745 INFO:tasks.workunit.client.1.smithi134.stdout:9/327: mkdir d2/d5/d9/d6b 0 2024-09-17T04:20:46.750 INFO:tasks.workunit.client.1.smithi134.stdout:2/78: creat d19/d1c/f1d x:0 0 0 2024-09-17T04:20:46.754 INFO:tasks.workunit.client.1.smithi134.stdout:2/79: read - f16 zero size 2024-09-17T04:20:46.755 INFO:tasks.workunit.client.1.smithi134.stdout:2/80: dread - d19/d1c/f1d zero size 2024-09-17T04:20:46.756 INFO:tasks.workunit.client.1.smithi134.stdout:3/56: link fc de/f13 0 2024-09-17T04:20:46.757 INFO:tasks.workunit.client.1.smithi134.stdout:9/328: getdents d2/d7 0 2024-09-17T04:20:46.757 INFO:tasks.workunit.client.1.smithi134.stdout:7/50: link d0/d4/la d0/d4/lf 0 2024-09-17T04:20:46.758 INFO:tasks.workunit.client.1.smithi134.stdout:7/51: rename d0 to d0/dd/d10 22 2024-09-17T04:20:46.761 INFO:tasks.workunit.client.1.smithi134.stdout:9/329: rename d2/d5/d8/f60 to d2/d5/d9/df/d38/f6c 0 2024-09-17T04:20:46.762 INFO:tasks.workunit.client.1.smithi134.stdout:8/50: getdents d4 0 2024-09-17T04:20:46.763 INFO:tasks.workunit.client.1.smithi134.stdout:3/57: link c1 de/c14 0 2024-09-17T04:20:46.763 INFO:tasks.workunit.client.1.smithi134.stdout:2/81: dread f12 [0,4194304] 0 2024-09-17T04:20:46.764 INFO:tasks.workunit.client.1.smithi134.stdout:7/52: unlink d0/l2 0 2024-09-17T04:20:46.767 INFO:tasks.workunit.client.1.smithi134.stdout:9/330: mkdir d2/d5/d37/d57/d6d 0 2024-09-17T04:20:46.768 INFO:tasks.workunit.client.1.smithi134.stdout:6/137: truncate de/f12 1785853 0 2024-09-17T04:20:46.769 INFO:tasks.workunit.client.1.smithi134.stdout:2/82: dread f12 [0,4194304] 0 2024-09-17T04:20:46.769 INFO:tasks.workunit.client.1.smithi134.stdout:0/69: dwrite ff [0,4194304] 0 2024-09-17T04:20:46.770 INFO:tasks.workunit.client.1.smithi134.stdout:9/331: dread - d2/d5/f68 zero size 2024-09-17T04:20:46.771 INFO:tasks.workunit.client.1.smithi134.stdout:8/51: dread f3 [0,4194304] 0 2024-09-17T04:20:46.771 INFO:tasks.workunit.client.1.smithi134.stdout:3/58: mkdir de/d12/d15 0 2024-09-17T04:20:46.773 INFO:tasks.workunit.client.1.smithi134.stdout:7/53: unlink d0/d4/lf 0 2024-09-17T04:20:46.774 INFO:tasks.workunit.client.1.smithi134.stdout:0/70: mkdir d11/d18 0 2024-09-17T04:20:46.775 INFO:tasks.workunit.client.1.smithi134.stdout:8/52: creat d4/fa x:0 0 0 2024-09-17T04:20:46.777 INFO:tasks.workunit.client.1.smithi134.stdout:9/332: creat d2/d5/d37/d4c/f6e x:0 0 0 2024-09-17T04:20:46.778 INFO:tasks.workunit.client.1.smithi134.stdout:0/71: mkdir d11/d19 0 2024-09-17T04:20:46.778 INFO:tasks.workunit.client.1.smithi134.stdout:4/192: dwrite d0/df/d1e/f25 [0,4194304] 0 2024-09-17T04:20:46.779 INFO:tasks.workunit.client.1.smithi134.stdout:7/54: unlink d0/c9 0 2024-09-17T04:20:46.784 INFO:tasks.workunit.client.1.smithi134.stdout:8/53: rmdir d4 39 2024-09-17T04:20:46.784 INFO:tasks.workunit.client.1.smithi134.stdout:6/138: dwrite f7 [0,4194304] 0 2024-09-17T04:20:46.785 INFO:tasks.workunit.client.1.smithi134.stdout:3/59: dread f6 [0,4194304] 0 2024-09-17T04:20:46.789 INFO:tasks.workunit.client.1.smithi134.stdout:2/83: getdents d19 0 2024-09-17T04:20:46.789 INFO:tasks.workunit.client.1.smithi134.stdout:6/139: fsync de/d19/d1f/f2a 0 2024-09-17T04:20:46.792 INFO:tasks.workunit.client.1.smithi134.stdout:9/333: dread d2/d5/f13 [0,4194304] 0 2024-09-17T04:20:46.793 INFO:tasks.workunit.client.1.smithi134.stdout:8/54: fdatasync f3 0 2024-09-17T04:20:46.794 INFO:tasks.workunit.client.1.smithi134.stdout:0/72: dread ff [0,4194304] 0 2024-09-17T04:20:46.794 INFO:tasks.workunit.client.1.smithi134.stdout:6/140: mkdir de/d2b 0 2024-09-17T04:20:46.796 INFO:tasks.workunit.client.1.smithi134.stdout:7/55: dread d0/f6 [0,4194304] 0 2024-09-17T04:20:46.797 INFO:tasks.workunit.client.1.smithi134.stdout:9/334: dread - d2/d5/d9/df/d38/f6c zero size 2024-09-17T04:20:46.800 INFO:tasks.workunit.client.1.smithi134.stdout:0/73: mkdir d11/d1a 0 2024-09-17T04:20:46.801 INFO:tasks.workunit.client.1.smithi134.stdout:0/74: fdatasync f3 0 2024-09-17T04:20:46.802 INFO:tasks.workunit.client.1.smithi134.stdout:3/60: dwrite f3 [0,4194304] 0 2024-09-17T04:20:46.802 INFO:tasks.workunit.client.1.smithi134.stdout:8/55: mkdir d4/db 0 2024-09-17T04:20:46.803 INFO:tasks.workunit.client.1.smithi134.stdout:3/61: readlink l8 0 2024-09-17T04:20:46.804 INFO:tasks.workunit.client.1.smithi134.stdout:2/84: getdents d19 0 2024-09-17T04:20:46.804 INFO:tasks.workunit.client.1.smithi134.stdout:0/75: read d11/f12 [1930197,65296] 0 2024-09-17T04:20:46.805 INFO:tasks.workunit.client.1.smithi134.stdout:7/56: truncate d0/f6 2656169 0 2024-09-17T04:20:46.817 INFO:tasks.workunit.client.1.smithi134.stdout:8/56: creat d4/db/fc x:0 0 0 2024-09-17T04:20:46.818 INFO:tasks.workunit.client.1.smithi134.stdout:0/76: mknod d11/d18/c1b 0 2024-09-17T04:20:46.818 INFO:tasks.workunit.client.1.smithi134.stdout:9/335: creat d2/d5/f6f x:0 0 0 2024-09-17T04:20:46.823 INFO:tasks.workunit.client.1.smithi134.stdout:4/193: dwrite d0/d13/f14 [0,4194304] 0 2024-09-17T04:20:46.828 INFO:tasks.workunit.client.1.smithi134.stdout:6/141: dwrite fd [0,4194304] 0 2024-09-17T04:20:46.829 INFO:tasks.workunit.client.1.smithi134.stdout:9/336: dread d2/d5/d8/d1e/f29 [0,4194304] 0 2024-09-17T04:20:46.829 INFO:tasks.workunit.client.1.smithi134.stdout:7/57: read - d0/dd/fe zero size 2024-09-17T04:20:46.829 INFO:tasks.workunit.client.1.smithi134.stdout:0/77: mkdir d11/d1a/d1c 0 2024-09-17T04:20:46.831 INFO:tasks.workunit.client.1.smithi134.stdout:8/57: getdents d4/db 0 2024-09-17T04:20:46.834 INFO:tasks.workunit.client.1.smithi134.stdout:9/337: creat d2/d5/d9/df/f70 x:0 0 0 2024-09-17T04:20:46.834 INFO:tasks.workunit.client.1.smithi134.stdout:7/58: dread - d0/dd/fe zero size 2024-09-17T04:20:46.835 INFO:tasks.workunit.client.1.smithi134.stdout:6/142: write de/f15 [348600,14868] 0 2024-09-17T04:20:46.837 INFO:tasks.workunit.client.1.smithi134.stdout:8/58: truncate f0 916521 0 2024-09-17T04:20:46.837 INFO:tasks.workunit.client.1.smithi134.stdout:3/62: dwrite de/f13 [0,4194304] 0 2024-09-17T04:20:46.839 INFO:tasks.workunit.client.1.smithi134.stdout:7/59: mkdir d0/dd/d11 0 2024-09-17T04:20:46.839 INFO:tasks.workunit.client.1.smithi134.stdout:1/52: sync 2024-09-17T04:20:46.839 INFO:tasks.workunit.client.1.smithi134.stdout:1/53: rmdir - no directory 2024-09-17T04:20:46.840 INFO:tasks.workunit.client.1.smithi134.stdout:6/143: write de/d19/f22 [45660,28290] 0 2024-09-17T04:20:46.840 INFO:tasks.workunit.client.1.smithi134.stdout:9/338: symlink d2/d5/d9/l71 0 2024-09-17T04:20:46.843 INFO:tasks.workunit.client.1.smithi134.stdout:2/85: dwrite f2 [0,4194304] 0 2024-09-17T04:20:46.846 INFO:tasks.workunit.client.1.smithi134.stdout:6/144: creat de/f2c x:0 0 0 2024-09-17T04:20:46.847 INFO:tasks.workunit.client.1.smithi134.stdout:2/86: symlink d19/l1e 0 2024-09-17T04:20:46.847 INFO:tasks.workunit.client.1.smithi134.stdout:6/145: chown de/c16 154349 1 2024-09-17T04:20:46.848 INFO:tasks.workunit.client.1.smithi134.stdout:6/146: read - de/d19/d1f/f28 zero size 2024-09-17T04:20:46.848 INFO:tasks.workunit.client.1.smithi134.stdout:9/339: creat d2/d5/d8/d16/f72 x:0 0 0 2024-09-17T04:20:46.851 INFO:tasks.workunit.client.1.smithi134.stdout:2/87: creat d19/d1c/f1f x:0 0 0 2024-09-17T04:20:46.851 INFO:tasks.workunit.client.1.smithi134.stdout:1/54: link cc c10 0 2024-09-17T04:20:46.851 INFO:tasks.workunit.client.1.smithi134.stdout:1/55: truncate ff 388733 0 2024-09-17T04:20:46.853 INFO:tasks.workunit.client.1.smithi134.stdout:6/147: mkdir de/d19/d21/d2d 0 2024-09-17T04:20:46.854 INFO:tasks.workunit.client.1.smithi134.stdout:1/56: dread fd [0,4194304] 0 2024-09-17T04:20:46.855 INFO:tasks.workunit.client.1.smithi134.stdout:6/148: fsync de/d19/d1a/f20 0 2024-09-17T04:20:46.858 INFO:tasks.workunit.client.1.smithi134.stdout:1/57: mknod c11 0 2024-09-17T04:20:46.858 INFO:tasks.workunit.client.1.smithi134.stdout:1/58: fsync fd 0 2024-09-17T04:20:46.858 INFO:tasks.workunit.client.1.smithi134.stdout:7/60: link d0/l5 d0/l12 0 2024-09-17T04:20:46.858 INFO:tasks.workunit.client.1.smithi134.stdout:1/59: read fd [376847,123873] 0 2024-09-17T04:20:46.859 INFO:tasks.workunit.client.1.smithi134.stdout:1/60: truncate fd 1870826 0 2024-09-17T04:20:46.859 INFO:tasks.workunit.client.1.smithi134.stdout:1/61: chown ff 460225 1 2024-09-17T04:20:46.863 INFO:tasks.workunit.client.1.smithi134.stdout:3/63: dwrite f0 [0,4194304] 0 2024-09-17T04:20:46.864 INFO:tasks.workunit.client.1.smithi134.stdout:1/62: dread fe [0,4194304] 0 2024-09-17T04:20:46.865 INFO:tasks.workunit.client.1.smithi134.stdout:3/64: truncate fc 5103640 0 2024-09-17T04:20:46.865 INFO:tasks.workunit.client.1.smithi134.stdout:1/63: chown fd 337384657 1 2024-09-17T04:20:46.865 INFO:tasks.workunit.client.1.smithi134.stdout:1/64: rmdir - no directory 2024-09-17T04:20:46.868 INFO:tasks.workunit.client.1.smithi134.stdout:1/65: dread fe [0,4194304] 0 2024-09-17T04:20:46.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:46 smithi088 ceph-mon[27811]: pgmap v14: 65 pgs: 65 active+clean; 323 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.9 MiB/s rd, 25 MiB/s wr, 429 op/s 2024-09-17T04:20:46.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:46 smithi134 ceph-mon[35201]: pgmap v14: 65 pgs: 65 active+clean; 323 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.9 MiB/s rd, 25 MiB/s wr, 429 op/s 2024-09-17T04:20:46.913 INFO:tasks.workunit.client.1.smithi134.stdout:6/149: unlink de/l17 0 2024-09-17T04:20:46.914 INFO:tasks.workunit.client.1.smithi134.stdout:6/150: readlink l0 0 2024-09-17T04:20:46.917 INFO:tasks.workunit.client.1.smithi134.stdout:3/65: unlink f0 0 2024-09-17T04:20:46.918 INFO:tasks.workunit.client.1.smithi134.stdout:1/66: mkdir d12 0 2024-09-17T04:20:46.919 INFO:tasks.workunit.client.1.smithi134.stdout:9/340: link d2/d5/d37/d4c/c53 d2/d5/d8/d16/c73 0 2024-09-17T04:20:46.920 INFO:tasks.workunit.client.1.smithi134.stdout:9/341: stat d2/d5/d9/c31 0 2024-09-17T04:20:46.921 INFO:tasks.workunit.client.1.smithi134.stdout:7/61: creat d0/d4/f13 x:0 0 0 2024-09-17T04:20:46.922 INFO:tasks.workunit.client.1.smithi134.stdout:8/59: write f0 [1836055,61917] 0 2024-09-17T04:20:46.923 INFO:tasks.workunit.client.1.smithi134.stdout:3/66: rename de/f13 to de/d12/f16 0 2024-09-17T04:20:46.923 INFO:tasks.workunit.client.1.smithi134.stdout:3/67: read de/ff [1503776,37575] 0 2024-09-17T04:20:46.925 INFO:tasks.workunit.client.1.smithi134.stdout:6/151: mknod de/d2b/c2e 0 2024-09-17T04:20:46.929 INFO:tasks.workunit.client.1.smithi134.stdout:1/67: mknod d12/c13 0 2024-09-17T04:20:46.929 INFO:tasks.workunit.client.1.smithi134.stdout:1/68: read fd [1168971,24347] 0 2024-09-17T04:20:46.930 INFO:tasks.workunit.client.1.smithi134.stdout:1/69: fsync fd 0 2024-09-17T04:20:46.931 INFO:tasks.workunit.client.1.smithi134.stdout:6/152: unlink l0 0 2024-09-17T04:20:46.932 INFO:tasks.workunit.client.1.smithi134.stdout:3/68: fsync de/d12/f16 0 2024-09-17T04:20:46.934 INFO:tasks.workunit.client.1.smithi134.stdout:1/70: rename fe to d12/f14 0 2024-09-17T04:20:46.935 INFO:tasks.workunit.client.1.smithi134.stdout:3/69: truncate f6 773823 0 2024-09-17T04:20:46.937 INFO:tasks.workunit.client.1.smithi134.stdout:6/153: creat de/d19/d21/d2d/f2f x:0 0 0 2024-09-17T04:20:46.938 INFO:tasks.workunit.client.1.smithi134.stdout:9/342: dwrite d2/d5/d8/d1e/f29 [0,4194304] 0 2024-09-17T04:20:46.941 INFO:tasks.workunit.client.1.smithi134.stdout:1/71: fsync d12/f14 0 2024-09-17T04:20:46.943 INFO:tasks.workunit.client.1.smithi134.stdout:9/343: write d2/f34 [110499,13585] 0 2024-09-17T04:20:46.944 INFO:tasks.workunit.client.1.smithi134.stdout:6/154: dread fd [0,4194304] 0 2024-09-17T04:20:46.945 INFO:tasks.workunit.client.1.smithi134.stdout:3/70: dread de/ff [0,4194304] 0 2024-09-17T04:20:46.947 INFO:tasks.workunit.client.1.smithi134.stdout:6/155: write de/d19/d21/d2d/f2f [653071,75413] 0 2024-09-17T04:20:46.949 INFO:tasks.workunit.client.1.smithi134.stdout:6/156: truncate de/d19/d21/f25 376271 0 2024-09-17T04:20:46.950 INFO:tasks.workunit.client.1.smithi134.stdout:9/344: getdents d2/d5/d9/d6a 0 2024-09-17T04:20:46.951 INFO:tasks.workunit.client.1.smithi134.stdout:6/157: creat de/f30 x:0 0 0 2024-09-17T04:20:46.952 INFO:tasks.workunit.client.1.smithi134.stdout:6/158: write de/f2c [507191,25714] 0 2024-09-17T04:20:46.953 INFO:tasks.workunit.client.1.smithi134.stdout:9/345: symlink d2/d5/d8/d16/l74 0 2024-09-17T04:20:46.955 INFO:tasks.workunit.client.1.smithi134.stdout:9/346: fdatasync d2/d5/fb 0 2024-09-17T04:20:46.955 INFO:tasks.workunit.client.1.smithi134.stdout:6/159: write fd [3655932,33405] 0 2024-09-17T04:20:46.960 INFO:tasks.workunit.client.1.smithi134.stdout:9/347: write d2/d5/d8/d1e/f29 [3521227,9703] 0 2024-09-17T04:20:46.963 INFO:tasks.workunit.client.1.smithi134.stdout:1/72: dwrite fd [0,4194304] 0 2024-09-17T04:20:46.963 INFO:tasks.workunit.client.1.smithi134.stdout:6/160: write f9 [1604820,44938] 0 2024-09-17T04:20:47.008 INFO:tasks.workunit.client.1.smithi134.stdout:5/64: sync 2024-09-17T04:20:47.016 INFO:tasks.workunit.client.1.smithi134.stdout:9/348: mkdir d2/d7/d75 0 2024-09-17T04:20:47.017 INFO:tasks.workunit.client.1.smithi134.stdout:3/71: dwrite de/ff [4194304,4194304] 0 2024-09-17T04:20:47.017 INFO:tasks.workunit.client.1.smithi134.stdout:5/65: chown d0/f5 2052 1 2024-09-17T04:20:47.017 INFO:tasks.workunit.client.1.smithi134.stdout:6/161: chown de/d19/d21 50830 1 2024-09-17T04:20:47.018 INFO:tasks.workunit.client.1.smithi134.stdout:3/72: write fc [4488312,99174] 0 2024-09-17T04:20:47.019 INFO:tasks.workunit.client.1.smithi134.stdout:6/162: fsync de/f13 0 2024-09-17T04:20:47.020 INFO:tasks.workunit.client.1.smithi134.stdout:1/73: rename c9 to d12/c15 0 2024-09-17T04:20:47.023 INFO:tasks.workunit.client.1.smithi134.stdout:3/73: write de/d10/f11 [664440,109127] 0 2024-09-17T04:20:47.023 INFO:tasks.workunit.client.1.smithi134.stdout:9/349: symlink d2/d5/d37/l76 0 2024-09-17T04:20:47.025 INFO:tasks.workunit.client.1.smithi134.stdout:5/66: link d0/d6/ce d0/da/d12/c15 0 2024-09-17T04:20:47.025 INFO:tasks.workunit.client.1.smithi134.stdout:6/163: link c1 de/d19/d1f/c31 0 2024-09-17T04:20:47.026 INFO:tasks.workunit.client.1.smithi134.stdout:9/350: dread - d2/d5/d9/df/d38/f6c zero size 2024-09-17T04:20:47.027 INFO:tasks.workunit.client.1.smithi134.stdout:3/74: rename f3 to de/d12/f17 0 2024-09-17T04:20:47.028 INFO:tasks.workunit.client.1.smithi134.stdout:3/75: chown l8 83 1 2024-09-17T04:20:47.030 INFO:tasks.workunit.client.1.smithi134.stdout:9/351: write d2/d5/d8/d16/f72 [670846,273] 0 2024-09-17T04:20:47.031 INFO:tasks.workunit.client.1.smithi134.stdout:1/74: dwrite fd [0,4194304] 0 2024-09-17T04:20:47.032 INFO:tasks.workunit.client.1.smithi134.stdout:3/76: unlink f9 0 2024-09-17T04:20:47.033 INFO:tasks.workunit.client.1.smithi134.stdout:3/77: readlink la 0 2024-09-17T04:20:47.034 INFO:tasks.workunit.client.1.smithi134.stdout:5/67: chown d0/da/d12/c15 1 1 2024-09-17T04:20:47.034 INFO:tasks.workunit.client.1.smithi134.stdout:9/352: write d2/d5/d37/d4c/f5c [307842,117460] 0 2024-09-17T04:20:47.035 INFO:tasks.workunit.client.1.smithi134.stdout:3/78: truncate fd 482003 0 2024-09-17T04:20:47.036 INFO:tasks.workunit.client.1.smithi134.stdout:6/164: dwrite f9 [0,4194304] 0 2024-09-17T04:20:47.036 INFO:tasks.workunit.client.1.smithi134.stdout:5/68: chown d0/d6/ff 417000 1 2024-09-17T04:20:47.037 INFO:tasks.workunit.client.1.smithi134.stdout:6/165: readlink de/d19/d1f/l27 0 2024-09-17T04:20:47.038 INFO:tasks.workunit.client.1.smithi134.stdout:6/166: truncate de/f30 5414 0 2024-09-17T04:20:47.039 INFO:tasks.workunit.client.1.smithi134.stdout:9/353: symlink d2/d5/d8/d16/d54/l77 0 2024-09-17T04:20:47.042 INFO:tasks.workunit.client.1.smithi134.stdout:6/167: dread de/d19/f22 [0,4194304] 0 2024-09-17T04:20:47.043 INFO:tasks.workunit.client.1.smithi134.stdout:9/354: write d2/d5/d8/d16/f72 [1444513,69681] 0 2024-09-17T04:20:47.045 INFO:tasks.workunit.client.1.smithi134.stdout:5/69: getdents d0/da/d12 0 2024-09-17T04:20:47.046 INFO:tasks.workunit.client.1.smithi134.stdout:6/168: dread de/d19/d21/f25 [0,4194304] 0 2024-09-17T04:20:47.047 INFO:tasks.workunit.client.1.smithi134.stdout:3/79: dwrite de/d12/f17 [4194304,4194304] 0 2024-09-17T04:20:47.048 INFO:tasks.workunit.client.1.smithi134.stdout:5/70: dread d0/f5 [0,4194304] 0 2024-09-17T04:20:47.049 INFO:tasks.workunit.client.1.smithi134.stdout:9/355: mkdir d2/d78 0 2024-09-17T04:20:47.049 INFO:tasks.workunit.client.1.smithi134.stdout:5/71: chown d0/f4 202 1 2024-09-17T04:20:47.049 INFO:tasks.workunit.client.1.smithi134.stdout:5/72: chown d0/da/d12 63974 1 2024-09-17T04:20:47.050 INFO:tasks.workunit.client.1.smithi134.stdout:6/169: chown de/c1c 1 1 2024-09-17T04:20:47.053 INFO:tasks.workunit.client.1.smithi134.stdout:6/170: symlink de/l32 0 2024-09-17T04:20:47.053 INFO:tasks.workunit.client.1.smithi134.stdout:5/73: dread d0/f2 [0,4194304] 0 2024-09-17T04:20:47.056 INFO:tasks.workunit.client.1.smithi134.stdout:9/356: rename d2/d5/f13 to d2/d5/d9/df/f79 0 2024-09-17T04:20:47.058 INFO:tasks.workunit.client.1.smithi134.stdout:6/171: dread de/f2c [0,4194304] 0 2024-09-17T04:20:47.058 INFO:tasks.workunit.client.1.smithi134.stdout:5/74: unlink d0/d6/ce 0 2024-09-17T04:20:47.059 INFO:tasks.workunit.client.1.smithi134.stdout:5/75: truncate d0/f8 4799713 0 2024-09-17T04:20:47.061 INFO:tasks.workunit.client.1.smithi134.stdout:6/172: unlink f8 0 2024-09-17T04:20:47.061 INFO:tasks.workunit.client.1.smithi134.stdout:6/173: fdatasync fd 0 2024-09-17T04:20:47.061 INFO:tasks.workunit.client.1.smithi134.stdout:6/174: chown de/d19/d21 10 1 2024-09-17T04:20:47.062 INFO:tasks.workunit.client.1.smithi134.stdout:3/80: truncate de/ff 1003089 0 2024-09-17T04:20:47.063 INFO:tasks.workunit.client.1.smithi134.stdout:3/81: dread fd [0,4194304] 0 2024-09-17T04:20:47.063 INFO:tasks.workunit.client.1.smithi134.stdout:3/82: chown l8 0 1 2024-09-17T04:20:47.064 INFO:tasks.workunit.client.1.smithi134.stdout:5/76: mkdir d0/d16 0 2024-09-17T04:20:47.065 INFO:tasks.workunit.client.1.smithi134.stdout:5/77: stat d0/da/d12 0 2024-09-17T04:20:47.065 INFO:tasks.workunit.client.1.smithi134.stdout:5/78: write d0/d6/fc [2082709,122048] 0 2024-09-17T04:20:47.065 INFO:tasks.workunit.client.1.smithi134.stdout:6/175: creat de/d19/f33 x:0 0 0 2024-09-17T04:20:47.066 INFO:tasks.workunit.client.1.smithi134.stdout:3/83: mknod de/d10/c18 0 2024-09-17T04:20:47.066 INFO:tasks.workunit.client.1.smithi134.stdout:6/176: fsync de/d19/d1f/f26 0 2024-09-17T04:20:47.067 INFO:tasks.workunit.client.1.smithi134.stdout:6/177: stat de/d19/d1f/f26 0 2024-09-17T04:20:47.068 INFO:tasks.workunit.client.1.smithi134.stdout:5/79: creat d0/d6/f17 x:0 0 0 2024-09-17T04:20:47.068 INFO:tasks.workunit.client.1.smithi134.stdout:6/178: readlink la 0 2024-09-17T04:20:47.068 INFO:tasks.workunit.client.1.smithi134.stdout:3/84: mknod de/d10/c19 0 2024-09-17T04:20:47.070 INFO:tasks.workunit.client.1.smithi134.stdout:3/85: dread f6 [0,4194304] 0 2024-09-17T04:20:47.071 INFO:tasks.workunit.client.1.smithi134.stdout:6/179: getdents de/d2b 0 2024-09-17T04:20:47.072 INFO:tasks.workunit.client.1.smithi134.stdout:5/80: dread d0/f8 [0,4194304] 0 2024-09-17T04:20:47.072 INFO:tasks.workunit.client.1.smithi134.stdout:5/81: write d0/f11 [74887,46007] 0 2024-09-17T04:20:47.073 INFO:tasks.workunit.client.1.smithi134.stdout:3/86: unlink l8 0 2024-09-17T04:20:47.074 INFO:tasks.workunit.client.1.smithi134.stdout:3/87: stat de/d12/f16 0 2024-09-17T04:20:47.074 INFO:tasks.workunit.client.1.smithi134.stdout:6/180: mkdir de/d19/d1a/d34 0 2024-09-17T04:20:47.074 INFO:tasks.workunit.client.1.smithi134.stdout:3/88: fdatasync de/d12/f17 0 2024-09-17T04:20:47.075 INFO:tasks.workunit.client.1.smithi134.stdout:5/82: mknod d0/da/c18 0 2024-09-17T04:20:47.083 INFO:tasks.workunit.client.1.smithi134.stdout:6/181: getdents de/d19/d1a/d34 0 2024-09-17T04:20:47.085 INFO:tasks.workunit.client.1.smithi134.stdout:5/83: dwrite d0/f4 [0,4194304] 0 2024-09-17T04:20:47.085 INFO:tasks.workunit.client.1.smithi134.stdout:4/194: sync 2024-09-17T04:20:47.085 INFO:tasks.workunit.client.1.smithi134.stdout:9/357: dwrite d2/d7/f2f [0,4194304] 0 2024-09-17T04:20:47.087 INFO:tasks.workunit.client.1.smithi134.stdout:4/195: write d0/f22 [1756918,109409] 0 2024-09-17T04:20:47.089 INFO:tasks.workunit.client.1.smithi134.stdout:9/358: dread - d2/d5/d8/d1e/d42/f67 zero size 2024-09-17T04:20:47.089 INFO:tasks.workunit.client.1.smithi134.stdout:6/182: symlink de/d19/d1a/d34/l35 0 2024-09-17T04:20:47.090 INFO:tasks.workunit.client.1.smithi134.stdout:6/183: fdatasync de/f30 0 2024-09-17T04:20:47.094 INFO:tasks.workunit.client.1.smithi134.stdout:9/359: creat d2/d5/d9/d6a/f7a x:0 0 0 2024-09-17T04:20:47.100 INFO:tasks.workunit.client.1.smithi134.stdout:9/360: chown d2/d5/d8/c1f 41380918 1 2024-09-17T04:20:47.101 INFO:tasks.workunit.client.1.smithi134.stdout:5/84: rmdir d0/d16 0 2024-09-17T04:20:47.103 INFO:tasks.workunit.client.1.smithi134.stdout:3/89: dread de/ff [0,4194304] 0 2024-09-17T04:20:47.103 INFO:tasks.workunit.client.1.smithi134.stdout:9/361: mknod d2/d5/d8/d16/c7b 0 2024-09-17T04:20:47.104 INFO:tasks.workunit.client.1.smithi134.stdout:9/362: dread - d2/d5/f68 zero size 2024-09-17T04:20:47.105 INFO:tasks.workunit.client.1.smithi134.stdout:9/363: write d2/d5/d8/d16/f72 [1757608,22408] 0 2024-09-17T04:20:47.105 INFO:tasks.workunit.client.1.smithi134.stdout:5/85: rename d0/c3 to d0/c19 0 2024-09-17T04:20:47.105 INFO:tasks.workunit.client.1.smithi134.stdout:4/196: getdents d0/df/d35 0 2024-09-17T04:20:47.106 INFO:tasks.workunit.client.1.smithi134.stdout:5/86: fsync d0/d6/f17 0 2024-09-17T04:20:47.106 INFO:tasks.workunit.client.1.smithi134.stdout:3/90: unlink de/d12/f16 0 2024-09-17T04:20:47.107 INFO:tasks.workunit.client.1.smithi134.stdout:9/364: write d2/d5/d9/df/f48 [871046,33679] 0 2024-09-17T04:20:47.108 INFO:tasks.workunit.client.1.smithi134.stdout:9/365: readlink d2/d5/d9/l71 0 2024-09-17T04:20:47.108 INFO:tasks.workunit.client.1.smithi134.stdout:5/87: fsync d0/f8 0 2024-09-17T04:20:47.109 INFO:tasks.workunit.client.1.smithi134.stdout:4/197: symlink d0/df/d1e/d20/l3a 0 2024-09-17T04:20:47.110 INFO:tasks.workunit.client.1.smithi134.stdout:3/91: creat de/d12/d15/f1a x:0 0 0 2024-09-17T04:20:47.111 INFO:tasks.workunit.client.1.smithi134.stdout:9/366: unlink d2/d5/d8/d16/d54/c69 0 2024-09-17T04:20:47.112 INFO:tasks.workunit.client.1.smithi134.stdout:9/367: write d2/d5/d37/f2b [3672576,103534] 0 2024-09-17T04:20:47.112 INFO:tasks.workunit.client.1.smithi134.stdout:4/198: rmdir d0/df/d35 39 2024-09-17T04:20:47.113 INFO:tasks.workunit.client.1.smithi134.stdout:9/368: readlink d2/d5/d8/l3d 0 2024-09-17T04:20:47.113 INFO:tasks.workunit.client.1.smithi134.stdout:4/199: write d0/df/f18 [4837425,30725] 0 2024-09-17T04:20:47.114 INFO:tasks.workunit.client.1.smithi134.stdout:5/88: symlink d0/da/d12/l1a 0 2024-09-17T04:20:47.115 INFO:tasks.workunit.client.1.smithi134.stdout:5/89: write d0/f5 [1132216,38266] 0 2024-09-17T04:20:47.116 INFO:tasks.workunit.client.1.smithi134.stdout:5/90: read d0/f2 [1509049,33437] 0 2024-09-17T04:20:47.116 INFO:tasks.workunit.client.1.smithi134.stdout:9/369: mkdir d2/d5/d37/d7c 0 2024-09-17T04:20:47.118 INFO:tasks.workunit.client.1.smithi134.stdout:4/200: mkdir d0/d3b 0 2024-09-17T04:20:47.119 INFO:tasks.workunit.client.1.smithi134.stdout:4/201: write d0/df/d1e/f2e [718310,110620] 0 2024-09-17T04:20:47.121 INFO:tasks.workunit.client.1.smithi134.stdout:4/202: truncate d0/f5 3345205 0 2024-09-17T04:20:47.123 INFO:tasks.workunit.client.1.smithi134.stdout:9/370: getdents d2/d5/d58 0 2024-09-17T04:20:47.124 INFO:tasks.workunit.client.1.smithi134.stdout:5/91: dwrite d0/d6/ff [0,4194304] 0 2024-09-17T04:20:47.127 INFO:tasks.workunit.client.1.smithi134.stdout:5/92: creat d0/f1b x:0 0 0 2024-09-17T04:20:47.127 INFO:tasks.workunit.client.1.smithi134.stdout:9/371: creat d2/d5/d37/d3f/f7d x:0 0 0 2024-09-17T04:20:47.128 INFO:tasks.workunit.client.1.smithi134.stdout:9/372: fsync d2/d5/f6f 0 2024-09-17T04:20:47.128 INFO:tasks.workunit.client.1.smithi134.stdout:5/93: mknod d0/c1c 0 2024-09-17T04:20:47.130 INFO:tasks.workunit.client.1.smithi134.stdout:4/203: dread d0/f5 [0,4194304] 0 2024-09-17T04:20:47.132 INFO:tasks.workunit.client.1.smithi134.stdout:5/94: rmdir d0/da/d12 39 2024-09-17T04:20:47.133 INFO:tasks.workunit.client.1.smithi134.stdout:3/92: write fc [2633756,16140] 0 2024-09-17T04:20:47.136 INFO:tasks.workunit.client.1.smithi134.stdout:3/93: creat de/f1b x:0 0 0 2024-09-17T04:20:47.137 INFO:tasks.workunit.client.1.smithi134.stdout:5/95: symlink d0/da/d12/l1d 0 2024-09-17T04:20:47.138 INFO:tasks.workunit.client.1.smithi134.stdout:3/94: creat de/d12/f1c x:0 0 0 2024-09-17T04:20:47.141 INFO:tasks.workunit.client.1.smithi134.stdout:5/96: creat d0/da/f1e x:0 0 0 2024-09-17T04:20:47.141 INFO:tasks.workunit.client.1.smithi134.stdout:3/95: mkdir de/d12/d15/d1d 0 2024-09-17T04:20:47.143 INFO:tasks.workunit.client.1.smithi134.stdout:4/204: dwrite d0/df/f31 [0,4194304] 0 2024-09-17T04:20:47.144 INFO:tasks.workunit.client.1.smithi134.stdout:3/96: truncate fc 5342096 0 2024-09-17T04:20:47.145 INFO:tasks.workunit.client.1.smithi134.stdout:5/97: creat d0/d6/f1f x:0 0 0 2024-09-17T04:20:47.147 INFO:tasks.workunit.client.1.smithi134.stdout:9/373: dwrite d2/f4b [0,4194304] 0 2024-09-17T04:20:47.147 INFO:tasks.workunit.client.1.smithi134.stdout:3/97: truncate de/f1b 334018 0 2024-09-17T04:20:47.147 INFO:tasks.workunit.client.1.smithi134.stdout:4/205: truncate d0/d13/f1f 4849958 0 2024-09-17T04:20:47.148 INFO:tasks.workunit.client.1.smithi134.stdout:5/98: write d0/d6/fc [3227174,16656] 0 2024-09-17T04:20:47.148 INFO:tasks.workunit.client.1.smithi134.stdout:9/374: fdatasync d2/d5/d8/d16/f72 0 2024-09-17T04:20:47.151 INFO:tasks.workunit.client.1.smithi134.stdout:4/206: chown d0/df/d35/d39 16014789 1 2024-09-17T04:20:47.151 INFO:tasks.workunit.client.1.smithi134.stdout:5/99: symlink d0/l20 0 2024-09-17T04:20:47.152 INFO:tasks.workunit.client.1.smithi134.stdout:4/207: read d0/d13/f1f [2713193,65465] 0 2024-09-17T04:20:47.152 INFO:tasks.workunit.client.1.smithi134.stdout:3/98: truncate de/ff 856394 0 2024-09-17T04:20:47.153 INFO:tasks.workunit.client.1.smithi134.stdout:9/375: unlink d2/d5/d37/f2b 0 2024-09-17T04:20:47.154 INFO:tasks.workunit.client.1.smithi134.stdout:9/376: readlink d2/d5/d8/d16/d54/l63 0 2024-09-17T04:20:47.155 INFO:tasks.workunit.client.1.smithi134.stdout:5/100: creat d0/f21 x:0 0 0 2024-09-17T04:20:47.158 INFO:tasks.workunit.client.1.smithi134.stdout:3/99: symlink de/d12/d15/d1d/l1e 0 2024-09-17T04:20:47.159 INFO:tasks.workunit.client.1.smithi134.stdout:4/208: rename d0/df/d17/f38 to d0/d13/f3c 0 2024-09-17T04:20:47.160 INFO:tasks.workunit.client.1.smithi134.stdout:5/101: getdents d0/da 0 2024-09-17T04:20:47.161 INFO:tasks.workunit.client.1.smithi134.stdout:3/100: rename de/d12/f1c to de/d12/d15/f1f 0 2024-09-17T04:20:47.163 INFO:tasks.workunit.client.1.smithi134.stdout:4/209: symlink d0/df/l3d 0 2024-09-17T04:20:47.164 INFO:tasks.workunit.client.1.smithi134.stdout:3/101: symlink de/d12/d15/d1d/l20 0 2024-09-17T04:20:47.167 INFO:tasks.workunit.client.1.smithi134.stdout:3/102: dread - de/d12/d15/f1a zero size 2024-09-17T04:20:47.168 INFO:tasks.workunit.client.1.smithi134.stdout:9/377: chown d2/d5/d9/f18 6 1 2024-09-17T04:20:47.168 INFO:tasks.workunit.client.1.smithi134.stdout:5/102: dwrite d0/f21 [0,4194304] 0 2024-09-17T04:20:47.168 INFO:tasks.workunit.client.1.smithi134.stdout:4/210: mknod d0/df/d35/d39/c3e 0 2024-09-17T04:20:47.169 INFO:tasks.workunit.client.1.smithi134.stdout:3/103: readlink de/d12/d15/d1d/l1e 0 2024-09-17T04:20:47.169 INFO:tasks.workunit.client.1.smithi134.stdout:3/104: readlink l2 0 2024-09-17T04:20:47.171 INFO:tasks.workunit.client.1.smithi134.stdout:9/378: symlink d2/d5/d8/d1e/l7e 0 2024-09-17T04:20:47.173 INFO:tasks.workunit.client.1.smithi134.stdout:3/105: write de/d12/d15/f1f [341843,61580] 0 2024-09-17T04:20:47.178 INFO:tasks.workunit.client.1.smithi134.stdout:5/103: dwrite d0/d6/ff [4194304,4194304] 0 2024-09-17T04:20:47.179 INFO:tasks.workunit.client.1.smithi134.stdout:3/106: getdents de/d12/d15 0 2024-09-17T04:20:47.180 INFO:tasks.workunit.client.1.smithi134.stdout:5/104: chown d0/d6/ff 111675336 1 2024-09-17T04:20:47.182 INFO:tasks.workunit.client.1.smithi134.stdout:4/211: dwrite d0/d13/f33 [0,4194304] 0 2024-09-17T04:20:47.183 INFO:tasks.workunit.client.1.smithi134.stdout:3/107: rename de/d10/c18 to de/d12/d15/c21 0 2024-09-17T04:20:47.184 INFO:tasks.workunit.client.1.smithi134.stdout:4/212: chown d0 1545402 1 2024-09-17T04:20:47.186 INFO:tasks.workunit.client.1.smithi134.stdout:3/108: mkdir de/d12/d22 0 2024-09-17T04:20:47.188 INFO:tasks.workunit.client.1.smithi134.stdout:3/109: creat de/d10/f23 x:0 0 0 2024-09-17T04:20:47.189 INFO:tasks.workunit.client.1.smithi134.stdout:4/213: getdents d0/df/d1e 0 2024-09-17T04:20:47.189 INFO:tasks.workunit.client.1.smithi134.stdout:9/379: write d2/d7/f2f [1181642,54680] 0 2024-09-17T04:20:47.190 INFO:tasks.workunit.client.1.smithi134.stdout:4/214: chown d0/df/d17 41814878 1 2024-09-17T04:20:47.190 INFO:tasks.workunit.client.1.smithi134.stdout:3/110: truncate de/d10/f23 567873 0 2024-09-17T04:20:47.193 INFO:tasks.workunit.client.1.smithi134.stdout:4/215: symlink d0/df/d1e/d20/l3f 0 2024-09-17T04:20:47.194 INFO:tasks.workunit.client.1.smithi134.stdout:3/111: dread de/d10/f11 [0,4194304] 0 2024-09-17T04:20:47.195 INFO:tasks.workunit.client.1.smithi134.stdout:4/216: chown d0/df/d1e/l28 327931 1 2024-09-17T04:20:47.197 INFO:tasks.workunit.client.1.smithi134.stdout:3/112: write de/d12/d15/f1a [32534,30724] 0 2024-09-17T04:20:47.198 INFO:tasks.workunit.client.1.smithi134.stdout:4/217: unlink d0/d13/c2f 0 2024-09-17T04:20:47.199 INFO:tasks.workunit.client.1.smithi134.stdout:9/380: dwrite d2/d5/d9/df/d38/f6c [0,4194304] 0 2024-09-17T04:20:47.201 INFO:tasks.workunit.client.1.smithi134.stdout:9/381: write d2/d5/d37/f47 [22363,72183] 0 2024-09-17T04:20:47.202 INFO:tasks.workunit.client.1.smithi134.stdout:3/113: creat de/d12/d15/d1d/f24 x:0 0 0 2024-09-17T04:20:47.207 INFO:tasks.workunit.client.1.smithi134.stdout:3/114: creat de/d12/d22/f25 x:0 0 0 2024-09-17T04:20:47.209 INFO:tasks.workunit.client.1.smithi134.stdout:4/218: dwrite d0/df/d1e/f25 [0,4194304] 0 2024-09-17T04:20:47.209 INFO:tasks.workunit.client.1.smithi134.stdout:3/115: write fc [3833036,53855] 0 2024-09-17T04:20:47.211 INFO:tasks.workunit.client.1.smithi134.stdout:9/382: dwrite d2/d5/fb [4194304,4194304] 0 2024-09-17T04:20:47.214 INFO:tasks.workunit.client.1.smithi134.stdout:4/219: mkdir d0/d13/d40 0 2024-09-17T04:20:47.216 INFO:tasks.workunit.client.1.smithi134.stdout:9/383: creat d2/d5/d9/d6b/f7f x:0 0 0 2024-09-17T04:20:47.219 INFO:tasks.workunit.client.1.smithi134.stdout:9/384: write d2/d5/d9/f2e [305964,98162] 0 2024-09-17T04:20:47.219 INFO:tasks.workunit.client.1.smithi134.stdout:4/220: mknod d0/d13/d40/c41 0 2024-09-17T04:20:47.224 INFO:tasks.workunit.client.1.smithi134.stdout:9/385: unlink d2/d5/f6f 0 2024-09-17T04:20:47.224 INFO:tasks.workunit.client.1.smithi134.stdout:9/386: dread - d2/d5/d8/d16/d54/f66 zero size 2024-09-17T04:20:47.225 INFO:tasks.workunit.client.1.smithi134.stdout:4/221: dread d0/df/d1e/f25 [4194304,4194304] 0 2024-09-17T04:20:47.226 INFO:tasks.workunit.client.1.smithi134.stdout:2/88: sync 2024-09-17T04:20:47.226 INFO:tasks.workunit.client.1.smithi134.stdout:0/78: sync 2024-09-17T04:20:47.226 INFO:tasks.workunit.client.1.smithi134.stdout:7/62: sync 2024-09-17T04:20:47.227 INFO:tasks.workunit.client.1.smithi134.stdout:9/387: dwrite d2/d5/fb [0,4194304] 0 2024-09-17T04:20:47.229 INFO:tasks.workunit.client.1.smithi134.stdout:2/89: write d19/d1c/f1f [481872,24731] 0 2024-09-17T04:20:47.241 INFO:tasks.workunit.client.1.smithi134.stdout:0/79: mknod d11/d18/c1d 0 2024-09-17T04:20:47.241 INFO:tasks.workunit.client.1.smithi134.stdout:7/63: dread - d0/dd/fe zero size 2024-09-17T04:20:47.242 INFO:tasks.workunit.client.1.smithi134.stdout:9/388: mkdir d2/d5/d9/df/d80 0 2024-09-17T04:20:47.242 INFO:tasks.workunit.client.1.smithi134.stdout:2/90: chown l15 1 1 2024-09-17T04:20:47.242 INFO:tasks.workunit.client.1.smithi134.stdout:3/116: truncate de/d10/f11 724226 0 2024-09-17T04:20:47.242 INFO:tasks.workunit.client.1.smithi134.stdout:2/91: dread - d19/f1a zero size 2024-09-17T04:20:47.243 INFO:tasks.workunit.client.1.smithi134.stdout:2/92: dread - d19/f1a zero size 2024-09-17T04:20:47.244 INFO:tasks.workunit.client.1.smithi134.stdout:2/93: dread - d19/f1a zero size 2024-09-17T04:20:47.245 INFO:tasks.workunit.client.1.smithi134.stdout:9/389: creat d2/d5/d58/f81 x:0 0 0 2024-09-17T04:20:47.247 INFO:tasks.workunit.client.1.smithi134.stdout:2/94: unlink l7 0 2024-09-17T04:20:47.248 INFO:tasks.workunit.client.1.smithi134.stdout:9/390: write d2/d5/d8/d1e/f29 [3125823,22660] 0 2024-09-17T04:20:47.249 INFO:tasks.workunit.client.1.smithi134.stdout:2/95: symlink d19/l20 0 2024-09-17T04:20:47.250 INFO:tasks.workunit.client.1.smithi134.stdout:3/117: dwrite de/d12/d15/f1a [0,4194304] 0 2024-09-17T04:20:47.252 INFO:tasks.workunit.client.1.smithi134.stdout:9/391: creat d2/d5/d9/d6a/f82 x:0 0 0 2024-09-17T04:20:47.253 INFO:tasks.workunit.client.1.smithi134.stdout:2/96: write f16 [392567,58288] 0 2024-09-17T04:20:47.255 INFO:tasks.workunit.client.1.smithi134.stdout:3/118: link de/d10/f23 de/d12/d22/f26 0 2024-09-17T04:20:47.255 INFO:tasks.workunit.client.1.smithi134.stdout:3/119: fsync fc 0 2024-09-17T04:20:47.258 INFO:tasks.workunit.client.1.smithi134.stdout:3/120: truncate de/d12/d22/f26 765593 0 2024-09-17T04:20:47.262 INFO:tasks.workunit.client.1.smithi134.stdout:7/64: dwrite d0/f6 [0,4194304] 0 2024-09-17T04:20:47.262 INFO:tasks.workunit.client.1.smithi134.stdout:2/97: truncate ff 2242529 0 2024-09-17T04:20:47.262 INFO:tasks.workunit.client.1.smithi134.stdout:2/98: fdatasync d19/f1a 0 2024-09-17T04:20:47.263 INFO:tasks.workunit.client.1.smithi134.stdout:3/121: mknod de/c27 0 2024-09-17T04:20:47.264 INFO:tasks.workunit.client.1.smithi134.stdout:9/392: getdents d2/d5/d37 0 2024-09-17T04:20:47.265 INFO:tasks.workunit.client.1.smithi134.stdout:7/65: mkdir d0/d4/d14 0 2024-09-17T04:20:47.272 INFO:tasks.workunit.client.1.smithi134.stdout:2/99: getdents d19 0 2024-09-17T04:20:47.273 INFO:tasks.workunit.client.1.smithi134.stdout:3/122: truncate de/d12/d15/f1a 1042800 0 2024-09-17T04:20:47.273 INFO:tasks.workunit.client.1.smithi134.stdout:2/100: rmdir d19/d1c 39 2024-09-17T04:20:47.275 INFO:tasks.workunit.client.1.smithi134.stdout:3/123: chown de/d12/d22/f26 17 1 2024-09-17T04:20:47.277 INFO:tasks.workunit.client.1.smithi134.stdout:3/124: mknod de/d10/c28 0 2024-09-17T04:20:47.277 INFO:tasks.workunit.client.1.smithi134.stdout:9/393: dwrite d2/d25/f3c [0,4194304] 0 2024-09-17T04:20:47.278 INFO:tasks.workunit.client.1.smithi134.stdout:3/125: fdatasync de/d12/f17 0 2024-09-17T04:20:47.279 INFO:tasks.workunit.client.1.smithi134.stdout:2/101: rename l13 to d19/l21 0 2024-09-17T04:20:47.281 INFO:tasks.workunit.client.1.smithi134.stdout:9/394: mkdir d2/d5/d37/d83 0 2024-09-17T04:20:47.284 INFO:tasks.workunit.client.1.smithi134.stdout:3/126: dread fc [4194304,4194304] 0 2024-09-17T04:20:47.290 INFO:tasks.workunit.client.1.smithi134.stdout:3/127: link de/d12/d15/d1d/l20 de/d12/d15/d1d/l29 0 2024-09-17T04:20:47.291 INFO:tasks.workunit.client.1.smithi134.stdout:3/128: write de/d12/d15/f1f [175337,83233] 0 2024-09-17T04:20:47.294 INFO:tasks.workunit.client.1.smithi134.stdout:3/129: rename de/d12/d15/d1d/f24 to de/f2a 0 2024-09-17T04:20:47.294 INFO:tasks.workunit.client.1.smithi134.stdout:2/102: write ff [1581343,96780] 0 2024-09-17T04:20:47.296 INFO:tasks.workunit.client.1.smithi134.stdout:3/130: creat de/d12/f2b x:0 0 0 2024-09-17T04:20:47.298 INFO:tasks.workunit.client.1.smithi134.stdout:9/395: rename d2/d5/d37/d4c to d2/d5/d37/d57/d6d/d84 0 2024-09-17T04:20:47.299 INFO:tasks.workunit.client.1.smithi134.stdout:2/103: dread d19/f1b [0,4194304] 0 2024-09-17T04:20:47.299 INFO:tasks.workunit.client.1.smithi134.stdout:3/131: symlink de/d12/d15/l2c 0 2024-09-17T04:20:47.302 INFO:tasks.workunit.client.1.smithi134.stdout:9/396: creat d2/d5/d58/f85 x:0 0 0 2024-09-17T04:20:47.305 INFO:tasks.workunit.client.1.smithi134.stdout:2/104: creat d19/f22 x:0 0 0 2024-09-17T04:20:47.308 INFO:tasks.workunit.client.1.smithi134.stdout:2/105: creat d19/d1c/f23 x:0 0 0 2024-09-17T04:20:47.310 INFO:tasks.workunit.client.1.smithi134.stdout:2/106: chown c10 1 1 2024-09-17T04:20:47.310 INFO:tasks.workunit.client.1.smithi134.stdout:2/107: truncate f16 623326 0 2024-09-17T04:20:47.311 INFO:tasks.workunit.client.1.smithi134.stdout:2/108: dread - d19/f1a zero size 2024-09-17T04:20:47.312 INFO:tasks.workunit.client.1.smithi134.stdout:2/109: symlink d19/d1c/l24 0 2024-09-17T04:20:47.328 INFO:tasks.workunit.client.1.smithi134.stdout:8/60: sync 2024-09-17T04:20:47.329 INFO:tasks.workunit.client.1.smithi134.stdout:1/75: sync 2024-09-17T04:20:47.331 INFO:tasks.workunit.client.1.smithi134.stdout:1/76: dread d12/f14 [0,4194304] 0 2024-09-17T04:20:47.331 INFO:tasks.workunit.client.1.smithi134.stdout:8/61: unlink d4/c9 0 2024-09-17T04:20:47.332 INFO:tasks.workunit.client.1.smithi134.stdout:8/62: write f0 [2422292,90885] 0 2024-09-17T04:20:47.333 INFO:tasks.workunit.client.1.smithi134.stdout:8/63: write f3 [641212,128971] 0 2024-09-17T04:20:47.334 INFO:tasks.workunit.client.1.smithi134.stdout:8/64: dread - d4/fa zero size 2024-09-17T04:20:47.334 INFO:tasks.workunit.client.1.smithi134.stdout:8/65: fdatasync d4/db/fc 0 2024-09-17T04:20:47.335 INFO:tasks.workunit.client.1.smithi134.stdout:1/77: dread d12/f14 [0,4194304] 0 2024-09-17T04:20:47.337 INFO:tasks.workunit.client.1.smithi134.stdout:8/66: mkdir d4/db/dd 0 2024-09-17T04:20:47.337 INFO:tasks.workunit.client.1.smithi134.stdout:8/67: chown d4/l5 44979649 1 2024-09-17T04:20:47.338 INFO:tasks.workunit.client.1.smithi134.stdout:1/78: rmdir d12 39 2024-09-17T04:20:47.341 INFO:tasks.workunit.client.1.smithi134.stdout:1/79: write d12/f14 [1203736,100325] 0 2024-09-17T04:20:47.342 INFO:tasks.workunit.client.1.smithi134.stdout:2/110: write f12 [851602,65836] 0 2024-09-17T04:20:47.342 INFO:tasks.workunit.client.1.smithi134.stdout:2/111: fdatasync d19/d1c/f1f 0 2024-09-17T04:20:47.375 INFO:tasks.workunit.client.1.smithi134.stdout:1/80: dwrite d12/f14 [0,4194304] 0 2024-09-17T04:20:47.376 INFO:tasks.workunit.client.1.smithi134.stdout:1/81: write ff [612919,68197] 0 2024-09-17T04:20:47.377 INFO:tasks.workunit.client.1.smithi134.stdout:2/112: creat d19/f25 x:0 0 0 2024-09-17T04:20:47.381 INFO:tasks.workunit.client.1.smithi134.stdout:2/113: unlink d19/f1b 0 2024-09-17T04:20:47.398 INFO:tasks.workunit.client.1.smithi134.stdout:1/82: fdatasync d12/f14 0 2024-09-17T04:20:47.402 INFO:tasks.workunit.client.1.smithi134.stdout:2/114: dwrite f11 [4194304,4194304] 0 2024-09-17T04:20:47.403 INFO:tasks.workunit.client.1.smithi134.stdout:2/115: read f12 [591523,17201] 0 2024-09-17T04:20:47.403 INFO:tasks.workunit.client.1.smithi134.stdout:2/116: write d19/f1a [185744,61004] 0 2024-09-17T04:20:47.455 INFO:tasks.workunit.client.1.smithi134.stdout:4/222: sync 2024-09-17T04:20:47.455 INFO:tasks.workunit.client.1.smithi134.stdout:6/184: sync 2024-09-17T04:20:47.455 INFO:tasks.workunit.client.1.smithi134.stdout:5/105: sync 2024-09-17T04:20:47.455 INFO:tasks.workunit.client.1.smithi134.stdout:5/106: dread - d0/f1b zero size 2024-09-17T04:20:47.455 INFO:tasks.workunit.client.1.smithi134.stdout:6/185: dread - de/d19/d1f/f2a zero size 2024-09-17T04:20:47.456 INFO:tasks.workunit.client.1.smithi134.stdout:5/107: write d0/f11 [851746,119121] 0 2024-09-17T04:20:47.456 INFO:tasks.workunit.client.1.smithi134.stdout:6/186: fdatasync de/f30 0 2024-09-17T04:20:47.489 INFO:tasks.workunit.client.1.smithi134.stdout:9/397: sync 2024-09-17T04:20:47.489 INFO:tasks.workunit.client.1.smithi134.stdout:8/68: sync 2024-09-17T04:20:47.489 INFO:tasks.workunit.client.1.smithi134.stdout:3/132: sync 2024-09-17T04:20:47.489 INFO:tasks.workunit.client.1.smithi134.stdout:7/66: sync 2024-09-17T04:20:47.489 INFO:tasks.workunit.client.1.smithi134.stdout:0/80: sync 2024-09-17T04:20:47.490 INFO:tasks.workunit.client.1.smithi134.stdout:3/133: read de/d12/f17 [836997,117392] 0 2024-09-17T04:20:47.651 INFO:tasks.workunit.client.1.smithi134.stdout:1/83: creat d12/f16 x:0 0 0 2024-09-17T04:20:47.652 INFO:tasks.workunit.client.1.smithi134.stdout:4/223: mkdir d0/d13/d40/d42 0 2024-09-17T04:20:47.653 INFO:tasks.workunit.client.1.smithi134.stdout:5/108: mknod d0/d6/c22 0 2024-09-17T04:20:47.655 INFO:tasks.workunit.client.1.smithi134.stdout:0/81: creat d11/d18/f1e x:0 0 0 2024-09-17T04:20:47.656 INFO:tasks.workunit.client.1.smithi134.stdout:3/134: fdatasync de/f2a 0 2024-09-17T04:20:47.656 INFO:tasks.workunit.client.1.smithi134.stdout:1/84: rmdir d12 39 2024-09-17T04:20:47.658 INFO:tasks.workunit.client.1.smithi134.stdout:5/109: symlink d0/l23 0 2024-09-17T04:20:47.658 INFO:tasks.workunit.client.1.smithi134.stdout:4/224: dwrite d0/fb [0,4194304] 0 2024-09-17T04:20:47.658 INFO:tasks.workunit.client.1.smithi134.stdout:5/110: readlink d0/l23 0 2024-09-17T04:20:47.659 INFO:tasks.workunit.client.1.smithi134.stdout:5/111: dread - d0/f1b zero size 2024-09-17T04:20:47.660 INFO:tasks.workunit.client.1.smithi134.stdout:8/69: link f3 d4/fe 0 2024-09-17T04:20:47.660 INFO:tasks.workunit.client.1.smithi134.stdout:4/225: truncate d0/df/d1e/f2e 1058700 0 2024-09-17T04:20:47.661 INFO:tasks.workunit.client.1.smithi134.stdout:0/82: creat d11/d18/f1f x:0 0 0 2024-09-17T04:20:47.662 INFO:tasks.workunit.client.1.smithi134.stdout:9/398: dread d2/d5/d37/d57/d6d/d84/f5c [0,4194304] 0 2024-09-17T04:20:47.662 INFO:tasks.workunit.client.1.smithi134.stdout:3/135: rmdir de/d12/d15 39 2024-09-17T04:20:47.664 INFO:tasks.workunit.client.1.smithi134.stdout:7/67: rmdir d0/d4/d14 0 2024-09-17T04:20:47.665 INFO:tasks.workunit.client.1.smithi134.stdout:5/112: mknod d0/da/c24 0 2024-09-17T04:20:47.667 INFO:tasks.workunit.client.1.smithi134.stdout:1/85: creat d12/f17 x:0 0 0 2024-09-17T04:20:47.668 INFO:tasks.workunit.client.1.smithi134.stdout:6/187: getdents de/d19/d21 0 2024-09-17T04:20:47.669 INFO:tasks.workunit.client.1.smithi134.stdout:9/399: symlink d2/d5/d9/l86 0 2024-09-17T04:20:47.670 INFO:tasks.workunit.client.1.smithi134.stdout:0/83: symlink d11/d1a/d1c/l20 0 2024-09-17T04:20:47.671 INFO:tasks.workunit.client.1.smithi134.stdout:1/86: truncate d12/f16 873808 0 2024-09-17T04:20:47.672 INFO:tasks.workunit.client.1.smithi134.stdout:3/136: mkdir de/d12/d15/d1d/d2d 0 2024-09-17T04:20:47.672 INFO:tasks.workunit.client.1.smithi134.stdout:4/226: creat d0/f43 x:0 0 0 2024-09-17T04:20:47.673 INFO:tasks.workunit.client.1.smithi134.stdout:9/400: stat d2/l4 0 2024-09-17T04:20:47.673 INFO:tasks.workunit.client.1.smithi134.stdout:0/84: chown d11/f13 37 1 2024-09-17T04:20:47.674 INFO:tasks.workunit.client.1.smithi134.stdout:0/85: stat f10 0 2024-09-17T04:20:47.675 INFO:tasks.workunit.client.1.smithi134.stdout:7/68: dread d0/f6 [0,4194304] 0 2024-09-17T04:20:47.677 INFO:tasks.workunit.client.1.smithi134.stdout:7/69: fsync d0/dd/fb 0 2024-09-17T04:20:47.678 INFO:tasks.workunit.client.1.smithi134.stdout:8/70: dwrite d4/fe [0,4194304] 0 2024-09-17T04:20:47.680 INFO:tasks.workunit.client.1.smithi134.stdout:8/71: readlink d4/l5 0 2024-09-17T04:20:47.681 INFO:tasks.workunit.client.1.smithi134.stdout:1/87: dread fd [0,4194304] 0 2024-09-17T04:20:47.682 INFO:tasks.workunit.client.1.smithi134.stdout:2/117: getdents d19 0 2024-09-17T04:20:47.689 INFO:tasks.workunit.client.1.smithi134.stdout:8/72: mkdir d4/db/df 0 2024-09-17T04:20:47.690 INFO:tasks.workunit.client.1.smithi134.stdout:9/401: rename d2/d5/d37/l27 to d2/d5/d37/d7c/l87 0 2024-09-17T04:20:47.691 INFO:tasks.workunit.client.1.smithi134.stdout:3/137: dread de/d12/f17 [4194304,4194304] 0 2024-09-17T04:20:47.691 INFO:tasks.workunit.client.1.smithi134.stdout:1/88: mknod d12/c18 0 2024-09-17T04:20:47.693 INFO:tasks.workunit.client.1.smithi134.stdout:8/73: creat d4/f10 x:0 0 0 2024-09-17T04:20:47.696 INFO:tasks.workunit.client.1.smithi134.stdout:1/89: dread d12/f16 [0,4194304] 0 2024-09-17T04:20:47.696 INFO:tasks.workunit.client.1.smithi134.stdout:7/70: dwrite d0/dd/fe [0,4194304] 0 2024-09-17T04:20:47.696 INFO:tasks.workunit.client.1.smithi134.stdout:9/402: truncate d2/d5/d8/d16/f72 2220173 0 2024-09-17T04:20:47.696 INFO:tasks.workunit.client.1.smithi134.stdout:8/74: write d4/fa [689860,2388] 0 2024-09-17T04:20:47.697 INFO:tasks.workunit.client.1.smithi134.stdout:3/138: rename de/d12/d22/f25 to de/d10/f2e 0 2024-09-17T04:20:47.700 INFO:tasks.workunit.client.1.smithi134.stdout:1/90: mkdir d12/d19 0 2024-09-17T04:20:47.702 INFO:tasks.workunit.client.1.smithi134.stdout:9/403: unlink d2/d25/l51 0 2024-09-17T04:20:47.706 INFO:tasks.workunit.client.1.smithi134.stdout:1/91: dread fd [0,4194304] 0 2024-09-17T04:20:47.708 INFO:tasks.workunit.client.1.smithi134.stdout:7/71: dwrite d0/f6 [0,4194304] 0 2024-09-17T04:20:47.708 INFO:tasks.workunit.client.1.smithi134.stdout:1/92: write d12/f14 [1196554,39791] 0 2024-09-17T04:20:47.709 INFO:tasks.workunit.client.1.smithi134.stdout:1/93: truncate fd 4404250 0 2024-09-17T04:20:47.710 INFO:tasks.workunit.client.1.smithi134.stdout:9/404: dread d2/d5/d8/d16/fd [4194304,4194304] 0 2024-09-17T04:20:47.746 INFO:tasks.workunit.client.1.smithi134.stdout:3/139: link l4 de/d12/l2f 0 2024-09-17T04:20:47.748 INFO:tasks.workunit.client.1.smithi134.stdout:3/140: read - de/d12/f2b zero size 2024-09-17T04:20:47.748 INFO:tasks.workunit.client.1.smithi134.stdout:9/405: dread d2/f43 [0,4194304] 0 2024-09-17T04:20:47.750 INFO:tasks.workunit.client.1.smithi134.stdout:3/141: creat de/d10/f30 x:0 0 0 2024-09-17T04:20:47.750 INFO:tasks.workunit.client.1.smithi134.stdout:3/142: chown de/d10/f2e 23717117 1 2024-09-17T04:20:47.751 INFO:tasks.workunit.client.1.smithi134.stdout:3/143: truncate de/d12/d15/f1a 1247193 0 2024-09-17T04:20:47.753 INFO:tasks.workunit.client.1.smithi134.stdout:7/72: getdents d0/dd 0 2024-09-17T04:20:47.755 INFO:tasks.workunit.client.1.smithi134.stdout:9/406: dread d2/f43 [0,4194304] 0 2024-09-17T04:20:47.755 INFO:tasks.workunit.client.1.smithi134.stdout:9/407: fdatasync d2/d5/d58/f81 0 2024-09-17T04:20:47.756 INFO:tasks.workunit.client.1.smithi134.stdout:9/408: chown d2/d5/d8/d1e/f29 21683499 1 2024-09-17T04:20:47.757 INFO:tasks.workunit.client.1.smithi134.stdout:7/73: creat d0/f15 x:0 0 0 2024-09-17T04:20:47.759 INFO:tasks.workunit.client.1.smithi134.stdout:9/409: mknod d2/d5/d8/d16/c88 0 2024-09-17T04:20:47.759 INFO:tasks.workunit.client.1.smithi134.stdout:9/410: fsync d2/d5/d9/d6a/f7a 0 2024-09-17T04:20:47.760 INFO:tasks.workunit.client.1.smithi134.stdout:9/411: chown d2/d25/f3c 492434 1 2024-09-17T04:20:47.761 INFO:tasks.workunit.client.1.smithi134.stdout:9/412: truncate d2/d5/d9/df/d38/f6c 5045859 0 2024-09-17T04:20:47.764 INFO:tasks.workunit.client.1.smithi134.stdout:9/413: dread d2/d5/d9/df/f79 [0,4194304] 0 2024-09-17T04:20:47.766 INFO:tasks.workunit.client.1.smithi134.stdout:9/414: mknod d2/d5/d37/d57/d6d/c89 0 2024-09-17T04:20:47.768 INFO:tasks.workunit.client.1.smithi134.stdout:9/415: symlink d2/d5/d8/d16/d54/l8a 0 2024-09-17T04:20:47.770 INFO:tasks.workunit.client.1.smithi134.stdout:9/416: read d2/d5/d9/f2e [2388441,127090] 0 2024-09-17T04:20:47.771 INFO:tasks.workunit.client.1.smithi134.stdout:9/417: dread - d2/d5/d9/df/f70 zero size 2024-09-17T04:20:47.774 INFO:tasks.workunit.client.1.smithi134.stdout:9/418: rename d2/d5/d37/d57/d6d/c89 to d2/d5/d9/d6a/c8b 0 2024-09-17T04:20:47.775 INFO:tasks.workunit.client.1.smithi134.stdout:9/419: write d2/d5/d8/d16/d54/f66 [888885,81533] 0 2024-09-17T04:20:47.777 INFO:tasks.workunit.client.1.smithi134.stdout:9/420: read d2/d5/d8/d16/f72 [22136,124798] 0 2024-09-17T04:20:47.778 INFO:tasks.workunit.client.1.smithi134.stdout:9/421: fsync d2/d5/d8/d16/d54/f66 0 2024-09-17T04:20:47.779 INFO:tasks.workunit.client.1.smithi134.stdout:9/422: read d2/d5/d9/df/d38/f6c [3938377,119237] 0 2024-09-17T04:20:47.784 INFO:tasks.workunit.client.1.smithi134.stdout:9/423: dwrite d2/d5/d9/f18 [4194304,4194304] 0 2024-09-17T04:20:47.785 INFO:tasks.workunit.client.1.smithi134.stdout:9/424: dread - d2/d5/d9/d6b/f7f zero size 2024-09-17T04:20:47.786 INFO:tasks.workunit.client.1.smithi134.stdout:9/425: write d2/d5/d58/f85 [237581,129201] 0 2024-09-17T04:20:47.790 INFO:tasks.workunit.client.1.smithi134.stdout:9/426: symlink d2/d5/d37/d57/d6d/d84/l8c 0 2024-09-17T04:20:47.792 INFO:tasks.workunit.client.1.smithi134.stdout:9/427: rename d2/d5/d9/l86 to d2/d7/l8d 0 2024-09-17T04:20:47.794 INFO:tasks.workunit.client.1.smithi134.stdout:9/428: creat d2/d5/d37/d7c/f8e x:0 0 0 2024-09-17T04:20:47.795 INFO:tasks.workunit.client.1.smithi134.stdout:9/429: stat d2/c26 0 2024-09-17T04:20:47.799 INFO:tasks.workunit.client.1.smithi134.stdout:0/86: sync 2024-09-17T04:20:47.801 INFO:tasks.workunit.client.1.smithi134.stdout:0/87: mkdir d11/d19/d21 0 2024-09-17T04:20:47.802 INFO:tasks.workunit.client.1.smithi134.stdout:9/430: dwrite d2/d5/d58/f81 [0,4194304] 0 2024-09-17T04:20:47.802 INFO:tasks.workunit.client.1.smithi134.stdout:0/88: chown d11/f14 7837576 1 2024-09-17T04:20:47.811 INFO:tasks.workunit.client.1.smithi134.stdout:0/89: dwrite f3 [0,4194304] 0 2024-09-17T04:20:47.831 INFO:tasks.workunit.client.1.smithi134.stdout:1/94: sync 2024-09-17T04:20:47.833 INFO:tasks.workunit.client.1.smithi134.stdout:1/95: creat d12/f1a x:0 0 0 2024-09-17T04:20:47.834 INFO:tasks.workunit.client.1.smithi134.stdout:1/96: read fd [1533253,111035] 0 2024-09-17T04:20:47.835 INFO:tasks.workunit.client.1.smithi134.stdout:1/97: creat d12/f1b x:0 0 0 2024-09-17T04:20:47.841 INFO:tasks.workunit.client.1.smithi134.stdout:1/98: mkdir d12/d1c 0 2024-09-17T04:20:47.841 INFO:tasks.workunit.client.1.smithi134.stdout:1/99: dread - d12/f1b zero size 2024-09-17T04:20:47.846 INFO:tasks.workunit.client.1.smithi134.stdout:2/118: chown fc 5501 1 2024-09-17T04:20:47.848 INFO:tasks.workunit.client.1.smithi134.stdout:2/119: symlink d19/l26 0 2024-09-17T04:20:47.849 INFO:tasks.workunit.client.1.smithi134.stdout:7/74: rename d0/d4 to d0/d16 0 2024-09-17T04:20:47.850 INFO:tasks.workunit.client.1.smithi134.stdout:2/120: mkdir d19/d27 0 2024-09-17T04:20:47.852 INFO:tasks.workunit.client.1.smithi134.stdout:5/113: readlink d0/da/d12/l1a 0 2024-09-17T04:20:47.852 INFO:tasks.workunit.client.1.smithi134.stdout:2/121: rmdir d19 39 2024-09-17T04:20:47.855 INFO:tasks.workunit.client.1.smithi134.stdout:0/90: rename d11/d1a to d11/d22 0 2024-09-17T04:20:47.856 INFO:tasks.workunit.client.1.smithi134.stdout:3/144: getdents de/d12/d15/d1d 0 2024-09-17T04:20:47.861 INFO:tasks.workunit.client.1.smithi134.stdout:7/75: dwrite d0/d16/f13 [0,4194304] 0 2024-09-17T04:20:47.864 INFO:tasks.workunit.client.1.smithi134.stdout:2/122: dread d19/d1c/f1f [0,4194304] 0 2024-09-17T04:20:47.866 INFO:tasks.workunit.client.1.smithi134.stdout:8/75: truncate d4/fe 3013108 0 2024-09-17T04:20:47.868 INFO:tasks.workunit.client.1.smithi134.stdout:5/114: dread d0/f21 [0,4194304] 0 2024-09-17T04:20:47.870 INFO:tasks.workunit.client.1.smithi134.stdout:3/145: write de/d12/d15/f1a [952278,62404] 0 2024-09-17T04:20:47.873 INFO:tasks.workunit.client.1.smithi134.stdout:6/188: dwrite de/f12 [0,4194304] 0 2024-09-17T04:20:47.875 INFO:tasks.workunit.client.1.smithi134.stdout:7/76: symlink d0/dd/l17 0 2024-09-17T04:20:47.875 INFO:tasks.workunit.client.1.smithi134.stdout:4/227: dwrite d0/df/d1e/d20/f21 [0,4194304] 0 2024-09-17T04:20:47.882 INFO:tasks.workunit.client.1.smithi134.stdout:7/77: write d0/dd/fe [5062476,26645] 0 2024-09-17T04:20:47.884 INFO:tasks.workunit.client.1.smithi134.stdout:6/189: write de/f12 [872398,73870] 0 2024-09-17T04:20:47.887 INFO:tasks.workunit.client.1.smithi134.stdout:7/78: dread - d0/f15 zero size 2024-09-17T04:20:47.887 INFO:tasks.workunit.client.1.smithi134.stdout:0/91: link d11/f13 d11/d18/f23 0 2024-09-17T04:20:47.890 INFO:tasks.workunit.client.1.smithi134.stdout:2/123: dwrite ff [0,4194304] 0 2024-09-17T04:20:47.894 INFO:tasks.workunit.client.1.smithi134.stdout:1/100: truncate fd 1977976 0 2024-09-17T04:20:47.895 INFO:tasks.workunit.client.1.smithi134.stdout:1/101: stat d12 0 2024-09-17T04:20:47.897 INFO:tasks.workunit.client.1.smithi134.stdout:5/115: dwrite d0/d6/f17 [0,4194304] 0 2024-09-17T04:20:47.900 INFO:tasks.workunit.client.1.smithi134.stdout:9/431: dwrite d2/d5/d8/f19 [0,4194304] 0 2024-09-17T04:20:47.913 INFO:tasks.workunit.client.1.smithi134.stdout:2/124: fdatasync d19/f22 0 2024-09-17T04:20:47.913 INFO:tasks.workunit.client.1.smithi134.stdout:4/228: dwrite d0/df/d17/f24 [4194304,4194304] 0 2024-09-17T04:20:47.916 INFO:tasks.workunit.client.1.smithi134.stdout:6/190: dwrite de/d19/d1f/f28 [0,4194304] 0 2024-09-17T04:20:47.917 INFO:tasks.workunit.client.1.smithi134.stdout:6/191: chown de/c16 16956108 1 2024-09-17T04:20:47.920 INFO:tasks.workunit.client.1.smithi134.stdout:3/146: mkdir de/d12/d15/d1d/d2d/d31 0 2024-09-17T04:20:47.924 INFO:tasks.workunit.client.1.smithi134.stdout:5/116: dread d0/d6/ff [4194304,4194304] 0 2024-09-17T04:20:47.925 INFO:tasks.workunit.client.1.smithi134.stdout:8/76: write f3 [3024626,80532] 0 2024-09-17T04:20:47.925 INFO:tasks.workunit.client.1.smithi134.stdout:6/192: truncate de/d19/d21/f23 298296 0 2024-09-17T04:20:47.925 INFO:tasks.workunit.client.1.smithi134.stdout:9/432: unlink d2/d5/d9/l71 0 2024-09-17T04:20:47.926 INFO:tasks.workunit.client.1.smithi134.stdout:5/117: readlink d0/da/d12/l1a 0 2024-09-17T04:20:47.926 INFO:tasks.workunit.client.1.smithi134.stdout:3/147: dread - de/d10/f2e zero size 2024-09-17T04:20:47.932 INFO:tasks.workunit.client.1.smithi134.stdout:8/77: chown d4/f10 856719676 1 2024-09-17T04:20:47.932 INFO:tasks.workunit.client.1.smithi134.stdout:4/229: creat d0/df/d1e/f44 x:0 0 0 2024-09-17T04:20:47.934 INFO:tasks.workunit.client.1.smithi134.stdout:0/92: dwrite f0 [0,4194304] 0 2024-09-17T04:20:47.935 INFO:tasks.workunit.client.1.smithi134.stdout:8/78: fsync d4/fa 0 2024-09-17T04:20:47.935 INFO:tasks.workunit.client.1.smithi134.stdout:9/433: dread - d2/d5/d9/d6a/f7a zero size 2024-09-17T04:20:47.937 INFO:tasks.workunit.client.1.smithi134.stdout:7/79: truncate d0/dd/fb 1119819 0 2024-09-17T04:20:47.938 INFO:tasks.workunit.client.1.smithi134.stdout:1/102: mkdir d12/d19/d1d 0 2024-09-17T04:20:47.939 INFO:tasks.workunit.client.1.smithi134.stdout:4/230: write d0/df/f16 [1453234,7108] 0 2024-09-17T04:20:47.940 INFO:tasks.workunit.client.1.smithi134.stdout:6/193: mknod de/d19/d1a/d34/c36 0 2024-09-17T04:20:47.941 INFO:tasks.workunit.client.1.smithi134.stdout:3/148: symlink de/d12/d22/l32 0 2024-09-17T04:20:47.942 INFO:tasks.workunit.client.1.smithi134.stdout:0/93: mkdir d11/d24 0 2024-09-17T04:20:47.943 INFO:tasks.workunit.client.1.smithi134.stdout:4/231: chown d0/l7 87290 1 2024-09-17T04:20:47.945 INFO:tasks.workunit.client.1.smithi134.stdout:8/79: mkdir d4/d11 0 2024-09-17T04:20:47.945 INFO:tasks.workunit.client.1.smithi134.stdout:6/194: rename de/d2b to de/d2b/d37 22 2024-09-17T04:20:47.945 INFO:tasks.workunit.client.1.smithi134.stdout:9/434: unlink d2/d5/d8/d1e/l64 0 2024-09-17T04:20:47.951 INFO:tasks.workunit.client.1.smithi134.stdout:5/118: dwrite d0/f4 [0,4194304] 0 2024-09-17T04:20:47.951 INFO:tasks.workunit.client.1.smithi134.stdout:2/125: dread f2 [0,4194304] 0 2024-09-17T04:20:47.955 INFO:tasks.workunit.client.1.smithi134.stdout:8/80: chown d4/db/fc 904 1 2024-09-17T04:20:47.958 INFO:tasks.workunit.client.1.smithi134.stdout:9/435: symlink d2/l8f 0 2024-09-17T04:20:47.960 INFO:tasks.workunit.client.1.smithi134.stdout:1/103: dwrite ff [0,4194304] 0 2024-09-17T04:20:47.961 INFO:tasks.workunit.client.1.smithi134.stdout:8/81: fdatasync d4/fa 0 2024-09-17T04:20:47.967 INFO:tasks.workunit.client.1.smithi134.stdout:7/80: dwrite d0/f15 [0,4194304] 0 2024-09-17T04:20:47.970 INFO:tasks.workunit.client.1.smithi134.stdout:4/232: creat d0/df/d1e/d20/f45 x:0 0 0 2024-09-17T04:20:47.973 INFO:tasks.workunit.client.1.smithi134.stdout:9/436: write d2/d5/d8/d16/d54/f66 [890748,2054] 0 2024-09-17T04:20:47.975 INFO:tasks.workunit.client.1.smithi134.stdout:1/104: rename d12/f16 to d12/f1e 0 2024-09-17T04:20:47.976 INFO:tasks.workunit.client.1.smithi134.stdout:0/94: dwrite d11/f15 [0,4194304] 0 2024-09-17T04:20:47.978 INFO:tasks.workunit.client.1.smithi134.stdout:7/81: readlink d0/d16/la 0 2024-09-17T04:20:47.979 INFO:tasks.workunit.client.1.smithi134.stdout:5/119: rename d0/c1c to d0/da/c25 0 2024-09-17T04:20:47.980 INFO:tasks.workunit.client.1.smithi134.stdout:6/195: dwrite de/f15 [0,4194304] 0 2024-09-17T04:20:47.983 INFO:tasks.workunit.client.1.smithi134.stdout:4/233: symlink d0/d3b/l46 0 2024-09-17T04:20:47.990 INFO:tasks.workunit.client.1.smithi134.stdout:2/126: dwrite d19/d1c/f1f [0,4194304] 0 2024-09-17T04:20:47.991 INFO:tasks.workunit.client.1.smithi134.stdout:6/196: unlink de/l18 0 2024-09-17T04:20:47.991 INFO:tasks.workunit.client.1.smithi134.stdout:9/437: chown d2/d5/d9/d6a/f82 841 1 2024-09-17T04:20:47.991 INFO:tasks.workunit.client.1.smithi134.stdout:4/234: symlink d0/df/d1e/d20/l47 0 2024-09-17T04:20:47.994 INFO:tasks.workunit.client.1.smithi134.stdout:7/82: creat d0/dd/d11/f18 x:0 0 0 2024-09-17T04:20:47.994 INFO:tasks.workunit.client.1.smithi134.stdout:8/82: dwrite f3 [0,4194304] 0 2024-09-17T04:20:47.995 INFO:tasks.workunit.client.1.smithi134.stdout:3/149: dwrite de/ff [0,4194304] 0 2024-09-17T04:20:47.998 INFO:tasks.workunit.client.1.smithi134.stdout:1/105: getdents d12 0 2024-09-17T04:20:47.999 INFO:tasks.workunit.client.1.smithi134.stdout:2/127: dread fc [0,4194304] 0 2024-09-17T04:20:47.999 INFO:tasks.workunit.client.1.smithi134.stdout:4/235: unlink d0/l36 0 2024-09-17T04:20:47.999 INFO:tasks.workunit.client.1.smithi134.stdout:1/106: read - d12/f17 zero size 2024-09-17T04:20:48.000 INFO:tasks.workunit.client.1.smithi134.stdout:9/438: mknod d2/d5/d9/df/c90 0 2024-09-17T04:20:48.000 INFO:tasks.workunit.client.1.smithi134.stdout:3/150: stat l4 0 2024-09-17T04:20:48.004 INFO:tasks.workunit.client.1.smithi134.stdout:5/120: rename d0/c10 to d0/da/c26 0 2024-09-17T04:20:48.005 INFO:tasks.workunit.client.1.smithi134.stdout:8/83: creat d4/db/df/f12 x:0 0 0 2024-09-17T04:20:48.005 INFO:tasks.workunit.client.1.smithi134.stdout:3/151: write de/ff [1682484,92815] 0 2024-09-17T04:20:48.006 INFO:tasks.workunit.client.1.smithi134.stdout:2/128: mknod d19/c28 0 2024-09-17T04:20:48.009 INFO:tasks.workunit.client.1.smithi134.stdout:9/439: fsync d2/d5/d9/df/d38/f6c 0 2024-09-17T04:20:48.009 INFO:tasks.workunit.client.1.smithi134.stdout:3/152: dread fd [0,4194304] 0 2024-09-17T04:20:48.010 INFO:tasks.workunit.client.1.smithi134.stdout:2/129: write d19/f22 [142907,61527] 0 2024-09-17T04:20:48.010 INFO:tasks.workunit.client.1.smithi134.stdout:8/84: mkdir d4/db/df/d13 0 2024-09-17T04:20:48.011 INFO:tasks.workunit.client.1.smithi134.stdout:6/197: rename de/d19/c1d to de/d19/d1a/c38 0 2024-09-17T04:20:48.015 INFO:tasks.workunit.client.1.smithi134.stdout:0/95: dread d11/d18/f23 [0,4194304] 0 2024-09-17T04:20:48.016 INFO:tasks.workunit.client.1.smithi134.stdout:2/130: mknod d19/d1c/c29 0 2024-09-17T04:20:48.018 INFO:tasks.workunit.client.1.smithi134.stdout:8/85: dread f3 [0,4194304] 0 2024-09-17T04:20:48.020 INFO:tasks.workunit.client.1.smithi134.stdout:0/96: unlink cd 0 2024-09-17T04:20:48.021 INFO:tasks.workunit.client.1.smithi134.stdout:7/83: dread d0/dd/fb [0,4194304] 0 2024-09-17T04:20:48.022 INFO:tasks.workunit.client.1.smithi134.stdout:4/236: rename d0/d13/c37 to d0/df/d1e/d20/c48 0 2024-09-17T04:20:48.022 INFO:tasks.workunit.client.1.smithi134.stdout:0/97: chown d11/f15 238 1 2024-09-17T04:20:48.026 INFO:tasks.workunit.client.1.smithi134.stdout:6/198: dwrite de/f2c [0,4194304] 0 2024-09-17T04:20:48.027 INFO:tasks.workunit.client.1.smithi134.stdout:2/131: mknod d19/d27/c2a 0 2024-09-17T04:20:48.028 INFO:tasks.workunit.client.1.smithi134.stdout:9/440: link d2/d5/d37/c39 d2/d5/d37/d57/c91 0 2024-09-17T04:20:48.029 INFO:tasks.workunit.client.1.smithi134.stdout:3/153: write de/d10/f23 [1077709,127914] 0 2024-09-17T04:20:48.030 INFO:tasks.workunit.client.1.smithi134.stdout:0/98: rename d11/d18/c1d to d11/c25 0 2024-09-17T04:20:48.031 INFO:tasks.workunit.client.1.smithi134.stdout:4/237: unlink d0/df/d1e/d20/l3a 0 2024-09-17T04:20:48.031 INFO:tasks.workunit.client.1.smithi134.stdout:6/199: read - de/d19/d1f/f26 zero size 2024-09-17T04:20:48.031 INFO:tasks.workunit.client.1.smithi134.stdout:8/86: dwrite d4/f7 [0,4194304] 0 2024-09-17T04:20:48.034 INFO:tasks.workunit.client.1.smithi134.stdout:2/132: creat d19/d27/f2b x:0 0 0 2024-09-17T04:20:48.034 INFO:tasks.workunit.client.1.smithi134.stdout:0/99: rename d11 to d11/d22/d1c/d26 22 2024-09-17T04:20:48.035 INFO:tasks.workunit.client.1.smithi134.stdout:3/154: chown de/d12/d15/d1d/d2d/d31 103794819 1 2024-09-17T04:20:48.036 INFO:tasks.workunit.client.1.smithi134.stdout:7/84: creat d0/f19 x:0 0 0 2024-09-17T04:20:48.036 INFO:tasks.workunit.client.1.smithi134.stdout:1/107: dwrite fd [0,4194304] 0 2024-09-17T04:20:48.037 INFO:tasks.workunit.client.1.smithi134.stdout:9/441: creat d2/d5/d37/d83/f92 x:0 0 0 2024-09-17T04:20:48.039 INFO:tasks.workunit.client.1.smithi134.stdout:2/133: symlink d19/d1c/l2c 0 2024-09-17T04:20:48.040 INFO:tasks.workunit.client.1.smithi134.stdout:2/134: chown d19/f22 13804271 1 2024-09-17T04:20:48.041 INFO:tasks.workunit.client.1.smithi134.stdout:7/85: creat d0/dd/f1a x:0 0 0 2024-09-17T04:20:48.046 INFO:tasks.workunit.client.1.smithi134.stdout:9/442: truncate d2/d5/d37/d83/f92 371833 0 2024-09-17T04:20:48.046 INFO:tasks.workunit.client.1.smithi134.stdout:7/86: write d0/dd/fe [2802591,117460] 0 2024-09-17T04:20:48.046 INFO:tasks.workunit.client.1.smithi134.stdout:8/87: rename d4/fa to d4/db/f14 0 2024-09-17T04:20:48.046 INFO:tasks.workunit.client.1.smithi134.stdout:7/87: stat d0/f6 0 2024-09-17T04:20:48.046 INFO:tasks.workunit.client.1.smithi134.stdout:8/88: stat f3 0 2024-09-17T04:20:48.047 INFO:tasks.workunit.client.1.smithi134.stdout:0/100: creat d11/d19/d21/f27 x:0 0 0 2024-09-17T04:20:48.049 INFO:tasks.workunit.client.1.smithi134.stdout:1/108: dwrite d12/f14 [0,4194304] 0 2024-09-17T04:20:48.050 INFO:tasks.workunit.client.1.smithi134.stdout:3/155: creat de/d12/d15/d1d/f33 x:0 0 0 2024-09-17T04:20:48.052 INFO:tasks.workunit.client.1.smithi134.stdout:2/135: rename ff to d19/d1c/f2d 0 2024-09-17T04:20:48.054 INFO:tasks.workunit.client.1.smithi134.stdout:3/156: write de/d12/f17 [8889271,101274] 0 2024-09-17T04:20:48.054 INFO:tasks.workunit.client.1.smithi134.stdout:0/101: unlink ff 0 2024-09-17T04:20:48.055 INFO:tasks.workunit.client.1.smithi134.stdout:6/200: link de/f12 de/d19/d21/d2d/f39 0 2024-09-17T04:20:48.057 INFO:tasks.workunit.client.1.smithi134.stdout:7/88: dwrite d0/f15 [0,4194304] 0 2024-09-17T04:20:48.058 INFO:tasks.workunit.client.1.smithi134.stdout:3/157: write de/d12/d22/f26 [2098421,21299] 0 2024-09-17T04:20:48.063 INFO:tasks.workunit.client.1.smithi134.stdout:1/109: rename c4 to d12/d1c/c1f 0 2024-09-17T04:20:48.068 INFO:tasks.workunit.client.1.smithi134.stdout:2/136: symlink d19/l2e 0 2024-09-17T04:20:48.070 INFO:tasks.workunit.client.1.smithi134.stdout:0/102: creat d11/d24/f28 x:0 0 0 2024-09-17T04:20:48.070 INFO:tasks.workunit.client.1.smithi134.stdout:4/238: truncate d0/df/d1e/d20/f21 62242 0 2024-09-17T04:20:48.070 INFO:tasks.workunit.client.1.smithi134.stdout:0/103: dread - d11/d18/f1e zero size 2024-09-17T04:20:48.071 INFO:tasks.workunit.client.1.smithi134.stdout:6/201: link fd de/f3a 0 2024-09-17T04:20:48.072 INFO:tasks.workunit.client.1.smithi134.stdout:3/158: symlink de/d12/d15/d1d/d2d/d31/l34 0 2024-09-17T04:20:48.074 INFO:tasks.workunit.client.1.smithi134.stdout:3/159: dread - de/d10/f2e zero size 2024-09-17T04:20:48.074 INFO:tasks.workunit.client.1.smithi134.stdout:4/239: unlink d0/d3b/l46 0 2024-09-17T04:20:48.075 INFO:tasks.workunit.client.1.smithi134.stdout:3/160: fsync fc 0 2024-09-17T04:20:48.076 INFO:tasks.workunit.client.1.smithi134.stdout:0/104: unlink d11/d22/d1c/l20 0 2024-09-17T04:20:48.076 INFO:tasks.workunit.client.1.smithi134.stdout:3/161: read de/ff [786085,70948] 0 2024-09-17T04:20:48.077 INFO:tasks.workunit.client.1.smithi134.stdout:7/89: creat d0/f1b x:0 0 0 2024-09-17T04:20:48.077 INFO:tasks.workunit.client.1.smithi134.stdout:0/105: write f0 [1453629,99623] 0 2024-09-17T04:20:48.078 INFO:tasks.workunit.client.1.smithi134.stdout:6/202: mkdir de/d19/d1a/d34/d3b 0 2024-09-17T04:20:48.078 INFO:tasks.workunit.client.1.smithi134.stdout:3/162: dread - de/f2a zero size 2024-09-17T04:20:48.078 INFO:tasks.workunit.client.1.smithi134.stdout:7/90: dread - d0/dd/f1a zero size 2024-09-17T04:20:48.079 INFO:tasks.workunit.client.1.smithi134.stdout:2/137: rename d19/f25 to d19/d27/f2f 0 2024-09-17T04:20:48.079 INFO:tasks.workunit.client.1.smithi134.stdout:0/106: chown cb 499 1 2024-09-17T04:20:48.080 INFO:tasks.workunit.client.1.smithi134.stdout:4/240: mknod d0/df/d17/c49 0 2024-09-17T04:20:48.080 INFO:tasks.workunit.client.1.smithi134.stdout:7/91: stat d0/dd/fb 0 2024-09-17T04:20:48.081 INFO:tasks.workunit.client.1.smithi134.stdout:1/110: getdents d12/d19 0 2024-09-17T04:20:48.082 INFO:tasks.workunit.client.1.smithi134.stdout:2/138: rmdir d19 39 2024-09-17T04:20:48.083 INFO:tasks.workunit.client.1.smithi134.stdout:0/107: symlink d11/d24/l29 0 2024-09-17T04:20:48.083 INFO:tasks.workunit.client.1.smithi134.stdout:8/89: dread f0 [0,4194304] 0 2024-09-17T04:20:48.084 INFO:tasks.workunit.client.1.smithi134.stdout:3/163: rename fc to de/d12/d15/d1d/d2d/d31/f35 0 2024-09-17T04:20:48.085 INFO:tasks.workunit.client.1.smithi134.stdout:9/443: dread d2/d5/d9/f30 [0,4194304] 0 2024-09-17T04:20:48.085 INFO:tasks.workunit.client.1.smithi134.stdout:4/241: creat d0/df/d1e/d20/f4a x:0 0 0 2024-09-17T04:20:48.087 INFO:tasks.workunit.client.1.smithi134.stdout:1/111: creat d12/d19/f20 x:0 0 0 2024-09-17T04:20:48.087 INFO:tasks.workunit.client.1.smithi134.stdout:1/112: fsync d12/f17 0 2024-09-17T04:20:48.089 INFO:tasks.workunit.client.1.smithi134.stdout:1/113: dread - d12/f1a zero size 2024-09-17T04:20:48.090 INFO:tasks.workunit.client.1.smithi134.stdout:7/92: unlink d0/l5 0 2024-09-17T04:20:48.091 INFO:tasks.workunit.client.1.smithi134.stdout:0/108: stat d11/c25 0 2024-09-17T04:20:48.092 INFO:tasks.workunit.client.1.smithi134.stdout:7/93: chown d0/dd/f1a 1611709 1 2024-09-17T04:20:48.093 INFO:tasks.workunit.client.1.smithi134.stdout:3/164: creat de/d12/d15/d1d/d2d/f36 x:0 0 0 2024-09-17T04:20:48.093 INFO:tasks.workunit.client.1.smithi134.stdout:7/94: chown d0/dd/l17 1 1 2024-09-17T04:20:48.094 INFO:tasks.workunit.client.1.smithi134.stdout:4/242: dwrite d0/df/f16 [0,4194304] 0 2024-09-17T04:20:48.094 INFO:tasks.workunit.client.1.smithi134.stdout:0/109: truncate d11/d18/f1f 132911 0 2024-09-17T04:20:48.095 INFO:tasks.workunit.client.1.smithi134.stdout:2/139: creat d19/d1c/f30 x:0 0 0 2024-09-17T04:20:48.097 INFO:tasks.workunit.client.1.smithi134.stdout:1/114: creat d12/d1c/f21 x:0 0 0 2024-09-17T04:20:48.097 INFO:tasks.workunit.client.1.smithi134.stdout:2/140: dread - d19/d1c/f1d zero size 2024-09-17T04:20:48.098 INFO:tasks.workunit.client.1.smithi134.stdout:9/444: creat d2/d7/d75/f93 x:0 0 0 2024-09-17T04:20:48.099 INFO:tasks.workunit.client.1.smithi134.stdout:7/95: rmdir d0 39 2024-09-17T04:20:48.099 INFO:tasks.workunit.client.1.smithi134.stdout:1/115: write fd [860075,11297] 0 2024-09-17T04:20:48.100 INFO:tasks.workunit.client.1.smithi134.stdout:8/90: dwrite d4/db/f14 [0,4194304] 0 2024-09-17T04:20:48.100 INFO:tasks.workunit.client.1.smithi134.stdout:2/141: chown d19/d1c/l24 23337808 1 2024-09-17T04:20:48.100 INFO:tasks.workunit.client.1.smithi134.stdout:2/142: fsync f11 0 2024-09-17T04:20:48.101 INFO:tasks.workunit.client.1.smithi134.stdout:3/165: creat de/d12/d15/d1d/f37 x:0 0 0 2024-09-17T04:20:48.101 INFO:tasks.workunit.client.1.smithi134.stdout:4/243: fsync d0/df/d1e/d20/f34 0 2024-09-17T04:20:48.101 INFO:tasks.workunit.client.1.smithi134.stdout:6/203: write de/d19/d1a/f20 [179246,62832] 0 2024-09-17T04:20:48.103 INFO:tasks.workunit.client.1.smithi134.stdout:4/244: readlink d0/df/d1e/d20/l47 0 2024-09-17T04:20:48.104 INFO:tasks.workunit.client.1.smithi134.stdout:9/445: mknod d2/d7/c94 0 2024-09-17T04:20:48.105 INFO:tasks.workunit.client.1.smithi134.stdout:6/204: chown de/d19/d1a/d34/l35 1231332 1 2024-09-17T04:20:48.105 INFO:tasks.workunit.client.1.smithi134.stdout:8/91: unlink d4/f7 0 2024-09-17T04:20:48.106 INFO:tasks.workunit.client.1.smithi134.stdout:9/446: dread - d2/d5/d37/d57/d6d/d84/f65 zero size 2024-09-17T04:20:48.107 INFO:tasks.workunit.client.1.smithi134.stdout:1/116: mknod d12/d19/c22 0 2024-09-17T04:20:48.109 INFO:tasks.workunit.client.1.smithi134.stdout:3/166: symlink de/l38 0 2024-09-17T04:20:48.110 INFO:tasks.workunit.client.1.smithi134.stdout:2/143: mkdir d19/d27/d31 0 2024-09-17T04:20:48.113 INFO:tasks.workunit.client.1.smithi134.stdout:4/245: symlink d0/df/d35/d39/l4b 0 2024-09-17T04:20:48.113 INFO:tasks.workunit.client.1.smithi134.stdout:8/92: dread f3 [0,4194304] 0 2024-09-17T04:20:48.114 INFO:tasks.workunit.client.1.smithi134.stdout:6/205: creat de/d19/d1a/d34/f3c x:0 0 0 2024-09-17T04:20:48.114 INFO:tasks.workunit.client.1.smithi134.stdout:1/117: unlink d12/f1e 0 2024-09-17T04:20:48.116 INFO:tasks.workunit.client.1.smithi134.stdout:8/93: dread f3 [0,4194304] 0 2024-09-17T04:20:48.117 INFO:tasks.workunit.client.1.smithi134.stdout:9/447: creat d2/d5/d37/d57/f95 x:0 0 0 2024-09-17T04:20:48.117 INFO:tasks.workunit.client.1.smithi134.stdout:8/94: stat d4/db 0 2024-09-17T04:20:48.118 INFO:tasks.workunit.client.1.smithi134.stdout:8/95: read - d4/db/fc zero size 2024-09-17T04:20:48.120 INFO:tasks.workunit.client.1.smithi134.stdout:4/246: mkdir d0/d13/d4c 0 2024-09-17T04:20:48.123 INFO:tasks.workunit.client.1.smithi134.stdout:1/118: creat d12/f23 x:0 0 0 2024-09-17T04:20:48.124 INFO:tasks.workunit.client.1.smithi134.stdout:1/119: write d12/d1c/f21 [258515,49480] 0 2024-09-17T04:20:48.125 INFO:tasks.workunit.client.1.smithi134.stdout:1/120: write d12/f14 [5054688,14233] 0 2024-09-17T04:20:48.127 INFO:tasks.workunit.client.1.smithi134.stdout:4/247: mknod d0/d3b/c4d 0 2024-09-17T04:20:48.129 INFO:tasks.workunit.client.1.smithi134.stdout:9/448: truncate d2/f43 1360605 0 2024-09-17T04:20:48.130 INFO:tasks.workunit.client.1.smithi134.stdout:9/449: chown d2/d5 1 1 2024-09-17T04:20:48.132 INFO:tasks.workunit.client.1.smithi134.stdout:2/144: link f1 d19/d27/f32 0 2024-09-17T04:20:48.133 INFO:tasks.workunit.client.1.smithi134.stdout:2/145: chown d19/d1c/c29 60688 1 2024-09-17T04:20:48.133 INFO:tasks.workunit.client.1.smithi134.stdout:4/248: dwrite d0/df/d1e/d20/f26 [0,4194304] 0 2024-09-17T04:20:48.133 INFO:tasks.workunit.client.1.smithi134.stdout:6/206: write de/f3a [5192276,62804] 0 2024-09-17T04:20:48.135 INFO:tasks.workunit.client.1.smithi134.stdout:3/167: truncate de/d12/d15/f1a 500710 0 2024-09-17T04:20:48.136 INFO:tasks.workunit.client.1.smithi134.stdout:6/207: write de/d19/d21/d2d/f2f [748337,112158] 0 2024-09-17T04:20:48.136 INFO:tasks.workunit.client.1.smithi134.stdout:9/450: mkdir d2/d7/d75/d96 0 2024-09-17T04:20:48.137 INFO:tasks.workunit.client.1.smithi134.stdout:8/96: link d4/l8 d4/db/l15 0 2024-09-17T04:20:48.139 INFO:tasks.workunit.client.1.smithi134.stdout:1/121: link fd d12/d1c/f24 0 2024-09-17T04:20:48.140 INFO:tasks.workunit.client.1.smithi134.stdout:2/146: mknod d19/d27/c33 0 2024-09-17T04:20:48.140 INFO:tasks.workunit.client.1.smithi134.stdout:6/208: dread de/f13 [0,4194304] 0 2024-09-17T04:20:48.141 INFO:tasks.workunit.client.1.smithi134.stdout:4/249: write d0/df/d1e/f2e [1464619,10943] 0 2024-09-17T04:20:48.142 INFO:tasks.workunit.client.1.smithi134.stdout:9/451: dread d2/d5/d58/f85 [0,4194304] 0 2024-09-17T04:20:48.142 INFO:tasks.workunit.client.1.smithi134.stdout:3/168: fdatasync de/d12/d15/f1a 0 2024-09-17T04:20:48.143 INFO:tasks.workunit.client.1.smithi134.stdout:8/97: write f3 [583614,52660] 0 2024-09-17T04:20:48.143 INFO:tasks.workunit.client.1.smithi134.stdout:2/147: read - d19/d27/f2b zero size 2024-09-17T04:20:48.145 INFO:tasks.workunit.client.1.smithi134.stdout:2/148: rmdir d19 39 2024-09-17T04:20:48.146 INFO:tasks.workunit.client.1.smithi134.stdout:8/98: write d4/fe [506284,19640] 0 2024-09-17T04:20:48.146 INFO:tasks.workunit.client.1.smithi134.stdout:6/209: dread de/d19/f22 [0,4194304] 0 2024-09-17T04:20:48.147 INFO:tasks.workunit.client.1.smithi134.stdout:4/250: creat d0/df/f4e x:0 0 0 2024-09-17T04:20:48.148 INFO:tasks.workunit.client.1.smithi134.stdout:9/452: creat d2/d5/d37/d57/d6d/f97 x:0 0 0 2024-09-17T04:20:48.150 INFO:tasks.workunit.client.1.smithi134.stdout:3/169: rename de/d12/d15/l2c to de/d12/d22/l39 0 2024-09-17T04:20:48.151 INFO:tasks.workunit.client.1.smithi134.stdout:1/122: dwrite ff [0,4194304] 0 2024-09-17T04:20:48.151 INFO:tasks.workunit.client.1.smithi134.stdout:2/149: dread - d19/d27/f2b zero size 2024-09-17T04:20:48.151 INFO:tasks.workunit.client.1.smithi134.stdout:8/99: fdatasync d4/fe 0 2024-09-17T04:20:48.152 INFO:tasks.workunit.client.1.smithi134.stdout:6/210: creat de/d19/f3d x:0 0 0 2024-09-17T04:20:48.155 INFO:tasks.workunit.client.1.smithi134.stdout:9/453: unlink d2/d5/d9/c41 0 2024-09-17T04:20:48.155 INFO:tasks.workunit.client.1.smithi134.stdout:6/211: chown de/d19/d21/f25 911 1 2024-09-17T04:20:48.156 INFO:tasks.workunit.client.1.smithi134.stdout:1/123: creat d12/d19/f25 x:0 0 0 2024-09-17T04:20:48.157 INFO:tasks.workunit.client.1.smithi134.stdout:9/454: chown d2/d5/d8/d16/fd 0 1 2024-09-17T04:20:48.158 INFO:tasks.workunit.client.1.smithi134.stdout:4/251: dwrite d0/f43 [0,4194304] 0 2024-09-17T04:20:48.159 INFO:tasks.workunit.client.1.smithi134.stdout:8/100: rmdir d4/db/df 39 2024-09-17T04:20:48.161 INFO:tasks.workunit.client.1.smithi134.stdout:8/101: stat d4/l5 0 2024-09-17T04:20:48.162 INFO:tasks.workunit.client.1.smithi134.stdout:8/102: stat d4/db 0 2024-09-17T04:20:48.164 INFO:tasks.workunit.client.1.smithi134.stdout:6/212: creat de/d19/d21/d2d/f3e x:0 0 0 2024-09-17T04:20:48.168 INFO:tasks.workunit.client.1.smithi134.stdout:3/170: creat de/d12/f3a x:0 0 0 2024-09-17T04:20:48.170 INFO:tasks.workunit.client.1.smithi134.stdout:1/124: dwrite d12/d1c/f21 [0,4194304] 0 2024-09-17T04:20:48.170 INFO:tasks.workunit.client.1.smithi134.stdout:2/150: dwrite f2 [0,4194304] 0 2024-09-17T04:20:48.173 INFO:tasks.workunit.client.1.smithi134.stdout:3/171: chown de/d12/l2f 3 1 2024-09-17T04:20:48.175 INFO:tasks.workunit.client.1.smithi134.stdout:8/103: write d4/db/df/f12 [993083,29628] 0 2024-09-17T04:20:48.179 INFO:tasks.workunit.client.1.smithi134.stdout:8/104: chown d4 128393 1 2024-09-17T04:20:48.181 INFO:tasks.workunit.client.1.smithi134.stdout:9/455: dwrite d2/d5/d9/df/f79 [0,4194304] 0 2024-09-17T04:20:48.185 INFO:tasks.workunit.client.1.smithi134.stdout:4/252: dwrite d0/f43 [4194304,4194304] 0 2024-09-17T04:20:48.186 INFO:tasks.workunit.client.1.smithi134.stdout:1/125: dread d12/f14 [0,4194304] 0 2024-09-17T04:20:48.187 INFO:tasks.workunit.client.1.smithi134.stdout:1/126: chown d12/f17 168655337 1 2024-09-17T04:20:48.189 INFO:tasks.workunit.client.1.smithi134.stdout:1/127: chown d12/d19 2400 1 2024-09-17T04:20:48.193 INFO:tasks.workunit.client.1.smithi134.stdout:9/456: dwrite d2/d5/d9/d6a/f82 [0,4194304] 0 2024-09-17T04:20:48.212 INFO:tasks.workunit.client.1.smithi134.stdout:5/121: sync 2024-09-17T04:20:48.236 INFO:tasks.workunit.client.1.smithi134.stdout:6/213: mknod de/d19/d1a/d34/d3b/c3f 0 2024-09-17T04:20:48.237 INFO:tasks.workunit.client.1.smithi134.stdout:6/214: dread - de/d19/d1a/d34/f3c zero size 2024-09-17T04:20:48.241 INFO:tasks.workunit.client.1.smithi134.stdout:2/151: mkdir d19/d27/d31/d34 0 2024-09-17T04:20:48.241 INFO:tasks.workunit.client.1.smithi134.stdout:2/152: chown f16 16567827 1 2024-09-17T04:20:48.243 INFO:tasks.workunit.client.1.smithi134.stdout:8/105: creat d4/db/dd/f16 x:0 0 0 2024-09-17T04:20:48.249 INFO:tasks.workunit.client.1.smithi134.stdout:3/172: truncate de/d12/d22/f26 1791531 0 2024-09-17T04:20:48.249 INFO:tasks.workunit.client.1.smithi134.stdout:9/457: creat d2/d5/f98 x:0 0 0 2024-09-17T04:20:48.249 INFO:tasks.workunit.client.1.smithi134.stdout:5/122: symlink d0/da/d12/l27 0 2024-09-17T04:20:48.249 INFO:tasks.workunit.client.1.smithi134.stdout:8/106: write f0 [1825355,112727] 0 2024-09-17T04:20:48.249 INFO:tasks.workunit.client.1.smithi134.stdout:4/253: getdents d0/df/d35/d39 0 2024-09-17T04:20:48.250 INFO:tasks.workunit.client.1.smithi134.stdout:1/128: link d12/d1c/c1f d12/d19/c26 0 2024-09-17T04:20:48.251 INFO:tasks.workunit.client.1.smithi134.stdout:2/153: creat d19/f35 x:0 0 0 2024-09-17T04:20:48.252 INFO:tasks.workunit.client.1.smithi134.stdout:5/123: chown d0/d6/fc 44443 1 2024-09-17T04:20:48.252 INFO:tasks.workunit.client.1.smithi134.stdout:8/107: readlink d4/db/l15 0 2024-09-17T04:20:48.253 INFO:tasks.workunit.client.1.smithi134.stdout:4/254: stat d0/df/d17/c49 0 2024-09-17T04:20:48.254 INFO:tasks.workunit.client.1.smithi134.stdout:6/215: dwrite de/d19/d21/d2d/f39 [0,4194304] 0 2024-09-17T04:20:48.255 INFO:tasks.workunit.client.1.smithi134.stdout:0/110: sync 2024-09-17T04:20:48.257 INFO:tasks.workunit.client.1.smithi134.stdout:3/173: rename de/d10/f23 to de/f3b 0 2024-09-17T04:20:48.258 INFO:tasks.workunit.client.1.smithi134.stdout:6/216: mknod de/d19/c40 0 2024-09-17T04:20:48.260 INFO:tasks.workunit.client.1.smithi134.stdout:4/255: creat d0/d13/d40/d42/f4f x:0 0 0 2024-09-17T04:20:48.261 INFO:tasks.workunit.client.1.smithi134.stdout:0/111: symlink d11/d19/l2a 0 2024-09-17T04:20:48.263 INFO:tasks.workunit.client.1.smithi134.stdout:1/129: rename d12/d19/f20 to d12/d19/d1d/f27 0 2024-09-17T04:20:48.268 INFO:tasks.workunit.client.1.smithi134.stdout:5/124: dread d0/f2 [0,4194304] 0 2024-09-17T04:20:48.268 INFO:tasks.workunit.client.1.smithi134.stdout:6/217: mkdir de/d19/d21/d2d/d41 0 2024-09-17T04:20:48.270 INFO:tasks.workunit.client.1.smithi134.stdout:2/154: dwrite f16 [0,4194304] 0 2024-09-17T04:20:48.275 INFO:tasks.workunit.client.1.smithi134.stdout:8/108: dwrite d4/db/dd/f16 [0,4194304] 0 2024-09-17T04:20:48.278 INFO:tasks.workunit.client.1.smithi134.stdout:8/109: chown d4 224929169 1 2024-09-17T04:20:48.279 INFO:tasks.workunit.client.1.smithi134.stdout:9/458: dwrite d2/d5/d8/d1e/f29 [0,4194304] 0 2024-09-17T04:20:48.279 INFO:tasks.workunit.client.1.smithi134.stdout:1/130: rename cb to d12/d1c/c28 0 2024-09-17T04:20:48.280 INFO:tasks.workunit.client.1.smithi134.stdout:4/256: rmdir d0/d13/d4c 0 2024-09-17T04:20:48.283 INFO:tasks.workunit.client.1.smithi134.stdout:1/131: write d12/f23 [313093,38208] 0 2024-09-17T04:20:48.284 INFO:tasks.workunit.client.1.smithi134.stdout:8/110: symlink d4/l17 0 2024-09-17T04:20:48.288 INFO:tasks.workunit.client.1.smithi134.stdout:7/96: sync 2024-09-17T04:20:48.289 INFO:tasks.workunit.client.1.smithi134.stdout:0/112: rename d11/d18/c1b to d11/d24/c2b 0 2024-09-17T04:20:48.289 INFO:tasks.workunit.client.1.smithi134.stdout:3/174: dwrite de/d12/d15/d1d/d2d/d31/f35 [0,4194304] 0 2024-09-17T04:20:48.290 INFO:tasks.workunit.client.1.smithi134.stdout:2/155: link d19/d1c/l2c d19/d27/d31/l36 0 2024-09-17T04:20:48.290 INFO:tasks.workunit.client.1.smithi134.stdout:1/132: rmdir d12/d19/d1d 39 2024-09-17T04:20:48.291 INFO:tasks.workunit.client.1.smithi134.stdout:1/133: readlink - no filename 2024-09-17T04:20:48.291 INFO:tasks.workunit.client.1.smithi134.stdout:2/156: chown fc 80171889 1 2024-09-17T04:20:48.294 INFO:tasks.workunit.client.1.smithi134.stdout:2/157: readlink d19/l26 0 2024-09-17T04:20:48.295 INFO:tasks.workunit.client.1.smithi134.stdout:6/218: dwrite de/d19/f24 [0,4194304] 0 2024-09-17T04:20:48.295 INFO:tasks.workunit.client.1.smithi134.stdout:8/111: symlink d4/db/df/d13/l18 0 2024-09-17T04:20:48.296 INFO:tasks.workunit.client.1.smithi134.stdout:0/113: rename d11/d24/l29 to d11/l2c 0 2024-09-17T04:20:48.297 INFO:tasks.workunit.client.1.smithi134.stdout:1/134: mknod d12/c29 0 2024-09-17T04:20:48.298 INFO:tasks.workunit.client.1.smithi134.stdout:8/112: write f3 [4214951,58011] 0 2024-09-17T04:20:48.299 INFO:tasks.workunit.client.1.smithi134.stdout:6/219: dread de/d19/d21/f25 [0,4194304] 0 2024-09-17T04:20:48.299 INFO:tasks.workunit.client.1.smithi134.stdout:9/459: getdents d2/d5/d37 0 2024-09-17T04:20:48.300 INFO:tasks.workunit.client.1.smithi134.stdout:1/135: write d12/d1c/f21 [183365,129261] 0 2024-09-17T04:20:48.301 INFO:tasks.workunit.client.1.smithi134.stdout:2/158: rmdir d19 39 2024-09-17T04:20:48.302 INFO:tasks.workunit.client.1.smithi134.stdout:7/97: creat d0/f1c x:0 0 0 2024-09-17T04:20:48.303 INFO:tasks.workunit.client.1.smithi134.stdout:1/136: write d12/f17 [508664,98692] 0 2024-09-17T04:20:48.304 INFO:tasks.workunit.client.1.smithi134.stdout:8/113: rename d4/db/df/d13 to d4/db/df/d13/d19 22 2024-09-17T04:20:48.306 INFO:tasks.workunit.client.1.smithi134.stdout:2/159: rmdir d19/d27 39 2024-09-17T04:20:48.307 INFO:tasks.workunit.client.1.smithi134.stdout:6/220: read f7 [3097407,26098] 0 2024-09-17T04:20:48.307 INFO:tasks.workunit.client.1.smithi134.stdout:1/137: rename d12/c15 to d12/c2a 0 2024-09-17T04:20:48.311 INFO:tasks.workunit.client.1.smithi134.stdout:9/460: rename d2/d5/d8/d16/f32 to d2/d5/d9/df/d38/f99 0 2024-09-17T04:20:48.312 INFO:tasks.workunit.client.1.smithi134.stdout:1/138: rmdir d12 39 2024-09-17T04:20:48.315 INFO:tasks.workunit.client.1.smithi134.stdout:8/114: dwrite d4/db/df/f12 [0,4194304] 0 2024-09-17T04:20:48.315 INFO:tasks.workunit.client.1.smithi134.stdout:8/115: dread - d4/db/fc zero size 2024-09-17T04:20:48.317 INFO:tasks.workunit.client.1.smithi134.stdout:1/139: fsync d12/d1c/f21 0 2024-09-17T04:20:48.318 INFO:tasks.workunit.client.1.smithi134.stdout:5/125: truncate d0/d6/ff 5484556 0 2024-09-17T04:20:48.318 INFO:tasks.workunit.client.1.smithi134.stdout:5/126: truncate d0/d6/f1f 344569 0 2024-09-17T04:20:48.321 INFO:tasks.workunit.client.1.smithi134.stdout:6/221: rename de/f15 to de/d19/d1a/d34/f42 0 2024-09-17T04:20:48.323 INFO:tasks.workunit.client.1.smithi134.stdout:6/222: dread de/f13 [0,4194304] 0 2024-09-17T04:20:48.324 INFO:tasks.workunit.client.1.smithi134.stdout:9/461: truncate d2/d5/d9/df/d38/f6c 1056743 0 2024-09-17T04:20:48.325 INFO:tasks.workunit.client.1.smithi134.stdout:9/462: fdatasync d2/d5/d37/d57/d6d/d84/f65 0 2024-09-17T04:20:48.327 INFO:tasks.workunit.client.1.smithi134.stdout:4/257: truncate d0/df/d1e/f25 4250832 0 2024-09-17T04:20:48.328 INFO:tasks.workunit.client.1.smithi134.stdout:5/127: rmdir d0/da/d12 39 2024-09-17T04:20:48.329 INFO:tasks.workunit.client.1.smithi134.stdout:4/258: chown d0/d13/f33 0 1 2024-09-17T04:20:48.330 INFO:tasks.workunit.client.1.smithi134.stdout:0/114: dread f9 [0,4194304] 0 2024-09-17T04:20:48.332 INFO:tasks.workunit.client.1.smithi134.stdout:3/175: dwrite de/d10/f11 [0,4194304] 0 2024-09-17T04:20:48.335 INFO:tasks.workunit.client.1.smithi134.stdout:1/140: rename d12/c13 to d12/d1c/c2b 0 2024-09-17T04:20:48.335 INFO:tasks.workunit.client.1.smithi134.stdout:2/160: write f12 [317992,101057] 0 2024-09-17T04:20:48.336 INFO:tasks.workunit.client.1.smithi134.stdout:1/141: read ff [3612826,27527] 0 2024-09-17T04:20:48.339 INFO:tasks.workunit.client.1.smithi134.stdout:6/223: creat de/d2b/f43 x:0 0 0 2024-09-17T04:20:48.339 INFO:tasks.workunit.client.1.smithi134.stdout:6/224: chown de/d19/d1a/d34/c36 6386 1 2024-09-17T04:20:48.340 INFO:tasks.workunit.client.1.smithi134.stdout:9/463: readlink d2/d7/l8d 0 2024-09-17T04:20:48.343 INFO:tasks.workunit.client.1.smithi134.stdout:2/161: dwrite f2 [0,4194304] 0 2024-09-17T04:20:48.349 INFO:tasks.workunit.client.1.smithi134.stdout:0/115: mkdir d11/d18/d2d 0 2024-09-17T04:20:48.349 INFO:tasks.workunit.client.1.smithi134.stdout:0/116: fsync d11/d18/f1e 0 2024-09-17T04:20:48.354 INFO:tasks.workunit.client.1.smithi134.stdout:1/142: unlink d12/d19/c22 0 2024-09-17T04:20:48.430 INFO:tasks.workunit.client.1.smithi134.stdout:6/225: symlink de/d2b/l44 0 2024-09-17T04:20:48.431 INFO:tasks.workunit.client.1.smithi134.stdout:8/116: link d4/db/l15 d4/db/df/l1a 0 2024-09-17T04:20:48.451 INFO:tasks.workunit.client.1.smithi134.stdout:7/98: creat d0/dd/d11/f1d x:0 0 0 2024-09-17T04:20:48.456 INFO:tasks.workunit.client.1.smithi134.stdout:4/259: truncate d0/df/d1e/d20/f21 205136 0 2024-09-17T04:20:48.458 INFO:tasks.workunit.client.1.smithi134.stdout:3/176: mknod de/d12/c3c 0 2024-09-17T04:20:48.461 INFO:tasks.workunit.client.1.smithi134.stdout:0/117: creat d11/f2e x:0 0 0 2024-09-17T04:20:48.463 INFO:tasks.workunit.client.1.smithi134.stdout:1/143: symlink d12/l2c 0 2024-09-17T04:20:48.464 INFO:tasks.workunit.client.1.smithi134.stdout:1/144: readlink d12/l2c 0 2024-09-17T04:20:48.464 INFO:tasks.workunit.client.1.smithi134.stdout:1/145: stat c6 0 2024-09-17T04:20:48.465 INFO:tasks.workunit.client.1.smithi134.stdout:6/226: creat de/d2b/f45 x:0 0 0 2024-09-17T04:20:48.467 INFO:tasks.workunit.client.1.smithi134.stdout:8/117: creat d4/db/dd/f1b x:0 0 0 2024-09-17T04:20:48.471 INFO:tasks.workunit.client.1.smithi134.stdout:8/118: dread d4/db/dd/f16 [0,4194304] 0 2024-09-17T04:20:48.472 INFO:tasks.workunit.client.1.smithi134.stdout:5/128: unlink d0/da/d12/c13 0 2024-09-17T04:20:48.475 INFO:tasks.workunit.client.1.smithi134.stdout:3/177: chown de/d12/d22/l39 444417 1 2024-09-17T04:20:48.476 INFO:tasks.workunit.client.1.smithi134.stdout:0/118: unlink d11/c25 0 2024-09-17T04:20:48.478 INFO:tasks.workunit.client.1.smithi134.stdout:6/227: rmdir de/d19/d21/d2d 39 2024-09-17T04:20:48.479 INFO:tasks.workunit.client.1.smithi134.stdout:6/228: write de/f12 [1555311,48119] 0 2024-09-17T04:20:48.482 INFO:tasks.workunit.client.1.smithi134.stdout:7/99: creat d0/d16/f1e x:0 0 0 2024-09-17T04:20:48.484 INFO:tasks.workunit.client.1.smithi134.stdout:0/119: dwrite d11/d18/f1f [0,4194304] 0 2024-09-17T04:20:48.485 INFO:tasks.workunit.client.1.smithi134.stdout:7/100: dread d0/dd/fb [0,4194304] 0 2024-09-17T04:20:48.488 INFO:tasks.workunit.client.1.smithi134.stdout:5/129: rmdir d0 39 2024-09-17T04:20:48.498 INFO:tasks.workunit.client.1.smithi134.stdout:1/146: mknod d12/d19/d1d/c2d 0 2024-09-17T04:20:48.498 INFO:tasks.workunit.client.1.smithi134.stdout:3/178: dread de/d12/d22/f26 [0,4194304] 0 2024-09-17T04:20:48.499 INFO:tasks.workunit.client.1.smithi134.stdout:3/179: chown l2 57195 1 2024-09-17T04:20:48.499 INFO:tasks.workunit.client.1.smithi134.stdout:3/180: read de/f3b [1348858,121112] 0 2024-09-17T04:20:48.499 INFO:tasks.workunit.client.1.smithi134.stdout:3/181: chown de/d12/d15/d1d/d2d 401298 1 2024-09-17T04:20:48.500 INFO:tasks.workunit.client.1.smithi134.stdout:3/182: fsync de/d10/f30 0 2024-09-17T04:20:48.501 INFO:tasks.workunit.client.1.smithi134.stdout:3/183: read - de/d12/d15/d1d/f33 zero size 2024-09-17T04:20:48.502 INFO:tasks.workunit.client.1.smithi134.stdout:9/464: link d2/d5/d37/d57/d6d/d84/c53 d2/d5/d8/c9a 0 2024-09-17T04:20:48.505 INFO:tasks.workunit.client.1.smithi134.stdout:6/229: write de/d19/d21/d2d/f39 [4157441,52164] 0 2024-09-17T04:20:48.506 INFO:tasks.workunit.client.1.smithi134.stdout:2/162: getdents d19 0 2024-09-17T04:20:48.508 INFO:tasks.workunit.client.1.smithi134.stdout:8/119: creat d4/d11/f1c x:0 0 0 2024-09-17T04:20:48.513 INFO:tasks.workunit.client.1.smithi134.stdout:4/260: creat d0/df/d1e/f50 x:0 0 0 2024-09-17T04:20:48.514 INFO:tasks.workunit.client.1.smithi134.stdout:1/147: mkdir d12/d1c/d2e 0 2024-09-17T04:20:48.516 INFO:tasks.workunit.client.1.smithi134.stdout:3/184: mkdir de/d10/d3d 0 2024-09-17T04:20:48.519 INFO:tasks.workunit.client.1.smithi134.stdout:6/230: dread f7 [0,4194304] 0 2024-09-17T04:20:48.519 INFO:tasks.workunit.client.1.smithi134.stdout:2/163: mknod d19/d27/c37 0 2024-09-17T04:20:48.520 INFO:tasks.workunit.client.1.smithi134.stdout:6/231: chown de/d19/d1a/d34/f3c 4215661 1 2024-09-17T04:20:48.522 INFO:tasks.workunit.client.1.smithi134.stdout:8/120: symlink d4/l1d 0 2024-09-17T04:20:48.522 INFO:tasks.workunit.client.1.smithi134.stdout:8/121: fsync d4/fe 0 2024-09-17T04:20:48.523 INFO:tasks.workunit.client.1.smithi134.stdout:7/101: link d0/dd/f1a d0/dd/f1f 0 2024-09-17T04:20:48.523 INFO:tasks.workunit.client.1.smithi134.stdout:7/102: stat d0/d16/f1e 0 2024-09-17T04:20:48.527 INFO:tasks.workunit.client.1.smithi134.stdout:1/148: creat d12/d1c/f2f x:0 0 0 2024-09-17T04:20:48.528 INFO:tasks.workunit.client.1.smithi134.stdout:1/149: stat d12/d1c/d2e 0 2024-09-17T04:20:48.528 INFO:tasks.workunit.client.1.smithi134.stdout:3/185: creat de/d12/d15/d1d/d2d/d31/f3e x:0 0 0 2024-09-17T04:20:48.529 INFO:tasks.workunit.client.1.smithi134.stdout:3/186: chown de/d12/d22 5478 1 2024-09-17T04:20:48.530 INFO:tasks.workunit.client.1.smithi134.stdout:1/150: dread d12/d1c/f24 [0,4194304] 0 2024-09-17T04:20:48.531 INFO:tasks.workunit.client.1.smithi134.stdout:2/164: creat d19/d27/f38 x:0 0 0 2024-09-17T04:20:48.531 INFO:tasks.workunit.client.1.smithi134.stdout:2/165: dread - d19/d1c/f23 zero size 2024-09-17T04:20:48.532 INFO:tasks.workunit.client.1.smithi134.stdout:2/166: write d19/d1c/f30 [666987,39750] 0 2024-09-17T04:20:48.532 INFO:tasks.workunit.client.1.smithi134.stdout:6/232: fsync f7 0 2024-09-17T04:20:48.534 INFO:tasks.workunit.client.1.smithi134.stdout:6/233: dread de/d19/d21/f23 [0,4194304] 0 2024-09-17T04:20:48.536 INFO:tasks.workunit.client.1.smithi134.stdout:8/122: mkdir d4/d1e 0 2024-09-17T04:20:48.538 INFO:tasks.workunit.client.1.smithi134.stdout:5/130: symlink d0/da/l28 0 2024-09-17T04:20:48.539 INFO:tasks.workunit.client.1.smithi134.stdout:6/234: dread de/f12 [0,4194304] 0 2024-09-17T04:20:48.541 INFO:tasks.workunit.client.1.smithi134.stdout:0/120: truncate f9 2330801 0 2024-09-17T04:20:48.542 INFO:tasks.workunit.client.1.smithi134.stdout:4/261: unlink d0/df/d1e/l2d 0 2024-09-17T04:20:48.542 INFO:tasks.workunit.client.1.smithi134.stdout:9/465: dwrite d2/d5/d9/f1c [0,4194304] 0 2024-09-17T04:20:48.546 INFO:tasks.workunit.client.1.smithi134.stdout:8/123: dwrite f0 [0,4194304] 0 2024-09-17T04:20:48.547 INFO:tasks.workunit.client.1.smithi134.stdout:8/124: chown d4/d11 108 1 2024-09-17T04:20:48.550 INFO:tasks.workunit.client.1.smithi134.stdout:5/131: dwrite d0/f4 [0,4194304] 0 2024-09-17T04:20:48.566 INFO:tasks.workunit.client.1.smithi134.stdout:9/466: chown d2/l22 30 1 2024-09-17T04:20:48.567 INFO:tasks.workunit.client.1.smithi134.stdout:2/167: symlink d19/d27/d31/d34/l39 0 2024-09-17T04:20:48.569 INFO:tasks.workunit.client.1.smithi134.stdout:6/235: symlink de/d19/d1a/d34/d3b/l46 0 2024-09-17T04:20:48.569 INFO:tasks.workunit.client.1.smithi134.stdout:6/236: chown de/f3a 0 1 2024-09-17T04:20:48.573 INFO:tasks.workunit.client.1.smithi134.stdout:7/103: creat d0/f20 x:0 0 0 2024-09-17T04:20:48.574 INFO:tasks.workunit.client.1.smithi134.stdout:7/104: chown d0/f20 8102259 1 2024-09-17T04:20:48.577 INFO:tasks.workunit.client.1.smithi134.stdout:3/187: rename de/d12/d22/l39 to de/d12/l3f 0 2024-09-17T04:20:48.581 INFO:tasks.workunit.client.1.smithi134.stdout:9/467: write d2/d5/d9/f2e [4745546,109610] 0 2024-09-17T04:20:48.583 INFO:tasks.workunit.client.1.smithi134.stdout:2/168: mkdir d19/d1c/d3a 0 2024-09-17T04:20:48.584 INFO:tasks.workunit.client.1.smithi134.stdout:2/169: write d19/f22 [632293,50461] 0 2024-09-17T04:20:48.585 INFO:tasks.workunit.client.1.smithi134.stdout:0/121: write d11/f12 [45521,114569] 0 2024-09-17T04:20:48.590 INFO:tasks.workunit.client.1.smithi134.stdout:6/237: rename de/c29 to de/d19/d1f/c47 0 2024-09-17T04:20:48.592 INFO:tasks.workunit.client.1.smithi134.stdout:1/151: link fd d12/d19/f30 0 2024-09-17T04:20:48.593 INFO:tasks.workunit.client.1.smithi134.stdout:1/152: write d12/f23 [27004,114343] 0 2024-09-17T04:20:48.593 INFO:tasks.workunit.client.1.smithi134.stdout:9/468: symlink d2/d5/d37/d57/d6d/d84/l9b 0 2024-09-17T04:20:48.597 INFO:tasks.workunit.client.1.smithi134.stdout:2/170: chown d19/d1c/l2c 413660 1 2024-09-17T04:20:48.597 INFO:tasks.workunit.client.1.smithi134.stdout:0/122: mkdir d11/d22/d1c/d2f 0 2024-09-17T04:20:48.598 INFO:tasks.workunit.client.1.smithi134.stdout:7/105: mknod d0/dd/d11/c21 0 2024-09-17T04:20:48.599 INFO:tasks.workunit.client.1.smithi134.stdout:7/106: dread - d0/f1c zero size 2024-09-17T04:20:48.599 INFO:tasks.workunit.client.1.smithi134.stdout:8/125: dwrite d4/db/dd/f16 [4194304,4194304] 0 2024-09-17T04:20:48.600 INFO:tasks.workunit.client.1.smithi134.stdout:8/126: truncate f3 4484571 0 2024-09-17T04:20:48.603 INFO:tasks.workunit.client.1.smithi134.stdout:1/153: rename d12/f23 to d12/d1c/d2e/f31 0 2024-09-17T04:20:48.604 INFO:tasks.workunit.client.1.smithi134.stdout:9/469: creat d2/d5/d8/d1e/f9c x:0 0 0 2024-09-17T04:20:48.607 INFO:tasks.workunit.client.1.smithi134.stdout:4/262: getdents d0/df/d1e 0 2024-09-17T04:20:48.608 INFO:tasks.workunit.client.1.smithi134.stdout:4/263: truncate d0/df/d1e/d20/f4a 782286 0 2024-09-17T04:20:48.608 INFO:tasks.workunit.client.1.smithi134.stdout:4/264: chown d0/c12 5 1 2024-09-17T04:20:48.609 INFO:tasks.workunit.client.1.smithi134.stdout:2/171: chown c5 150717469 1 2024-09-17T04:20:48.609 INFO:tasks.workunit.client.1.smithi134.stdout:4/265: write d0/df/d1e/f2b [43073,120452] 0 2024-09-17T04:20:48.610 INFO:tasks.workunit.client.1.smithi134.stdout:2/172: readlink d19/d27/d31/l36 0 2024-09-17T04:20:48.613 INFO:tasks.workunit.client.1.smithi134.stdout:0/123: write d11/f13 [2249196,76906] 0 2024-09-17T04:20:48.613 INFO:tasks.workunit.client.1.smithi134.stdout:2/173: write d19/d27/f2b [197240,23258] 0 2024-09-17T04:20:48.613 INFO:tasks.workunit.client.1.smithi134.stdout:5/132: getdents d0/d6 0 2024-09-17T04:20:48.614 INFO:tasks.workunit.client.1.smithi134.stdout:0/124: read d11/f15 [422105,15869] 0 2024-09-17T04:20:48.615 INFO:tasks.workunit.client.1.smithi134.stdout:2/174: dread fc [0,4194304] 0 2024-09-17T04:20:48.615 INFO:tasks.workunit.client.1.smithi134.stdout:7/107: readlink d0/d16/la 0 2024-09-17T04:20:48.619 INFO:tasks.workunit.client.1.smithi134.stdout:2/175: dread f2 [0,4194304] 0 2024-09-17T04:20:48.619 INFO:tasks.workunit.client.1.smithi134.stdout:2/176: fsync d19/f22 0 2024-09-17T04:20:48.620 INFO:tasks.workunit.client.1.smithi134.stdout:8/127: mkdir d4/d1f 0 2024-09-17T04:20:48.626 INFO:tasks.workunit.client.1.smithi134.stdout:4/266: dread d0/f5 [0,4194304] 0 2024-09-17T04:20:48.626 INFO:tasks.workunit.client.1.smithi134.stdout:1/154: dread d12/d19/f30 [0,4194304] 0 2024-09-17T04:20:48.627 INFO:tasks.workunit.client.1.smithi134.stdout:6/238: write de/d19/d21/d2d/f39 [4077055,1320] 0 2024-09-17T04:20:48.628 INFO:tasks.workunit.client.1.smithi134.stdout:6/239: chown de/d19/d1f 0 1 2024-09-17T04:20:48.628 INFO:tasks.workunit.client.1.smithi134.stdout:6/240: chown de/c14 4 1 2024-09-17T04:20:48.631 INFO:tasks.workunit.client.1.smithi134.stdout:3/188: getdents de 0 2024-09-17T04:20:48.632 INFO:tasks.workunit.client.1.smithi134.stdout:3/189: chown c7 0 1 2024-09-17T04:20:48.640 INFO:tasks.workunit.client.1.smithi134.stdout:4/267: creat d0/d13/f51 x:0 0 0 2024-09-17T04:20:48.641 INFO:tasks.workunit.client.1.smithi134.stdout:6/241: dread de/f3a [0,4194304] 0 2024-09-17T04:20:48.641 INFO:tasks.workunit.client.1.smithi134.stdout:1/155: rmdir d12/d1c 39 2024-09-17T04:20:48.642 INFO:tasks.workunit.client.1.smithi134.stdout:1/156: write d12/f1a [969635,92078] 0 2024-09-17T04:20:48.642 INFO:tasks.workunit.client.1.smithi134.stdout:1/157: fsync d12/d19/f25 0 2024-09-17T04:20:48.644 INFO:tasks.workunit.client.1.smithi134.stdout:6/242: dread fd [0,4194304] 0 2024-09-17T04:20:48.646 INFO:tasks.workunit.client.1.smithi134.stdout:0/125: truncate f9 2600091 0 2024-09-17T04:20:48.646 INFO:tasks.workunit.client.1.smithi134.stdout:0/126: readlink d11/l16 0 2024-09-17T04:20:48.647 INFO:tasks.workunit.client.1.smithi134.stdout:3/190: rmdir de/d12/d22 39 2024-09-17T04:20:48.650 INFO:tasks.workunit.client.1.smithi134.stdout:2/177: write d19/d27/f32 [343081,126681] 0 2024-09-17T04:20:48.657 INFO:tasks.workunit.client.1.smithi134.stdout:4/268: fsync d0/d13/f51 0 2024-09-17T04:20:48.657 INFO:tasks.workunit.client.1.smithi134.stdout:0/127: chown c1 64180634 1 2024-09-17T04:20:48.659 INFO:tasks.workunit.client.1.smithi134.stdout:3/191: mknod de/c40 0 2024-09-17T04:20:48.660 INFO:tasks.workunit.client.1.smithi134.stdout:9/470: getdents d2/d5/d37/d57 0 2024-09-17T04:20:48.660 INFO:tasks.workunit.client.1.smithi134.stdout:9/471: chown d2/d5/d9/df/d38/f99 11298 1 2024-09-17T04:20:48.697 INFO:tasks.workunit.client.1.smithi134.stdout:7/108: rename d0/l7 to d0/l22 0 2024-09-17T04:20:48.698 INFO:tasks.workunit.client.1.smithi134.stdout:4/269: creat d0/d3b/f52 x:0 0 0 2024-09-17T04:20:48.698 INFO:tasks.workunit.client.1.smithi134.stdout:8/128: truncate d4/db/df/f12 3010687 0 2024-09-17T04:20:48.698 INFO:tasks.workunit.client.1.smithi134.stdout:9/472: dread - d2/d5/d37/d57/d6d/f97 zero size 2024-09-17T04:20:48.699 INFO:tasks.workunit.client.1.smithi134.stdout:3/192: rename de/ff to de/f41 0 2024-09-17T04:20:48.699 INFO:tasks.workunit.client.1.smithi134.stdout:2/178: dread f11 [0,4194304] 0 2024-09-17T04:20:48.700 INFO:tasks.workunit.client.1.smithi134.stdout:0/128: link d11/d18/f1e d11/d18/f30 0 2024-09-17T04:20:48.700 INFO:tasks.workunit.client.1.smithi134.stdout:6/243: getdents de/d19/d1a/d34/d3b 0 2024-09-17T04:20:48.700 INFO:tasks.workunit.client.1.smithi134.stdout:7/109: truncate d0/dd/d11/f1d 663418 0 2024-09-17T04:20:48.701 INFO:tasks.workunit.client.1.smithi134.stdout:4/270: mknod d0/d13/d40/c53 0 2024-09-17T04:20:48.701 INFO:tasks.workunit.client.1.smithi134.stdout:9/473: chown d2/d5/d8/d16/d54/l8a 1 1 2024-09-17T04:20:48.703 INFO:tasks.workunit.client.1.smithi134.stdout:3/193: write de/d12/d15/d1d/f33 [490568,65641] 0 2024-09-17T04:20:48.703 INFO:tasks.workunit.client.1.smithi134.stdout:2/179: symlink d19/d27/d31/l3b 0 2024-09-17T04:20:48.703 INFO:tasks.workunit.client.1.smithi134.stdout:9/474: stat d2/d25/l35 0 2024-09-17T04:20:48.704 INFO:tasks.workunit.client.1.smithi134.stdout:2/180: chown d19/d27/d31/l3b 178 1 2024-09-17T04:20:48.704 INFO:tasks.workunit.client.1.smithi134.stdout:3/194: chown de/d12/d15/d1d/d2d 1921357 1 2024-09-17T04:20:48.705 INFO:tasks.workunit.client.1.smithi134.stdout:3/195: dread - de/d12/f3a zero size 2024-09-17T04:20:48.705 INFO:tasks.workunit.client.1.smithi134.stdout:3/196: readlink l4 0 2024-09-17T04:20:48.705 INFO:tasks.workunit.client.1.smithi134.stdout:8/129: creat d4/db/f20 x:0 0 0 2024-09-17T04:20:48.705 INFO:tasks.workunit.client.1.smithi134.stdout:7/110: creat d0/dd/d11/f23 x:0 0 0 2024-09-17T04:20:48.706 INFO:tasks.workunit.client.1.smithi134.stdout:9/475: read d2/f4b [3550045,18405] 0 2024-09-17T04:20:48.706 INFO:tasks.workunit.client.1.smithi134.stdout:0/129: creat d11/d19/d21/f31 x:0 0 0 2024-09-17T04:20:48.707 INFO:tasks.workunit.client.1.smithi134.stdout:4/271: mknod d0/df/d1e/c54 0 2024-09-17T04:20:48.707 INFO:tasks.workunit.client.1.smithi134.stdout:8/130: chown f0 1586 1 2024-09-17T04:20:48.709 INFO:tasks.workunit.client.1.smithi134.stdout:2/181: dread d19/f22 [0,4194304] 0 2024-09-17T04:20:48.710 INFO:tasks.workunit.client.1.smithi134.stdout:8/131: write d4/fe [3898916,40925] 0 2024-09-17T04:20:48.712 INFO:tasks.workunit.client.1.smithi134.stdout:4/272: symlink d0/d13/d40/d42/l55 0 2024-09-17T04:20:48.712 INFO:tasks.workunit.client.1.smithi134.stdout:2/182: fsync d19/f35 0 2024-09-17T04:20:48.712 INFO:tasks.workunit.client.1.smithi134.stdout:9/476: mknod d2/d5/c9d 0 2024-09-17T04:20:48.713 INFO:tasks.workunit.client.1.smithi134.stdout:4/273: read - d0/d13/f51 zero size 2024-09-17T04:20:48.713 INFO:tasks.workunit.client.1.smithi134.stdout:6/244: rename de/c14 to de/d19/d21/c48 0 2024-09-17T04:20:48.714 INFO:tasks.workunit.client.1.smithi134.stdout:9/477: fsync d2/d7/f4f 0 2024-09-17T04:20:48.716 INFO:tasks.workunit.client.1.smithi134.stdout:2/183: truncate d19/d27/f2f 634409 0 2024-09-17T04:20:48.717 INFO:tasks.workunit.client.1.smithi134.stdout:0/130: dread d11/d18/f23 [0,4194304] 0 2024-09-17T04:20:48.717 INFO:tasks.workunit.client.1.smithi134.stdout:2/184: dread - d19/f35 zero size 2024-09-17T04:20:48.717 INFO:tasks.workunit.client.1.smithi134.stdout:9/478: write d2/d7/d75/f93 [792455,122108] 0 2024-09-17T04:20:48.721 INFO:tasks.workunit.client.1.smithi134.stdout:4/274: fdatasync d0/d13/f3c 0 2024-09-17T04:20:48.724 INFO:tasks.workunit.client.1.smithi134.stdout:6/245: dwrite de/d19/d1a/d34/f3c [0,4194304] 0 2024-09-17T04:20:48.727 INFO:tasks.workunit.client.1.smithi134.stdout:0/131: rmdir d11/d18/d2d 0 2024-09-17T04:20:48.728 INFO:tasks.workunit.client.1.smithi134.stdout:2/185: dwrite d19/d27/f32 [0,4194304] 0 2024-09-17T04:20:48.729 INFO:tasks.workunit.client.1.smithi134.stdout:0/132: stat d11/d19/l2a 0 2024-09-17T04:20:48.731 INFO:tasks.workunit.client.1.smithi134.stdout:6/246: write de/f3a [707739,112688] 0 2024-09-17T04:20:48.732 INFO:tasks.workunit.client.1.smithi134.stdout:2/186: symlink d19/d27/d31/l3c 0 2024-09-17T04:20:48.739 INFO:tasks.workunit.client.1.smithi134.stdout:0/133: link cc d11/d22/c32 0 2024-09-17T04:20:48.741 INFO:tasks.workunit.client.0.smithi088.stderr:++ readlink -f fsstress 2024-09-17T04:20:48.741 INFO:tasks.workunit.client.1.smithi134.stdout:6/247: link la de/l49 0 2024-09-17T04:20:48.741 INFO:tasks.workunit.client.1.smithi134.stdout:6/248: fsync de/f12 0 2024-09-17T04:20:48.743 INFO:tasks.workunit.client.0.smithi088.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-17T04:20:48.743 INFO:tasks.workunit.client.0.smithi088.stderr:+ popd 2024-09-17T04:20:48.744 INFO:tasks.workunit.client.1.smithi134.stdout:9/479: dread d2/f4b [0,4194304] 0 2024-09-17T04:20:48.744 INFO:tasks.workunit.client.1.smithi134.stdout:0/134: mknod d11/d22/d1c/d2f/c33 0 2024-09-17T04:20:48.745 INFO:tasks.workunit.client.1.smithi134.stdout:0/135: dread - d11/f14 zero size 2024-09-17T04:20:48.745 INFO:tasks.workunit.client.0.smithi088.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-17T04:20:48.746 INFO:tasks.workunit.client.0.smithi088.stderr:+ popd 2024-09-17T04:20:48.746 INFO:tasks.workunit.client.0.smithi088.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-17T04:20:48.747 INFO:tasks.workunit.client.0.smithi088.stderr:++ mktemp -d -p . 2024-09-17T04:20:48.747 INFO:tasks.workunit.client.1.smithi134.stdout:9/480: mknod d2/d5/d9/d6b/c9e 0 2024-09-17T04:20:48.747 INFO:tasks.workunit.client.1.smithi134.stdout:6/249: dread de/d19/d1f/f28 [0,4194304] 0 2024-09-17T04:20:48.747 INFO:tasks.workunit.client.1.smithi134.stdout:9/481: chown d2/d5/d8/d16/d54 9833462 1 2024-09-17T04:20:48.748 INFO:tasks.workunit.client.1.smithi134.stdout:6/250: symlink de/d19/d1a/l4a 0 2024-09-17T04:20:48.749 INFO:tasks.workunit.client.0.smithi088.stderr:+ T=./tmp.ueRy0Lz8k5 2024-09-17T04:20:48.750 INFO:tasks.workunit.client.0.smithi088.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.ueRy0Lz8k5 -l 1 -n 1000 -p 10 -v 2024-09-17T04:20:48.752 INFO:tasks.workunit.client.1.smithi134.stdout:6/251: mknod de/d19/d1a/d34/c4b 0 2024-09-17T04:20:48.752 INFO:tasks.workunit.client.1.smithi134.stdout:0/136: dwrite d11/d19/d21/f31 [0,4194304] 0 2024-09-17T04:20:48.793 INFO:tasks.workunit.client.1.smithi134.stdout:5/133: sync 2024-09-17T04:20:48.793 INFO:tasks.workunit.client.1.smithi134.stdout:5/134: truncate d0/d6/f1f 1078362 0 2024-09-17T04:20:48.808 INFO:tasks.workunit.client.0.smithi088.stdout:seed = 1726306841 2024-09-17T04:20:48.809 INFO:tasks.workunit.client.1.smithi134.stdout:6/252: mkdir de/d19/d21/d2d/d4c 0 2024-09-17T04:20:48.809 INFO:tasks.workunit.client.1.smithi134.stdout:0/137: symlink d11/d18/l34 0 2024-09-17T04:20:48.817 INFO:tasks.workunit.client.1.smithi134.stdout:9/482: link d2/d5/d37/d7c/l87 d2/d5/d37/l9f 0 2024-09-17T04:20:48.821 INFO:tasks.workunit.client.1.smithi134.stdout:6/253: mkdir de/d19/d21/d4d 0 2024-09-17T04:20:48.822 INFO:tasks.workunit.client.0.smithi088.stdout:1/0: fsync - no filename 2024-09-17T04:20:48.823 INFO:tasks.workunit.client.1.smithi134.stdout:0/138: dread f3 [0,4194304] 0 2024-09-17T04:20:48.824 INFO:tasks.workunit.client.0.smithi088.stdout:2/0: unlink - no file 2024-09-17T04:20:48.825 INFO:tasks.workunit.client.0.smithi088.stdout:2/1: write - no filename 2024-09-17T04:20:48.825 INFO:tasks.workunit.client.0.smithi088.stdout:2/2: dwrite - no filename 2024-09-17T04:20:48.825 INFO:tasks.workunit.client.1.smithi134.stdout:6/254: symlink de/d19/l4e 0 2024-09-17T04:20:48.825 INFO:tasks.workunit.client.1.smithi134.stdout:6/255: chown de/d19/d1a 6323 1 2024-09-17T04:20:48.826 INFO:tasks.workunit.client.1.smithi134.stdout:9/483: mkdir d2/d5/d8/d16/d54/d5e/da0 0 2024-09-17T04:20:48.827 INFO:tasks.workunit.client.0.smithi088.stdout:0/0: creat f0 x:0 0 0 2024-09-17T04:20:48.828 INFO:tasks.workunit.client.1.smithi134.stdout:0/139: symlink d11/d24/l35 0 2024-09-17T04:20:48.830 INFO:tasks.workunit.client.1.smithi134.stdout:9/484: chown d2/c2c 2049 1 2024-09-17T04:20:48.831 INFO:tasks.workunit.client.1.smithi134.stdout:0/140: rmdir d11/d18 39 2024-09-17T04:20:48.833 INFO:tasks.workunit.client.0.smithi088.stdout:1/1: mkdir d0 0 2024-09-17T04:20:48.834 INFO:tasks.workunit.client.1.smithi134.stdout:9/485: creat d2/d5/d37/d57/fa1 x:0 0 0 2024-09-17T04:20:48.834 INFO:tasks.workunit.client.0.smithi088.stdout:0/1: dwrite f0 [0,4194304] 0 2024-09-17T04:20:48.836 INFO:tasks.workunit.client.0.smithi088.stdout:2/3: mkdir d0 0 2024-09-17T04:20:48.837 INFO:tasks.workunit.client.0.smithi088.stdout:2/4: chown d0 0 1 2024-09-17T04:20:48.837 INFO:tasks.workunit.client.0.smithi088.stdout:2/5: write - no filename 2024-09-17T04:20:48.837 INFO:tasks.workunit.client.0.smithi088.stdout:2/6: write - no filename 2024-09-17T04:20:48.837 INFO:tasks.workunit.client.0.smithi088.stdout:2/7: stat d0 0 2024-09-17T04:20:48.837 INFO:tasks.workunit.client.0.smithi088.stdout:2/8: write - no filename 2024-09-17T04:20:48.837 INFO:tasks.workunit.client.0.smithi088.stdout:2/9: stat d0 0 2024-09-17T04:20:48.838 INFO:tasks.workunit.client.0.smithi088.stdout:2/10: dread - no filename 2024-09-17T04:20:48.838 INFO:tasks.workunit.client.0.smithi088.stdout:2/11: dread - no filename 2024-09-17T04:20:48.838 INFO:tasks.workunit.client.0.smithi088.stdout:2/12: dread - no filename 2024-09-17T04:20:48.841 INFO:tasks.workunit.client.1.smithi134.stdout:9/486: mknod d2/d78/ca2 0 2024-09-17T04:20:48.844 INFO:tasks.workunit.client.1.smithi134.stdout:0/141: link d11/f13 d11/d18/f36 0 2024-09-17T04:20:48.846 INFO:tasks.workunit.client.1.smithi134.stdout:9/487: creat d2/d5/d37/fa3 x:0 0 0 2024-09-17T04:20:48.846 INFO:tasks.workunit.client.1.smithi134.stdout:9/488: write d2/d7/f2f [1823154,104235] 0 2024-09-17T04:20:48.847 INFO:tasks.workunit.client.0.smithi088.stdout:1/2: mkdir d0/d1 0 2024-09-17T04:20:48.847 INFO:tasks.workunit.client.0.smithi088.stdout:1/3: dread - no filename 2024-09-17T04:20:48.847 INFO:tasks.workunit.client.0.smithi088.stdout:1/4: truncate - no filename 2024-09-17T04:20:48.847 INFO:tasks.workunit.client.1.smithi134.stdout:0/142: dread d11/d18/f36 [0,4194304] 0 2024-09-17T04:20:48.849 INFO:tasks.workunit.client.0.smithi088.stdout:6/0: write - no filename 2024-09-17T04:20:48.852 INFO:tasks.workunit.client.0.smithi088.stdout:4/0: symlink l0 0 2024-09-17T04:20:48.852 INFO:tasks.workunit.client.1.smithi134.stdout:9/489: dwrite d2/d5/d8/d1e/f29 [0,4194304] 0 2024-09-17T04:20:48.855 INFO:tasks.workunit.client.1.smithi134.stdout:0/143: mkdir d11/d19/d21/d37 0 2024-09-17T04:20:48.856 INFO:tasks.workunit.client.0.smithi088.stdout:2/13: mkdir d0/d1 0 2024-09-17T04:20:48.856 INFO:tasks.workunit.client.0.smithi088.stdout:2/14: unlink - no file 2024-09-17T04:20:48.856 INFO:tasks.workunit.client.0.smithi088.stdout:2/15: readlink - no filename 2024-09-17T04:20:48.857 INFO:tasks.workunit.client.0.smithi088.stdout:7/0: fdatasync - no filename 2024-09-17T04:20:48.857 INFO:tasks.workunit.client.0.smithi088.stdout:7/1: dwrite - no filename 2024-09-17T04:20:48.861 INFO:tasks.workunit.client.0.smithi088.stdout:5/0: mkdir d0 0 2024-09-17T04:20:48.861 INFO:tasks.workunit.client.0.smithi088.stdout:5/1: write - no filename 2024-09-17T04:20:48.861 INFO:tasks.workunit.client.0.smithi088.stdout:5/2: truncate - no filename 2024-09-17T04:20:48.862 INFO:tasks.workunit.client.1.smithi134.stdout:7/111: write d0/dd/fb [2117148,8625] 0 2024-09-17T04:20:48.862 INFO:tasks.workunit.client.1.smithi134.stdout:0/144: symlink d11/d22/l38 0 2024-09-17T04:20:48.862 INFO:tasks.workunit.client.1.smithi134.stdout:7/112: truncate d0/dd/f1f 846244 0 2024-09-17T04:20:48.862 INFO:tasks.workunit.client.1.smithi134.stdout:7/113: fdatasync d0/dd/d11/f1d 0 2024-09-17T04:20:48.862 INFO:tasks.workunit.client.0.smithi088.stdout:4/1: creat f1 x:0 0 0 2024-09-17T04:20:48.862 INFO:tasks.workunit.client.0.smithi088.stdout:4/2: fdatasync f1 0 2024-09-17T04:20:48.863 INFO:tasks.workunit.client.1.smithi134.stdout:9/490: mknod d2/d5/ca4 0 2024-09-17T04:20:48.865 INFO:tasks.workunit.client.1.smithi134.stdout:0/145: creat d11/d19/d21/f39 x:0 0 0 2024-09-17T04:20:48.865 INFO:tasks.workunit.client.0.smithi088.stdout:1/5: creat d0/d1/f2 x:0 0 0 2024-09-17T04:20:48.867 INFO:tasks.workunit.client.1.smithi134.stdout:8/132: truncate f3 2284464 0 2024-09-17T04:20:48.868 INFO:tasks.workunit.client.1.smithi134.stdout:3/197: dwrite de/d12/d22/f26 [0,4194304] 0 2024-09-17T04:20:48.869 INFO:tasks.workunit.client.1.smithi134.stdout:7/114: read d0/f15 [3982560,9129] 0 2024-09-17T04:20:48.870 INFO:tasks.workunit.client.1.smithi134.stdout:0/146: dread f10 [0,4194304] 0 2024-09-17T04:20:48.870 INFO:tasks.workunit.client.0.smithi088.stdout:4/3: dwrite f1 [0,4194304] 0 2024-09-17T04:20:48.870 INFO:tasks.workunit.client.0.smithi088.stdout:6/1: mknod c0 0 2024-09-17T04:20:48.871 INFO:tasks.workunit.client.0.smithi088.stdout:6/2: chown c0 16 1 2024-09-17T04:20:48.876 INFO:tasks.workunit.client.0.smithi088.stdout:2/16: creat d0/d1/f2 x:0 0 0 2024-09-17T04:20:48.876 INFO:tasks.workunit.client.1.smithi134.stdout:2/187: write f12 [1017666,37009] 0 2024-09-17T04:20:48.877 INFO:tasks.workunit.client.0.smithi088.stdout:2/17: dread - d0/d1/f2 zero size 2024-09-17T04:20:48.877 INFO:tasks.workunit.client.0.smithi088.stdout:2/18: chown d0/d1 0 1 2024-09-17T04:20:48.877 INFO:tasks.workunit.client.0.smithi088.stdout:2/19: chown d0 953912 1 2024-09-17T04:20:48.878 INFO:tasks.workunit.client.0.smithi088.stdout:2/20: readlink - no filename 2024-09-17T04:20:48.880 INFO:tasks.workunit.client.0.smithi088.stdout:1/6: mknod d0/c3 0 2024-09-17T04:20:48.881 INFO:tasks.workunit.client.0.smithi088.stdout:1/7: write d0/d1/f2 [674887,91340] 0 2024-09-17T04:20:48.882 INFO:tasks.workunit.client.1.smithi134.stdout:8/133: dwrite d4/db/dd/f16 [8388608,4194304] 0 2024-09-17T04:20:48.883 INFO:tasks.workunit.client.0.smithi088.stdout:9/0: readlink - no filename 2024-09-17T04:20:48.883 INFO:tasks.workunit.client.0.smithi088.stdout:9/1: stat - no entries 2024-09-17T04:20:48.884 INFO:tasks.workunit.client.0.smithi088.stdout:7/2: creat f0 x:0 0 0 2024-09-17T04:20:48.885 INFO:tasks.workunit.client.1.smithi134.stdout:3/198: dwrite de/d10/f30 [0,4194304] 0 2024-09-17T04:20:48.885 INFO:tasks.workunit.client.0.smithi088.stdout:7/3: dread - f0 zero size 2024-09-17T04:20:48.885 INFO:tasks.workunit.client.0.smithi088.stdout:7/4: chown f0 502580 1 2024-09-17T04:20:48.886 INFO:tasks.workunit.client.0.smithi088.stdout:7/5: write f0 [154396,110837] 0 2024-09-17T04:20:48.887 INFO:tasks.workunit.client.1.smithi134.stdout:0/147: dwrite d11/f14 [0,4194304] 0 2024-09-17T04:20:48.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:48 smithi088 ceph-mon[27811]: pgmap v15: 65 pgs: 65 active+clean; 323 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 23 MiB/s wr, 270 op/s 2024-09-17T04:20:48.888 INFO:tasks.workunit.client.1.smithi134.stdout:3/199: write de/f2a [136673,27126] 0 2024-09-17T04:20:48.890 INFO:tasks.workunit.client.1.smithi134.stdout:2/188: dwrite d19/f22 [0,4194304] 0 2024-09-17T04:20:48.891 INFO:tasks.workunit.client.1.smithi134.stdout:4/275: truncate d0/df/d1e/d20/f34 3338479 0 2024-09-17T04:20:48.891 INFO:tasks.workunit.client.1.smithi134.stdout:2/189: write fc [907491,6418] 0 2024-09-17T04:20:48.894 INFO:tasks.workunit.client.1.smithi134.stdout:7/115: creat d0/dd/d11/f24 x:0 0 0 2024-09-17T04:20:48.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:48 smithi134 ceph-mon[35201]: pgmap v15: 65 pgs: 65 active+clean; 323 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 23 MiB/s wr, 270 op/s 2024-09-17T04:20:48.900 INFO:tasks.workunit.client.0.smithi088.stdout:5/3: getdents d0 0 2024-09-17T04:20:48.900 INFO:tasks.workunit.client.0.smithi088.stdout:5/4: dwrite - no filename 2024-09-17T04:20:48.900 INFO:tasks.workunit.client.0.smithi088.stdout:5/5: write - no filename 2024-09-17T04:20:48.901 INFO:tasks.workunit.client.0.smithi088.stdout:5/6: rename d0 to d0/d1 22 2024-09-17T04:20:48.901 INFO:tasks.workunit.client.0.smithi088.stdout:6/3: creat f1 x:0 0 0 2024-09-17T04:20:48.902 INFO:tasks.workunit.client.0.smithi088.stdout:2/21: creat d0/d1/f3 x:0 0 0 2024-09-17T04:20:48.903 INFO:tasks.workunit.client.0.smithi088.stdout:6/4: write f1 [784090,17577] 0 2024-09-17T04:20:48.905 INFO:tasks.workunit.client.0.smithi088.stdout:6/5: chown f1 65235449 1 2024-09-17T04:20:48.905 INFO:tasks.workunit.client.0.smithi088.stdout:1/8: creat d0/f4 x:0 0 0 2024-09-17T04:20:48.910 INFO:tasks.workunit.client.0.smithi088.stdout:7/6: creat f1 x:0 0 0 2024-09-17T04:20:48.911 INFO:tasks.workunit.client.0.smithi088.stdout:8/0: symlink l0 0 2024-09-17T04:20:48.912 INFO:tasks.workunit.client.0.smithi088.stdout:8/1: truncate - no filename 2024-09-17T04:20:48.913 INFO:tasks.workunit.client.0.smithi088.stdout:8/2: chown l0 0 1 2024-09-17T04:20:48.913 INFO:tasks.workunit.client.0.smithi088.stdout:8/3: truncate - no filename 2024-09-17T04:20:48.913 INFO:tasks.workunit.client.0.smithi088.stdout:8/4: write - no filename 2024-09-17T04:20:48.914 INFO:tasks.workunit.client.1.smithi134.stdout:0/148: creat d11/d22/f3a x:0 0 0 2024-09-17T04:20:48.915 INFO:tasks.workunit.client.0.smithi088.stdout:1/9: dwrite d0/d1/f2 [0,4194304] 0 2024-09-17T04:20:48.916 INFO:tasks.workunit.client.0.smithi088.stdout:1/10: truncate d0/d1/f2 4929467 0 2024-09-17T04:20:48.917 INFO:tasks.workunit.client.0.smithi088.stdout:2/22: symlink d0/l4 0 2024-09-17T04:20:48.919 INFO:tasks.workunit.client.0.smithi088.stdout:2/23: write d0/d1/f3 [548626,41646] 0 2024-09-17T04:20:48.921 INFO:tasks.workunit.client.0.smithi088.stdout:2/24: truncate d0/d1/f2 684896 0 2024-09-17T04:20:48.921 INFO:tasks.workunit.client.0.smithi088.stdout:6/6: rename f1 to f2 0 2024-09-17T04:20:48.923 INFO:tasks.workunit.client.1.smithi134.stdout:2/190: symlink d19/d27/l3d 0 2024-09-17T04:20:48.925 INFO:tasks.workunit.client.1.smithi134.stdout:1/158: sync 2024-09-17T04:20:48.926 INFO:tasks.workunit.client.0.smithi088.stdout:9/2: creat f0 x:0 0 0 2024-09-17T04:20:48.926 INFO:tasks.workunit.client.0.smithi088.stdout:9/3: dread - f0 zero size 2024-09-17T04:20:48.927 INFO:tasks.workunit.client.0.smithi088.stdout:9/4: dread - f0 zero size 2024-09-17T04:20:48.927 INFO:tasks.workunit.client.1.smithi134.stdout:7/116: truncate d0/f19 170818 0 2024-09-17T04:20:48.928 INFO:tasks.workunit.client.0.smithi088.stdout:9/5: truncate f0 747592 0 2024-09-17T04:20:48.929 INFO:tasks.workunit.client.1.smithi134.stdout:2/191: dwrite f16 [0,4194304] 0 2024-09-17T04:20:48.932 INFO:tasks.workunit.client.0.smithi088.stdout:4/4: fsync f1 0 2024-09-17T04:20:48.932 INFO:tasks.workunit.client.1.smithi134.stdout:3/200: mkdir de/d12/d42 0 2024-09-17T04:20:48.933 INFO:tasks.workunit.client.0.smithi088.stdout:4/5: write f1 [2745044,64331] 0 2024-09-17T04:20:48.933 INFO:tasks.workunit.client.1.smithi134.stdout:3/201: chown de/d12/d22/l32 455 1 2024-09-17T04:20:48.935 INFO:tasks.workunit.client.0.smithi088.stdout:2/25: mknod d0/c5 0 2024-09-17T04:20:48.936 INFO:tasks.workunit.client.0.smithi088.stdout:2/26: write d0/d1/f3 [620311,99261] 0 2024-09-17T04:20:48.940 INFO:tasks.workunit.client.1.smithi134.stdout:3/202: dwrite de/d12/f17 [4194304,4194304] 0 2024-09-17T04:20:48.941 INFO:tasks.workunit.client.1.smithi134.stdout:3/203: write de/f3b [4043979,79443] 0 2024-09-17T04:20:48.942 INFO:tasks.workunit.client.1.smithi134.stdout:9/491: getdents d2/d5/d9 0 2024-09-17T04:20:48.943 INFO:tasks.workunit.client.0.smithi088.stdout:9/6: creat f1 x:0 0 0 2024-09-17T04:20:48.944 INFO:tasks.workunit.client.1.smithi134.stdout:7/117: symlink d0/dd/d11/l25 0 2024-09-17T04:20:48.945 INFO:tasks.workunit.client.0.smithi088.stdout:5/7: rmdir d0 0 2024-09-17T04:20:48.946 INFO:tasks.workunit.client.1.smithi134.stdout:7/118: read - d0/d16/f1e zero size 2024-09-17T04:20:48.947 INFO:tasks.workunit.client.1.smithi134.stdout:7/119: truncate d0/f19 948571 0 2024-09-17T04:20:48.947 INFO:tasks.workunit.client.1.smithi134.stdout:9/492: dwrite d2/f43 [0,4194304] 0 2024-09-17T04:20:48.948 INFO:tasks.workunit.client.0.smithi088.stdout:4/6: symlink l2 0 2024-09-17T04:20:48.948 INFO:tasks.workunit.client.1.smithi134.stdout:9/493: stat d2/d5/d58 0 2024-09-17T04:20:48.952 INFO:tasks.workunit.client.1.smithi134.stdout:2/192: symlink d19/d27/d31/d34/l3e 0 2024-09-17T04:20:48.956 INFO:tasks.workunit.client.1.smithi134.stdout:7/120: dwrite d0/f19 [0,4194304] 0 2024-09-17T04:20:48.956 INFO:tasks.workunit.client.0.smithi088.stdout:4/7: dwrite f1 [0,4194304] 0 2024-09-17T04:20:48.957 INFO:tasks.workunit.client.1.smithi134.stdout:7/121: fsync d0/dd/fb 0 2024-09-17T04:20:48.957 INFO:tasks.workunit.client.1.smithi134.stdout:7/122: dread - d0/f20 zero size 2024-09-17T04:20:48.958 INFO:tasks.workunit.client.0.smithi088.stdout:9/7: mkdir d2 0 2024-09-17T04:20:48.959 INFO:tasks.workunit.client.1.smithi134.stdout:4/276: link d0/df/d1e/f2e d0/df/d35/d39/f56 0 2024-09-17T04:20:48.962 INFO:tasks.workunit.client.0.smithi088.stdout:5/8: mkdir d2 0 2024-09-17T04:20:48.962 INFO:tasks.workunit.client.0.smithi088.stdout:5/9: write - no filename 2024-09-17T04:20:48.962 INFO:tasks.workunit.client.0.smithi088.stdout:5/10: dwrite - no filename 2024-09-17T04:20:48.962 INFO:tasks.workunit.client.0.smithi088.stdout:5/11: fdatasync - no filename 2024-09-17T04:20:48.962 INFO:tasks.workunit.client.0.smithi088.stdout:5/12: unlink - no file 2024-09-17T04:20:48.966 INFO:tasks.workunit.client.0.smithi088.stdout:1/11: fsync d0/f4 0 2024-09-17T04:20:48.968 INFO:tasks.workunit.client.1.smithi134.stdout:3/204: rename de/d12/f2b to de/d10/d3d/f43 0 2024-09-17T04:20:48.970 INFO:tasks.workunit.client.0.smithi088.stdout:4/8: symlink l3 0 2024-09-17T04:20:48.970 INFO:tasks.workunit.client.0.smithi088.stdout:7/7: getdents . 0 2024-09-17T04:20:48.971 INFO:tasks.workunit.client.0.smithi088.stdout:4/9: write f1 [4787139,7891] 0 2024-09-17T04:20:48.971 INFO:tasks.workunit.client.1.smithi134.stdout:8/134: getdents d4/db/dd 0 2024-09-17T04:20:48.974 INFO:tasks.workunit.client.1.smithi134.stdout:9/494: unlink d2/d5/d8/d1e/d42/f67 0 2024-09-17T04:20:48.976 INFO:tasks.workunit.client.0.smithi088.stdout:1/12: creat d0/f5 x:0 0 0 2024-09-17T04:20:48.977 INFO:tasks.workunit.client.0.smithi088.stdout:6/7: fsync f2 0 2024-09-17T04:20:48.979 INFO:tasks.workunit.client.0.smithi088.stdout:6/8: read f2 [588968,99977] 0 2024-09-17T04:20:48.979 INFO:tasks.workunit.client.1.smithi134.stdout:2/193: symlink d19/l3f 0 2024-09-17T04:20:48.980 INFO:tasks.workunit.client.0.smithi088.stdout:7/8: mkdir d2 0 2024-09-17T04:20:48.982 INFO:tasks.workunit.client.1.smithi134.stdout:0/149: rename d11/f2e to d11/f3b 0 2024-09-17T04:20:48.982 INFO:tasks.workunit.client.0.smithi088.stdout:6/9: dread f2 [0,4194304] 0 2024-09-17T04:20:48.984 INFO:tasks.workunit.client.0.smithi088.stdout:4/10: unlink l2 0 2024-09-17T04:20:48.986 INFO:tasks.workunit.client.0.smithi088.stdout:4/11: write f1 [680020,115395] 0 2024-09-17T04:20:48.986 INFO:tasks.workunit.client.0.smithi088.stdout:9/8: creat d2/f3 x:0 0 0 2024-09-17T04:20:48.986 INFO:tasks.workunit.client.0.smithi088.stdout:9/9: readlink - no filename 2024-09-17T04:20:48.987 INFO:tasks.workunit.client.0.smithi088.stdout:5/13: symlink d2/l3 0 2024-09-17T04:20:48.987 INFO:tasks.workunit.client.0.smithi088.stdout:5/14: write - no filename 2024-09-17T04:20:48.988 INFO:tasks.workunit.client.0.smithi088.stdout:7/9: dwrite f1 [0,4194304] 0 2024-09-17T04:20:48.989 INFO:tasks.workunit.client.1.smithi134.stdout:7/123: fdatasync d0/dd/f1a 0 2024-09-17T04:20:48.989 INFO:tasks.workunit.client.1.smithi134.stdout:1/159: write ff [4419413,93907] 0 2024-09-17T04:20:48.990 INFO:tasks.workunit.client.1.smithi134.stdout:1/160: readlink d12/l2c 0 2024-09-17T04:20:48.990 INFO:tasks.workunit.client.1.smithi134.stdout:7/124: chown d0/dd/fe 391 1 2024-09-17T04:20:48.992 INFO:tasks.workunit.client.0.smithi088.stdout:6/10: creat f3 x:0 0 0 2024-09-17T04:20:48.993 INFO:tasks.workunit.client.0.smithi088.stdout:6/11: dread - f3 zero size 2024-09-17T04:20:49.001 INFO:tasks.workunit.client.1.smithi134.stdout:8/135: symlink d4/l21 0 2024-09-17T04:20:49.001 INFO:tasks.workunit.client.0.smithi088.stdout:6/12: dwrite f3 [0,4194304] 0 2024-09-17T04:20:49.002 INFO:tasks.workunit.client.1.smithi134.stdout:8/136: write d4/db/f14 [1378438,67629] 0 2024-09-17T04:20:49.003 INFO:tasks.workunit.client.0.smithi088.stdout:4/12: symlink l4 0 2024-09-17T04:20:49.006 INFO:tasks.workunit.client.0.smithi088.stdout:9/10: mknod d2/c4 0 2024-09-17T04:20:49.008 INFO:tasks.workunit.client.1.smithi134.stdout:9/495: mkdir d2/d5/d8/d1e/d42/da5 0 2024-09-17T04:20:49.009 INFO:tasks.workunit.client.1.smithi134.stdout:9/496: fdatasync d2/d5/d37/d57/d6d/d84/f6e 0 2024-09-17T04:20:49.010 INFO:tasks.workunit.client.0.smithi088.stdout:5/15: creat d2/f4 x:0 0 0 2024-09-17T04:20:49.011 INFO:tasks.workunit.client.0.smithi088.stdout:4/13: dwrite f1 [4194304,4194304] 0 2024-09-17T04:20:49.012 INFO:tasks.workunit.client.0.smithi088.stdout:4/14: chown l4 357 1 2024-09-17T04:20:49.012 INFO:tasks.workunit.client.0.smithi088.stdout:7/10: unlink f1 0 2024-09-17T04:20:49.014 INFO:tasks.workunit.client.0.smithi088.stdout:7/11: write f0 [712578,42201] 0 2024-09-17T04:20:49.016 INFO:tasks.workunit.client.1.smithi134.stdout:0/150: mknod d11/d19/d21/c3c 0 2024-09-17T04:20:49.019 INFO:tasks.workunit.client.0.smithi088.stdout:4/15: dread f1 [4194304,4194304] 0 2024-09-17T04:20:49.019 INFO:tasks.workunit.client.0.smithi088.stdout:6/13: creat f4 x:0 0 0 2024-09-17T04:20:49.022 INFO:tasks.workunit.client.0.smithi088.stdout:6/14: write f3 [3743533,119274] 0 2024-09-17T04:20:49.023 INFO:tasks.workunit.client.0.smithi088.stdout:6/15: dread - f4 zero size 2024-09-17T04:20:49.023 INFO:tasks.workunit.client.0.smithi088.stdout:7/12: dwrite f0 [0,4194304] 0 2024-09-17T04:20:49.024 INFO:tasks.workunit.client.0.smithi088.stdout:9/11: mknod d2/c5 0 2024-09-17T04:20:49.024 INFO:tasks.workunit.client.1.smithi134.stdout:3/205: dread de/f41 [0,4194304] 0 2024-09-17T04:20:49.026 INFO:tasks.workunit.client.1.smithi134.stdout:1/161: symlink d12/d19/d1d/l32 0 2024-09-17T04:20:49.033 INFO:tasks.workunit.client.0.smithi088.stdout:5/16: creat d2/f5 x:0 0 0 2024-09-17T04:20:49.033 INFO:tasks.workunit.client.1.smithi134.stdout:5/135: sync 2024-09-17T04:20:49.033 INFO:tasks.workunit.client.1.smithi134.stdout:6/256: sync 2024-09-17T04:20:49.036 INFO:tasks.workunit.client.1.smithi134.stdout:9/497: creat d2/d5/d37/d57/fa6 x:0 0 0 2024-09-17T04:20:49.036 INFO:tasks.workunit.client.0.smithi088.stdout:7/13: dwrite f0 [0,4194304] 0 2024-09-17T04:20:49.036 INFO:tasks.workunit.client.1.smithi134.stdout:9/498: chown d2/d5/c9d 9403543 1 2024-09-17T04:20:49.037 INFO:tasks.workunit.client.0.smithi088.stdout:7/14: stat d2 0 2024-09-17T04:20:49.038 INFO:tasks.workunit.client.0.smithi088.stdout:9/12: dwrite f0 [0,4194304] 0 2024-09-17T04:20:49.039 INFO:tasks.workunit.client.1.smithi134.stdout:3/206: unlink de/c27 0 2024-09-17T04:20:49.040 INFO:tasks.workunit.client.1.smithi134.stdout:3/207: chown de/c40 33909 1 2024-09-17T04:20:49.042 INFO:tasks.workunit.client.1.smithi134.stdout:9/499: dwrite d2/d5/d37/d57/d6d/d84/f65 [0,4194304] 0 2024-09-17T04:20:49.046 INFO:tasks.workunit.client.1.smithi134.stdout:2/194: write d19/d1c/f1f [2911351,29520] 0 2024-09-17T04:20:49.048 INFO:tasks.workunit.client.1.smithi134.stdout:8/137: symlink d4/d1e/l22 0 2024-09-17T04:20:49.048 INFO:tasks.workunit.client.1.smithi134.stdout:2/195: chown d19/d1c/d3a 8180937 1 2024-09-17T04:20:49.048 INFO:tasks.workunit.client.0.smithi088.stdout:6/16: creat f5 x:0 0 0 2024-09-17T04:20:49.048 INFO:tasks.workunit.client.0.smithi088.stdout:6/17: readlink - no filename 2024-09-17T04:20:49.049 INFO:tasks.workunit.client.1.smithi134.stdout:5/136: fsync d0/f21 0 2024-09-17T04:20:49.049 INFO:tasks.workunit.client.0.smithi088.stdout:7/15: dwrite f0 [0,4194304] 0 2024-09-17T04:20:49.049 INFO:tasks.workunit.client.0.smithi088.stdout:6/18: chown c0 1680 1 2024-09-17T04:20:49.053 INFO:tasks.workunit.client.1.smithi134.stdout:3/208: rename de/d12/d15/d1d/l1e to de/d10/l44 0 2024-09-17T04:20:49.055 INFO:tasks.workunit.client.0.smithi088.stdout:5/17: creat d2/f6 x:0 0 0 2024-09-17T04:20:49.056 INFO:tasks.workunit.client.1.smithi134.stdout:1/162: unlink d12/d1c/d2e/f31 0 2024-09-17T04:20:49.057 INFO:tasks.workunit.client.0.smithi088.stdout:5/18: write d2/f4 [268399,60287] 0 2024-09-17T04:20:49.057 INFO:tasks.workunit.client.1.smithi134.stdout:7/125: link d0/f15 d0/d16/f26 0 2024-09-17T04:20:49.058 INFO:tasks.workunit.client.0.smithi088.stdout:5/19: dread - d2/f5 zero size 2024-09-17T04:20:49.059 INFO:tasks.workunit.client.0.smithi088.stdout:9/13: creat d2/f6 x:0 0 0 2024-09-17T04:20:49.059 INFO:tasks.workunit.client.0.smithi088.stdout:9/14: dread - d2/f3 zero size 2024-09-17T04:20:49.060 INFO:tasks.workunit.client.0.smithi088.stdout:1/13: getdents d0 0 2024-09-17T04:20:49.064 INFO:tasks.workunit.client.1.smithi134.stdout:7/126: dwrite d0/dd/fe [0,4194304] 0 2024-09-17T04:20:49.065 INFO:tasks.workunit.client.1.smithi134.stdout:7/127: dread d0/dd/f1f [0,4194304] 0 2024-09-17T04:20:49.172 INFO:tasks.workunit.client.1.smithi134.stdout:4/277: sync 2024-09-17T04:20:49.174 INFO:tasks.workunit.client.1.smithi134.stdout:8/138: mkdir d4/d23 0 2024-09-17T04:20:49.177 INFO:tasks.workunit.client.1.smithi134.stdout:5/137: rmdir d0/d6 39 2024-09-17T04:20:49.178 INFO:tasks.workunit.client.0.smithi088.stdout:6/19: mkdir d6 0 2024-09-17T04:20:49.192 INFO:tasks.workunit.client.1.smithi134.stdout:0/151: sync 2024-09-17T04:20:49.192 INFO:tasks.workunit.client.1.smithi134.stdout:9/500: sync 2024-09-17T04:20:49.192 INFO:tasks.workunit.client.1.smithi134.stdout:0/152: read - d11/d18/f30 zero size 2024-09-17T04:20:49.195 INFO:tasks.workunit.client.0.smithi088.stdout:9/15: creat d2/f7 x:0 0 0 2024-09-17T04:20:49.195 INFO:tasks.workunit.client.0.smithi088.stdout:9/16: dread - d2/f6 zero size 2024-09-17T04:20:49.196 INFO:tasks.workunit.client.0.smithi088.stdout:1/14: symlink d0/l6 0 2024-09-17T04:20:49.197 INFO:tasks.workunit.client.0.smithi088.stdout:9/17: write d2/f3 [481849,104647] 0 2024-09-17T04:20:49.197 INFO:tasks.workunit.client.1.smithi134.stdout:0/153: dwrite d11/f14 [0,4194304] 0 2024-09-17T04:20:49.200 INFO:tasks.workunit.client.0.smithi088.stdout:7/16: creat d2/f3 x:0 0 0 2024-09-17T04:20:49.200 INFO:tasks.workunit.client.0.smithi088.stdout:7/17: dread - d2/f3 zero size 2024-09-17T04:20:49.202 INFO:tasks.workunit.client.1.smithi134.stdout:0/154: dread d11/d18/f1f [0,4194304] 0 2024-09-17T04:20:49.203 INFO:tasks.workunit.client.1.smithi134.stdout:7/128: creat d0/dd/f27 x:0 0 0 2024-09-17T04:20:49.204 INFO:tasks.workunit.client.0.smithi088.stdout:4/16: getdents . 0 2024-09-17T04:20:49.208 INFO:tasks.workunit.client.0.smithi088.stdout:9/18: creat d2/f8 x:0 0 0 2024-09-17T04:20:49.208 INFO:tasks.workunit.client.0.smithi088.stdout:9/19: write d2/f6 [86304,86146] 0 2024-09-17T04:20:49.210 INFO:tasks.workunit.client.0.smithi088.stdout:1/15: rename d0/c3 to d0/c7 0 2024-09-17T04:20:49.210 INFO:tasks.workunit.client.1.smithi134.stdout:8/139: dread f3 [0,4194304] 0 2024-09-17T04:20:49.211 INFO:tasks.workunit.client.1.smithi134.stdout:8/140: chown d4/db 252887 1 2024-09-17T04:20:49.211 INFO:tasks.workunit.client.1.smithi134.stdout:2/196: symlink d19/d27/d31/d34/l40 0 2024-09-17T04:20:49.212 INFO:tasks.workunit.client.1.smithi134.stdout:8/141: dread - d4/db/f20 zero size 2024-09-17T04:20:49.212 INFO:tasks.workunit.client.0.smithi088.stdout:7/18: mkdir d2/d4 0 2024-09-17T04:20:49.213 INFO:tasks.workunit.client.0.smithi088.stdout:7/19: write f0 [435839,91332] 0 2024-09-17T04:20:49.213 INFO:tasks.workunit.client.0.smithi088.stdout:7/20: rename d2 to d2/d4/d5 22 2024-09-17T04:20:49.213 INFO:tasks.workunit.client.0.smithi088.stdout:7/21: chown d2/d4 3439 1 2024-09-17T04:20:49.218 INFO:tasks.workunit.client.1.smithi134.stdout:9/501: mkdir d2/d5/d37/d83/da7 0 2024-09-17T04:20:49.220 INFO:tasks.workunit.client.0.smithi088.stdout:9/20: creat d2/f9 x:0 0 0 2024-09-17T04:20:49.220 INFO:tasks.workunit.client.0.smithi088.stdout:7/22: dwrite f0 [0,4194304] 0 2024-09-17T04:20:49.222 INFO:tasks.workunit.client.0.smithi088.stdout:9/21: chown d2/c5 0 1 2024-09-17T04:20:49.224 INFO:tasks.workunit.client.0.smithi088.stdout:9/22: read - d2/f8 zero size 2024-09-17T04:20:49.224 INFO:tasks.workunit.client.1.smithi134.stdout:6/257: truncate fb 2709515 0 2024-09-17T04:20:49.225 INFO:tasks.workunit.client.1.smithi134.stdout:9/502: dwrite d2/d5/d8/d1e/f29 [4194304,4194304] 0 2024-09-17T04:20:49.226 INFO:tasks.workunit.client.0.smithi088.stdout:4/17: dwrite f1 [0,4194304] 0 2024-09-17T04:20:49.231 INFO:tasks.workunit.client.0.smithi088.stdout:7/23: dwrite d2/f3 [0,4194304] 0 2024-09-17T04:20:49.234 INFO:tasks.workunit.client.0.smithi088.stdout:6/20: rmdir d6 0 2024-09-17T04:20:49.235 INFO:tasks.workunit.client.0.smithi088.stdout:6/21: dread - f4 zero size 2024-09-17T04:20:49.235 INFO:tasks.workunit.client.1.smithi134.stdout:1/163: dwrite fd [0,4194304] 0 2024-09-17T04:20:49.238 INFO:tasks.workunit.client.1.smithi134.stdout:4/278: mkdir d0/df/d1e/d57 0 2024-09-17T04:20:49.239 INFO:tasks.workunit.client.1.smithi134.stdout:2/197: symlink d19/d27/d31/l41 0 2024-09-17T04:20:49.241 INFO:tasks.workunit.client.1.smithi134.stdout:8/142: mkdir d4/d24 0 2024-09-17T04:20:49.242 INFO:tasks.workunit.client.0.smithi088.stdout:4/18: unlink l3 0 2024-09-17T04:20:49.244 INFO:tasks.workunit.client.1.smithi134.stdout:5/138: mkdir d0/da/d29 0 2024-09-17T04:20:49.245 INFO:tasks.workunit.client.1.smithi134.stdout:5/139: stat d0/da/c24 0 2024-09-17T04:20:49.246 INFO:tasks.workunit.client.0.smithi088.stdout:7/24: rename f0 to d2/f6 0 2024-09-17T04:20:49.248 INFO:tasks.workunit.client.1.smithi134.stdout:3/209: rename de/d10/l44 to de/d10/d3d/l45 0 2024-09-17T04:20:49.250 INFO:tasks.workunit.client.0.smithi088.stdout:6/22: rename f2 to f7 0 2024-09-17T04:20:49.252 INFO:tasks.workunit.client.0.smithi088.stdout:6/23: write f4 [495209,54471] 0 2024-09-17T04:20:49.253 INFO:tasks.workunit.client.1.smithi134.stdout:0/155: write d11/f13 [1627010,46257] 0 2024-09-17T04:20:49.253 INFO:tasks.workunit.client.0.smithi088.stdout:4/19: mkdir d5 0 2024-09-17T04:20:49.254 INFO:tasks.workunit.client.0.smithi088.stdout:6/24: truncate f4 787835 0 2024-09-17T04:20:49.254 INFO:tasks.workunit.client.1.smithi134.stdout:9/503: chown d2/d5/d9/df/d38/f6c 489772626 1 2024-09-17T04:20:49.255 INFO:tasks.workunit.client.1.smithi134.stdout:7/129: write d0/dd/f1f [733469,25795] 0 2024-09-17T04:20:49.255 INFO:tasks.workunit.client.0.smithi088.stdout:1/16: dwrite d0/d1/f2 [4194304,4194304] 0 2024-09-17T04:20:49.256 INFO:tasks.workunit.client.1.smithi134.stdout:7/130: fdatasync d0/dd/d11/f1d 0 2024-09-17T04:20:49.259 INFO:tasks.workunit.client.1.smithi134.stdout:1/164: chown d12/d1c/c28 37197711 1 2024-09-17T04:20:49.261 INFO:tasks.workunit.client.1.smithi134.stdout:4/279: creat d0/d3b/f58 x:0 0 0 2024-09-17T04:20:49.263 INFO:tasks.workunit.client.1.smithi134.stdout:2/198: mkdir d19/d27/d31/d34/d42 0 2024-09-17T04:20:49.263 INFO:tasks.workunit.client.0.smithi088.stdout:6/25: rename c0 to c8 0 2024-09-17T04:20:49.263 INFO:tasks.workunit.client.0.smithi088.stdout:6/26: readlink - no filename 2024-09-17T04:20:49.269 INFO:tasks.workunit.client.1.smithi134.stdout:1/165: dwrite ff [4194304,4194304] 0 2024-09-17T04:20:49.270 INFO:tasks.workunit.client.0.smithi088.stdout:7/25: mkdir d2/d4/d7 0 2024-09-17T04:20:49.270 INFO:tasks.workunit.client.1.smithi134.stdout:6/258: rename de/d2b/l44 to de/d19/d21/d2d/l4f 0 2024-09-17T04:20:49.270 INFO:tasks.workunit.client.0.smithi088.stdout:9/23: getdents d2 0 2024-09-17T04:20:49.272 INFO:tasks.workunit.client.0.smithi088.stdout:9/24: read d2/f6 [16138,84361] 0 2024-09-17T04:20:49.272 INFO:tasks.workunit.client.0.smithi088.stdout:4/20: getdents d5 0 2024-09-17T04:20:49.275 INFO:tasks.workunit.client.0.smithi088.stdout:6/27: creat f9 x:0 0 0 2024-09-17T04:20:49.275 INFO:tasks.workunit.client.0.smithi088.stdout:6/28: chown f5 2 1 2024-09-17T04:20:49.277 INFO:tasks.workunit.client.0.smithi088.stdout:1/17: link d0/f4 d0/f8 0 2024-09-17T04:20:49.281 INFO:tasks.workunit.client.0.smithi088.stdout:7/26: symlink d2/d4/l8 0 2024-09-17T04:20:49.282 INFO:tasks.workunit.client.1.smithi134.stdout:3/210: creat de/d12/d22/f46 x:0 0 0 2024-09-17T04:20:49.283 INFO:tasks.workunit.client.1.smithi134.stdout:2/199: unlink d19/d1c/l2c 0 2024-09-17T04:20:49.284 INFO:tasks.workunit.client.1.smithi134.stdout:8/143: mkdir d4/d1f/d25 0 2024-09-17T04:20:49.284 INFO:tasks.workunit.client.0.smithi088.stdout:9/25: creat d2/fa x:0 0 0 2024-09-17T04:20:49.286 INFO:tasks.workunit.client.1.smithi134.stdout:0/156: rename d11/d19/d21/f39 to d11/d18/f3d 0 2024-09-17T04:20:49.286 INFO:tasks.workunit.client.1.smithi134.stdout:9/504: write d2/d5/d9/df/d38/f6c [1569242,90177] 0 2024-09-17T04:20:49.286 INFO:tasks.workunit.client.1.smithi134.stdout:0/157: fdatasync d11/d18/f23 0 2024-09-17T04:20:49.287 INFO:tasks.workunit.client.1.smithi134.stdout:0/158: dread - d11/d22/f3a zero size 2024-09-17T04:20:49.288 INFO:tasks.workunit.client.1.smithi134.stdout:9/505: truncate d2/d5/d37/fa3 133101 0 2024-09-17T04:20:49.288 INFO:tasks.workunit.client.0.smithi088.stdout:1/18: mknod d0/d1/c9 0 2024-09-17T04:20:49.291 INFO:tasks.workunit.client.1.smithi134.stdout:0/159: dread fe [4194304,4194304] 0 2024-09-17T04:20:49.291 INFO:tasks.workunit.client.0.smithi088.stdout:4/21: symlink d5/l6 0 2024-09-17T04:20:49.293 INFO:tasks.workunit.client.0.smithi088.stdout:6/29: unlink c8 0 2024-09-17T04:20:49.294 INFO:tasks.workunit.client.1.smithi134.stdout:8/144: creat d4/f26 x:0 0 0 2024-09-17T04:20:49.295 INFO:tasks.workunit.client.0.smithi088.stdout:1/19: unlink d0/l6 0 2024-09-17T04:20:49.296 INFO:tasks.workunit.client.0.smithi088.stdout:1/20: truncate d0/f8 329979 0 2024-09-17T04:20:49.296 INFO:tasks.workunit.client.0.smithi088.stdout:1/21: fdatasync d0/f5 0 2024-09-17T04:20:49.297 INFO:tasks.workunit.client.1.smithi134.stdout:2/200: write d19/d27/f2f [1191366,125130] 0 2024-09-17T04:20:49.297 INFO:tasks.workunit.client.0.smithi088.stdout:7/27: creat d2/d4/d7/f9 x:0 0 0 2024-09-17T04:20:49.297 INFO:tasks.workunit.client.1.smithi134.stdout:2/201: chown d19/d27/c33 3602515 1 2024-09-17T04:20:49.298 INFO:tasks.workunit.client.0.smithi088.stdout:7/28: write d2/f3 [627262,28125] 0 2024-09-17T04:20:49.298 INFO:tasks.workunit.client.0.smithi088.stdout:4/22: mknod d5/c7 0 2024-09-17T04:20:49.299 INFO:tasks.workunit.client.0.smithi088.stdout:6/30: mknod ca 0 2024-09-17T04:20:49.299 INFO:tasks.workunit.client.0.smithi088.stdout:6/31: write f4 [246270,6698] 0 2024-09-17T04:20:49.302 INFO:tasks.workunit.client.0.smithi088.stdout:7/29: write d2/f6 [3603906,108874] 0 2024-09-17T04:20:49.303 INFO:tasks.workunit.client.1.smithi134.stdout:9/506: creat d2/d5/d37/fa8 x:0 0 0 2024-09-17T04:20:49.305 INFO:tasks.workunit.client.0.smithi088.stdout:4/23: creat d5/f8 x:0 0 0 2024-09-17T04:20:49.306 INFO:tasks.workunit.client.0.smithi088.stdout:4/24: rename d5 to d5/d9 22 2024-09-17T04:20:49.306 INFO:tasks.workunit.client.1.smithi134.stdout:5/140: sync 2024-09-17T04:20:49.306 INFO:tasks.workunit.client.1.smithi134.stdout:4/280: rmdir d0/df/d1e/d57 0 2024-09-17T04:20:49.308 INFO:tasks.workunit.client.0.smithi088.stdout:7/30: dread d2/f6 [0,4194304] 0 2024-09-17T04:20:49.310 INFO:tasks.workunit.client.1.smithi134.stdout:0/160: creat d11/d22/f3e x:0 0 0 2024-09-17T04:20:49.315 INFO:tasks.workunit.client.0.smithi088.stdout:7/31: dwrite d2/f3 [4194304,4194304] 0 2024-09-17T04:20:49.316 INFO:tasks.workunit.client.0.smithi088.stdout:4/25: rename d5/f8 to d5/fa 0 2024-09-17T04:20:49.316 INFO:tasks.workunit.client.0.smithi088.stdout:7/32: write d2/d4/d7/f9 [181399,117533] 0 2024-09-17T04:20:49.325 INFO:tasks.workunit.client.1.smithi134.stdout:5/141: chown d0/d6/f17 113449 1 2024-09-17T04:20:49.326 INFO:tasks.workunit.client.1.smithi134.stdout:4/281: stat d0/df/d1e/d20/l47 0 2024-09-17T04:20:49.329 INFO:tasks.workunit.client.1.smithi134.stdout:3/211: creat de/d12/f47 x:0 0 0 2024-09-17T04:20:49.329 INFO:tasks.workunit.client.1.smithi134.stdout:6/259: truncate fd 60174 0 2024-09-17T04:20:49.330 INFO:tasks.workunit.client.0.smithi088.stdout:4/26: unlink d5/c7 0 2024-09-17T04:20:49.330 INFO:tasks.workunit.client.0.smithi088.stdout:7/33: creat d2/d4/d7/fa x:0 0 0 2024-09-17T04:20:49.331 INFO:tasks.workunit.client.1.smithi134.stdout:0/161: mknod d11/d22/c3f 0 2024-09-17T04:20:49.331 INFO:tasks.workunit.client.1.smithi134.stdout:0/162: stat d11/d24 0 2024-09-17T04:20:49.332 INFO:tasks.workunit.client.0.smithi088.stdout:7/34: chown d2/d4 28 1 2024-09-17T04:20:49.332 INFO:tasks.workunit.client.0.smithi088.stdout:4/27: chown d5/fa 5104247 1 2024-09-17T04:20:49.332 INFO:tasks.workunit.client.0.smithi088.stdout:1/22: dwrite d0/f4 [0,4194304] 0 2024-09-17T04:20:49.332 INFO:tasks.workunit.client.0.smithi088.stdout:4/28: stat l4 0 2024-09-17T04:20:49.333 INFO:tasks.workunit.client.1.smithi134.stdout:7/131: sync 2024-09-17T04:20:49.336 INFO:tasks.workunit.client.1.smithi134.stdout:2/202: symlink d19/d27/d31/l43 0 2024-09-17T04:20:49.336 INFO:tasks.workunit.client.0.smithi088.stdout:4/29: dread f1 [4194304,4194304] 0 2024-09-17T04:20:49.337 INFO:tasks.workunit.client.0.smithi088.stdout:4/30: write f1 [8609813,28098] 0 2024-09-17T04:20:49.338 INFO:tasks.workunit.client.1.smithi134.stdout:8/145: mknod d4/d1f/d25/c27 0 2024-09-17T04:20:49.338 INFO:tasks.workunit.client.1.smithi134.stdout:7/132: dwrite d0/d16/f1e [0,4194304] 0 2024-09-17T04:20:49.338 INFO:tasks.workunit.client.1.smithi134.stdout:8/146: chown d4 164 1 2024-09-17T04:20:49.339 INFO:tasks.workunit.client.1.smithi134.stdout:8/147: readlink d4/l5 0 2024-09-17T04:20:49.339 INFO:tasks.workunit.client.1.smithi134.stdout:1/166: link cc d12/d19/d1d/c33 0 2024-09-17T04:20:49.345 INFO:tasks.workunit.client.1.smithi134.stdout:7/133: dwrite d0/dd/d11/f18 [0,4194304] 0 2024-09-17T04:20:49.347 INFO:tasks.workunit.client.1.smithi134.stdout:4/282: mknod d0/d13/d40/d42/c59 0 2024-09-17T04:20:49.350 INFO:tasks.workunit.client.1.smithi134.stdout:6/260: creat de/d2b/f50 x:0 0 0 2024-09-17T04:20:49.353 INFO:tasks.workunit.client.1.smithi134.stdout:6/261: write de/f12 [790397,50920] 0 2024-09-17T04:20:49.355 INFO:tasks.workunit.client.1.smithi134.stdout:4/283: dwrite d0/d13/d40/d42/f4f [0,4194304] 0 2024-09-17T04:20:49.358 INFO:tasks.workunit.client.1.smithi134.stdout:2/203: fsync f2 0 2024-09-17T04:20:49.359 INFO:tasks.workunit.client.1.smithi134.stdout:2/204: write f1 [2601565,108896] 0 2024-09-17T04:20:49.360 INFO:tasks.workunit.client.1.smithi134.stdout:8/148: symlink d4/d11/l28 0 2024-09-17T04:20:49.364 INFO:tasks.workunit.client.1.smithi134.stdout:9/507: link d2/d5/d8/d1e/l7e d2/d5/d9/df/d80/la9 0 2024-09-17T04:20:49.364 INFO:tasks.workunit.client.1.smithi134.stdout:8/149: dread f0 [0,4194304] 0 2024-09-17T04:20:49.365 INFO:tasks.workunit.client.1.smithi134.stdout:9/508: write d2/d5/d37/d7c/f8e [792345,51614] 0 2024-09-17T04:20:49.370 INFO:tasks.workunit.client.1.smithi134.stdout:6/262: write de/d19/d1f/f28 [3307110,104006] 0 2024-09-17T04:20:49.374 INFO:tasks.workunit.client.1.smithi134.stdout:9/509: dwrite d2/d5/d37/d57/d6d/f97 [0,4194304] 0 2024-09-17T04:20:49.376 INFO:tasks.workunit.client.1.smithi134.stdout:9/510: write d2/d5/d37/d57/fa1 [519289,65641] 0 2024-09-17T04:20:49.377 INFO:tasks.workunit.client.1.smithi134.stdout:5/142: rename d0/f5 to d0/f2a 0 2024-09-17T04:20:49.379 INFO:tasks.workunit.client.1.smithi134.stdout:9/511: write d2/d5/d37/fa8 [595424,47104] 0 2024-09-17T04:20:49.380 INFO:tasks.workunit.client.1.smithi134.stdout:1/167: write d12/f14 [2587116,92723] 0 2024-09-17T04:20:49.382 INFO:tasks.workunit.client.1.smithi134.stdout:3/212: rename de/d12/d15/d1d/f33 to de/d12/f48 0 2024-09-17T04:20:49.382 INFO:tasks.workunit.client.1.smithi134.stdout:1/168: truncate d12/d19/f25 1005648 0 2024-09-17T04:20:49.383 INFO:tasks.workunit.client.1.smithi134.stdout:3/213: chown de/d12/d15/d1d/d2d 1772 1 2024-09-17T04:20:49.383 INFO:tasks.workunit.client.1.smithi134.stdout:3/214: readlink l2 0 2024-09-17T04:20:49.384 INFO:tasks.workunit.client.1.smithi134.stdout:3/215: write de/f2a [1055135,117038] 0 2024-09-17T04:20:49.385 INFO:tasks.workunit.client.1.smithi134.stdout:3/216: truncate de/d12/d22/f46 892776 0 2024-09-17T04:20:49.387 INFO:tasks.workunit.client.1.smithi134.stdout:6/263: symlink de/d19/l51 0 2024-09-17T04:20:49.393 INFO:tasks.workunit.client.1.smithi134.stdout:5/143: mkdir d0/d6/d2b 0 2024-09-17T04:20:49.393 INFO:tasks.workunit.client.1.smithi134.stdout:4/284: dwrite d0/d13/f3c [0,4194304] 0 2024-09-17T04:20:49.394 INFO:tasks.workunit.client.1.smithi134.stdout:7/134: dread d0/f6 [0,4194304] 0 2024-09-17T04:20:49.398 INFO:tasks.workunit.client.1.smithi134.stdout:0/163: rename f3 to d11/d18/f40 0 2024-09-17T04:20:49.400 INFO:tasks.workunit.client.1.smithi134.stdout:1/169: creat d12/d1c/f34 x:0 0 0 2024-09-17T04:20:49.403 INFO:tasks.workunit.client.1.smithi134.stdout:3/217: symlink de/d10/l49 0 2024-09-17T04:20:49.404 INFO:tasks.workunit.client.1.smithi134.stdout:8/150: link d4/l17 d4/d23/l29 0 2024-09-17T04:20:49.404 INFO:tasks.workunit.client.1.smithi134.stdout:4/285: dwrite d0/df/f4e [0,4194304] 0 2024-09-17T04:20:49.404 INFO:tasks.workunit.client.1.smithi134.stdout:0/164: truncate d11/d19/d21/f27 957367 0 2024-09-17T04:20:49.412 INFO:tasks.workunit.client.1.smithi134.stdout:1/170: dwrite d12/d1c/f2f [0,4194304] 0 2024-09-17T04:20:49.416 INFO:tasks.workunit.client.1.smithi134.stdout:5/144: mkdir d0/da/d2c 0 2024-09-17T04:20:49.417 INFO:tasks.workunit.client.1.smithi134.stdout:4/286: rmdir d0/df/d1e/d20 39 2024-09-17T04:20:49.418 INFO:tasks.workunit.client.1.smithi134.stdout:9/512: dwrite d2/d5/d8/d16/fd [4194304,4194304] 0 2024-09-17T04:20:49.424 INFO:tasks.workunit.client.1.smithi134.stdout:9/513: truncate d2/d5/d37/d7c/f8e 1685634 0 2024-09-17T04:20:49.424 INFO:tasks.workunit.client.1.smithi134.stdout:2/205: rename d19/l26 to d19/d1c/d3a/l44 0 2024-09-17T04:20:49.425 INFO:tasks.workunit.client.1.smithi134.stdout:6/264: rename de to de/d19/d21/d2d/d41/d52 22 2024-09-17T04:20:49.426 INFO:tasks.workunit.client.1.smithi134.stdout:1/171: mknod d12/d1c/c35 0 2024-09-17T04:20:49.427 INFO:tasks.workunit.client.1.smithi134.stdout:1/172: dread - d12/d1c/f34 zero size 2024-09-17T04:20:49.428 INFO:tasks.workunit.client.1.smithi134.stdout:1/173: write d12/f1b [610704,10573] 0 2024-09-17T04:20:49.429 INFO:tasks.workunit.client.1.smithi134.stdout:8/151: dread d4/db/f14 [0,4194304] 0 2024-09-17T04:20:49.430 INFO:tasks.workunit.client.1.smithi134.stdout:1/174: write d12/d19/f30 [2843151,6998] 0 2024-09-17T04:20:49.430 INFO:tasks.workunit.client.1.smithi134.stdout:1/175: chown c11 3 1 2024-09-17T04:20:49.432 INFO:tasks.workunit.client.1.smithi134.stdout:4/287: symlink d0/d13/d40/d42/l5a 0 2024-09-17T04:20:49.433 INFO:tasks.workunit.client.1.smithi134.stdout:0/165: write d11/f12 [3966660,115057] 0 2024-09-17T04:20:49.436 INFO:tasks.workunit.client.1.smithi134.stdout:9/514: mkdir d2/d5/d37/d57/d6d/daa 0 2024-09-17T04:20:49.438 INFO:tasks.workunit.client.1.smithi134.stdout:9/515: write d2/d5/d9/df/d38/f6c [991968,122999] 0 2024-09-17T04:20:49.438 INFO:tasks.workunit.client.1.smithi134.stdout:7/135: write d0/d16/f26 [1597024,99046] 0 2024-09-17T04:20:49.439 INFO:tasks.workunit.client.1.smithi134.stdout:9/516: stat d2/d7/d75/f93 0 2024-09-17T04:20:49.443 INFO:tasks.workunit.client.1.smithi134.stdout:3/218: link l2 de/d10/l4a 0 2024-09-17T04:20:49.445 INFO:tasks.workunit.client.1.smithi134.stdout:5/145: creat d0/d6/d2b/f2d x:0 0 0 2024-09-17T04:20:49.445 INFO:tasks.workunit.client.1.smithi134.stdout:9/517: dwrite d2/d5/d9/d6a/f82 [0,4194304] 0 2024-09-17T04:20:49.451 INFO:tasks.workunit.client.1.smithi134.stdout:4/288: dread d0/d13/f33 [4194304,4194304] 0 2024-09-17T04:20:49.453 INFO:tasks.workunit.client.1.smithi134.stdout:6/265: link de/d19/d1a/d34/f42 de/f53 0 2024-09-17T04:20:49.455 INFO:tasks.workunit.client.1.smithi134.stdout:7/136: unlink d0/dd/d11/l25 0 2024-09-17T04:20:49.457 INFO:tasks.workunit.client.1.smithi134.stdout:8/152: unlink d4/db/l15 0 2024-09-17T04:20:49.458 INFO:tasks.workunit.client.1.smithi134.stdout:8/153: truncate d4/d11/f1c 630583 0 2024-09-17T04:20:49.459 INFO:tasks.workunit.client.1.smithi134.stdout:3/219: creat de/d12/d15/f4b x:0 0 0 2024-09-17T04:20:49.460 INFO:tasks.workunit.client.1.smithi134.stdout:1/176: mkdir d12/d36 0 2024-09-17T04:20:49.460 INFO:tasks.workunit.client.1.smithi134.stdout:1/177: stat c11 0 2024-09-17T04:20:49.461 INFO:tasks.workunit.client.1.smithi134.stdout:5/146: write d0/f2a [910365,74790] 0 2024-09-17T04:20:49.463 INFO:tasks.workunit.client.1.smithi134.stdout:2/206: dwrite d19/d1c/f23 [0,4194304] 0 2024-09-17T04:20:49.465 INFO:tasks.workunit.client.1.smithi134.stdout:9/518: rename d2/d5/d37/d57/c91 to d2/d5/d37/d83/da7/cab 0 2024-09-17T04:20:49.466 INFO:tasks.workunit.client.1.smithi134.stdout:9/519: read - d2/d5/f98 zero size 2024-09-17T04:20:49.467 INFO:tasks.workunit.client.1.smithi134.stdout:0/166: creat d11/d19/d21/d37/f41 x:0 0 0 2024-09-17T04:20:49.469 INFO:tasks.workunit.client.1.smithi134.stdout:4/289: creat d0/d3b/f5b x:0 0 0 2024-09-17T04:20:49.472 INFO:tasks.workunit.client.1.smithi134.stdout:6/266: unlink lc 0 2024-09-17T04:20:49.473 INFO:tasks.workunit.client.1.smithi134.stdout:7/137: mknod d0/dd/c28 0 2024-09-17T04:20:49.473 INFO:tasks.workunit.client.1.smithi134.stdout:8/154: symlink d4/d1e/l2a 0 2024-09-17T04:20:49.475 INFO:tasks.workunit.client.1.smithi134.stdout:3/220: mknod de/d12/d15/c4c 0 2024-09-17T04:20:49.475 INFO:tasks.workunit.client.1.smithi134.stdout:6/267: dwrite de/d19/d1a/d34/f3c [0,4194304] 0 2024-09-17T04:20:49.476 INFO:tasks.workunit.client.1.smithi134.stdout:3/221: dread - de/d10/d3d/f43 zero size 2024-09-17T04:20:49.476 INFO:tasks.workunit.client.1.smithi134.stdout:1/178: mknod d12/d1c/d2e/c37 0 2024-09-17T04:20:49.477 INFO:tasks.workunit.client.1.smithi134.stdout:3/222: dread - de/d12/d15/f4b zero size 2024-09-17T04:20:49.478 INFO:tasks.workunit.client.1.smithi134.stdout:3/223: write de/f2a [1103672,69942] 0 2024-09-17T04:20:49.480 INFO:tasks.workunit.client.1.smithi134.stdout:9/520: symlink d2/d5/d37/d57/d6d/d84/lac 0 2024-09-17T04:20:49.481 INFO:tasks.workunit.client.1.smithi134.stdout:0/167: creat d11/d19/d21/d37/f42 x:0 0 0 2024-09-17T04:20:49.482 INFO:tasks.workunit.client.1.smithi134.stdout:4/290: mkdir d0/df/d35/d5c 0 2024-09-17T04:20:49.485 INFO:tasks.workunit.client.1.smithi134.stdout:7/138: mknod d0/dd/d11/c29 0 2024-09-17T04:20:49.486 INFO:tasks.workunit.client.1.smithi134.stdout:8/155: mkdir d4/d1f/d2b 0 2024-09-17T04:20:49.489 INFO:tasks.workunit.client.1.smithi134.stdout:1/179: unlink ff 0 2024-09-17T04:20:49.499 INFO:tasks.workunit.client.1.smithi134.stdout:4/291: mknod d0/df/d35/c5d 0 2024-09-17T04:20:49.500 INFO:tasks.workunit.client.1.smithi134.stdout:7/139: mknod d0/dd/c2a 0 2024-09-17T04:20:49.501 INFO:tasks.workunit.client.1.smithi134.stdout:7/140: read - d0/dd/d11/f23 zero size 2024-09-17T04:20:49.503 INFO:tasks.workunit.client.1.smithi134.stdout:6/268: fsync de/f3a 0 2024-09-17T04:20:49.504 INFO:tasks.workunit.client.1.smithi134.stdout:7/141: write d0/f15 [4155548,53801] 0 2024-09-17T04:20:49.506 INFO:tasks.workunit.client.1.smithi134.stdout:7/142: chown d0/d16/f1e 453379 1 2024-09-17T04:20:49.506 INFO:tasks.workunit.client.1.smithi134.stdout:4/292: dwrite d0/fb [0,4194304] 0 2024-09-17T04:20:49.506 INFO:tasks.workunit.client.1.smithi134.stdout:1/180: chown d12/d1c/c1f 34443700 1 2024-09-17T04:20:49.509 INFO:tasks.workunit.client.1.smithi134.stdout:5/147: creat d0/da/f2e x:0 0 0 2024-09-17T04:20:49.510 INFO:tasks.workunit.client.1.smithi134.stdout:3/224: unlink de/d12/l3f 0 2024-09-17T04:20:49.516 INFO:tasks.workunit.client.1.smithi134.stdout:6/269: dwrite de/d19/f3d [0,4194304] 0 2024-09-17T04:20:49.516 INFO:tasks.workunit.client.1.smithi134.stdout:5/148: dread d0/d6/f1f [0,4194304] 0 2024-09-17T04:20:49.517 INFO:tasks.workunit.client.1.smithi134.stdout:7/143: dread d0/f6 [0,4194304] 0 2024-09-17T04:20:49.520 INFO:tasks.workunit.client.1.smithi134.stdout:1/181: dwrite d12/d19/f25 [0,4194304] 0 2024-09-17T04:20:49.524 INFO:tasks.workunit.client.1.smithi134.stdout:8/156: write f3 [1779810,46099] 0 2024-09-17T04:20:49.524 INFO:tasks.workunit.client.1.smithi134.stdout:0/168: dwrite d11/d18/f30 [0,4194304] 0 2024-09-17T04:20:49.526 INFO:tasks.workunit.client.1.smithi134.stdout:8/157: fsync d4/f26 0 2024-09-17T04:20:49.527 INFO:tasks.workunit.client.1.smithi134.stdout:4/293: chown d0/df/d1e/d20/l47 108675494 1 2024-09-17T04:20:49.529 INFO:tasks.workunit.client.1.smithi134.stdout:2/207: creat d19/d27/d31/d34/f45 x:0 0 0 2024-09-17T04:20:49.529 INFO:tasks.workunit.client.1.smithi134.stdout:8/158: dread - d4/db/fc zero size 2024-09-17T04:20:49.531 INFO:tasks.workunit.client.1.smithi134.stdout:8/159: truncate d4/db/fc 876389 0 2024-09-17T04:20:49.532 INFO:tasks.workunit.client.1.smithi134.stdout:1/182: dwrite d12/d19/f30 [4194304,4194304] 0 2024-09-17T04:20:49.539 INFO:tasks.workunit.client.1.smithi134.stdout:9/521: truncate d2/d5/d9/d6a/f82 432759 0 2024-09-17T04:20:49.547 INFO:tasks.workunit.client.1.smithi134.stdout:0/169: unlink d11/d19/d21/d37/f41 0 2024-09-17T04:20:49.553 INFO:tasks.workunit.client.1.smithi134.stdout:3/225: rename de/d12/d15/f1a to de/d12/d15/f4d 0 2024-09-17T04:20:49.556 INFO:tasks.workunit.client.1.smithi134.stdout:1/183: rename d12/c18 to d12/d19/d1d/c38 0 2024-09-17T04:20:49.556 INFO:tasks.workunit.client.1.smithi134.stdout:2/208: dread d19/d1c/f1f [0,4194304] 0 2024-09-17T04:20:49.557 INFO:tasks.workunit.client.1.smithi134.stdout:7/144: mknod d0/c2b 0 2024-09-17T04:20:49.558 INFO:tasks.workunit.client.1.smithi134.stdout:7/145: rename d0/dd to d0/dd/d11/d2c 22 2024-09-17T04:20:49.558 INFO:tasks.workunit.client.1.smithi134.stdout:7/146: stat d0/dd/d11/c29 0 2024-09-17T04:20:49.560 INFO:tasks.workunit.client.1.smithi134.stdout:5/149: mknod d0/da/c2f 0 2024-09-17T04:20:49.561 INFO:tasks.workunit.client.1.smithi134.stdout:5/150: dread - d0/d6/d2b/f2d zero size 2024-09-17T04:20:49.563 INFO:tasks.workunit.client.1.smithi134.stdout:6/270: unlink de/d19/d1f/c31 0 2024-09-17T04:20:49.563 INFO:tasks.workunit.client.1.smithi134.stdout:6/271: fdatasync de/d19/d1f/f28 0 2024-09-17T04:20:49.567 INFO:tasks.workunit.client.1.smithi134.stdout:0/170: mkdir d11/d22/d1c/d2f/d43 0 2024-09-17T04:20:49.567 INFO:tasks.workunit.client.1.smithi134.stdout:0/171: readlink d11/d18/l34 0 2024-09-17T04:20:49.567 INFO:tasks.workunit.client.1.smithi134.stdout:4/294: write d0/df/d35/d39/f56 [950350,86991] 0 2024-09-17T04:20:49.571 INFO:tasks.workunit.client.1.smithi134.stdout:8/160: link d4/f26 d4/db/df/d13/f2c 0 2024-09-17T04:20:49.575 INFO:tasks.workunit.client.1.smithi134.stdout:2/209: chown d19/c28 44708870 1 2024-09-17T04:20:49.578 INFO:tasks.workunit.client.1.smithi134.stdout:7/147: rename d0/d16/f1e to d0/dd/f2d 0 2024-09-17T04:20:49.578 INFO:tasks.workunit.client.1.smithi134.stdout:7/148: fdatasync d0/f15 0 2024-09-17T04:20:49.584 INFO:tasks.workunit.client.1.smithi134.stdout:6/272: symlink de/d19/d1a/d34/l54 0 2024-09-17T04:20:49.591 INFO:tasks.workunit.client.1.smithi134.stdout:1/184: symlink d12/d36/l39 0 2024-09-17T04:20:49.596 INFO:tasks.workunit.client.1.smithi134.stdout:5/151: rename d0 to d0/da/d12/d30 22 2024-09-17T04:20:49.599 INFO:tasks.workunit.client.1.smithi134.stdout:9/522: truncate d2/d5/d9/f1c 35484 0 2024-09-17T04:20:49.603 INFO:tasks.workunit.client.1.smithi134.stdout:6/273: mkdir de/d19/d1f/d55 0 2024-09-17T04:20:49.609 INFO:tasks.workunit.client.0.smithi088.stdout:6/32: getdents . 0 2024-09-17T04:20:49.610 INFO:tasks.workunit.client.1.smithi134.stdout:3/226: creat de/d12/f4e x:0 0 0 2024-09-17T04:20:49.610 INFO:tasks.workunit.client.1.smithi134.stdout:3/227: truncate de/d10/f2e 905938 0 2024-09-17T04:20:49.611 INFO:tasks.workunit.client.0.smithi088.stdout:1/23: chown d0/c7 200 1 2024-09-17T04:20:49.611 INFO:tasks.workunit.client.0.smithi088.stdout:7/35: mknod d2/cb 0 2024-09-17T04:20:49.615 INFO:tasks.workunit.client.1.smithi134.stdout:2/210: unlink d19/d1c/d3a/l44 0 2024-09-17T04:20:49.616 INFO:tasks.workunit.client.0.smithi088.stdout:4/31: creat d5/fb x:0 0 0 2024-09-17T04:20:49.617 INFO:tasks.workunit.client.1.smithi134.stdout:5/152: unlink d0/f11 0 2024-09-17T04:20:49.618 INFO:tasks.workunit.client.0.smithi088.stdout:6/33: mknod cb 0 2024-09-17T04:20:49.620 INFO:tasks.workunit.client.0.smithi088.stdout:1/24: rename d0/d1/f2 to d0/d1/fa 0 2024-09-17T04:20:49.621 INFO:tasks.workunit.client.1.smithi134.stdout:0/172: truncate d11/d19/d21/f27 861910 0 2024-09-17T04:20:49.621 INFO:tasks.workunit.client.0.smithi088.stdout:7/36: symlink d2/d4/d7/lc 0 2024-09-17T04:20:49.622 INFO:tasks.workunit.client.1.smithi134.stdout:4/295: creat d0/df/d1e/f5e x:0 0 0 2024-09-17T04:20:49.625 INFO:tasks.workunit.client.0.smithi088.stdout:4/32: fdatasync f1 0 2024-09-17T04:20:49.629 INFO:tasks.workunit.client.0.smithi088.stdout:1/25: mkdir d0/db 0 2024-09-17T04:20:49.630 INFO:tasks.workunit.client.0.smithi088.stdout:1/26: dread - d0/f5 zero size 2024-09-17T04:20:49.631 INFO:tasks.workunit.client.0.smithi088.stdout:7/37: rmdir d2/d4 39 2024-09-17T04:20:49.633 INFO:tasks.workunit.client.0.smithi088.stdout:4/33: mknod d5/cc 0 2024-09-17T04:20:49.636 INFO:tasks.workunit.client.0.smithi088.stdout:1/27: fsync d0/d1/fa 0 2024-09-17T04:20:49.638 INFO:tasks.workunit.client.0.smithi088.stdout:7/38: chown d2/d4/l8 993526 1 2024-09-17T04:20:49.639 INFO:tasks.workunit.client.0.smithi088.stdout:4/34: creat d5/fd x:0 0 0 2024-09-17T04:20:49.640 INFO:tasks.workunit.client.0.smithi088.stdout:1/28: dread d0/f4 [0,4194304] 0 2024-09-17T04:20:49.641 INFO:tasks.workunit.client.0.smithi088.stdout:1/29: write d0/f8 [257876,9311] 0 2024-09-17T04:20:49.641 INFO:tasks.workunit.client.0.smithi088.stdout:1/30: chown d0/d1 144 1 2024-09-17T04:20:49.641 INFO:tasks.workunit.client.0.smithi088.stdout:7/39: symlink d2/d4/ld 0 2024-09-17T04:20:49.643 INFO:tasks.workunit.client.0.smithi088.stdout:6/34: getdents . 0 2024-09-17T04:20:49.643 INFO:tasks.workunit.client.0.smithi088.stdout:1/31: write d0/d1/fa [7195065,2906] 0 2024-09-17T04:20:49.644 INFO:tasks.workunit.client.0.smithi088.stdout:4/35: symlink d5/le 0 2024-09-17T04:20:49.645 INFO:tasks.workunit.client.0.smithi088.stdout:4/36: chown d5/cc 2 1 2024-09-17T04:20:49.646 INFO:tasks.workunit.client.0.smithi088.stdout:6/35: unlink cb 0 2024-09-17T04:20:49.646 INFO:tasks.workunit.client.0.smithi088.stdout:4/37: fsync d5/fb 0 2024-09-17T04:20:49.648 INFO:tasks.workunit.client.0.smithi088.stdout:1/32: mknod d0/db/cc 0 2024-09-17T04:20:49.648 INFO:tasks.workunit.client.0.smithi088.stdout:6/36: write f3 [3058841,33576] 0 2024-09-17T04:20:49.649 INFO:tasks.workunit.client.0.smithi088.stdout:4/38: chown d5/fb 3 1 2024-09-17T04:20:49.652 INFO:tasks.workunit.client.0.smithi088.stdout:7/40: dwrite d2/d4/d7/fa [0,4194304] 0 2024-09-17T04:20:49.652 INFO:tasks.workunit.client.0.smithi088.stdout:4/39: truncate d5/fb 207541 0 2024-09-17T04:20:49.656 INFO:tasks.workunit.client.0.smithi088.stdout:4/40: write d5/fd [270281,61058] 0 2024-09-17T04:20:49.659 INFO:tasks.workunit.client.1.smithi134.stdout:8/161: creat d4/db/f2d x:0 0 0 2024-09-17T04:20:49.660 INFO:tasks.workunit.client.0.smithi088.stdout:4/41: symlink d5/lf 0 2024-09-17T04:20:49.660 INFO:tasks.workunit.client.1.smithi134.stdout:3/228: mkdir de/d10/d3d/d4f 0 2024-09-17T04:20:49.661 INFO:tasks.workunit.client.1.smithi134.stdout:1/185: unlink c10 0 2024-09-17T04:20:49.661 INFO:tasks.workunit.client.1.smithi134.stdout:2/211: symlink d19/d27/l46 0 2024-09-17T04:20:49.662 INFO:tasks.workunit.client.1.smithi134.stdout:8/162: truncate f3 2669173 0 2024-09-17T04:20:49.662 INFO:tasks.workunit.client.0.smithi088.stdout:6/37: dwrite f5 [0,4194304] 0 2024-09-17T04:20:49.663 INFO:tasks.workunit.client.1.smithi134.stdout:1/186: fdatasync d12/f17 0 2024-09-17T04:20:49.663 INFO:tasks.workunit.client.1.smithi134.stdout:5/153: fdatasync d0/d6/f1f 0 2024-09-17T04:20:49.663 INFO:tasks.workunit.client.1.smithi134.stdout:3/229: chown de/d10/l49 3015690 1 2024-09-17T04:20:49.663 INFO:tasks.workunit.client.0.smithi088.stdout:4/42: creat d5/f10 x:0 0 0 2024-09-17T04:20:49.664 INFO:tasks.workunit.client.0.smithi088.stdout:1/33: dwrite d0/f4 [0,4194304] 0 2024-09-17T04:20:49.664 INFO:tasks.workunit.client.1.smithi134.stdout:9/523: creat d2/d5/d37/d57/d6d/daa/fad x:0 0 0 2024-09-17T04:20:49.664 INFO:tasks.workunit.client.0.smithi088.stdout:4/43: fdatasync d5/fb 0 2024-09-17T04:20:49.666 INFO:tasks.workunit.client.0.smithi088.stdout:7/41: dread d2/f6 [0,4194304] 0 2024-09-17T04:20:49.674 INFO:tasks.workunit.client.1.smithi134.stdout:4/296: dwrite d0/df/d1e/f5e [0,4194304] 0 2024-09-17T04:20:49.674 INFO:tasks.workunit.client.1.smithi134.stdout:7/149: link d0/dd/l17 d0/l2e 0 2024-09-17T04:20:49.674 INFO:tasks.workunit.client.1.smithi134.stdout:9/524: chown d2/d5/d8/d16/c7b 149 1 2024-09-17T04:20:49.675 INFO:tasks.workunit.client.1.smithi134.stdout:0/173: link d11/d18/f1f d11/d22/d1c/d2f/d43/f44 0 2024-09-17T04:20:49.675 INFO:tasks.workunit.client.1.smithi134.stdout:5/154: chown d0/da/l14 1 1 2024-09-17T04:20:49.677 INFO:tasks.workunit.client.1.smithi134.stdout:7/150: chown d0/d16/la 37 1 2024-09-17T04:20:49.681 INFO:tasks.workunit.client.1.smithi134.stdout:2/212: unlink d19/d27/d31/l36 0 2024-09-17T04:20:49.681 INFO:tasks.workunit.client.1.smithi134.stdout:3/230: rename de/d12/d15/d1d/d2d/d31/l34 to de/l50 0 2024-09-17T04:20:49.682 INFO:tasks.workunit.client.1.smithi134.stdout:8/163: dwrite d4/db/dd/f16 [0,4194304] 0 2024-09-17T04:20:49.683 INFO:tasks.workunit.client.1.smithi134.stdout:0/174: chown f9 44258312 1 2024-09-17T04:20:49.684 INFO:tasks.workunit.client.0.smithi088.stdout:4/44: dwrite d5/fd [0,4194304] 0 2024-09-17T04:20:49.685 INFO:tasks.workunit.client.0.smithi088.stdout:1/34: dwrite d0/d1/fa [4194304,4194304] 0 2024-09-17T04:20:49.686 INFO:tasks.workunit.client.1.smithi134.stdout:3/231: dread - de/d12/f4e zero size 2024-09-17T04:20:49.688 INFO:tasks.workunit.client.1.smithi134.stdout:8/164: dread - d4/db/df/d13/f2c zero size 2024-09-17T04:20:49.688 INFO:tasks.workunit.client.0.smithi088.stdout:6/38: dwrite f7 [0,4194304] 0 2024-09-17T04:20:49.689 INFO:tasks.workunit.client.0.smithi088.stdout:6/39: chown f7 3 1 2024-09-17T04:20:49.689 INFO:tasks.workunit.client.0.smithi088.stdout:7/42: dwrite d2/f3 [0,4194304] 0 2024-09-17T04:20:49.690 INFO:tasks.workunit.client.0.smithi088.stdout:4/45: write d5/f10 [101882,55729] 0 2024-09-17T04:20:49.690 INFO:tasks.workunit.client.1.smithi134.stdout:7/151: dwrite d0/dd/fe [4194304,4194304] 0 2024-09-17T04:20:49.691 INFO:tasks.workunit.client.1.smithi134.stdout:5/155: creat d0/d6/d2b/f31 x:0 0 0 2024-09-17T04:20:49.692 INFO:tasks.workunit.client.1.smithi134.stdout:2/213: mkdir d19/d1c/d47 0 2024-09-17T04:20:49.693 INFO:tasks.workunit.client.1.smithi134.stdout:8/165: dread - d4/f10 zero size 2024-09-17T04:20:49.694 INFO:tasks.workunit.client.1.smithi134.stdout:0/175: mkdir d11/d22/d1c/d2f/d45 0 2024-09-17T04:20:49.694 INFO:tasks.workunit.client.1.smithi134.stdout:4/297: mknod d0/c5f 0 2024-09-17T04:20:49.695 INFO:tasks.workunit.client.0.smithi088.stdout:1/35: dread d0/d1/fa [4194304,4194304] 0 2024-09-17T04:20:49.696 INFO:tasks.workunit.client.1.smithi134.stdout:4/298: write d0/f43 [4213958,124393] 0 2024-09-17T04:20:49.697 INFO:tasks.workunit.client.0.smithi088.stdout:6/40: rename ca to cc 0 2024-09-17T04:20:49.699 INFO:tasks.workunit.client.0.smithi088.stdout:4/46: symlink d5/l11 0 2024-09-17T04:20:49.702 INFO:tasks.workunit.client.1.smithi134.stdout:2/214: truncate f2 2270108 0 2024-09-17T04:20:49.704 INFO:tasks.workunit.client.1.smithi134.stdout:4/299: dread d0/f5 [0,4194304] 0 2024-09-17T04:20:49.705 INFO:tasks.workunit.client.1.smithi134.stdout:8/166: creat d4/db/dd/f2e x:0 0 0 2024-09-17T04:20:49.708 INFO:tasks.workunit.client.0.smithi088.stdout:4/47: rename l0 to d5/l12 0 2024-09-17T04:20:49.711 INFO:tasks.workunit.client.1.smithi134.stdout:0/176: symlink d11/d18/l46 0 2024-09-17T04:20:49.712 INFO:tasks.workunit.client.0.smithi088.stdout:1/36: dwrite d0/f5 [0,4194304] 0 2024-09-17T04:20:49.712 INFO:tasks.workunit.client.1.smithi134.stdout:7/152: dwrite d0/f1b [0,4194304] 0 2024-09-17T04:20:49.713 INFO:tasks.workunit.client.0.smithi088.stdout:6/41: dwrite f9 [0,4194304] 0 2024-09-17T04:20:49.714 INFO:tasks.workunit.client.1.smithi134.stdout:4/300: rmdir d0 39 2024-09-17T04:20:49.716 INFO:tasks.workunit.client.0.smithi088.stdout:7/43: getdents d2/d4 0 2024-09-17T04:20:49.717 INFO:tasks.workunit.client.1.smithi134.stdout:2/215: dwrite d19/d27/f2f [0,4194304] 0 2024-09-17T04:20:49.717 INFO:tasks.workunit.client.1.smithi134.stdout:3/232: rmdir de/d12/d42 0 2024-09-17T04:20:49.719 INFO:tasks.workunit.client.0.smithi088.stdout:4/48: dread f1 [0,4194304] 0 2024-09-17T04:20:49.720 INFO:tasks.workunit.client.0.smithi088.stdout:1/37: dread d0/d1/fa [0,4194304] 0 2024-09-17T04:20:49.720 INFO:tasks.workunit.client.1.smithi134.stdout:2/216: read d19/d1c/f1f [2893212,37479] 0 2024-09-17T04:20:49.723 INFO:tasks.workunit.client.0.smithi088.stdout:6/42: mknod cd 0 2024-09-17T04:20:49.724 INFO:tasks.workunit.client.1.smithi134.stdout:7/153: mknod d0/dd/d11/c2f 0 2024-09-17T04:20:49.725 INFO:tasks.workunit.client.1.smithi134.stdout:0/177: rename d11/d19/d21/f31 to d11/d24/f47 0 2024-09-17T04:20:49.725 INFO:tasks.workunit.client.0.smithi088.stdout:7/44: dread d2/d4/d7/f9 [0,4194304] 0 2024-09-17T04:20:49.727 INFO:tasks.workunit.client.1.smithi134.stdout:2/217: dread f16 [0,4194304] 0 2024-09-17T04:20:49.728 INFO:tasks.workunit.client.0.smithi088.stdout:1/38: creat d0/d1/fd x:0 0 0 2024-09-17T04:20:49.728 INFO:tasks.workunit.client.1.smithi134.stdout:2/218: stat d19/d27/f2b 0 2024-09-17T04:20:49.729 INFO:tasks.workunit.client.1.smithi134.stdout:3/233: write de/d10/d3d/f43 [555042,16697] 0 2024-09-17T04:20:49.732 INFO:tasks.workunit.client.0.smithi088.stdout:7/45: mknod d2/d4/d7/ce 0 2024-09-17T04:20:49.732 INFO:tasks.workunit.client.0.smithi088.stdout:7/46: chown d2 0 1 2024-09-17T04:20:49.734 INFO:tasks.workunit.client.1.smithi134.stdout:0/178: write d11/d18/f1f [3605055,37770] 0 2024-09-17T04:20:49.734 INFO:tasks.workunit.client.0.smithi088.stdout:1/39: unlink d0/f5 0 2024-09-17T04:20:49.735 INFO:tasks.workunit.client.0.smithi088.stdout:4/49: dwrite d5/fa [0,4194304] 0 2024-09-17T04:20:49.735 INFO:tasks.workunit.client.1.smithi134.stdout:0/179: read d11/d18/f36 [2624227,60573] 0 2024-09-17T04:20:49.736 INFO:tasks.workunit.client.0.smithi088.stdout:4/50: dread d5/fb [0,4194304] 0 2024-09-17T04:20:49.737 INFO:tasks.workunit.client.0.smithi088.stdout:4/51: read d5/f10 [119769,82715] 0 2024-09-17T04:20:49.738 INFO:tasks.workunit.client.1.smithi134.stdout:8/167: rmdir d4/d24 0 2024-09-17T04:20:49.740 INFO:tasks.workunit.client.0.smithi088.stdout:1/40: dread d0/f8 [0,4194304] 0 2024-09-17T04:20:49.743 INFO:tasks.workunit.client.0.smithi088.stdout:4/52: dread f1 [4194304,4194304] 0 2024-09-17T04:20:49.744 INFO:tasks.workunit.client.1.smithi134.stdout:5/156: dread d0/d6/f17 [0,4194304] 0 2024-09-17T04:20:49.745 INFO:tasks.workunit.client.1.smithi134.stdout:3/234: rename l4 to de/d12/d15/d1d/d2d/l51 0 2024-09-17T04:20:49.746 INFO:tasks.workunit.client.1.smithi134.stdout:4/301: mknod d0/c60 0 2024-09-17T04:20:49.747 INFO:tasks.workunit.client.1.smithi134.stdout:8/168: stat d4/l17 0 2024-09-17T04:20:49.747 INFO:tasks.workunit.client.0.smithi088.stdout:4/53: rmdir d5 39 2024-09-17T04:20:49.748 INFO:tasks.workunit.client.1.smithi134.stdout:8/169: readlink d4/d1e/l2a 0 2024-09-17T04:20:49.748 INFO:tasks.workunit.client.1.smithi134.stdout:4/302: write d0/df/f16 [4297600,99050] 0 2024-09-17T04:20:49.748 INFO:tasks.workunit.client.1.smithi134.stdout:2/219: symlink d19/d27/d31/l48 0 2024-09-17T04:20:49.749 INFO:tasks.workunit.client.1.smithi134.stdout:5/157: mknod d0/d6/d2b/c32 0 2024-09-17T04:20:49.750 INFO:tasks.workunit.client.1.smithi134.stdout:5/158: stat d0/d6/d2b/c32 0 2024-09-17T04:20:49.750 INFO:tasks.workunit.client.1.smithi134.stdout:0/180: mkdir d11/d48 0 2024-09-17T04:20:49.752 INFO:tasks.workunit.client.0.smithi088.stdout:4/54: dread d5/fa [0,4194304] 0 2024-09-17T04:20:49.753 INFO:tasks.workunit.client.1.smithi134.stdout:3/235: rename fd to de/d10/d3d/f52 0 2024-09-17T04:20:49.754 INFO:tasks.workunit.client.0.smithi088.stdout:4/55: rename d5/fa to d5/f13 0 2024-09-17T04:20:49.755 INFO:tasks.workunit.client.1.smithi134.stdout:8/170: unlink d4/db/f14 0 2024-09-17T04:20:49.757 INFO:tasks.workunit.client.1.smithi134.stdout:8/171: fdatasync d4/fe 0 2024-09-17T04:20:49.757 INFO:tasks.workunit.client.1.smithi134.stdout:2/220: dread - d19/f35 zero size 2024-09-17T04:20:49.758 INFO:tasks.workunit.client.1.smithi134.stdout:2/221: read f1 [2097529,68831] 0 2024-09-17T04:20:49.758 INFO:tasks.workunit.client.1.smithi134.stdout:4/303: creat d0/d3b/f61 x:0 0 0 2024-09-17T04:20:49.759 INFO:tasks.workunit.client.1.smithi134.stdout:5/159: symlink d0/d6/d2b/l33 0 2024-09-17T04:20:49.759 INFO:tasks.workunit.client.1.smithi134.stdout:8/172: dread d4/d11/f1c [0,4194304] 0 2024-09-17T04:20:49.760 INFO:tasks.workunit.client.1.smithi134.stdout:0/181: write d11/d18/f3d [365379,20085] 0 2024-09-17T04:20:49.760 INFO:tasks.workunit.client.1.smithi134.stdout:0/182: stat f10 0 2024-09-17T04:20:49.760 INFO:tasks.workunit.client.1.smithi134.stdout:3/236: unlink de/d12/f17 0 2024-09-17T04:20:49.761 INFO:tasks.workunit.client.1.smithi134.stdout:0/183: dread - d11/d24/f28 zero size 2024-09-17T04:20:49.761 INFO:tasks.workunit.client.1.smithi134.stdout:3/237: chown c7 275 1 2024-09-17T04:20:49.765 INFO:tasks.workunit.client.1.smithi134.stdout:5/160: dwrite d0/f2a [0,4194304] 0 2024-09-17T04:20:49.766 INFO:tasks.workunit.client.1.smithi134.stdout:8/173: creat d4/d1f/d2b/f2f x:0 0 0 2024-09-17T04:20:49.767 INFO:tasks.workunit.client.1.smithi134.stdout:2/222: getdents d19/d1c/d3a 0 2024-09-17T04:20:49.768 INFO:tasks.workunit.client.1.smithi134.stdout:4/304: getdents d0/d13/d40/d42 0 2024-09-17T04:20:49.769 INFO:tasks.workunit.client.1.smithi134.stdout:8/174: creat d4/db/dd/f30 x:0 0 0 2024-09-17T04:20:49.769 INFO:tasks.workunit.client.1.smithi134.stdout:3/238: dread de/f3b [0,4194304] 0 2024-09-17T04:20:49.770 INFO:tasks.workunit.client.1.smithi134.stdout:8/175: fdatasync f3 0 2024-09-17T04:20:49.772 INFO:tasks.workunit.client.1.smithi134.stdout:8/176: read - d4/db/f2d zero size 2024-09-17T04:20:49.773 INFO:tasks.workunit.client.1.smithi134.stdout:3/239: creat de/d12/d15/d1d/d2d/f53 x:0 0 0 2024-09-17T04:20:49.773 INFO:tasks.workunit.client.1.smithi134.stdout:4/305: getdents d0/df/d35/d5c 0 2024-09-17T04:20:49.776 INFO:tasks.workunit.client.1.smithi134.stdout:3/240: dread de/f1b [0,4194304] 0 2024-09-17T04:20:49.777 INFO:tasks.workunit.client.1.smithi134.stdout:2/223: dwrite fc [0,4194304] 0 2024-09-17T04:20:49.780 INFO:tasks.workunit.client.1.smithi134.stdout:2/224: chown d19/d1c/d3a 2 1 2024-09-17T04:20:49.780 INFO:tasks.workunit.client.1.smithi134.stdout:4/306: mknod d0/c62 0 2024-09-17T04:20:49.780 INFO:tasks.workunit.client.1.smithi134.stdout:2/225: chown d19/d27/d31/l43 118282 1 2024-09-17T04:20:49.781 INFO:tasks.workunit.client.1.smithi134.stdout:6/274: sync 2024-09-17T04:20:49.782 INFO:tasks.workunit.client.1.smithi134.stdout:2/226: chown d19/d1c/f2d 302 1 2024-09-17T04:20:49.788 INFO:tasks.workunit.client.1.smithi134.stdout:4/307: dwrite d0/df/d1e/d20/f4a [0,4194304] 0 2024-09-17T04:20:49.798 INFO:tasks.workunit.client.1.smithi134.stdout:5/161: dread d0/d6/fc [0,4194304] 0 2024-09-17T04:20:49.798 INFO:tasks.workunit.client.1.smithi134.stdout:5/162: stat d0/d6/d2b/c32 0 2024-09-17T04:20:49.808 INFO:tasks.workunit.client.1.smithi134.stdout:1/187: sync 2024-09-17T04:20:49.808 INFO:tasks.workunit.client.1.smithi134.stdout:1/188: readlink d12/d19/d1d/l32 0 2024-09-17T04:20:49.809 INFO:tasks.workunit.client.1.smithi134.stdout:3/241: unlink de/f1b 0 2024-09-17T04:20:49.810 INFO:tasks.workunit.client.1.smithi134.stdout:3/242: write de/d12/f47 [498345,110634] 0 2024-09-17T04:20:49.813 INFO:tasks.workunit.client.1.smithi134.stdout:6/275: mknod de/d19/d1a/d34/c56 0 2024-09-17T04:20:49.816 INFO:tasks.workunit.client.1.smithi134.stdout:2/227: dread d19/f22 [0,4194304] 0 2024-09-17T04:20:49.854 INFO:tasks.workunit.client.1.smithi134.stdout:5/163: write d0/d6/fc [4443273,14351] 0 2024-09-17T04:20:49.855 INFO:tasks.workunit.client.0.smithi088.stdout:6/43: chown cc 344 1 2024-09-17T04:20:49.855 INFO:tasks.workunit.client.0.smithi088.stdout:6/44: write f3 [4058424,102008] 0 2024-09-17T04:20:49.857 INFO:tasks.workunit.client.1.smithi134.stdout:3/243: creat de/d12/d15/d1d/f54 x:0 0 0 2024-09-17T04:20:49.859 INFO:tasks.workunit.client.1.smithi134.stdout:8/177: link d4/l21 d4/d1f/d25/l31 0 2024-09-17T04:20:49.859 INFO:tasks.workunit.client.1.smithi134.stdout:4/308: dwrite d0/df/d1e/f2b [0,4194304] 0 2024-09-17T04:20:49.860 INFO:tasks.workunit.client.0.smithi088.stdout:6/45: symlink le 0 2024-09-17T04:20:49.860 INFO:tasks.workunit.client.1.smithi134.stdout:6/276: rmdir de/d19/d1f 39 2024-09-17T04:20:49.862 INFO:tasks.workunit.client.1.smithi134.stdout:6/277: chown de/f12 121 1 2024-09-17T04:20:49.864 INFO:tasks.workunit.client.1.smithi134.stdout:5/164: rename d0/f1b to d0/d6/d2b/f34 0 2024-09-17T04:20:49.865 INFO:tasks.workunit.client.1.smithi134.stdout:7/154: getdents d0/dd/d11 0 2024-09-17T04:20:49.865 INFO:tasks.workunit.client.1.smithi134.stdout:6/278: dread - de/d2b/f50 zero size 2024-09-17T04:20:49.865 INFO:tasks.workunit.client.1.smithi134.stdout:9/525: sync 2024-09-17T04:20:49.867 INFO:tasks.workunit.client.1.smithi134.stdout:5/165: readlink d0/da/d12/l27 0 2024-09-17T04:20:49.867 INFO:tasks.workunit.client.1.smithi134.stdout:3/244: dwrite de/f2a [0,4194304] 0 2024-09-17T04:20:49.868 INFO:tasks.workunit.client.1.smithi134.stdout:7/155: write d0/dd/fe [2981302,26844] 0 2024-09-17T04:20:49.870 INFO:tasks.workunit.client.1.smithi134.stdout:3/245: write de/d12/f3a [937996,118229] 0 2024-09-17T04:20:49.870 INFO:tasks.workunit.client.1.smithi134.stdout:2/228: mkdir d19/d27/d31/d49 0 2024-09-17T04:20:49.873 INFO:tasks.workunit.client.1.smithi134.stdout:4/309: mkdir d0/df/d1e/d63 0 2024-09-17T04:20:49.876 INFO:tasks.workunit.client.1.smithi134.stdout:9/526: creat d2/d5/d8/d1e/d42/fae x:0 0 0 2024-09-17T04:20:49.877 INFO:tasks.workunit.client.1.smithi134.stdout:5/166: dwrite d0/f2a [0,4194304] 0 2024-09-17T04:20:49.880 INFO:tasks.workunit.client.1.smithi134.stdout:8/178: rename d4/d1f/d25/l31 to d4/l32 0 2024-09-17T04:20:49.880 INFO:tasks.workunit.client.1.smithi134.stdout:2/229: dread f16 [0,4194304] 0 2024-09-17T04:20:49.881 INFO:tasks.workunit.client.1.smithi134.stdout:2/230: chown f16 5814 1 2024-09-17T04:20:49.884 INFO:tasks.workunit.client.1.smithi134.stdout:6/279: creat de/d19/d1f/f57 x:0 0 0 2024-09-17T04:20:49.885 INFO:tasks.workunit.client.0.smithi088.stdout:7/47: dwrite d2/f6 [0,4194304] 0 2024-09-17T04:20:49.885 INFO:tasks.workunit.client.0.smithi088.stdout:7/48: chown d2/d4/d7/lc 345 1 2024-09-17T04:20:49.885 INFO:tasks.workunit.client.1.smithi134.stdout:4/310: rmdir d0/d13 39 2024-09-17T04:20:49.885 INFO:tasks.workunit.client.1.smithi134.stdout:3/246: rmdir de/d12/d15/d1d/d2d 39 2024-09-17T04:20:49.886 INFO:tasks.workunit.client.1.smithi134.stdout:7/156: getdents d0/dd/d11 0 2024-09-17T04:20:49.889 INFO:tasks.workunit.client.1.smithi134.stdout:5/167: symlink d0/d6/l35 0 2024-09-17T04:20:49.890 INFO:tasks.workunit.client.0.smithi088.stdout:7/49: creat d2/d4/ff x:0 0 0 2024-09-17T04:20:49.891 INFO:tasks.workunit.client.0.smithi088.stdout:7/50: fsync d2/f3 0 2024-09-17T04:20:49.893 INFO:tasks.workunit.client.1.smithi134.stdout:9/527: rename d2/d5/d37/d57 to d2/d5/d8/d16/d54/daf 0 2024-09-17T04:20:49.894 INFO:tasks.workunit.client.1.smithi134.stdout:9/528: read - d2/d5/d37/d3f/f7d zero size 2024-09-17T04:20:49.894 INFO:tasks.workunit.client.1.smithi134.stdout:5/168: dwrite d0/f4 [0,4194304] 0 2024-09-17T04:20:49.896 INFO:tasks.workunit.client.0.smithi088.stdout:4/56: getdents d5 0 2024-09-17T04:20:49.898 INFO:tasks.workunit.client.1.smithi134.stdout:9/529: dread d2/d5/d8/d16/d54/daf/d6d/f97 [0,4194304] 0 2024-09-17T04:20:49.900 INFO:tasks.workunit.client.1.smithi134.stdout:2/231: dread d19/f22 [0,4194304] 0 2024-09-17T04:20:49.900 INFO:tasks.workunit.client.0.smithi088.stdout:7/51: creat d2/d4/d7/f10 x:0 0 0 2024-09-17T04:20:49.902 INFO:tasks.workunit.client.0.smithi088.stdout:7/52: write d2/d4/d7/f10 [632077,83534] 0 2024-09-17T04:20:49.904 INFO:tasks.workunit.client.0.smithi088.stdout:4/57: rename d5/f13 to d5/f14 0 2024-09-17T04:20:49.907 INFO:tasks.workunit.client.0.smithi088.stdout:7/53: unlink d2/d4/d7/lc 0 2024-09-17T04:20:49.908 INFO:tasks.workunit.client.0.smithi088.stdout:7/54: dread d2/d4/d7/f9 [0,4194304] 0 2024-09-17T04:20:49.909 INFO:tasks.workunit.client.0.smithi088.stdout:7/55: read d2/f3 [8166138,88744] 0 2024-09-17T04:20:49.909 INFO:tasks.workunit.client.0.smithi088.stdout:4/58: rename d5/cc to d5/c15 0 2024-09-17T04:20:49.910 INFO:tasks.workunit.client.0.smithi088.stdout:7/56: chown d2/f6 3041 1 2024-09-17T04:20:49.910 INFO:tasks.workunit.client.0.smithi088.stdout:4/59: write d5/fb [950719,53633] 0 2024-09-17T04:20:49.911 INFO:tasks.workunit.client.1.smithi134.stdout:7/157: mknod d0/d16/c30 0 2024-09-17T04:20:49.917 INFO:tasks.workunit.client.0.smithi088.stdout:4/60: dwrite d5/fb [0,4194304] 0 2024-09-17T04:20:49.921 INFO:tasks.workunit.client.1.smithi134.stdout:3/247: creat de/d12/d15/d1d/d2d/d31/f55 x:0 0 0 2024-09-17T04:20:49.922 INFO:tasks.workunit.client.0.smithi088.stdout:4/61: write d5/f14 [3927650,49045] 0 2024-09-17T04:20:49.924 INFO:tasks.workunit.client.1.smithi134.stdout:0/184: dwrite d11/d19/d21/f27 [0,4194304] 0 2024-09-17T04:20:49.925 INFO:tasks.workunit.client.0.smithi088.stdout:4/62: write d5/f10 [779935,24262] 0 2024-09-17T04:20:49.925 INFO:tasks.workunit.client.0.smithi088.stdout:4/63: readlink d5/l6 0 2024-09-17T04:20:49.926 INFO:tasks.workunit.client.1.smithi134.stdout:0/185: chown d11/d24/f28 149929226 1 2024-09-17T04:20:49.927 INFO:tasks.workunit.client.1.smithi134.stdout:2/232: symlink d19/l4a 0 2024-09-17T04:20:49.929 INFO:tasks.workunit.client.1.smithi134.stdout:0/186: read f0 [1553312,65640] 0 2024-09-17T04:20:49.929 INFO:tasks.workunit.client.1.smithi134.stdout:6/280: rmdir de/d19/d21/d2d/d41 0 2024-09-17T04:20:49.931 INFO:tasks.workunit.client.1.smithi134.stdout:3/248: mknod de/d10/c56 0 2024-09-17T04:20:49.932 INFO:tasks.workunit.client.1.smithi134.stdout:3/249: chown de/d12/f48 2 1 2024-09-17T04:20:49.932 INFO:tasks.workunit.client.1.smithi134.stdout:7/158: getdents d0/dd/d11 0 2024-09-17T04:20:49.933 INFO:tasks.workunit.client.1.smithi134.stdout:3/250: truncate de/d12/d15/f4b 514785 0 2024-09-17T04:20:49.935 INFO:tasks.workunit.client.1.smithi134.stdout:1/189: truncate d12/f1a 415250 0 2024-09-17T04:20:49.935 INFO:tasks.workunit.client.1.smithi134.stdout:1/190: chown d12/d1c/c28 32 1 2024-09-17T04:20:49.937 INFO:tasks.workunit.client.1.smithi134.stdout:0/187: mkdir d11/d24/d49 0 2024-09-17T04:20:49.937 INFO:tasks.workunit.client.1.smithi134.stdout:6/281: truncate de/f3a 591521 0 2024-09-17T04:20:49.938 INFO:tasks.workunit.client.1.smithi134.stdout:6/282: fdatasync de/f2c 0 2024-09-17T04:20:49.939 INFO:tasks.workunit.client.1.smithi134.stdout:7/159: symlink d0/d16/l31 0 2024-09-17T04:20:49.939 INFO:tasks.workunit.client.1.smithi134.stdout:6/283: write de/f2c [4031204,5420] 0 2024-09-17T04:20:49.939 INFO:tasks.workunit.client.1.smithi134.stdout:3/251: mknod de/d12/d15/d1d/d2d/c57 0 2024-09-17T04:20:49.940 INFO:tasks.workunit.client.1.smithi134.stdout:6/284: write f9 [2378568,113165] 0 2024-09-17T04:20:49.942 INFO:tasks.workunit.client.1.smithi134.stdout:1/191: unlink d12/d1c/f21 0 2024-09-17T04:20:49.945 INFO:tasks.workunit.client.1.smithi134.stdout:6/285: dwrite de/d19/f3d [0,4194304] 0 2024-09-17T04:20:49.945 INFO:tasks.workunit.client.1.smithi134.stdout:0/188: mknod d11/d19/c4a 0 2024-09-17T04:20:49.945 INFO:tasks.workunit.client.1.smithi134.stdout:6/286: readlink de/d19/d1a/d34/l54 0 2024-09-17T04:20:49.958 INFO:tasks.workunit.client.0.smithi088.stdout:7/57: truncate d2/f6 3545914 0 2024-09-17T04:20:49.960 INFO:tasks.workunit.client.0.smithi088.stdout:7/58: write d2/d4/d7/f9 [2592,3549] 0 2024-09-17T04:20:49.967 INFO:tasks.workunit.client.0.smithi088.stdout:7/59: dwrite d2/d4/d7/f10 [0,4194304] 0 2024-09-17T04:20:49.968 INFO:tasks.workunit.client.0.smithi088.stdout:7/60: chown d2/d4/ld 26126406 1 2024-09-17T04:20:49.969 INFO:tasks.workunit.client.1.smithi134.stdout:3/252: stat de/d12/d15/f4d 0 2024-09-17T04:20:49.969 INFO:tasks.workunit.client.0.smithi088.stdout:7/61: read d2/f3 [4469259,95942] 0 2024-09-17T04:20:49.969 INFO:tasks.workunit.client.1.smithi134.stdout:1/192: rmdir d12 39 2024-09-17T04:20:49.970 INFO:tasks.workunit.client.0.smithi088.stdout:7/62: readlink d2/d4/ld 0 2024-09-17T04:20:49.970 INFO:tasks.workunit.client.1.smithi134.stdout:2/233: getdents d19/d27/d31/d49 0 2024-09-17T04:20:49.971 INFO:tasks.workunit.client.0.smithi088.stdout:7/63: dread - d2/d4/ff zero size 2024-09-17T04:20:49.971 INFO:tasks.workunit.client.0.smithi088.stdout:7/64: readlink d2/d4/ld 0 2024-09-17T04:20:49.974 INFO:tasks.workunit.client.1.smithi134.stdout:3/253: readlink l2 0 2024-09-17T04:20:49.975 INFO:tasks.workunit.client.1.smithi134.stdout:0/189: unlink d11/l2c 0 2024-09-17T04:20:49.977 INFO:tasks.workunit.client.0.smithi088.stdout:7/65: unlink d2/d4/ld 0 2024-09-17T04:20:49.977 INFO:tasks.workunit.client.1.smithi134.stdout:6/287: chown fd 356559318 1 2024-09-17T04:20:49.980 INFO:tasks.workunit.client.1.smithi134.stdout:0/190: unlink d11/f15 0 2024-09-17T04:20:49.983 INFO:tasks.workunit.client.1.smithi134.stdout:6/288: mknod de/d19/d1a/d34/c58 0 2024-09-17T04:20:49.984 INFO:tasks.workunit.client.1.smithi134.stdout:5/169: dwrite d0/d6/ff [0,4194304] 0 2024-09-17T04:20:49.984 INFO:tasks.workunit.client.1.smithi134.stdout:2/234: creat d19/d27/d31/f4b x:0 0 0 2024-09-17T04:20:49.985 INFO:tasks.workunit.client.1.smithi134.stdout:1/193: dwrite fd [4194304,4194304] 0 2024-09-17T04:20:49.987 INFO:tasks.workunit.client.1.smithi134.stdout:4/311: dwrite d0/df/d1e/d20/f34 [0,4194304] 0 2024-09-17T04:20:49.989 INFO:tasks.workunit.client.1.smithi134.stdout:6/289: chown de/d19/d1f/f28 598261 1 2024-09-17T04:20:49.993 INFO:tasks.workunit.client.1.smithi134.stdout:3/254: dwrite de/d10/f2e [0,4194304] 0 2024-09-17T04:20:49.995 INFO:tasks.workunit.client.1.smithi134.stdout:0/191: dread d11/d18/f30 [0,4194304] 0 2024-09-17T04:20:49.996 INFO:tasks.workunit.client.1.smithi134.stdout:4/312: mknod d0/df/d17/c64 0 2024-09-17T04:20:49.996 INFO:tasks.workunit.client.1.smithi134.stdout:3/255: stat de/d12/d15/d1d/d2d/d31/f35 0 2024-09-17T04:20:49.996 INFO:tasks.workunit.client.1.smithi134.stdout:6/290: chown de/f3a 10752472 1 2024-09-17T04:20:49.998 INFO:tasks.workunit.client.1.smithi134.stdout:0/192: chown d11/d18/f36 619236840 1 2024-09-17T04:20:49.998 INFO:tasks.workunit.client.1.smithi134.stdout:3/256: write de/d10/f11 [714828,55856] 0 2024-09-17T04:20:49.998 INFO:tasks.workunit.client.1.smithi134.stdout:1/194: dread d12/d1c/f2f [0,4194304] 0 2024-09-17T04:20:50.003 INFO:tasks.workunit.client.1.smithi134.stdout:2/235: creat d19/d27/d31/f4c x:0 0 0 2024-09-17T04:20:50.003 INFO:tasks.workunit.client.1.smithi134.stdout:2/236: chown d19/d27/f32 1685257 1 2024-09-17T04:20:50.008 INFO:tasks.workunit.client.1.smithi134.stdout:0/193: creat d11/d19/d21/d37/f4b x:0 0 0 2024-09-17T04:20:50.008 INFO:tasks.workunit.client.1.smithi134.stdout:1/195: rename c8 to d12/d1c/d2e/c3a 0 2024-09-17T04:20:50.009 INFO:tasks.workunit.client.1.smithi134.stdout:5/170: link d0/f2 d0/da/f36 0 2024-09-17T04:20:50.011 INFO:tasks.workunit.client.1.smithi134.stdout:6/291: symlink de/d19/d21/l59 0 2024-09-17T04:20:50.013 INFO:tasks.workunit.client.1.smithi134.stdout:1/196: creat d12/d1c/d2e/f3b x:0 0 0 2024-09-17T04:20:50.014 INFO:tasks.workunit.client.1.smithi134.stdout:0/194: mkdir d11/d4c 0 2024-09-17T04:20:50.016 INFO:tasks.workunit.client.1.smithi134.stdout:1/197: mknod d12/c3c 0 2024-09-17T04:20:50.017 INFO:tasks.workunit.client.1.smithi134.stdout:5/171: link d0/da/f1e d0/da/d2c/f37 0 2024-09-17T04:20:50.018 INFO:tasks.workunit.client.1.smithi134.stdout:1/198: chown d12/f1b 52213 1 2024-09-17T04:20:50.019 INFO:tasks.workunit.client.1.smithi134.stdout:3/257: dwrite f6 [0,4194304] 0 2024-09-17T04:20:50.020 INFO:tasks.workunit.client.1.smithi134.stdout:1/199: fsync d12/d1c/f34 0 2024-09-17T04:20:50.027 INFO:tasks.workunit.client.1.smithi134.stdout:0/195: dread d11/f13 [0,4194304] 0 2024-09-17T04:20:50.027 INFO:tasks.workunit.client.1.smithi134.stdout:8/179: sync 2024-09-17T04:20:50.027 INFO:tasks.workunit.client.1.smithi134.stdout:7/160: sync 2024-09-17T04:20:50.027 INFO:tasks.workunit.client.1.smithi134.stdout:9/530: sync 2024-09-17T04:20:50.027 INFO:tasks.workunit.client.1.smithi134.stdout:3/258: symlink de/d12/d22/l58 0 2024-09-17T04:20:50.028 INFO:tasks.workunit.client.1.smithi134.stdout:5/172: write d0/d6/f17 [1281286,21520] 0 2024-09-17T04:20:50.031 INFO:tasks.workunit.client.1.smithi134.stdout:7/161: mkdir d0/d32 0 2024-09-17T04:20:50.033 INFO:tasks.workunit.client.1.smithi134.stdout:8/180: dread - d4/db/dd/f30 zero size 2024-09-17T04:20:50.033 INFO:tasks.workunit.client.1.smithi134.stdout:4/313: dwrite d0/df/d1e/f25 [0,4194304] 0 2024-09-17T04:20:50.045 INFO:tasks.workunit.client.1.smithi134.stdout:8/181: stat d4/f10 0 2024-09-17T04:20:50.045 INFO:tasks.workunit.client.1.smithi134.stdout:3/259: symlink de/d12/d15/d1d/l59 0 2024-09-17T04:20:50.047 INFO:tasks.workunit.client.1.smithi134.stdout:2/237: dwrite d19/f22 [4194304,4194304] 0 2024-09-17T04:20:50.047 INFO:tasks.workunit.client.1.smithi134.stdout:5/173: mknod d0/da/d29/c38 0 2024-09-17T04:20:50.048 INFO:tasks.workunit.client.1.smithi134.stdout:7/162: creat d0/f33 x:0 0 0 2024-09-17T04:20:50.050 INFO:tasks.workunit.client.1.smithi134.stdout:1/200: dwrite d12/d1c/f24 [4194304,4194304] 0 2024-09-17T04:20:50.052 INFO:tasks.workunit.client.1.smithi134.stdout:8/182: chown d4/d1f/d2b 398 1 2024-09-17T04:20:50.054 INFO:tasks.workunit.client.1.smithi134.stdout:2/238: read f16 [366780,95319] 0 2024-09-17T04:20:50.057 INFO:tasks.workunit.client.1.smithi134.stdout:0/196: dwrite d11/d18/f23 [0,4194304] 0 2024-09-17T04:20:50.058 INFO:tasks.workunit.client.1.smithi134.stdout:2/239: dread - d19/d27/f38 zero size 2024-09-17T04:20:50.059 INFO:tasks.workunit.client.1.smithi134.stdout:5/174: creat d0/f39 x:0 0 0 2024-09-17T04:20:50.060 INFO:tasks.workunit.client.1.smithi134.stdout:7/163: creat d0/dd/f34 x:0 0 0 2024-09-17T04:20:50.061 INFO:tasks.workunit.client.1.smithi134.stdout:0/197: readlink d11/d18/l34 0 2024-09-17T04:20:50.062 INFO:tasks.workunit.client.1.smithi134.stdout:6/292: dread de/f12 [0,4194304] 0 2024-09-17T04:20:50.064 INFO:tasks.workunit.client.1.smithi134.stdout:7/164: fdatasync d0/f20 0 2024-09-17T04:20:50.064 INFO:tasks.workunit.client.1.smithi134.stdout:1/201: creat d12/d19/f3d x:0 0 0 2024-09-17T04:20:50.068 INFO:tasks.workunit.client.1.smithi134.stdout:0/198: mknod d11/d19/c4d 0 2024-09-17T04:20:50.069 INFO:tasks.workunit.client.1.smithi134.stdout:7/165: unlink d0/l2e 0 2024-09-17T04:20:50.069 INFO:tasks.workunit.client.1.smithi134.stdout:3/260: dwrite de/d12/d15/f1f [0,4194304] 0 2024-09-17T04:20:50.070 INFO:tasks.workunit.client.1.smithi134.stdout:6/293: mknod de/d19/d1a/d34/d3b/c5a 0 2024-09-17T04:20:50.071 INFO:tasks.workunit.client.1.smithi134.stdout:0/199: write d11/d19/d21/f27 [3676344,125648] 0 2024-09-17T04:20:50.072 INFO:tasks.workunit.client.1.smithi134.stdout:5/175: rename d0/d6 to d0/d3a 0 2024-09-17T04:20:50.073 INFO:tasks.workunit.client.1.smithi134.stdout:1/202: mkdir d12/d19/d1d/d3e 0 2024-09-17T04:20:50.073 INFO:tasks.workunit.client.1.smithi134.stdout:0/200: dread - d11/d22/f3a zero size 2024-09-17T04:20:50.077 INFO:tasks.workunit.client.1.smithi134.stdout:2/240: rmdir d19/d1c/d3a 0 2024-09-17T04:20:50.077 INFO:tasks.workunit.client.1.smithi134.stdout:6/294: creat de/d19/d21/d2d/f5b x:0 0 0 2024-09-17T04:20:50.077 INFO:tasks.workunit.client.1.smithi134.stdout:5/176: creat d0/d3a/f3b x:0 0 0 2024-09-17T04:20:50.078 INFO:tasks.workunit.client.1.smithi134.stdout:0/201: symlink d11/d22/l4e 0 2024-09-17T04:20:50.081 INFO:tasks.workunit.client.1.smithi134.stdout:6/295: chown de/f53 7106 1 2024-09-17T04:20:50.081 INFO:tasks.workunit.client.1.smithi134.stdout:1/203: mknod d12/d19/d1d/d3e/c3f 0 2024-09-17T04:20:50.082 INFO:tasks.workunit.client.1.smithi134.stdout:2/241: chown d19/f35 1300 1 2024-09-17T04:20:50.084 INFO:tasks.workunit.client.1.smithi134.stdout:5/177: write d0/d3a/f17 [1506396,68715] 0 2024-09-17T04:20:50.084 INFO:tasks.workunit.client.1.smithi134.stdout:2/242: fdatasync d19/f35 0 2024-09-17T04:20:50.086 INFO:tasks.workunit.client.1.smithi134.stdout:3/261: dread de/d10/f2e [0,4194304] 0 2024-09-17T04:20:50.087 INFO:tasks.workunit.client.1.smithi134.stdout:1/204: dread - d12/d19/d1d/f27 zero size 2024-09-17T04:20:50.088 INFO:tasks.workunit.client.1.smithi134.stdout:6/296: mkdir de/d19/d1f/d5c 0 2024-09-17T04:20:50.095 INFO:tasks.workunit.client.1.smithi134.stdout:0/202: read d11/d24/f47 [1531379,43815] 0 2024-09-17T04:20:50.095 INFO:tasks.workunit.client.1.smithi134.stdout:3/262: mkdir de/d12/d22/d5a 0 2024-09-17T04:20:50.095 INFO:tasks.workunit.client.1.smithi134.stdout:7/166: dwrite d0/dd/d11/f1d [0,4194304] 0 2024-09-17T04:20:50.095 INFO:tasks.workunit.client.1.smithi134.stdout:4/314: dread d0/df/f16 [0,4194304] 0 2024-09-17T04:20:50.095 INFO:tasks.workunit.client.1.smithi134.stdout:1/205: symlink d12/d19/d1d/d3e/l40 0 2024-09-17T04:20:50.095 INFO:tasks.workunit.client.1.smithi134.stdout:3/263: mknod de/d10/d3d/c5b 0 2024-09-17T04:20:50.095 INFO:tasks.workunit.client.1.smithi134.stdout:7/167: mkdir d0/d16/d35 0 2024-09-17T04:20:50.096 INFO:tasks.workunit.client.1.smithi134.stdout:5/178: creat d0/f3c x:0 0 0 2024-09-17T04:20:50.097 INFO:tasks.workunit.client.1.smithi134.stdout:2/243: dread d19/f22 [0,4194304] 0 2024-09-17T04:20:50.098 INFO:tasks.workunit.client.1.smithi134.stdout:6/297: getdents de/d2b 0 2024-09-17T04:20:50.098 INFO:tasks.workunit.client.1.smithi134.stdout:1/206: symlink d12/d19/l41 0 2024-09-17T04:20:50.098 INFO:tasks.workunit.client.1.smithi134.stdout:2/244: fsync d19/d27/d31/f4b 0 2024-09-17T04:20:50.100 INFO:tasks.workunit.client.1.smithi134.stdout:4/315: getdents d0/df/d35 0 2024-09-17T04:20:50.100 INFO:tasks.workunit.client.1.smithi134.stdout:6/298: mkdir de/d5d 0 2024-09-17T04:20:50.101 INFO:tasks.workunit.client.1.smithi134.stdout:4/316: fsync d0/df/d1e/d20/f4a 0 2024-09-17T04:20:50.102 INFO:tasks.workunit.client.1.smithi134.stdout:3/264: rename de/d10/f11 to de/d10/d3d/d4f/f5c 0 2024-09-17T04:20:50.103 INFO:tasks.workunit.client.1.smithi134.stdout:6/299: write de/d19/d1f/f28 [411557,85748] 0 2024-09-17T04:20:50.104 INFO:tasks.workunit.client.1.smithi134.stdout:1/207: creat d12/f42 x:0 0 0 2024-09-17T04:20:50.105 INFO:tasks.workunit.client.1.smithi134.stdout:3/265: write de/d10/d3d/f43 [1554215,103375] 0 2024-09-17T04:20:50.105 INFO:tasks.workunit.client.1.smithi134.stdout:2/245: symlink d19/d27/d31/l4d 0 2024-09-17T04:20:50.107 INFO:tasks.workunit.client.1.smithi134.stdout:1/208: mknod d12/d36/c43 0 2024-09-17T04:20:50.107 INFO:tasks.workunit.client.1.smithi134.stdout:6/300: read de/d19/f22 [30402,116749] 0 2024-09-17T04:20:50.108 INFO:tasks.workunit.client.1.smithi134.stdout:3/266: write de/d12/d15/d1d/d2d/f53 [477164,43572] 0 2024-09-17T04:20:50.109 INFO:tasks.workunit.client.1.smithi134.stdout:2/246: symlink d19/d1c/d47/l4e 0 2024-09-17T04:20:50.109 INFO:tasks.workunit.client.1.smithi134.stdout:1/209: chown d12/d19/d1d/c2d 3 1 2024-09-17T04:20:50.110 INFO:tasks.workunit.client.1.smithi134.stdout:2/247: chown d19/d27 29 1 2024-09-17T04:20:50.111 INFO:tasks.workunit.client.1.smithi134.stdout:6/301: dread - de/d19/d1f/f57 zero size 2024-09-17T04:20:50.113 INFO:tasks.workunit.client.1.smithi134.stdout:1/210: creat d12/d19/d1d/f44 x:0 0 0 2024-09-17T04:20:50.113 INFO:tasks.workunit.client.1.smithi134.stdout:5/179: write d0/da/f1e [685803,83818] 0 2024-09-17T04:20:50.114 INFO:tasks.workunit.client.1.smithi134.stdout:1/211: chown d12/d19/f25 133 1 2024-09-17T04:20:50.114 INFO:tasks.workunit.client.1.smithi134.stdout:5/180: chown d0/f8 3390729 1 2024-09-17T04:20:50.114 INFO:tasks.workunit.client.1.smithi134.stdout:1/212: stat d12/d1c/d2e/c37 0 2024-09-17T04:20:50.116 INFO:tasks.workunit.client.1.smithi134.stdout:1/213: chown d12/d1c/c1f 8116 1 2024-09-17T04:20:50.116 INFO:tasks.workunit.client.1.smithi134.stdout:6/302: mknod de/d19/d1f/d55/c5e 0 2024-09-17T04:20:50.117 INFO:tasks.workunit.client.1.smithi134.stdout:5/181: symlink d0/d3a/l3d 0 2024-09-17T04:20:50.118 INFO:tasks.workunit.client.1.smithi134.stdout:2/248: rename d19/d27/l3d to d19/d27/d31/l4f 0 2024-09-17T04:20:50.120 INFO:tasks.workunit.client.1.smithi134.stdout:6/303: write de/d19/f22 [64860,124753] 0 2024-09-17T04:20:50.120 INFO:tasks.workunit.client.1.smithi134.stdout:2/249: write f12 [1624393,48265] 0 2024-09-17T04:20:50.123 INFO:tasks.workunit.client.1.smithi134.stdout:5/182: symlink d0/da/d2c/l3e 0 2024-09-17T04:20:50.125 INFO:tasks.workunit.client.1.smithi134.stdout:5/183: chown d0/l20 0 1 2024-09-17T04:20:50.126 INFO:tasks.workunit.client.1.smithi134.stdout:1/214: dwrite d12/d19/f30 [4194304,4194304] 0 2024-09-17T04:20:50.127 INFO:tasks.workunit.client.1.smithi134.stdout:2/250: write fc [4692802,38206] 0 2024-09-17T04:20:50.127 INFO:tasks.workunit.client.1.smithi134.stdout:5/184: stat d0/da/d29 0 2024-09-17T04:20:50.129 INFO:tasks.workunit.client.1.smithi134.stdout:6/304: link de/l32 de/d19/d1a/d34/d3b/l5f 0 2024-09-17T04:20:50.131 INFO:tasks.workunit.client.1.smithi134.stdout:3/267: dwrite de/f2a [4194304,4194304] 0 2024-09-17T04:20:50.131 INFO:tasks.workunit.client.1.smithi134.stdout:1/215: symlink d12/d1c/l45 0 2024-09-17T04:20:50.131 INFO:tasks.workunit.client.1.smithi134.stdout:4/317: dread d0/d13/f14 [0,4194304] 0 2024-09-17T04:20:50.133 INFO:tasks.workunit.client.1.smithi134.stdout:2/251: mkdir d19/d1c/d47/d50 0 2024-09-17T04:20:50.133 INFO:tasks.workunit.client.1.smithi134.stdout:5/185: creat d0/d3a/f3f x:0 0 0 2024-09-17T04:20:50.133 INFO:tasks.workunit.client.1.smithi134.stdout:1/216: dread - d12/d19/d1d/f27 zero size 2024-09-17T04:20:50.137 INFO:tasks.workunit.client.1.smithi134.stdout:4/318: mkdir d0/df/d1e/d20/d65 0 2024-09-17T04:20:50.140 INFO:tasks.workunit.client.1.smithi134.stdout:5/186: unlink d0/d3a/f1f 0 2024-09-17T04:20:50.141 INFO:tasks.workunit.client.1.smithi134.stdout:2/252: rename d19/d27/d31/f4b to d19/d27/f51 0 2024-09-17T04:20:50.143 INFO:tasks.workunit.client.1.smithi134.stdout:6/305: dwrite de/d2b/f45 [0,4194304] 0 2024-09-17T04:20:50.146 INFO:tasks.workunit.client.1.smithi134.stdout:2/253: fsync f16 0 2024-09-17T04:20:50.149 INFO:tasks.workunit.client.1.smithi134.stdout:3/268: truncate de/f2a 3800426 0 2024-09-17T04:20:50.149 INFO:tasks.workunit.client.1.smithi134.stdout:6/306: dread fd [0,4194304] 0 2024-09-17T04:20:50.151 INFO:tasks.workunit.client.1.smithi134.stdout:2/254: fdatasync f1 0 2024-09-17T04:20:50.153 INFO:tasks.workunit.client.1.smithi134.stdout:1/217: dwrite d12/d19/d1d/f27 [0,4194304] 0 2024-09-17T04:20:50.155 INFO:tasks.workunit.client.1.smithi134.stdout:3/269: chown de/d10/d3d/l45 85 1 2024-09-17T04:20:50.156 INFO:tasks.workunit.client.1.smithi134.stdout:5/187: dread d0/f2a [0,4194304] 0 2024-09-17T04:20:50.157 INFO:tasks.workunit.client.1.smithi134.stdout:2/255: creat d19/d1c/f52 x:0 0 0 2024-09-17T04:20:50.160 INFO:tasks.workunit.client.1.smithi134.stdout:1/218: creat d12/d1c/d2e/f46 x:0 0 0 2024-09-17T04:20:50.164 INFO:tasks.workunit.client.1.smithi134.stdout:2/256: readlink d19/l1e 0 2024-09-17T04:20:50.165 INFO:tasks.workunit.client.1.smithi134.stdout:6/307: dwrite de/d2b/f43 [0,4194304] 0 2024-09-17T04:20:50.169 INFO:tasks.workunit.client.1.smithi134.stdout:1/219: truncate d12/d1c/f34 318985 0 2024-09-17T04:20:50.170 INFO:tasks.workunit.client.1.smithi134.stdout:2/257: mknod d19/d27/d31/d49/c53 0 2024-09-17T04:20:50.171 INFO:tasks.workunit.client.1.smithi134.stdout:1/220: chown d12/l2c 14632846 1 2024-09-17T04:20:50.172 INFO:tasks.workunit.client.1.smithi134.stdout:2/258: fsync d19/d1c/f52 0 2024-09-17T04:20:50.174 INFO:tasks.workunit.client.1.smithi134.stdout:3/270: dwrite de/d10/f30 [0,4194304] 0 2024-09-17T04:20:50.175 INFO:tasks.workunit.client.1.smithi134.stdout:9/531: sync 2024-09-17T04:20:50.176 INFO:tasks.workunit.client.1.smithi134.stdout:1/221: dread - d12/d1c/d2e/f3b zero size 2024-09-17T04:20:50.176 INFO:tasks.workunit.client.1.smithi134.stdout:2/259: rmdir d19/d27 39 2024-09-17T04:20:50.177 INFO:tasks.workunit.client.1.smithi134.stdout:5/188: dwrite d0/f8 [0,4194304] 0 2024-09-17T04:20:50.177 INFO:tasks.workunit.client.1.smithi134.stdout:4/319: dread d0/df/d1e/d20/f26 [0,4194304] 0 2024-09-17T04:20:50.179 INFO:tasks.workunit.client.1.smithi134.stdout:1/222: unlink c11 0 2024-09-17T04:20:50.182 INFO:tasks.workunit.client.1.smithi134.stdout:4/320: read d0/df/f16 [4125914,56141] 0 2024-09-17T04:20:50.183 INFO:tasks.workunit.client.1.smithi134.stdout:5/189: mknod d0/da/d2c/c40 0 2024-09-17T04:20:50.183 INFO:tasks.workunit.client.1.smithi134.stdout:6/308: dwrite de/d19/f3d [0,4194304] 0 2024-09-17T04:20:50.190 INFO:tasks.workunit.client.1.smithi134.stdout:1/223: mknod d12/d19/d1d/c47 0 2024-09-17T04:20:50.190 INFO:tasks.workunit.client.1.smithi134.stdout:4/321: creat d0/d13/d40/d42/f66 x:0 0 0 2024-09-17T04:20:50.193 INFO:tasks.workunit.client.1.smithi134.stdout:2/260: write f1 [2916035,123526] 0 2024-09-17T04:20:50.195 INFO:tasks.workunit.client.1.smithi134.stdout:6/309: rename de/d19/d1f/f2a to de/d19/d1f/f60 0 2024-09-17T04:20:50.200 INFO:tasks.workunit.client.1.smithi134.stdout:3/271: dwrite de/d12/d15/d1d/d2d/d31/f3e [0,4194304] 0 2024-09-17T04:20:50.205 INFO:tasks.workunit.client.1.smithi134.stdout:1/224: creat d12/d19/d1d/d3e/f48 x:0 0 0 2024-09-17T04:20:50.205 INFO:tasks.workunit.client.1.smithi134.stdout:9/532: dwrite d2/d5/d9/df/f48 [0,4194304] 0 2024-09-17T04:20:50.209 INFO:tasks.workunit.client.1.smithi134.stdout:5/190: dwrite d0/f39 [0,4194304] 0 2024-09-17T04:20:50.209 INFO:tasks.workunit.client.1.smithi134.stdout:6/310: rename de/d19/d21/f23 to de/d19/f61 0 2024-09-17T04:20:50.277 INFO:tasks.workunit.client.1.smithi134.stdout:6/311: write de/d19/f24 [2642231,14490] 0 2024-09-17T04:20:50.279 INFO:tasks.workunit.client.1.smithi134.stdout:5/191: write d0/d3a/f3b [930448,125440] 0 2024-09-17T04:20:50.280 INFO:tasks.workunit.client.1.smithi134.stdout:2/261: rename d19/d27/f2b to d19/d27/d31/d34/d42/f54 0 2024-09-17T04:20:50.283 INFO:tasks.workunit.client.1.smithi134.stdout:4/322: dwrite d0/df/d1e/d20/f45 [0,4194304] 0 2024-09-17T04:20:50.284 INFO:tasks.workunit.client.1.smithi134.stdout:3/272: dwrite de/d12/f47 [0,4194304] 0 2024-09-17T04:20:50.287 INFO:tasks.workunit.client.1.smithi134.stdout:5/192: getdents d0/da 0 2024-09-17T04:20:50.291 INFO:tasks.workunit.client.1.smithi134.stdout:3/273: chown de/l50 0 1 2024-09-17T04:20:50.294 INFO:tasks.workunit.client.1.smithi134.stdout:4/323: symlink d0/df/d35/d5c/l67 0 2024-09-17T04:20:50.299 INFO:tasks.workunit.client.1.smithi134.stdout:3/274: write de/d12/d22/f46 [1102109,105000] 0 2024-09-17T04:20:50.299 INFO:tasks.workunit.client.1.smithi134.stdout:9/533: dwrite d2/d5/d8/d16/d54/daf/d6d/daa/fad [0,4194304] 0 2024-09-17T04:20:50.300 INFO:tasks.workunit.client.1.smithi134.stdout:6/312: dwrite de/f2c [0,4194304] 0 2024-09-17T04:20:50.302 INFO:tasks.workunit.client.1.smithi134.stdout:9/534: dread d2/d5/d37/fa3 [0,4194304] 0 2024-09-17T04:20:50.302 INFO:tasks.workunit.client.1.smithi134.stdout:2/262: dwrite d19/d1c/f1d [0,4194304] 0 2024-09-17T04:20:50.307 INFO:tasks.workunit.client.1.smithi134.stdout:9/535: creat d2/d7/d75/fb0 x:0 0 0 2024-09-17T04:20:50.309 INFO:tasks.workunit.client.1.smithi134.stdout:8/183: sync 2024-09-17T04:20:50.309 INFO:tasks.workunit.client.1.smithi134.stdout:2/263: symlink d19/d1c/d47/l55 0 2024-09-17T04:20:50.311 INFO:tasks.workunit.client.1.smithi134.stdout:3/275: dwrite de/f3b [4194304,4194304] 0 2024-09-17T04:20:50.313 INFO:tasks.workunit.client.1.smithi134.stdout:9/536: mknod d2/d5/d8/cb1 0 2024-09-17T04:20:50.313 INFO:tasks.workunit.client.1.smithi134.stdout:5/193: write d0/da/f36 [1744104,30313] 0 2024-09-17T04:20:50.315 INFO:tasks.workunit.client.1.smithi134.stdout:6/313: truncate de/d19/d1a/d34/f42 1552288 0 2024-09-17T04:20:50.317 INFO:tasks.workunit.client.1.smithi134.stdout:8/184: creat d4/d1f/f33 x:0 0 0 2024-09-17T04:20:50.318 INFO:tasks.workunit.client.1.smithi134.stdout:2/264: symlink d19/l56 0 2024-09-17T04:20:50.319 INFO:tasks.workunit.client.1.smithi134.stdout:8/185: readlink d4/d23/l29 0 2024-09-17T04:20:50.321 INFO:tasks.workunit.client.1.smithi134.stdout:5/194: mkdir d0/da/d12/d41 0 2024-09-17T04:20:50.321 INFO:tasks.workunit.client.1.smithi134.stdout:9/537: creat d2/d7/d75/d96/fb2 x:0 0 0 2024-09-17T04:20:50.321 INFO:tasks.workunit.client.1.smithi134.stdout:2/265: write d19/d1c/f30 [305527,60408] 0 2024-09-17T04:20:50.327 INFO:tasks.workunit.client.1.smithi134.stdout:5/195: stat d0/d3a/ff 0 2024-09-17T04:20:50.327 INFO:tasks.workunit.client.1.smithi134.stdout:3/276: dwrite de/d12/d15/d1d/d2d/d31/f55 [0,4194304] 0 2024-09-17T04:20:50.330 INFO:tasks.workunit.client.1.smithi134.stdout:6/314: dwrite de/f13 [0,4194304] 0 2024-09-17T04:20:50.331 INFO:tasks.workunit.client.1.smithi134.stdout:9/538: mknod d2/d5/d37/d83/cb3 0 2024-09-17T04:20:50.333 INFO:tasks.workunit.client.1.smithi134.stdout:3/277: write de/d12/d15/f1f [3009726,93913] 0 2024-09-17T04:20:50.334 INFO:tasks.workunit.client.1.smithi134.stdout:2/266: creat d19/d27/d31/d49/f57 x:0 0 0 2024-09-17T04:20:50.337 INFO:tasks.workunit.client.1.smithi134.stdout:8/186: link d4/l5 d4/d11/l34 0 2024-09-17T04:20:50.338 INFO:tasks.workunit.client.1.smithi134.stdout:8/187: readlink d4/d11/l28 0 2024-09-17T04:20:50.342 INFO:tasks.workunit.client.1.smithi134.stdout:9/539: creat d2/d5/d8/d1e/d42/fb4 x:0 0 0 2024-09-17T04:20:50.343 INFO:tasks.workunit.client.1.smithi134.stdout:5/196: symlink d0/da/d12/l42 0 2024-09-17T04:20:50.344 INFO:tasks.workunit.client.1.smithi134.stdout:9/540: write d2/d5/d8/d16/fd [6469468,64766] 0 2024-09-17T04:20:50.344 INFO:tasks.workunit.client.1.smithi134.stdout:2/267: dwrite d19/d1c/f1d [0,4194304] 0 2024-09-17T04:20:50.345 INFO:tasks.workunit.client.1.smithi134.stdout:5/197: chown d0/f8 1 1 2024-09-17T04:20:50.349 INFO:tasks.workunit.client.1.smithi134.stdout:8/188: creat d4/db/df/f35 x:0 0 0 2024-09-17T04:20:50.351 INFO:tasks.workunit.client.1.smithi134.stdout:0/203: sync 2024-09-17T04:20:50.351 INFO:tasks.workunit.client.1.smithi134.stdout:7/168: sync 2024-09-17T04:20:50.354 INFO:tasks.workunit.client.1.smithi134.stdout:4/324: dread d0/d13/d40/d42/f4f [0,4194304] 0 2024-09-17T04:20:50.354 INFO:tasks.workunit.client.1.smithi134.stdout:5/198: dread d0/da/d2c/f37 [0,4194304] 0 2024-09-17T04:20:50.354 INFO:tasks.workunit.client.1.smithi134.stdout:7/169: write d0/d16/f26 [4788016,112424] 0 2024-09-17T04:20:50.356 INFO:tasks.workunit.client.1.smithi134.stdout:3/278: creat de/d12/d22/d5a/f5d x:0 0 0 2024-09-17T04:20:50.357 INFO:tasks.workunit.client.1.smithi134.stdout:2/268: dwrite d19/d27/d31/d34/f45 [0,4194304] 0 2024-09-17T04:20:50.358 INFO:tasks.workunit.client.1.smithi134.stdout:9/541: mkdir d2/d5/d58/db5 0 2024-09-17T04:20:50.360 INFO:tasks.workunit.client.1.smithi134.stdout:8/189: unlink d4/d11/l28 0 2024-09-17T04:20:50.361 INFO:tasks.workunit.client.1.smithi134.stdout:6/315: rename de/d19/d1a to de/d19/d62 0 2024-09-17T04:20:50.364 INFO:tasks.workunit.client.1.smithi134.stdout:4/325: mknod d0/df/d35/d39/c68 0 2024-09-17T04:20:50.367 INFO:tasks.workunit.client.1.smithi134.stdout:2/269: write d19/d27/f51 [959644,69924] 0 2024-09-17T04:20:50.368 INFO:tasks.workunit.client.1.smithi134.stdout:3/279: truncate de/d12/d15/f4d 996996 0 2024-09-17T04:20:50.368 INFO:tasks.workunit.client.1.smithi134.stdout:6/316: dread de/d19/d21/d2d/f2f [0,4194304] 0 2024-09-17T04:20:50.369 INFO:tasks.workunit.client.1.smithi134.stdout:9/542: symlink d2/d5/d8/d16/d54/daf/d6d/d84/lb6 0 2024-09-17T04:20:50.370 INFO:tasks.workunit.client.1.smithi134.stdout:2/270: read d19/d1c/f23 [2897437,66281] 0 2024-09-17T04:20:50.372 INFO:tasks.workunit.client.1.smithi134.stdout:9/543: truncate d2/d5/d9/df/f48 4647093 0 2024-09-17T04:20:50.375 INFO:tasks.workunit.client.1.smithi134.stdout:7/170: mkdir d0/d16/d35/d36 0 2024-09-17T04:20:50.378 INFO:tasks.workunit.client.1.smithi134.stdout:5/199: link d0/da/f1e d0/d3a/d2b/f43 0 2024-09-17T04:20:50.378 INFO:tasks.workunit.client.1.smithi134.stdout:5/200: fsync d0/f8 0 2024-09-17T04:20:50.381 INFO:tasks.workunit.client.1.smithi134.stdout:3/280: rename de/d10/l49 to de/d10/d3d/l5e 0 2024-09-17T04:20:50.381 INFO:tasks.workunit.client.1.smithi134.stdout:3/281: stat de/d10/d3d/f43 0 2024-09-17T04:20:50.382 INFO:tasks.workunit.client.1.smithi134.stdout:3/282: read de/d12/d15/f4b [309247,83552] 0 2024-09-17T04:20:50.382 INFO:tasks.workunit.client.1.smithi134.stdout:6/317: creat de/d19/d1f/d55/f63 x:0 0 0 2024-09-17T04:20:50.383 INFO:tasks.workunit.client.1.smithi134.stdout:0/204: creat d11/f4f x:0 0 0 2024-09-17T04:20:50.399 INFO:tasks.workunit.client.1.smithi134.stdout:9/544: mknod d2/d5/d8/d1e/cb7 0 2024-09-17T04:20:50.399 INFO:tasks.workunit.client.1.smithi134.stdout:9/545: chown d2/d5/f68 43716 1 2024-09-17T04:20:50.400 INFO:tasks.workunit.client.1.smithi134.stdout:1/225: sync 2024-09-17T04:20:50.409 INFO:tasks.workunit.client.1.smithi134.stdout:5/201: creat d0/d3a/d2b/f44 x:0 0 0 2024-09-17T04:20:50.411 INFO:tasks.workunit.client.1.smithi134.stdout:3/283: fdatasync de/f2a 0 2024-09-17T04:20:50.412 INFO:tasks.workunit.client.1.smithi134.stdout:0/205: symlink d11/d19/d21/l50 0 2024-09-17T04:20:50.418 INFO:tasks.workunit.client.1.smithi134.stdout:9/546: dwrite d2/d5/d8/d1e/d42/fb4 [0,4194304] 0 2024-09-17T04:20:50.420 INFO:tasks.workunit.client.1.smithi134.stdout:8/190: dwrite d4/f26 [0,4194304] 0 2024-09-17T04:20:50.422 INFO:tasks.workunit.client.1.smithi134.stdout:7/171: dwrite d0/f6 [0,4194304] 0 2024-09-17T04:20:50.422 INFO:tasks.workunit.client.1.smithi134.stdout:1/226: unlink d12/f17 0 2024-09-17T04:20:50.427 INFO:tasks.workunit.client.1.smithi134.stdout:1/227: write d12/d19/d1d/d3e/f48 [434153,47867] 0 2024-09-17T04:20:50.432 INFO:tasks.workunit.client.1.smithi134.stdout:7/172: dwrite d0/dd/fb [0,4194304] 0 2024-09-17T04:20:50.433 INFO:tasks.workunit.client.1.smithi134.stdout:5/202: creat d0/d3a/d2b/f45 x:0 0 0 2024-09-17T04:20:50.435 INFO:tasks.workunit.client.1.smithi134.stdout:3/284: creat de/d10/f5f x:0 0 0 2024-09-17T04:20:50.440 INFO:tasks.workunit.client.1.smithi134.stdout:4/326: getdents d0/d13/d40/d42 0 2024-09-17T04:20:50.444 INFO:tasks.workunit.client.1.smithi134.stdout:7/173: symlink d0/d16/l37 0 2024-09-17T04:20:50.446 INFO:tasks.workunit.client.1.smithi134.stdout:5/203: creat d0/da/f46 x:0 0 0 2024-09-17T04:20:50.450 INFO:tasks.workunit.client.1.smithi134.stdout:3/285: write de/d10/d3d/d4f/f5c [2607644,68844] 0 2024-09-17T04:20:50.451 INFO:tasks.workunit.client.1.smithi134.stdout:4/327: write d0/d13/f33 [6996981,88663] 0 2024-09-17T04:20:50.453 INFO:tasks.workunit.client.1.smithi134.stdout:5/204: dread d0/f2a [0,4194304] 0 2024-09-17T04:20:50.455 INFO:tasks.workunit.client.1.smithi134.stdout:5/205: write d0/f39 [3033354,43565] 0 2024-09-17T04:20:50.455 INFO:tasks.workunit.client.1.smithi134.stdout:7/174: rename d0/dd/d11 to d0/d32/d38 0 2024-09-17T04:20:50.460 INFO:tasks.workunit.client.1.smithi134.stdout:3/286: read de/d12/d15/f4d [126543,123936] 0 2024-09-17T04:20:50.460 INFO:tasks.workunit.client.1.smithi134.stdout:9/547: creat d2/d5/d9/df/fb8 x:0 0 0 2024-09-17T04:20:50.461 INFO:tasks.workunit.client.1.smithi134.stdout:4/328: dwrite d0/df/d1e/f44 [0,4194304] 0 2024-09-17T04:20:50.463 INFO:tasks.workunit.client.1.smithi134.stdout:8/191: getdents d4/d1f 0 2024-09-17T04:20:50.463 INFO:tasks.workunit.client.1.smithi134.stdout:9/548: write d2/d5/d8/d16/d54/daf/f95 [444228,121587] 0 2024-09-17T04:20:50.465 INFO:tasks.workunit.client.1.smithi134.stdout:9/549: fdatasync d2/d7/f4f 0 2024-09-17T04:20:50.466 INFO:tasks.workunit.client.1.smithi134.stdout:9/550: fdatasync d2/d5/d9/f2e 0 2024-09-17T04:20:50.466 INFO:tasks.workunit.client.1.smithi134.stdout:3/287: mknod de/d12/d22/d5a/c60 0 2024-09-17T04:20:50.468 INFO:tasks.workunit.client.1.smithi134.stdout:4/329: dwrite d0/d13/f3c [0,4194304] 0 2024-09-17T04:20:50.471 INFO:tasks.workunit.client.1.smithi134.stdout:8/192: creat d4/f36 x:0 0 0 2024-09-17T04:20:50.475 INFO:tasks.workunit.client.1.smithi134.stdout:9/551: unlink d2/d78/ca2 0 2024-09-17T04:20:50.478 INFO:tasks.workunit.client.1.smithi134.stdout:3/288: write de/d12/d15/f4b [362614,70263] 0 2024-09-17T04:20:50.479 INFO:tasks.workunit.client.1.smithi134.stdout:3/289: write de/d12/f3a [1678682,14608] 0 2024-09-17T04:20:50.480 INFO:tasks.workunit.client.1.smithi134.stdout:3/290: dread - de/d12/d15/d1d/f37 zero size 2024-09-17T04:20:50.481 INFO:tasks.workunit.client.1.smithi134.stdout:4/330: write d0/d13/f14 [1343270,43062] 0 2024-09-17T04:20:50.485 INFO:tasks.workunit.client.1.smithi134.stdout:8/193: rename d4/l32 to d4/d23/l37 0 2024-09-17T04:20:50.486 INFO:tasks.workunit.client.1.smithi134.stdout:8/194: stat d4/f26 0 2024-09-17T04:20:50.487 INFO:tasks.workunit.client.1.smithi134.stdout:8/195: write d4/db/fc [23868,76423] 0 2024-09-17T04:20:50.491 INFO:tasks.workunit.client.1.smithi134.stdout:2/271: truncate d19/d27/d31/d34/f45 1592533 0 2024-09-17T04:20:50.494 INFO:tasks.workunit.client.1.smithi134.stdout:8/196: mknod d4/d23/c38 0 2024-09-17T04:20:50.497 INFO:tasks.workunit.client.1.smithi134.stdout:3/291: creat de/d12/d15/d1d/f61 x:0 0 0 2024-09-17T04:20:50.498 INFO:tasks.workunit.client.1.smithi134.stdout:3/292: write de/d12/d15/d1d/f54 [864644,27576] 0 2024-09-17T04:20:50.499 INFO:tasks.workunit.client.1.smithi134.stdout:8/197: mknod d4/db/dd/c39 0 2024-09-17T04:20:50.499 INFO:tasks.workunit.client.1.smithi134.stdout:8/198: read - d4/db/df/f35 zero size 2024-09-17T04:20:50.500 INFO:tasks.workunit.client.1.smithi134.stdout:2/272: symlink d19/d1c/d47/d50/l58 0 2024-09-17T04:20:50.502 INFO:tasks.workunit.client.1.smithi134.stdout:3/293: write de/d12/f48 [259029,110409] 0 2024-09-17T04:20:50.504 INFO:tasks.workunit.client.1.smithi134.stdout:8/199: creat d4/d1f/f3a x:0 0 0 2024-09-17T04:20:50.507 INFO:tasks.workunit.client.1.smithi134.stdout:2/273: dwrite d19/d27/d31/f4c [0,4194304] 0 2024-09-17T04:20:50.508 INFO:tasks.workunit.client.1.smithi134.stdout:8/200: creat d4/db/dd/f3b x:0 0 0 2024-09-17T04:20:50.509 INFO:tasks.workunit.client.1.smithi134.stdout:2/274: chown d19/d27/d31/d49/f57 112966418 1 2024-09-17T04:20:50.511 INFO:tasks.workunit.client.1.smithi134.stdout:8/201: symlink d4/d1e/l3c 0 2024-09-17T04:20:50.512 INFO:tasks.workunit.client.1.smithi134.stdout:5/206: chown d0/da/c24 1 1 2024-09-17T04:20:50.514 INFO:tasks.workunit.client.1.smithi134.stdout:3/294: creat de/d12/d15/d1d/f62 x:0 0 0 2024-09-17T04:20:50.516 INFO:tasks.workunit.client.1.smithi134.stdout:2/275: unlink d19/d1c/f23 0 2024-09-17T04:20:50.517 INFO:tasks.workunit.client.1.smithi134.stdout:8/202: dwrite d4/db/dd/f16 [4194304,4194304] 0 2024-09-17T04:20:50.517 INFO:tasks.workunit.client.1.smithi134.stdout:2/276: write f12 [1255755,62664] 0 2024-09-17T04:20:50.519 INFO:tasks.workunit.client.1.smithi134.stdout:5/207: unlink d0/d3a/f17 0 2024-09-17T04:20:50.519 INFO:tasks.workunit.client.1.smithi134.stdout:8/203: truncate d4/db/df/f35 607922 0 2024-09-17T04:20:50.521 INFO:tasks.workunit.client.1.smithi134.stdout:3/295: mkdir de/d12/d15/d1d/d2d/d63 0 2024-09-17T04:20:50.523 INFO:tasks.workunit.client.1.smithi134.stdout:1/228: truncate d12/f1b 517928 0 2024-09-17T04:20:50.526 INFO:tasks.workunit.client.1.smithi134.stdout:6/318: rmdir de 39 2024-09-17T04:20:50.527 INFO:tasks.workunit.client.1.smithi134.stdout:2/277: symlink d19/d27/d31/d34/l59 0 2024-09-17T04:20:50.528 INFO:tasks.workunit.client.1.smithi134.stdout:5/208: dwrite d0/f4 [4194304,4194304] 0 2024-09-17T04:20:50.528 INFO:tasks.workunit.client.1.smithi134.stdout:4/331: mknod d0/c69 0 2024-09-17T04:20:50.532 INFO:tasks.workunit.client.1.smithi134.stdout:3/296: dwrite de/d12/d22/d5a/f5d [0,4194304] 0 2024-09-17T04:20:50.533 INFO:tasks.workunit.client.1.smithi134.stdout:9/552: mknod d2/d5/d9/cb9 0 2024-09-17T04:20:50.537 INFO:tasks.workunit.client.1.smithi134.stdout:6/319: dread - de/d19/d1f/f60 zero size 2024-09-17T04:20:50.540 INFO:tasks.workunit.client.1.smithi134.stdout:2/278: dwrite d19/d27/d31/f4c [0,4194304] 0 2024-09-17T04:20:50.540 INFO:tasks.workunit.client.1.smithi134.stdout:6/320: write f9 [2020685,64483] 0 2024-09-17T04:20:50.542 INFO:tasks.workunit.client.1.smithi134.stdout:4/332: dwrite d0/d3b/f5b [0,4194304] 0 2024-09-17T04:20:50.544 INFO:tasks.workunit.client.1.smithi134.stdout:1/229: rename d12/d19/d1d/c38 to d12/d19/d1d/d3e/c49 0 2024-09-17T04:20:50.545 INFO:tasks.workunit.client.1.smithi134.stdout:1/230: fdatasync d12/d1c/d2e/f46 0 2024-09-17T04:20:50.547 INFO:tasks.workunit.client.1.smithi134.stdout:3/297: creat de/d10/f64 x:0 0 0 2024-09-17T04:20:50.549 INFO:tasks.workunit.client.1.smithi134.stdout:6/321: dread de/f13 [0,4194304] 0 2024-09-17T04:20:50.552 INFO:tasks.workunit.client.1.smithi134.stdout:3/298: dread de/d12/d15/f4b [0,4194304] 0 2024-09-17T04:20:50.553 INFO:tasks.workunit.client.1.smithi134.stdout:4/333: dwrite d0/df/d1e/f5e [4194304,4194304] 0 2024-09-17T04:20:50.553 INFO:tasks.workunit.client.1.smithi134.stdout:9/553: write d2/d5/f68 [1025039,103172] 0 2024-09-17T04:20:50.560 INFO:tasks.workunit.client.1.smithi134.stdout:2/279: mknod d19/d1c/d47/d50/c5a 0 2024-09-17T04:20:50.562 INFO:tasks.workunit.client.1.smithi134.stdout:5/209: link d0/d3a/fc d0/f47 0 2024-09-17T04:20:50.562 INFO:tasks.workunit.client.1.smithi134.stdout:7/175: sync 2024-09-17T04:20:50.562 INFO:tasks.workunit.client.1.smithi134.stdout:0/206: sync 2024-09-17T04:20:50.562 INFO:tasks.workunit.client.1.smithi134.stdout:9/554: dread d2/d5/d8/d16/d54/daf/f95 [0,4194304] 0 2024-09-17T04:20:50.564 INFO:tasks.workunit.client.1.smithi134.stdout:0/207: readlink d11/d22/l4e 0 2024-09-17T04:20:50.569 INFO:tasks.workunit.client.1.smithi134.stdout:1/231: fdatasync d12/f1b 0 2024-09-17T04:20:50.569 INFO:tasks.workunit.client.1.smithi134.stdout:2/280: rename f12 to d19/d27/f5b 0 2024-09-17T04:20:50.570 INFO:tasks.workunit.client.1.smithi134.stdout:4/334: symlink d0/df/d1e/l6a 0 2024-09-17T04:20:50.570 INFO:tasks.workunit.client.1.smithi134.stdout:3/299: symlink de/d12/d15/d1d/d2d/d63/l65 0 2024-09-17T04:20:50.571 INFO:tasks.workunit.client.1.smithi134.stdout:4/335: readlink d0/l23 0 2024-09-17T04:20:50.572 INFO:tasks.workunit.client.1.smithi134.stdout:1/232: dread - d12/d1c/d2e/f3b zero size 2024-09-17T04:20:50.573 INFO:tasks.workunit.client.1.smithi134.stdout:9/555: fsync d2/d5/d8/d16/d54/daf/f95 0 2024-09-17T04:20:50.573 INFO:tasks.workunit.client.1.smithi134.stdout:5/210: dread d0/d3a/ff [0,4194304] 0 2024-09-17T04:20:50.574 INFO:tasks.workunit.client.1.smithi134.stdout:7/176: dwrite d0/d32/d38/f24 [0,4194304] 0 2024-09-17T04:20:50.574 INFO:tasks.workunit.client.1.smithi134.stdout:1/233: chown d12/f1b 7 1 2024-09-17T04:20:50.575 INFO:tasks.workunit.client.1.smithi134.stdout:9/556: stat d2/d5/d58 0 2024-09-17T04:20:50.577 INFO:tasks.workunit.client.1.smithi134.stdout:7/177: write d0/f19 [3626755,63852] 0 2024-09-17T04:20:50.578 INFO:tasks.workunit.client.1.smithi134.stdout:0/208: mknod d11/d22/d1c/d2f/d45/c51 0 2024-09-17T04:20:50.580 INFO:tasks.workunit.client.1.smithi134.stdout:5/211: fdatasync d0/f2a 0 2024-09-17T04:20:50.580 INFO:tasks.workunit.client.1.smithi134.stdout:3/300: rename de/d10/d3d/d4f/f5c to de/d12/d22/d5a/f66 0 2024-09-17T04:20:50.581 INFO:tasks.workunit.client.1.smithi134.stdout:1/234: write d12/d1c/f2f [92180,8745] 0 2024-09-17T04:20:50.582 INFO:tasks.workunit.client.1.smithi134.stdout:5/212: stat d0/d3a/d2b/c32 0 2024-09-17T04:20:50.585 INFO:tasks.workunit.client.1.smithi134.stdout:0/209: fdatasync d11/d18/f30 0 2024-09-17T04:20:50.586 INFO:tasks.workunit.client.1.smithi134.stdout:2/281: creat d19/d27/d31/f5c x:0 0 0 2024-09-17T04:20:50.588 INFO:tasks.workunit.client.1.smithi134.stdout:1/235: mkdir d12/d1c/d4a 0 2024-09-17T04:20:50.589 INFO:tasks.workunit.client.1.smithi134.stdout:1/236: write d12/d19/d1d/f27 [251227,118155] 0 2024-09-17T04:20:50.590 INFO:tasks.workunit.client.1.smithi134.stdout:9/557: creat d2/d5/d8/d16/d54/d5e/da0/fba x:0 0 0 2024-09-17T04:20:50.591 INFO:tasks.workunit.client.1.smithi134.stdout:3/301: unlink de/d12/d15/d1d/d2d/d31/f35 0 2024-09-17T04:20:50.593 INFO:tasks.workunit.client.1.smithi134.stdout:7/178: symlink d0/d16/d35/d36/l39 0 2024-09-17T04:20:50.594 INFO:tasks.workunit.client.1.smithi134.stdout:7/179: chown d0/dd/f1f 58242909 1 2024-09-17T04:20:50.594 INFO:tasks.workunit.client.1.smithi134.stdout:5/213: dread d0/da/f1e [0,4194304] 0 2024-09-17T04:20:50.594 INFO:tasks.workunit.client.1.smithi134.stdout:0/210: rename d11/d19/c4d to d11/d22/d1c/d2f/d45/c52 0 2024-09-17T04:20:50.595 INFO:tasks.workunit.client.1.smithi134.stdout:2/282: fdatasync d19/d1c/f1f 0 2024-09-17T04:20:50.598 INFO:tasks.workunit.client.1.smithi134.stdout:9/558: readlink d2/l12 0 2024-09-17T04:20:50.598 INFO:tasks.workunit.client.1.smithi134.stdout:0/211: write d11/f4f [991029,41624] 0 2024-09-17T04:20:50.600 INFO:tasks.workunit.client.1.smithi134.stdout:7/180: mkdir d0/dd/d3a 0 2024-09-17T04:20:50.602 INFO:tasks.workunit.client.1.smithi134.stdout:3/302: dwrite de/d12/f47 [4194304,4194304] 0 2024-09-17T04:20:50.603 INFO:tasks.workunit.client.1.smithi134.stdout:5/214: write d0/d3a/fc [4256076,12560] 0 2024-09-17T04:20:50.606 INFO:tasks.workunit.client.1.smithi134.stdout:7/181: mkdir d0/d16/d35/d3b 0 2024-09-17T04:20:50.606 INFO:tasks.workunit.client.1.smithi134.stdout:8/204: write d4/db/df/f12 [826524,65769] 0 2024-09-17T04:20:50.607 INFO:tasks.workunit.client.1.smithi134.stdout:7/182: chown d0/dd 37585736 1 2024-09-17T04:20:50.608 INFO:tasks.workunit.client.1.smithi134.stdout:1/237: rename d12/c29 to d12/d19/c4b 0 2024-09-17T04:20:50.609 INFO:tasks.workunit.client.1.smithi134.stdout:3/303: mkdir de/d67 0 2024-09-17T04:20:50.612 INFO:tasks.workunit.client.1.smithi134.stdout:3/304: write de/d12/d15/d1d/f61 [809593,386] 0 2024-09-17T04:20:50.612 INFO:tasks.workunit.client.1.smithi134.stdout:5/215: rmdir d0/d3a 39 2024-09-17T04:20:50.613 INFO:tasks.workunit.client.1.smithi134.stdout:9/559: truncate d2/d5/d8/d16/d54/daf/d6d/d84/f5c 941930 0 2024-09-17T04:20:50.616 INFO:tasks.workunit.client.1.smithi134.stdout:1/238: dread fd [4194304,4194304] 0 2024-09-17T04:20:50.616 INFO:tasks.workunit.client.1.smithi134.stdout:8/205: dwrite d4/d1f/f3a [0,4194304] 0 2024-09-17T04:20:50.622 INFO:tasks.workunit.client.1.smithi134.stdout:1/239: write d12/d1c/f2f [2885802,55482] 0 2024-09-17T04:20:50.622 INFO:tasks.workunit.client.1.smithi134.stdout:2/283: dread f11 [0,4194304] 0 2024-09-17T04:20:50.624 INFO:tasks.workunit.client.1.smithi134.stdout:8/206: read - d4/db/f2d zero size 2024-09-17T04:20:50.625 INFO:tasks.workunit.client.1.smithi134.stdout:9/560: symlink d2/d5/d9/d6b/lbb 0 2024-09-17T04:20:50.628 INFO:tasks.workunit.client.1.smithi134.stdout:2/284: truncate fc 4958151 0 2024-09-17T04:20:50.628 INFO:tasks.workunit.client.1.smithi134.stdout:1/240: write d12/d1c/f2f [3344572,63934] 0 2024-09-17T04:20:50.630 INFO:tasks.workunit.client.1.smithi134.stdout:6/322: truncate de/d2b/f43 1439003 0 2024-09-17T04:20:50.631 INFO:tasks.workunit.client.1.smithi134.stdout:2/285: fsync d19/d27/d31/f4c 0 2024-09-17T04:20:50.632 INFO:tasks.workunit.client.1.smithi134.stdout:5/216: dwrite d0/da/f46 [0,4194304] 0 2024-09-17T04:20:50.633 INFO:tasks.workunit.client.1.smithi134.stdout:7/183: dwrite d0/dd/f2d [4194304,4194304] 0 2024-09-17T04:20:50.633 INFO:tasks.workunit.client.1.smithi134.stdout:1/241: write d12/f42 [505686,32498] 0 2024-09-17T04:20:50.636 INFO:tasks.workunit.client.1.smithi134.stdout:4/336: truncate d0/df/d1e/f25 829218 0 2024-09-17T04:20:50.636 INFO:tasks.workunit.client.1.smithi134.stdout:7/184: chown d0/dd/d3a 7754624 1 2024-09-17T04:20:50.636 INFO:tasks.workunit.client.1.smithi134.stdout:4/337: fsync d0/d13/f3c 0 2024-09-17T04:20:50.636 INFO:tasks.workunit.client.1.smithi134.stdout:0/212: getdents d11/d19 0 2024-09-17T04:20:50.638 INFO:tasks.workunit.client.1.smithi134.stdout:8/207: creat d4/db/df/d13/f3d x:0 0 0 2024-09-17T04:20:50.639 INFO:tasks.workunit.client.1.smithi134.stdout:9/561: unlink d2/d5/d9/df/d38/l4a 0 2024-09-17T04:20:50.641 INFO:tasks.workunit.client.1.smithi134.stdout:2/286: unlink d19/d27/f51 0 2024-09-17T04:20:50.644 INFO:tasks.workunit.client.1.smithi134.stdout:3/305: getdents de/d10/d3d 0 2024-09-17T04:20:50.644 INFO:tasks.workunit.client.1.smithi134.stdout:1/242: write d12/d19/f30 [6461571,86659] 0 2024-09-17T04:20:50.645 INFO:tasks.workunit.client.1.smithi134.stdout:7/185: creat d0/d32/d38/f3c x:0 0 0 2024-09-17T04:20:50.646 INFO:tasks.workunit.client.1.smithi134.stdout:4/338: rename d0/df/d1e/f44 to d0/df/d35/d5c/f6b 0 2024-09-17T04:20:50.648 INFO:tasks.workunit.client.1.smithi134.stdout:5/217: dread d0/da/d2c/f37 [0,4194304] 0 2024-09-17T04:20:50.649 INFO:tasks.workunit.client.1.smithi134.stdout:0/213: symlink d11/d48/l53 0 2024-09-17T04:20:50.650 INFO:tasks.workunit.client.1.smithi134.stdout:6/323: creat de/d19/d21/f64 x:0 0 0 2024-09-17T04:20:50.650 INFO:tasks.workunit.client.1.smithi134.stdout:3/306: creat de/d10/f68 x:0 0 0 2024-09-17T04:20:50.650 INFO:tasks.workunit.client.1.smithi134.stdout:5/218: dread - d0/f3c zero size 2024-09-17T04:20:50.651 INFO:tasks.workunit.client.1.smithi134.stdout:2/287: symlink d19/d27/d31/l5d 0 2024-09-17T04:20:50.652 INFO:tasks.workunit.client.1.smithi134.stdout:1/243: creat d12/d1c/d4a/f4c x:0 0 0 2024-09-17T04:20:50.652 INFO:tasks.workunit.client.1.smithi134.stdout:0/214: chown d11/d18/f1e 540045 1 2024-09-17T04:20:50.654 INFO:tasks.workunit.client.1.smithi134.stdout:2/288: fsync d19/d27/d31/f5c 0 2024-09-17T04:20:50.655 INFO:tasks.workunit.client.1.smithi134.stdout:3/307: symlink de/d12/d15/d1d/d2d/l69 0 2024-09-17T04:20:50.658 INFO:tasks.workunit.client.1.smithi134.stdout:7/186: dwrite d0/d32/d38/f24 [0,4194304] 0 2024-09-17T04:20:50.658 INFO:tasks.workunit.client.1.smithi134.stdout:6/324: mknod de/d19/d21/d2d/d4c/c65 0 2024-09-17T04:20:50.658 INFO:tasks.workunit.client.1.smithi134.stdout:5/219: write d0/d3a/d2b/f44 [64188,64125] 0 2024-09-17T04:20:50.665 INFO:tasks.workunit.client.1.smithi134.stdout:5/220: read - d0/d3a/d2b/f2d zero size 2024-09-17T04:20:50.665 INFO:tasks.workunit.client.1.smithi134.stdout:3/308: mkdir de/d12/d15/d1d/d2d/d31/d6a 0 2024-09-17T04:20:50.665 INFO:tasks.workunit.client.1.smithi134.stdout:8/208: dread d4/fe [0,4194304] 0 2024-09-17T04:20:50.665 INFO:tasks.workunit.client.1.smithi134.stdout:6/325: creat de/d2b/f66 x:0 0 0 2024-09-17T04:20:50.669 INFO:tasks.workunit.client.1.smithi134.stdout:4/339: dwrite d0/df/d35/d5c/f6b [0,4194304] 0 2024-09-17T04:20:50.671 INFO:tasks.workunit.client.1.smithi134.stdout:8/209: dread - d4/f10 zero size 2024-09-17T04:20:50.671 INFO:tasks.workunit.client.1.smithi134.stdout:5/221: fsync d0/f2 0 2024-09-17T04:20:50.672 INFO:tasks.workunit.client.1.smithi134.stdout:3/309: chown de/d10/d3d/f52 246 1 2024-09-17T04:20:50.673 INFO:tasks.workunit.client.1.smithi134.stdout:1/244: dread d12/d19/f30 [4194304,4194304] 0 2024-09-17T04:20:50.673 INFO:tasks.workunit.client.1.smithi134.stdout:3/310: readlink de/l50 0 2024-09-17T04:20:50.674 INFO:tasks.workunit.client.1.smithi134.stdout:6/326: mkdir de/d5d/d67 0 2024-09-17T04:20:50.676 INFO:tasks.workunit.client.1.smithi134.stdout:8/210: mknod d4/c3e 0 2024-09-17T04:20:50.678 INFO:tasks.workunit.client.1.smithi134.stdout:3/311: rename de to de/d10/d3d/d4f/d6b 22 2024-09-17T04:20:50.679 INFO:tasks.workunit.client.1.smithi134.stdout:5/222: mkdir d0/d48 0 2024-09-17T04:20:50.679 INFO:tasks.workunit.client.1.smithi134.stdout:6/327: write de/d19/d62/d34/f3c [4675831,60513] 0 2024-09-17T04:20:50.682 INFO:tasks.workunit.client.1.smithi134.stdout:2/289: dwrite d19/d27/d31/d34/d42/f54 [0,4194304] 0 2024-09-17T04:20:50.685 INFO:tasks.workunit.client.1.smithi134.stdout:4/340: dread d0/df/d35/d5c/f6b [0,4194304] 0 2024-09-17T04:20:50.689 INFO:tasks.workunit.client.1.smithi134.stdout:9/562: truncate d2/d5/fb 7392741 0 2024-09-17T04:20:50.690 INFO:tasks.workunit.client.1.smithi134.stdout:0/215: dread d11/d22/d1c/d2f/d43/f44 [0,4194304] 0 2024-09-17T04:20:50.691 INFO:tasks.workunit.client.1.smithi134.stdout:1/245: dread d12/d19/d1d/f27 [0,4194304] 0 2024-09-17T04:20:50.692 INFO:tasks.workunit.client.1.smithi134.stdout:6/328: unlink de/d19/d62/d34/c4b 0 2024-09-17T04:20:50.694 INFO:tasks.workunit.client.1.smithi134.stdout:8/211: dwrite d4/db/f20 [0,4194304] 0 2024-09-17T04:20:50.697 INFO:tasks.workunit.client.1.smithi134.stdout:2/290: rename d19/d27/d31/d49/f57 to d19/d27/d31/d34/d42/f5e 0 2024-09-17T04:20:50.700 INFO:tasks.workunit.client.1.smithi134.stdout:5/223: creat d0/da/d12/d41/f49 x:0 0 0 2024-09-17T04:20:50.705 INFO:tasks.workunit.client.1.smithi134.stdout:3/312: dwrite de/d10/f2e [0,4194304] 0 2024-09-17T04:20:50.705 INFO:tasks.workunit.client.1.smithi134.stdout:0/216: creat d11/d22/d1c/f54 x:0 0 0 2024-09-17T04:20:50.705 INFO:tasks.workunit.client.1.smithi134.stdout:1/246: fsync d12/d19/f30 0 2024-09-17T04:20:50.705 INFO:tasks.workunit.client.1.smithi134.stdout:8/212: dread d4/db/fc [0,4194304] 0 2024-09-17T04:20:50.705 INFO:tasks.workunit.client.1.smithi134.stdout:0/217: stat d11/d24 0 2024-09-17T04:20:50.705 INFO:tasks.workunit.client.1.smithi134.stdout:6/329: fsync de/f13 0 2024-09-17T04:20:50.705 INFO:tasks.workunit.client.1.smithi134.stdout:0/218: readlink d11/l17 0 2024-09-17T04:20:50.705 INFO:tasks.workunit.client.1.smithi134.stdout:3/313: stat de/d12/d15/d1d/f62 0 2024-09-17T04:20:50.706 INFO:tasks.workunit.client.1.smithi134.stdout:0/219: fsync d11/d18/f3d 0 2024-09-17T04:20:50.707 INFO:tasks.workunit.client.1.smithi134.stdout:8/213: write d4/db/f2d [194495,98316] 0 2024-09-17T04:20:50.709 INFO:tasks.workunit.client.1.smithi134.stdout:3/314: rmdir de/d12/d15/d1d/d2d 39 2024-09-17T04:20:50.711 INFO:tasks.workunit.client.1.smithi134.stdout:9/563: getdents d2/d5/d37/d3f 0 2024-09-17T04:20:50.712 INFO:tasks.workunit.client.1.smithi134.stdout:8/214: dread d4/fe [0,4194304] 0 2024-09-17T04:20:50.712 INFO:tasks.workunit.client.1.smithi134.stdout:9/564: dread d2/d5/d37/d83/f92 [0,4194304] 0 2024-09-17T04:20:50.713 INFO:tasks.workunit.client.1.smithi134.stdout:8/215: dread - d4/d1f/f33 zero size 2024-09-17T04:20:50.713 INFO:tasks.workunit.client.1.smithi134.stdout:6/330: rename de/d2b/f66 to de/d19/d1f/d55/f68 0 2024-09-17T04:20:50.715 INFO:tasks.workunit.client.1.smithi134.stdout:4/341: truncate d0/df/f16 2667102 0 2024-09-17T04:20:50.715 INFO:tasks.workunit.client.1.smithi134.stdout:2/291: link d19/d27/d31/l48 d19/d1c/l5f 0 2024-09-17T04:20:50.716 INFO:tasks.workunit.client.1.smithi134.stdout:8/216: write d4/f26 [1222095,112111] 0 2024-09-17T04:20:50.717 INFO:tasks.workunit.client.1.smithi134.stdout:0/220: creat d11/d22/d1c/d2f/f55 x:0 0 0 2024-09-17T04:20:50.717 INFO:tasks.workunit.client.1.smithi134.stdout:3/315: mknod de/d12/d22/d5a/c6c 0 2024-09-17T04:20:50.719 INFO:tasks.workunit.client.1.smithi134.stdout:9/565: mknod d2/d5/d9/df/d80/cbc 0 2024-09-17T04:20:50.719 INFO:tasks.workunit.client.1.smithi134.stdout:8/217: dread - d4/db/dd/f30 zero size 2024-09-17T04:20:50.721 INFO:tasks.workunit.client.1.smithi134.stdout:4/342: symlink d0/d13/d40/d42/l6c 0 2024-09-17T04:20:50.721 INFO:tasks.workunit.client.1.smithi134.stdout:3/316: rmdir de/d12/d22/d5a 39 2024-09-17T04:20:50.721 INFO:tasks.workunit.client.1.smithi134.stdout:2/292: truncate d19/f1a 336168 0 2024-09-17T04:20:50.722 INFO:tasks.workunit.client.1.smithi134.stdout:0/221: chown d11/d19/d21/d37/f42 5735334 1 2024-09-17T04:20:50.722 INFO:tasks.workunit.client.1.smithi134.stdout:9/566: fsync d2/d5/f98 0 2024-09-17T04:20:50.723 INFO:tasks.workunit.client.1.smithi134.stdout:2/293: stat cd 0 2024-09-17T04:20:50.723 INFO:tasks.workunit.client.1.smithi134.stdout:8/218: fsync d4/db/df/f35 0 2024-09-17T04:20:50.726 INFO:tasks.workunit.client.1.smithi134.stdout:9/567: chown d2/d5/d8/d1e/cb7 907416593 1 2024-09-17T04:20:50.727 INFO:tasks.workunit.client.1.smithi134.stdout:2/294: read d19/d1c/f1d [844976,9779] 0 2024-09-17T04:20:50.729 INFO:tasks.workunit.client.1.smithi134.stdout:0/222: rename d11/f4f to d11/d48/f56 0 2024-09-17T04:20:50.729 INFO:tasks.workunit.client.1.smithi134.stdout:8/219: write d4/d1f/f33 [487353,127569] 0 2024-09-17T04:20:50.729 INFO:tasks.workunit.client.1.smithi134.stdout:5/224: dwrite d0/d3a/d2b/f43 [0,4194304] 0 2024-09-17T04:20:50.730 INFO:tasks.workunit.client.1.smithi134.stdout:9/568: stat d2/d5/d8/d16/d54/l77 0 2024-09-17T04:20:50.733 INFO:tasks.workunit.client.1.smithi134.stdout:8/220: write d4/db/dd/f2e [793923,121581] 0 2024-09-17T04:20:50.733 INFO:tasks.workunit.client.1.smithi134.stdout:0/223: truncate d11/d18/f3d 1095902 0 2024-09-17T04:20:50.737 INFO:tasks.workunit.client.1.smithi134.stdout:2/295: dwrite d19/d1c/f1d [4194304,4194304] 0 2024-09-17T04:20:50.738 INFO:tasks.workunit.client.1.smithi134.stdout:2/296: fsync d19/d1c/f30 0 2024-09-17T04:20:50.826 INFO:tasks.workunit.client.1.smithi134.stdout:7/187: sync 2024-09-17T04:20:50.831 INFO:tasks.workunit.client.1.smithi134.stdout:7/188: dwrite d0/d32/d38/f1d [0,4194304] 0 2024-09-17T04:20:50.832 INFO:tasks.workunit.client.1.smithi134.stdout:7/189: read d0/f6 [2451039,28518] 0 2024-09-17T04:20:50.832 INFO:tasks.workunit.client.1.smithi134.stdout:7/190: chown d0/d32/d38/f24 2240 1 2024-09-17T04:20:50.868 INFO:tasks.workunit.client.1.smithi134.stdout:8/221: sync 2024-09-17T04:20:50.868 INFO:tasks.workunit.client.1.smithi134.stdout:1/247: sync 2024-09-17T04:20:50.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:50 smithi088 ceph-mon[27811]: pgmap v16: 65 pgs: 65 active+clean; 323 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 23 MiB/s wr, 270 op/s 2024-09-17T04:20:50.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:50 smithi134 ceph-mon[35201]: pgmap v16: 65 pgs: 65 active+clean; 323 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 23 MiB/s wr, 270 op/s 2024-09-17T04:20:50.922 INFO:tasks.workunit.client.1.smithi134.stdout:6/331: truncate f9 411771 0 2024-09-17T04:20:50.926 INFO:tasks.workunit.client.1.smithi134.stdout:2/297: mknod d19/d27/d31/d49/c60 0 2024-09-17T04:20:50.929 INFO:tasks.workunit.client.1.smithi134.stdout:4/343: dread d0/f43 [0,4194304] 0 2024-09-17T04:20:50.929 INFO:tasks.workunit.client.1.smithi134.stdout:7/191: rename d0/d32 to d0/dd/d3a/d3d 0 2024-09-17T04:20:50.930 INFO:tasks.workunit.client.1.smithi134.stdout:4/344: write d0/d13/f14 [4248601,1351] 0 2024-09-17T04:20:50.931 INFO:tasks.workunit.client.1.smithi134.stdout:3/317: link de/d10/d3d/l5e de/d12/d15/l6d 0 2024-09-17T04:20:50.932 INFO:tasks.workunit.client.1.smithi134.stdout:6/332: rmdir de/d19/d62/d34/d3b 39 2024-09-17T04:20:50.933 INFO:tasks.workunit.client.1.smithi134.stdout:8/222: dread d4/db/fc [0,4194304] 0 2024-09-17T04:20:50.934 INFO:tasks.workunit.client.1.smithi134.stdout:6/333: chown de/d19/d21/d2d/d4c 474 1 2024-09-17T04:20:50.935 INFO:tasks.workunit.client.1.smithi134.stdout:6/334: write de/d19/d21/f64 [372478,129929] 0 2024-09-17T04:20:50.936 INFO:tasks.workunit.client.1.smithi134.stdout:1/248: dread d12/f1a [0,4194304] 0 2024-09-17T04:20:50.938 INFO:tasks.workunit.client.1.smithi134.stdout:5/225: creat d0/da/d12/f4a x:0 0 0 2024-09-17T04:20:50.939 INFO:tasks.workunit.client.1.smithi134.stdout:7/192: rename d0/dd/c2a to d0/dd/d3a/c3e 0 2024-09-17T04:20:50.939 INFO:tasks.workunit.client.1.smithi134.stdout:9/569: link d2/d5/d9/c31 d2/d5/d37/cbd 0 2024-09-17T04:20:50.940 INFO:tasks.workunit.client.1.smithi134.stdout:7/193: write d0/f1b [278867,36132] 0 2024-09-17T04:20:50.943 INFO:tasks.workunit.client.1.smithi134.stdout:8/223: symlink d4/l3f 0 2024-09-17T04:20:50.943 INFO:tasks.workunit.client.1.smithi134.stdout:8/224: chown d4/d1f/d25/c27 2 1 2024-09-17T04:20:50.943 INFO:tasks.workunit.client.1.smithi134.stdout:6/335: mknod de/d19/d21/d2d/d4c/c69 0 2024-09-17T04:20:50.944 INFO:tasks.workunit.client.1.smithi134.stdout:8/225: write d4/db/df/d13/f3d [143793,48521] 0 2024-09-17T04:20:50.945 INFO:tasks.workunit.client.1.smithi134.stdout:8/226: dread - d4/db/dd/f1b zero size 2024-09-17T04:20:50.946 INFO:tasks.workunit.client.1.smithi134.stdout:5/226: creat d0/da/d2c/f4b x:0 0 0 2024-09-17T04:20:50.948 INFO:tasks.workunit.client.1.smithi134.stdout:5/227: chown d0/f8 1644321 1 2024-09-17T04:20:50.949 INFO:tasks.workunit.client.1.smithi134.stdout:0/224: getdents d11/d19/d21 0 2024-09-17T04:20:50.949 INFO:tasks.workunit.client.1.smithi134.stdout:7/194: symlink d0/dd/d3a/d3d/d38/l3f 0 2024-09-17T04:20:50.949 INFO:tasks.workunit.client.1.smithi134.stdout:0/225: chown d11/d22/d1c/d2f 2117 1 2024-09-17T04:20:50.951 INFO:tasks.workunit.client.1.smithi134.stdout:6/336: creat de/d19/d21/d2d/f6a x:0 0 0 2024-09-17T04:20:50.952 INFO:tasks.workunit.client.1.smithi134.stdout:1/249: symlink d12/d19/l4d 0 2024-09-17T04:20:50.953 INFO:tasks.workunit.client.1.smithi134.stdout:8/227: rmdir d4/db/dd 39 2024-09-17T04:20:50.955 INFO:tasks.workunit.client.1.smithi134.stdout:8/228: dread - d4/f36 zero size 2024-09-17T04:20:50.955 INFO:tasks.workunit.client.1.smithi134.stdout:0/226: dwrite d11/d18/f3d [0,4194304] 0 2024-09-17T04:20:50.955 INFO:tasks.workunit.client.1.smithi134.stdout:9/570: dread d2/d5/d8/d16/f72 [0,4194304] 0 2024-09-17T04:20:50.957 INFO:tasks.workunit.client.1.smithi134.stdout:5/228: creat d0/da/d2c/f4c x:0 0 0 2024-09-17T04:20:50.958 INFO:tasks.workunit.client.1.smithi134.stdout:7/195: creat d0/d16/d35/f40 x:0 0 0 2024-09-17T04:20:50.958 INFO:tasks.workunit.client.1.smithi134.stdout:2/298: link d19/l56 d19/d27/d31/l61 0 2024-09-17T04:20:50.959 INFO:tasks.workunit.client.1.smithi134.stdout:3/318: mknod de/d12/d15/d1d/d2d/d31/d6a/c6e 0 2024-09-17T04:20:50.960 INFO:tasks.workunit.client.1.smithi134.stdout:5/229: write d0/d3a/d2b/f45 [678868,652] 0 2024-09-17T04:20:50.962 INFO:tasks.workunit.client.1.smithi134.stdout:1/250: creat d12/d1c/f4e x:0 0 0 2024-09-17T04:20:50.962 INFO:tasks.workunit.client.1.smithi134.stdout:3/319: chown de/d12/d15/d1d/l59 149777336 1 2024-09-17T04:20:50.963 INFO:tasks.workunit.client.1.smithi134.stdout:8/229: creat d4/db/df/d13/f40 x:0 0 0 2024-09-17T04:20:50.964 INFO:tasks.workunit.client.1.smithi134.stdout:9/571: rmdir d2/d5/d8/d16/d54/d5e/da0 39 2024-09-17T04:20:50.965 INFO:tasks.workunit.client.1.smithi134.stdout:7/196: dread d0/f15 [4194304,4194304] 0 2024-09-17T04:20:50.970 INFO:tasks.workunit.client.1.smithi134.stdout:6/337: symlink de/d19/d62/d34/d3b/l6b 0 2024-09-17T04:20:50.972 INFO:tasks.workunit.client.1.smithi134.stdout:0/227: dwrite d11/d24/f28 [0,4194304] 0 2024-09-17T04:20:50.975 INFO:tasks.workunit.client.1.smithi134.stdout:5/230: creat d0/da/d12/d41/f4d x:0 0 0 2024-09-17T04:20:50.975 INFO:tasks.workunit.client.1.smithi134.stdout:6/338: readlink de/d19/d62/l4a 0 2024-09-17T04:20:50.976 INFO:tasks.workunit.client.1.smithi134.stdout:8/230: symlink d4/db/df/d13/l41 0 2024-09-17T04:20:50.976 INFO:tasks.workunit.client.1.smithi134.stdout:2/299: dread d19/d27/d31/d34/f45 [0,4194304] 0 2024-09-17T04:20:50.977 INFO:tasks.workunit.client.1.smithi134.stdout:7/197: creat d0/dd/d3a/d3d/f41 x:0 0 0 2024-09-17T04:20:50.978 INFO:tasks.workunit.client.1.smithi134.stdout:6/339: truncate de/d19/d1f/f57 202659 0 2024-09-17T04:20:50.979 INFO:tasks.workunit.client.1.smithi134.stdout:5/231: truncate d0/d3a/d2b/f2d 252242 0 2024-09-17T04:20:50.979 INFO:tasks.workunit.client.1.smithi134.stdout:1/251: mkdir d12/d19/d4f 0 2024-09-17T04:20:50.979 INFO:tasks.workunit.client.1.smithi134.stdout:0/228: read fe [1610677,36562] 0 2024-09-17T04:20:50.980 INFO:tasks.workunit.client.1.smithi134.stdout:7/198: write d0/d16/d35/f40 [577670,89066] 0 2024-09-17T04:20:50.980 INFO:tasks.workunit.client.1.smithi134.stdout:1/252: readlink d12/d1c/l45 0 2024-09-17T04:20:50.983 INFO:tasks.workunit.client.1.smithi134.stdout:8/231: write d4/db/dd/f1b [863409,121291] 0 2024-09-17T04:20:50.983 INFO:tasks.workunit.client.1.smithi134.stdout:9/572: link d2/d5/d37/fa8 d2/d7/d75/d96/fbe 0 2024-09-17T04:20:50.985 INFO:tasks.workunit.client.1.smithi134.stdout:4/345: sync 2024-09-17T04:20:50.987 INFO:tasks.workunit.client.1.smithi134.stdout:6/340: chown de/d19/d62/c38 37 1 2024-09-17T04:20:50.988 INFO:tasks.workunit.client.1.smithi134.stdout:2/300: dwrite d19/d27/f32 [4194304,4194304] 0 2024-09-17T04:20:50.989 INFO:tasks.workunit.client.1.smithi134.stdout:8/232: symlink d4/d1f/d2b/l42 0 2024-09-17T04:20:50.990 INFO:tasks.workunit.client.1.smithi134.stdout:1/253: truncate fd 5238744 0 2024-09-17T04:20:50.991 INFO:tasks.workunit.client.1.smithi134.stdout:3/320: truncate de/f3b 589525 0 2024-09-17T04:20:50.994 INFO:tasks.workunit.client.1.smithi134.stdout:5/232: creat d0/da/d29/f4e x:0 0 0 2024-09-17T04:20:50.995 INFO:tasks.workunit.client.1.smithi134.stdout:9/573: symlink d2/d5/d37/d7c/lbf 0 2024-09-17T04:20:50.997 INFO:tasks.workunit.client.1.smithi134.stdout:4/346: creat d0/df/d17/f6d x:0 0 0 2024-09-17T04:20:50.998 INFO:tasks.workunit.client.1.smithi134.stdout:6/341: fsync fd 0 2024-09-17T04:20:50.999 INFO:tasks.workunit.client.1.smithi134.stdout:2/301: symlink d19/d1c/d47/d50/l62 0 2024-09-17T04:20:50.999 INFO:tasks.workunit.client.1.smithi134.stdout:3/321: mknod de/d12/d15/c6f 0 2024-09-17T04:20:50.999 INFO:tasks.workunit.client.1.smithi134.stdout:8/233: dread d4/d1f/f3a [0,4194304] 0 2024-09-17T04:20:51.000 INFO:tasks.workunit.client.1.smithi134.stdout:9/574: rmdir d2/d5/d58 39 2024-09-17T04:20:51.001 INFO:tasks.workunit.client.1.smithi134.stdout:4/347: symlink d0/df/d35/l6e 0 2024-09-17T04:20:51.003 INFO:tasks.workunit.client.1.smithi134.stdout:2/302: mkdir d19/d27/d31/d49/d63 0 2024-09-17T04:20:51.003 INFO:tasks.workunit.client.1.smithi134.stdout:8/234: mkdir d4/db/dd/d43 0 2024-09-17T04:20:51.009 INFO:tasks.workunit.client.1.smithi134.stdout:2/303: mkdir d19/d27/d64 0 2024-09-17T04:20:51.009 INFO:tasks.workunit.client.1.smithi134.stdout:7/199: dread d0/d16/f13 [0,4194304] 0 2024-09-17T04:20:51.010 INFO:tasks.workunit.client.1.smithi134.stdout:0/229: truncate d11/d18/f36 4134966 0 2024-09-17T04:20:51.013 INFO:tasks.workunit.client.1.smithi134.stdout:8/235: fdatasync d4/d11/f1c 0 2024-09-17T04:20:51.013 INFO:tasks.workunit.client.1.smithi134.stdout:9/575: truncate d2/d5/d58/f85 1367005 0 2024-09-17T04:20:51.014 INFO:tasks.workunit.client.1.smithi134.stdout:7/200: chown d0/dd/d3a 2003 1 2024-09-17T04:20:51.014 INFO:tasks.workunit.client.1.smithi134.stdout:5/233: dwrite d0/d3a/ff [4194304,4194304] 0 2024-09-17T04:20:51.016 INFO:tasks.workunit.client.1.smithi134.stdout:3/322: dread de/d10/f2e [0,4194304] 0 2024-09-17T04:20:51.016 INFO:tasks.workunit.client.1.smithi134.stdout:0/230: creat d11/d18/f57 x:0 0 0 2024-09-17T04:20:51.016 INFO:tasks.workunit.client.1.smithi134.stdout:2/304: chown d19/d27/d31/d49/c60 16505909 1 2024-09-17T04:20:51.017 INFO:tasks.workunit.client.1.smithi134.stdout:6/342: write de/d19/d62/d34/f42 [1727119,44595] 0 2024-09-17T04:20:51.022 INFO:tasks.workunit.client.1.smithi134.stdout:8/236: stat d4/db/df/d13/f3d 0 2024-09-17T04:20:51.022 INFO:tasks.workunit.client.1.smithi134.stdout:2/305: stat d19/d1c/f2d 0 2024-09-17T04:20:51.023 INFO:tasks.workunit.client.1.smithi134.stdout:5/234: creat d0/d48/f4f x:0 0 0 2024-09-17T04:20:51.023 INFO:tasks.workunit.client.1.smithi134.stdout:0/231: chown d11/l17 139694897 1 2024-09-17T04:20:51.023 INFO:tasks.workunit.client.1.smithi134.stdout:8/237: creat d4/d1f/f44 x:0 0 0 2024-09-17T04:20:51.026 INFO:tasks.workunit.client.1.smithi134.stdout:1/254: dread d12/f14 [0,4194304] 0 2024-09-17T04:20:51.028 INFO:tasks.workunit.client.1.smithi134.stdout:2/306: dread d19/f1a [0,4194304] 0 2024-09-17T04:20:51.028 INFO:tasks.workunit.client.1.smithi134.stdout:1/255: readlink d12/l2c 0 2024-09-17T04:20:51.029 INFO:tasks.workunit.client.1.smithi134.stdout:0/232: rmdir d11/d19 39 2024-09-17T04:20:51.030 INFO:tasks.workunit.client.1.smithi134.stdout:8/238: symlink d4/db/dd/l45 0 2024-09-17T04:20:51.032 INFO:tasks.workunit.client.1.smithi134.stdout:4/348: dread d0/fb [0,4194304] 0 2024-09-17T04:20:51.032 INFO:tasks.workunit.client.1.smithi134.stdout:2/307: stat d19/d27/d31/d34/d42 0 2024-09-17T04:20:51.034 INFO:tasks.workunit.client.1.smithi134.stdout:7/201: dread d0/dd/fb [0,4194304] 0 2024-09-17T04:20:51.035 INFO:tasks.workunit.client.1.smithi134.stdout:8/239: write d4/d1f/f44 [122204,42527] 0 2024-09-17T04:20:51.036 INFO:tasks.workunit.client.1.smithi134.stdout:6/343: creat de/d19/d62/d34/f6c x:0 0 0 2024-09-17T04:20:51.037 INFO:tasks.workunit.client.1.smithi134.stdout:1/256: creat d12/d1c/d2e/f50 x:0 0 0 2024-09-17T04:20:51.038 INFO:tasks.workunit.client.1.smithi134.stdout:9/576: dwrite d2/d5/d8/d16/d54/daf/d6d/d84/f6e [0,4194304] 0 2024-09-17T04:20:51.040 INFO:tasks.workunit.client.1.smithi134.stdout:0/233: fsync d11/d18/f36 0 2024-09-17T04:20:51.041 INFO:tasks.workunit.client.1.smithi134.stdout:8/240: unlink d4/d11/f1c 0 2024-09-17T04:20:51.043 INFO:tasks.workunit.client.1.smithi134.stdout:1/257: truncate d12/d1c/d4a/f4c 465609 0 2024-09-17T04:20:51.046 INFO:tasks.workunit.client.1.smithi134.stdout:1/258: fdatasync d12/d1c/f2f 0 2024-09-17T04:20:51.046 INFO:tasks.workunit.client.1.smithi134.stdout:8/241: rmdir d4/db/dd 39 2024-09-17T04:20:51.046 INFO:tasks.workunit.client.1.smithi134.stdout:6/344: chown de/d19/f61 1092 1 2024-09-17T04:20:51.048 INFO:tasks.workunit.client.1.smithi134.stdout:2/308: fsync d19/d27/f5b 0 2024-09-17T04:20:51.048 INFO:tasks.workunit.client.1.smithi134.stdout:3/323: dwrite de/d12/d22/d5a/f66 [0,4194304] 0 2024-09-17T04:20:51.048 INFO:tasks.workunit.client.1.smithi134.stdout:1/259: chown c6 29 1 2024-09-17T04:20:51.049 INFO:tasks.workunit.client.1.smithi134.stdout:6/345: write de/d19/f33 [303852,37076] 0 2024-09-17T04:20:51.049 INFO:tasks.workunit.client.1.smithi134.stdout:9/577: write d2/d5/d9/df/d38/f99 [154317,9988] 0 2024-09-17T04:20:51.051 INFO:tasks.workunit.client.1.smithi134.stdout:7/202: link d0/d16/l31 d0/d16/l42 0 2024-09-17T04:20:51.052 INFO:tasks.workunit.client.1.smithi134.stdout:5/235: dread d0/f4 [0,4194304] 0 2024-09-17T04:20:51.054 INFO:tasks.workunit.client.1.smithi134.stdout:3/324: mkdir de/d10/d70 0 2024-09-17T04:20:51.056 INFO:tasks.workunit.client.1.smithi134.stdout:1/260: write d12/f14 [5865072,21783] 0 2024-09-17T04:20:51.058 INFO:tasks.workunit.client.1.smithi134.stdout:5/236: rmdir d0 39 2024-09-17T04:20:51.059 INFO:tasks.workunit.client.1.smithi134.stdout:6/346: truncate de/d19/d62/d34/f42 2605574 0 2024-09-17T04:20:51.059 INFO:tasks.workunit.client.1.smithi134.stdout:8/242: rename d4/db/dd/l45 to d4/db/df/d13/l46 0 2024-09-17T04:20:51.059 INFO:tasks.workunit.client.1.smithi134.stdout:2/309: creat d19/d27/d31/f65 x:0 0 0 2024-09-17T04:20:51.063 INFO:tasks.workunit.client.1.smithi134.stdout:0/234: dwrite d11/d18/f1f [0,4194304] 0 2024-09-17T04:20:51.063 INFO:tasks.workunit.client.1.smithi134.stdout:2/310: rmdir d19/d1c/d47 39 2024-09-17T04:20:51.065 INFO:tasks.workunit.client.1.smithi134.stdout:8/243: creat d4/d11/f47 x:0 0 0 2024-09-17T04:20:51.065 INFO:tasks.workunit.client.1.smithi134.stdout:5/237: fdatasync d0/d3a/fc 0 2024-09-17T04:20:51.065 INFO:tasks.workunit.client.1.smithi134.stdout:6/347: mkdir de/d19/d21/d2d/d6d 0 2024-09-17T04:20:51.066 INFO:tasks.workunit.client.1.smithi134.stdout:0/235: stat d11/d22/f3e 0 2024-09-17T04:20:51.067 INFO:tasks.workunit.client.1.smithi134.stdout:3/325: rename de/d12/f4e to de/d12/d22/d5a/f71 0 2024-09-17T04:20:51.067 INFO:tasks.workunit.client.1.smithi134.stdout:5/238: read d0/f47 [2166870,28589] 0 2024-09-17T04:20:51.068 INFO:tasks.workunit.client.1.smithi134.stdout:8/244: chown d4/db/f20 0 1 2024-09-17T04:20:51.070 INFO:tasks.workunit.client.1.smithi134.stdout:3/326: chown de/c40 1321054260 1 2024-09-17T04:20:51.070 INFO:tasks.workunit.client.1.smithi134.stdout:5/239: dread - d0/f3c zero size 2024-09-17T04:20:51.073 INFO:tasks.workunit.client.1.smithi134.stdout:6/348: mknod de/d19/d21/d4d/c6e 0 2024-09-17T04:20:51.073 INFO:tasks.workunit.client.1.smithi134.stdout:7/203: dwrite d0/dd/f2d [4194304,4194304] 0 2024-09-17T04:20:51.073 INFO:tasks.workunit.client.1.smithi134.stdout:8/245: chown d4/l17 501 1 2024-09-17T04:20:51.078 INFO:tasks.workunit.client.1.smithi134.stdout:1/261: dwrite d12/f42 [0,4194304] 0 2024-09-17T04:20:51.084 INFO:tasks.workunit.client.1.smithi134.stdout:5/240: rename d0/f2 to d0/d3a/f50 0 2024-09-17T04:20:51.088 INFO:tasks.workunit.client.1.smithi134.stdout:0/236: dwrite d11/d22/f3a [0,4194304] 0 2024-09-17T04:20:51.091 INFO:tasks.workunit.client.1.smithi134.stdout:1/262: read - d12/d1c/d2e/f3b zero size 2024-09-17T04:20:51.091 INFO:tasks.workunit.client.1.smithi134.stdout:2/311: dwrite d19/d27/d31/f4c [0,4194304] 0 2024-09-17T04:20:51.091 INFO:tasks.workunit.client.1.smithi134.stdout:0/237: chown d11/d48 1 1 2024-09-17T04:20:51.092 INFO:tasks.workunit.client.1.smithi134.stdout:5/241: creat d0/d3a/d2b/f51 x:0 0 0 2024-09-17T04:20:51.092 INFO:tasks.workunit.client.1.smithi134.stdout:9/578: dread d2/d5/d9/df/f48 [0,4194304] 0 2024-09-17T04:20:51.097 INFO:tasks.workunit.client.1.smithi134.stdout:0/238: unlink d11/d18/f23 0 2024-09-17T04:20:51.097 INFO:tasks.workunit.client.1.smithi134.stdout:2/312: dread - d19/d27/d31/d34/d42/f5e zero size 2024-09-17T04:20:51.099 INFO:tasks.workunit.client.1.smithi134.stdout:5/242: write d0/da/f1e [2172765,7337] 0 2024-09-17T04:20:51.101 INFO:tasks.workunit.client.1.smithi134.stdout:8/246: dread d4/d1f/f3a [0,4194304] 0 2024-09-17T04:20:51.103 INFO:tasks.workunit.client.1.smithi134.stdout:7/204: dwrite d0/dd/d3a/d3d/d38/f24 [0,4194304] 0 2024-09-17T04:20:51.103 INFO:tasks.workunit.client.1.smithi134.stdout:1/263: rename d12/d19/d1d/c33 to d12/d19/d4f/c51 0 2024-09-17T04:20:51.103 INFO:tasks.workunit.client.1.smithi134.stdout:9/579: dread d2/d5/d8/d16/d54/daf/f95 [0,4194304] 0 2024-09-17T04:20:51.106 INFO:tasks.workunit.client.1.smithi134.stdout:2/313: write d19/d27/d31/d34/d42/f54 [3059822,68191] 0 2024-09-17T04:20:51.112 INFO:tasks.workunit.client.1.smithi134.stdout:8/247: read d4/db/df/d13/f3d [52708,118793] 0 2024-09-17T04:20:51.114 INFO:tasks.workunit.client.1.smithi134.stdout:1/264: rename d12/d19/c4b to d12/d1c/c52 0 2024-09-17T04:20:51.116 INFO:tasks.workunit.client.1.smithi134.stdout:2/314: mkdir d19/d1c/d47/d66 0 2024-09-17T04:20:51.118 INFO:tasks.workunit.client.1.smithi134.stdout:9/580: rename d2/d7/d75/d96/fb2 to d2/d78/fc0 0 2024-09-17T04:20:51.118 INFO:tasks.workunit.client.1.smithi134.stdout:3/327: dread de/d12/d15/f1f [0,4194304] 0 2024-09-17T04:20:51.118 INFO:tasks.workunit.client.1.smithi134.stdout:5/243: dwrite d0/d3a/f50 [0,4194304] 0 2024-09-17T04:20:51.119 INFO:tasks.workunit.client.1.smithi134.stdout:8/248: mknod d4/d1f/d2b/c48 0 2024-09-17T04:20:51.119 INFO:tasks.workunit.client.1.smithi134.stdout:5/244: stat d0/d48 0 2024-09-17T04:20:51.120 INFO:tasks.workunit.client.1.smithi134.stdout:8/249: dread - d4/f36 zero size 2024-09-17T04:20:51.121 INFO:tasks.workunit.client.1.smithi134.stdout:2/315: dread d19/d27/d31/d34/f45 [0,4194304] 0 2024-09-17T04:20:51.122 INFO:tasks.workunit.client.1.smithi134.stdout:8/250: read - d4/d1f/d2b/f2f zero size 2024-09-17T04:20:51.123 INFO:tasks.workunit.client.1.smithi134.stdout:9/581: symlink d2/d5/d9/lc1 0 2024-09-17T04:20:51.124 INFO:tasks.workunit.client.1.smithi134.stdout:7/205: link d0/dd/d3a/d3d/d38/l3f d0/d16/l43 0 2024-09-17T04:20:51.126 INFO:tasks.workunit.client.1.smithi134.stdout:2/316: rmdir d19/d27/d31/d34/d42 39 2024-09-17T04:20:51.126 INFO:tasks.workunit.client.1.smithi134.stdout:6/349: write de/f13 [5068322,4699] 0 2024-09-17T04:20:51.127 INFO:tasks.workunit.client.1.smithi134.stdout:8/251: write d4/d1f/d2b/f2f [696183,111208] 0 2024-09-17T04:20:51.129 INFO:tasks.workunit.client.1.smithi134.stdout:2/317: fsync d19/d1c/f1f 0 2024-09-17T04:20:51.130 INFO:tasks.workunit.client.1.smithi134.stdout:8/252: rmdir d4 39 2024-09-17T04:20:51.133 INFO:tasks.workunit.client.1.smithi134.stdout:0/239: truncate d11/d48/f56 443745 0 2024-09-17T04:20:51.135 INFO:tasks.workunit.client.1.smithi134.stdout:5/245: dwrite d0/da/d12/d41/f49 [0,4194304] 0 2024-09-17T04:20:51.135 INFO:tasks.workunit.client.1.smithi134.stdout:8/253: creat d4/f49 x:0 0 0 2024-09-17T04:20:51.137 INFO:tasks.workunit.client.1.smithi134.stdout:9/582: rmdir d2/d5/d8/d1e/d42/da5 0 2024-09-17T04:20:51.137 INFO:tasks.workunit.client.1.smithi134.stdout:8/254: fdatasync d4/f26 0 2024-09-17T04:20:51.137 INFO:tasks.workunit.client.1.smithi134.stdout:5/246: stat d0/f47 0 2024-09-17T04:20:51.137 INFO:tasks.workunit.client.1.smithi134.stdout:2/318: mkdir d19/d67 0 2024-09-17T04:20:51.140 INFO:tasks.workunit.client.1.smithi134.stdout:0/240: unlink d11/d24/l35 0 2024-09-17T04:20:51.141 INFO:tasks.workunit.client.1.smithi134.stdout:7/206: dwrite d0/f15 [4194304,4194304] 0 2024-09-17T04:20:51.141 INFO:tasks.workunit.client.1.smithi134.stdout:2/319: chown d19/d27/d31/l5d 15 1 2024-09-17T04:20:51.141 INFO:tasks.workunit.client.1.smithi134.stdout:9/583: write d2/d5/d8/d16/d54/f66 [914846,65031] 0 2024-09-17T04:20:51.143 INFO:tasks.workunit.client.1.smithi134.stdout:9/584: stat d2/d25/c40 0 2024-09-17T04:20:51.145 INFO:tasks.workunit.client.1.smithi134.stdout:8/255: symlink d4/d11/l4a 0 2024-09-17T04:20:51.145 INFO:tasks.workunit.client.1.smithi134.stdout:7/207: chown d0/dd/f34 988 1 2024-09-17T04:20:51.146 INFO:tasks.workunit.client.1.smithi134.stdout:2/320: read d19/d27/f5b [4042319,41574] 0 2024-09-17T04:20:51.147 INFO:tasks.workunit.client.1.smithi134.stdout:9/585: unlink d2/d5/d8/d16/d54/daf/d6d/d84/l50 0 2024-09-17T04:20:51.148 INFO:tasks.workunit.client.1.smithi134.stdout:7/208: creat d0/d16/d35/d36/f44 x:0 0 0 2024-09-17T04:20:51.149 INFO:tasks.workunit.client.1.smithi134.stdout:8/256: fsync d4/d1f/f3a 0 2024-09-17T04:20:51.150 INFO:tasks.workunit.client.1.smithi134.stdout:9/586: symlink d2/d5/d37/lc2 0 2024-09-17T04:20:51.151 INFO:tasks.workunit.client.1.smithi134.stdout:9/587: write d2/d5/d58/f81 [4479331,80046] 0 2024-09-17T04:20:51.152 INFO:tasks.workunit.client.1.smithi134.stdout:3/328: write de/d12/d22/f26 [59115,31192] 0 2024-09-17T04:20:51.153 INFO:tasks.workunit.client.1.smithi134.stdout:8/257: creat d4/d23/f4b x:0 0 0 2024-09-17T04:20:51.154 INFO:tasks.workunit.client.1.smithi134.stdout:2/321: creat d19/d27/d31/d49/d63/f68 x:0 0 0 2024-09-17T04:20:51.155 INFO:tasks.workunit.client.1.smithi134.stdout:3/329: rmdir de/d10/d3d 39 2024-09-17T04:20:51.157 INFO:tasks.workunit.client.1.smithi134.stdout:9/588: mknod d2/d5/d8/d16/d54/cc3 0 2024-09-17T04:20:51.157 INFO:tasks.workunit.client.1.smithi134.stdout:2/322: write f11 [4009703,56142] 0 2024-09-17T04:20:51.158 INFO:tasks.workunit.client.1.smithi134.stdout:7/209: rmdir d0/d16/d35/d3b 0 2024-09-17T04:20:51.159 INFO:tasks.workunit.client.1.smithi134.stdout:8/258: write d4/db/df/d13/f40 [913405,10734] 0 2024-09-17T04:20:51.162 INFO:tasks.workunit.client.1.smithi134.stdout:6/350: dwrite de/d19/f61 [0,4194304] 0 2024-09-17T04:20:51.170 INFO:tasks.workunit.client.1.smithi134.stdout:8/259: write d4/d1f/d2b/f2f [871844,93548] 0 2024-09-17T04:20:51.170 INFO:tasks.workunit.client.1.smithi134.stdout:8/260: chown d4/d1e/l2a 16540529 1 2024-09-17T04:20:51.171 INFO:tasks.workunit.client.1.smithi134.stdout:3/330: dread de/d12/d15/f1f [0,4194304] 0 2024-09-17T04:20:51.171 INFO:tasks.workunit.client.1.smithi134.stdout:3/331: chown de/c40 370 1 2024-09-17T04:20:51.171 INFO:tasks.workunit.client.1.smithi134.stdout:6/351: creat de/d19/d21/d4d/f6f x:0 0 0 2024-09-17T04:20:51.175 INFO:tasks.workunit.client.1.smithi134.stdout:2/323: dwrite d19/d27/d31/d34/d42/f54 [0,4194304] 0 2024-09-17T04:20:51.176 INFO:tasks.workunit.client.1.smithi134.stdout:8/261: fdatasync d4/db/fc 0 2024-09-17T04:20:51.177 INFO:tasks.workunit.client.1.smithi134.stdout:8/262: readlink d4/l1d 0 2024-09-17T04:20:51.177 INFO:tasks.workunit.client.1.smithi134.stdout:2/324: chown c10 2956 1 2024-09-17T04:20:51.178 INFO:tasks.workunit.client.1.smithi134.stdout:9/589: link d2/l4 d2/d5/d9/d6a/lc4 0 2024-09-17T04:20:51.179 INFO:tasks.workunit.client.1.smithi134.stdout:9/590: readlink d2/l22 0 2024-09-17T04:20:51.180 INFO:tasks.workunit.client.1.smithi134.stdout:4/349: sync 2024-09-17T04:20:51.181 INFO:tasks.workunit.client.1.smithi134.stdout:8/263: mknod d4/d1f/c4c 0 2024-09-17T04:20:51.183 INFO:tasks.workunit.client.1.smithi134.stdout:4/350: write d0/df/d1e/d20/f4a [4737322,128757] 0 2024-09-17T04:20:51.185 INFO:tasks.workunit.client.1.smithi134.stdout:9/591: dread d2/d5/f68 [0,4194304] 0 2024-09-17T04:20:51.187 INFO:tasks.workunit.client.1.smithi134.stdout:6/352: truncate f9 178836 0 2024-09-17T04:20:51.187 INFO:tasks.workunit.client.1.smithi134.stdout:0/241: write d11/d48/f56 [250640,35055] 0 2024-09-17T04:20:51.187 INFO:tasks.workunit.client.1.smithi134.stdout:9/592: chown d2/d7/d75/f93 6986795 1 2024-09-17T04:20:51.189 INFO:tasks.workunit.client.1.smithi134.stdout:8/264: mknod d4/d1f/d2b/c4d 0 2024-09-17T04:20:51.191 INFO:tasks.workunit.client.1.smithi134.stdout:3/332: creat de/d12/d15/d1d/f72 x:0 0 0 2024-09-17T04:20:51.195 INFO:tasks.workunit.client.1.smithi134.stdout:9/593: dwrite d2/f43 [4194304,4194304] 0 2024-09-17T04:20:51.196 INFO:tasks.workunit.client.1.smithi134.stdout:7/210: dread d0/dd/d3a/d3d/d38/f18 [0,4194304] 0 2024-09-17T04:20:51.204 INFO:tasks.workunit.client.1.smithi134.stdout:4/351: dread d0/df/d1e/d20/f34 [0,4194304] 0 2024-09-17T04:20:51.211 INFO:tasks.workunit.client.1.smithi134.stdout:6/353: creat de/d2b/f70 x:0 0 0 2024-09-17T04:20:51.213 INFO:tasks.workunit.client.1.smithi134.stdout:6/354: write de/d19/f3d [3547026,116782] 0 2024-09-17T04:20:51.213 INFO:tasks.workunit.client.1.smithi134.stdout:0/242: creat d11/d24/f58 x:0 0 0 2024-09-17T04:20:51.215 INFO:tasks.workunit.client.1.smithi134.stdout:2/325: creat d19/f69 x:0 0 0 2024-09-17T04:20:51.215 INFO:tasks.workunit.client.1.smithi134.stdout:2/326: chown d19/d1c/d47/l4e 28 1 2024-09-17T04:20:51.216 INFO:tasks.workunit.client.1.smithi134.stdout:8/265: symlink d4/d23/l4e 0 2024-09-17T04:20:51.218 INFO:tasks.workunit.client.1.smithi134.stdout:2/327: truncate d19/d27/d31/d34/d42/f5e 27085 0 2024-09-17T04:20:51.218 INFO:tasks.workunit.client.1.smithi134.stdout:3/333: rename de/d10/l4a to de/d12/d22/d5a/l73 0 2024-09-17T04:20:51.219 INFO:tasks.workunit.client.1.smithi134.stdout:3/334: dread - de/d10/f64 zero size 2024-09-17T04:20:51.220 INFO:tasks.workunit.client.1.smithi134.stdout:8/266: dread d4/db/dd/f1b [0,4194304] 0 2024-09-17T04:20:51.221 INFO:tasks.workunit.client.1.smithi134.stdout:7/211: symlink d0/dd/d3a/d3d/l45 0 2024-09-17T04:20:51.221 INFO:tasks.workunit.client.1.smithi134.stdout:8/267: chown d4/d23 3 1 2024-09-17T04:20:51.222 INFO:tasks.workunit.client.1.smithi134.stdout:4/352: write d0/fb [5044162,103378] 0 2024-09-17T04:20:51.222 INFO:tasks.workunit.client.1.smithi134.stdout:8/268: write d4/db/dd/f1b [71159,34974] 0 2024-09-17T04:20:51.223 INFO:tasks.workunit.client.1.smithi134.stdout:8/269: fdatasync f3 0 2024-09-17T04:20:51.224 INFO:tasks.workunit.client.1.smithi134.stdout:6/355: creat de/d2b/f71 x:0 0 0 2024-09-17T04:20:51.225 INFO:tasks.workunit.client.1.smithi134.stdout:3/335: dread de/d12/d15/d1d/d2d/f53 [0,4194304] 0 2024-09-17T04:20:51.225 INFO:tasks.workunit.client.1.smithi134.stdout:2/328: chown l15 0 1 2024-09-17T04:20:51.228 INFO:tasks.workunit.client.1.smithi134.stdout:7/212: write d0/dd/d3a/d3d/d38/f18 [4734336,108554] 0 2024-09-17T04:20:51.230 INFO:tasks.workunit.client.1.smithi134.stdout:4/353: unlink d0/df/d1e/d20/f34 0 2024-09-17T04:20:51.231 INFO:tasks.workunit.client.1.smithi134.stdout:8/270: fdatasync f0 0 2024-09-17T04:20:51.232 INFO:tasks.workunit.client.1.smithi134.stdout:7/213: dread d0/dd/f2d [4194304,4194304] 0 2024-09-17T04:20:51.233 INFO:tasks.workunit.client.1.smithi134.stdout:8/271: read d4/db/df/f35 [194462,129113] 0 2024-09-17T04:20:51.234 INFO:tasks.workunit.client.1.smithi134.stdout:2/329: fsync d19/d27/d31/d34/f45 0 2024-09-17T04:20:51.235 INFO:tasks.workunit.client.1.smithi134.stdout:9/594: write d2/d5/d9/d6a/f82 [2901,58837] 0 2024-09-17T04:20:51.235 INFO:tasks.workunit.client.1.smithi134.stdout:4/354: symlink d0/df/d35/d39/l6f 0 2024-09-17T04:20:51.236 INFO:tasks.workunit.client.1.smithi134.stdout:4/355: fdatasync d0/df/d35/d39/f56 0 2024-09-17T04:20:51.237 INFO:tasks.workunit.client.1.smithi134.stdout:4/356: truncate d0/d3b/f52 281712 0 2024-09-17T04:20:51.238 INFO:tasks.workunit.client.1.smithi134.stdout:7/214: rmdir d0/dd/d3a/d3d 39 2024-09-17T04:20:51.238 INFO:tasks.workunit.client.1.smithi134.stdout:7/215: write d0/f20 [256967,119246] 0 2024-09-17T04:20:51.293 INFO:tasks.workunit.client.1.smithi134.stdout:1/265: sync 2024-09-17T04:20:51.298 INFO:tasks.workunit.client.1.smithi134.stdout:6/356: creat de/d19/d62/d34/f72 x:0 0 0 2024-09-17T04:20:51.298 INFO:tasks.workunit.client.1.smithi134.stdout:8/272: rename d4/d23/l37 to d4/l4f 0 2024-09-17T04:20:51.299 INFO:tasks.workunit.client.1.smithi134.stdout:3/336: truncate de/d12/d15/d1d/d2d/d31/f3e 545308 0 2024-09-17T04:20:51.299 INFO:tasks.workunit.client.1.smithi134.stdout:2/330: symlink d19/d27/d31/d34/l6a 0 2024-09-17T04:20:51.300 INFO:tasks.workunit.client.1.smithi134.stdout:6/357: chown de/d19/d1f/d55/f63 13279522 1 2024-09-17T04:20:51.301 INFO:tasks.workunit.client.1.smithi134.stdout:3/337: readlink de/d12/l2f 0 2024-09-17T04:20:51.302 INFO:tasks.workunit.client.1.smithi134.stdout:7/216: dwrite d0/dd/f1f [0,4194304] 0 2024-09-17T04:20:51.303 INFO:tasks.workunit.client.1.smithi134.stdout:1/266: creat d12/f53 x:0 0 0 2024-09-17T04:20:51.307 INFO:tasks.workunit.client.1.smithi134.stdout:4/357: truncate d0/df/d1e/d20/f4a 1821681 0 2024-09-17T04:20:51.307 INFO:tasks.workunit.client.1.smithi134.stdout:8/273: dread f3 [0,4194304] 0 2024-09-17T04:20:51.309 INFO:tasks.workunit.client.1.smithi134.stdout:6/358: rename de/d19/d62/d34/f6c to de/d19/d1f/f73 0 2024-09-17T04:20:51.309 INFO:tasks.workunit.client.1.smithi134.stdout:7/217: mknod d0/d16/d35/d36/c46 0 2024-09-17T04:20:51.310 INFO:tasks.workunit.client.1.smithi134.stdout:4/358: fsync d0/df/f4e 0 2024-09-17T04:20:51.310 INFO:tasks.workunit.client.1.smithi134.stdout:2/331: rmdir d19/d1c/d47/d66 0 2024-09-17T04:20:51.318 INFO:tasks.workunit.client.1.smithi134.stdout:8/274: creat d4/d1f/d25/f50 x:0 0 0 2024-09-17T04:20:51.318 INFO:tasks.workunit.client.1.smithi134.stdout:1/267: creat d12/d19/f54 x:0 0 0 2024-09-17T04:20:51.318 INFO:tasks.workunit.client.1.smithi134.stdout:6/359: mkdir de/d19/d74 0 2024-09-17T04:20:51.318 INFO:tasks.workunit.client.1.smithi134.stdout:3/338: dwrite de/d12/d15/d1d/f37 [0,4194304] 0 2024-09-17T04:20:51.318 INFO:tasks.workunit.client.1.smithi134.stdout:2/332: rename d19/d27/d31/f65 to d19/d1c/d47/f6b 0 2024-09-17T04:20:51.318 INFO:tasks.workunit.client.1.smithi134.stdout:4/359: unlink d0/df/d1e/d20/l3f 0 2024-09-17T04:20:51.318 INFO:tasks.workunit.client.1.smithi134.stdout:3/339: chown de/d12/d15/d1d/d2d/d31 3707816 1 2024-09-17T04:20:51.319 INFO:tasks.workunit.client.1.smithi134.stdout:3/340: dread - de/d12/d15/d1d/d2d/f36 zero size 2024-09-17T04:20:51.321 INFO:tasks.workunit.client.1.smithi134.stdout:6/360: truncate de/d19/d1f/f26 216644 0 2024-09-17T04:20:51.322 INFO:tasks.workunit.client.1.smithi134.stdout:4/360: stat d0/df/d17/f24 0 2024-09-17T04:20:51.322 INFO:tasks.workunit.client.1.smithi134.stdout:1/268: symlink d12/l55 0 2024-09-17T04:20:51.324 INFO:tasks.workunit.client.1.smithi134.stdout:6/361: chown de/d19/f24 1 1 2024-09-17T04:20:51.324 INFO:tasks.workunit.client.1.smithi134.stdout:2/333: symlink d19/d27/d31/l6c 0 2024-09-17T04:20:51.325 INFO:tasks.workunit.client.1.smithi134.stdout:1/269: mkdir d12/d1c/d56 0 2024-09-17T04:20:51.325 INFO:tasks.workunit.client.1.smithi134.stdout:8/275: link d4/l1d d4/db/df/d13/l51 0 2024-09-17T04:20:51.325 INFO:tasks.workunit.client.1.smithi134.stdout:6/362: chown de/d19/d1f/d5c 124 1 2024-09-17T04:20:51.325 INFO:tasks.workunit.client.1.smithi134.stdout:1/270: readlink d12/d19/l41 0 2024-09-17T04:20:51.326 INFO:tasks.workunit.client.1.smithi134.stdout:3/341: unlink de/d10/d3d/l45 0 2024-09-17T04:20:51.327 INFO:tasks.workunit.client.1.smithi134.stdout:1/271: readlink d12/d19/l4d 0 2024-09-17T04:20:51.327 INFO:tasks.workunit.client.1.smithi134.stdout:6/363: readlink de/d19/d62/d34/l35 0 2024-09-17T04:20:51.328 INFO:tasks.workunit.client.1.smithi134.stdout:2/334: mkdir d19/d27/d31/d34/d6d 0 2024-09-17T04:20:51.332 INFO:tasks.workunit.client.1.smithi134.stdout:8/276: dread d4/db/df/d13/f40 [0,4194304] 0 2024-09-17T04:20:51.333 INFO:tasks.workunit.client.1.smithi134.stdout:2/335: creat d19/d27/d31/f6e x:0 0 0 2024-09-17T04:20:51.333 INFO:tasks.workunit.client.1.smithi134.stdout:3/342: link de/d12/d15/d1d/l20 de/l74 0 2024-09-17T04:20:51.333 INFO:tasks.workunit.client.1.smithi134.stdout:3/343: write de/d12/f47 [9193493,111716] 0 2024-09-17T04:20:51.334 INFO:tasks.workunit.client.1.smithi134.stdout:2/336: mkdir d19/d27/d31/d49/d6f 0 2024-09-17T04:20:51.337 INFO:tasks.workunit.client.1.smithi134.stdout:8/277: getdents d4/d11 0 2024-09-17T04:20:51.337 INFO:tasks.workunit.client.1.smithi134.stdout:2/337: truncate d19/d1c/f1f 4401644 0 2024-09-17T04:20:51.341 INFO:tasks.workunit.client.1.smithi134.stdout:8/278: link d4/d1f/d2b/c4d d4/db/df/d13/c52 0 2024-09-17T04:20:51.341 INFO:tasks.workunit.client.1.smithi134.stdout:3/344: dread de/f3b [0,4194304] 0 2024-09-17T04:20:51.342 INFO:tasks.workunit.client.1.smithi134.stdout:3/345: truncate de/d10/f5f 43917 0 2024-09-17T04:20:51.345 INFO:tasks.workunit.client.1.smithi134.stdout:8/279: mkdir d4/d53 0 2024-09-17T04:20:51.345 INFO:tasks.workunit.client.1.smithi134.stdout:4/361: dread d0/df/d1e/d20/f45 [0,4194304] 0 2024-09-17T04:20:51.347 INFO:tasks.workunit.client.1.smithi134.stdout:3/346: mknod de/c75 0 2024-09-17T04:20:51.350 INFO:tasks.workunit.client.1.smithi134.stdout:4/362: rename d0/c12 to d0/df/d1e/d63/c70 0 2024-09-17T04:20:51.380 INFO:tasks.workunit.client.1.smithi134.stdout:5/247: sync 2024-09-17T04:20:51.384 INFO:tasks.workunit.client.1.smithi134.stdout:5/248: truncate d0/da/d12/d41/f4d 769843 0 2024-09-17T04:20:51.385 INFO:tasks.workunit.client.1.smithi134.stdout:4/363: write d0/df/d1e/d20/f26 [581658,115922] 0 2024-09-17T04:20:51.386 INFO:tasks.workunit.client.1.smithi134.stdout:3/347: symlink de/d10/d70/l76 0 2024-09-17T04:20:51.432 INFO:tasks.workunit.client.1.smithi134.stdout:3/348: mkdir de/d12/d15/d1d/d2d/d63/d77 0 2024-09-17T04:20:51.433 INFO:tasks.workunit.client.1.smithi134.stdout:5/249: dwrite d0/d3a/d2b/f31 [0,4194304] 0 2024-09-17T04:20:51.437 INFO:tasks.workunit.client.1.smithi134.stdout:4/364: rename d0/df/d1e/d20/f4a to d0/df/d35/f71 0 2024-09-17T04:20:51.442 INFO:tasks.workunit.client.1.smithi134.stdout:5/250: rmdir d0/da/d29 39 2024-09-17T04:20:51.443 INFO:tasks.workunit.client.1.smithi134.stdout:5/251: fdatasync d0/d3a/fc 0 2024-09-17T04:20:51.443 INFO:tasks.workunit.client.1.smithi134.stdout:5/252: truncate d0/d3a/f3f 592968 0 2024-09-17T04:20:51.443 INFO:tasks.workunit.client.1.smithi134.stdout:4/365: fsync d0/d13/d40/d42/f4f 0 2024-09-17T04:20:51.444 INFO:tasks.workunit.client.1.smithi134.stdout:5/253: write d0/d3a/fc [5230503,40587] 0 2024-09-17T04:20:51.445 INFO:tasks.workunit.client.1.smithi134.stdout:0/243: sync 2024-09-17T04:20:51.446 INFO:tasks.workunit.client.1.smithi134.stdout:9/595: sync 2024-09-17T04:20:51.449 INFO:tasks.workunit.client.1.smithi134.stdout:4/366: dwrite d0/d3b/f58 [0,4194304] 0 2024-09-17T04:20:51.450 INFO:tasks.workunit.client.1.smithi134.stdout:9/596: mknod d2/d5/d37/cc5 0 2024-09-17T04:20:51.450 INFO:tasks.workunit.client.1.smithi134.stdout:0/244: read d11/f12 [1055368,38725] 0 2024-09-17T04:20:51.454 INFO:tasks.workunit.client.1.smithi134.stdout:9/597: creat d2/d78/fc6 x:0 0 0 2024-09-17T04:20:51.455 INFO:tasks.workunit.client.1.smithi134.stdout:4/367: mkdir d0/d13/d40/d72 0 2024-09-17T04:20:51.457 INFO:tasks.workunit.client.1.smithi134.stdout:0/245: write d11/f3b [922441,106699] 0 2024-09-17T04:20:51.457 INFO:tasks.workunit.client.1.smithi134.stdout:5/254: rmdir d0/da/d12 39 2024-09-17T04:20:51.459 INFO:tasks.workunit.client.1.smithi134.stdout:9/598: creat d2/d78/fc7 x:0 0 0 2024-09-17T04:20:51.463 INFO:tasks.workunit.client.1.smithi134.stdout:5/255: readlink d0/da/d12/l1a 0 2024-09-17T04:20:51.466 INFO:tasks.workunit.client.1.smithi134.stdout:9/599: dwrite d2/d5/d8/f19 [0,4194304] 0 2024-09-17T04:20:51.467 INFO:tasks.workunit.client.1.smithi134.stdout:5/256: creat d0/d48/f52 x:0 0 0 2024-09-17T04:20:51.471 INFO:tasks.workunit.client.1.smithi134.stdout:0/246: getdents d11/d48 0 2024-09-17T04:20:51.473 INFO:tasks.workunit.client.1.smithi134.stdout:4/368: dread d0/df/d1e/f2b [0,4194304] 0 2024-09-17T04:20:51.478 INFO:tasks.workunit.client.1.smithi134.stdout:5/257: truncate d0/f8 449935 0 2024-09-17T04:20:51.486 INFO:tasks.workunit.client.1.smithi134.stdout:5/258: unlink d0/da/d12/l42 0 2024-09-17T04:20:51.488 INFO:tasks.workunit.client.1.smithi134.stdout:0/247: link d11/d22/d1c/f54 d11/d22/d1c/d2f/d45/f59 0 2024-09-17T04:20:51.489 INFO:tasks.workunit.client.1.smithi134.stdout:4/369: dread d0/df/d1e/f25 [0,4194304] 0 2024-09-17T04:20:51.489 INFO:tasks.workunit.client.1.smithi134.stdout:4/370: chown d0/d3b/f5b 223063848 1 2024-09-17T04:20:51.490 INFO:tasks.workunit.client.1.smithi134.stdout:9/600: link d2/d5/d9/d6a/lc4 d2/d5/d9/df/lc8 0 2024-09-17T04:20:51.495 INFO:tasks.workunit.client.1.smithi134.stdout:9/601: symlink d2/d5/d8/d1e/d42/lc9 0 2024-09-17T04:20:51.496 INFO:tasks.workunit.client.1.smithi134.stdout:4/371: dwrite d0/d3b/f52 [0,4194304] 0 2024-09-17T04:20:51.499 INFO:tasks.workunit.client.1.smithi134.stdout:3/349: truncate de/d12/f47 4021373 0 2024-09-17T04:20:51.500 INFO:tasks.workunit.client.1.smithi134.stdout:0/248: dread fe [0,4194304] 0 2024-09-17T04:20:51.505 INFO:tasks.workunit.client.1.smithi134.stdout:9/602: dread d2/d5/d58/f85 [0,4194304] 0 2024-09-17T04:20:51.507 INFO:tasks.workunit.client.1.smithi134.stdout:3/350: truncate de/f41 5150385 0 2024-09-17T04:20:51.509 INFO:tasks.workunit.client.1.smithi134.stdout:0/249: dwrite d11/d22/d1c/d2f/d43/f44 [0,4194304] 0 2024-09-17T04:20:51.510 INFO:tasks.workunit.client.1.smithi134.stdout:4/372: mkdir d0/df/d1e/d73 0 2024-09-17T04:20:51.511 INFO:tasks.workunit.client.1.smithi134.stdout:0/250: stat d11/d22/d1c/d2f/d43/f44 0 2024-09-17T04:20:51.512 INFO:tasks.workunit.client.1.smithi134.stdout:5/259: getdents d0/d3a 0 2024-09-17T04:20:51.516 INFO:tasks.workunit.client.1.smithi134.stdout:3/351: mkdir de/d12/d15/d1d/d2d/d31/d6a/d78 0 2024-09-17T04:20:51.521 INFO:tasks.workunit.client.1.smithi134.stdout:4/373: dwrite d0/df/f18 [4194304,4194304] 0 2024-09-17T04:20:51.521 INFO:tasks.workunit.client.1.smithi134.stdout:0/251: readlink d11/d19/d21/l50 0 2024-09-17T04:20:51.526 INFO:tasks.workunit.client.1.smithi134.stdout:0/252: dwrite d11/d19/d21/f27 [0,4194304] 0 2024-09-17T04:20:51.532 INFO:tasks.workunit.client.1.smithi134.stdout:7/218: sync 2024-09-17T04:20:51.532 INFO:tasks.workunit.client.1.smithi134.stdout:4/374: getdents d0/df/d1e/d20/d65 0 2024-09-17T04:20:51.533 INFO:tasks.workunit.client.1.smithi134.stdout:5/260: creat d0/da/d12/f53 x:0 0 0 2024-09-17T04:20:51.535 INFO:tasks.workunit.client.1.smithi134.stdout:0/253: symlink d11/d22/d1c/d2f/l5a 0 2024-09-17T04:20:51.537 INFO:tasks.workunit.client.1.smithi134.stdout:4/375: dwrite d0/d13/d40/d42/f4f [0,4194304] 0 2024-09-17T04:20:51.541 INFO:tasks.workunit.client.1.smithi134.stdout:0/254: dread d11/d19/d21/f27 [0,4194304] 0 2024-09-17T04:20:51.544 INFO:tasks.workunit.client.1.smithi134.stdout:0/255: truncate d11/d19/d21/d37/f42 379214 0 2024-09-17T04:20:51.544 INFO:tasks.workunit.client.1.smithi134.stdout:4/376: dwrite d0/fb [4194304,4194304] 0 2024-09-17T04:20:51.545 INFO:tasks.workunit.client.1.smithi134.stdout:4/377: fdatasync d0/d3b/f61 0 2024-09-17T04:20:51.554 INFO:tasks.workunit.client.1.smithi134.stdout:0/256: rename f9 to d11/d24/d49/f5b 0 2024-09-17T04:20:51.555 INFO:tasks.workunit.client.1.smithi134.stdout:0/257: write d11/d24/f28 [1013304,81329] 0 2024-09-17T04:20:51.555 INFO:tasks.workunit.client.1.smithi134.stdout:4/378: rmdir d0/d13/d40/d42 39 2024-09-17T04:20:51.558 INFO:tasks.workunit.client.1.smithi134.stdout:5/261: creat d0/da/f54 x:0 0 0 2024-09-17T04:20:51.564 INFO:tasks.workunit.client.1.smithi134.stdout:9/603: write d2/d5/d8/d16/d54/daf/d6d/d84/f5c [1843021,20152] 0 2024-09-17T04:20:51.564 INFO:tasks.workunit.client.1.smithi134.stdout:9/604: chown d2/d25/f3c 263958487 1 2024-09-17T04:20:51.565 INFO:tasks.workunit.client.1.smithi134.stdout:0/258: mknod d11/d19/c5c 0 2024-09-17T04:20:51.565 INFO:tasks.workunit.client.1.smithi134.stdout:3/352: write de/d12/d15/d1d/d2d/f53 [1105063,63616] 0 2024-09-17T04:20:51.570 INFO:tasks.workunit.client.1.smithi134.stdout:9/605: rmdir d2/d78 39 2024-09-17T04:20:51.576 INFO:tasks.workunit.client.1.smithi134.stdout:5/262: symlink d0/da/d12/l55 0 2024-09-17T04:20:51.577 INFO:tasks.workunit.client.1.smithi134.stdout:1/272: sync 2024-09-17T04:20:51.577 INFO:tasks.workunit.client.1.smithi134.stdout:6/364: sync 2024-09-17T04:20:51.578 INFO:tasks.workunit.client.1.smithi134.stdout:8/280: sync 2024-09-17T04:20:51.578 INFO:tasks.workunit.client.1.smithi134.stdout:2/338: sync 2024-09-17T04:20:51.578 INFO:tasks.workunit.client.1.smithi134.stdout:7/219: getdents d0/dd/d3a/d3d/d38 0 2024-09-17T04:20:51.579 INFO:tasks.workunit.client.1.smithi134.stdout:9/606: mkdir d2/d7/d75/d96/dca 0 2024-09-17T04:20:51.580 INFO:tasks.workunit.client.1.smithi134.stdout:0/259: mkdir d11/d22/d1c/d2f/d43/d5d 0 2024-09-17T04:20:51.583 INFO:tasks.workunit.client.1.smithi134.stdout:5/263: read - d0/da/d2c/f4b zero size 2024-09-17T04:20:51.588 INFO:tasks.workunit.client.1.smithi134.stdout:1/273: rename d12/d36/l39 to d12/d36/l57 0 2024-09-17T04:20:51.590 INFO:tasks.workunit.client.1.smithi134.stdout:9/607: creat d2/d5/d8/d16/d54/daf/d6d/daa/fcb x:0 0 0 2024-09-17T04:20:51.598 INFO:tasks.workunit.client.1.smithi134.stdout:3/353: creat de/d10/f79 x:0 0 0 2024-09-17T04:20:51.599 INFO:tasks.workunit.client.1.smithi134.stdout:4/379: truncate d0/d3b/f58 720584 0 2024-09-17T04:20:51.601 INFO:tasks.workunit.client.1.smithi134.stdout:9/608: mkdir d2/d5/d8/d16/dcc 0 2024-09-17T04:20:51.602 INFO:tasks.workunit.client.1.smithi134.stdout:5/264: symlink d0/l56 0 2024-09-17T04:20:51.603 INFO:tasks.workunit.client.1.smithi134.stdout:4/380: dread d0/df/f18 [4194304,4194304] 0 2024-09-17T04:20:51.604 INFO:tasks.workunit.client.1.smithi134.stdout:8/281: rmdir d4/d53 0 2024-09-17T04:20:51.605 INFO:tasks.workunit.client.1.smithi134.stdout:3/354: dwrite de/d12/d22/d5a/f5d [0,4194304] 0 2024-09-17T04:20:51.607 INFO:tasks.workunit.client.1.smithi134.stdout:2/339: creat d19/d27/d31/d34/f70 x:0 0 0 2024-09-17T04:20:51.610 INFO:tasks.workunit.client.1.smithi134.stdout:9/609: chown d2/d78/fc6 262832 1 2024-09-17T04:20:51.610 INFO:tasks.workunit.client.1.smithi134.stdout:8/282: chown d4/db/df/d13/c52 1 1 2024-09-17T04:20:51.613 INFO:tasks.workunit.client.1.smithi134.stdout:0/260: dwrite f10 [0,4194304] 0 2024-09-17T04:20:51.614 INFO:tasks.workunit.client.1.smithi134.stdout:2/340: unlink d19/d27/d31/l4d 0 2024-09-17T04:20:51.618 INFO:tasks.workunit.client.1.smithi134.stdout:2/341: dread d19/d1c/f1f [4194304,4194304] 0 2024-09-17T04:20:51.619 INFO:tasks.workunit.client.1.smithi134.stdout:3/355: rename de/d12/d22/d5a/l73 to de/d12/d15/l7a 0 2024-09-17T04:20:51.622 INFO:tasks.workunit.client.1.smithi134.stdout:0/261: creat d11/d18/f5e x:0 0 0 2024-09-17T04:20:51.623 INFO:tasks.workunit.client.1.smithi134.stdout:5/265: link d0/d3a/d2b/c32 d0/d3a/d2b/c57 0 2024-09-17T04:20:51.624 INFO:tasks.workunit.client.1.smithi134.stdout:6/365: dwrite fb [0,4194304] 0 2024-09-17T04:20:51.626 INFO:tasks.workunit.client.1.smithi134.stdout:6/366: stat de/d2b/f50 0 2024-09-17T04:20:51.627 INFO:tasks.workunit.client.1.smithi134.stdout:9/610: rename d2/d5/d8/d1e/d42 to d2/d5/d8/d16/dcc/dcd 0 2024-09-17T04:20:51.628 INFO:tasks.workunit.client.1.smithi134.stdout:5/266: write d0/da/d12/d41/f4d [1176950,63472] 0 2024-09-17T04:20:51.629 INFO:tasks.workunit.client.1.smithi134.stdout:6/367: read - de/d19/d1f/f73 zero size 2024-09-17T04:20:51.631 INFO:tasks.workunit.client.1.smithi134.stdout:2/342: creat d19/d27/d31/d34/d6d/f71 x:0 0 0 2024-09-17T04:20:51.632 INFO:tasks.workunit.client.1.smithi134.stdout:4/381: link d0/df/d1e/d20/f21 d0/d3b/f74 0 2024-09-17T04:20:51.635 INFO:tasks.workunit.client.1.smithi134.stdout:2/343: readlink d19/l20 0 2024-09-17T04:20:51.635 INFO:tasks.workunit.client.1.smithi134.stdout:3/356: truncate de/d12/f47 4456932 0 2024-09-17T04:20:51.636 INFO:tasks.workunit.client.1.smithi134.stdout:0/262: dwrite d11/d18/f57 [0,4194304] 0 2024-09-17T04:20:51.637 INFO:tasks.workunit.client.1.smithi134.stdout:0/263: readlink d11/l16 0 2024-09-17T04:20:51.638 INFO:tasks.workunit.client.1.smithi134.stdout:8/283: dread d4/db/df/f12 [0,4194304] 0 2024-09-17T04:20:51.639 INFO:tasks.workunit.client.1.smithi134.stdout:9/611: rename d2/d5/d58/f81 to d2/d7/d75/d96/fce 0 2024-09-17T04:20:51.642 INFO:tasks.workunit.client.1.smithi134.stdout:0/264: write d11/d18/f1e [858519,45391] 0 2024-09-17T04:20:51.643 INFO:tasks.workunit.client.1.smithi134.stdout:2/344: mkdir d19/d27/d31/d49/d72 0 2024-09-17T04:20:51.645 INFO:tasks.workunit.client.1.smithi134.stdout:5/267: dwrite d0/d48/f4f [0,4194304] 0 2024-09-17T04:20:51.646 INFO:tasks.workunit.client.1.smithi134.stdout:2/345: dread - d19/d27/d31/d49/d63/f68 zero size 2024-09-17T04:20:51.647 INFO:tasks.workunit.client.1.smithi134.stdout:5/268: chown d0/da/d12/l27 0 1 2024-09-17T04:20:51.647 INFO:tasks.workunit.client.1.smithi134.stdout:6/368: link de/d19/d21/d4d/c6e de/d19/d1f/c75 0 2024-09-17T04:20:51.648 INFO:tasks.workunit.client.1.smithi134.stdout:5/269: write d0/d3a/fc [1276513,68213] 0 2024-09-17T04:20:51.651 INFO:tasks.workunit.client.1.smithi134.stdout:8/284: rename d4/l8 to d4/db/df/l54 0 2024-09-17T04:20:51.653 INFO:tasks.workunit.client.1.smithi134.stdout:8/285: truncate d4/d1f/f44 1165574 0 2024-09-17T04:20:51.655 INFO:tasks.workunit.client.1.smithi134.stdout:0/265: getdents d11/d48 0 2024-09-17T04:20:51.657 INFO:tasks.workunit.client.1.smithi134.stdout:4/382: truncate d0/df/d1e/f2e 194267 0 2024-09-17T04:20:51.658 INFO:tasks.workunit.client.1.smithi134.stdout:3/357: getdents de/d10/d70 0 2024-09-17T04:20:51.658 INFO:tasks.workunit.client.1.smithi134.stdout:5/270: dwrite d0/d3a/d2b/f43 [0,4194304] 0 2024-09-17T04:20:51.661 INFO:tasks.workunit.client.1.smithi134.stdout:3/358: chown la 2010846 1 2024-09-17T04:20:51.663 INFO:tasks.workunit.client.1.smithi134.stdout:6/369: write de/f3a [310559,33841] 0 2024-09-17T04:20:51.665 INFO:tasks.workunit.client.1.smithi134.stdout:0/266: read d11/d18/f36 [2544105,9923] 0 2024-09-17T04:20:51.665 INFO:tasks.workunit.client.1.smithi134.stdout:4/383: rename d0/df/d1e/c54 to d0/df/d35/d5c/c75 0 2024-09-17T04:20:51.668 INFO:tasks.workunit.client.1.smithi134.stdout:5/271: rename d0/d3a/d2b/f44 to d0/d3a/d2b/f58 0 2024-09-17T04:20:51.672 INFO:tasks.workunit.client.1.smithi134.stdout:9/612: dwrite d2/d5/d9/f1c [0,4194304] 0 2024-09-17T04:20:51.674 INFO:tasks.workunit.client.1.smithi134.stdout:8/286: dwrite d4/fe [0,4194304] 0 2024-09-17T04:20:51.674 INFO:tasks.workunit.client.1.smithi134.stdout:0/267: write d11/d18/f3d [3408248,78528] 0 2024-09-17T04:20:51.677 INFO:tasks.workunit.client.1.smithi134.stdout:2/346: dwrite f16 [0,4194304] 0 2024-09-17T04:20:51.677 INFO:tasks.workunit.client.1.smithi134.stdout:0/268: readlink d11/l16 0 2024-09-17T04:20:51.678 INFO:tasks.workunit.client.1.smithi134.stdout:4/384: mknod d0/df/d35/d39/c76 0 2024-09-17T04:20:51.678 INFO:tasks.workunit.client.1.smithi134.stdout:7/220: sync 2024-09-17T04:20:51.679 INFO:tasks.workunit.client.1.smithi134.stdout:3/359: link de/d12/d22/l58 de/d10/d3d/l7b 0 2024-09-17T04:20:51.681 INFO:tasks.workunit.client.1.smithi134.stdout:5/272: dread - d0/da/f2e zero size 2024-09-17T04:20:51.682 INFO:tasks.workunit.client.1.smithi134.stdout:2/347: read f1 [6358366,62668] 0 2024-09-17T04:20:51.685 INFO:tasks.workunit.client.1.smithi134.stdout:7/221: dread - d0/dd/f27 zero size 2024-09-17T04:20:51.685 INFO:tasks.workunit.client.1.smithi134.stdout:8/287: rmdir d4/d1f/d2b 39 2024-09-17T04:20:51.687 INFO:tasks.workunit.client.1.smithi134.stdout:0/269: unlink d11/d48/f56 0 2024-09-17T04:20:51.689 INFO:tasks.workunit.client.1.smithi134.stdout:4/385: read d0/df/d1e/f25 [452787,78549] 0 2024-09-17T04:20:51.690 INFO:tasks.workunit.client.1.smithi134.stdout:6/370: dwrite de/d19/d62/f20 [0,4194304] 0 2024-09-17T04:20:51.691 INFO:tasks.workunit.client.1.smithi134.stdout:4/386: chown d0/df/f4e 133141372 1 2024-09-17T04:20:51.691 INFO:tasks.workunit.client.1.smithi134.stdout:5/273: unlink d0/d3a/d2b/f45 0 2024-09-17T04:20:51.692 INFO:tasks.workunit.client.1.smithi134.stdout:6/371: dread - de/d2b/f50 zero size 2024-09-17T04:20:51.692 INFO:tasks.workunit.client.1.smithi134.stdout:7/222: mknod d0/dd/d3a/d3d/c47 0 2024-09-17T04:20:51.693 INFO:tasks.workunit.client.1.smithi134.stdout:6/372: dread - de/d19/d21/d2d/f6a zero size 2024-09-17T04:20:51.694 INFO:tasks.workunit.client.1.smithi134.stdout:0/270: creat d11/d19/d21/f5f x:0 0 0 2024-09-17T04:20:51.697 INFO:tasks.workunit.client.1.smithi134.stdout:4/387: mknod d0/df/d1e/d63/c77 0 2024-09-17T04:20:51.697 INFO:tasks.workunit.client.1.smithi134.stdout:3/360: mkdir de/d12/d15/d1d/d2d/d31/d6a/d78/d7c 0 2024-09-17T04:20:51.697 INFO:tasks.workunit.client.1.smithi134.stdout:5/274: mknod d0/d3a/c59 0 2024-09-17T04:20:51.698 INFO:tasks.workunit.client.1.smithi134.stdout:4/388: chown d0/d3b/f52 4 1 2024-09-17T04:20:51.698 INFO:tasks.workunit.client.1.smithi134.stdout:2/348: creat d19/f73 x:0 0 0 2024-09-17T04:20:51.699 INFO:tasks.workunit.client.1.smithi134.stdout:5/275: chown d0/da/d12 1 1 2024-09-17T04:20:51.700 INFO:tasks.workunit.client.1.smithi134.stdout:9/613: getdents d2/d5/d8/d1e 0 2024-09-17T04:20:51.702 INFO:tasks.workunit.client.1.smithi134.stdout:7/223: dwrite d0/f19 [0,4194304] 0 2024-09-17T04:20:51.702 INFO:tasks.workunit.client.1.smithi134.stdout:0/271: creat d11/d19/d21/f60 x:0 0 0 2024-09-17T04:20:51.703 INFO:tasks.workunit.client.1.smithi134.stdout:0/272: readlink d11/d19/l2a 0 2024-09-17T04:20:51.703 INFO:tasks.workunit.client.1.smithi134.stdout:6/373: mknod de/d19/d1f/c76 0 2024-09-17T04:20:51.705 INFO:tasks.workunit.client.1.smithi134.stdout:3/361: unlink de/d10/c28 0 2024-09-17T04:20:51.706 INFO:tasks.workunit.client.1.smithi134.stdout:5/276: mkdir d0/d3a/d2b/d5a 0 2024-09-17T04:20:51.710 INFO:tasks.workunit.client.1.smithi134.stdout:9/614: chown d2/d5/d8/d16/fd 1037172 1 2024-09-17T04:20:51.710 INFO:tasks.workunit.client.1.smithi134.stdout:4/389: mkdir d0/d78 0 2024-09-17T04:20:51.711 INFO:tasks.workunit.client.1.smithi134.stdout:5/277: dread - d0/d3a/d2b/f51 zero size 2024-09-17T04:20:51.714 INFO:tasks.workunit.client.1.smithi134.stdout:2/349: rename d19/d27/d31/d34/d6d/f71 to d19/f74 0 2024-09-17T04:20:51.715 INFO:tasks.workunit.client.1.smithi134.stdout:3/362: rename de/d10/d3d/f52 to de/d10/d3d/f7d 0 2024-09-17T04:20:51.715 INFO:tasks.workunit.client.1.smithi134.stdout:0/273: dwrite d11/d22/f3a [0,4194304] 0 2024-09-17T04:20:51.718 INFO:tasks.workunit.client.1.smithi134.stdout:1/274: sync 2024-09-17T04:20:51.718 INFO:tasks.workunit.client.1.smithi134.stdout:8/288: dread f0 [0,4194304] 0 2024-09-17T04:20:51.720 INFO:tasks.workunit.client.1.smithi134.stdout:4/390: mknod d0/d13/d40/d72/c79 0 2024-09-17T04:20:51.723 INFO:tasks.workunit.client.1.smithi134.stdout:0/274: mknod d11/d19/d21/c61 0 2024-09-17T04:20:51.725 INFO:tasks.workunit.client.1.smithi134.stdout:1/275: symlink d12/d1c/l58 0 2024-09-17T04:20:51.726 INFO:tasks.workunit.client.1.smithi134.stdout:3/363: unlink de/c14 0 2024-09-17T04:20:51.727 INFO:tasks.workunit.client.1.smithi134.stdout:4/391: rename d0/df/d35/c5d to d0/df/d1e/d63/c7a 0 2024-09-17T04:20:51.727 INFO:tasks.workunit.client.1.smithi134.stdout:7/224: dread d0/f15 [0,4194304] 0 2024-09-17T04:20:51.728 INFO:tasks.workunit.client.1.smithi134.stdout:7/225: chown d0/d16/d35/d36/l39 0 1 2024-09-17T04:20:51.729 INFO:tasks.workunit.client.1.smithi134.stdout:7/226: chown d0/f33 12563 1 2024-09-17T04:20:51.730 INFO:tasks.workunit.client.1.smithi134.stdout:4/392: mkdir d0/df/d1e/d20/d7b 0 2024-09-17T04:20:51.731 INFO:tasks.workunit.client.1.smithi134.stdout:1/276: fsync d12/f1b 0 2024-09-17T04:20:51.732 INFO:tasks.workunit.client.1.smithi134.stdout:7/227: dread d0/f20 [0,4194304] 0 2024-09-17T04:20:51.733 INFO:tasks.workunit.client.1.smithi134.stdout:3/364: symlink de/d12/l7e 0 2024-09-17T04:20:51.734 INFO:tasks.workunit.client.1.smithi134.stdout:9/615: write d2/d5/f68 [735429,12738] 0 2024-09-17T04:20:51.734 INFO:tasks.workunit.client.1.smithi134.stdout:4/393: creat d0/df/d35/d39/f7c x:0 0 0 2024-09-17T04:20:51.736 INFO:tasks.workunit.client.1.smithi134.stdout:5/278: truncate d0/d3a/d2b/f43 2754898 0 2024-09-17T04:20:51.736 INFO:tasks.workunit.client.1.smithi134.stdout:7/228: write d0/f1c [784955,88917] 0 2024-09-17T04:20:51.737 INFO:tasks.workunit.client.1.smithi134.stdout:1/277: mkdir d12/d1c/d59 0 2024-09-17T04:20:51.737 INFO:tasks.workunit.client.1.smithi134.stdout:6/374: dread de/d19/d1f/f28 [0,4194304] 0 2024-09-17T04:20:51.738 INFO:tasks.workunit.client.1.smithi134.stdout:9/616: truncate d2/d78/fc0 303134 0 2024-09-17T04:20:51.740 INFO:tasks.workunit.client.1.smithi134.stdout:0/275: truncate d11/d18/f1f 2066356 0 2024-09-17T04:20:51.741 INFO:tasks.workunit.client.1.smithi134.stdout:4/394: symlink d0/df/d1e/d73/l7d 0 2024-09-17T04:20:51.741 INFO:tasks.workunit.client.1.smithi134.stdout:4/395: chown d0/df/f18 23644 1 2024-09-17T04:20:51.742 INFO:tasks.workunit.client.1.smithi134.stdout:1/278: creat d12/d1c/d2e/f5a x:0 0 0 2024-09-17T04:20:51.742 INFO:tasks.workunit.client.1.smithi134.stdout:1/279: readlink d12/d19/d1d/l32 0 2024-09-17T04:20:51.742 INFO:tasks.workunit.client.1.smithi134.stdout:7/229: creat d0/d16/d35/d36/f48 x:0 0 0 2024-09-17T04:20:51.744 INFO:tasks.workunit.client.1.smithi134.stdout:7/230: write d0/dd/f27 [175025,125406] 0 2024-09-17T04:20:51.745 INFO:tasks.workunit.client.1.smithi134.stdout:9/617: mkdir d2/d5/d8/d16/dcc/dcf 0 2024-09-17T04:20:51.746 INFO:tasks.workunit.client.1.smithi134.stdout:0/276: mkdir d11/d24/d49/d62 0 2024-09-17T04:20:51.747 INFO:tasks.workunit.client.1.smithi134.stdout:4/396: chown d0/d3b/f58 3 1 2024-09-17T04:20:51.747 INFO:tasks.workunit.client.1.smithi134.stdout:0/277: dread - d11/d19/d21/f5f zero size 2024-09-17T04:20:51.748 INFO:tasks.workunit.client.1.smithi134.stdout:7/231: write d0/d16/f13 [3085451,113948] 0 2024-09-17T04:20:51.750 INFO:tasks.workunit.client.1.smithi134.stdout:5/279: getdents d0/d3a 0 2024-09-17T04:20:51.751 INFO:tasks.workunit.client.1.smithi134.stdout:9/618: mkdir d2/d5/dd0 0 2024-09-17T04:20:51.752 INFO:tasks.workunit.client.1.smithi134.stdout:0/278: mknod d11/d18/c63 0 2024-09-17T04:20:51.754 INFO:tasks.workunit.client.1.smithi134.stdout:7/232: creat d0/d16/d35/f49 x:0 0 0 2024-09-17T04:20:51.757 INFO:tasks.workunit.client.1.smithi134.stdout:4/397: dread d0/df/d1e/d20/f21 [0,4194304] 0 2024-09-17T04:20:51.757 INFO:tasks.workunit.client.1.smithi134.stdout:3/365: dwrite de/d12/d15/f4d [0,4194304] 0 2024-09-17T04:20:51.757 INFO:tasks.workunit.client.1.smithi134.stdout:9/619: write d2/d7/d75/d96/fce [2053591,118646] 0 2024-09-17T04:20:51.760 INFO:tasks.workunit.client.1.smithi134.stdout:3/366: rmdir de/d12/d15 39 2024-09-17T04:20:51.763 INFO:tasks.workunit.client.1.smithi134.stdout:7/233: creat d0/dd/d3a/f4a x:0 0 0 2024-09-17T04:20:51.763 INFO:tasks.workunit.client.1.smithi134.stdout:9/620: dread d2/d5/d58/f85 [0,4194304] 0 2024-09-17T04:20:51.763 INFO:tasks.workunit.client.1.smithi134.stdout:5/280: dread d0/d3a/d2b/f43 [0,4194304] 0 2024-09-17T04:20:51.764 INFO:tasks.workunit.client.1.smithi134.stdout:9/621: chown d2/l8f 105 1 2024-09-17T04:20:51.764 INFO:tasks.workunit.client.1.smithi134.stdout:1/280: dread d12/d19/d1d/f27 [0,4194304] 0 2024-09-17T04:20:51.765 INFO:tasks.workunit.client.1.smithi134.stdout:4/398: dread d0/df/d1e/f2e [0,4194304] 0 2024-09-17T04:20:51.765 INFO:tasks.workunit.client.1.smithi134.stdout:3/367: chown de/d10/d3d/l5e 2888810 1 2024-09-17T04:20:51.767 INFO:tasks.workunit.client.1.smithi134.stdout:7/234: rename d0/d16/d35/d36 to d0/d16/d35/d4b 0 2024-09-17T04:20:51.768 INFO:tasks.workunit.client.1.smithi134.stdout:1/281: mknod d12/d1c/d4a/c5b 0 2024-09-17T04:20:51.768 INFO:tasks.workunit.client.1.smithi134.stdout:0/279: truncate d11/f14 2069606 0 2024-09-17T04:20:51.770 INFO:tasks.workunit.client.1.smithi134.stdout:3/368: write de/d12/d22/d5a/f71 [192958,100565] 0 2024-09-17T04:20:51.770 INFO:tasks.workunit.client.1.smithi134.stdout:4/399: rename d0/d13/f3c to d0/df/d1e/d20/f7e 0 2024-09-17T04:20:51.771 INFO:tasks.workunit.client.1.smithi134.stdout:7/235: mkdir d0/dd/d3a/d3d/d4c 0 2024-09-17T04:20:51.771 INFO:tasks.workunit.client.1.smithi134.stdout:1/282: rmdir d12/d1c/d2e 39 2024-09-17T04:20:51.773 INFO:tasks.workunit.client.1.smithi134.stdout:4/400: chown d0/d13/f14 70196 1 2024-09-17T04:20:51.774 INFO:tasks.workunit.client.1.smithi134.stdout:1/283: chown d12/f42 29120920 1 2024-09-17T04:20:51.775 INFO:tasks.workunit.client.1.smithi134.stdout:0/280: getdents d11/d18 0 2024-09-17T04:20:51.776 INFO:tasks.workunit.client.1.smithi134.stdout:9/622: dwrite d2/d5/d8/d16/d54/daf/fa1 [0,4194304] 0 2024-09-17T04:20:51.777 INFO:tasks.workunit.client.1.smithi134.stdout:1/284: write d12/d19/f25 [502876,17807] 0 2024-09-17T04:20:51.779 INFO:tasks.workunit.client.1.smithi134.stdout:9/623: fdatasync d2/d78/fc0 0 2024-09-17T04:20:51.779 INFO:tasks.workunit.client.1.smithi134.stdout:0/281: mknod d11/d4c/c64 0 2024-09-17T04:20:51.782 INFO:tasks.workunit.client.1.smithi134.stdout:9/624: symlink d2/ld1 0 2024-09-17T04:20:51.783 INFO:tasks.workunit.client.1.smithi134.stdout:3/369: dread de/d12/d15/f1f [0,4194304] 0 2024-09-17T04:20:51.785 INFO:tasks.workunit.client.1.smithi134.stdout:7/236: dwrite d0/d16/d35/d4b/f48 [0,4194304] 0 2024-09-17T04:20:51.787 INFO:tasks.workunit.client.1.smithi134.stdout:1/285: read d12/d1c/f2f [81862,70040] 0 2024-09-17T04:20:51.790 INFO:tasks.workunit.client.1.smithi134.stdout:1/286: chown d12/d36/c43 0 1 2024-09-17T04:20:51.793 INFO:tasks.workunit.client.1.smithi134.stdout:9/625: dwrite d2/d78/fc6 [0,4194304] 0 2024-09-17T04:20:51.795 INFO:tasks.workunit.client.1.smithi134.stdout:7/237: dread d0/dd/f1a [0,4194304] 0 2024-09-17T04:20:51.795 INFO:tasks.workunit.client.1.smithi134.stdout:9/626: chown d2/c2c 83 1 2024-09-17T04:20:51.797 INFO:tasks.workunit.client.1.smithi134.stdout:7/238: fdatasync d0/dd/d3a/d3d/d38/f3c 0 2024-09-17T04:20:51.798 INFO:tasks.workunit.client.1.smithi134.stdout:1/287: dwrite d12/d19/d1d/f27 [0,4194304] 0 2024-09-17T04:20:51.798 INFO:tasks.workunit.client.1.smithi134.stdout:9/627: fsync d2/d5/d8/d16/d54/daf/d6d/daa/fad 0 2024-09-17T04:20:51.799 INFO:tasks.workunit.client.1.smithi134.stdout:7/239: mknod d0/dd/c4d 0 2024-09-17T04:20:51.800 INFO:tasks.workunit.client.1.smithi134.stdout:7/240: chown d0/dd/f27 23652438 1 2024-09-17T04:20:51.802 INFO:tasks.workunit.client.1.smithi134.stdout:1/288: unlink d12/f1b 0 2024-09-17T04:20:51.803 INFO:tasks.workunit.client.1.smithi134.stdout:9/628: symlink d2/d5/d8/ld2 0 2024-09-17T04:20:51.803 INFO:tasks.workunit.client.1.smithi134.stdout:7/241: rmdir d0/dd 39 2024-09-17T04:20:51.807 INFO:tasks.workunit.client.1.smithi134.stdout:1/289: mkdir d12/d19/d5c 0 2024-09-17T04:20:51.807 INFO:tasks.workunit.client.1.smithi134.stdout:9/629: mknod d2/d5/d37/d3f/cd3 0 2024-09-17T04:20:51.808 INFO:tasks.workunit.client.1.smithi134.stdout:7/242: symlink d0/dd/d3a/d3d/l4e 0 2024-09-17T04:20:51.809 INFO:tasks.workunit.client.1.smithi134.stdout:9/630: dread - d2/d5/d8/d1e/f9c zero size 2024-09-17T04:20:51.810 INFO:tasks.workunit.client.1.smithi134.stdout:1/290: mkdir d12/d19/d5d 0 2024-09-17T04:20:51.810 INFO:tasks.workunit.client.1.smithi134.stdout:9/631: truncate d2/d5/d37/f47 111285 0 2024-09-17T04:20:51.851 INFO:tasks.workunit.client.1.smithi134.stdout:1/291: symlink d12/d19/d1d/d3e/l5e 0 2024-09-17T04:20:51.852 INFO:tasks.workunit.client.1.smithi134.stdout:9/632: rename d2/c2c to d2/d5/d8/cd4 0 2024-09-17T04:20:51.853 INFO:tasks.workunit.client.1.smithi134.stdout:7/243: dwrite d0/dd/f27 [0,4194304] 0 2024-09-17T04:20:51.855 INFO:tasks.workunit.client.1.smithi134.stdout:5/281: dread d0/f8 [0,4194304] 0 2024-09-17T04:20:51.857 INFO:tasks.workunit.client.1.smithi134.stdout:9/633: symlink d2/d5/d8/d16/d54/daf/d6d/daa/ld5 0 2024-09-17T04:20:51.858 INFO:tasks.workunit.client.1.smithi134.stdout:5/282: readlink d0/da/l28 0 2024-09-17T04:20:51.860 INFO:tasks.workunit.client.1.smithi134.stdout:6/375: dread de/f12 [0,4194304] 0 2024-09-17T04:20:51.864 INFO:tasks.workunit.client.1.smithi134.stdout:9/634: dread d2/d5/d9/df/d38/f99 [0,4194304] 0 2024-09-17T04:20:51.865 INFO:tasks.workunit.client.1.smithi134.stdout:1/292: write d12/d1c/f24 [5436525,92971] 0 2024-09-17T04:20:51.867 INFO:tasks.workunit.client.1.smithi134.stdout:7/244: fsync d0/dd/f27 0 2024-09-17T04:20:51.869 INFO:tasks.workunit.client.1.smithi134.stdout:5/283: dwrite d0/da/f54 [0,4194304] 0 2024-09-17T04:20:51.870 INFO:tasks.workunit.client.1.smithi134.stdout:1/293: read d12/d1c/f24 [4638837,9106] 0 2024-09-17T04:20:51.872 INFO:tasks.workunit.client.1.smithi134.stdout:9/635: mkdir d2/d5/d8/d16/dcc/dcd/dd6 0 2024-09-17T04:20:51.872 INFO:tasks.workunit.client.1.smithi134.stdout:7/245: write d0/dd/f27 [2614436,116051] 0 2024-09-17T04:20:51.873 INFO:tasks.workunit.client.1.smithi134.stdout:1/294: chown d12/d1c/d4a/f4c 25507112 1 2024-09-17T04:20:51.874 INFO:tasks.workunit.client.1.smithi134.stdout:5/284: write d0/d48/f52 [898233,49685] 0 2024-09-17T04:20:51.874 INFO:tasks.workunit.client.1.smithi134.stdout:6/376: dwrite de/d2b/f71 [0,4194304] 0 2024-09-17T04:20:51.877 INFO:tasks.workunit.client.1.smithi134.stdout:1/295: mkdir d12/d19/d1d/d5f 0 2024-09-17T04:20:51.878 INFO:tasks.workunit.client.1.smithi134.stdout:0/282: dread d11/f13 [0,4194304] 0 2024-09-17T04:20:51.879 INFO:tasks.workunit.client.1.smithi134.stdout:9/636: creat d2/d5/d8/d16/d54/daf/d6d/daa/fd7 x:0 0 0 2024-09-17T04:20:51.880 INFO:tasks.workunit.client.1.smithi134.stdout:0/283: fsync d11/d24/f28 0 2024-09-17T04:20:51.881 INFO:tasks.workunit.client.1.smithi134.stdout:6/377: dread de/f12 [0,4194304] 0 2024-09-17T04:20:51.882 INFO:tasks.workunit.client.1.smithi134.stdout:5/285: getdents d0/da/d29 0 2024-09-17T04:20:51.883 INFO:tasks.workunit.client.1.smithi134.stdout:0/284: mknod d11/d24/d49/c65 0 2024-09-17T04:20:51.884 INFO:tasks.workunit.client.1.smithi134.stdout:0/285: fdatasync f10 0 2024-09-17T04:20:51.884 INFO:tasks.workunit.client.1.smithi134.stdout:6/378: write de/d19/d21/d4d/f6f [53395,35180] 0 2024-09-17T04:20:51.888 INFO:tasks.workunit.client.1.smithi134.stdout:9/637: link d2/l12 d2/d7/d75/ld8 0 2024-09-17T04:20:51.894 INFO:tasks.workunit.client.1.smithi134.stdout:1/296: dwrite d12/f1a [0,4194304] 0 2024-09-17T04:20:51.897 INFO:tasks.workunit.client.1.smithi134.stdout:9/638: unlink d2/d5/d8/d16/d54/daf/d6d/daa/fad 0 2024-09-17T04:20:51.897 INFO:tasks.workunit.client.1.smithi134.stdout:6/379: dread de/d2b/f43 [0,4194304] 0 2024-09-17T04:20:51.898 INFO:tasks.workunit.client.1.smithi134.stdout:1/297: write d12/d19/f30 [6131750,70478] 0 2024-09-17T04:20:51.899 INFO:tasks.workunit.client.1.smithi134.stdout:6/380: chown fd 137 1 2024-09-17T04:20:51.899 INFO:tasks.workunit.client.1.smithi134.stdout:9/639: chown d2/l4 2361664 1 2024-09-17T04:20:51.901 INFO:tasks.workunit.client.1.smithi134.stdout:6/381: write de/d19/d62/d34/f72 [105447,22080] 0 2024-09-17T04:20:51.901 INFO:tasks.workunit.client.1.smithi134.stdout:1/298: mknod d12/d36/c60 0 2024-09-17T04:20:51.902 INFO:tasks.workunit.client.1.smithi134.stdout:9/640: creat d2/d5/dd0/fd9 x:0 0 0 2024-09-17T04:20:51.902 INFO:tasks.workunit.client.1.smithi134.stdout:1/299: write d12/d1c/f2f [1444282,90622] 0 2024-09-17T04:20:51.903 INFO:tasks.workunit.client.1.smithi134.stdout:1/300: chown d12/d19/l41 52520 1 2024-09-17T04:20:51.904 INFO:tasks.workunit.client.1.smithi134.stdout:6/382: mkdir de/d19/d1f/d55/d77 0 2024-09-17T04:20:51.904 INFO:tasks.workunit.client.1.smithi134.stdout:9/641: readlink d2/d5/d9/d6a/l44 0 2024-09-17T04:20:51.905 INFO:tasks.workunit.client.1.smithi134.stdout:6/383: write de/f13 [5534101,61382] 0 2024-09-17T04:20:51.905 INFO:tasks.workunit.client.1.smithi134.stdout:1/301: mkdir d12/d19/d1d/d61 0 2024-09-17T04:20:51.905 INFO:tasks.workunit.client.1.smithi134.stdout:9/642: dread - d2/d5/d8/d1e/f9c zero size 2024-09-17T04:20:51.908 INFO:tasks.workunit.client.1.smithi134.stdout:1/302: mknod d12/d19/d1d/d61/c62 0 2024-09-17T04:20:51.909 INFO:tasks.workunit.client.1.smithi134.stdout:1/303: dread - d12/d19/d1d/f44 zero size 2024-09-17T04:20:51.910 INFO:tasks.workunit.client.1.smithi134.stdout:9/643: mknod d2/d7/cda 0 2024-09-17T04:20:51.910 INFO:tasks.workunit.client.1.smithi134.stdout:6/384: dread de/d19/d21/d2d/f2f [0,4194304] 0 2024-09-17T04:20:51.911 INFO:tasks.workunit.client.1.smithi134.stdout:1/304: mkdir d12/d1c/d4a/d63 0 2024-09-17T04:20:51.912 INFO:tasks.workunit.client.1.smithi134.stdout:9/644: dread - d2/d5/d9/df/fb8 zero size 2024-09-17T04:20:51.912 INFO:tasks.workunit.client.1.smithi134.stdout:6/385: chown de/d19/f24 495 1 2024-09-17T04:20:51.913 INFO:tasks.workunit.client.1.smithi134.stdout:9/645: fdatasync d2/d5/f68 0 2024-09-17T04:20:51.914 INFO:tasks.workunit.client.1.smithi134.stdout:1/305: creat d12/d19/f64 x:0 0 0 2024-09-17T04:20:51.915 INFO:tasks.workunit.client.1.smithi134.stdout:6/386: chown de/d19/d21/d2d/d4c/c69 212 1 2024-09-17T04:20:51.916 INFO:tasks.workunit.client.1.smithi134.stdout:0/286: dwrite d11/f14 [0,4194304] 0 2024-09-17T04:20:51.917 INFO:tasks.workunit.client.1.smithi134.stdout:9/646: write d2/d5/d8/d16/d54/daf/f95 [1372050,76749] 0 2024-09-17T04:20:51.918 INFO:tasks.workunit.client.1.smithi134.stdout:6/387: write de/d2b/f71 [1198923,70440] 0 2024-09-17T04:20:51.921 INFO:tasks.workunit.client.1.smithi134.stdout:9/647: symlink d2/d78/ldb 0 2024-09-17T04:20:51.924 INFO:tasks.workunit.client.1.smithi134.stdout:0/287: creat d11/d22/d1c/d2f/f66 x:0 0 0 2024-09-17T04:20:51.924 INFO:tasks.workunit.client.1.smithi134.stdout:1/306: dwrite d12/d19/d1d/f27 [4194304,4194304] 0 2024-09-17T04:20:51.929 INFO:tasks.workunit.client.1.smithi134.stdout:6/388: mknod de/d19/d21/c78 0 2024-09-17T04:20:51.929 INFO:tasks.workunit.client.1.smithi134.stdout:0/288: creat d11/d18/f67 x:0 0 0 2024-09-17T04:20:51.934 INFO:tasks.workunit.client.1.smithi134.stdout:6/389: mknod de/d19/d1f/d5c/c79 0 2024-09-17T04:20:51.936 INFO:tasks.workunit.client.1.smithi134.stdout:1/307: rename c0 to d12/d19/c65 0 2024-09-17T04:20:51.937 INFO:tasks.workunit.client.1.smithi134.stdout:1/308: truncate d12/d1c/f4e 575868 0 2024-09-17T04:20:51.938 INFO:tasks.workunit.client.1.smithi134.stdout:6/390: creat de/d19/d21/f7a x:0 0 0 2024-09-17T04:20:51.940 INFO:tasks.workunit.client.1.smithi134.stdout:9/648: write d2/d5/d8/d16/f72 [3014851,126069] 0 2024-09-17T04:20:51.941 INFO:tasks.workunit.client.1.smithi134.stdout:9/649: chown d2/d5/d8/d16/d54/daf/fa6 1 1 2024-09-17T04:20:51.941 INFO:tasks.workunit.client.1.smithi134.stdout:1/309: mkdir d12/d19/d66 0 2024-09-17T04:20:51.942 INFO:tasks.workunit.client.1.smithi134.stdout:1/310: write d12/f1a [2386644,105311] 0 2024-09-17T04:20:51.943 INFO:tasks.workunit.client.1.smithi134.stdout:9/650: creat d2/d5/d8/d16/dcc/dcf/fdc x:0 0 0 2024-09-17T04:20:51.946 INFO:tasks.workunit.client.1.smithi134.stdout:2/350: sync 2024-09-17T04:20:51.946 INFO:tasks.workunit.client.1.smithi134.stdout:8/289: sync 2024-09-17T04:20:51.946 INFO:tasks.workunit.client.1.smithi134.stdout:1/311: creat d12/d1c/d2e/f67 x:0 0 0 2024-09-17T04:20:51.947 INFO:tasks.workunit.client.1.smithi134.stdout:8/290: write d4/d23/f4b [7877,122159] 0 2024-09-17T04:20:51.947 INFO:tasks.workunit.client.1.smithi134.stdout:9/651: creat d2/d5/d58/db5/fdd x:0 0 0 2024-09-17T04:20:51.949 INFO:tasks.workunit.client.1.smithi134.stdout:2/351: symlink d19/d27/d31/d49/d63/l75 0 2024-09-17T04:20:51.950 INFO:tasks.workunit.client.1.smithi134.stdout:2/352: stat d19/d1c/f1f 0 2024-09-17T04:20:51.951 INFO:tasks.workunit.client.1.smithi134.stdout:8/291: rename d4/l3f to d4/d1f/d25/l55 0 2024-09-17T04:20:51.951 INFO:tasks.workunit.client.1.smithi134.stdout:1/312: fsync d12/d1c/d2e/f67 0 2024-09-17T04:20:51.952 INFO:tasks.workunit.client.1.smithi134.stdout:9/652: fsync d2/d5/d58/db5/fdd 0 2024-09-17T04:20:51.953 INFO:tasks.workunit.client.1.smithi134.stdout:2/353: write d19/d27/d31/d34/f70 [335203,129068] 0 2024-09-17T04:20:51.955 INFO:tasks.workunit.client.1.smithi134.stdout:9/653: chown d2/d5/d8/d16/dcc/dcd 7854 1 2024-09-17T04:20:51.956 INFO:tasks.workunit.client.1.smithi134.stdout:6/391: dwrite f9 [0,4194304] 0 2024-09-17T04:20:51.957 INFO:tasks.workunit.client.1.smithi134.stdout:8/292: unlink d4/db/df/f12 0 2024-09-17T04:20:51.959 INFO:tasks.workunit.client.1.smithi134.stdout:1/313: symlink d12/d19/d4f/l68 0 2024-09-17T04:20:51.959 INFO:tasks.workunit.client.1.smithi134.stdout:1/314: fdatasync d12/d19/d1d/d3e/f48 0 2024-09-17T04:20:51.960 INFO:tasks.workunit.client.1.smithi134.stdout:9/654: dread d2/d5/d37/d83/f92 [0,4194304] 0 2024-09-17T04:20:51.961 INFO:tasks.workunit.client.1.smithi134.stdout:8/293: chown d4/d1f/d25/l55 15 1 2024-09-17T04:20:51.962 INFO:tasks.workunit.client.1.smithi134.stdout:9/655: fdatasync d2/d5/d8/d16/d54/daf/d6d/daa/fd7 0 2024-09-17T04:20:51.964 INFO:tasks.workunit.client.1.smithi134.stdout:6/392: mkdir de/d19/d7b 0 2024-09-17T04:20:51.965 INFO:tasks.workunit.client.1.smithi134.stdout:6/393: write de/d19/d62/d34/f3c [665850,54038] 0 2024-09-17T04:20:51.965 INFO:tasks.workunit.client.1.smithi134.stdout:8/294: mkdir d4/d56 0 2024-09-17T04:20:51.967 INFO:tasks.workunit.client.1.smithi134.stdout:8/295: readlink d4/db/df/d13/l18 0 2024-09-17T04:20:51.967 INFO:tasks.workunit.client.1.smithi134.stdout:9/656: creat d2/d5/d8/d16/d54/fde x:0 0 0 2024-09-17T04:20:51.968 INFO:tasks.workunit.client.1.smithi134.stdout:6/394: dread - de/d19/d21/f7a zero size 2024-09-17T04:20:51.971 INFO:tasks.workunit.client.1.smithi134.stdout:1/315: getdents d12/d1c/d4a 0 2024-09-17T04:20:51.973 INFO:tasks.workunit.client.1.smithi134.stdout:8/296: read d4/d1f/d2b/f2f [237594,46801] 0 2024-09-17T04:20:51.974 INFO:tasks.workunit.client.1.smithi134.stdout:9/657: chown d2/d5/d37/d83/da7/cab 6337383 1 2024-09-17T04:20:51.976 INFO:tasks.workunit.client.1.smithi134.stdout:6/395: getdents de/d19/d21/d2d/d6d 0 2024-09-17T04:20:51.978 INFO:tasks.workunit.client.1.smithi134.stdout:6/396: truncate de/d19/d21/f64 605789 0 2024-09-17T04:20:51.979 INFO:tasks.workunit.client.1.smithi134.stdout:1/316: creat d12/d19/d5c/f69 x:0 0 0 2024-09-17T04:20:51.979 INFO:tasks.workunit.client.1.smithi134.stdout:6/397: dread - de/d19/d1f/d55/f63 zero size 2024-09-17T04:20:51.980 INFO:tasks.workunit.client.1.smithi134.stdout:9/658: mknod d2/d5/d8/d16/d54/d5e/cdf 0 2024-09-17T04:20:51.981 INFO:tasks.workunit.client.1.smithi134.stdout:1/317: dread - d12/d19/f3d zero size 2024-09-17T04:20:51.982 INFO:tasks.workunit.client.1.smithi134.stdout:8/297: rmdir d4/d56 0 2024-09-17T04:20:51.982 INFO:tasks.workunit.client.1.smithi134.stdout:1/318: stat d12/d1c/d56 0 2024-09-17T04:20:51.983 INFO:tasks.workunit.client.1.smithi134.stdout:9/659: mknod d2/d5/d58/ce0 0 2024-09-17T04:20:51.983 INFO:tasks.workunit.client.1.smithi134.stdout:2/354: dread f11 [0,4194304] 0 2024-09-17T04:20:51.990 INFO:tasks.workunit.client.1.smithi134.stdout:6/398: dwrite de/d19/d21/f64 [0,4194304] 0 2024-09-17T04:20:51.991 INFO:tasks.workunit.client.1.smithi134.stdout:9/660: rename d2/d5/d8/d16/d54/daf/d6d/d84 to d2/d5/d9/d6b/de1 0 2024-09-17T04:20:51.994 INFO:tasks.workunit.client.1.smithi134.stdout:2/355: dwrite d19/d27/d31/d34/d42/f54 [0,4194304] 0 2024-09-17T04:20:51.995 INFO:tasks.workunit.client.1.smithi134.stdout:6/399: mkdir de/d19/d62/d7c 0 2024-09-17T04:20:51.996 INFO:tasks.workunit.client.1.smithi134.stdout:1/319: dread d12/d19/f30 [4194304,4194304] 0 2024-09-17T04:20:52.000 INFO:tasks.workunit.client.1.smithi134.stdout:9/661: rename d2/d5/d8/d16/dcc to d2/d5/d8/d16/d54/daf/d6d/daa/de2 0 2024-09-17T04:20:52.001 INFO:tasks.workunit.client.1.smithi134.stdout:9/662: stat d2/d5/d37/d7c 0 2024-09-17T04:20:52.003 INFO:tasks.workunit.client.1.smithi134.stdout:2/356: unlink d19/d1c/d47/f6b 0 2024-09-17T04:20:52.004 INFO:tasks.workunit.client.1.smithi134.stdout:6/400: creat de/d19/d62/d7c/f7d x:0 0 0 2024-09-17T04:20:52.004 INFO:tasks.workunit.client.1.smithi134.stdout:9/663: rmdir d2/d5/d9/d6a 39 2024-09-17T04:20:52.004 INFO:tasks.workunit.client.1.smithi134.stdout:2/357: stat d19/d27/d64 0 2024-09-17T04:20:52.005 INFO:tasks.workunit.client.1.smithi134.stdout:8/298: dwrite f0 [0,4194304] 0 2024-09-17T04:20:52.005 INFO:tasks.workunit.client.1.smithi134.stdout:1/320: mkdir d12/d19/d1d/d5f/d6a 0 2024-09-17T04:20:52.006 INFO:tasks.workunit.client.1.smithi134.stdout:2/358: chown d19/l1e 2 1 2024-09-17T04:20:52.007 INFO:tasks.workunit.client.1.smithi134.stdout:6/401: write de/d19/d62/f20 [2073518,116804] 0 2024-09-17T04:20:52.008 INFO:tasks.workunit.client.1.smithi134.stdout:8/299: creat d4/f57 x:0 0 0 2024-09-17T04:20:52.010 INFO:tasks.workunit.client.1.smithi134.stdout:1/321: rename d12/d19/d1d/f27 to d12/d19/d1d/f6b 0 2024-09-17T04:20:52.013 INFO:tasks.workunit.client.1.smithi134.stdout:6/402: mknod de/d2b/c7e 0 2024-09-17T04:20:52.014 INFO:tasks.workunit.client.1.smithi134.stdout:2/359: getdents d19/d27/d31/d49/d72 0 2024-09-17T04:20:52.015 INFO:tasks.workunit.client.1.smithi134.stdout:9/664: dwrite d2/d5/d8/d1e/f29 [4194304,4194304] 0 2024-09-17T04:20:52.015 INFO:tasks.workunit.client.1.smithi134.stdout:1/322: symlink d12/d19/d5d/l6c 0 2024-09-17T04:20:52.017 INFO:tasks.workunit.client.1.smithi134.stdout:6/403: dread - de/d19/d62/d7c/f7d zero size 2024-09-17T04:20:52.018 INFO:tasks.workunit.client.1.smithi134.stdout:8/300: dwrite f3 [4194304,4194304] 0 2024-09-17T04:20:52.021 INFO:tasks.workunit.client.1.smithi134.stdout:6/404: readlink de/d19/d62/d34/l54 0 2024-09-17T04:20:52.021 INFO:tasks.workunit.client.1.smithi134.stdout:9/665: write d2/d78/fc6 [1495687,22686] 0 2024-09-17T04:20:52.022 INFO:tasks.workunit.client.1.smithi134.stdout:1/323: rename d12/d1c/l45 to d12/d1c/d4a/d63/l6d 0 2024-09-17T04:20:52.023 INFO:tasks.workunit.client.1.smithi134.stdout:2/360: creat d19/f76 x:0 0 0 2024-09-17T04:20:52.024 INFO:tasks.workunit.client.1.smithi134.stdout:2/361: truncate d19/f69 211925 0 2024-09-17T04:20:52.025 INFO:tasks.workunit.client.1.smithi134.stdout:2/362: chown d19/d27/c37 150272 1 2024-09-17T04:20:52.029 INFO:tasks.workunit.client.1.smithi134.stdout:1/324: symlink d12/d36/l6e 0 2024-09-17T04:20:52.032 INFO:tasks.workunit.client.1.smithi134.stdout:8/301: mknod d4/d1f/c58 0 2024-09-17T04:20:52.033 INFO:tasks.workunit.client.1.smithi134.stdout:6/405: symlink de/d19/d62/d34/l7f 0 2024-09-17T04:20:52.034 INFO:tasks.workunit.client.1.smithi134.stdout:6/406: dread - de/d19/d1f/d55/f68 zero size 2024-09-17T04:20:52.035 INFO:tasks.workunit.client.1.smithi134.stdout:9/666: mkdir d2/d5/d8/d16/d54/daf/d6d/daa/de2/dcd/dd6/de3 0 2024-09-17T04:20:52.036 INFO:tasks.workunit.client.1.smithi134.stdout:9/667: readlink d2/d5/d8/d1e/l7e 0 2024-09-17T04:20:52.036 INFO:tasks.workunit.client.1.smithi134.stdout:6/407: dread de/d19/d1f/f26 [0,4194304] 0 2024-09-17T04:20:52.036 INFO:tasks.workunit.client.1.smithi134.stdout:1/325: unlink d12/d19/d4f/l68 0 2024-09-17T04:20:52.037 INFO:tasks.workunit.client.1.smithi134.stdout:2/363: mkdir d19/d77 0 2024-09-17T04:20:52.038 INFO:tasks.workunit.client.1.smithi134.stdout:1/326: truncate d12/d19/f64 57679 0 2024-09-17T04:20:52.039 INFO:tasks.workunit.client.1.smithi134.stdout:9/668: readlink d2/d7/d75/ld8 0 2024-09-17T04:20:52.043 INFO:tasks.workunit.client.1.smithi134.stdout:2/364: rename d19/l2e to d19/d27/d31/d34/l78 0 2024-09-17T04:20:52.046 INFO:tasks.workunit.client.1.smithi134.stdout:9/669: getdents d2/d5/d8/d16 0 2024-09-17T04:20:52.046 INFO:tasks.workunit.client.1.smithi134.stdout:6/408: dwrite fd [0,4194304] 0 2024-09-17T04:20:52.048 INFO:tasks.workunit.client.1.smithi134.stdout:6/409: stat de/d19/d1f/d55/f63 0 2024-09-17T04:20:52.049 INFO:tasks.workunit.client.1.smithi134.stdout:1/327: dwrite d12/d1c/d2e/f50 [0,4194304] 0 2024-09-17T04:20:52.049 INFO:tasks.workunit.client.1.smithi134.stdout:9/670: symlink d2/d5/d58/db5/le4 0 2024-09-17T04:20:52.054 INFO:tasks.workunit.client.1.smithi134.stdout:6/410: chown c1 32284683 1 2024-09-17T04:20:52.055 INFO:tasks.workunit.client.1.smithi134.stdout:2/365: dwrite fc [4194304,4194304] 0 2024-09-17T04:20:52.055 INFO:tasks.workunit.client.1.smithi134.stdout:9/671: creat d2/d5/d58/db5/fe5 x:0 0 0 2024-09-17T04:20:52.057 INFO:tasks.workunit.client.1.smithi134.stdout:9/672: fdatasync d2/d5/d9/d6b/de1/f65 0 2024-09-17T04:20:52.059 INFO:tasks.workunit.client.1.smithi134.stdout:2/366: unlink d19/d27/d31/d34/l3e 0 2024-09-17T04:20:52.063 INFO:tasks.workunit.client.1.smithi134.stdout:1/328: dwrite d12/d19/d1d/d3e/f48 [0,4194304] 0 2024-09-17T04:20:52.064 INFO:tasks.workunit.client.1.smithi134.stdout:1/329: chown d12 0 1 2024-09-17T04:20:52.065 INFO:tasks.workunit.client.1.smithi134.stdout:6/411: dwrite de/d19/d1f/d55/f63 [0,4194304] 0 2024-09-17T04:20:52.066 INFO:tasks.workunit.client.1.smithi134.stdout:9/673: symlink d2/d5/d8/d16/d54/daf/d6d/daa/de2/dcf/le6 0 2024-09-17T04:20:52.066 INFO:tasks.workunit.client.1.smithi134.stdout:3/370: sync 2024-09-17T04:20:52.066 INFO:tasks.workunit.client.1.smithi134.stdout:4/401: sync 2024-09-17T04:20:52.067 INFO:tasks.workunit.client.1.smithi134.stdout:1/330: chown d12/d19/d1d/d3e/l40 145047221 1 2024-09-17T04:20:52.071 INFO:tasks.workunit.client.1.smithi134.stdout:1/331: creat d12/d19/d5c/f6f x:0 0 0 2024-09-17T04:20:52.072 INFO:tasks.workunit.client.1.smithi134.stdout:3/371: mknod de/d12/d22/d5a/c7f 0 2024-09-17T04:20:52.076 INFO:tasks.workunit.client.1.smithi134.stdout:9/674: chown d2/d5/d37/d7c/l87 205 1 2024-09-17T04:20:52.078 INFO:tasks.workunit.client.1.smithi134.stdout:4/402: link d0/c5f d0/d13/d40/d72/c7f 0 2024-09-17T04:20:52.079 INFO:tasks.workunit.client.1.smithi134.stdout:1/332: creat d12/d1c/d56/f70 x:0 0 0 2024-09-17T04:20:52.080 INFO:tasks.workunit.client.1.smithi134.stdout:2/367: dwrite d19/d27/d31/d34/d42/f5e [0,4194304] 0 2024-09-17T04:20:52.082 INFO:tasks.workunit.client.1.smithi134.stdout:1/333: dread - d12/d1c/d2e/f3b zero size 2024-09-17T04:20:52.083 INFO:tasks.workunit.client.1.smithi134.stdout:3/372: chown de/d12/d15/d1d/d2d/d31/f3e 106135133 1 2024-09-17T04:20:52.083 INFO:tasks.workunit.client.0.smithi088.stdout:3/0: sync 2024-09-17T04:20:52.084 INFO:tasks.workunit.client.0.smithi088.stdout:0/2: sync 2024-09-17T04:20:52.084 INFO:tasks.workunit.client.0.smithi088.stdout:3/1: dwrite - no filename 2024-09-17T04:20:52.084 INFO:tasks.workunit.client.0.smithi088.stdout:3/2: dwrite - no filename 2024-09-17T04:20:52.084 INFO:tasks.workunit.client.0.smithi088.stdout:8/5: sync 2024-09-17T04:20:52.084 INFO:tasks.workunit.client.0.smithi088.stdout:3/3: link - no file 2024-09-17T04:20:52.085 INFO:tasks.workunit.client.1.smithi134.stdout:6/412: dwrite de/d2b/f70 [0,4194304] 0 2024-09-17T04:20:52.085 INFO:tasks.workunit.client.0.smithi088.stdout:8/6: chown l0 406 1 2024-09-17T04:20:52.086 INFO:tasks.workunit.client.0.smithi088.stdout:0/3: creat f1 x:0 0 0 2024-09-17T04:20:52.088 INFO:tasks.workunit.client.0.smithi088.stdout:3/4: mkdir d0 0 2024-09-17T04:20:52.089 INFO:tasks.workunit.client.1.smithi134.stdout:9/675: link d2/d5/d9/df/d80/cbc d2/d5/d9/df/d38/ce7 0 2024-09-17T04:20:52.091 INFO:tasks.workunit.client.1.smithi134.stdout:3/373: unlink de/d12/d15/f1f 0 2024-09-17T04:20:52.092 INFO:tasks.workunit.client.1.smithi134.stdout:4/403: dwrite d0/d3b/f52 [0,4194304] 0 2024-09-17T04:20:52.094 INFO:tasks.workunit.client.1.smithi134.stdout:2/368: rename d19/l3f to d19/d27/d31/d34/d6d/l79 0 2024-09-17T04:20:52.095 INFO:tasks.workunit.client.1.smithi134.stdout:6/413: dwrite de/d19/d1f/d55/f63 [0,4194304] 0 2024-09-17T04:20:52.095 INFO:tasks.workunit.client.1.smithi134.stdout:6/414: readlink de/lf 0 2024-09-17T04:20:52.095 INFO:tasks.workunit.client.0.smithi088.stdout:0/4: dwrite f0 [0,4194304] 0 2024-09-17T04:20:52.096 INFO:tasks.workunit.client.0.smithi088.stdout:8/7: getdents . 0 2024-09-17T04:20:52.097 INFO:tasks.workunit.client.1.smithi134.stdout:1/334: mknod d12/d1c/c71 0 2024-09-17T04:20:52.097 INFO:tasks.workunit.client.1.smithi134.stdout:2/369: truncate d19/d27/d31/d34/f70 1270474 0 2024-09-17T04:20:52.097 INFO:tasks.workunit.client.1.smithi134.stdout:6/415: write de/d19/d1f/f57 [615620,32239] 0 2024-09-17T04:20:52.097 INFO:tasks.workunit.client.0.smithi088.stdout:8/8: chown l0 3200 1 2024-09-17T04:20:52.097 INFO:tasks.workunit.client.1.smithi134.stdout:2/370: chown d19/f22 55 1 2024-09-17T04:20:52.098 INFO:tasks.workunit.client.1.smithi134.stdout:6/416: chown de/d19/d62/d34/d3b 54803800 1 2024-09-17T04:20:52.098 INFO:tasks.workunit.client.1.smithi134.stdout:6/417: fsync de/d19/f3d 0 2024-09-17T04:20:52.099 INFO:tasks.workunit.client.1.smithi134.stdout:9/676: symlink d2/d5/d8/d16/d54/daf/d6d/daa/de2/dcd/dd6/le8 0 2024-09-17T04:20:52.099 INFO:tasks.workunit.client.1.smithi134.stdout:6/418: chown de/c16 1720625527 1 2024-09-17T04:20:52.101 INFO:tasks.workunit.client.0.smithi088.stdout:0/5: creat f2 x:0 0 0 2024-09-17T04:20:52.101 INFO:tasks.workunit.client.0.smithi088.stdout:0/6: truncate f2 792497 0 2024-09-17T04:20:52.102 INFO:tasks.workunit.client.1.smithi134.stdout:6/419: write de/d19/d62/d34/f3c [711956,37907] 0 2024-09-17T04:20:52.102 INFO:tasks.workunit.client.0.smithi088.stdout:8/9: creat f1 x:0 0 0 2024-09-17T04:20:52.104 INFO:tasks.workunit.client.0.smithi088.stdout:8/10: write f1 [499921,92048] 0 2024-09-17T04:20:52.104 INFO:tasks.workunit.client.1.smithi134.stdout:1/335: dwrite d12/d1c/d2e/f46 [0,4194304] 0 2024-09-17T04:20:52.105 INFO:tasks.workunit.client.1.smithi134.stdout:1/336: chown d12/d36 5418 1 2024-09-17T04:20:52.106 INFO:tasks.workunit.client.1.smithi134.stdout:1/337: write d12/f14 [2798693,39177] 0 2024-09-17T04:20:52.107 INFO:tasks.workunit.client.1.smithi134.stdout:9/677: creat d2/d5/d37/d83/fe9 x:0 0 0 2024-09-17T04:20:52.111 INFO:tasks.workunit.client.0.smithi088.stdout:0/7: dwrite f0 [0,4194304] 0 2024-09-17T04:20:52.112 INFO:tasks.workunit.client.0.smithi088.stdout:0/8: stat f0 0 2024-09-17T04:20:52.112 INFO:tasks.workunit.client.1.smithi134.stdout:2/371: dread d19/f1a [0,4194304] 0 2024-09-17T04:20:52.113 INFO:tasks.workunit.client.0.smithi088.stdout:0/9: read f2 [756384,109839] 0 2024-09-17T04:20:52.113 INFO:tasks.workunit.client.1.smithi134.stdout:6/420: creat de/d2b/f80 x:0 0 0 2024-09-17T04:20:52.114 INFO:tasks.workunit.client.0.smithi088.stdout:0/10: write f1 [997319,113764] 0 2024-09-17T04:20:52.115 INFO:tasks.workunit.client.1.smithi134.stdout:6/421: dread - de/d19/d1f/d55/f68 zero size 2024-09-17T04:20:52.118 INFO:tasks.workunit.client.0.smithi088.stdout:0/11: symlink l3 0 2024-09-17T04:20:52.121 INFO:tasks.workunit.client.0.smithi088.stdout:0/12: creat f4 x:0 0 0 2024-09-17T04:20:52.127 INFO:tasks.workunit.client.0.smithi088.stdout:0/13: creat f5 x:0 0 0 2024-09-17T04:20:52.127 INFO:tasks.workunit.client.0.smithi088.stdout:0/14: chown f4 1 1 2024-09-17T04:20:52.129 INFO:tasks.workunit.client.1.smithi134.stdout:6/422: mknod de/d19/d7b/c81 0 2024-09-17T04:20:52.130 INFO:tasks.workunit.client.1.smithi134.stdout:6/423: readlink de/d19/d62/d34/d3b/l6b 0 2024-09-17T04:20:52.130 INFO:tasks.workunit.client.1.smithi134.stdout:1/338: rmdir d12/d19/d1d/d5f/d6a 0 2024-09-17T04:20:52.133 INFO:tasks.workunit.client.0.smithi088.stdout:0/15: write f2 [797211,40452] 0 2024-09-17T04:20:52.133 INFO:tasks.workunit.client.0.smithi088.stdout:0/16: readlink l3 0 2024-09-17T04:20:52.134 INFO:tasks.workunit.client.1.smithi134.stdout:1/339: mknod d12/d19/d1d/d61/c72 0 2024-09-17T04:20:52.135 INFO:tasks.workunit.client.1.smithi134.stdout:6/424: rename de/d19/d62/d34/f42 to de/d19/d1f/d55/f82 0 2024-09-17T04:20:52.138 INFO:tasks.workunit.client.1.smithi134.stdout:1/340: unlink d12/d1c/d2e/f46 0 2024-09-17T04:20:52.138 INFO:tasks.workunit.client.1.smithi134.stdout:6/425: fdatasync de/d19/d1f/d55/f82 0 2024-09-17T04:20:52.139 INFO:tasks.workunit.client.1.smithi134.stdout:1/341: write d12/d1c/d2e/f3b [391229,10168] 0 2024-09-17T04:20:52.140 INFO:tasks.workunit.client.1.smithi134.stdout:6/426: write de/f3a [2382648,24886] 0 2024-09-17T04:20:52.144 INFO:tasks.workunit.client.1.smithi134.stdout:6/427: getdents de/d19/d62/d7c 0 2024-09-17T04:20:52.145 INFO:tasks.workunit.client.1.smithi134.stdout:1/342: dwrite d12/d19/f3d [0,4194304] 0 2024-09-17T04:20:52.146 INFO:tasks.workunit.client.1.smithi134.stdout:6/428: fsync de/d19/d21/f25 0 2024-09-17T04:20:52.149 INFO:tasks.workunit.client.1.smithi134.stdout:1/343: mknod d12/d19/d5c/c73 0 2024-09-17T04:20:52.151 INFO:tasks.workunit.client.0.smithi088.stdout:8/11: getdents . 0 2024-09-17T04:20:52.153 INFO:tasks.workunit.client.1.smithi134.stdout:6/429: creat de/d19/d21/d2d/d4c/f83 x:0 0 0 2024-09-17T04:20:52.155 INFO:tasks.workunit.client.1.smithi134.stdout:4/404: write d0/df/f16 [696122,7260] 0 2024-09-17T04:20:52.155 INFO:tasks.workunit.client.0.smithi088.stdout:8/12: dread f1 [0,4194304] 0 2024-09-17T04:20:52.156 INFO:tasks.workunit.client.1.smithi134.stdout:4/405: chown d0/df/d35 4555 1 2024-09-17T04:20:52.159 INFO:tasks.workunit.client.1.smithi134.stdout:6/430: rename de/d19/d1f/c47 to de/c84 0 2024-09-17T04:20:52.159 INFO:tasks.workunit.client.1.smithi134.stdout:3/374: truncate de/d12/d22/d5a/f66 2683666 0 2024-09-17T04:20:52.161 INFO:tasks.workunit.client.1.smithi134.stdout:3/375: read de/d12/d15/d1d/d2d/f53 [30559,111101] 0 2024-09-17T04:20:52.162 INFO:tasks.workunit.client.1.smithi134.stdout:4/406: dwrite d0/df/f31 [0,4194304] 0 2024-09-17T04:20:52.163 INFO:tasks.workunit.client.1.smithi134.stdout:6/431: mkdir de/d19/d1f/d85 0 2024-09-17T04:20:52.164 INFO:tasks.workunit.client.1.smithi134.stdout:4/407: chown d0/df/d1e/d20/l47 0 1 2024-09-17T04:20:52.165 INFO:tasks.workunit.client.1.smithi134.stdout:3/376: truncate de/d12/d15/d1d/f62 204693 0 2024-09-17T04:20:52.165 INFO:tasks.workunit.client.1.smithi134.stdout:9/678: write d2/d5/d37/d83/f92 [869328,76266] 0 2024-09-17T04:20:52.166 INFO:tasks.workunit.client.1.smithi134.stdout:1/344: dread d12/d1c/f2f [0,4194304] 0 2024-09-17T04:20:52.166 INFO:tasks.workunit.client.1.smithi134.stdout:6/432: unlink de/d19/l4e 0 2024-09-17T04:20:52.167 INFO:tasks.workunit.client.1.smithi134.stdout:9/679: write d2/d25/f3c [4840554,15223] 0 2024-09-17T04:20:52.169 INFO:tasks.workunit.client.1.smithi134.stdout:9/680: fsync d2/d5/d37/d83/fe9 0 2024-09-17T04:20:52.169 INFO:tasks.workunit.client.1.smithi134.stdout:0/289: sync 2024-09-17T04:20:52.169 INFO:tasks.workunit.client.1.smithi134.stdout:5/286: sync 2024-09-17T04:20:52.169 INFO:tasks.workunit.client.1.smithi134.stdout:7/246: sync 2024-09-17T04:20:52.169 INFO:tasks.workunit.client.1.smithi134.stdout:3/377: mknod de/c80 0 2024-09-17T04:20:52.172 INFO:tasks.workunit.client.1.smithi134.stdout:4/408: rename d0/df/f16 to d0/df/d1e/d20/f80 0 2024-09-17T04:20:52.175 INFO:tasks.workunit.client.1.smithi134.stdout:9/681: write d2/d5/d8/d16/d54/daf/d6d/daa/fd7 [805641,24286] 0 2024-09-17T04:20:52.176 INFO:tasks.workunit.client.1.smithi134.stdout:1/345: dwrite d12/d1c/f34 [0,4194304] 0 2024-09-17T04:20:52.180 INFO:tasks.workunit.client.1.smithi134.stdout:5/287: dwrite d0/d3a/ff [4194304,4194304] 0 2024-09-17T04:20:52.182 INFO:tasks.workunit.client.1.smithi134.stdout:5/288: fsync d0/da/d12/d41/f49 0 2024-09-17T04:20:52.182 INFO:tasks.workunit.client.1.smithi134.stdout:6/433: rename de/d19/d62/d34/d3b/c5a to de/d19/d74/c86 0 2024-09-17T04:20:52.183 INFO:tasks.workunit.client.1.smithi134.stdout:5/289: dread - d0/d3a/d2b/f34 zero size 2024-09-17T04:20:52.184 INFO:tasks.workunit.client.1.smithi134.stdout:4/409: creat d0/df/d35/d5c/f81 x:0 0 0 2024-09-17T04:20:52.186 INFO:tasks.workunit.client.1.smithi134.stdout:9/682: dread d2/d5/d37/fa3 [0,4194304] 0 2024-09-17T04:20:52.188 INFO:tasks.workunit.client.1.smithi134.stdout:8/302: sync 2024-09-17T04:20:52.188 INFO:tasks.workunit.client.1.smithi134.stdout:2/372: sync 2024-09-17T04:20:52.191 INFO:tasks.workunit.client.1.smithi134.stdout:6/434: unlink de/d19/d62/d34/c56 0 2024-09-17T04:20:52.193 INFO:tasks.workunit.client.1.smithi134.stdout:3/378: creat de/d12/d22/f81 x:0 0 0 2024-09-17T04:20:52.193 INFO:tasks.workunit.client.0.smithi088.stdout:8/13: truncate f1 589159 0 2024-09-17T04:20:52.194 INFO:tasks.workunit.client.1.smithi134.stdout:9/683: dwrite d2/d5/d8/f19 [0,4194304] 0 2024-09-17T04:20:52.195 INFO:tasks.workunit.client.1.smithi134.stdout:2/373: dread d19/d27/d31/d34/d42/f5e [0,4194304] 0 2024-09-17T04:20:52.195 INFO:tasks.workunit.client.1.smithi134.stdout:5/290: creat d0/d3a/f5b x:0 0 0 2024-09-17T04:20:52.196 INFO:tasks.workunit.client.1.smithi134.stdout:4/410: symlink d0/d13/d40/d72/l82 0 2024-09-17T04:20:52.197 INFO:tasks.workunit.client.0.smithi088.stdout:8/14: unlink l0 0 2024-09-17T04:20:52.199 INFO:tasks.workunit.client.1.smithi134.stdout:7/247: rename d0/dd/d3a/f4a to d0/dd/d3a/f4f 0 2024-09-17T04:20:52.200 INFO:tasks.workunit.client.1.smithi134.stdout:2/374: write d19/d27/d31/d34/f70 [586033,113115] 0 2024-09-17T04:20:52.201 INFO:tasks.workunit.client.1.smithi134.stdout:7/248: chown d0/d16/d35/d4b 48475 1 2024-09-17T04:20:52.203 INFO:tasks.workunit.client.1.smithi134.stdout:3/379: dwrite de/d12/d22/f81 [0,4194304] 0 2024-09-17T04:20:52.206 INFO:tasks.workunit.client.1.smithi134.stdout:8/303: mknod d4/d1f/d25/c59 0 2024-09-17T04:20:52.208 INFO:tasks.workunit.client.1.smithi134.stdout:6/435: rmdir de/d19/d1f/d5c 39 2024-09-17T04:20:52.213 INFO:tasks.workunit.client.1.smithi134.stdout:0/290: dwrite d11/d22/d1c/d2f/d45/f59 [0,4194304] 0 2024-09-17T04:20:52.215 INFO:tasks.workunit.client.1.smithi134.stdout:2/375: creat d19/d1c/d47/f7a x:0 0 0 2024-09-17T04:20:52.216 INFO:tasks.workunit.client.1.smithi134.stdout:2/376: read - d19/d1c/f52 zero size 2024-09-17T04:20:52.219 INFO:tasks.workunit.client.0.smithi088.stdout:8/15: rename f1 to f2 0 2024-09-17T04:20:52.221 INFO:tasks.workunit.client.1.smithi134.stdout:8/304: write d4/db/df/d13/f3d [900850,104942] 0 2024-09-17T04:20:52.223 INFO:tasks.workunit.client.1.smithi134.stdout:8/305: truncate d4/db/f20 4811751 0 2024-09-17T04:20:52.224 INFO:tasks.workunit.client.1.smithi134.stdout:1/346: truncate d12/f14 4123206 0 2024-09-17T04:20:52.225 INFO:tasks.workunit.client.1.smithi134.stdout:1/347: write d12/d19/f25 [80239,18601] 0 2024-09-17T04:20:52.227 INFO:tasks.workunit.client.1.smithi134.stdout:0/291: rmdir d11/d4c 39 2024-09-17T04:20:52.229 INFO:tasks.workunit.client.1.smithi134.stdout:7/249: creat d0/dd/d3a/d3d/d4c/f50 x:0 0 0 2024-09-17T04:20:52.231 INFO:tasks.workunit.client.1.smithi134.stdout:2/377: chown d19/d27/d31/l48 6 1 2024-09-17T04:20:52.233 INFO:tasks.workunit.client.1.smithi134.stdout:5/291: rename d0/d3a/d2b/f2d to d0/f5c 0 2024-09-17T04:20:52.235 INFO:tasks.workunit.client.1.smithi134.stdout:0/292: dwrite d11/d19/d21/f5f [0,4194304] 0 2024-09-17T04:20:52.237 INFO:tasks.workunit.client.1.smithi134.stdout:6/436: link de/d19/d1f/d55/f63 de/d19/d1f/d55/f87 0 2024-09-17T04:20:52.238 INFO:tasks.workunit.client.0.smithi088.stdout:8/16: fdatasync f2 0 2024-09-17T04:20:52.239 INFO:tasks.workunit.client.1.smithi134.stdout:6/437: fsync de/f3a 0 2024-09-17T04:20:52.240 INFO:tasks.workunit.client.1.smithi134.stdout:0/293: truncate d11/d22/d1c/d2f/f66 726439 0 2024-09-17T04:20:52.240 INFO:tasks.workunit.client.1.smithi134.stdout:9/684: truncate d2/d7/d75/d96/fce 2885380 0 2024-09-17T04:20:52.241 INFO:tasks.workunit.client.1.smithi134.stdout:7/250: rmdir d0/dd/d3a/d3d 39 2024-09-17T04:20:52.242 INFO:tasks.workunit.client.1.smithi134.stdout:5/292: dwrite d0/d3a/d2b/f31 [0,4194304] 0 2024-09-17T04:20:52.244 INFO:tasks.workunit.client.1.smithi134.stdout:5/293: write d0/d3a/f50 [1147607,1317] 0 2024-09-17T04:20:52.247 INFO:tasks.workunit.client.1.smithi134.stdout:5/294: write d0/da/d12/f53 [785572,46828] 0 2024-09-17T04:20:52.247 INFO:tasks.workunit.client.1.smithi134.stdout:5/295: dread - d0/f3c zero size 2024-09-17T04:20:52.250 INFO:tasks.workunit.client.0.smithi088.stdout:8/17: stat f2 0 2024-09-17T04:20:52.251 INFO:tasks.workunit.client.0.smithi088.stdout:8/18: dread f2 [0,4194304] 0 2024-09-17T04:20:52.252 INFO:tasks.workunit.client.1.smithi134.stdout:3/380: dwrite de/d12/f47 [0,4194304] 0 2024-09-17T04:20:52.255 INFO:tasks.workunit.client.1.smithi134.stdout:0/294: creat d11/d24/d49/f68 x:0 0 0 2024-09-17T04:20:52.257 INFO:tasks.workunit.client.0.smithi088.stdout:8/19: mknod c3 0 2024-09-17T04:20:52.259 INFO:tasks.workunit.client.0.smithi088.stdout:8/20: mknod c4 0 2024-09-17T04:20:52.261 INFO:tasks.workunit.client.0.smithi088.stdout:8/21: dread f2 [0,4194304] 0 2024-09-17T04:20:52.262 INFO:tasks.workunit.client.1.smithi134.stdout:8/306: dwrite d4/db/dd/f1b [0,4194304] 0 2024-09-17T04:20:52.262 INFO:tasks.workunit.client.1.smithi134.stdout:9/685: creat d2/d5/d8/d16/d54/daf/d6d/daa/de2/fea x:0 0 0 2024-09-17T04:20:52.264 INFO:tasks.workunit.client.1.smithi134.stdout:5/296: mknod d0/da/d29/c5d 0 2024-09-17T04:20:52.265 INFO:tasks.workunit.client.0.smithi088.stdout:8/22: fsync f2 0 2024-09-17T04:20:52.266 INFO:tasks.workunit.client.0.smithi088.stdout:8/23: dread f2 [0,4194304] 0 2024-09-17T04:20:52.271 INFO:tasks.workunit.client.1.smithi134.stdout:6/438: dwrite de/d19/d1f/f28 [0,4194304] 0 2024-09-17T04:20:52.271 INFO:tasks.workunit.client.1.smithi134.stdout:7/251: write d0/f6 [2847459,37726] 0 2024-09-17T04:20:52.271 INFO:tasks.workunit.client.1.smithi134.stdout:1/348: rename fd to d12/d1c/f74 0 2024-09-17T04:20:52.275 INFO:tasks.workunit.client.0.smithi088.stdout:8/24: truncate f2 188763 0 2024-09-17T04:20:52.275 INFO:tasks.workunit.client.1.smithi134.stdout:0/295: dwrite d11/d22/f3e [0,4194304] 0 2024-09-17T04:20:52.276 INFO:tasks.workunit.client.1.smithi134.stdout:9/686: dread - d2/d5/d8/d16/d54/d5e/da0/fba zero size 2024-09-17T04:20:52.276 INFO:tasks.workunit.client.1.smithi134.stdout:8/307: rename d4/d1f/d2b/c48 to d4/c5a 0 2024-09-17T04:20:52.282 INFO:tasks.workunit.client.1.smithi134.stdout:1/349: creat d12/d1c/d2e/f75 x:0 0 0 2024-09-17T04:20:52.282 INFO:tasks.workunit.client.1.smithi134.stdout:3/381: creat de/d12/d22/f82 x:0 0 0 2024-09-17T04:20:52.284 INFO:tasks.workunit.client.1.smithi134.stdout:7/252: mkdir d0/dd/d3a/d51 0 2024-09-17T04:20:52.284 INFO:tasks.workunit.client.1.smithi134.stdout:8/308: truncate d4/db/f20 5190720 0 2024-09-17T04:20:52.284 INFO:tasks.workunit.client.1.smithi134.stdout:9/687: unlink d2/f43 0 2024-09-17T04:20:52.288 INFO:tasks.workunit.client.1.smithi134.stdout:8/309: write d4/f10 [735912,7543] 0 2024-09-17T04:20:52.290 INFO:tasks.workunit.client.1.smithi134.stdout:0/296: dwrite d11/d19/d21/d37/f4b [0,4194304] 0 2024-09-17T04:20:52.291 INFO:tasks.workunit.client.1.smithi134.stdout:7/253: creat d0/d16/d35/d4b/f52 x:0 0 0 2024-09-17T04:20:52.292 INFO:tasks.workunit.client.1.smithi134.stdout:4/411: sync 2024-09-17T04:20:52.293 INFO:tasks.workunit.client.1.smithi134.stdout:1/350: truncate d12/d1c/d56/f70 364205 0 2024-09-17T04:20:52.294 INFO:tasks.workunit.client.1.smithi134.stdout:8/310: readlink d4/d11/l4a 0 2024-09-17T04:20:52.294 INFO:tasks.workunit.client.1.smithi134.stdout:9/688: creat d2/d7/d75/d96/dca/feb x:0 0 0 2024-09-17T04:20:52.296 INFO:tasks.workunit.client.0.smithi088.stdout:8/25: read f2 [117304,67707] 0 2024-09-17T04:20:52.298 INFO:tasks.workunit.client.1.smithi134.stdout:0/297: chown d11/d22/l38 2473616 1 2024-09-17T04:20:52.303 INFO:tasks.workunit.client.1.smithi134.stdout:9/689: chown d2/d5/f98 4 1 2024-09-17T04:20:52.304 INFO:tasks.workunit.client.1.smithi134.stdout:6/439: dread f7 [0,4194304] 0 2024-09-17T04:20:52.304 INFO:tasks.workunit.client.1.smithi134.stdout:5/297: dread d0/da/f46 [0,4194304] 0 2024-09-17T04:20:52.305 INFO:tasks.workunit.client.1.smithi134.stdout:3/382: dwrite de/d10/d3d/f7d [0,4194304] 0 2024-09-17T04:20:52.308 INFO:tasks.workunit.client.1.smithi134.stdout:5/298: write d0/d3a/f3f [1295072,33650] 0 2024-09-17T04:20:52.309 INFO:tasks.workunit.client.1.smithi134.stdout:6/440: truncate de/d19/d62/d34/f72 909080 0 2024-09-17T04:20:52.311 INFO:tasks.workunit.client.1.smithi134.stdout:5/299: write d0/da/d12/f4a [260451,65071] 0 2024-09-17T04:20:52.314 INFO:tasks.workunit.client.1.smithi134.stdout:2/378: sync 2024-09-17T04:20:52.412 INFO:tasks.workunit.client.1.smithi134.stdout:0/298: write d11/d18/f40 [302947,81973] 0 2024-09-17T04:20:52.412 INFO:tasks.workunit.client.1.smithi134.stdout:8/311: stat d4/db/df/l1a 0 2024-09-17T04:20:52.413 INFO:tasks.workunit.client.1.smithi134.stdout:4/412: write d0/df/d35/d5c/f6b [3369295,76631] 0 2024-09-17T04:20:52.414 INFO:tasks.workunit.client.0.smithi088.stdout:5/20: sync 2024-09-17T04:20:52.414 INFO:tasks.workunit.client.0.smithi088.stdout:6/46: sync 2024-09-17T04:20:52.414 INFO:tasks.workunit.client.0.smithi088.stdout:1/41: sync 2024-09-17T04:20:52.414 INFO:tasks.workunit.client.0.smithi088.stdout:4/64: sync 2024-09-17T04:20:52.414 INFO:tasks.workunit.client.0.smithi088.stdout:7/66: sync 2024-09-17T04:20:52.414 INFO:tasks.workunit.client.0.smithi088.stdout:2/27: sync 2024-09-17T04:20:52.414 INFO:tasks.workunit.client.0.smithi088.stdout:9/26: sync 2024-09-17T04:20:52.415 INFO:tasks.workunit.client.0.smithi088.stdout:6/47: stat f5 0 2024-09-17T04:20:52.415 INFO:tasks.workunit.client.0.smithi088.stdout:6/48: read f3 [356554,89579] 0 2024-09-17T04:20:52.416 INFO:tasks.workunit.client.0.smithi088.stdout:9/27: write d2/f7 [498016,40307] 0 2024-09-17T04:20:52.416 INFO:tasks.workunit.client.0.smithi088.stdout:5/21: truncate d2/f5 214935 0 2024-09-17T04:20:52.416 INFO:tasks.workunit.client.0.smithi088.stdout:1/42: chown d0/d1/c9 38376518 1 2024-09-17T04:20:52.417 INFO:tasks.workunit.client.0.smithi088.stdout:1/43: chown d0/db/cc 5 1 2024-09-17T04:20:52.417 INFO:tasks.workunit.client.1.smithi134.stdout:1/351: dwrite d12/d1c/f24 [4194304,4194304] 0 2024-09-17T04:20:52.465 INFO:tasks.workunit.client.1.smithi134.stdout:3/383: mkdir de/d12/d15/d1d/d2d/d31/d6a/d83 0 2024-09-17T04:20:52.466 INFO:tasks.workunit.client.1.smithi134.stdout:3/384: truncate de/d12/d22/d5a/f71 480323 0 2024-09-17T04:20:52.467 INFO:tasks.workunit.client.0.smithi088.stdout:2/28: mknod d0/c6 0 2024-09-17T04:20:52.469 INFO:tasks.workunit.client.0.smithi088.stdout:2/29: dread d0/d1/f2 [0,4194304] 0 2024-09-17T04:20:52.469 INFO:tasks.workunit.client.1.smithi134.stdout:7/254: creat d0/f53 x:0 0 0 2024-09-17T04:20:52.470 INFO:tasks.workunit.client.0.smithi088.stdout:4/65: write d5/fd [1329507,18917] 0 2024-09-17T04:20:52.471 INFO:tasks.workunit.client.0.smithi088.stdout:2/30: dread d0/d1/f2 [0,4194304] 0 2024-09-17T04:20:52.471 INFO:tasks.workunit.client.1.smithi134.stdout:0/299: mknod d11/d19/d21/c69 0 2024-09-17T04:20:52.472 INFO:tasks.workunit.client.1.smithi134.stdout:7/255: write d0/f33 [902069,56051] 0 2024-09-17T04:20:52.473 INFO:tasks.workunit.client.0.smithi088.stdout:2/31: read d0/d1/f2 [234505,38859] 0 2024-09-17T04:20:52.473 INFO:tasks.workunit.client.0.smithi088.stdout:5/22: mknod d2/c7 0 2024-09-17T04:20:52.474 INFO:tasks.workunit.client.1.smithi134.stdout:5/300: dwrite d0/d3a/d2b/f58 [0,4194304] 0 2024-09-17T04:20:52.474 INFO:tasks.workunit.client.1.smithi134.stdout:8/312: creat d4/db/dd/f5b x:0 0 0 2024-09-17T04:20:52.475 INFO:tasks.workunit.client.0.smithi088.stdout:9/28: creat d2/fb x:0 0 0 2024-09-17T04:20:52.475 INFO:tasks.workunit.client.0.smithi088.stdout:9/29: fdatasync d2/fa 0 2024-09-17T04:20:52.476 INFO:tasks.workunit.client.0.smithi088.stdout:9/30: dread - d2/fa zero size 2024-09-17T04:20:52.478 INFO:tasks.workunit.client.0.smithi088.stdout:1/44: creat d0/d1/fe x:0 0 0 2024-09-17T04:20:52.478 INFO:tasks.workunit.client.0.smithi088.stdout:9/31: write f0 [778739,91542] 0 2024-09-17T04:20:52.481 INFO:tasks.workunit.client.0.smithi088.stdout:9/32: write d2/fb [436370,92083] 0 2024-09-17T04:20:52.481 INFO:tasks.workunit.client.0.smithi088.stdout:2/32: dwrite d0/d1/f3 [0,4194304] 0 2024-09-17T04:20:52.482 INFO:tasks.workunit.client.0.smithi088.stdout:9/33: chown d2/c4 0 1 2024-09-17T04:20:52.483 INFO:tasks.workunit.client.0.smithi088.stdout:9/34: write f0 [2697315,12299] 0 2024-09-17T04:20:52.490 INFO:tasks.workunit.client.1.smithi134.stdout:6/441: mkdir de/d19/d1f/d85/d88 0 2024-09-17T04:20:52.491 INFO:tasks.workunit.client.0.smithi088.stdout:4/66: mknod d5/c16 0 2024-09-17T04:20:52.491 INFO:tasks.workunit.client.0.smithi088.stdout:4/67: chown d5/le 1 1 2024-09-17T04:20:52.492 INFO:tasks.workunit.client.0.smithi088.stdout:7/67: write d2/f6 [3512954,44592] 0 2024-09-17T04:20:52.492 INFO:tasks.workunit.client.0.smithi088.stdout:7/68: stat d2/f6 0 2024-09-17T04:20:52.493 INFO:tasks.workunit.client.0.smithi088.stdout:7/69: chown d2/d4 412125155 1 2024-09-17T04:20:52.494 INFO:tasks.workunit.client.0.smithi088.stdout:7/70: rename d2 to d2/d4/d11 22 2024-09-17T04:20:52.494 INFO:tasks.workunit.client.1.smithi134.stdout:4/413: dwrite d0/df/d1e/f2e [0,4194304] 0 2024-09-17T04:20:52.494 INFO:tasks.workunit.client.0.smithi088.stdout:5/23: rename d2/l3 to d2/l8 0 2024-09-17T04:20:52.498 INFO:tasks.workunit.client.1.smithi134.stdout:7/256: unlink d0/d16/d35/d4b/l39 0 2024-09-17T04:20:52.499 INFO:tasks.workunit.client.0.smithi088.stdout:2/33: mknod d0/c7 0 2024-09-17T04:20:52.499 INFO:tasks.workunit.client.0.smithi088.stdout:2/34: readlink d0/l4 0 2024-09-17T04:20:52.502 INFO:tasks.workunit.client.1.smithi134.stdout:8/313: symlink d4/l5c 0 2024-09-17T04:20:52.502 INFO:tasks.workunit.client.1.smithi134.stdout:8/314: write d4/d23/f4b [719656,49093] 0 2024-09-17T04:20:52.503 INFO:tasks.workunit.client.0.smithi088.stdout:2/35: stat d0 0 2024-09-17T04:20:52.503 INFO:tasks.workunit.client.0.smithi088.stdout:2/36: stat d0/d1 0 2024-09-17T04:20:52.503 INFO:tasks.workunit.client.0.smithi088.stdout:7/71: dwrite d2/f3 [8388608,4194304] 0 2024-09-17T04:20:52.504 INFO:tasks.workunit.client.1.smithi134.stdout:1/352: unlink d12/d1c/d4a/d63/l6d 0 2024-09-17T04:20:52.504 INFO:tasks.workunit.client.0.smithi088.stdout:2/37: write d0/d1/f3 [2086953,86070] 0 2024-09-17T04:20:52.509 INFO:tasks.workunit.client.1.smithi134.stdout:2/379: rename d19/d1c/d47/f7a to d19/f7b 0 2024-09-17T04:20:52.512 INFO:tasks.workunit.client.0.smithi088.stdout:5/24: mkdir d2/d9 0 2024-09-17T04:20:52.512 INFO:tasks.workunit.client.0.smithi088.stdout:5/25: chown d2/c7 1536 1 2024-09-17T04:20:52.513 INFO:tasks.workunit.client.1.smithi134.stdout:4/414: unlink d0/df/d17/c49 0 2024-09-17T04:20:52.514 INFO:tasks.workunit.client.1.smithi134.stdout:9/690: getdents d2/d5/d8/d16/d54/daf/d6d/daa/de2/dcd 0 2024-09-17T04:20:52.515 INFO:tasks.workunit.client.0.smithi088.stdout:7/72: rmdir d2/d4 39 2024-09-17T04:20:52.516 INFO:tasks.workunit.client.1.smithi134.stdout:7/257: rmdir d0/d16/d35 39 2024-09-17T04:20:52.518 INFO:tasks.workunit.client.0.smithi088.stdout:2/38: fdatasync d0/d1/f2 0 2024-09-17T04:20:52.519 INFO:tasks.workunit.client.0.smithi088.stdout:9/35: link d2/f9 d2/fc 0 2024-09-17T04:20:52.520 INFO:tasks.workunit.client.0.smithi088.stdout:9/36: stat d2 0 2024-09-17T04:20:52.521 INFO:tasks.workunit.client.0.smithi088.stdout:5/26: dwrite d2/f5 [0,4194304] 0 2024-09-17T04:20:52.522 INFO:tasks.workunit.client.0.smithi088.stdout:6/49: getdents . 0 2024-09-17T04:20:52.526 INFO:tasks.workunit.client.1.smithi134.stdout:6/442: mkdir de/d19/d1f/d55/d77/d89 0 2024-09-17T04:20:52.531 INFO:tasks.workunit.client.1.smithi134.stdout:3/385: rename de/d12/d22/l32 to de/d12/d15/d1d/d2d/d63/d77/l84 0 2024-09-17T04:20:52.532 INFO:tasks.workunit.client.1.smithi134.stdout:0/300: truncate d11/d24/f47 3856637 0 2024-09-17T04:20:52.533 INFO:tasks.workunit.client.1.smithi134.stdout:0/301: readlink d11/d19/d21/l50 0 2024-09-17T04:20:52.535 INFO:tasks.workunit.client.0.smithi088.stdout:2/39: symlink d0/l8 0 2024-09-17T04:20:52.537 INFO:tasks.workunit.client.1.smithi134.stdout:7/258: write d0/d16/d35/f49 [905611,62584] 0 2024-09-17T04:20:52.538 INFO:tasks.workunit.client.0.smithi088.stdout:9/37: mkdir d2/dd 0 2024-09-17T04:20:52.538 INFO:tasks.workunit.client.1.smithi134.stdout:7/259: dread - d0/f53 zero size 2024-09-17T04:20:52.539 INFO:tasks.workunit.client.1.smithi134.stdout:0/302: dwrite d11/f14 [0,4194304] 0 2024-09-17T04:20:52.539 INFO:tasks.workunit.client.1.smithi134.stdout:8/315: mknod d4/db/c5d 0 2024-09-17T04:20:52.539 INFO:tasks.workunit.client.0.smithi088.stdout:4/68: truncate d5/f10 715455 0 2024-09-17T04:20:52.540 INFO:tasks.workunit.client.1.smithi134.stdout:0/303: chown d11/d24 973 1 2024-09-17T04:20:52.541 INFO:tasks.workunit.client.1.smithi134.stdout:0/304: readlink d11/l17 0 2024-09-17T04:20:52.541 INFO:tasks.workunit.client.1.smithi134.stdout:1/353: dread d12/d19/f25 [0,4194304] 0 2024-09-17T04:20:52.545 INFO:tasks.workunit.client.0.smithi088.stdout:7/73: mknod d2/d4/d7/c12 0 2024-09-17T04:20:52.547 INFO:tasks.workunit.client.0.smithi088.stdout:7/74: fsync d2/f3 0 2024-09-17T04:20:52.547 INFO:tasks.workunit.client.0.smithi088.stdout:7/75: readlink d2/d4/l8 0 2024-09-17T04:20:52.548 INFO:tasks.workunit.client.0.smithi088.stdout:7/76: write d2/f3 [10740357,27086] 0 2024-09-17T04:20:52.549 INFO:tasks.workunit.client.0.smithi088.stdout:2/40: creat d0/f9 x:0 0 0 2024-09-17T04:20:52.551 INFO:tasks.workunit.client.1.smithi134.stdout:8/316: dread d4/db/df/d13/f40 [0,4194304] 0 2024-09-17T04:20:52.552 INFO:tasks.workunit.client.1.smithi134.stdout:8/317: stat d4/d1f/d25/f50 0 2024-09-17T04:20:52.552 INFO:tasks.workunit.client.1.smithi134.stdout:9/691: dwrite d2/d5/d37/fa3 [0,4194304] 0 2024-09-17T04:20:52.553 INFO:tasks.workunit.client.0.smithi088.stdout:5/27: creat d2/d9/fa x:0 0 0 2024-09-17T04:20:52.553 INFO:tasks.workunit.client.1.smithi134.stdout:8/318: chown d4/d1f/d25 203227 1 2024-09-17T04:20:52.555 INFO:tasks.workunit.client.1.smithi134.stdout:2/380: link d19/f74 d19/d1c/d47/d50/f7c 0 2024-09-17T04:20:52.555 INFO:tasks.workunit.client.0.smithi088.stdout:5/28: dread d2/f4 [0,4194304] 0 2024-09-17T04:20:52.556 INFO:tasks.workunit.client.0.smithi088.stdout:5/29: chown d2/d9 1 1 2024-09-17T04:20:52.557 INFO:tasks.workunit.client.0.smithi088.stdout:5/30: write d2/f6 [473415,95024] 0 2024-09-17T04:20:52.557 INFO:tasks.workunit.client.0.smithi088.stdout:5/31: stat d2/f5 0 2024-09-17T04:20:52.558 INFO:tasks.workunit.client.0.smithi088.stdout:2/41: fsync d0/f9 0 2024-09-17T04:20:52.559 INFO:tasks.workunit.client.0.smithi088.stdout:2/42: write d0/d1/f2 [1443848,22656] 0 2024-09-17T04:20:52.563 INFO:tasks.workunit.client.1.smithi134.stdout:7/260: write d0/dd/d3a/d3d/d38/f1d [2006942,3760] 0 2024-09-17T04:20:52.563 INFO:tasks.workunit.client.0.smithi088.stdout:5/32: dread d2/f5 [0,4194304] 0 2024-09-17T04:20:52.564 INFO:tasks.workunit.client.0.smithi088.stdout:5/33: dread d2/f4 [0,4194304] 0 2024-09-17T04:20:52.565 INFO:tasks.workunit.client.0.smithi088.stdout:7/77: mknod d2/d4/d7/c13 0 2024-09-17T04:20:52.566 INFO:tasks.workunit.client.0.smithi088.stdout:5/34: write d2/f6 [602064,64962] 0 2024-09-17T04:20:52.566 INFO:tasks.workunit.client.0.smithi088.stdout:7/78: write d2/f3 [3385641,78266] 0 2024-09-17T04:20:52.567 INFO:tasks.workunit.client.0.smithi088.stdout:7/79: readlink d2/d4/l8 0 2024-09-17T04:20:52.568 INFO:tasks.workunit.client.0.smithi088.stdout:7/80: chown d2/d4/d7/f9 26271877 1 2024-09-17T04:20:52.569 INFO:tasks.workunit.client.0.smithi088.stdout:6/50: truncate f9 3381207 0 2024-09-17T04:20:52.569 INFO:tasks.workunit.client.0.smithi088.stdout:6/51: chown cc 12398 1 2024-09-17T04:20:52.570 INFO:tasks.workunit.client.1.smithi134.stdout:1/354: creat d12/d1c/d56/f76 x:0 0 0 2024-09-17T04:20:52.571 INFO:tasks.workunit.client.1.smithi134.stdout:1/355: truncate d12/d19/d5c/f69 910340 0 2024-09-17T04:20:52.573 INFO:tasks.workunit.client.1.smithi134.stdout:1/356: read d12/d1c/f74 [2678663,60909] 0 2024-09-17T04:20:52.574 INFO:tasks.workunit.client.1.smithi134.stdout:5/301: rename d0/da/f36 to d0/d3a/d2b/d5a/f5e 0 2024-09-17T04:20:52.575 INFO:tasks.workunit.client.1.smithi134.stdout:5/302: write d0/da/d2c/f4b [292866,9583] 0 2024-09-17T04:20:52.575 INFO:tasks.workunit.client.0.smithi088.stdout:4/69: truncate f1 1996121 0 2024-09-17T04:20:52.577 INFO:tasks.workunit.client.0.smithi088.stdout:5/35: dread d2/f6 [0,4194304] 0 2024-09-17T04:20:52.577 INFO:tasks.workunit.client.1.smithi134.stdout:1/357: dread d12/d1c/d2e/f50 [0,4194304] 0 2024-09-17T04:20:52.580 INFO:tasks.workunit.client.0.smithi088.stdout:4/70: dread d5/fb [0,4194304] 0 2024-09-17T04:20:52.580 INFO:tasks.workunit.client.1.smithi134.stdout:1/358: dread d12/d19/d1d/f6b [0,4194304] 0 2024-09-17T04:20:52.583 INFO:tasks.workunit.client.0.smithi088.stdout:4/71: dread d5/fd [0,4194304] 0 2024-09-17T04:20:52.585 INFO:tasks.workunit.client.1.smithi134.stdout:8/319: write d4/db/fc [214726,99601] 0 2024-09-17T04:20:52.587 INFO:tasks.workunit.client.1.smithi134.stdout:7/261: creat d0/dd/f54 x:0 0 0 2024-09-17T04:20:52.588 INFO:tasks.workunit.client.1.smithi134.stdout:7/262: write d0/dd/d3a/d3d/f41 [586712,2393] 0 2024-09-17T04:20:52.590 INFO:tasks.workunit.client.1.smithi134.stdout:6/443: rmdir de/d19/d21/d2d/d6d 0 2024-09-17T04:20:52.591 INFO:tasks.workunit.client.0.smithi088.stdout:7/81: creat d2/d4/f14 x:0 0 0 2024-09-17T04:20:52.593 INFO:tasks.workunit.client.1.smithi134.stdout:2/381: dwrite d19/f1a [0,4194304] 0 2024-09-17T04:20:52.593 INFO:tasks.workunit.client.0.smithi088.stdout:6/52: symlink lf 0 2024-09-17T04:20:52.605 INFO:tasks.workunit.client.1.smithi134.stdout:1/359: creat d12/d19/d1d/d61/f77 x:0 0 0 2024-09-17T04:20:52.605 INFO:tasks.workunit.client.1.smithi134.stdout:1/360: fdatasync d12/d1c/d2e/f67 0 2024-09-17T04:20:52.606 INFO:tasks.workunit.client.1.smithi134.stdout:1/361: stat d12/d19/d1d/d5f 0 2024-09-17T04:20:52.607 INFO:tasks.workunit.client.1.smithi134.stdout:1/362: write d12/d19/f3d [644110,77952] 0 2024-09-17T04:20:52.608 INFO:tasks.workunit.client.1.smithi134.stdout:7/263: write d0/dd/f1f [4755496,125073] 0 2024-09-17T04:20:52.608 INFO:tasks.workunit.client.1.smithi134.stdout:1/363: read - d12/f53 zero size 2024-09-17T04:20:52.608 INFO:tasks.workunit.client.0.smithi088.stdout:9/38: getdents d2 0 2024-09-17T04:20:52.609 INFO:tasks.workunit.client.1.smithi134.stdout:7/264: stat d0/dd/d3a/d3d/d38/c21 0 2024-09-17T04:20:52.609 INFO:tasks.workunit.client.0.smithi088.stdout:9/39: chown d2/c4 39083 1 2024-09-17T04:20:52.610 INFO:tasks.workunit.client.1.smithi134.stdout:7/265: chown d0/d16/f13 2 1 2024-09-17T04:20:52.610 INFO:tasks.workunit.client.1.smithi134.stdout:1/364: dread d12/d19/d5c/f69 [0,4194304] 0 2024-09-17T04:20:52.610 INFO:tasks.workunit.client.0.smithi088.stdout:7/82: creat d2/d4/d7/f15 x:0 0 0 2024-09-17T04:20:52.611 INFO:tasks.workunit.client.0.smithi088.stdout:6/53: rename f3 to f10 0 2024-09-17T04:20:52.612 INFO:tasks.workunit.client.1.smithi134.stdout:6/444: mkdir de/d2b/d8a 0 2024-09-17T04:20:52.613 INFO:tasks.workunit.client.1.smithi134.stdout:6/445: chown de/d19/d62/d34/f72 11548815 1 2024-09-17T04:20:52.614 INFO:tasks.workunit.client.0.smithi088.stdout:5/36: dwrite d2/f4 [0,4194304] 0 2024-09-17T04:20:52.615 INFO:tasks.workunit.client.0.smithi088.stdout:5/37: dread - d2/d9/fa zero size 2024-09-17T04:20:52.616 INFO:tasks.workunit.client.0.smithi088.stdout:5/38: truncate d2/f4 4821763 0 2024-09-17T04:20:52.617 INFO:tasks.workunit.client.0.smithi088.stdout:2/43: link d0/c5 d0/ca 0 2024-09-17T04:20:52.619 INFO:tasks.workunit.client.1.smithi134.stdout:8/320: dwrite d4/d1f/d2b/f2f [0,4194304] 0 2024-09-17T04:20:52.621 INFO:tasks.workunit.client.1.smithi134.stdout:5/303: symlink d0/da/d12/l5f 0 2024-09-17T04:20:52.623 INFO:tasks.workunit.client.1.smithi134.stdout:5/304: write d0/f21 [4461302,72800] 0 2024-09-17T04:20:52.623 INFO:tasks.workunit.client.1.smithi134.stdout:3/386: getdents de/d10/d3d 0 2024-09-17T04:20:52.624 INFO:tasks.workunit.client.0.smithi088.stdout:7/83: symlink d2/d4/d7/l16 0 2024-09-17T04:20:52.625 INFO:tasks.workunit.client.0.smithi088.stdout:7/84: chown d2/d4/d7/c12 66 1 2024-09-17T04:20:52.626 INFO:tasks.workunit.client.0.smithi088.stdout:6/54: creat f11 x:0 0 0 2024-09-17T04:20:52.628 INFO:tasks.workunit.client.0.smithi088.stdout:5/39: creat d2/fb x:0 0 0 2024-09-17T04:20:52.631 INFO:tasks.workunit.client.0.smithi088.stdout:2/44: creat d0/d1/fb x:0 0 0 2024-09-17T04:20:52.633 INFO:tasks.workunit.client.0.smithi088.stdout:4/72: truncate d5/f14 3162314 0 2024-09-17T04:20:52.634 INFO:tasks.workunit.client.0.smithi088.stdout:9/40: creat d2/dd/fe x:0 0 0 2024-09-17T04:20:52.635 INFO:tasks.workunit.client.1.smithi134.stdout:4/415: rename d0/df/d35/d39/c76 to d0/df/d1e/c83 0 2024-09-17T04:20:52.637 INFO:tasks.workunit.client.1.smithi134.stdout:8/321: mkdir d4/db/df/d5e 0 2024-09-17T04:20:52.638 INFO:tasks.workunit.client.0.smithi088.stdout:5/40: rename d2/f4 to d2/d9/fc 0 2024-09-17T04:20:52.639 INFO:tasks.workunit.client.1.smithi134.stdout:5/305: rmdir d0/d48 39 2024-09-17T04:20:52.640 INFO:tasks.workunit.client.0.smithi088.stdout:2/45: creat d0/fc x:0 0 0 2024-09-17T04:20:52.640 INFO:tasks.workunit.client.1.smithi134.stdout:3/387: truncate de/d12/d15/d1d/d2d/d31/f3e 1114586 0 2024-09-17T04:20:52.641 INFO:tasks.workunit.client.1.smithi134.stdout:5/306: read d0/d3a/d2b/d5a/f5e [1148807,112734] 0 2024-09-17T04:20:52.643 INFO:tasks.workunit.client.0.smithi088.stdout:9/41: mknod d2/cf 0 2024-09-17T04:20:52.645 INFO:tasks.workunit.client.1.smithi134.stdout:7/266: write d0/f20 [433694,51280] 0 2024-09-17T04:20:52.649 INFO:tasks.workunit.client.1.smithi134.stdout:0/305: dread d11/d24/f47 [0,4194304] 0 2024-09-17T04:20:52.649 INFO:tasks.workunit.client.1.smithi134.stdout:9/692: rename d2/d5/d9/cb9 to d2/d5/d37/d7c/cec 0 2024-09-17T04:20:52.650 INFO:tasks.workunit.client.1.smithi134.stdout:9/693: chown d2/d5/d8/d16/d54/d5e/cdf 5289 1 2024-09-17T04:20:52.651 INFO:tasks.workunit.client.1.smithi134.stdout:9/694: readlink d2/d5/d8/d16/d54/l63 0 2024-09-17T04:20:52.652 INFO:tasks.workunit.client.0.smithi088.stdout:5/41: readlink d2/l8 0 2024-09-17T04:20:52.652 INFO:tasks.workunit.client.1.smithi134.stdout:9/695: write d2/d5/d8/d1e/f9c [649057,114480] 0 2024-09-17T04:20:52.653 INFO:tasks.workunit.client.1.smithi134.stdout:8/322: mkdir d4/d11/d5f 0 2024-09-17T04:20:52.654 INFO:tasks.workunit.client.1.smithi134.stdout:3/388: dread de/d12/d15/d1d/f37 [0,4194304] 0 2024-09-17T04:20:52.655 INFO:tasks.workunit.client.0.smithi088.stdout:2/46: creat d0/fd x:0 0 0 2024-09-17T04:20:52.655 INFO:tasks.workunit.client.1.smithi134.stdout:9/696: dread d2/d5/d9/df/d38/f99 [0,4194304] 0 2024-09-17T04:20:52.657 INFO:tasks.workunit.client.1.smithi134.stdout:9/697: dread - d2/d5/d58/db5/fdd zero size 2024-09-17T04:20:52.659 INFO:tasks.workunit.client.1.smithi134.stdout:3/389: dwrite de/d12/f47 [0,4194304] 0 2024-09-17T04:20:52.659 INFO:tasks.workunit.client.0.smithi088.stdout:6/55: write f10 [499876,93901] 0 2024-09-17T04:20:52.660 INFO:tasks.workunit.client.0.smithi088.stdout:7/85: link d2/d4/d7/c12 d2/d4/c17 0 2024-09-17T04:20:52.660 INFO:tasks.workunit.client.1.smithi134.stdout:3/390: chown de/d12/d15/d1d/d2d/f36 76474 1 2024-09-17T04:20:52.661 INFO:tasks.workunit.client.0.smithi088.stdout:2/47: dwrite d0/d1/f2 [0,4194304] 0 2024-09-17T04:20:52.662 INFO:tasks.workunit.client.1.smithi134.stdout:2/382: rename d19/f69 to d19/d27/d64/f7d 0 2024-09-17T04:20:52.664 INFO:tasks.workunit.client.0.smithi088.stdout:5/42: creat d2/fd x:0 0 0 2024-09-17T04:20:52.666 INFO:tasks.workunit.client.1.smithi134.stdout:0/306: creat d11/d24/d49/f6a x:0 0 0 2024-09-17T04:20:52.667 INFO:tasks.workunit.client.1.smithi134.stdout:2/383: dread f11 [4194304,4194304] 0 2024-09-17T04:20:52.668 INFO:tasks.workunit.client.1.smithi134.stdout:0/307: truncate d11/d24/f58 735456 0 2024-09-17T04:20:52.670 INFO:tasks.workunit.client.0.smithi088.stdout:2/48: dwrite d0/d1/f3 [4194304,4194304] 0 2024-09-17T04:20:52.670 INFO:tasks.workunit.client.0.smithi088.stdout:4/73: rename d5/f14 to d5/f17 0 2024-09-17T04:20:52.672 INFO:tasks.workunit.client.1.smithi134.stdout:8/323: mkdir d4/d23/d60 0 2024-09-17T04:20:52.675 INFO:tasks.workunit.client.1.smithi134.stdout:0/308: dwrite d11/d18/f1e [0,4194304] 0 2024-09-17T04:20:52.676 INFO:tasks.workunit.client.0.smithi088.stdout:6/56: mknod c12 0 2024-09-17T04:20:52.676 INFO:tasks.workunit.client.1.smithi134.stdout:0/309: write d11/f3b [1843042,82269] 0 2024-09-17T04:20:52.678 INFO:tasks.workunit.client.0.smithi088.stdout:6/57: read f4 [338501,86783] 0 2024-09-17T04:20:52.679 INFO:tasks.workunit.client.0.smithi088.stdout:7/86: creat d2/d4/f18 x:0 0 0 2024-09-17T04:20:52.679 INFO:tasks.workunit.client.1.smithi134.stdout:8/324: dread d4/db/fc [0,4194304] 0 2024-09-17T04:20:52.679 INFO:tasks.workunit.client.0.smithi088.stdout:7/87: readlink d2/d4/d7/l16 0 2024-09-17T04:20:52.680 INFO:tasks.workunit.client.0.smithi088.stdout:7/88: read - d2/d4/d7/f15 zero size 2024-09-17T04:20:52.682 INFO:tasks.workunit.client.1.smithi134.stdout:4/416: truncate d0/df/d1e/d20/f45 93512 0 2024-09-17T04:20:52.682 INFO:tasks.workunit.client.1.smithi134.stdout:4/417: chown d0/l30 47688 1 2024-09-17T04:20:52.685 INFO:tasks.workunit.client.1.smithi134.stdout:9/698: mkdir d2/d5/d8/d16/d54/daf/ded 0 2024-09-17T04:20:52.686 INFO:tasks.workunit.client.1.smithi134.stdout:1/365: link d12/d1c/c52 d12/d1c/d2e/c78 0 2024-09-17T04:20:52.686 INFO:tasks.workunit.client.0.smithi088.stdout:7/89: dread d2/d4/d7/fa [0,4194304] 0 2024-09-17T04:20:52.687 INFO:tasks.workunit.client.1.smithi134.stdout:9/699: read - d2/d5/d8/d16/d54/daf/d6d/daa/de2/dcf/fdc zero size 2024-09-17T04:20:52.689 INFO:tasks.workunit.client.0.smithi088.stdout:6/58: symlink l13 0 2024-09-17T04:20:52.691 INFO:tasks.workunit.client.1.smithi134.stdout:3/391: mknod de/d12/d15/d1d/d2d/d31/d6a/d78/c85 0 2024-09-17T04:20:52.695 INFO:tasks.workunit.client.1.smithi134.stdout:0/310: symlink d11/d22/d1c/d2f/l6b 0 2024-09-17T04:20:52.696 INFO:tasks.workunit.client.0.smithi088.stdout:6/59: dwrite f5 [0,4194304] 0 2024-09-17T04:20:52.697 INFO:tasks.workunit.client.1.smithi134.stdout:4/418: chown d0/d13/d40/d42/l6c 1817 1 2024-09-17T04:20:52.702 INFO:tasks.workunit.client.1.smithi134.stdout:0/311: dwrite d11/d19/d21/f60 [0,4194304] 0 2024-09-17T04:20:52.702 INFO:tasks.workunit.client.1.smithi134.stdout:7/267: link d0/d16/f26 d0/f55 0 2024-09-17T04:20:52.703 INFO:tasks.workunit.client.0.smithi088.stdout:6/60: mkdir d14 0 2024-09-17T04:20:52.706 INFO:tasks.workunit.client.1.smithi134.stdout:1/366: dwrite d12/d19/d1d/f6b [0,4194304] 0 2024-09-17T04:20:52.706 INFO:tasks.workunit.client.0.smithi088.stdout:6/61: dread f7 [0,4194304] 0 2024-09-17T04:20:52.708 INFO:tasks.workunit.client.0.smithi088.stdout:5/43: write d2/f6 [959432,93978] 0 2024-09-17T04:20:52.709 INFO:tasks.workunit.client.1.smithi134.stdout:6/446: rename de/d19/d62/d34/d3b/l5f to de/d19/d74/l8b 0 2024-09-17T04:20:52.709 INFO:tasks.workunit.client.0.smithi088.stdout:2/49: getdents d0/d1 0 2024-09-17T04:20:52.709 INFO:tasks.workunit.client.0.smithi088.stdout:5/44: chown d2/fd 103 1 2024-09-17T04:20:52.710 INFO:tasks.workunit.client.0.smithi088.stdout:4/74: write d5/fd [1096050,95467] 0 2024-09-17T04:20:52.711 INFO:tasks.workunit.client.1.smithi134.stdout:2/384: mkdir d19/d7e 0 2024-09-17T04:20:52.711 INFO:tasks.workunit.client.0.smithi088.stdout:7/90: creat d2/f19 x:0 0 0 2024-09-17T04:20:52.713 INFO:tasks.workunit.client.0.smithi088.stdout:7/91: write d2/d4/f18 [808500,127597] 0 2024-09-17T04:20:52.715 INFO:tasks.workunit.client.0.smithi088.stdout:2/50: dread d0/d1/f3 [4194304,4194304] 0 2024-09-17T04:20:52.721 INFO:tasks.workunit.client.1.smithi134.stdout:0/312: creat d11/d19/f6c x:0 0 0 2024-09-17T04:20:52.722 INFO:tasks.workunit.client.1.smithi134.stdout:0/313: chown d11/d22/d1c/d2f/l5a 6022040 1 2024-09-17T04:20:52.722 INFO:tasks.workunit.client.0.smithi088.stdout:5/45: symlink d2/le 0 2024-09-17T04:20:52.723 INFO:tasks.workunit.client.1.smithi134.stdout:7/268: creat d0/dd/d3a/d3d/f56 x:0 0 0 2024-09-17T04:20:52.725 INFO:tasks.workunit.client.1.smithi134.stdout:7/269: write d0/dd/d3a/d3d/d38/f3c [694985,15667] 0 2024-09-17T04:20:52.725 INFO:tasks.workunit.client.0.smithi088.stdout:4/75: mknod d5/c18 0 2024-09-17T04:20:52.725 INFO:tasks.workunit.client.0.smithi088.stdout:7/92: dwrite d2/d4/d7/f9 [0,4194304] 0 2024-09-17T04:20:52.725 INFO:tasks.workunit.client.0.smithi088.stdout:2/51: dwrite d0/d1/f3 [4194304,4194304] 0 2024-09-17T04:20:52.727 INFO:tasks.workunit.client.0.smithi088.stdout:2/52: fdatasync d0/d1/f2 0 2024-09-17T04:20:52.729 INFO:tasks.workunit.client.1.smithi134.stdout:1/367: rename d12/d19/d1d/d3e/l40 to d12/d19/d1d/d61/l79 0 2024-09-17T04:20:52.730 INFO:tasks.workunit.client.1.smithi134.stdout:1/368: write d12/d1c/d2e/f75 [714317,5760] 0 2024-09-17T04:20:52.736 INFO:tasks.workunit.client.0.smithi088.stdout:7/93: dwrite d2/d4/f14 [0,4194304] 0 2024-09-17T04:20:52.736 INFO:tasks.workunit.client.0.smithi088.stdout:6/62: mkdir d14/d15 0 2024-09-17T04:20:52.741 INFO:tasks.workunit.client.1.smithi134.stdout:7/270: mkdir d0/dd/d57 0 2024-09-17T04:20:52.746 INFO:tasks.workunit.client.0.smithi088.stdout:5/46: mknod d2/d9/cf 0 2024-09-17T04:20:52.746 INFO:tasks.workunit.client.1.smithi134.stdout:7/271: read d0/dd/fb [3104635,20208] 0 2024-09-17T04:20:52.746 INFO:tasks.workunit.client.1.smithi134.stdout:8/325: rename d4/f49 to d4/db/df/d13/f61 0 2024-09-17T04:20:52.748 INFO:tasks.workunit.client.1.smithi134.stdout:8/326: write d4/d1f/d2b/f2f [2148080,58134] 0 2024-09-17T04:20:52.749 INFO:tasks.workunit.client.0.smithi088.stdout:2/53: creat d0/d1/fe x:0 0 0 2024-09-17T04:20:52.749 INFO:tasks.workunit.client.1.smithi134.stdout:7/272: dwrite d0/dd/fe [0,4194304] 0 2024-09-17T04:20:52.750 INFO:tasks.workunit.client.1.smithi134.stdout:0/314: creat d11/d22/d1c/d2f/d43/d5d/f6d x:0 0 0 2024-09-17T04:20:52.751 INFO:tasks.workunit.client.1.smithi134.stdout:0/315: write d11/d19/f6c [222948,47439] 0 2024-09-17T04:20:52.752 INFO:tasks.workunit.client.0.smithi088.stdout:7/94: fsync d2/d4/d7/fa 0 2024-09-17T04:20:52.754 INFO:tasks.workunit.client.0.smithi088.stdout:5/47: creat d2/f10 x:0 0 0 2024-09-17T04:20:52.756 INFO:tasks.workunit.client.1.smithi134.stdout:9/700: rename d2/d5/d8/d16/d54/d5e/da0/fba to d2/d5/d8/d16/d54/daf/d6d/daa/de2/dcd/fee 0 2024-09-17T04:20:52.757 INFO:tasks.workunit.client.0.smithi088.stdout:7/95: dread d2/d4/f18 [0,4194304] 0 2024-09-17T04:20:52.758 INFO:tasks.workunit.client.1.smithi134.stdout:9/701: chown d2/d5/d8/d16/d54/daf/d6d/daa/de2/dcf/fdc 53 1 2024-09-17T04:20:52.758 INFO:tasks.workunit.client.1.smithi134.stdout:9/702: stat d2/d78 0 2024-09-17T04:20:52.759 INFO:tasks.workunit.client.0.smithi088.stdout:7/96: write d2/d4/d7/f9 [624579,130987] 0 2024-09-17T04:20:52.761 INFO:tasks.workunit.client.1.smithi134.stdout:4/419: link d0/d13/d40/c53 d0/d13/d40/c84 0 2024-09-17T04:20:52.762 INFO:tasks.workunit.client.0.smithi088.stdout:6/63: mkdir d14/d15/d16 0 2024-09-17T04:20:52.763 INFO:tasks.workunit.client.1.smithi134.stdout:8/327: symlink d4/d23/l62 0 2024-09-17T04:20:52.764 INFO:tasks.workunit.client.1.smithi134.stdout:7/273: rmdir d0 39 2024-09-17T04:20:52.764 INFO:tasks.workunit.client.1.smithi134.stdout:8/328: chown d4/d1f/d25/c59 0 1 2024-09-17T04:20:52.765 INFO:tasks.workunit.client.1.smithi134.stdout:3/392: dwrite de/d12/d22/d5a/f66 [0,4194304] 0 2024-09-17T04:20:52.767 INFO:tasks.workunit.client.1.smithi134.stdout:1/369: rename d12/d1c/f74 to d12/d19/d5d/f7a 0 2024-09-17T04:20:52.774 INFO:tasks.workunit.client.1.smithi134.stdout:8/329: mknod d4/d1e/c63 0 2024-09-17T04:20:52.777 INFO:tasks.workunit.client.0.smithi088.stdout:4/76: write d5/f17 [2803966,59329] 0 2024-09-17T04:20:52.778 INFO:tasks.workunit.client.1.smithi134.stdout:1/370: mknod d12/d1c/d56/c7b 0 2024-09-17T04:20:52.778 INFO:tasks.workunit.client.0.smithi088.stdout:6/64: dread f4 [0,4194304] 0 2024-09-17T04:20:52.778 INFO:tasks.workunit.client.0.smithi088.stdout:4/77: stat d5/l12 0 2024-09-17T04:20:52.780 INFO:tasks.workunit.client.1.smithi134.stdout:1/371: truncate d12/d1c/d2e/f75 1259225 0 2024-09-17T04:20:52.781 INFO:tasks.workunit.client.1.smithi134.stdout:9/703: link d2/d5/d9/df/d38/f6c d2/d5/d8/d16/d54/daf/d6d/daa/de2/fef 0 2024-09-17T04:20:52.782 INFO:tasks.workunit.client.1.smithi134.stdout:7/274: creat d0/dd/f58 x:0 0 0 2024-09-17T04:20:52.783 INFO:tasks.workunit.client.1.smithi134.stdout:8/330: rmdir d4/d1f/d2b 39 2024-09-17T04:20:52.788 INFO:tasks.workunit.client.0.smithi088.stdout:8/26: sync 2024-09-17T04:20:52.788 INFO:tasks.workunit.client.0.smithi088.stdout:8/27: readlink - no filename 2024-09-17T04:20:52.788 INFO:tasks.workunit.client.0.smithi088.stdout:0/17: sync 2024-09-17T04:20:52.788 INFO:tasks.workunit.client.0.smithi088.stdout:1/45: sync 2024-09-17T04:20:52.788 INFO:tasks.workunit.client.0.smithi088.stdout:3/5: sync 2024-09-17T04:20:52.788 INFO:tasks.workunit.client.0.smithi088.stdout:2/54: link d0/c6 d0/d1/cf 0 2024-09-17T04:20:52.788 INFO:tasks.workunit.client.0.smithi088.stdout:0/18: fdatasync f5 0 2024-09-17T04:20:52.789 INFO:tasks.workunit.client.1.smithi134.stdout:8/331: dwrite d4/db/df/f35 [0,4194304] 0 2024-09-17T04:20:52.789 INFO:tasks.workunit.client.0.smithi088.stdout:0/19: fsync f5 0 2024-09-17T04:20:52.789 INFO:tasks.workunit.client.0.smithi088.stdout:0/20: chown f1 18 1 2024-09-17T04:20:52.790 INFO:tasks.workunit.client.1.smithi134.stdout:4/420: dread d0/df/f18 [4194304,4194304] 0 2024-09-17T04:20:52.790 INFO:tasks.workunit.client.0.smithi088.stdout:0/21: truncate f4 51206 0 2024-09-17T04:20:52.792 INFO:tasks.workunit.client.0.smithi088.stdout:6/65: symlink d14/l17 0 2024-09-17T04:20:52.792 INFO:tasks.workunit.client.0.smithi088.stdout:0/22: chown l3 315253 1 2024-09-17T04:20:52.792 INFO:tasks.workunit.client.0.smithi088.stdout:5/48: truncate d2/f6 337442 0 2024-09-17T04:20:52.794 INFO:tasks.workunit.client.1.smithi134.stdout:1/372: rename d12/d19/f3d to d12/d1c/d4a/f7c 0 2024-09-17T04:20:52.794 INFO:tasks.workunit.client.0.smithi088.stdout:0/23: write f0 [1435325,36312] 0 2024-09-17T04:20:52.796 INFO:tasks.workunit.client.0.smithi088.stdout:5/49: write d2/f10 [174208,86929] 0 2024-09-17T04:20:52.797 INFO:tasks.workunit.client.0.smithi088.stdout:7/97: creat d2/f1a x:0 0 0 2024-09-17T04:20:52.798 INFO:tasks.workunit.client.0.smithi088.stdout:1/46: dwrite d0/d1/fd [0,4194304] 0 2024-09-17T04:20:52.799 INFO:tasks.workunit.client.0.smithi088.stdout:8/28: creat f5 x:0 0 0 2024-09-17T04:20:52.799 INFO:tasks.workunit.client.0.smithi088.stdout:1/47: chown d0/db 17 1 2024-09-17T04:20:52.799 INFO:tasks.workunit.client.1.smithi134.stdout:3/393: truncate de/d10/d3d/f7d 76827 0 2024-09-17T04:20:52.800 INFO:tasks.workunit.client.0.smithi088.stdout:5/50: write d2/fb [517556,119663] 0 2024-09-17T04:20:52.800 INFO:tasks.workunit.client.1.smithi134.stdout:7/275: stat d0/dd/d3a/d3d/d38/l3f 0 2024-09-17T04:20:52.800 INFO:tasks.workunit.client.1.smithi134.stdout:3/394: chown de/d12/d22/d5a 7 1 2024-09-17T04:20:52.802 INFO:tasks.workunit.client.0.smithi088.stdout:2/55: mknod d0/c10 0 2024-09-17T04:20:52.805 INFO:tasks.workunit.client.0.smithi088.stdout:6/66: unlink cc 0 2024-09-17T04:20:52.805 INFO:tasks.workunit.client.0.smithi088.stdout:6/67: chown d14/d15/d16 14218 1 2024-09-17T04:20:52.810 INFO:tasks.workunit.client.0.smithi088.stdout:6/68: dread f5 [0,4194304] 0 2024-09-17T04:20:52.810 INFO:tasks.workunit.client.0.smithi088.stdout:0/24: creat f6 x:0 0 0 2024-09-17T04:20:52.811 INFO:tasks.workunit.client.1.smithi134.stdout:7/276: dwrite d0/d16/d35/f40 [0,4194304] 0 2024-09-17T04:20:52.811 INFO:tasks.workunit.client.1.smithi134.stdout:1/373: mkdir d12/d1c/d2e/d7d 0 2024-09-17T04:20:52.811 INFO:tasks.workunit.client.1.smithi134.stdout:3/395: dwrite de/d12/d15/d1d/f62 [0,4194304] 0 2024-09-17T04:20:52.811 INFO:tasks.workunit.client.1.smithi134.stdout:1/374: read d12/d19/f25 [2021957,109532] 0 2024-09-17T04:20:52.816 INFO:tasks.workunit.client.0.smithi088.stdout:1/48: mkdir d0/d1/df 0 2024-09-17T04:20:52.816 INFO:tasks.workunit.client.0.smithi088.stdout:1/49: chown d0/f8 353316224 1 2024-09-17T04:20:52.818 INFO:tasks.workunit.client.1.smithi134.stdout:8/332: symlink d4/db/df/d5e/l64 0 2024-09-17T04:20:52.818 INFO:tasks.workunit.client.0.smithi088.stdout:3/6: creat d0/f1 x:0 0 0 2024-09-17T04:20:52.818 INFO:tasks.workunit.client.0.smithi088.stdout:3/7: readlink - no filename 2024-09-17T04:20:52.818 INFO:tasks.workunit.client.0.smithi088.stdout:3/8: dread - d0/f1 zero size 2024-09-17T04:20:52.819 INFO:tasks.workunit.client.0.smithi088.stdout:3/9: dread - d0/f1 zero size 2024-09-17T04:20:52.821 INFO:tasks.workunit.client.1.smithi134.stdout:3/396: dwrite de/d12/d22/f81 [0,4194304] 0 2024-09-17T04:20:52.821 INFO:tasks.workunit.client.1.smithi134.stdout:3/397: chown de/l38 4412 1 2024-09-17T04:20:52.822 INFO:tasks.workunit.client.0.smithi088.stdout:2/56: creat d0/d1/f11 x:0 0 0 2024-09-17T04:20:52.827 INFO:tasks.workunit.client.1.smithi134.stdout:1/375: mknod d12/d36/c7e 0 2024-09-17T04:20:52.827 INFO:tasks.workunit.client.1.smithi134.stdout:9/704: dwrite d2/d7/d75/d96/fce [0,4194304] 0 2024-09-17T04:20:52.828 INFO:tasks.workunit.client.0.smithi088.stdout:0/25: mknod c7 0 2024-09-17T04:20:52.834 INFO:tasks.workunit.client.1.smithi134.stdout:3/398: symlink de/d12/d15/d1d/d2d/l86 0 2024-09-17T04:20:52.835 INFO:tasks.workunit.client.0.smithi088.stdout:8/29: rename f5 to f6 0 2024-09-17T04:20:52.835 INFO:tasks.workunit.client.0.smithi088.stdout:8/30: read - f6 zero size 2024-09-17T04:20:52.836 INFO:tasks.workunit.client.0.smithi088.stdout:8/31: dread f2 [0,4194304] 0 2024-09-17T04:20:52.837 INFO:tasks.workunit.client.1.smithi134.stdout:4/421: rename d0/df/d35/d39/f56 to d0/df/f85 0 2024-09-17T04:20:52.838 INFO:tasks.workunit.client.0.smithi088.stdout:1/50: write d0/f8 [1768200,127785] 0 2024-09-17T04:20:52.838 INFO:tasks.workunit.client.1.smithi134.stdout:7/277: mknod d0/dd/d57/c59 0 2024-09-17T04:20:52.840 INFO:tasks.workunit.client.0.smithi088.stdout:3/10: creat d0/f2 x:0 0 0 2024-09-17T04:20:52.840 INFO:tasks.workunit.client.0.smithi088.stdout:3/11: chown d0 133757855 1 2024-09-17T04:20:52.840 INFO:tasks.workunit.client.0.smithi088.stdout:3/12: truncate d0/f2 779186 0 2024-09-17T04:20:52.841 INFO:tasks.workunit.client.1.smithi134.stdout:1/376: unlink d12/d36/c60 0 2024-09-17T04:20:52.842 INFO:tasks.workunit.client.0.smithi088.stdout:3/13: dread d0/f2 [0,4194304] 0 2024-09-17T04:20:52.843 INFO:tasks.workunit.client.0.smithi088.stdout:3/14: write d0/f1 [942065,24070] 0 2024-09-17T04:20:52.845 INFO:tasks.workunit.client.1.smithi134.stdout:3/399: creat de/d10/d70/f87 x:0 0 0 2024-09-17T04:20:52.845 INFO:tasks.workunit.client.0.smithi088.stdout:6/69: symlink d14/d15/d16/l18 0 2024-09-17T04:20:52.846 INFO:tasks.workunit.client.1.smithi134.stdout:5/307: sync 2024-09-17T04:20:52.847 INFO:tasks.workunit.client.0.smithi088.stdout:0/26: symlink l8 0 2024-09-17T04:20:52.848 INFO:tasks.workunit.client.1.smithi134.stdout:4/422: mkdir d0/df/d1e/d20/d86 0 2024-09-17T04:20:52.849 INFO:tasks.workunit.client.0.smithi088.stdout:7/98: creat d2/f1b x:0 0 0 2024-09-17T04:20:52.853 INFO:tasks.workunit.client.1.smithi134.stdout:1/377: rename d12/d1c/d4a/f7c to d12/d19/d4f/f7f 0 2024-09-17T04:20:52.853 INFO:tasks.workunit.client.1.smithi134.stdout:1/378: read - d12/d19/d1d/f44 zero size 2024-09-17T04:20:52.855 INFO:tasks.workunit.client.1.smithi134.stdout:9/705: write d2/d5/fb [6257268,6210] 0 2024-09-17T04:20:52.856 INFO:tasks.workunit.client.1.smithi134.stdout:3/400: symlink de/d12/d22/d5a/l88 0 2024-09-17T04:20:52.857 INFO:tasks.workunit.client.0.smithi088.stdout:8/32: mkdir d7 0 2024-09-17T04:20:52.857 INFO:tasks.workunit.client.1.smithi134.stdout:9/706: readlink d2/d5/d37/l61 0 2024-09-17T04:20:52.859 INFO:tasks.workunit.client.1.smithi134.stdout:1/379: dwrite d12/d1c/d2e/f3b [0,4194304] 0 2024-09-17T04:20:52.861 INFO:tasks.workunit.client.1.smithi134.stdout:1/380: truncate d12/d19/d1d/f44 605209 0 2024-09-17T04:20:52.861 INFO:tasks.workunit.client.1.smithi134.stdout:8/333: link d4/d1f/d2b/l42 d4/db/dd/l65 0 2024-09-17T04:20:52.864 INFO:tasks.workunit.client.1.smithi134.stdout:3/401: unlink de/d12/d15/d1d/l59 0 2024-09-17T04:20:52.864 INFO:tasks.workunit.client.0.smithi088.stdout:6/70: symlink d14/l19 0 2024-09-17T04:20:52.864 INFO:tasks.workunit.client.0.smithi088.stdout:6/71: readlink l13 0 2024-09-17T04:20:52.866 INFO:tasks.workunit.client.1.smithi134.stdout:5/308: link d0/da/d29/f4e d0/da/d29/f60 0 2024-09-17T04:20:52.867 INFO:tasks.workunit.client.1.smithi134.stdout:7/278: creat d0/d16/f5a x:0 0 0 2024-09-17T04:20:52.868 INFO:tasks.workunit.client.0.smithi088.stdout:7/99: symlink d2/d4/d7/l1c 0 2024-09-17T04:20:52.868 INFO:tasks.workunit.client.1.smithi134.stdout:8/334: dwrite d4/d1f/f44 [0,4194304] 0 2024-09-17T04:20:52.869 INFO:tasks.workunit.client.0.smithi088.stdout:7/100: dread - d2/f1b zero size 2024-09-17T04:20:52.869 INFO:tasks.workunit.client.0.smithi088.stdout:5/51: truncate d2/f6 1061795 0 2024-09-17T04:20:52.869 INFO:tasks.workunit.client.0.smithi088.stdout:7/101: write d2/d4/f14 [3371027,127697] 0 2024-09-17T04:20:52.870 INFO:tasks.workunit.client.0.smithi088.stdout:5/52: write d2/f10 [314370,16210] 0 2024-09-17T04:20:52.871 INFO:tasks.workunit.client.0.smithi088.stdout:8/33: write f6 [998217,101493] 0 2024-09-17T04:20:52.872 INFO:tasks.workunit.client.0.smithi088.stdout:1/51: creat d0/d1/df/f10 x:0 0 0 2024-09-17T04:20:52.872 INFO:tasks.workunit.client.0.smithi088.stdout:5/53: stat d2/d9/fc 0 2024-09-17T04:20:52.872 INFO:tasks.workunit.client.0.smithi088.stdout:7/102: chown d2/d4/d7/fa 759148 1 2024-09-17T04:20:52.873 INFO:tasks.workunit.client.1.smithi134.stdout:5/309: mkdir d0/d3a/d2b/d61 0 2024-09-17T04:20:52.876 INFO:tasks.workunit.client.0.smithi088.stdout:5/54: dread d2/f10 [0,4194304] 0 2024-09-17T04:20:52.876 INFO:tasks.workunit.client.1.smithi134.stdout:3/402: rename de/d12/d15/d1d/f37 to de/d12/d15/d1d/d2d/d31/d6a/d83/f89 0 2024-09-17T04:20:52.877 INFO:tasks.workunit.client.1.smithi134.stdout:1/381: dwrite d12/d1c/f24 [0,4194304] 0 2024-09-17T04:20:52.878 INFO:tasks.workunit.client.1.smithi134.stdout:3/403: fsync de/d12/d15/d1d/d2d/f36 0 2024-09-17T04:20:52.878 INFO:tasks.workunit.client.1.smithi134.stdout:6/447: sync 2024-09-17T04:20:52.880 INFO:tasks.workunit.client.1.smithi134.stdout:8/335: creat d4/db/df/d5e/f66 x:0 0 0 2024-09-17T04:20:52.881 INFO:tasks.workunit.client.0.smithi088.stdout:6/72: mknod d14/c1a 0 2024-09-17T04:20:52.881 INFO:tasks.workunit.client.0.smithi088.stdout:1/52: dwrite d0/f4 [0,4194304] 0 2024-09-17T04:20:52.882 INFO:tasks.workunit.client.0.smithi088.stdout:1/53: dread - d0/d1/df/f10 zero size 2024-09-17T04:20:52.883 INFO:tasks.workunit.client.1.smithi134.stdout:7/279: mknod d0/dd/d3a/d51/c5b 0 2024-09-17T04:20:52.886 INFO:tasks.workunit.client.1.smithi134.stdout:7/280: write d0/dd/f54 [401188,94154] 0 2024-09-17T04:20:52.886 INFO:tasks.workunit.client.1.smithi134.stdout:1/382: mknod d12/d19/d1d/d3e/c80 0 2024-09-17T04:20:52.887 INFO:tasks.workunit.client.1.smithi134.stdout:9/707: creat d2/d5/d8/d16/d54/d5e/ff0 x:0 0 0 2024-09-17T04:20:52.888 INFO:tasks.workunit.client.1.smithi134.stdout:9/708: stat d2/d5/d9/f18 0 2024-09-17T04:20:52.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:52 smithi088 ceph-mon[27811]: pgmap v17: 65 pgs: 65 active+clean; 915 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 14 MiB/s rd, 112 MiB/s wr, 410 op/s 2024-09-17T04:20:52.893 INFO:tasks.workunit.client.1.smithi134.stdout:5/310: link d0/f21 d0/d3a/d2b/f62 0 2024-09-17T04:20:52.893 INFO:tasks.workunit.client.0.smithi088.stdout:2/57: getdents d0 0 2024-09-17T04:20:52.895 INFO:tasks.workunit.client.0.smithi088.stdout:5/55: symlink d2/d9/l11 0 2024-09-17T04:20:52.895 INFO:tasks.workunit.client.1.smithi134.stdout:3/404: dwrite de/d12/d22/f26 [0,4194304] 0 2024-09-17T04:20:52.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:52 smithi134 ceph-mon[35201]: pgmap v17: 65 pgs: 65 active+clean; 915 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 14 MiB/s rd, 112 MiB/s wr, 410 op/s 2024-09-17T04:20:52.896 INFO:tasks.workunit.client.1.smithi134.stdout:1/383: readlink d12/d36/l57 0 2024-09-17T04:20:52.898 INFO:tasks.workunit.client.1.smithi134.stdout:1/384: truncate d12/d19/d5c/f6f 683130 0 2024-09-17T04:20:52.901 INFO:tasks.workunit.client.1.smithi134.stdout:6/448: link de/d19/d21/d2d/f5b de/f8c 0 2024-09-17T04:20:52.902 INFO:tasks.workunit.client.1.smithi134.stdout:6/449: fsync de/d19/d1f/f28 0 2024-09-17T04:20:52.903 INFO:tasks.workunit.client.0.smithi088.stdout:8/34: creat d7/f8 x:0 0 0 2024-09-17T04:20:52.903 INFO:tasks.workunit.client.0.smithi088.stdout:2/58: dwrite d0/fc [0,4194304] 0 2024-09-17T04:20:52.905 INFO:tasks.workunit.client.0.smithi088.stdout:8/35: fdatasync d7/f8 0 2024-09-17T04:20:52.907 INFO:tasks.workunit.client.0.smithi088.stdout:7/103: mkdir d2/d1d 0 2024-09-17T04:20:52.908 INFO:tasks.workunit.client.0.smithi088.stdout:5/56: dwrite d2/fd [0,4194304] 0 2024-09-17T04:20:52.908 INFO:tasks.workunit.client.0.smithi088.stdout:2/59: truncate d0/d1/fb 435436 0 2024-09-17T04:20:52.909 INFO:tasks.workunit.client.0.smithi088.stdout:2/60: stat d0/l8 0 2024-09-17T04:20:52.910 INFO:tasks.workunit.client.0.smithi088.stdout:2/61: fsync d0/d1/f11 0 2024-09-17T04:20:52.915 INFO:tasks.workunit.client.1.smithi134.stdout:5/311: dwrite d0/f21 [0,4194304] 0 2024-09-17T04:20:52.915 INFO:tasks.workunit.client.0.smithi088.stdout:3/15: truncate d0/f1 453596 0 2024-09-17T04:20:52.917 INFO:tasks.workunit.client.1.smithi134.stdout:3/405: creat de/d12/d15/d1d/d2d/d63/d77/f8a x:0 0 0 2024-09-17T04:20:52.918 INFO:tasks.workunit.client.0.smithi088.stdout:6/73: truncate f9 3797214 0 2024-09-17T04:20:52.919 INFO:tasks.workunit.client.1.smithi134.stdout:3/406: chown de/d10/c56 2121928 1 2024-09-17T04:20:52.920 INFO:tasks.workunit.client.0.smithi088.stdout:0/27: truncate f0 2291426 0 2024-09-17T04:20:52.922 INFO:tasks.workunit.client.1.smithi134.stdout:5/312: dwrite d0/d3a/f3b [0,4194304] 0 2024-09-17T04:20:52.922 INFO:tasks.workunit.client.1.smithi134.stdout:5/313: stat d0/d3a/d2b/l33 0 2024-09-17T04:20:52.922 INFO:tasks.workunit.client.1.smithi134.stdout:1/385: mknod d12/d1c/d4a/c81 0 2024-09-17T04:20:52.923 INFO:tasks.workunit.client.1.smithi134.stdout:1/386: stat d12/d19/d1d/d61 0 2024-09-17T04:20:52.927 INFO:tasks.workunit.client.1.smithi134.stdout:5/314: read d0/da/d2c/f4b [251793,68852] 0 2024-09-17T04:20:52.929 INFO:tasks.workunit.client.1.smithi134.stdout:8/336: creat d4/d1f/f67 x:0 0 0 2024-09-17T04:20:52.929 INFO:tasks.workunit.client.0.smithi088.stdout:0/28: dwrite f5 [0,4194304] 0 2024-09-17T04:20:52.930 INFO:tasks.workunit.client.0.smithi088.stdout:8/36: creat d7/f9 x:0 0 0 2024-09-17T04:20:52.932 INFO:tasks.workunit.client.1.smithi134.stdout:6/450: chown de/d19/d1f/d5c 14724892 1 2024-09-17T04:20:52.933 INFO:tasks.workunit.client.1.smithi134.stdout:6/451: read de/d19/d21/d4d/f6f [78746,6351] 0 2024-09-17T04:20:52.934 INFO:tasks.workunit.client.1.smithi134.stdout:6/452: write f7 [1636213,36582] 0 2024-09-17T04:20:52.935 INFO:tasks.workunit.client.1.smithi134.stdout:7/281: creat d0/dd/d3a/f5c x:0 0 0 2024-09-17T04:20:52.936 INFO:tasks.workunit.client.1.smithi134.stdout:7/282: read - d0/f53 zero size 2024-09-17T04:20:52.938 INFO:tasks.workunit.client.1.smithi134.stdout:7/283: truncate d0/d16/d35/d4b/f52 427226 0 2024-09-17T04:20:52.938 INFO:tasks.workunit.client.0.smithi088.stdout:2/62: rename d0/fc to d0/f12 0 2024-09-17T04:20:52.938 INFO:tasks.workunit.client.0.smithi088.stdout:9/42: sync 2024-09-17T04:20:52.939 INFO:tasks.workunit.client.1.smithi134.stdout:9/709: link d2/d5/d9/f30 d2/d5/d58/ff1 0 2024-09-17T04:20:52.940 INFO:tasks.workunit.client.0.smithi088.stdout:3/16: dread d0/f2 [0,4194304] 0 2024-09-17T04:20:52.942 INFO:tasks.workunit.client.0.smithi088.stdout:6/74: symlink d14/l1b 0 2024-09-17T04:20:52.944 INFO:tasks.workunit.client.0.smithi088.stdout:1/54: truncate d0/f8 935227 0 2024-09-17T04:20:52.950 INFO:tasks.workunit.client.0.smithi088.stdout:0/29: rename f2 to f9 0 2024-09-17T04:20:52.950 INFO:tasks.workunit.client.0.smithi088.stdout:8/37: mknod d7/ca 0 2024-09-17T04:20:52.950 INFO:tasks.workunit.client.1.smithi134.stdout:3/407: dread de/d12/d15/d1d/d2d/f53 [0,4194304] 0 2024-09-17T04:20:52.951 INFO:tasks.workunit.client.1.smithi134.stdout:7/284: dread d0/f20 [0,4194304] 0 2024-09-17T04:20:52.951 INFO:tasks.workunit.client.1.smithi134.stdout:5/315: write d0/d3a/d2b/f34 [100382,130808] 0 2024-09-17T04:20:52.951 INFO:tasks.workunit.client.1.smithi134.stdout:5/316: dread d0/f21 [0,4194304] 0 2024-09-17T04:20:52.952 INFO:tasks.workunit.client.1.smithi134.stdout:5/317: truncate d0/f5c 633374 0 2024-09-17T04:20:52.953 INFO:tasks.workunit.client.1.smithi134.stdout:5/318: write d0/da/f2e [708576,51807] 0 2024-09-17T04:20:52.956 INFO:tasks.workunit.client.1.smithi134.stdout:6/453: dread fd [0,4194304] 0 2024-09-17T04:20:52.957 INFO:tasks.workunit.client.1.smithi134.stdout:6/454: write de/d19/d21/f7a [938574,59010] 0 2024-09-17T04:20:52.961 INFO:tasks.workunit.client.0.smithi088.stdout:9/43: symlink d2/dd/l10 0 2024-09-17T04:20:52.962 INFO:tasks.workunit.client.1.smithi134.stdout:1/387: creat d12/d19/d66/f82 x:0 0 0 2024-09-17T04:20:52.964 INFO:tasks.workunit.client.0.smithi088.stdout:6/75: mknod d14/d15/c1c 0 2024-09-17T04:20:52.965 INFO:tasks.workunit.client.0.smithi088.stdout:6/76: truncate f11 756252 0 2024-09-17T04:20:52.968 INFO:tasks.workunit.client.0.smithi088.stdout:1/55: mknod d0/d1/c11 0 2024-09-17T04:20:52.971 INFO:tasks.workunit.client.0.smithi088.stdout:5/57: truncate d2/f5 3297749 0 2024-09-17T04:20:52.973 INFO:tasks.workunit.client.0.smithi088.stdout:8/38: mknod d7/cb 0 2024-09-17T04:20:52.973 INFO:tasks.workunit.client.0.smithi088.stdout:8/39: readlink - no filename 2024-09-17T04:20:52.976 INFO:tasks.workunit.client.0.smithi088.stdout:1/56: dwrite d0/d1/fd [4194304,4194304] 0 2024-09-17T04:20:52.979 INFO:tasks.workunit.client.1.smithi134.stdout:5/319: read d0/da/f1e [1079587,124815] 0 2024-09-17T04:20:52.981 INFO:tasks.workunit.client.0.smithi088.stdout:9/44: mkdir d2/dd/d11 0 2024-09-17T04:20:52.984 INFO:tasks.workunit.client.1.smithi134.stdout:6/455: rename de/d19/d1f/f60 to de/d19/d7b/f8d 0 2024-09-17T04:20:52.986 INFO:tasks.workunit.client.1.smithi134.stdout:1/388: mknod d12/d19/d1d/d3e/c83 0 2024-09-17T04:20:52.989 INFO:tasks.workunit.client.0.smithi088.stdout:5/58: creat d2/d9/f12 x:0 0 0 2024-09-17T04:20:52.991 INFO:tasks.workunit.client.1.smithi134.stdout:3/408: creat de/d12/d15/d1d/f8b x:0 0 0 2024-09-17T04:20:52.992 INFO:tasks.workunit.client.0.smithi088.stdout:7/104: getdents d2/d4/d7 0 2024-09-17T04:20:52.993 INFO:tasks.workunit.client.1.smithi134.stdout:1/389: rename d12/d1c/l58 to d12/d19/d1d/l84 0 2024-09-17T04:20:52.994 INFO:tasks.workunit.client.1.smithi134.stdout:8/337: truncate d4/d23/f4b 273418 0 2024-09-17T04:20:52.995 INFO:tasks.workunit.client.1.smithi134.stdout:1/390: write d12/d1c/d2e/f75 [1839543,87555] 0 2024-09-17T04:20:52.996 INFO:tasks.workunit.client.1.smithi134.stdout:1/391: fdatasync d12/d19/d66/f82 0 2024-09-17T04:20:52.998 INFO:tasks.workunit.client.0.smithi088.stdout:9/45: unlink d2/c5 0 2024-09-17T04:20:52.999 INFO:tasks.workunit.client.1.smithi134.stdout:2/385: sync 2024-09-17T04:20:52.999 INFO:tasks.workunit.client.1.smithi134.stdout:0/316: sync 2024-09-17T04:20:53.001 INFO:tasks.workunit.client.1.smithi134.stdout:3/409: truncate de/f2a 228772 0 2024-09-17T04:20:53.002 INFO:tasks.workunit.client.1.smithi134.stdout:5/320: dread d0/da/d2c/f37 [0,4194304] 0 2024-09-17T04:20:53.003 INFO:tasks.workunit.client.1.smithi134.stdout:1/392: mkdir d12/d19/d5c/d85 0 2024-09-17T04:20:53.004 INFO:tasks.workunit.client.1.smithi134.stdout:9/710: truncate d2/d5/d8/d1e/f9c 117450 0 2024-09-17T04:20:53.007 INFO:tasks.workunit.client.1.smithi134.stdout:3/410: dwrite de/d12/d15/d1d/f61 [0,4194304] 0 2024-09-17T04:20:53.008 INFO:tasks.workunit.client.1.smithi134.stdout:6/456: dread de/d19/d62/d34/f3c [0,4194304] 0 2024-09-17T04:20:53.008 INFO:tasks.workunit.client.1.smithi134.stdout:0/317: read d11/d24/d49/f5b [2098599,91419] 0 2024-09-17T04:20:53.009 INFO:tasks.workunit.client.0.smithi088.stdout:2/63: getdents d0/d1 0 2024-09-17T04:20:53.009 INFO:tasks.workunit.client.1.smithi134.stdout:8/338: symlink d4/d11/d5f/l68 0 2024-09-17T04:20:53.010 INFO:tasks.workunit.client.1.smithi134.stdout:8/339: chown d4/f36 228078667 1 2024-09-17T04:20:53.011 INFO:tasks.workunit.client.1.smithi134.stdout:8/340: truncate d4/db/dd/f3b 249334 0 2024-09-17T04:20:53.012 INFO:tasks.workunit.client.1.smithi134.stdout:8/341: chown d4/db/df/d5e/l64 17978 1 2024-09-17T04:20:53.012 INFO:tasks.workunit.client.1.smithi134.stdout:8/342: chown d4/d1e 7 1 2024-09-17T04:20:53.014 INFO:tasks.workunit.client.1.smithi134.stdout:5/321: rename d0/f21 to d0/da/d2c/f63 0 2024-09-17T04:20:53.015 INFO:tasks.workunit.client.1.smithi134.stdout:5/322: chown d0/da/d29/c5d 1 1 2024-09-17T04:20:53.016 INFO:tasks.workunit.client.1.smithi134.stdout:2/386: dread d19/d27/d31/d34/f45 [0,4194304] 0 2024-09-17T04:20:53.017 INFO:tasks.workunit.client.0.smithi088.stdout:0/30: getdents . 0 2024-09-17T04:20:53.018 INFO:tasks.workunit.client.1.smithi134.stdout:8/343: dread d4/f10 [0,4194304] 0 2024-09-17T04:20:53.019 INFO:tasks.workunit.client.0.smithi088.stdout:5/59: fdatasync d2/f6 0 2024-09-17T04:20:53.019 INFO:tasks.workunit.client.1.smithi134.stdout:5/323: dread d0/da/d2c/f37 [0,4194304] 0 2024-09-17T04:20:53.019 INFO:tasks.workunit.client.1.smithi134.stdout:8/344: rename d4/db/df/d5e to d4/db/df/d5e/d69 22 2024-09-17T04:20:53.021 INFO:tasks.workunit.client.1.smithi134.stdout:9/711: unlink d2/d5/d8/d16/d54/f66 0 2024-09-17T04:20:53.021 INFO:tasks.workunit.client.0.smithi088.stdout:8/40: link d7/ca d7/cc 0 2024-09-17T04:20:53.022 INFO:tasks.workunit.client.0.smithi088.stdout:8/41: write d7/f8 [814195,49825] 0 2024-09-17T04:20:53.022 INFO:tasks.workunit.client.1.smithi134.stdout:5/324: dread d0/da/f2e [0,4194304] 0 2024-09-17T04:20:53.023 INFO:tasks.workunit.client.1.smithi134.stdout:7/285: sync 2024-09-17T04:20:53.023 INFO:tasks.workunit.client.1.smithi134.stdout:4/423: sync 2024-09-17T04:20:53.023 INFO:tasks.workunit.client.0.smithi088.stdout:7/105: mkdir d2/d1e 0 2024-09-17T04:20:53.025 INFO:tasks.workunit.client.0.smithi088.stdout:1/57: link d0/d1/c11 d0/db/c12 0 2024-09-17T04:20:53.028 INFO:tasks.workunit.client.1.smithi134.stdout:4/424: read d0/df/d35/d5c/f6b [4064691,106707] 0 2024-09-17T04:20:53.028 INFO:tasks.workunit.client.1.smithi134.stdout:9/712: dwrite d2/d5/d9/d6b/de1/f6e [0,4194304] 0 2024-09-17T04:20:53.029 INFO:tasks.workunit.client.0.smithi088.stdout:2/64: mkdir d0/d13 0 2024-09-17T04:20:53.029 INFO:tasks.workunit.client.0.smithi088.stdout:8/42: dread d7/f8 [0,4194304] 0 2024-09-17T04:20:53.029 INFO:tasks.workunit.client.0.smithi088.stdout:8/43: write d7/f9 [528787,121466] 0 2024-09-17T04:20:53.030 INFO:tasks.workunit.client.1.smithi134.stdout:5/325: dwrite d0/da/f2e [0,4194304] 0 2024-09-17T04:20:53.030 INFO:tasks.workunit.client.1.smithi134.stdout:9/713: write d2/d5/d8/d16/f72 [4185656,52912] 0 2024-09-17T04:20:53.031 INFO:tasks.workunit.client.0.smithi088.stdout:9/46: symlink d2/dd/d11/l12 0 2024-09-17T04:20:53.035 INFO:tasks.workunit.client.0.smithi088.stdout:3/17: dread d0/f1 [0,4194304] 0 2024-09-17T04:20:53.041 INFO:tasks.workunit.client.1.smithi134.stdout:8/345: mkdir d4/d1f/d25/d6a 0 2024-09-17T04:20:53.042 INFO:tasks.workunit.client.1.smithi134.stdout:8/346: chown d4/d1f/d25/l55 136703899 1 2024-09-17T04:20:53.047 INFO:tasks.workunit.client.1.smithi134.stdout:6/457: mkdir de/d19/d62/d34/d8e 0 2024-09-17T04:20:53.048 INFO:tasks.workunit.client.0.smithi088.stdout:1/58: write d0/f4 [303065,73493] 0 2024-09-17T04:20:53.048 INFO:tasks.workunit.client.0.smithi088.stdout:1/59: chown d0/d1/df/f10 201277 1 2024-09-17T04:20:53.048 INFO:tasks.workunit.client.0.smithi088.stdout:2/65: mkdir d0/d14 0 2024-09-17T04:20:53.048 INFO:tasks.workunit.client.0.smithi088.stdout:2/66: dread - d0/d1/fe zero size 2024-09-17T04:20:53.049 INFO:tasks.workunit.client.0.smithi088.stdout:8/44: mkdir d7/dd 0 2024-09-17T04:20:53.051 INFO:tasks.workunit.client.0.smithi088.stdout:9/47: fdatasync d2/f6 0 2024-09-17T04:20:53.052 INFO:tasks.workunit.client.0.smithi088.stdout:3/18: rmdir d0 39 2024-09-17T04:20:53.055 INFO:tasks.workunit.client.1.smithi134.stdout:2/387: dread d19/d27/f32 [0,4194304] 0 2024-09-17T04:20:53.059 INFO:tasks.workunit.client.1.smithi134.stdout:1/393: creat d12/f86 x:0 0 0 2024-09-17T04:20:53.060 INFO:tasks.workunit.client.0.smithi088.stdout:1/60: fdatasync d0/d1/fa 0 2024-09-17T04:20:53.063 INFO:tasks.workunit.client.1.smithi134.stdout:8/347: rename d4/db/df to d4/d23/d60/d6b 0 2024-09-17T04:20:53.063 INFO:tasks.workunit.client.1.smithi134.stdout:8/348: read - d4/d1f/f67 zero size 2024-09-17T04:20:53.065 INFO:tasks.workunit.client.0.smithi088.stdout:7/106: write d2/d4/f18 [1900370,47219] 0 2024-09-17T04:20:53.065 INFO:tasks.workunit.client.0.smithi088.stdout:0/31: dwrite f0 [0,4194304] 0 2024-09-17T04:20:53.067 INFO:tasks.workunit.client.0.smithi088.stdout:0/32: stat f0 0 2024-09-17T04:20:53.069 INFO:tasks.workunit.client.1.smithi134.stdout:3/411: creat de/d10/f8c x:0 0 0 2024-09-17T04:20:53.071 INFO:tasks.workunit.client.0.smithi088.stdout:9/48: symlink d2/dd/d11/l13 0 2024-09-17T04:20:53.072 INFO:tasks.workunit.client.0.smithi088.stdout:9/49: dread - d2/fa zero size 2024-09-17T04:20:53.073 INFO:tasks.workunit.client.1.smithi134.stdout:4/425: write d0/df/f18 [8836128,18339] 0 2024-09-17T04:20:53.074 INFO:tasks.workunit.client.0.smithi088.stdout:8/45: dwrite d7/f8 [0,4194304] 0 2024-09-17T04:20:53.074 INFO:tasks.workunit.client.0.smithi088.stdout:8/46: readlink - no filename 2024-09-17T04:20:53.074 INFO:tasks.workunit.client.0.smithi088.stdout:1/61: rmdir d0/db 39 2024-09-17T04:20:53.075 INFO:tasks.workunit.client.1.smithi134.stdout:6/458: dread de/d19/d21/d4d/f6f [0,4194304] 0 2024-09-17T04:20:53.076 INFO:tasks.workunit.client.0.smithi088.stdout:8/47: write f6 [594459,117479] 0 2024-09-17T04:20:53.076 INFO:tasks.workunit.client.0.smithi088.stdout:3/19: dread d0/f1 [0,4194304] 0 2024-09-17T04:20:53.077 INFO:tasks.workunit.client.0.smithi088.stdout:2/67: mknod d0/d14/c15 0 2024-09-17T04:20:53.078 INFO:tasks.workunit.client.0.smithi088.stdout:5/60: truncate d2/d9/fc 2294808 0 2024-09-17T04:20:53.081 INFO:tasks.workunit.client.0.smithi088.stdout:7/107: mknod d2/d4/c1f 0 2024-09-17T04:20:53.083 INFO:tasks.workunit.client.0.smithi088.stdout:0/33: rename c7 to ca 0 2024-09-17T04:20:53.086 INFO:tasks.workunit.client.1.smithi134.stdout:5/326: symlink d0/da/l64 0 2024-09-17T04:20:53.087 INFO:tasks.workunit.client.0.smithi088.stdout:9/50: mkdir d2/dd/d14 0 2024-09-17T04:20:53.089 INFO:tasks.workunit.client.1.smithi134.stdout:9/714: link d2/d78/fc0 d2/d5/d37/d83/ff2 0 2024-09-17T04:20:53.089 INFO:tasks.workunit.client.1.smithi134.stdout:1/394: creat d12/d19/d1d/d5f/f87 x:0 0 0 2024-09-17T04:20:53.092 INFO:tasks.workunit.client.0.smithi088.stdout:5/61: creat d2/f13 x:0 0 0 2024-09-17T04:20:53.093 INFO:tasks.workunit.client.0.smithi088.stdout:5/62: dread - d2/d9/f12 zero size 2024-09-17T04:20:53.093 INFO:tasks.workunit.client.1.smithi134.stdout:4/426: creat d0/d13/d40/d42/f87 x:0 0 0 2024-09-17T04:20:53.093 INFO:tasks.workunit.client.0.smithi088.stdout:5/63: stat d2/f13 0 2024-09-17T04:20:53.094 INFO:tasks.workunit.client.0.smithi088.stdout:7/108: mkdir d2/d4/d7/d20 0 2024-09-17T04:20:53.095 INFO:tasks.workunit.client.0.smithi088.stdout:0/34: mkdir db 0 2024-09-17T04:20:53.096 INFO:tasks.workunit.client.0.smithi088.stdout:9/51: creat d2/dd/f15 x:0 0 0 2024-09-17T04:20:53.097 INFO:tasks.workunit.client.1.smithi134.stdout:0/318: getdents d11/d18 0 2024-09-17T04:20:53.099 INFO:tasks.workunit.client.1.smithi134.stdout:2/388: mknod d19/d77/c7f 0 2024-09-17T04:20:53.100 INFO:tasks.workunit.client.0.smithi088.stdout:8/48: creat d7/dd/fe x:0 0 0 2024-09-17T04:20:53.101 INFO:tasks.workunit.client.1.smithi134.stdout:9/715: mkdir d2/d5/d8/d16/df3 0 2024-09-17T04:20:53.102 INFO:tasks.workunit.client.0.smithi088.stdout:2/68: creat d0/d13/f16 x:0 0 0 2024-09-17T04:20:53.104 INFO:tasks.workunit.client.1.smithi134.stdout:1/395: chown d12/d19/d1d/d61/l79 2859 1 2024-09-17T04:20:53.104 INFO:tasks.workunit.client.1.smithi134.stdout:9/716: dread - d2/d5/d8/d16/d54/fde zero size 2024-09-17T04:20:53.105 INFO:tasks.workunit.client.1.smithi134.stdout:0/319: dwrite d11/d19/d21/d37/f42 [0,4194304] 0 2024-09-17T04:20:53.106 INFO:tasks.workunit.client.1.smithi134.stdout:5/327: dwrite d0/d3a/f50 [4194304,4194304] 0 2024-09-17T04:20:53.110 INFO:tasks.workunit.client.0.smithi088.stdout:9/52: mkdir d2/d16 0 2024-09-17T04:20:53.110 INFO:tasks.workunit.client.0.smithi088.stdout:2/69: dwrite d0/d1/fe [0,4194304] 0 2024-09-17T04:20:53.110 INFO:tasks.workunit.client.1.smithi134.stdout:4/427: rename d0/fb to d0/df/d1e/d73/f88 0 2024-09-17T04:20:53.111 INFO:tasks.workunit.client.1.smithi134.stdout:2/389: dwrite d19/d27/f2f [0,4194304] 0 2024-09-17T04:20:53.112 INFO:tasks.workunit.client.1.smithi134.stdout:2/390: truncate d19/d1c/f52 960761 0 2024-09-17T04:20:53.113 INFO:tasks.workunit.client.0.smithi088.stdout:8/49: creat d7/dd/ff x:0 0 0 2024-09-17T04:20:53.113 INFO:tasks.workunit.client.1.smithi134.stdout:6/459: truncate de/f53 1029947 0 2024-09-17T04:20:53.114 INFO:tasks.workunit.client.1.smithi134.stdout:2/391: write d19/d1c/f1d [2345694,77175] 0 2024-09-17T04:20:53.115 INFO:tasks.workunit.client.0.smithi088.stdout:2/70: dread d0/d1/f2 [0,4194304] 0 2024-09-17T04:20:53.118 INFO:tasks.workunit.client.1.smithi134.stdout:1/396: mkdir d12/d19/d5d/d88 0 2024-09-17T04:20:53.119 INFO:tasks.workunit.client.0.smithi088.stdout:9/53: symlink d2/dd/d11/l17 0 2024-09-17T04:20:53.120 INFO:tasks.workunit.client.0.smithi088.stdout:7/109: creat d2/f21 x:0 0 0 2024-09-17T04:20:53.123 INFO:tasks.workunit.client.1.smithi134.stdout:9/717: creat d2/d7/ff4 x:0 0 0 2024-09-17T04:20:53.123 INFO:tasks.workunit.client.0.smithi088.stdout:8/50: mkdir d7/dd/d10 0 2024-09-17T04:20:53.124 INFO:tasks.workunit.client.0.smithi088.stdout:2/71: dwrite d0/d1/f2 [0,4194304] 0 2024-09-17T04:20:53.126 INFO:tasks.workunit.client.0.smithi088.stdout:9/54: rename f0 to d2/f18 0 2024-09-17T04:20:53.126 INFO:tasks.workunit.client.0.smithi088.stdout:2/72: write d0/d13/f16 [695195,96870] 0 2024-09-17T04:20:53.127 INFO:tasks.workunit.client.0.smithi088.stdout:7/110: fdatasync d2/d4/d7/fa 0 2024-09-17T04:20:53.129 INFO:tasks.workunit.client.0.smithi088.stdout:7/111: truncate d2/f19 723109 0 2024-09-17T04:20:53.130 INFO:tasks.workunit.client.0.smithi088.stdout:8/51: dread d7/f8 [0,4194304] 0 2024-09-17T04:20:53.130 INFO:tasks.workunit.client.0.smithi088.stdout:7/112: chown d2/d4/d7/f15 33454265 1 2024-09-17T04:20:53.132 INFO:tasks.workunit.client.1.smithi134.stdout:4/428: creat d0/df/d35/f89 x:0 0 0 2024-09-17T04:20:53.132 INFO:tasks.workunit.client.0.smithi088.stdout:7/113: dread d2/f19 [0,4194304] 0 2024-09-17T04:20:53.133 INFO:tasks.workunit.client.1.smithi134.stdout:2/392: fsync d19/d1c/f2d 0 2024-09-17T04:20:53.133 INFO:tasks.workunit.client.0.smithi088.stdout:2/73: mkdir d0/d14/d17 0 2024-09-17T04:20:53.134 INFO:tasks.workunit.client.1.smithi134.stdout:2/393: dread - d19/d27/d31/f5c zero size 2024-09-17T04:20:53.134 INFO:tasks.workunit.client.0.smithi088.stdout:2/74: chown d0/ca 28677512 1 2024-09-17T04:20:53.135 INFO:tasks.workunit.client.0.smithi088.stdout:8/52: symlink d7/l11 0 2024-09-17T04:20:53.135 INFO:tasks.workunit.client.1.smithi134.stdout:1/397: rmdir d12/d19/d1d/d61 39 2024-09-17T04:20:53.137 INFO:tasks.workunit.client.1.smithi134.stdout:9/718: creat d2/d5/d8/d16/d54/daf/d6d/daa/de2/dcf/ff5 x:0 0 0 2024-09-17T04:20:53.140 INFO:tasks.workunit.client.1.smithi134.stdout:2/394: dwrite d19/d27/f38 [0,4194304] 0 2024-09-17T04:20:53.141 INFO:tasks.workunit.client.0.smithi088.stdout:9/55: creat d2/dd/d14/f19 x:0 0 0 2024-09-17T04:20:53.142 INFO:tasks.workunit.client.0.smithi088.stdout:7/114: chown d2/d4/d7/c12 288179 1 2024-09-17T04:20:53.143 INFO:tasks.workunit.client.1.smithi134.stdout:9/719: dwrite d2/d78/fc6 [0,4194304] 0 2024-09-17T04:20:53.143 INFO:tasks.workunit.client.1.smithi134.stdout:5/328: creat d0/d3a/d2b/d61/f65 x:0 0 0 2024-09-17T04:20:53.144 INFO:tasks.workunit.client.0.smithi088.stdout:2/75: mkdir d0/d18 0 2024-09-17T04:20:53.146 INFO:tasks.workunit.client.1.smithi134.stdout:9/720: write d2/d5/d8/d16/d54/fde [903605,24278] 0 2024-09-17T04:20:53.147 INFO:tasks.workunit.client.1.smithi134.stdout:6/460: mknod de/d19/d1f/d85/d88/c8f 0 2024-09-17T04:20:53.154 INFO:tasks.workunit.client.0.smithi088.stdout:7/115: dread d2/d4/d7/f10 [0,4194304] 0 2024-09-17T04:20:53.157 INFO:tasks.workunit.client.0.smithi088.stdout:8/53: creat d7/dd/d10/f12 x:0 0 0 2024-09-17T04:20:53.157 INFO:tasks.workunit.client.1.smithi134.stdout:7/286: truncate d0/f1b 484786 0 2024-09-17T04:20:53.161 INFO:tasks.workunit.client.0.smithi088.stdout:9/56: mknod d2/d16/c1a 0 2024-09-17T04:20:53.163 INFO:tasks.workunit.client.1.smithi134.stdout:7/287: dwrite d0/dd/d3a/d3d/d38/f23 [0,4194304] 0 2024-09-17T04:20:53.164 INFO:tasks.workunit.client.1.smithi134.stdout:2/395: unlink d19/d27/f38 0 2024-09-17T04:20:53.166 INFO:tasks.workunit.client.0.smithi088.stdout:8/54: dwrite d7/f9 [0,4194304] 0 2024-09-17T04:20:53.167 INFO:tasks.workunit.client.0.smithi088.stdout:8/55: dread - d7/dd/fe zero size 2024-09-17T04:20:53.170 INFO:tasks.workunit.client.1.smithi134.stdout:9/721: creat d2/d25/ff6 x:0 0 0 2024-09-17T04:20:53.170 INFO:tasks.workunit.client.0.smithi088.stdout:9/57: creat d2/dd/f1b x:0 0 0 2024-09-17T04:20:53.175 INFO:tasks.workunit.client.0.smithi088.stdout:7/116: creat d2/d4/d7/d20/f22 x:0 0 0 2024-09-17T04:20:53.175 INFO:tasks.workunit.client.0.smithi088.stdout:1/62: truncate d0/d1/fd 6949516 0 2024-09-17T04:20:53.176 INFO:tasks.workunit.client.0.smithi088.stdout:1/63: readlink - no filename 2024-09-17T04:20:53.176 INFO:tasks.workunit.client.1.smithi134.stdout:6/461: symlink de/d19/d7b/l90 0 2024-09-17T04:20:53.177 INFO:tasks.workunit.client.1.smithi134.stdout:0/320: getdents d11/d22/d1c/d2f/d43/d5d 0 2024-09-17T04:20:53.178 INFO:tasks.workunit.client.0.smithi088.stdout:9/58: mknod d2/c1c 0 2024-09-17T04:20:53.182 INFO:tasks.workunit.client.1.smithi134.stdout:8/349: write d4/d23/f4b [471734,67258] 0 2024-09-17T04:20:53.182 INFO:tasks.workunit.client.0.smithi088.stdout:5/64: write d2/f6 [182662,59576] 0 2024-09-17T04:20:53.184 INFO:tasks.workunit.client.1.smithi134.stdout:7/288: unlink d0/dd/f1a 0 2024-09-17T04:20:53.186 INFO:tasks.workunit.client.1.smithi134.stdout:7/289: chown d0/d16/d35/f49 3599 1 2024-09-17T04:20:53.186 INFO:tasks.workunit.client.0.smithi088.stdout:1/64: dwrite d0/f4 [0,4194304] 0 2024-09-17T04:20:53.187 INFO:tasks.workunit.client.1.smithi134.stdout:3/412: dwrite de/d10/d3d/f7d [0,4194304] 0 2024-09-17T04:20:53.187 INFO:tasks.workunit.client.0.smithi088.stdout:8/56: dwrite d7/f8 [0,4194304] 0 2024-09-17T04:20:53.188 INFO:tasks.workunit.client.1.smithi134.stdout:7/290: write d0/dd/d3a/d3d/d38/f3c [57370,118211] 0 2024-09-17T04:20:53.190 INFO:tasks.workunit.client.0.smithi088.stdout:5/65: fdatasync d2/f6 0 2024-09-17T04:20:53.197 INFO:tasks.workunit.client.0.smithi088.stdout:0/35: truncate f5 3058140 0 2024-09-17T04:20:53.197 INFO:tasks.workunit.client.1.smithi134.stdout:1/398: link d12/d19/l41 d12/d36/l89 0 2024-09-17T04:20:53.200 INFO:tasks.workunit.client.0.smithi088.stdout:8/57: dwrite d7/dd/d10/f12 [0,4194304] 0 2024-09-17T04:20:53.200 INFO:tasks.workunit.client.1.smithi134.stdout:6/462: fsync de/d19/d1f/f73 0 2024-09-17T04:20:53.202 INFO:tasks.workunit.client.0.smithi088.stdout:8/58: read f2 [65259,7855] 0 2024-09-17T04:20:53.203 INFO:tasks.workunit.client.1.smithi134.stdout:0/321: symlink d11/d19/d21/d37/l6e 0 2024-09-17T04:20:53.205 INFO:tasks.workunit.client.1.smithi134.stdout:0/322: write d11/d18/f40 [4805218,122788] 0 2024-09-17T04:20:53.208 INFO:tasks.workunit.client.0.smithi088.stdout:0/36: dwrite f6 [0,4194304] 0 2024-09-17T04:20:53.209 INFO:tasks.workunit.client.1.smithi134.stdout:8/350: mknod d4/c6c 0 2024-09-17T04:20:53.211 INFO:tasks.workunit.client.0.smithi088.stdout:8/59: dread d7/dd/d10/f12 [0,4194304] 0 2024-09-17T04:20:53.212 INFO:tasks.workunit.client.1.smithi134.stdout:8/351: read d4/d23/d60/d6b/d13/f3d [894058,66031] 0 2024-09-17T04:20:53.217 INFO:tasks.workunit.client.1.smithi134.stdout:7/291: readlink d0/d16/l31 0 2024-09-17T04:20:53.218 INFO:tasks.workunit.client.1.smithi134.stdout:3/413: mknod de/d12/d15/d1d/d2d/d31/c8d 0 2024-09-17T04:20:53.221 INFO:tasks.workunit.client.1.smithi134.stdout:5/329: creat d0/da/d12/f66 x:0 0 0 2024-09-17T04:20:53.222 INFO:tasks.workunit.client.1.smithi134.stdout:5/330: read - d0/da/d29/f60 zero size 2024-09-17T04:20:53.223 INFO:tasks.workunit.client.1.smithi134.stdout:5/331: chown d0/da/d2c/f37 40 1 2024-09-17T04:20:53.224 INFO:tasks.workunit.client.1.smithi134.stdout:3/414: dwrite de/d10/f68 [0,4194304] 0 2024-09-17T04:20:53.224 INFO:tasks.workunit.client.0.smithi088.stdout:0/37: rename f6 to db/fc 0 2024-09-17T04:20:53.226 INFO:tasks.workunit.client.1.smithi134.stdout:4/429: write d0/fa [3141625,39741] 0 2024-09-17T04:20:53.227 INFO:tasks.workunit.client.0.smithi088.stdout:8/60: creat d7/f13 x:0 0 0 2024-09-17T04:20:53.229 INFO:tasks.workunit.client.1.smithi134.stdout:6/463: mknod de/d19/d1f/d55/d77/c91 0 2024-09-17T04:20:53.230 INFO:tasks.workunit.client.0.smithi088.stdout:9/59: getdents d2/dd/d14 0 2024-09-17T04:20:53.230 INFO:tasks.workunit.client.1.smithi134.stdout:6/464: write de/d19/f33 [712014,85777] 0 2024-09-17T04:20:53.232 INFO:tasks.workunit.client.1.smithi134.stdout:5/332: dwrite d0/d3a/d2b/f58 [0,4194304] 0 2024-09-17T04:20:53.233 INFO:tasks.workunit.client.1.smithi134.stdout:5/333: fsync d0/d3a/ff 0 2024-09-17T04:20:53.234 INFO:tasks.workunit.client.0.smithi088.stdout:4/78: sync 2024-09-17T04:20:53.237 INFO:tasks.workunit.client.0.smithi088.stdout:8/61: dwrite f6 [0,4194304] 0 2024-09-17T04:20:53.240 INFO:tasks.workunit.client.1.smithi134.stdout:8/352: creat d4/d23/f6d x:0 0 0 2024-09-17T04:20:53.243 INFO:tasks.workunit.client.0.smithi088.stdout:0/38: rename f4 to db/fd 0 2024-09-17T04:20:53.247 INFO:tasks.workunit.client.1.smithi134.stdout:7/292: creat d0/dd/d3a/d3d/d38/f5d x:0 0 0 2024-09-17T04:20:53.249 INFO:tasks.workunit.client.0.smithi088.stdout:1/65: fsync d0/d1/fd 0 2024-09-17T04:20:53.251 INFO:tasks.workunit.client.0.smithi088.stdout:9/60: unlink d2/dd/l10 0 2024-09-17T04:20:53.257 INFO:tasks.workunit.client.0.smithi088.stdout:4/79: dread f1 [0,4194304] 0 2024-09-17T04:20:53.258 INFO:tasks.workunit.client.0.smithi088.stdout:8/62: unlink d7/f13 0 2024-09-17T04:20:53.258 INFO:tasks.workunit.client.0.smithi088.stdout:4/80: stat d5/le 0 2024-09-17T04:20:53.258 INFO:tasks.workunit.client.0.smithi088.stdout:4/81: chown d5/l12 4931419 1 2024-09-17T04:20:53.261 INFO:tasks.workunit.client.0.smithi088.stdout:7/117: truncate d2/d4/f18 16224 0 2024-09-17T04:20:53.261 INFO:tasks.workunit.client.1.smithi134.stdout:9/722: write d2/d5/d8/d16/d54/daf/d6d/f97 [650594,76026] 0 2024-09-17T04:20:53.263 INFO:tasks.workunit.client.1.smithi134.stdout:1/399: mknod d12/d19/c8a 0 2024-09-17T04:20:53.265 INFO:tasks.workunit.client.1.smithi134.stdout:4/430: chown d0/d13/d40/d72/c7f 996 1 2024-09-17T04:20:53.269 INFO:tasks.workunit.client.1.smithi134.stdout:5/334: dread d0/f4 [4194304,4194304] 0 2024-09-17T04:20:53.269 INFO:tasks.workunit.client.1.smithi134.stdout:0/323: mkdir d11/d6f 0 2024-09-17T04:20:53.272 INFO:tasks.workunit.client.0.smithi088.stdout:8/63: chown d7/ca 781158 1 2024-09-17T04:20:53.273 INFO:tasks.workunit.client.0.smithi088.stdout:8/64: dread - d7/dd/ff zero size 2024-09-17T04:20:53.276 INFO:tasks.workunit.client.1.smithi134.stdout:2/396: getdents d19/d27/d31/d49 0 2024-09-17T04:20:53.277 INFO:tasks.workunit.client.1.smithi134.stdout:2/397: chown d19/d27/d31/l48 262106456 1 2024-09-17T04:20:53.280 INFO:tasks.workunit.client.0.smithi088.stdout:1/66: mkdir d0/d13 0 2024-09-17T04:20:53.284 INFO:tasks.workunit.client.1.smithi134.stdout:9/723: mknod d2/d5/d9/d6b/de1/cf7 0 2024-09-17T04:20:53.284 INFO:tasks.workunit.client.0.smithi088.stdout:8/65: mknod d7/c14 0 2024-09-17T04:20:53.286 INFO:tasks.workunit.client.1.smithi134.stdout:1/400: unlink d12/d1c/f4e 0 2024-09-17T04:20:53.286 INFO:tasks.workunit.client.1.smithi134.stdout:1/401: readlink d12/d36/l6e 0 2024-09-17T04:20:53.287 INFO:tasks.workunit.client.1.smithi134.stdout:1/402: fdatasync d12/d19/d1d/f44 0 2024-09-17T04:20:53.288 INFO:tasks.workunit.client.1.smithi134.stdout:4/431: mknod d0/d13/d40/d72/c8a 0 2024-09-17T04:20:53.289 INFO:tasks.workunit.client.0.smithi088.stdout:7/118: mkdir d2/d1e/d23 0 2024-09-17T04:20:53.290 INFO:tasks.workunit.client.1.smithi134.stdout:6/465: getdents de/d19/d62/d7c 0 2024-09-17T04:20:53.290 INFO:tasks.workunit.client.0.smithi088.stdout:0/39: link l8 db/le 0 2024-09-17T04:20:53.291 INFO:tasks.workunit.client.0.smithi088.stdout:8/66: dwrite d7/f8 [0,4194304] 0 2024-09-17T04:20:53.291 INFO:tasks.workunit.client.0.smithi088.stdout:0/40: truncate f9 1117426 0 2024-09-17T04:20:53.291 INFO:tasks.workunit.client.0.smithi088.stdout:8/67: readlink d7/l11 0 2024-09-17T04:20:53.296 INFO:tasks.workunit.client.1.smithi134.stdout:8/353: mkdir d4/db/d6e 0 2024-09-17T04:20:53.299 INFO:tasks.workunit.client.1.smithi134.stdout:8/354: dread d4/d1f/f44 [0,4194304] 0 2024-09-17T04:20:53.300 INFO:tasks.workunit.client.0.smithi088.stdout:7/119: creat d2/d1e/f24 x:0 0 0 2024-09-17T04:20:53.300 INFO:tasks.workunit.client.0.smithi088.stdout:7/120: dread - d2/d1e/f24 zero size 2024-09-17T04:20:53.300 INFO:tasks.workunit.client.1.smithi134.stdout:2/398: rmdir d19/d27/d31/d49 39 2024-09-17T04:20:53.301 INFO:tasks.workunit.client.0.smithi088.stdout:8/68: creat d7/dd/f15 x:0 0 0 2024-09-17T04:20:53.301 INFO:tasks.workunit.client.0.smithi088.stdout:8/69: read - d7/dd/f15 zero size 2024-09-17T04:20:53.303 INFO:tasks.workunit.client.1.smithi134.stdout:7/293: rename d0/l12 to d0/dd/d3a/d3d/l5e 0 2024-09-17T04:20:53.304 INFO:tasks.workunit.client.1.smithi134.stdout:3/415: creat de/d12/d22/f8e x:0 0 0 2024-09-17T04:20:53.305 INFO:tasks.workunit.client.0.smithi088.stdout:9/61: getdents d2/dd 0 2024-09-17T04:20:53.306 INFO:tasks.workunit.client.1.smithi134.stdout:9/724: mknod d2/d5/d37/d83/da7/cf8 0 2024-09-17T04:20:53.307 INFO:tasks.workunit.client.0.smithi088.stdout:9/62: write d2/fa [8145,110347] 0 2024-09-17T04:20:53.307 INFO:tasks.workunit.client.1.smithi134.stdout:9/725: chown d2/d5/d9/df/f79 447 1 2024-09-17T04:20:53.308 INFO:tasks.workunit.client.0.smithi088.stdout:9/63: read - f1 zero size 2024-09-17T04:20:53.309 INFO:tasks.workunit.client.1.smithi134.stdout:3/416: dwrite de/d10/f68 [0,4194304] 0 2024-09-17T04:20:53.309 INFO:tasks.workunit.client.0.smithi088.stdout:4/82: dwrite f1 [0,4194304] 0 2024-09-17T04:20:53.310 INFO:tasks.workunit.client.0.smithi088.stdout:9/64: chown d2/d16 1 1 2024-09-17T04:20:53.310 INFO:tasks.workunit.client.1.smithi134.stdout:3/417: read - de/d12/d22/f8e zero size 2024-09-17T04:20:53.315 INFO:tasks.workunit.client.1.smithi134.stdout:9/726: dwrite d2/d5/d37/f47 [0,4194304] 0 2024-09-17T04:20:53.316 INFO:tasks.workunit.client.0.smithi088.stdout:8/70: creat d7/dd/f16 x:0 0 0 2024-09-17T04:20:53.317 INFO:tasks.workunit.client.1.smithi134.stdout:1/403: rmdir d12/d19 39 2024-09-17T04:20:53.318 INFO:tasks.workunit.client.1.smithi134.stdout:9/727: read d2/d5/d8/d16/d54/daf/f95 [756597,54521] 0 2024-09-17T04:20:53.320 INFO:tasks.workunit.client.0.smithi088.stdout:5/66: dwrite d2/d9/fc [0,4194304] 0 2024-09-17T04:20:53.320 INFO:tasks.workunit.client.1.smithi134.stdout:9/728: read - d2/d5/d8/d16/d54/daf/d6d/daa/de2/dcd/fae zero size 2024-09-17T04:20:53.322 INFO:tasks.workunit.client.1.smithi134.stdout:4/432: mkdir d0/df/d35/d5c/d8b 0 2024-09-17T04:20:53.322 INFO:tasks.workunit.client.0.smithi088.stdout:1/67: rename d0/d1/c9 to d0/c14 0 2024-09-17T04:20:53.325 INFO:tasks.workunit.client.1.smithi134.stdout:6/466: write de/d19/d62/d34/f3c [5613653,102797] 0 2024-09-17T04:20:53.327 INFO:tasks.workunit.client.0.smithi088.stdout:7/121: mknod d2/d1d/c25 0 2024-09-17T04:20:53.330 INFO:tasks.workunit.client.0.smithi088.stdout:7/122: write d2/f1b [268344,79781] 0 2024-09-17T04:20:53.331 INFO:tasks.workunit.client.0.smithi088.stdout:5/67: dwrite d2/fb [0,4194304] 0 2024-09-17T04:20:53.332 INFO:tasks.workunit.client.0.smithi088.stdout:5/68: write d2/f6 [55264,16956] 0 2024-09-17T04:20:53.333 INFO:tasks.workunit.client.0.smithi088.stdout:9/65: mkdir d2/dd/d11/d1d 0 2024-09-17T04:20:53.337 INFO:tasks.workunit.client.0.smithi088.stdout:9/66: dread d2/f3 [0,4194304] 0 2024-09-17T04:20:53.338 INFO:tasks.workunit.client.1.smithi134.stdout:2/399: mkdir d19/d27/d64/d80 0 2024-09-17T04:20:53.341 INFO:tasks.workunit.client.1.smithi134.stdout:8/355: rename d4/d23/c38 to d4/d23/d60/d6b/c6f 0 2024-09-17T04:20:53.345 INFO:tasks.workunit.client.0.smithi088.stdout:8/71: dwrite d7/dd/d10/f12 [4194304,4194304] 0 2024-09-17T04:20:53.345 INFO:tasks.workunit.client.0.smithi088.stdout:8/72: fsync f6 0 2024-09-17T04:20:53.350 INFO:tasks.workunit.client.0.smithi088.stdout:7/123: symlink d2/d1e/l26 0 2024-09-17T04:20:53.352 INFO:tasks.workunit.client.0.smithi088.stdout:5/69: unlink d2/c7 0 2024-09-17T04:20:53.357 INFO:tasks.workunit.client.1.smithi134.stdout:9/729: dread d2/d5/d9/df/f48 [0,4194304] 0 2024-09-17T04:20:53.357 INFO:tasks.workunit.client.1.smithi134.stdout:3/418: dread de/d12/d15/f4d [0,4194304] 0 2024-09-17T04:20:53.357 INFO:tasks.workunit.client.1.smithi134.stdout:3/419: chown de/d12/l7e 1 1 2024-09-17T04:20:53.358 INFO:tasks.workunit.client.0.smithi088.stdout:5/70: dread d2/d9/fc [0,4194304] 0 2024-09-17T04:20:53.385 INFO:tasks.workunit.client.0.smithi088.stdout:9/67: creat d2/dd/d11/f1e x:0 0 0 2024-09-17T04:20:53.386 INFO:tasks.workunit.client.0.smithi088.stdout:1/68: mknod d0/db/c15 0 2024-09-17T04:20:53.386 INFO:tasks.workunit.client.0.smithi088.stdout:4/83: truncate d5/fb 4127673 0 2024-09-17T04:20:53.387 INFO:tasks.workunit.client.1.smithi134.stdout:6/467: mkdir de/d19/d21/d2d/d92 0 2024-09-17T04:20:53.390 INFO:tasks.workunit.client.1.smithi134.stdout:5/335: link d0/l20 d0/d3a/d2b/d61/l67 0 2024-09-17T04:20:53.391 INFO:tasks.workunit.client.0.smithi088.stdout:8/73: symlink d7/l17 0 2024-09-17T04:20:53.395 INFO:tasks.workunit.client.1.smithi134.stdout:8/356: chown d4/d23/d60/d6b/c6f 1 1 2024-09-17T04:20:53.396 INFO:tasks.workunit.client.0.smithi088.stdout:5/71: rename d2/le to d2/d9/l14 0 2024-09-17T04:20:53.400 INFO:tasks.workunit.client.0.smithi088.stdout:8/74: mknod d7/dd/d10/c18 0 2024-09-17T04:20:53.401 INFO:tasks.workunit.client.1.smithi134.stdout:1/404: rmdir d12/d19/d66 39 2024-09-17T04:20:53.404 INFO:tasks.workunit.client.0.smithi088.stdout:5/72: rename d2/f13 to d2/f15 0 2024-09-17T04:20:53.405 INFO:tasks.workunit.client.1.smithi134.stdout:1/405: dwrite d12/d1c/f34 [0,4194304] 0 2024-09-17T04:20:53.405 INFO:tasks.workunit.client.1.smithi134.stdout:6/468: mknod de/d19/d62/d7c/c93 0 2024-09-17T04:20:53.405 INFO:tasks.workunit.client.0.smithi088.stdout:9/68: symlink d2/dd/d11/d1d/l1f 0 2024-09-17T04:20:53.406 INFO:tasks.workunit.client.1.smithi134.stdout:1/406: stat d12/d19/d1d/l32 0 2024-09-17T04:20:53.406 INFO:tasks.workunit.client.0.smithi088.stdout:9/69: chown d2/f18 118447098 1 2024-09-17T04:20:53.407 INFO:tasks.workunit.client.1.smithi134.stdout:0/324: link d11/d24/d49/f5b d11/f70 0 2024-09-17T04:20:53.408 INFO:tasks.workunit.client.1.smithi134.stdout:5/336: symlink d0/d3a/l68 0 2024-09-17T04:20:53.409 INFO:tasks.workunit.client.0.smithi088.stdout:4/84: truncate d5/f10 243283 0 2024-09-17T04:20:53.410 INFO:tasks.workunit.client.1.smithi134.stdout:2/400: creat d19/d7e/f81 x:0 0 0 2024-09-17T04:20:53.411 INFO:tasks.workunit.client.0.smithi088.stdout:8/75: mknod d7/c19 0 2024-09-17T04:20:53.413 INFO:tasks.workunit.client.0.smithi088.stdout:8/76: fsync d7/dd/f15 0 2024-09-17T04:20:53.413 INFO:tasks.workunit.client.1.smithi134.stdout:3/420: mkdir de/d12/d15/d1d/d8f 0 2024-09-17T04:20:53.413 INFO:tasks.workunit.client.1.smithi134.stdout:6/469: dwrite de/f13 [0,4194304] 0 2024-09-17T04:20:53.414 INFO:tasks.workunit.client.0.smithi088.stdout:8/77: fdatasync d7/dd/f15 0 2024-09-17T04:20:53.415 INFO:tasks.workunit.client.0.smithi088.stdout:9/70: unlink d2/f6 0 2024-09-17T04:20:53.416 INFO:tasks.workunit.client.1.smithi134.stdout:4/433: link d0/c60 d0/d3b/c8c 0 2024-09-17T04:20:53.417 INFO:tasks.workunit.client.1.smithi134.stdout:0/325: dwrite d11/d24/f28 [0,4194304] 0 2024-09-17T04:20:53.419 INFO:tasks.workunit.client.0.smithi088.stdout:1/69: dwrite d0/d1/fd [0,4194304] 0 2024-09-17T04:20:53.421 INFO:tasks.workunit.client.1.smithi134.stdout:1/407: rmdir d12/d19 39 2024-09-17T04:20:53.421 INFO:tasks.workunit.client.1.smithi134.stdout:2/401: dwrite d19/d27/d31/f5c [0,4194304] 0 2024-09-17T04:20:53.421 INFO:tasks.workunit.client.0.smithi088.stdout:1/70: write d0/f4 [4330740,24125] 0 2024-09-17T04:20:53.422 INFO:tasks.workunit.client.1.smithi134.stdout:2/402: chown d19/d27/l46 64927183 1 2024-09-17T04:20:53.423 INFO:tasks.workunit.client.1.smithi134.stdout:6/470: dread de/d19/d1f/f57 [0,4194304] 0 2024-09-17T04:20:53.425 INFO:tasks.workunit.client.1.smithi134.stdout:5/337: dread d0/d3a/d2b/f62 [4194304,4194304] 0 2024-09-17T04:20:53.428 INFO:tasks.workunit.client.1.smithi134.stdout:2/403: dwrite d19/f76 [0,4194304] 0 2024-09-17T04:20:53.429 INFO:tasks.workunit.client.0.smithi088.stdout:9/71: dwrite d2/fa [0,4194304] 0 2024-09-17T04:20:53.432 INFO:tasks.workunit.client.0.smithi088.stdout:9/72: fdatasync d2/f8 0 2024-09-17T04:20:53.442 INFO:tasks.workunit.client.0.smithi088.stdout:1/71: rename d0/db to d0/d1/d16 0 2024-09-17T04:20:53.443 INFO:tasks.workunit.client.0.smithi088.stdout:8/78: link f6 d7/dd/f1a 0 2024-09-17T04:20:53.443 INFO:tasks.workunit.client.0.smithi088.stdout:9/73: dwrite d2/dd/f15 [0,4194304] 0 2024-09-17T04:20:53.443 INFO:tasks.workunit.client.0.smithi088.stdout:1/72: chown d0/d1 0 1 2024-09-17T04:20:53.448 INFO:tasks.workunit.client.0.smithi088.stdout:8/79: dread d7/f9 [0,4194304] 0 2024-09-17T04:20:53.453 INFO:tasks.workunit.client.0.smithi088.stdout:1/73: rename d0/c7 to d0/d1/df/c17 0 2024-09-17T04:20:53.454 INFO:tasks.workunit.client.0.smithi088.stdout:8/80: mknod d7/dd/d10/c1b 0 2024-09-17T04:20:53.457 INFO:tasks.workunit.client.0.smithi088.stdout:9/74: dwrite d2/f18 [0,4194304] 0 2024-09-17T04:20:53.459 INFO:tasks.workunit.client.0.smithi088.stdout:1/74: creat d0/d1/f18 x:0 0 0 2024-09-17T04:20:53.462 INFO:tasks.workunit.client.0.smithi088.stdout:8/81: creat d7/dd/d10/f1c x:0 0 0 2024-09-17T04:20:53.468 INFO:tasks.workunit.client.0.smithi088.stdout:5/73: dwrite d2/f5 [0,4194304] 0 2024-09-17T04:20:53.469 INFO:tasks.workunit.client.0.smithi088.stdout:9/75: link d2/f18 d2/dd/d14/f20 0 2024-09-17T04:20:53.469 INFO:tasks.workunit.client.1.smithi134.stdout:0/326: creat d11/d24/f71 x:0 0 0 2024-09-17T04:20:53.470 INFO:tasks.workunit.client.1.smithi134.stdout:4/434: truncate d0/df/d35/d5c/f6b 2426686 0 2024-09-17T04:20:53.470 INFO:tasks.workunit.client.1.smithi134.stdout:1/408: rmdir d12/d36 39 2024-09-17T04:20:53.470 INFO:tasks.workunit.client.0.smithi088.stdout:4/85: write d5/f10 [105899,35542] 0 2024-09-17T04:20:53.471 INFO:tasks.workunit.client.1.smithi134.stdout:2/404: readlink l17 0 2024-09-17T04:20:53.471 INFO:tasks.workunit.client.1.smithi134.stdout:9/730: rename d2/d5/c3b to d2/d5/d9/cf9 0 2024-09-17T04:20:53.471 INFO:tasks.workunit.client.1.smithi134.stdout:3/421: mkdir de/d12/d15/d1d/d8f/d90 0 2024-09-17T04:20:53.472 INFO:tasks.workunit.client.1.smithi134.stdout:8/357: truncate d4/db/dd/f16 6840121 0 2024-09-17T04:20:53.472 INFO:tasks.workunit.client.1.smithi134.stdout:0/327: write d11/d18/f40 [1428360,94209] 0 2024-09-17T04:20:53.472 INFO:tasks.workunit.client.1.smithi134.stdout:4/435: chown d0/d13/d40/d42/f87 777054 1 2024-09-17T04:20:53.474 INFO:tasks.workunit.client.1.smithi134.stdout:3/422: fsync de/d12/d15/d1d/d2d/d63/d77/f8a 0 2024-09-17T04:20:53.475 INFO:tasks.workunit.client.1.smithi134.stdout:3/423: truncate de/d12/f47 5229733 0 2024-09-17T04:20:53.476 INFO:tasks.workunit.client.1.smithi134.stdout:3/424: write de/f3b [1215048,123644] 0 2024-09-17T04:20:53.477 INFO:tasks.workunit.client.0.smithi088.stdout:5/74: rmdir d2/d9 39 2024-09-17T04:20:53.478 INFO:tasks.workunit.client.1.smithi134.stdout:3/425: read de/d12/d15/d1d/f61 [2085833,83347] 0 2024-09-17T04:20:53.482 INFO:tasks.workunit.client.1.smithi134.stdout:1/409: readlink d12/d36/l57 0 2024-09-17T04:20:53.483 INFO:tasks.workunit.client.1.smithi134.stdout:3/426: dwrite f6 [0,4194304] 0 2024-09-17T04:20:53.484 INFO:tasks.workunit.client.1.smithi134.stdout:1/410: write d12/d1c/d2e/f67 [1020518,92066] 0 2024-09-17T04:20:53.484 INFO:tasks.workunit.client.0.smithi088.stdout:5/75: write d2/f15 [1042483,125768] 0 2024-09-17T04:20:53.488 INFO:tasks.workunit.client.1.smithi134.stdout:2/405: write d19/f7b [342290,116762] 0 2024-09-17T04:20:53.489 INFO:tasks.workunit.client.0.smithi088.stdout:4/86: dread d5/f10 [0,4194304] 0 2024-09-17T04:20:53.489 INFO:tasks.workunit.client.1.smithi134.stdout:7/294: rename d0/d16/d35/d4b/f52 to d0/dd/d57/f5f 0 2024-09-17T04:20:53.490 INFO:tasks.workunit.client.0.smithi088.stdout:4/87: read d5/fd [3980966,52471] 0 2024-09-17T04:20:53.490 INFO:tasks.workunit.client.0.smithi088.stdout:4/88: chown f1 121144109 1 2024-09-17T04:20:53.491 INFO:tasks.workunit.client.1.smithi134.stdout:7/295: chown d0/d16/l43 230921843 1 2024-09-17T04:20:53.491 INFO:tasks.workunit.client.1.smithi134.stdout:8/358: symlink d4/d1f/d25/l70 0 2024-09-17T04:20:53.492 INFO:tasks.workunit.client.0.smithi088.stdout:4/89: write f1 [2082051,17428] 0 2024-09-17T04:20:53.493 INFO:tasks.workunit.client.1.smithi134.stdout:3/427: dwrite de/d10/f5f [0,4194304] 0 2024-09-17T04:20:53.494 INFO:tasks.workunit.client.1.smithi134.stdout:8/359: write d4/db/f20 [4276243,127595] 0 2024-09-17T04:20:53.498 INFO:tasks.workunit.client.1.smithi134.stdout:2/406: dwrite d19/d1c/f30 [0,4194304] 0 2024-09-17T04:20:53.499 INFO:tasks.workunit.client.1.smithi134.stdout:0/328: mknod d11/d22/d1c/d2f/d43/c72 0 2024-09-17T04:20:53.505 INFO:tasks.workunit.client.0.smithi088.stdout:1/75: truncate d0/f8 3129639 0 2024-09-17T04:20:53.507 INFO:tasks.workunit.client.0.smithi088.stdout:1/76: write d0/d1/f18 [619772,102565] 0 2024-09-17T04:20:53.507 INFO:tasks.workunit.client.0.smithi088.stdout:4/90: rename d5/le to d5/l19 0 2024-09-17T04:20:53.511 INFO:tasks.workunit.client.1.smithi134.stdout:5/338: rename d0/da/d12 to d0/da/d69 0 2024-09-17T04:20:53.512 INFO:tasks.workunit.client.0.smithi088.stdout:5/76: creat d2/f16 x:0 0 0 2024-09-17T04:20:53.516 INFO:tasks.workunit.client.0.smithi088.stdout:1/77: mknod d0/d1/df/c19 0 2024-09-17T04:20:53.519 INFO:tasks.workunit.client.0.smithi088.stdout:9/76: dwrite d2/f3 [0,4194304] 0 2024-09-17T04:20:53.520 INFO:tasks.workunit.client.0.smithi088.stdout:5/77: dread - d2/d9/f12 zero size 2024-09-17T04:20:53.521 INFO:tasks.workunit.client.0.smithi088.stdout:4/91: dread d5/fb [0,4194304] 0 2024-09-17T04:20:53.524 INFO:tasks.workunit.client.0.smithi088.stdout:1/78: stat d0/d1/d16/c12 0 2024-09-17T04:20:53.525 INFO:tasks.workunit.client.1.smithi134.stdout:9/731: dwrite d2/d5/d8/d16/d54/daf/f95 [0,4194304] 0 2024-09-17T04:20:53.525 INFO:tasks.workunit.client.0.smithi088.stdout:1/79: fsync d0/d1/fa 0 2024-09-17T04:20:53.527 INFO:tasks.workunit.client.1.smithi134.stdout:9/732: fdatasync d2/d5/d8/d16/d54/daf/d6d/daa/de2/dcd/fae 0 2024-09-17T04:20:53.527 INFO:tasks.workunit.client.0.smithi088.stdout:1/80: write d0/d1/df/f10 [622134,53288] 0 2024-09-17T04:20:53.529 INFO:tasks.workunit.client.1.smithi134.stdout:9/733: dread d2/d5/d9/df/d38/f99 [0,4194304] 0 2024-09-17T04:20:53.530 INFO:tasks.workunit.client.0.smithi088.stdout:4/92: rmdir d5 39 2024-09-17T04:20:53.531 INFO:tasks.workunit.client.1.smithi134.stdout:9/734: chown d2/d5/d8/c9a 3849 1 2024-09-17T04:20:53.533 INFO:tasks.workunit.client.1.smithi134.stdout:3/428: mknod de/d12/d15/c91 0 2024-09-17T04:20:53.534 INFO:tasks.workunit.client.0.smithi088.stdout:5/78: symlink d2/l17 0 2024-09-17T04:20:53.536 INFO:tasks.workunit.client.0.smithi088.stdout:5/79: write d2/d9/f12 [947123,77119] 0 2024-09-17T04:20:53.536 INFO:tasks.workunit.client.1.smithi134.stdout:7/296: dwrite d0/dd/f34 [0,4194304] 0 2024-09-17T04:20:53.536 INFO:tasks.workunit.client.0.smithi088.stdout:1/81: creat d0/d1/f1a x:0 0 0 2024-09-17T04:20:53.538 INFO:tasks.workunit.client.0.smithi088.stdout:1/82: write d0/d1/fd [5519644,99248] 0 2024-09-17T04:20:53.543 INFO:tasks.workunit.client.0.smithi088.stdout:4/93: chown d5/c18 57825811 1 2024-09-17T04:20:53.543 INFO:tasks.workunit.client.1.smithi134.stdout:4/436: link d0/df/d1e/d73/f88 d0/d13/f8d 0 2024-09-17T04:20:53.544 INFO:tasks.workunit.client.1.smithi134.stdout:0/329: symlink d11/d22/d1c/d2f/d43/l73 0 2024-09-17T04:20:53.546 INFO:tasks.workunit.client.1.smithi134.stdout:0/330: chown d11/d22/d1c/d2f/c33 830080 1 2024-09-17T04:20:53.546 INFO:tasks.workunit.client.1.smithi134.stdout:7/297: dwrite d0/f1c [0,4194304] 0 2024-09-17T04:20:53.546 INFO:tasks.workunit.client.1.smithi134.stdout:5/339: symlink d0/da/d69/d41/l6a 0 2024-09-17T04:20:53.549 INFO:tasks.workunit.client.1.smithi134.stdout:5/340: chown d0/d3a/d2b/d61/l67 8 1 2024-09-17T04:20:53.549 INFO:tasks.workunit.client.0.smithi088.stdout:9/77: truncate d2/f3 1794455 0 2024-09-17T04:20:53.549 INFO:tasks.workunit.client.0.smithi088.stdout:9/78: dread - d2/dd/d14/f19 zero size 2024-09-17T04:20:53.550 INFO:tasks.workunit.client.0.smithi088.stdout:9/79: write d2/fa [97090,15187] 0 2024-09-17T04:20:53.551 INFO:tasks.workunit.client.0.smithi088.stdout:4/94: creat d5/f1a x:0 0 0 2024-09-17T04:20:53.552 INFO:tasks.workunit.client.0.smithi088.stdout:4/95: write f1 [285759,92587] 0 2024-09-17T04:20:53.554 INFO:tasks.workunit.client.0.smithi088.stdout:1/83: creat d0/d13/f1b x:0 0 0 2024-09-17T04:20:53.556 INFO:tasks.workunit.client.0.smithi088.stdout:9/80: fsync d2/f18 0 2024-09-17T04:20:53.561 INFO:tasks.workunit.client.0.smithi088.stdout:5/80: link d2/f10 d2/d9/f18 0 2024-09-17T04:20:53.562 INFO:tasks.workunit.client.0.smithi088.stdout:5/81: stat d2/l8 0 2024-09-17T04:20:53.562 INFO:tasks.workunit.client.0.smithi088.stdout:5/82: stat d2/f15 0 2024-09-17T04:20:53.563 INFO:tasks.workunit.client.1.smithi134.stdout:3/429: rmdir de/d12/d15/d1d 39 2024-09-17T04:20:53.563 INFO:tasks.workunit.client.0.smithi088.stdout:1/84: write d0/f4 [351137,95915] 0 2024-09-17T04:20:53.563 INFO:tasks.workunit.client.0.smithi088.stdout:1/85: dread - d0/d1/f1a zero size 2024-09-17T04:20:53.565 INFO:tasks.workunit.client.1.smithi134.stdout:3/430: dwrite de/d10/f64 [0,4194304] 0 2024-09-17T04:20:53.567 INFO:tasks.workunit.client.1.smithi134.stdout:7/298: rmdir d0/d16/d35 39 2024-09-17T04:20:53.570 INFO:tasks.workunit.client.0.smithi088.stdout:1/86: dwrite d0/f8 [0,4194304] 0 2024-09-17T04:20:53.570 INFO:tasks.workunit.client.0.smithi088.stdout:1/87: stat d0/d13 0 2024-09-17T04:20:53.572 INFO:tasks.workunit.client.1.smithi134.stdout:5/341: mkdir d0/d3a/d6b 0 2024-09-17T04:20:53.573 INFO:tasks.workunit.client.1.smithi134.stdout:5/342: stat d0/l20 0 2024-09-17T04:20:53.574 INFO:tasks.workunit.client.1.smithi134.stdout:1/411: mknod d12/d19/d5c/d85/c8b 0 2024-09-17T04:20:53.576 INFO:tasks.workunit.client.1.smithi134.stdout:9/735: write d2/d5/d9/f36 [1043512,125336] 0 2024-09-17T04:20:53.577 INFO:tasks.workunit.client.1.smithi134.stdout:9/736: stat d2/d5/d8/d16/l74 0 2024-09-17T04:20:53.577 INFO:tasks.workunit.client.1.smithi134.stdout:9/737: fsync d2/d5/d9/f18 0 2024-09-17T04:20:53.579 INFO:tasks.workunit.client.1.smithi134.stdout:9/738: write d2/d5/d37/fa3 [2685173,8857] 0 2024-09-17T04:20:53.579 INFO:tasks.workunit.client.1.smithi134.stdout:8/360: creat d4/d1f/f71 x:0 0 0 2024-09-17T04:20:53.580 INFO:tasks.workunit.client.0.smithi088.stdout:4/96: truncate f1 3635361 0 2024-09-17T04:20:53.581 INFO:tasks.workunit.client.1.smithi134.stdout:0/331: dread d11/d22/d1c/d2f/d45/f59 [0,4194304] 0 2024-09-17T04:20:53.581 INFO:tasks.workunit.client.0.smithi088.stdout:1/88: rename d0/d1/f18 to d0/d1/f1c 0 2024-09-17T04:20:53.582 INFO:tasks.workunit.client.0.smithi088.stdout:1/89: read d0/f4 [4170389,47333] 0 2024-09-17T04:20:53.582 INFO:tasks.workunit.client.0.smithi088.stdout:9/81: link d2/dd/d11/l13 d2/dd/d11/l21 0 2024-09-17T04:20:53.586 INFO:tasks.workunit.client.0.smithi088.stdout:4/97: mknod d5/c1b 0 2024-09-17T04:20:53.587 INFO:tasks.workunit.client.1.smithi134.stdout:3/431: write de/d10/f2e [1133065,77183] 0 2024-09-17T04:20:53.588 INFO:tasks.workunit.client.0.smithi088.stdout:4/98: dread - d5/f1a zero size 2024-09-17T04:20:53.589 INFO:tasks.workunit.client.0.smithi088.stdout:1/90: symlink d0/d1/df/l1d 0 2024-09-17T04:20:53.590 INFO:tasks.workunit.client.0.smithi088.stdout:9/82: dwrite d2/dd/d14/f20 [0,4194304] 0 2024-09-17T04:20:53.590 INFO:tasks.workunit.client.0.smithi088.stdout:9/83: dread - d2/dd/fe zero size 2024-09-17T04:20:53.593 INFO:tasks.workunit.client.1.smithi134.stdout:9/739: creat d2/d5/d37/d7c/ffa x:0 0 0 2024-09-17T04:20:53.594 INFO:tasks.workunit.client.0.smithi088.stdout:1/91: write d0/f8 [1678911,126373] 0 2024-09-17T04:20:53.595 INFO:tasks.workunit.client.0.smithi088.stdout:1/92: chown d0/d1/fd 10816329 1 2024-09-17T04:20:53.596 INFO:tasks.workunit.client.0.smithi088.stdout:5/83: write d2/f10 [693686,70880] 0 2024-09-17T04:20:53.596 INFO:tasks.workunit.client.1.smithi134.stdout:8/361: mkdir d4/db/dd/d72 0 2024-09-17T04:20:53.597 INFO:tasks.workunit.client.0.smithi088.stdout:9/84: write d2/f3 [2613862,50527] 0 2024-09-17T04:20:53.598 INFO:tasks.workunit.client.0.smithi088.stdout:5/84: truncate d2/f10 1576401 0 2024-09-17T04:20:53.598 INFO:tasks.workunit.client.1.smithi134.stdout:0/332: creat d11/d22/d1c/d2f/d45/f74 x:0 0 0 2024-09-17T04:20:53.599 INFO:tasks.workunit.client.0.smithi088.stdout:5/85: write d2/d9/fa [632800,62411] 0 2024-09-17T04:20:53.603 INFO:tasks.workunit.client.1.smithi134.stdout:2/407: rmdir d19/d27/d31/d49/d72 0 2024-09-17T04:20:53.604 INFO:tasks.workunit.client.0.smithi088.stdout:9/85: symlink d2/l22 0 2024-09-17T04:20:53.604 INFO:tasks.workunit.client.0.smithi088.stdout:9/86: read - d2/f9 zero size 2024-09-17T04:20:53.608 INFO:tasks.workunit.client.1.smithi134.stdout:5/343: unlink d0/da/d69/c15 0 2024-09-17T04:20:53.609 INFO:tasks.workunit.client.1.smithi134.stdout:4/437: dwrite d0/df/d1e/d20/f45 [0,4194304] 0 2024-09-17T04:20:53.611 INFO:tasks.workunit.client.1.smithi134.stdout:9/740: unlink d2/d5/d8/d16/d54/cc3 0 2024-09-17T04:20:53.614 INFO:tasks.workunit.client.1.smithi134.stdout:8/362: unlink d4/l5c 0 2024-09-17T04:20:53.614 INFO:tasks.workunit.client.1.smithi134.stdout:0/333: mknod d11/d48/c75 0 2024-09-17T04:20:53.619 INFO:tasks.workunit.client.1.smithi134.stdout:8/363: dwrite d4/d1f/d2b/f2f [0,4194304] 0 2024-09-17T04:20:53.620 INFO:tasks.workunit.client.1.smithi134.stdout:8/364: chown d4/d1f/f3a 217707 1 2024-09-17T04:20:53.625 INFO:tasks.workunit.client.1.smithi134.stdout:3/432: link de/d12/d22/f8e de/d12/d15/d1d/d2d/d63/d77/f92 0 2024-09-17T04:20:53.626 INFO:tasks.workunit.client.1.smithi134.stdout:1/412: getdents d12/d19/d1d/d3e 0 2024-09-17T04:20:53.627 INFO:tasks.workunit.client.1.smithi134.stdout:4/438: unlink d0/df/d1e/d63/c70 0 2024-09-17T04:20:53.629 INFO:tasks.workunit.client.1.smithi134.stdout:9/741: dread d2/d5/d9/d6b/de1/f65 [0,4194304] 0 2024-09-17T04:20:53.629 INFO:tasks.workunit.client.1.smithi134.stdout:2/408: link d19/d27/f2f d19/d27/d31/d34/f82 0 2024-09-17T04:20:53.630 INFO:tasks.workunit.client.1.smithi134.stdout:0/334: mkdir d11/d4c/d76 0 2024-09-17T04:20:53.631 INFO:tasks.workunit.client.1.smithi134.stdout:5/344: creat d0/da/f6c x:0 0 0 2024-09-17T04:20:53.631 INFO:tasks.workunit.client.1.smithi134.stdout:0/335: chown d11/d22/f3e 52655651 1 2024-09-17T04:20:53.632 INFO:tasks.workunit.client.1.smithi134.stdout:1/413: rename d12/d19/d1d/d3e/l5e to d12/d36/l8c 0 2024-09-17T04:20:53.634 INFO:tasks.workunit.client.1.smithi134.stdout:2/409: mknod d19/d27/d64/d80/c83 0 2024-09-17T04:20:53.634 INFO:tasks.workunit.client.1.smithi134.stdout:5/345: fsync d0/d3a/d2b/f43 0 2024-09-17T04:20:53.636 INFO:tasks.workunit.client.1.smithi134.stdout:9/742: dwrite d2/d78/fc6 [0,4194304] 0 2024-09-17T04:20:53.636 INFO:tasks.workunit.client.1.smithi134.stdout:3/433: link de/d12/l2f de/d12/d15/d1d/l93 0 2024-09-17T04:20:53.637 INFO:tasks.workunit.client.1.smithi134.stdout:1/414: symlink d12/d19/d5d/d88/l8d 0 2024-09-17T04:20:53.637 INFO:tasks.workunit.client.1.smithi134.stdout:3/434: stat de/d10/f2e 0 2024-09-17T04:20:53.638 INFO:tasks.workunit.client.1.smithi134.stdout:5/346: mkdir d0/da/d69/d41/d6d 0 2024-09-17T04:20:53.638 INFO:tasks.workunit.client.1.smithi134.stdout:2/410: read d19/d27/d31/d34/d42/f5e [575918,59009] 0 2024-09-17T04:20:53.639 INFO:tasks.workunit.client.1.smithi134.stdout:6/471: sync 2024-09-17T04:20:53.639 INFO:tasks.workunit.client.0.smithi088.stdout:1/93: link d0/d1/fd d0/d13/f1e 0 2024-09-17T04:20:53.640 INFO:tasks.workunit.client.1.smithi134.stdout:9/743: mknod d2/d5/d8/d16/d54/d5e/da0/cfb 0 2024-09-17T04:20:53.640 INFO:tasks.workunit.client.1.smithi134.stdout:1/415: write d12/f42 [2650612,2121] 0 2024-09-17T04:20:53.640 INFO:tasks.workunit.client.1.smithi134.stdout:5/347: stat d0/da/d69/d41/d6d 0 2024-09-17T04:20:53.640 INFO:tasks.workunit.client.0.smithi088.stdout:9/87: write d2/f18 [4813505,69932] 0 2024-09-17T04:20:53.643 INFO:tasks.workunit.client.0.smithi088.stdout:5/86: rename d2/d9/cf to d2/c19 0 2024-09-17T04:20:53.644 INFO:tasks.workunit.client.1.smithi134.stdout:6/472: mkdir de/d19/d74/d94 0 2024-09-17T04:20:53.646 INFO:tasks.workunit.client.1.smithi134.stdout:3/435: dwrite de/d12/d15/d1d/d2d/d63/d77/f8a [0,4194304] 0 2024-09-17T04:20:53.646 INFO:tasks.workunit.client.1.smithi134.stdout:5/348: symlink d0/da/d29/l6e 0 2024-09-17T04:20:53.647 INFO:tasks.workunit.client.1.smithi134.stdout:9/744: dread d2/d5/d9/df/f48 [0,4194304] 0 2024-09-17T04:20:53.648 INFO:tasks.workunit.client.1.smithi134.stdout:9/745: readlink d2/d5/d37/l46 0 2024-09-17T04:20:53.648 INFO:tasks.workunit.client.1.smithi134.stdout:9/746: stat d2/d5/d37/d7c/lbf 0 2024-09-17T04:20:53.648 INFO:tasks.workunit.client.0.smithi088.stdout:9/88: readlink d2/dd/d11/l21 0 2024-09-17T04:20:53.649 INFO:tasks.workunit.client.1.smithi134.stdout:2/411: mkdir d19/d27/d31/d49/d6f/d84 0 2024-09-17T04:20:53.650 INFO:tasks.workunit.client.0.smithi088.stdout:1/94: dwrite d0/f8 [4194304,4194304] 0 2024-09-17T04:20:53.651 INFO:tasks.workunit.client.1.smithi134.stdout:4/439: dread d0/df/d1e/f2e [0,4194304] 0 2024-09-17T04:20:53.652 INFO:tasks.workunit.client.0.smithi088.stdout:1/95: write d0/f8 [4371486,14182] 0 2024-09-17T04:20:53.652 INFO:tasks.workunit.client.1.smithi134.stdout:4/440: stat d0/d13/d40/d42 0 2024-09-17T04:20:53.652 INFO:tasks.workunit.client.0.smithi088.stdout:5/87: unlink d2/f16 0 2024-09-17T04:20:53.657 INFO:tasks.workunit.client.0.smithi088.stdout:9/89: symlink d2/dd/d14/l23 0 2024-09-17T04:20:53.658 INFO:tasks.workunit.client.0.smithi088.stdout:9/90: read d2/f3 [2386647,110530] 0 2024-09-17T04:20:53.659 INFO:tasks.workunit.client.1.smithi134.stdout:6/473: creat de/d19/d1f/d55/d77/f95 x:0 0 0 2024-09-17T04:20:53.659 INFO:tasks.workunit.client.1.smithi134.stdout:8/365: write d4/f10 [1713510,31857] 0 2024-09-17T04:20:53.660 INFO:tasks.workunit.client.1.smithi134.stdout:6/474: stat de/c16 0 2024-09-17T04:20:53.663 INFO:tasks.workunit.client.1.smithi134.stdout:3/436: readlink de/d10/d3d/l7b 0 2024-09-17T04:20:53.664 INFO:tasks.workunit.client.0.smithi088.stdout:5/88: symlink d2/d9/l1a 0 2024-09-17T04:20:53.666 INFO:tasks.workunit.client.1.smithi134.stdout:9/747: mknod d2/d5/d9/df/d80/cfc 0 2024-09-17T04:20:53.666 INFO:tasks.workunit.client.1.smithi134.stdout:9/748: dread - d2/d5/d58/db5/fe5 zero size 2024-09-17T04:20:53.668 INFO:tasks.workunit.client.1.smithi134.stdout:2/412: mkdir d19/d1c/d47/d50/d85 0 2024-09-17T04:20:53.670 INFO:tasks.workunit.client.1.smithi134.stdout:4/441: mknod d0/df/d1e/d20/c8e 0 2024-09-17T04:20:53.671 INFO:tasks.workunit.client.1.smithi134.stdout:4/442: stat d0/f5 0 2024-09-17T04:20:53.671 INFO:tasks.workunit.client.1.smithi134.stdout:0/336: dwrite fe [0,4194304] 0 2024-09-17T04:20:53.672 INFO:tasks.workunit.client.0.smithi088.stdout:9/91: rename d2/fa to d2/dd/d11/d1d/f24 0 2024-09-17T04:20:53.678 INFO:tasks.workunit.client.0.smithi088.stdout:5/89: rename d2/f6 to d2/d9/f1b 0 2024-09-17T04:20:53.681 INFO:tasks.workunit.client.0.smithi088.stdout:5/90: read d2/d9/f12 [24470,24080] 0 2024-09-17T04:20:53.681 INFO:tasks.workunit.client.0.smithi088.stdout:9/92: creat d2/dd/d11/f25 x:0 0 0 2024-09-17T04:20:53.682 INFO:tasks.workunit.client.1.smithi134.stdout:2/413: creat d19/d7e/f86 x:0 0 0 2024-09-17T04:20:53.683 INFO:tasks.workunit.client.1.smithi134.stdout:2/414: fsync d19/d27/d31/d49/d63/f68 0 2024-09-17T04:20:53.684 INFO:tasks.workunit.client.1.smithi134.stdout:4/443: creat d0/df/d1e/d73/f8f x:0 0 0 2024-09-17T04:20:53.688 INFO:tasks.workunit.client.1.smithi134.stdout:5/349: creat d0/f6f x:0 0 0 2024-09-17T04:20:53.689 INFO:tasks.workunit.client.0.smithi088.stdout:9/93: creat d2/f26 x:0 0 0 2024-09-17T04:20:53.689 INFO:tasks.workunit.client.0.smithi088.stdout:9/94: dread - d2/dd/d11/f1e zero size 2024-09-17T04:20:53.690 INFO:tasks.workunit.client.1.smithi134.stdout:6/475: symlink de/d19/d74/d94/l96 0 2024-09-17T04:20:53.690 INFO:tasks.workunit.client.0.smithi088.stdout:9/95: fdatasync d2/dd/d14/f19 0 2024-09-17T04:20:53.692 INFO:tasks.workunit.client.0.smithi088.stdout:9/96: write d2/dd/fe [718724,97551] 0 2024-09-17T04:20:53.692 INFO:tasks.workunit.client.1.smithi134.stdout:8/366: link d4/db/dd/f2e d4/d23/d60/d6b/d13/f73 0 2024-09-17T04:20:53.694 INFO:tasks.workunit.client.1.smithi134.stdout:8/367: write d4/d1f/d2b/f2f [2784819,130429] 0 2024-09-17T04:20:53.696 INFO:tasks.workunit.client.1.smithi134.stdout:8/368: write d4/db/dd/f1b [4416645,49157] 0 2024-09-17T04:20:53.696 INFO:tasks.workunit.client.1.smithi134.stdout:6/476: dwrite de/d19/d21/d2d/f6a [0,4194304] 0 2024-09-17T04:20:53.697 INFO:tasks.workunit.client.1.smithi134.stdout:2/415: rmdir d19/d27/d64 39 2024-09-17T04:20:53.697 INFO:tasks.workunit.client.0.smithi088.stdout:5/91: creat d2/f1c x:0 0 0 2024-09-17T04:20:53.697 INFO:tasks.workunit.client.0.smithi088.stdout:1/96: dwrite d0/d1/fd [4194304,4194304] 0 2024-09-17T04:20:53.697 INFO:tasks.workunit.client.1.smithi134.stdout:6/477: chown de/d19 38826983 1 2024-09-17T04:20:53.698 INFO:tasks.workunit.client.1.smithi134.stdout:8/369: write d4/f57 [169558,68558] 0 2024-09-17T04:20:53.698 INFO:tasks.workunit.client.1.smithi134.stdout:2/416: write d19/d1c/f1d [2020012,319] 0 2024-09-17T04:20:53.702 INFO:tasks.workunit.client.1.smithi134.stdout:9/749: write d2/d5/d9/df/d38/f6c [1842533,35104] 0 2024-09-17T04:20:53.703 INFO:tasks.workunit.client.1.smithi134.stdout:5/350: creat d0/da/d2c/f70 x:0 0 0 2024-09-17T04:20:53.703 INFO:tasks.workunit.client.1.smithi134.stdout:2/417: chown d19/d1c/f1f 0 1 2024-09-17T04:20:53.703 INFO:tasks.workunit.client.0.smithi088.stdout:1/97: symlink d0/d1/d16/l1f 0 2024-09-17T04:20:53.704 INFO:tasks.workunit.client.1.smithi134.stdout:9/750: write d2/d5/d8/d16/d54/d5e/ff0 [969087,69028] 0 2024-09-17T04:20:53.707 INFO:tasks.workunit.client.1.smithi134.stdout:9/751: fdatasync d2/d5/d37/d83/fe9 0 2024-09-17T04:20:53.709 INFO:tasks.workunit.client.1.smithi134.stdout:8/370: dread d4/d1f/f44 [0,4194304] 0 2024-09-17T04:20:53.709 INFO:tasks.workunit.client.0.smithi088.stdout:5/92: creat d2/f1d x:0 0 0 2024-09-17T04:20:53.711 INFO:tasks.workunit.client.1.smithi134.stdout:0/337: dwrite f0 [0,4194304] 0 2024-09-17T04:20:53.712 INFO:tasks.workunit.client.1.smithi134.stdout:4/444: unlink d0/df/d1e/c83 0 2024-09-17T04:20:53.712 INFO:tasks.workunit.client.1.smithi134.stdout:9/752: truncate d2/d5/d9/d6b/de1/f65 4638459 0 2024-09-17T04:20:53.713 INFO:tasks.workunit.client.0.smithi088.stdout:9/97: getdents d2/d16 0 2024-09-17T04:20:53.714 INFO:tasks.workunit.client.0.smithi088.stdout:9/98: chown d2/dd/d11/d1d/l1f 0 1 2024-09-17T04:20:53.716 INFO:tasks.workunit.client.1.smithi134.stdout:5/351: rename d0/da/d69/f4a to d0/d3a/f71 0 2024-09-17T04:20:53.717 INFO:tasks.workunit.client.1.smithi134.stdout:3/437: getdents de/d12/d15 0 2024-09-17T04:20:53.719 INFO:tasks.workunit.client.1.smithi134.stdout:3/438: chown de/d12/d15/d1d/d2d/d63/d77/f92 50275980 1 2024-09-17T04:20:53.720 INFO:tasks.workunit.client.0.smithi088.stdout:9/99: mknod d2/c27 0 2024-09-17T04:20:53.721 INFO:tasks.workunit.client.1.smithi134.stdout:8/371: mknod d4/d23/d60/d6b/d13/c74 0 2024-09-17T04:20:53.722 INFO:tasks.workunit.client.1.smithi134.stdout:8/372: write f0 [40775,4837] 0 2024-09-17T04:20:53.722 INFO:tasks.workunit.client.0.smithi088.stdout:9/100: creat d2/d16/f28 x:0 0 0 2024-09-17T04:20:53.723 INFO:tasks.workunit.client.0.smithi088.stdout:9/101: read - d2/fc zero size 2024-09-17T04:20:53.726 INFO:tasks.workunit.client.0.smithi088.stdout:9/102: dread d2/dd/f15 [0,4194304] 0 2024-09-17T04:20:53.727 INFO:tasks.workunit.client.0.smithi088.stdout:1/98: truncate d0/d1/fd 890500 0 2024-09-17T04:20:53.730 INFO:tasks.workunit.client.0.smithi088.stdout:5/93: link d2/d9/l14 d2/l1e 0 2024-09-17T04:20:53.731 INFO:tasks.workunit.client.1.smithi134.stdout:7/299: sync 2024-09-17T04:20:53.731 INFO:tasks.workunit.client.0.smithi088.stdout:9/103: symlink d2/dd/l29 0 2024-09-17T04:20:53.744 INFO:tasks.workunit.client.0.smithi088.stdout:1/99: dwrite d0/d13/f1e [0,4194304] 0 2024-09-17T04:20:53.745 INFO:tasks.workunit.client.1.smithi134.stdout:5/352: fdatasync d0/da/d2c/f37 0 2024-09-17T04:20:53.745 INFO:tasks.workunit.client.1.smithi134.stdout:3/439: creat de/d10/d3d/f94 x:0 0 0 2024-09-17T04:20:53.746 INFO:tasks.workunit.client.1.smithi134.stdout:0/338: getdents d11/d4c/d76 0 2024-09-17T04:20:53.746 INFO:tasks.workunit.client.0.smithi088.stdout:9/104: write d2/f9 [315814,116514] 0 2024-09-17T04:20:53.747 INFO:tasks.workunit.client.1.smithi134.stdout:2/418: creat d19/d1c/f87 x:0 0 0 2024-09-17T04:20:53.747 INFO:tasks.workunit.client.1.smithi134.stdout:5/353: write d0/da/f1e [2458054,59271] 0 2024-09-17T04:20:53.748 INFO:tasks.workunit.client.0.smithi088.stdout:5/94: truncate d2/fd 1842824 0 2024-09-17T04:20:53.748 INFO:tasks.workunit.client.0.smithi088.stdout:9/105: write d2/dd/d11/f1e [787824,70908] 0 2024-09-17T04:20:53.749 INFO:tasks.workunit.client.0.smithi088.stdout:1/100: mkdir d0/d1/df/d20 0 2024-09-17T04:20:53.749 INFO:tasks.workunit.client.1.smithi134.stdout:2/419: stat d19/d27/d31/l43 0 2024-09-17T04:20:53.749 INFO:tasks.workunit.client.0.smithi088.stdout:5/95: chown d2/f15 1427049 1 2024-09-17T04:20:53.750 INFO:tasks.workunit.client.1.smithi134.stdout:7/300: chown d0/dd/d3a/d3d/f41 1827745 1 2024-09-17T04:20:53.750 INFO:tasks.workunit.client.0.smithi088.stdout:5/96: write d2/d9/f18 [2285938,35592] 0 2024-09-17T04:20:53.750 INFO:tasks.workunit.client.0.smithi088.stdout:9/106: mkdir d2/dd/d14/d2a 0 2024-09-17T04:20:53.753 INFO:tasks.workunit.client.0.smithi088.stdout:1/101: rmdir d0/d1 39 2024-09-17T04:20:53.754 INFO:tasks.workunit.client.1.smithi134.stdout:6/478: getdents de/d19/d21/d2d 0 2024-09-17T04:20:53.754 INFO:tasks.workunit.client.0.smithi088.stdout:9/107: mkdir d2/d2b 0 2024-09-17T04:20:53.755 INFO:tasks.workunit.client.0.smithi088.stdout:9/108: chown d2/dd/d11 1576 1 2024-09-17T04:20:53.756 INFO:tasks.workunit.client.1.smithi134.stdout:9/753: rename d2/d5/d37/d7c/l87 to d2/lfd 0 2024-09-17T04:20:53.758 INFO:tasks.workunit.client.0.smithi088.stdout:9/109: chown d2/dd/d11/d1d/l1f 171 1 2024-09-17T04:20:53.758 INFO:tasks.workunit.client.0.smithi088.stdout:5/97: dwrite d2/f5 [0,4194304] 0 2024-09-17T04:20:53.758 INFO:tasks.workunit.client.1.smithi134.stdout:5/354: mkdir d0/da/d69/d41/d72 0 2024-09-17T04:20:53.759 INFO:tasks.workunit.client.0.smithi088.stdout:9/110: chown d2/fb 844 1 2024-09-17T04:20:53.759 INFO:tasks.workunit.client.1.smithi134.stdout:5/355: write d0/d3a/d2b/d61/f65 [152625,75024] 0 2024-09-17T04:20:53.765 INFO:tasks.workunit.client.0.smithi088.stdout:9/111: chown d2/dd/d11/l17 799023 1 2024-09-17T04:20:53.766 INFO:tasks.workunit.client.1.smithi134.stdout:3/440: creat de/d67/f95 x:0 0 0 2024-09-17T04:20:53.766 INFO:tasks.workunit.client.1.smithi134.stdout:9/754: creat d2/d5/d8/d16/d54/daf/d6d/daa/ffe x:0 0 0 2024-09-17T04:20:53.766 INFO:tasks.workunit.client.1.smithi134.stdout:3/441: write de/d12/d15/d1d/d2d/d63/d77/f8a [952541,103663] 0 2024-09-17T04:20:53.766 INFO:tasks.workunit.client.1.smithi134.stdout:5/356: mkdir d0/da/d2c/d73 0 2024-09-17T04:20:53.768 INFO:tasks.workunit.client.1.smithi134.stdout:9/755: chown d2/d25/c40 85174 1 2024-09-17T04:20:53.768 INFO:tasks.workunit.client.1.smithi134.stdout:2/420: mknod d19/d67/c88 0 2024-09-17T04:20:53.768 INFO:tasks.workunit.client.1.smithi134.stdout:8/373: dread d4/db/dd/f1b [0,4194304] 0 2024-09-17T04:20:53.769 INFO:tasks.workunit.client.1.smithi134.stdout:3/442: stat de/d12/d15/d1d/d2d/c57 0 2024-09-17T04:20:53.770 INFO:tasks.workunit.client.0.smithi088.stdout:5/98: dwrite d2/f1c [0,4194304] 0 2024-09-17T04:20:53.771 INFO:tasks.workunit.client.1.smithi134.stdout:0/339: dread d11/d18/f36 [0,4194304] 0 2024-09-17T04:20:53.771 INFO:tasks.workunit.client.1.smithi134.stdout:5/357: symlink d0/da/d69/d41/l74 0 2024-09-17T04:20:53.773 INFO:tasks.workunit.client.1.smithi134.stdout:8/374: truncate d4/d1f/d25/f50 392622 0 2024-09-17T04:20:53.773 INFO:tasks.workunit.client.1.smithi134.stdout:0/340: chown d11/f70 532 1 2024-09-17T04:20:53.773 INFO:tasks.workunit.client.1.smithi134.stdout:6/479: link de/d19/d7b/c81 de/d19/d7b/c97 0 2024-09-17T04:20:53.775 INFO:tasks.workunit.client.0.smithi088.stdout:1/102: dwrite d0/d1/df/f10 [0,4194304] 0 2024-09-17T04:20:53.775 INFO:tasks.workunit.client.1.smithi134.stdout:9/756: truncate d2/d5/d8/d16/d54/daf/d6d/daa/ffe 561688 0 2024-09-17T04:20:53.776 INFO:tasks.workunit.client.1.smithi134.stdout:5/358: dread d0/d3a/d2b/f34 [0,4194304] 0 2024-09-17T04:20:53.777 INFO:tasks.workunit.client.1.smithi134.stdout:6/480: chown de/d19/d1f/f28 40 1 2024-09-17T04:20:53.777 INFO:tasks.workunit.client.1.smithi134.stdout:8/375: dread - d4/d23/d60/d6b/d13/f61 zero size 2024-09-17T04:20:53.778 INFO:tasks.workunit.client.1.smithi134.stdout:6/481: stat de/d19/d21/c78 0 2024-09-17T04:20:53.779 INFO:tasks.workunit.client.1.smithi134.stdout:2/421: dwrite d19/d27/d31/d49/d63/f68 [0,4194304] 0 2024-09-17T04:20:53.779 INFO:tasks.workunit.client.0.smithi088.stdout:9/112: dwrite d2/dd/d11/f25 [0,4194304] 0 2024-09-17T04:20:53.784 INFO:tasks.workunit.client.1.smithi134.stdout:3/443: dread de/d12/d15/d1d/d2d/d31/f3e [0,4194304] 0 2024-09-17T04:20:53.791 INFO:tasks.workunit.client.0.smithi088.stdout:9/113: dwrite d2/dd/f1b [0,4194304] 0 2024-09-17T04:20:53.792 INFO:tasks.workunit.client.1.smithi134.stdout:5/359: write d0/d48/f52 [1273541,126728] 0 2024-09-17T04:20:53.792 INFO:tasks.workunit.client.0.smithi088.stdout:9/114: truncate f1 181566 0 2024-09-17T04:20:53.794 INFO:tasks.workunit.client.0.smithi088.stdout:1/103: symlink d0/l21 0 2024-09-17T04:20:53.795 INFO:tasks.workunit.client.0.smithi088.stdout:9/115: truncate d2/dd/d11/d1d/f24 4197266 0 2024-09-17T04:20:53.798 INFO:tasks.workunit.client.1.smithi134.stdout:0/341: symlink d11/d4c/d76/l77 0 2024-09-17T04:20:53.800 INFO:tasks.workunit.client.1.smithi134.stdout:0/342: stat d11/d18/f1e 0 2024-09-17T04:20:53.804 INFO:tasks.workunit.client.1.smithi134.stdout:5/360: dread d0/d3a/f3f [0,4194304] 0 2024-09-17T04:20:53.804 INFO:tasks.workunit.client.1.smithi134.stdout:7/301: truncate d0/dd/f27 766208 0 2024-09-17T04:20:53.805 INFO:tasks.workunit.client.1.smithi134.stdout:9/757: dwrite d2/d5/d8/d16/d54/daf/d6d/daa/de2/dcd/fee [0,4194304] 0 2024-09-17T04:20:53.806 INFO:tasks.workunit.client.0.smithi088.stdout:5/99: chown d2/fd 2087348 1 2024-09-17T04:20:53.808 INFO:tasks.workunit.client.0.smithi088.stdout:5/100: write d2/f10 [65194,124170] 0 2024-09-17T04:20:53.808 INFO:tasks.workunit.client.1.smithi134.stdout:0/343: read d11/d18/f3d [122790,29687] 0 2024-09-17T04:20:53.809 INFO:tasks.workunit.client.0.smithi088.stdout:1/104: truncate d0/d1/fa 2248959 0 2024-09-17T04:20:53.811 INFO:tasks.workunit.client.0.smithi088.stdout:5/101: write d2/d9/f18 [1904375,18351] 0 2024-09-17T04:20:53.814 INFO:tasks.workunit.client.1.smithi134.stdout:6/482: dread de/f53 [0,4194304] 0 2024-09-17T04:20:53.814 INFO:tasks.workunit.client.1.smithi134.stdout:0/344: read d11/d19/f6c [186029,75245] 0 2024-09-17T04:20:53.815 INFO:tasks.workunit.client.1.smithi134.stdout:9/758: readlink d2/d5/d37/l9f 0 2024-09-17T04:20:53.816 INFO:tasks.workunit.client.1.smithi134.stdout:5/361: read d0/d3a/f71 [648,121175] 0 2024-09-17T04:20:53.817 INFO:tasks.workunit.client.0.smithi088.stdout:1/105: creat d0/d1/df/f22 x:0 0 0 2024-09-17T04:20:53.818 INFO:tasks.workunit.client.1.smithi134.stdout:7/302: mkdir d0/dd/d3a/d3d/d38/d60 0 2024-09-17T04:20:53.818 INFO:tasks.workunit.client.1.smithi134.stdout:9/759: dread - d2/d5/d58/db5/fe5 zero size 2024-09-17T04:20:53.821 INFO:tasks.workunit.client.0.smithi088.stdout:9/116: getdents d2 0 2024-09-17T04:20:53.822 INFO:tasks.workunit.client.1.smithi134.stdout:2/422: creat d19/d27/d31/f89 x:0 0 0 2024-09-17T04:20:53.822 INFO:tasks.workunit.client.1.smithi134.stdout:3/444: write de/d12/d22/f8e [827523,8323] 0 2024-09-17T04:20:53.823 INFO:tasks.workunit.client.0.smithi088.stdout:9/117: write d2/f8 [361323,6759] 0 2024-09-17T04:20:53.824 INFO:tasks.workunit.client.0.smithi088.stdout:1/106: dwrite d0/d1/f1a [0,4194304] 0 2024-09-17T04:20:53.824 INFO:tasks.workunit.client.0.smithi088.stdout:9/118: write d2/fc [78633,31337] 0 2024-09-17T04:20:53.825 INFO:tasks.workunit.client.0.smithi088.stdout:1/107: stat d0/d1/fe 0 2024-09-17T04:20:53.826 INFO:tasks.workunit.client.1.smithi134.stdout:2/423: dread d19/f76 [0,4194304] 0 2024-09-17T04:20:53.827 INFO:tasks.workunit.client.1.smithi134.stdout:2/424: readlink d19/d27/d31/l48 0 2024-09-17T04:20:53.831 INFO:tasks.workunit.client.1.smithi134.stdout:6/483: mkdir de/d19/d74/d98 0 2024-09-17T04:20:53.833 INFO:tasks.workunit.client.1.smithi134.stdout:5/362: symlink d0/d3a/d2b/d5a/l75 0 2024-09-17T04:20:53.835 INFO:tasks.workunit.client.1.smithi134.stdout:0/345: creat d11/d22/d1c/d2f/d43/d5d/f78 x:0 0 0 2024-09-17T04:20:53.836 INFO:tasks.workunit.client.1.smithi134.stdout:0/346: readlink d11/d19/l2a 0 2024-09-17T04:20:53.836 INFO:tasks.workunit.client.1.smithi134.stdout:0/347: readlink l7 0 2024-09-17T04:20:53.836 INFO:tasks.workunit.client.0.smithi088.stdout:9/119: mknod d2/dd/d14/c2c 0 2024-09-17T04:20:53.840 INFO:tasks.workunit.client.1.smithi134.stdout:7/303: dread d0/f15 [4194304,4194304] 0 2024-09-17T04:20:53.840 INFO:tasks.workunit.client.1.smithi134.stdout:7/304: fdatasync d0/d16/f5a 0 2024-09-17T04:20:53.841 INFO:tasks.workunit.client.0.smithi088.stdout:1/108: mknod d0/c23 0 2024-09-17T04:20:53.842 INFO:tasks.workunit.client.1.smithi134.stdout:3/445: fsync de/d12/d15/f4b 0 2024-09-17T04:20:53.843 INFO:tasks.workunit.client.1.smithi134.stdout:3/446: readlink de/d10/d70/l76 0 2024-09-17T04:20:53.844 INFO:tasks.workunit.client.0.smithi088.stdout:9/120: rmdir d2/d16 39 2024-09-17T04:20:53.845 INFO:tasks.workunit.client.0.smithi088.stdout:5/102: getdents d2/d9 0 2024-09-17T04:20:53.846 INFO:tasks.workunit.client.1.smithi134.stdout:9/760: dread d2/d5/d9/f1c [0,4194304] 0 2024-09-17T04:20:53.846 INFO:tasks.workunit.client.1.smithi134.stdout:1/416: sync 2024-09-17T04:20:53.847 INFO:tasks.workunit.client.1.smithi134.stdout:1/417: chown d12/d19/d1d/d3e/c83 27649846 1 2024-09-17T04:20:53.848 INFO:tasks.workunit.client.1.smithi134.stdout:0/348: symlink d11/d18/l79 0 2024-09-17T04:20:53.848 INFO:tasks.workunit.client.0.smithi088.stdout:1/109: symlink d0/d1/l24 0 2024-09-17T04:20:53.848 INFO:tasks.workunit.client.1.smithi134.stdout:1/418: chown d12/d1c/d56/f76 178310404 1 2024-09-17T04:20:53.849 INFO:tasks.workunit.client.0.smithi088.stdout:1/110: chown d0/d13/f1e 291823628 1 2024-09-17T04:20:53.849 INFO:tasks.workunit.client.1.smithi134.stdout:3/447: dread de/d12/f3a [0,4194304] 0 2024-09-17T04:20:53.852 INFO:tasks.workunit.client.0.smithi088.stdout:5/103: creat d2/d9/f1f x:0 0 0 2024-09-17T04:20:53.853 INFO:tasks.workunit.client.0.smithi088.stdout:5/104: fdatasync d2/d9/fa 0 2024-09-17T04:20:53.853 INFO:tasks.workunit.client.1.smithi134.stdout:7/305: creat d0/dd/d3a/d3d/f61 x:0 0 0 2024-09-17T04:20:53.854 INFO:tasks.workunit.client.0.smithi088.stdout:5/105: write d2/fb [3686498,91636] 0 2024-09-17T04:20:53.854 INFO:tasks.workunit.client.0.smithi088.stdout:1/111: rename d0/l21 to d0/d1/d16/l25 0 2024-09-17T04:20:53.859 INFO:tasks.workunit.client.1.smithi134.stdout:7/306: dwrite d0/dd/d3a/d3d/d38/f24 [0,4194304] 0 2024-09-17T04:20:53.859 INFO:tasks.workunit.client.1.smithi134.stdout:6/484: getdents de/d19/d74/d98 0 2024-09-17T04:20:53.860 INFO:tasks.workunit.client.1.smithi134.stdout:6/485: chown de/d19/d62/d34/f3c 184498 1 2024-09-17T04:20:53.861 INFO:tasks.workunit.client.1.smithi134.stdout:6/486: dread - de/d19/d21/d2d/d4c/f83 zero size 2024-09-17T04:20:53.861 INFO:tasks.workunit.client.1.smithi134.stdout:5/363: link d0/da/f6c d0/da/d69/d41/d6d/f76 0 2024-09-17T04:20:53.863 INFO:tasks.workunit.client.0.smithi088.stdout:5/106: dread d2/fd [0,4194304] 0 2024-09-17T04:20:53.864 INFO:tasks.workunit.client.1.smithi134.stdout:9/761: mkdir d2/d5/d8/d16/d54/daf/d6d/daa/de2/dcd/dd6/dff 0 2024-09-17T04:20:53.864 INFO:tasks.workunit.client.0.smithi088.stdout:5/107: dread - d2/d9/f1f zero size 2024-09-17T04:20:53.864 INFO:tasks.workunit.client.1.smithi134.stdout:1/419: dread d12/f42 [0,4194304] 0 2024-09-17T04:20:53.865 INFO:tasks.workunit.client.0.smithi088.stdout:9/121: dwrite d2/f3 [0,4194304] 0 2024-09-17T04:20:53.865 INFO:tasks.workunit.client.1.smithi134.stdout:0/349: symlink d11/d22/d1c/d2f/d43/l7a 0 2024-09-17T04:20:53.866 INFO:tasks.workunit.client.1.smithi134.stdout:9/762: chown d2/d5/d8/d16/d54/daf/d6d/daa/de2/dcf/le6 9 1 2024-09-17T04:20:53.871 INFO:tasks.workunit.client.0.smithi088.stdout:5/108: fsync d2/fd 0 2024-09-17T04:20:53.871 INFO:tasks.workunit.client.1.smithi134.stdout:3/448: mknod de/d67/c96 0 2024-09-17T04:20:53.874 INFO:tasks.workunit.client.0.smithi088.stdout:9/122: dwrite d2/fc [0,4194304] 0 2024-09-17T04:20:53.876 INFO:tasks.workunit.client.0.smithi088.stdout:5/109: mkdir d2/d9/d20 0 2024-09-17T04:20:53.876 INFO:tasks.workunit.client.1.smithi134.stdout:6/487: mkdir de/d99 0 2024-09-17T04:20:53.877 INFO:tasks.workunit.client.0.smithi088.stdout:1/112: getdents d0/d13 0 2024-09-17T04:20:53.878 INFO:tasks.workunit.client.1.smithi134.stdout:6/488: fsync de/d19/d21/d2d/f6a 0 2024-09-17T04:20:53.881 INFO:tasks.workunit.client.0.smithi088.stdout:5/110: rename d2/fb to d2/d9/f21 0 2024-09-17T04:20:53.884 INFO:tasks.workunit.client.1.smithi134.stdout:0/350: symlink d11/d22/d1c/d2f/d43/l7b 0 2024-09-17T04:20:53.888 INFO:tasks.workunit.client.0.smithi088.stdout:9/123: rename d2/d16/c1a to d2/dd/d11/c2d 0 2024-09-17T04:20:53.890 INFO:tasks.workunit.client.1.smithi134.stdout:7/307: symlink d0/d16/d35/l62 0 2024-09-17T04:20:53.892 INFO:tasks.workunit.client.0.smithi088.stdout:5/111: fsync d2/d9/f21 0 2024-09-17T04:20:53.892 INFO:tasks.workunit.client.1.smithi134.stdout:7/308: dread d0/dd/d57/f5f [0,4194304] 0 2024-09-17T04:20:53.892 INFO:tasks.workunit.client.1.smithi134.stdout:7/309: read d0/dd/d57/f5f [146102,18715] 0 2024-09-17T04:20:53.893 INFO:tasks.workunit.client.0.smithi088.stdout:5/112: fdatasync d2/d9/f21 0 2024-09-17T04:20:53.894 INFO:tasks.workunit.client.1.smithi134.stdout:6/489: readlink de/l32 0 2024-09-17T04:20:53.895 INFO:tasks.workunit.client.1.smithi134.stdout:6/490: write f7 [3207865,73758] 0 2024-09-17T04:20:53.896 INFO:tasks.workunit.client.0.smithi088.stdout:5/113: creat d2/d9/d20/f22 x:0 0 0 2024-09-17T04:20:53.897 INFO:tasks.workunit.client.1.smithi134.stdout:0/351: mknod d11/d22/d1c/c7c 0 2024-09-17T04:20:53.898 INFO:tasks.workunit.client.1.smithi134.stdout:4/445: sync 2024-09-17T04:20:53.898 INFO:tasks.workunit.client.1.smithi134.stdout:9/763: dwrite d2/d5/d9/d6b/f7f [0,4194304] 0 2024-09-17T04:20:53.898 INFO:tasks.workunit.client.0.smithi088.stdout:1/113: truncate d0/d13/f1e 67364 0 2024-09-17T04:20:53.900 INFO:tasks.workunit.client.1.smithi134.stdout:5/364: rename d0/da/d2c/c40 to d0/da/d69/c77 0 2024-09-17T04:20:53.901 INFO:tasks.workunit.client.0.smithi088.stdout:1/114: symlink d0/d1/d16/l26 0 2024-09-17T04:20:53.902 INFO:tasks.workunit.client.1.smithi134.stdout:5/365: fsync d0/f2a 0 2024-09-17T04:20:53.902 INFO:tasks.workunit.client.1.smithi134.stdout:1/420: creat d12/d19/f8e x:0 0 0 2024-09-17T04:20:53.902 INFO:tasks.workunit.client.1.smithi134.stdout:4/446: dread d0/df/d1e/f25 [0,4194304] 0 2024-09-17T04:20:53.902 INFO:tasks.workunit.client.1.smithi134.stdout:5/366: fsync d0/f47 0 2024-09-17T04:20:53.903 INFO:tasks.workunit.client.1.smithi134.stdout:1/421: readlink d12/d19/d5d/d88/l8d 0 2024-09-17T04:20:53.904 INFO:tasks.workunit.client.1.smithi134.stdout:5/367: readlink d0/l23 0 2024-09-17T04:20:53.904 INFO:tasks.workunit.client.1.smithi134.stdout:6/491: creat de/d5d/f9a x:0 0 0 2024-09-17T04:20:53.906 INFO:tasks.workunit.client.1.smithi134.stdout:6/492: dread - de/d5d/f9a zero size 2024-09-17T04:20:53.906 INFO:tasks.workunit.client.1.smithi134.stdout:0/352: mknod d11/d22/c7d 0 2024-09-17T04:20:53.907 INFO:tasks.workunit.client.1.smithi134.stdout:9/764: dwrite d2/d7/d75/fb0 [0,4194304] 0 2024-09-17T04:20:53.913 INFO:tasks.workunit.client.1.smithi134.stdout:3/449: getdents de/d12/d15/d1d/d2d/d31/d6a/d83 0 2024-09-17T04:20:53.913 INFO:tasks.workunit.client.1.smithi134.stdout:4/447: creat d0/df/d17/f90 x:0 0 0 2024-09-17T04:20:53.914 INFO:tasks.workunit.client.1.smithi134.stdout:1/422: mknod d12/d1c/d4a/c8f 0 2024-09-17T04:20:53.915 INFO:tasks.workunit.client.1.smithi134.stdout:5/368: dwrite d0/d3a/f3b [0,4194304] 0 2024-09-17T04:20:53.919 INFO:tasks.workunit.client.1.smithi134.stdout:6/493: write de/d19/d7b/f8d [155901,12646] 0 2024-09-17T04:20:53.921 INFO:tasks.workunit.client.1.smithi134.stdout:7/310: truncate d0/d16/f13 377089 0 2024-09-17T04:20:53.923 INFO:tasks.workunit.client.1.smithi134.stdout:5/369: dread - d0/da/d2c/f4c zero size 2024-09-17T04:20:53.923 INFO:tasks.workunit.client.1.smithi134.stdout:0/353: write d11/d19/d21/f27 [3256221,4974] 0 2024-09-17T04:20:53.924 INFO:tasks.workunit.client.1.smithi134.stdout:4/448: rename d0/c62 to d0/d13/d40/d72/c91 0 2024-09-17T04:20:53.926 INFO:tasks.workunit.client.0.smithi088.stdout:1/115: dwrite d0/d13/f1e [0,4194304] 0 2024-09-17T04:20:53.927 INFO:tasks.workunit.client.1.smithi134.stdout:0/354: chown d11/d24/f47 2956 1 2024-09-17T04:20:53.928 INFO:tasks.workunit.client.1.smithi134.stdout:7/311: truncate d0/dd/d3a/f5c 979117 0 2024-09-17T04:20:53.928 INFO:tasks.workunit.client.1.smithi134.stdout:1/423: dwrite d12/d1c/f24 [0,4194304] 0 2024-09-17T04:20:53.929 INFO:tasks.workunit.client.1.smithi134.stdout:6/494: mkdir de/d19/d74/d94/d9b 0 2024-09-17T04:20:53.929 INFO:tasks.workunit.client.1.smithi134.stdout:3/450: write de/d12/d15/d1d/d2d/f53 [307101,6280] 0 2024-09-17T04:20:53.931 INFO:tasks.workunit.client.1.smithi134.stdout:5/370: mkdir d0/da/d29/d78 0 2024-09-17T04:20:53.935 INFO:tasks.workunit.client.1.smithi134.stdout:6/495: rmdir de/d19/d1f 39 2024-09-17T04:20:53.938 INFO:tasks.workunit.client.1.smithi134.stdout:5/371: read d0/d3a/d2b/d61/f65 [114046,31351] 0 2024-09-17T04:20:53.938 INFO:tasks.workunit.client.1.smithi134.stdout:4/449: dwrite d0/df/d17/f6d [0,4194304] 0 2024-09-17T04:20:53.938 INFO:tasks.workunit.client.1.smithi134.stdout:8/376: sync 2024-09-17T04:20:53.938 INFO:tasks.workunit.client.1.smithi134.stdout:2/425: sync 2024-09-17T04:20:53.942 INFO:tasks.workunit.client.1.smithi134.stdout:1/424: link d12/d19/f30 d12/f90 0 2024-09-17T04:20:53.944 INFO:tasks.workunit.client.1.smithi134.stdout:4/450: dread d0/df/d1e/d20/f21 [0,4194304] 0 2024-09-17T04:20:53.945 INFO:tasks.workunit.client.1.smithi134.stdout:8/377: creat d4/d1f/d25/f75 x:0 0 0 2024-09-17T04:20:53.946 INFO:tasks.workunit.client.1.smithi134.stdout:3/451: dread de/d12/f48 [0,4194304] 0 2024-09-17T04:20:53.947 INFO:tasks.workunit.client.1.smithi134.stdout:7/312: getdents d0/d16/d35/d4b 0 2024-09-17T04:20:53.948 INFO:tasks.workunit.client.1.smithi134.stdout:1/425: mkdir d12/d19/d5d/d91 0 2024-09-17T04:20:53.949 INFO:tasks.workunit.client.1.smithi134.stdout:5/372: creat d0/f79 x:0 0 0 2024-09-17T04:20:53.949 INFO:tasks.workunit.client.1.smithi134.stdout:9/765: dread d2/d5/d8/d16/d54/daf/d6d/daa/de2/dcd/fb4 [0,4194304] 0 2024-09-17T04:20:53.949 INFO:tasks.workunit.client.1.smithi134.stdout:8/378: symlink d4/d11/l76 0 2024-09-17T04:20:53.950 INFO:tasks.workunit.client.1.smithi134.stdout:4/451: rmdir d0/df/d1e/d73 39 2024-09-17T04:20:53.951 INFO:tasks.workunit.client.1.smithi134.stdout:6/496: symlink de/d19/d1f/d55/d77/d89/l9c 0 2024-09-17T04:20:53.952 INFO:tasks.workunit.client.1.smithi134.stdout:7/313: symlink d0/dd/d3a/d51/l63 0 2024-09-17T04:20:53.952 INFO:tasks.workunit.client.1.smithi134.stdout:1/426: fsync d12/d1c/f2f 0 2024-09-17T04:20:53.954 INFO:tasks.workunit.client.1.smithi134.stdout:4/452: fdatasync d0/df/d1e/f2b 0 2024-09-17T04:20:53.955 INFO:tasks.workunit.client.1.smithi134.stdout:4/453: stat d0/d3b 0 2024-09-17T04:20:53.956 INFO:tasks.workunit.client.1.smithi134.stdout:1/427: read d12/d1c/d2e/f3b [3326740,6947] 0 2024-09-17T04:20:53.956 INFO:tasks.workunit.client.1.smithi134.stdout:6/497: unlink de/f3a 0 2024-09-17T04:20:53.958 INFO:tasks.workunit.client.1.smithi134.stdout:9/766: rename d2/d5/d9/df/c90 to d2/d5/d37/c100 0 2024-09-17T04:20:53.959 INFO:tasks.workunit.client.1.smithi134.stdout:9/767: write d2/d5/d8/d16/d54/daf/fa6 [444769,20111] 0 2024-09-17T04:20:53.996 INFO:tasks.workunit.client.1.smithi134.stdout:3/452: creat de/d10/f97 x:0 0 0 2024-09-17T04:20:53.997 INFO:tasks.workunit.client.1.smithi134.stdout:8/379: mknod d4/d1f/d25/d6a/c77 0 2024-09-17T04:20:53.999 INFO:tasks.workunit.client.1.smithi134.stdout:6/498: mknod de/d19/d21/d2d/d92/c9d 0 2024-09-17T04:20:53.999 INFO:tasks.workunit.client.1.smithi134.stdout:9/768: mknod d2/d5/d8/d16/df3/c101 0 2024-09-17T04:20:54.001 INFO:tasks.workunit.client.1.smithi134.stdout:3/453: mknod de/d12/d22/c98 0 2024-09-17T04:20:54.002 INFO:tasks.workunit.client.1.smithi134.stdout:8/380: rename d4/db/dd/f3b to d4/d23/d60/d6b/d13/f78 0 2024-09-17T04:20:54.002 INFO:tasks.workunit.client.1.smithi134.stdout:6/499: rmdir de/d19/d1f/d55 39 2024-09-17T04:20:54.003 INFO:tasks.workunit.client.1.smithi134.stdout:4/454: dread d0/df/d1e/d20/f80 [0,4194304] 0 2024-09-17T04:20:54.004 INFO:tasks.workunit.client.1.smithi134.stdout:2/426: dread d19/d27/d31/d34/d42/f54 [0,4194304] 0 2024-09-17T04:20:54.005 INFO:tasks.workunit.client.1.smithi134.stdout:5/373: dwrite d0/d3a/f3f [0,4194304] 0 2024-09-17T04:20:54.006 INFO:tasks.workunit.client.1.smithi134.stdout:4/455: stat d0/df/d1e/d20/f80 0 2024-09-17T04:20:54.006 INFO:tasks.workunit.client.1.smithi134.stdout:2/427: chown d19/f22 30068483 1 2024-09-17T04:20:54.008 INFO:tasks.workunit.client.1.smithi134.stdout:3/454: getdents de/d12/d15/d1d/d2d/d31/d6a/d83 0 2024-09-17T04:20:54.013 INFO:tasks.workunit.client.1.smithi134.stdout:3/455: write de/d12/d15/d1d/d2d/d63/d77/f8a [672381,12643] 0 2024-09-17T04:20:54.013 INFO:tasks.workunit.client.1.smithi134.stdout:9/769: dwrite d2/d5/d9/f18 [0,4194304] 0 2024-09-17T04:20:54.015 INFO:tasks.workunit.client.1.smithi134.stdout:5/374: truncate d0/f2a 960247 0 2024-09-17T04:20:54.015 INFO:tasks.workunit.client.1.smithi134.stdout:8/381: dwrite d4/d23/d60/d6b/d13/f2c [0,4194304] 0 2024-09-17T04:20:54.016 INFO:tasks.workunit.client.1.smithi134.stdout:4/456: rename d0/df/d1e/d20 to d0/d13/d40/d42/d92 0 2024-09-17T04:20:54.017 INFO:tasks.workunit.client.1.smithi134.stdout:9/770: symlink d2/d5/d9/d6b/l102 0 2024-09-17T04:20:54.018 INFO:tasks.workunit.client.1.smithi134.stdout:2/428: creat d19/d27/f8a x:0 0 0 2024-09-17T04:20:54.018 INFO:tasks.workunit.client.1.smithi134.stdout:3/456: mknod de/d12/d22/c99 0 2024-09-17T04:20:54.021 INFO:tasks.workunit.client.1.smithi134.stdout:5/375: rename d0/d3a/l68 to d0/d3a/l7a 0 2024-09-17T04:20:54.022 INFO:tasks.workunit.client.1.smithi134.stdout:4/457: symlink d0/d78/l93 0 2024-09-17T04:20:54.022 INFO:tasks.workunit.client.1.smithi134.stdout:0/355: sync 2024-09-17T04:20:54.025 INFO:tasks.workunit.client.1.smithi134.stdout:9/771: chown d2/d5/d58/ff1 91734862 1 2024-09-17T04:20:54.025 INFO:tasks.workunit.client.1.smithi134.stdout:0/356: read - d11/d18/f5e zero size 2024-09-17T04:20:54.027 INFO:tasks.workunit.client.1.smithi134.stdout:9/772: dread - d2/d5/d9/df/fb8 zero size 2024-09-17T04:20:54.027 INFO:tasks.workunit.client.1.smithi134.stdout:4/458: creat d0/df/d35/d5c/f94 x:0 0 0 2024-09-17T04:20:54.029 INFO:tasks.workunit.client.1.smithi134.stdout:8/382: dwrite d4/d23/d60/d6b/f35 [0,4194304] 0 2024-09-17T04:20:54.030 INFO:tasks.workunit.client.1.smithi134.stdout:4/459: chown d0/df/d35/f89 44541134 1 2024-09-17T04:20:54.030 INFO:tasks.workunit.client.1.smithi134.stdout:3/457: dread de/d12/d15/f4d [0,4194304] 0 2024-09-17T04:20:54.030 INFO:tasks.workunit.client.1.smithi134.stdout:4/460: chown d0/d13/f8d 36231 1 2024-09-17T04:20:54.031 INFO:tasks.workunit.client.1.smithi134.stdout:0/357: fdatasync d11/f13 0 2024-09-17T04:20:54.032 INFO:tasks.workunit.client.1.smithi134.stdout:5/376: mkdir d0/d3a/d2b/d61/d7b 0 2024-09-17T04:20:54.038 INFO:tasks.workunit.client.1.smithi134.stdout:5/377: rmdir d0/d3a/d2b 39 2024-09-17T04:20:54.040 INFO:tasks.workunit.client.1.smithi134.stdout:0/358: dwrite d11/d19/d21/d37/f4b [0,4194304] 0 2024-09-17T04:20:54.041 INFO:tasks.workunit.client.1.smithi134.stdout:4/461: rename d0/df/f85 to d0/df/d1e/d73/f95 0 2024-09-17T04:20:54.042 INFO:tasks.workunit.client.1.smithi134.stdout:5/378: rmdir d0/da/d69/d41/d6d 39 2024-09-17T04:20:54.043 INFO:tasks.workunit.client.1.smithi134.stdout:4/462: fdatasync d0/f22 0 2024-09-17T04:20:54.045 INFO:tasks.workunit.client.1.smithi134.stdout:5/379: fsync d0/da/d2c/f4c 0 2024-09-17T04:20:54.045 INFO:tasks.workunit.client.1.smithi134.stdout:4/463: fdatasync d0/df/d17/f6d 0 2024-09-17T04:20:54.046 INFO:tasks.workunit.client.1.smithi134.stdout:9/773: dread d2/d5/d8/d16/f72 [0,4194304] 0 2024-09-17T04:20:54.047 INFO:tasks.workunit.client.1.smithi134.stdout:2/429: write d19/d27/d31/d34/d42/f5e [3462311,38418] 0 2024-09-17T04:20:54.053 INFO:tasks.workunit.client.1.smithi134.stdout:3/458: write de/f2a [1172036,67779] 0 2024-09-17T04:20:54.059 INFO:tasks.workunit.client.1.smithi134.stdout:3/459: dwrite de/d12/d22/f8e [0,4194304] 0 2024-09-17T04:20:54.062 INFO:tasks.workunit.client.1.smithi134.stdout:3/460: getdents de/d10 0 2024-09-17T04:20:54.064 INFO:tasks.workunit.client.1.smithi134.stdout:3/461: creat de/d10/d3d/f9a x:0 0 0 2024-09-17T04:20:54.065 INFO:tasks.workunit.client.1.smithi134.stdout:3/462: write de/d10/d3d/f9a [240214,5878] 0 2024-09-17T04:20:54.066 INFO:tasks.workunit.client.1.smithi134.stdout:3/463: dread - de/d10/f97 zero size 2024-09-17T04:20:54.066 INFO:tasks.workunit.client.1.smithi134.stdout:3/464: stat de/c75 0 2024-09-17T04:20:54.068 INFO:tasks.workunit.client.1.smithi134.stdout:3/465: truncate de/d12/d15/d1d/d2d/d31/f3e 2147449 0 2024-09-17T04:20:54.073 INFO:tasks.workunit.client.1.smithi134.stdout:3/466: dwrite de/f2a [0,4194304] 0 2024-09-17T04:20:54.078 INFO:tasks.workunit.client.1.smithi134.stdout:3/467: dwrite de/d67/f95 [0,4194304] 0 2024-09-17T04:20:54.085 INFO:tasks.workunit.client.1.smithi134.stdout:3/468: link de/d12/d15/l7a de/d10/d3d/d4f/l9b 0 2024-09-17T04:20:54.085 INFO:tasks.workunit.client.1.smithi134.stdout:3/469: fdatasync de/d10/d3d/f94 0 2024-09-17T04:20:54.085 INFO:tasks.workunit.client.1.smithi134.stdout:3/470: chown de/d12/d15/d1d/d2d/d31/d6a/c6e 22 1 2024-09-17T04:20:54.086 INFO:tasks.workunit.client.1.smithi134.stdout:3/471: readlink de/d12/l2f 0 2024-09-17T04:20:54.088 INFO:tasks.workunit.client.1.smithi134.stdout:3/472: unlink de/d12/d22/l58 0 2024-09-17T04:20:54.090 INFO:tasks.workunit.client.1.smithi134.stdout:3/473: dread de/d12/f3a [0,4194304] 0 2024-09-17T04:20:54.090 INFO:tasks.workunit.client.1.smithi134.stdout:3/474: fsync de/d10/d3d/f94 0 2024-09-17T04:20:54.091 INFO:tasks.workunit.client.1.smithi134.stdout:3/475: mknod de/c9c 0 2024-09-17T04:20:54.130 INFO:tasks.workunit.client.0.smithi088.stdout:6/77: sync 2024-09-17T04:20:54.155 INFO:tasks.workunit.client.1.smithi134.stdout:6/500: sync 2024-09-17T04:20:54.156 INFO:tasks.workunit.client.1.smithi134.stdout:1/428: sync 2024-09-17T04:20:54.156 INFO:tasks.workunit.client.1.smithi134.stdout:7/314: sync 2024-09-17T04:20:54.157 INFO:tasks.workunit.client.1.smithi134.stdout:7/315: dread - d0/dd/d3a/d3d/f61 zero size 2024-09-17T04:20:54.157 INFO:tasks.workunit.client.1.smithi134.stdout:6/501: dread - de/d19/d62/d7c/f7d zero size 2024-09-17T04:20:54.157 INFO:tasks.workunit.client.1.smithi134.stdout:6/502: stat de/d19/d1f/f57 0 2024-09-17T04:20:54.158 INFO:tasks.workunit.client.1.smithi134.stdout:7/316: mknod d0/d16/d35/d4b/c64 0 2024-09-17T04:20:54.159 INFO:tasks.workunit.client.1.smithi134.stdout:6/503: mkdir de/d19/d74/d94/d9e 0 2024-09-17T04:20:54.159 INFO:tasks.workunit.client.1.smithi134.stdout:7/317: fsync d0/f19 0 2024-09-17T04:20:54.161 INFO:tasks.workunit.client.1.smithi134.stdout:6/504: write de/d19/f3d [2611719,109218] 0 2024-09-17T04:20:54.161 INFO:tasks.workunit.client.1.smithi134.stdout:1/429: dwrite d12/d1c/f34 [0,4194304] 0 2024-09-17T04:20:54.168 INFO:tasks.workunit.client.1.smithi134.stdout:1/430: dwrite d12/d1c/d56/f70 [0,4194304] 0 2024-09-17T04:20:54.174 INFO:tasks.workunit.client.1.smithi134.stdout:3/476: sync 2024-09-17T04:20:54.174 INFO:tasks.workunit.client.1.smithi134.stdout:5/380: sync 2024-09-17T04:20:54.174 INFO:tasks.workunit.client.1.smithi134.stdout:8/383: sync 2024-09-17T04:20:54.175 INFO:tasks.workunit.client.1.smithi134.stdout:5/381: dread - d0/da/d2c/f70 zero size 2024-09-17T04:20:54.175 INFO:tasks.workunit.client.1.smithi134.stdout:8/384: write d4/d23/f6d [688707,80827] 0 2024-09-17T04:20:54.176 INFO:tasks.workunit.client.1.smithi134.stdout:8/385: dread - d4/d23/d60/d6b/d13/f61 zero size 2024-09-17T04:20:54.176 INFO:tasks.workunit.client.1.smithi134.stdout:3/477: mkdir de/d12/d9d 0 2024-09-17T04:20:54.177 INFO:tasks.workunit.client.1.smithi134.stdout:8/386: dread - d4/d1f/f71 zero size 2024-09-17T04:20:54.177 INFO:tasks.workunit.client.1.smithi134.stdout:5/382: mkdir d0/da/d29/d7c 0 2024-09-17T04:20:54.179 INFO:tasks.workunit.client.1.smithi134.stdout:5/383: fsync d0/d3a/d2b/f34 0 2024-09-17T04:20:54.181 INFO:tasks.workunit.client.1.smithi134.stdout:5/384: mknod d0/d3a/c7d 0 2024-09-17T04:20:54.187 INFO:tasks.workunit.client.1.smithi134.stdout:5/385: dwrite d0/d3a/f71 [0,4194304] 0 2024-09-17T04:20:54.190 INFO:tasks.workunit.client.1.smithi134.stdout:5/386: mknod d0/da/d69/d41/d72/c7e 0 2024-09-17T04:20:54.191 INFO:tasks.workunit.client.1.smithi134.stdout:5/387: creat d0/da/d69/d41/d6d/f7f x:0 0 0 2024-09-17T04:20:54.194 INFO:tasks.workunit.client.1.smithi134.stdout:5/388: creat d0/d48/f80 x:0 0 0 2024-09-17T04:20:54.199 INFO:tasks.workunit.client.1.smithi134.stdout:5/389: dwrite d0/da/f1e [0,4194304] 0 2024-09-17T04:20:54.201 INFO:tasks.workunit.client.1.smithi134.stdout:5/390: chown d0/da/d69/d41/f4d 129518436 1 2024-09-17T04:20:54.242 INFO:tasks.workunit.client.1.smithi134.stdout:0/359: dwrite d11/d22/d1c/d2f/d43/f44 [0,4194304] 0 2024-09-17T04:20:54.243 INFO:tasks.workunit.client.1.smithi134.stdout:0/360: chown d11/d22/c3f 39687331 1 2024-09-17T04:20:54.245 INFO:tasks.workunit.client.1.smithi134.stdout:9/774: truncate d2/d5/d37/fa3 3477897 0 2024-09-17T04:20:54.247 INFO:tasks.workunit.client.1.smithi134.stdout:1/431: read d12/d19/f25 [746293,115014] 0 2024-09-17T04:20:54.250 INFO:tasks.workunit.client.1.smithi134.stdout:5/391: sync 2024-09-17T04:20:54.250 INFO:tasks.workunit.client.1.smithi134.stdout:4/464: dwrite d0/df/d35/f71 [0,4194304] 0 2024-09-17T04:20:54.254 INFO:tasks.workunit.client.1.smithi134.stdout:1/432: rename c3 to d12/d1c/d2e/c92 0 2024-09-17T04:20:54.254 INFO:tasks.workunit.client.1.smithi134.stdout:0/361: dread fe [0,4194304] 0 2024-09-17T04:20:54.254 INFO:tasks.workunit.client.1.smithi134.stdout:2/430: dwrite d19/d1c/d47/d50/f7c [0,4194304] 0 2024-09-17T04:20:54.256 INFO:tasks.workunit.client.1.smithi134.stdout:4/465: unlink d0/df/d1e/f2b 0 2024-09-17T04:20:54.260 INFO:tasks.workunit.client.1.smithi134.stdout:5/392: creat d0/da/d29/d7c/f81 x:0 0 0 2024-09-17T04:20:54.260 INFO:tasks.workunit.client.1.smithi134.stdout:0/362: write fe [472315,88152] 0 2024-09-17T04:20:54.261 INFO:tasks.workunit.client.1.smithi134.stdout:5/393: stat d0/da/d69/l5f 0 2024-09-17T04:20:54.261 INFO:tasks.workunit.client.1.smithi134.stdout:1/433: symlink d12/d1c/d2e/l93 0 2024-09-17T04:20:54.263 INFO:tasks.workunit.client.1.smithi134.stdout:2/431: unlink d19/d27/d31/l48 0 2024-09-17T04:20:54.264 INFO:tasks.workunit.client.1.smithi134.stdout:0/363: fdatasync d11/d24/d49/f5b 0 2024-09-17T04:20:54.265 INFO:tasks.workunit.client.1.smithi134.stdout:1/434: read d12/d19/d1d/f6b [3728572,52516] 0 2024-09-17T04:20:54.266 INFO:tasks.workunit.client.1.smithi134.stdout:5/394: rename d0/da/f6c to d0/d48/f82 0 2024-09-17T04:20:54.267 INFO:tasks.workunit.client.1.smithi134.stdout:0/364: read d11/d18/f57 [574098,29596] 0 2024-09-17T04:20:54.268 INFO:tasks.workunit.client.1.smithi134.stdout:5/395: write d0/d48/f80 [374864,128870] 0 2024-09-17T04:20:54.271 INFO:tasks.workunit.client.0.smithi088.stdout:6/78: truncate f10 3170853 0 2024-09-17T04:20:54.271 INFO:tasks.workunit.client.0.smithi088.stdout:6/79: stat f11 0 2024-09-17T04:20:54.274 INFO:tasks.workunit.client.1.smithi134.stdout:6/505: truncate de/f12 1555202 0 2024-09-17T04:20:54.275 INFO:tasks.workunit.client.1.smithi134.stdout:6/506: chown de/d19/d21/c78 42578484 1 2024-09-17T04:20:54.275 INFO:tasks.workunit.client.1.smithi134.stdout:0/365: rename d11/d22/d1c/d2f/f66 to d11/d24/f7e 0 2024-09-17T04:20:54.276 INFO:tasks.workunit.client.1.smithi134.stdout:6/507: dread - de/d19/d21/d2d/f5b zero size 2024-09-17T04:20:54.276 INFO:tasks.workunit.client.1.smithi134.stdout:6/508: write fb [2172841,52878] 0 2024-09-17T04:20:54.277 INFO:tasks.workunit.client.1.smithi134.stdout:6/509: chown de/d19/f3d 10 1 2024-09-17T04:20:54.278 INFO:tasks.workunit.client.1.smithi134.stdout:1/435: mknod d12/d1c/d2e/d7d/c94 0 2024-09-17T04:20:54.282 INFO:tasks.workunit.client.1.smithi134.stdout:6/510: dwrite de/d2b/f70 [0,4194304] 0 2024-09-17T04:20:54.282 INFO:tasks.workunit.client.1.smithi134.stdout:8/387: fdatasync d4/d23/f6d 0 2024-09-17T04:20:54.283 INFO:tasks.workunit.client.1.smithi134.stdout:7/318: truncate d0/dd/d3a/d3d/d38/f1d 1437483 0 2024-09-17T04:20:54.293 INFO:tasks.workunit.client.0.smithi088.stdout:3/20: sync 2024-09-17T04:20:54.297 INFO:tasks.workunit.client.0.smithi088.stdout:3/21: link d0/f1 d0/f3 0 2024-09-17T04:20:54.310 INFO:tasks.workunit.client.1.smithi134.stdout:6/511: creat de/d2b/f9f x:0 0 0 2024-09-17T04:20:54.311 INFO:tasks.workunit.client.1.smithi134.stdout:5/396: getdents d0/da/d29 0 2024-09-17T04:20:54.311 INFO:tasks.workunit.client.1.smithi134.stdout:7/319: mkdir d0/d16/d35/d4b/d65 0 2024-09-17T04:20:54.312 INFO:tasks.workunit.client.0.smithi088.stdout:6/80: dwrite f9 [0,4194304] 0 2024-09-17T04:20:54.312 INFO:tasks.workunit.client.1.smithi134.stdout:8/388: dwrite d4/d1f/d2b/f2f [0,4194304] 0 2024-09-17T04:20:54.315 INFO:tasks.workunit.client.1.smithi134.stdout:7/320: dread - d0/dd/d3a/f4f zero size 2024-09-17T04:20:54.317 INFO:tasks.workunit.client.0.smithi088.stdout:6/81: dread f9 [0,4194304] 0 2024-09-17T04:20:54.318 INFO:tasks.workunit.client.1.smithi134.stdout:5/397: truncate d0/da/d69/f53 1418076 0 2024-09-17T04:20:54.318 INFO:tasks.workunit.client.0.smithi088.stdout:6/82: readlink d14/l1b 0 2024-09-17T04:20:54.318 INFO:tasks.workunit.client.1.smithi134.stdout:9/775: truncate d2/d7/d75/d96/fce 2918582 0 2024-09-17T04:20:54.321 INFO:tasks.workunit.client.1.smithi134.stdout:5/398: readlink d0/da/d69/l1d 0 2024-09-17T04:20:54.321 INFO:tasks.workunit.client.1.smithi134.stdout:3/478: dwrite de/d12/d22/f8e [4194304,4194304] 0 2024-09-17T04:20:54.322 INFO:tasks.workunit.client.0.smithi088.stdout:3/22: dwrite d0/f2 [0,4194304] 0 2024-09-17T04:20:54.324 INFO:tasks.workunit.client.1.smithi134.stdout:0/366: getdents d11/d19/d21 0 2024-09-17T04:20:54.326 INFO:tasks.workunit.client.1.smithi134.stdout:2/432: write d19/d27/f32 [732043,71360] 0 2024-09-17T04:20:54.327 INFO:tasks.workunit.client.1.smithi134.stdout:6/512: rmdir de/d19/d74/d94 39 2024-09-17T04:20:54.327 INFO:tasks.workunit.client.0.smithi088.stdout:3/23: stat d0/f3 0 2024-09-17T04:20:54.328 INFO:tasks.workunit.client.1.smithi134.stdout:8/389: symlink d4/l79 0 2024-09-17T04:20:54.329 INFO:tasks.workunit.client.1.smithi134.stdout:7/321: rename d0/dd/d3a/d3d/l4e to d0/d16/d35/d4b/d65/l66 0 2024-09-17T04:20:54.330 INFO:tasks.workunit.client.1.smithi134.stdout:5/399: fsync d0/d3a/d2b/f34 0 2024-09-17T04:20:54.332 INFO:tasks.workunit.client.1.smithi134.stdout:6/513: creat de/d2b/fa0 x:0 0 0 2024-09-17T04:20:54.333 INFO:tasks.workunit.client.1.smithi134.stdout:2/433: symlink d19/d27/d31/d34/d6d/l8b 0 2024-09-17T04:20:54.333 INFO:tasks.workunit.client.1.smithi134.stdout:8/390: creat d4/d11/f7a x:0 0 0 2024-09-17T04:20:54.334 INFO:tasks.workunit.client.0.smithi088.stdout:3/24: dwrite d0/f2 [0,4194304] 0 2024-09-17T04:20:54.334 INFO:tasks.workunit.client.1.smithi134.stdout:6/514: chown de/d19/d1f/d85/d88 1734 1 2024-09-17T04:20:54.335 INFO:tasks.workunit.client.1.smithi134.stdout:8/391: stat d4/d11/l76 0 2024-09-17T04:20:54.335 INFO:tasks.workunit.client.1.smithi134.stdout:2/434: write d19/d27/d31/f5c [4936608,90224] 0 2024-09-17T04:20:54.335 INFO:tasks.workunit.client.1.smithi134.stdout:3/479: chown de/d10/d3d/f9a 653 1 2024-09-17T04:20:54.337 INFO:tasks.workunit.client.1.smithi134.stdout:7/322: dwrite d0/d16/d35/f40 [0,4194304] 0 2024-09-17T04:20:54.337 INFO:tasks.workunit.client.0.smithi088.stdout:3/25: unlink d0/f1 0 2024-09-17T04:20:54.338 INFO:tasks.workunit.client.1.smithi134.stdout:6/515: dread - de/d19/d21/d2d/d4c/f83 zero size 2024-09-17T04:20:54.338 INFO:tasks.workunit.client.1.smithi134.stdout:5/400: symlink d0/d3a/d2b/d61/l83 0 2024-09-17T04:20:54.342 INFO:tasks.workunit.client.1.smithi134.stdout:9/776: link d2/d5/d8/cb1 d2/d5/d58/db5/c103 0 2024-09-17T04:20:54.343 INFO:tasks.workunit.client.0.smithi088.stdout:3/26: link d0/f3 d0/f4 0 2024-09-17T04:20:54.343 INFO:tasks.workunit.client.1.smithi134.stdout:0/367: creat d11/f7f x:0 0 0 2024-09-17T04:20:54.345 INFO:tasks.workunit.client.1.smithi134.stdout:9/777: fsync d2/d25/ff6 0 2024-09-17T04:20:54.348 INFO:tasks.workunit.client.1.smithi134.stdout:0/368: creat d11/d22/d1c/f80 x:0 0 0 2024-09-17T04:20:54.350 INFO:tasks.workunit.client.1.smithi134.stdout:6/516: rename de/d19/d7b/f8d to de/d19/fa1 0 2024-09-17T04:20:54.351 INFO:tasks.workunit.client.1.smithi134.stdout:9/778: chown d2/d5/d9/d6b/de1/lac 2975111 1 2024-09-17T04:20:54.351 INFO:tasks.workunit.client.1.smithi134.stdout:0/369: rmdir d11/d19 39 2024-09-17T04:20:54.352 INFO:tasks.workunit.client.1.smithi134.stdout:6/517: readlink la 0 2024-09-17T04:20:54.354 INFO:tasks.workunit.client.1.smithi134.stdout:9/779: unlink d2/d7/f2f 0 2024-09-17T04:20:54.354 INFO:tasks.workunit.client.1.smithi134.stdout:7/323: dwrite d0/dd/d3a/d3d/f56 [0,4194304] 0 2024-09-17T04:20:54.354 INFO:tasks.workunit.client.1.smithi134.stdout:3/480: dwrite de/d12/d15/d1d/d2d/d63/d77/f92 [4194304,4194304] 0 2024-09-17T04:20:54.356 INFO:tasks.workunit.client.1.smithi134.stdout:0/370: mkdir d11/d22/d1c/d81 0 2024-09-17T04:20:54.356 INFO:tasks.workunit.client.1.smithi134.stdout:7/324: write d0/dd/d3a/d3d/f41 [284304,115430] 0 2024-09-17T04:20:54.357 INFO:tasks.workunit.client.1.smithi134.stdout:0/371: chown fe 5462415 1 2024-09-17T04:20:54.362 INFO:tasks.workunit.client.1.smithi134.stdout:4/466: sync 2024-09-17T04:20:54.365 INFO:tasks.workunit.client.1.smithi134.stdout:3/481: getdents de/d12/d15/d1d/d2d/d31/d6a/d78 0 2024-09-17T04:20:54.367 INFO:tasks.workunit.client.1.smithi134.stdout:7/325: link d0/dd/d3a/d3d/d38/c29 d0/dd/d3a/d3d/d4c/c67 0 2024-09-17T04:20:54.371 INFO:tasks.workunit.client.1.smithi134.stdout:6/518: dwrite de/d19/fa1 [0,4194304] 0 2024-09-17T04:20:54.372 INFO:tasks.workunit.client.1.smithi134.stdout:3/482: dread de/d10/d3d/f9a [0,4194304] 0 2024-09-17T04:20:54.373 INFO:tasks.workunit.client.1.smithi134.stdout:9/780: dwrite d2/d7/d75/d96/dca/feb [0,4194304] 0 2024-09-17T04:20:54.375 INFO:tasks.workunit.client.1.smithi134.stdout:3/483: dread - de/d10/f97 zero size 2024-09-17T04:20:54.380 INFO:tasks.workunit.client.1.smithi134.stdout:6/519: creat de/d19/d1f/d5c/fa2 x:0 0 0 2024-09-17T04:20:54.380 INFO:tasks.workunit.client.1.smithi134.stdout:4/467: dwrite d0/df/f31 [0,4194304] 0 2024-09-17T04:20:54.380 INFO:tasks.workunit.client.1.smithi134.stdout:3/484: write de/d10/f2e [4019437,54259] 0 2024-09-17T04:20:54.382 INFO:tasks.workunit.client.1.smithi134.stdout:9/781: mkdir d2/d5/d8/d16/d54/daf/d6d/daa/d104 0 2024-09-17T04:20:54.382 INFO:tasks.workunit.client.1.smithi134.stdout:6/520: dread - de/d2b/fa0 zero size 2024-09-17T04:20:54.385 INFO:tasks.workunit.client.1.smithi134.stdout:9/782: mknod d2/d5/d8/d16/d54/daf/c105 0 2024-09-17T04:20:54.386 INFO:tasks.workunit.client.1.smithi134.stdout:6/521: mkdir de/d19/da3 0 2024-09-17T04:20:54.386 INFO:tasks.workunit.client.1.smithi134.stdout:9/783: chown d2/d5/d37/lc2 0 1 2024-09-17T04:20:54.389 INFO:tasks.workunit.client.1.smithi134.stdout:6/522: creat de/d19/d21/d4d/fa4 x:0 0 0 2024-09-17T04:20:54.389 INFO:tasks.workunit.client.1.smithi134.stdout:3/485: dwrite de/d10/d70/f87 [0,4194304] 0 2024-09-17T04:20:54.390 INFO:tasks.workunit.client.1.smithi134.stdout:9/784: chown d2/d5/d8/d16/d54/daf/d6d/daa/de2/dcd/fae 421417 1 2024-09-17T04:20:54.391 INFO:tasks.workunit.client.1.smithi134.stdout:3/486: truncate de/d10/f97 805072 0 2024-09-17T04:20:54.393 INFO:tasks.workunit.client.1.smithi134.stdout:3/487: write de/d12/d15/d1d/d2d/f36 [346880,64706] 0 2024-09-17T04:20:54.393 INFO:tasks.workunit.client.1.smithi134.stdout:6/523: stat de/d19/d1f/d55/d77/c91 0 2024-09-17T04:20:54.393 INFO:tasks.workunit.client.1.smithi134.stdout:9/785: mknod d2/d5/d8/d16/d54/daf/ded/c106 0 2024-09-17T04:20:54.395 INFO:tasks.workunit.client.1.smithi134.stdout:9/786: stat d2/d5/d9/lc1 0 2024-09-17T04:20:54.396 INFO:tasks.workunit.client.1.smithi134.stdout:3/488: write de/d10/f97 [186511,94734] 0 2024-09-17T04:20:54.396 INFO:tasks.workunit.client.1.smithi134.stdout:6/524: mkdir de/da5 0 2024-09-17T04:20:54.397 INFO:tasks.workunit.client.1.smithi134.stdout:9/787: symlink d2/d5/d37/l107 0 2024-09-17T04:20:54.399 INFO:tasks.workunit.client.1.smithi134.stdout:3/489: creat de/d12/d22/d5a/f9e x:0 0 0 2024-09-17T04:20:54.400 INFO:tasks.workunit.client.1.smithi134.stdout:9/788: rename d2/d7/c94 to d2/d5/d37/d7c/c108 0 2024-09-17T04:20:54.402 INFO:tasks.workunit.client.1.smithi134.stdout:6/525: link de/l49 de/d19/d1f/la6 0 2024-09-17T04:20:54.404 INFO:tasks.workunit.client.1.smithi134.stdout:6/526: dread - de/d19/d62/d7c/f7d zero size 2024-09-17T04:20:54.404 INFO:tasks.workunit.client.1.smithi134.stdout:9/789: write d2/d5/d8/d16/d54/daf/d6d/daa/de2/dcd/fae [324630,130288] 0 2024-09-17T04:20:54.404 INFO:tasks.workunit.client.1.smithi134.stdout:3/490: dwrite de/d12/d15/d1d/f62 [0,4194304] 0 2024-09-17T04:20:54.406 INFO:tasks.workunit.client.1.smithi134.stdout:1/436: sync 2024-09-17T04:20:54.407 INFO:tasks.workunit.client.1.smithi134.stdout:6/527: creat de/d19/d1f/d85/fa7 x:0 0 0 2024-09-17T04:20:54.409 INFO:tasks.workunit.client.1.smithi134.stdout:9/790: creat d2/d5/d9/f109 x:0 0 0 2024-09-17T04:20:54.410 INFO:tasks.workunit.client.1.smithi134.stdout:1/437: unlink d12/d1c/d2e/l93 0 2024-09-17T04:20:54.411 INFO:tasks.workunit.client.1.smithi134.stdout:6/528: chown de/d2b/f9f 13566246 1 2024-09-17T04:20:54.413 INFO:tasks.workunit.client.1.smithi134.stdout:1/438: creat d12/d19/d5d/f95 x:0 0 0 2024-09-17T04:20:54.414 INFO:tasks.workunit.client.1.smithi134.stdout:3/491: dwrite de/d12/d22/d5a/f71 [0,4194304] 0 2024-09-17T04:20:54.415 INFO:tasks.workunit.client.1.smithi134.stdout:6/529: rename de/d19/f3d to de/d19/d62/fa8 0 2024-09-17T04:20:54.416 INFO:tasks.workunit.client.0.smithi088.stdout:2/76: sync 2024-09-17T04:20:54.416 INFO:tasks.workunit.client.0.smithi088.stdout:0/41: sync 2024-09-17T04:20:54.416 INFO:tasks.workunit.client.1.smithi134.stdout:1/439: mknod d12/d19/d1d/d3e/c96 0 2024-09-17T04:20:54.417 INFO:tasks.workunit.client.0.smithi088.stdout:2/77: fdatasync d0/d1/f2 0 2024-09-17T04:20:54.417 INFO:tasks.workunit.client.1.smithi134.stdout:1/440: fdatasync d12/d19/d1d/d3e/f48 0 2024-09-17T04:20:54.420 INFO:tasks.workunit.client.1.smithi134.stdout:1/441: write d12/d19/d1d/f44 [983552,37430] 0 2024-09-17T04:20:54.421 INFO:tasks.workunit.client.0.smithi088.stdout:2/78: creat d0/d18/f19 x:0 0 0 2024-09-17T04:20:54.422 INFO:tasks.workunit.client.0.smithi088.stdout:2/79: dread - d0/fd zero size 2024-09-17T04:20:54.423 INFO:tasks.workunit.client.0.smithi088.stdout:2/80: fsync d0/d1/fe 0 2024-09-17T04:20:54.423 INFO:tasks.workunit.client.1.smithi134.stdout:3/492: getdents de/d10/d70 0 2024-09-17T04:20:54.426 INFO:tasks.workunit.client.1.smithi134.stdout:1/442: dwrite d12/d19/d5c/f6f [0,4194304] 0 2024-09-17T04:20:54.428 INFO:tasks.workunit.client.0.smithi088.stdout:2/81: dread d0/f12 [0,4194304] 0 2024-09-17T04:20:54.429 INFO:tasks.workunit.client.0.smithi088.stdout:2/82: fsync d0/d1/f3 0 2024-09-17T04:20:54.430 INFO:tasks.workunit.client.1.smithi134.stdout:3/493: rmdir de/d12/d15/d1d/d8f 39 2024-09-17T04:20:54.430 INFO:tasks.workunit.client.1.smithi134.stdout:1/443: readlink d12/d19/d1d/d61/l79 0 2024-09-17T04:20:54.431 INFO:tasks.workunit.client.1.smithi134.stdout:3/494: write de/d12/d22/d5a/f9e [374035,71520] 0 2024-09-17T04:20:54.434 INFO:tasks.workunit.client.1.smithi134.stdout:1/444: unlink d12/d1c/d4a/c81 0 2024-09-17T04:20:54.435 INFO:tasks.workunit.client.0.smithi088.stdout:2/83: symlink d0/d14/d17/l1a 0 2024-09-17T04:20:54.437 INFO:tasks.workunit.client.1.smithi134.stdout:3/495: mkdir de/d12/d15/d9f 0 2024-09-17T04:20:54.438 INFO:tasks.workunit.client.1.smithi134.stdout:3/496: stat de/d12/d15/d1d/f54 0 2024-09-17T04:20:54.441 INFO:tasks.workunit.client.1.smithi134.stdout:3/497: symlink de/d12/d15/d1d/d2d/d31/d6a/la0 0 2024-09-17T04:20:54.444 INFO:tasks.workunit.client.1.smithi134.stdout:3/498: rename de/c80 to de/d12/d15/d1d/d2d/d63/ca1 0 2024-09-17T04:20:54.451 INFO:tasks.workunit.client.1.smithi134.stdout:3/499: mkdir de/d10/d3d/da2 0 2024-09-17T04:20:54.453 INFO:tasks.workunit.client.1.smithi134.stdout:3/500: symlink de/d12/d22/d5a/la3 0 2024-09-17T04:20:54.458 INFO:tasks.workunit.client.1.smithi134.stdout:3/501: dwrite de/d10/d70/f87 [0,4194304] 0 2024-09-17T04:20:54.458 INFO:tasks.workunit.client.1.smithi134.stdout:3/502: stat de/d12/d15/d1d/f62 0 2024-09-17T04:20:54.465 INFO:tasks.workunit.client.1.smithi134.stdout:3/503: symlink de/d12/d15/d1d/la4 0 2024-09-17T04:20:54.465 INFO:tasks.workunit.client.0.smithi088.stdout:3/27: write d0/f4 [595377,16793] 0 2024-09-17T04:20:54.466 INFO:tasks.workunit.client.1.smithi134.stdout:2/435: truncate d19/d27/f5b 6181054 0 2024-09-17T04:20:54.467 INFO:tasks.workunit.client.1.smithi134.stdout:8/392: dwrite d4/d23/d60/d6b/d13/f73 [0,4194304] 0 2024-09-17T04:20:54.469 INFO:tasks.workunit.client.1.smithi134.stdout:8/393: dread - d4/d23/d60/d6b/d5e/f66 zero size 2024-09-17T04:20:54.474 INFO:tasks.workunit.client.1.smithi134.stdout:5/401: truncate d0/da/d2c/f37 3527145 0 2024-09-17T04:20:54.476 INFO:tasks.workunit.client.1.smithi134.stdout:9/791: sync 2024-09-17T04:20:54.476 INFO:tasks.workunit.client.1.smithi134.stdout:5/402: write d0/d48/f4f [4667404,88000] 0 2024-09-17T04:20:54.478 INFO:tasks.workunit.client.1.smithi134.stdout:3/504: dwrite de/d10/f97 [0,4194304] 0 2024-09-17T04:20:54.479 INFO:tasks.workunit.client.1.smithi134.stdout:7/326: write d0/f20 [263565,23456] 0 2024-09-17T04:20:54.483 INFO:tasks.workunit.client.1.smithi134.stdout:4/468: write d0/d3b/f74 [70299,70323] 0 2024-09-17T04:20:54.486 INFO:tasks.workunit.client.1.smithi134.stdout:9/792: mkdir d2/d7/d10a 0 2024-09-17T04:20:54.488 INFO:tasks.workunit.client.1.smithi134.stdout:5/403: creat d0/da/d29/f84 x:0 0 0 2024-09-17T04:20:54.489 INFO:tasks.workunit.client.1.smithi134.stdout:8/394: dwrite d4/db/dd/f2e [0,4194304] 0 2024-09-17T04:20:54.489 INFO:tasks.workunit.client.1.smithi134.stdout:3/505: creat de/d12/d15/d1d/d2d/fa5 x:0 0 0 2024-09-17T04:20:54.489 INFO:tasks.workunit.client.1.smithi134.stdout:5/404: readlink d0/l56 0 2024-09-17T04:20:54.490 INFO:tasks.workunit.client.1.smithi134.stdout:0/372: dwrite d11/d18/f36 [0,4194304] 0 2024-09-17T04:20:54.491 INFO:tasks.workunit.client.1.smithi134.stdout:2/436: symlink d19/d1c/d47/d50/d85/l8c 0 2024-09-17T04:20:54.494 INFO:tasks.workunit.client.1.smithi134.stdout:8/395: truncate d4/db/f2d 1297949 0 2024-09-17T04:20:54.494 INFO:tasks.workunit.client.1.smithi134.stdout:4/469: unlink d0/d13/d40/d42/d92/f26 0 2024-09-17T04:20:54.495 INFO:tasks.workunit.client.1.smithi134.stdout:7/327: mknod d0/dd/d3a/c68 0 2024-09-17T04:20:54.497 INFO:tasks.workunit.client.1.smithi134.stdout:4/470: write d0/d13/d40/d42/f87 [953618,11247] 0 2024-09-17T04:20:54.498 INFO:tasks.workunit.client.1.smithi134.stdout:4/471: readlink d0/l23 0 2024-09-17T04:20:54.500 INFO:tasks.workunit.client.1.smithi134.stdout:6/530: write de/f53 [1803706,106059] 0 2024-09-17T04:20:54.502 INFO:tasks.workunit.client.1.smithi134.stdout:0/373: mknod d11/d22/d1c/d2f/c82 0 2024-09-17T04:20:54.503 INFO:tasks.workunit.client.1.smithi134.stdout:3/506: dwrite de/d12/d15/d1d/f54 [0,4194304] 0 2024-09-17T04:20:54.503 INFO:tasks.workunit.client.1.smithi134.stdout:4/472: write d0/d13/d40/d42/d92/f21 [72,111802] 0 2024-09-17T04:20:54.504 INFO:tasks.workunit.client.1.smithi134.stdout:4/473: stat d0/l30 0 2024-09-17T04:20:54.505 INFO:tasks.workunit.client.1.smithi134.stdout:8/396: creat d4/d1f/d2b/f7b x:0 0 0 2024-09-17T04:20:54.506 INFO:tasks.workunit.client.1.smithi134.stdout:7/328: creat d0/d16/d35/d4b/f69 x:0 0 0 2024-09-17T04:20:54.506 INFO:tasks.workunit.client.1.smithi134.stdout:0/374: chown d11/d22/d1c/d2f/d45 236204 1 2024-09-17T04:20:54.509 INFO:tasks.workunit.client.0.smithi088.stdout:0/42: dwrite f5 [0,4194304] 0 2024-09-17T04:20:54.509 INFO:tasks.workunit.client.1.smithi134.stdout:4/474: write d0/df/d35/f89 [701027,93064] 0 2024-09-17T04:20:54.510 INFO:tasks.workunit.client.1.smithi134.stdout:9/793: creat d2/d5/f10b x:0 0 0 2024-09-17T04:20:54.514 INFO:tasks.workunit.client.1.smithi134.stdout:9/794: chown d2/d5/d9/d6b/de1/lb6 68868 1 2024-09-17T04:20:54.515 INFO:tasks.workunit.client.1.smithi134.stdout:3/507: symlink de/d10/d3d/d4f/la6 0 2024-09-17T04:20:54.516 INFO:tasks.workunit.client.1.smithi134.stdout:7/329: truncate d0/dd/f58 1041646 0 2024-09-17T04:20:54.517 INFO:tasks.workunit.client.1.smithi134.stdout:1/445: truncate d12/f90 3667932 0 2024-09-17T04:20:54.517 INFO:tasks.workunit.client.1.smithi134.stdout:6/531: dread de/d19/d21/d2d/f2f [0,4194304] 0 2024-09-17T04:20:54.520 INFO:tasks.workunit.client.1.smithi134.stdout:8/397: dread d4/d23/d60/d6b/d13/f73 [0,4194304] 0 2024-09-17T04:20:54.520 INFO:tasks.workunit.client.1.smithi134.stdout:3/508: dread - de/d10/f79 zero size 2024-09-17T04:20:54.520 INFO:tasks.workunit.client.1.smithi134.stdout:9/795: write d2/d5/d37/d7c/ffa [759232,15705] 0 2024-09-17T04:20:54.520 INFO:tasks.workunit.client.1.smithi134.stdout:7/330: stat d0/d16/d35/f49 0 2024-09-17T04:20:54.521 INFO:tasks.workunit.client.0.smithi088.stdout:0/43: dwrite db/fc [4194304,4194304] 0 2024-09-17T04:20:54.522 INFO:tasks.workunit.client.1.smithi134.stdout:4/475: symlink d0/df/d1e/d73/l96 0 2024-09-17T04:20:54.526 INFO:tasks.workunit.client.0.smithi088.stdout:0/44: dread f0 [0,4194304] 0 2024-09-17T04:20:54.528 INFO:tasks.workunit.client.1.smithi134.stdout:4/476: write d0/d13/d40/d42/d92/f45 [3034813,56672] 0 2024-09-17T04:20:54.536 INFO:tasks.workunit.client.0.smithi088.stdout:0/45: rename l8 to db/lf 0 2024-09-17T04:20:54.537 INFO:tasks.workunit.client.1.smithi134.stdout:0/375: getdents d11/d22 0 2024-09-17T04:20:54.538 INFO:tasks.workunit.client.0.smithi088.stdout:3/28: symlink d0/l5 0 2024-09-17T04:20:54.540 INFO:tasks.workunit.client.1.smithi134.stdout:8/398: dwrite d4/db/dd/f5b [0,4194304] 0 2024-09-17T04:20:54.540 INFO:tasks.workunit.client.1.smithi134.stdout:2/437: dread d19/d1c/f1d [0,4194304] 0 2024-09-17T04:20:54.540 INFO:tasks.workunit.client.1.smithi134.stdout:7/331: dwrite d0/d16/d35/d4b/f48 [4194304,4194304] 0 2024-09-17T04:20:54.541 INFO:tasks.workunit.client.0.smithi088.stdout:0/46: rename f9 to db/f10 0 2024-09-17T04:20:54.543 INFO:tasks.workunit.client.1.smithi134.stdout:8/399: chown d4/d23/d60/d6b/d13/f40 4094747 1 2024-09-17T04:20:54.545 INFO:tasks.workunit.client.0.smithi088.stdout:8/82: sync 2024-09-17T04:20:54.546 INFO:tasks.workunit.client.0.smithi088.stdout:7/124: sync 2024-09-17T04:20:54.546 INFO:tasks.workunit.client.0.smithi088.stdout:4/99: sync 2024-09-17T04:20:54.547 INFO:tasks.workunit.client.0.smithi088.stdout:4/100: chown d5/c16 16497092 1 2024-09-17T04:20:54.552 INFO:tasks.workunit.client.0.smithi088.stdout:7/125: symlink d2/d1d/l27 0 2024-09-17T04:20:54.553 INFO:tasks.workunit.client.1.smithi134.stdout:5/405: write d0/d3a/d2b/f34 [1141596,89121] 0 2024-09-17T04:20:54.554 INFO:tasks.workunit.client.1.smithi134.stdout:6/532: dread de/d19/d62/d34/f3c [0,4194304] 0 2024-09-17T04:20:54.555 INFO:tasks.workunit.client.0.smithi088.stdout:3/29: dwrite d0/f4 [0,4194304] 0 2024-09-17T04:20:54.557 INFO:tasks.workunit.client.1.smithi134.stdout:1/446: link d12/d19/f64 d12/d1c/d2e/d7d/f97 0 2024-09-17T04:20:54.557 INFO:tasks.workunit.client.1.smithi134.stdout:1/447: write d12/f86 [837464,78133] 0 2024-09-17T04:20:54.559 INFO:tasks.workunit.client.0.smithi088.stdout:0/47: dwrite db/f10 [0,4194304] 0 2024-09-17T04:20:54.560 INFO:tasks.workunit.client.0.smithi088.stdout:4/101: write d5/f10 [24270,29004] 0 2024-09-17T04:20:54.563 INFO:tasks.workunit.client.0.smithi088.stdout:7/126: dread d2/d4/f18 [0,4194304] 0 2024-09-17T04:20:54.565 INFO:tasks.workunit.client.1.smithi134.stdout:7/332: rename d0/dd/d3a/d51 to d0/dd/d57/d6a 0 2024-09-17T04:20:54.568 INFO:tasks.workunit.client.0.smithi088.stdout:9/124: sync 2024-09-17T04:20:54.568 INFO:tasks.workunit.client.0.smithi088.stdout:5/114: sync 2024-09-17T04:20:54.568 INFO:tasks.workunit.client.0.smithi088.stdout:1/116: sync 2024-09-17T04:20:54.568 INFO:tasks.workunit.client.0.smithi088.stdout:7/127: dread d2/d4/f14 [0,4194304] 0 2024-09-17T04:20:54.569 INFO:tasks.workunit.client.0.smithi088.stdout:9/125: chown d2/dd/f1b 1835 1 2024-09-17T04:20:54.575 INFO:tasks.workunit.client.1.smithi134.stdout:9/796: link d2/d5/d8/d16/d54/daf/d6d/daa/de2/dcd/fb4 d2/d5/d37/d83/da7/f10c 0 2024-09-17T04:20:54.576 INFO:tasks.workunit.client.0.smithi088.stdout:2/84: sync 2024-09-17T04:20:54.576 INFO:tasks.workunit.client.1.smithi134.stdout:9/797: write d2/d78/fc6 [3960277,725] 0 2024-09-17T04:20:54.576 INFO:tasks.workunit.client.1.smithi134.stdout:9/798: chown d2/d5/d37/l46 914147 1 2024-09-17T04:20:54.578 INFO:tasks.workunit.client.0.smithi088.stdout:4/102: rename d5/lf to d5/l1c 0 2024-09-17T04:20:54.578 INFO:tasks.workunit.client.1.smithi134.stdout:5/406: creat d0/da/d29/f85 x:0 0 0 2024-09-17T04:20:54.580 INFO:tasks.workunit.client.1.smithi134.stdout:6/533: mkdir de/d19/d1f/d55/da9 0 2024-09-17T04:20:54.581 INFO:tasks.workunit.client.0.smithi088.stdout:3/30: dwrite d0/f3 [0,4194304] 0 2024-09-17T04:20:54.583 INFO:tasks.workunit.client.0.smithi088.stdout:3/31: chown d0 0 1 2024-09-17T04:20:54.590 INFO:tasks.workunit.client.0.smithi088.stdout:1/117: mkdir d0/d1/d27 0 2024-09-17T04:20:54.590 INFO:tasks.workunit.client.0.smithi088.stdout:7/128: dwrite d2/f3 [8388608,4194304] 0 2024-09-17T04:20:54.591 INFO:tasks.workunit.client.0.smithi088.stdout:6/83: dwrite f10 [0,4194304] 0 2024-09-17T04:20:54.593 INFO:tasks.workunit.client.1.smithi134.stdout:3/509: getdents de/d12/d15/d1d/d2d 0 2024-09-17T04:20:54.596 INFO:tasks.workunit.client.0.smithi088.stdout:7/129: readlink d2/d4/d7/l1c 0 2024-09-17T04:20:54.596 INFO:tasks.workunit.client.1.smithi134.stdout:8/400: symlink d4/d1f/l7c 0 2024-09-17T04:20:54.597 INFO:tasks.workunit.client.1.smithi134.stdout:7/333: dwrite d0/dd/f54 [0,4194304] 0 2024-09-17T04:20:54.598 INFO:tasks.workunit.client.0.smithi088.stdout:2/85: dread d0/d1/fe [0,4194304] 0 2024-09-17T04:20:54.601 INFO:tasks.workunit.client.1.smithi134.stdout:9/799: rmdir d2/d5/d8/d16/d54/daf/d6d 39 2024-09-17T04:20:54.602 INFO:tasks.workunit.client.0.smithi088.stdout:0/48: dwrite db/fd [0,4194304] 0 2024-09-17T04:20:54.603 INFO:tasks.workunit.client.0.smithi088.stdout:2/86: write d0/f9 [24105,108164] 0 2024-09-17T04:20:54.605 INFO:tasks.workunit.client.1.smithi134.stdout:4/477: truncate d0/df/d1e/d73/f95 3507080 0 2024-09-17T04:20:54.606 INFO:tasks.workunit.client.0.smithi088.stdout:8/83: dwrite d7/f9 [4194304,4194304] 0 2024-09-17T04:20:54.607 INFO:tasks.workunit.client.0.smithi088.stdout:2/87: write d0/d1/f2 [4829838,109148] 0 2024-09-17T04:20:54.609 INFO:tasks.workunit.client.0.smithi088.stdout:6/84: unlink f5 0 2024-09-17T04:20:54.610 INFO:tasks.workunit.client.1.smithi134.stdout:5/407: read d0/f2a [35419,95615] 0 2024-09-17T04:20:54.611 INFO:tasks.workunit.client.0.smithi088.stdout:8/84: dread d7/dd/d10/f12 [0,4194304] 0 2024-09-17T04:20:54.614 INFO:tasks.workunit.client.1.smithi134.stdout:0/376: truncate d11/d24/f7e 715715 0 2024-09-17T04:20:54.615 INFO:tasks.workunit.client.1.smithi134.stdout:0/377: chown c1 606645 1 2024-09-17T04:20:54.616 INFO:tasks.workunit.client.1.smithi134.stdout:2/438: rename d19/d27/d31/l3c to d19/d27/d31/d49/d6f/d84/l8d 0 2024-09-17T04:20:54.618 INFO:tasks.workunit.client.1.smithi134.stdout:2/439: chown d19/d27/c2a 147364476 1 2024-09-17T04:20:54.618 INFO:tasks.workunit.client.0.smithi088.stdout:5/115: link d2/f10 d2/d9/d20/f23 0 2024-09-17T04:20:54.619 INFO:tasks.workunit.client.0.smithi088.stdout:9/126: mkdir d2/d2b/d2e 0 2024-09-17T04:20:54.619 INFO:tasks.workunit.client.1.smithi134.stdout:1/448: dwrite d12/f42 [0,4194304] 0 2024-09-17T04:20:54.619 INFO:tasks.workunit.client.0.smithi088.stdout:9/127: chown d2/d2b/d2e 1586128 1 2024-09-17T04:20:54.621 INFO:tasks.workunit.client.0.smithi088.stdout:7/130: creat d2/d4/f28 x:0 0 0 2024-09-17T04:20:54.623 INFO:tasks.workunit.client.1.smithi134.stdout:3/510: mkdir de/d12/d15/d1d/d2d/d31/d6a/d83/da7 0 2024-09-17T04:20:54.626 INFO:tasks.workunit.client.1.smithi134.stdout:8/401: creat d4/d23/d60/f7d x:0 0 0 2024-09-17T04:20:54.628 INFO:tasks.workunit.client.0.smithi088.stdout:0/49: rename db/fd to db/f11 0 2024-09-17T04:20:54.629 INFO:tasks.workunit.client.0.smithi088.stdout:9/128: dwrite d2/f3 [4194304,4194304] 0 2024-09-17T04:20:54.631 INFO:tasks.workunit.client.1.smithi134.stdout:7/334: readlink d0/d16/d35/d4b/d65/l66 0 2024-09-17T04:20:54.632 INFO:tasks.workunit.client.1.smithi134.stdout:8/402: dwrite d4/d23/d60/f7d [0,4194304] 0 2024-09-17T04:20:54.632 INFO:tasks.workunit.client.1.smithi134.stdout:7/335: chown d0/dd/d3a/d3d/d38/d60 102 1 2024-09-17T04:20:54.637 INFO:tasks.workunit.client.0.smithi088.stdout:9/129: dread d2/fc [0,4194304] 0 2024-09-17T04:20:54.638 INFO:tasks.workunit.client.0.smithi088.stdout:0/50: dwrite db/f10 [0,4194304] 0 2024-09-17T04:20:54.639 INFO:tasks.workunit.client.0.smithi088.stdout:0/51: chown f5 1449 1 2024-09-17T04:20:54.646 INFO:tasks.workunit.client.0.smithi088.stdout:6/85: mknod d14/d15/c1d 0 2024-09-17T04:20:54.648 INFO:tasks.workunit.client.1.smithi134.stdout:4/478: dwrite d0/d13/d40/d42/d92/f80 [0,4194304] 0 2024-09-17T04:20:54.648 INFO:tasks.workunit.client.1.smithi134.stdout:0/378: mknod d11/d4c/d76/c83 0 2024-09-17T04:20:54.650 INFO:tasks.workunit.client.1.smithi134.stdout:6/534: rename de/d19/d62/d34/l54 to de/d19/d21/d2d/laa 0 2024-09-17T04:20:54.651 INFO:tasks.workunit.client.0.smithi088.stdout:4/103: write f1 [3706966,94639] 0 2024-09-17T04:20:54.652 INFO:tasks.workunit.client.0.smithi088.stdout:8/85: rmdir d7/dd/d10 39 2024-09-17T04:20:54.652 INFO:tasks.workunit.client.1.smithi134.stdout:6/535: read de/d19/d21/d2d/f2f [277178,124020] 0 2024-09-17T04:20:54.658 INFO:tasks.workunit.client.1.smithi134.stdout:1/449: creat d12/d1c/d2e/d7d/f98 x:0 0 0 2024-09-17T04:20:54.658 INFO:tasks.workunit.client.0.smithi088.stdout:3/32: truncate d0/f3 1472410 0 2024-09-17T04:20:54.660 INFO:tasks.workunit.client.1.smithi134.stdout:3/511: rmdir de/d12/d22/d5a 39 2024-09-17T04:20:54.663 INFO:tasks.workunit.client.1.smithi134.stdout:9/800: symlink d2/d5/d9/d6a/l10d 0 2024-09-17T04:20:54.665 INFO:tasks.workunit.client.1.smithi134.stdout:3/512: dread de/d67/f95 [0,4194304] 0 2024-09-17T04:20:54.666 INFO:tasks.workunit.client.1.smithi134.stdout:5/408: link d0/d3a/d2b/d5a/f5e d0/d3a/d2b/d61/f86 0 2024-09-17T04:20:54.667 INFO:tasks.workunit.client.1.smithi134.stdout:3/513: write de/d10/d70/f87 [1787490,39452] 0 2024-09-17T04:20:54.668 INFO:tasks.workunit.client.1.smithi134.stdout:5/409: dread - d0/da/d2c/f70 zero size 2024-09-17T04:20:54.669 INFO:tasks.workunit.client.0.smithi088.stdout:5/116: write d2/fd [2746354,52033] 0 2024-09-17T04:20:54.669 INFO:tasks.workunit.client.1.smithi134.stdout:0/379: creat d11/d4c/f84 x:0 0 0 2024-09-17T04:20:54.670 INFO:tasks.workunit.client.1.smithi134.stdout:5/410: read d0/f2a [840107,95714] 0 2024-09-17T04:20:54.671 INFO:tasks.workunit.client.1.smithi134.stdout:9/801: dwrite d2/d5/d8/d16/d54/daf/fa1 [0,4194304] 0 2024-09-17T04:20:54.671 INFO:tasks.workunit.client.1.smithi134.stdout:0/380: read d11/d18/f1f [125331,116794] 0 2024-09-17T04:20:54.673 INFO:tasks.workunit.client.0.smithi088.stdout:0/52: creat db/f12 x:0 0 0 2024-09-17T04:20:54.673 INFO:tasks.workunit.client.1.smithi134.stdout:9/802: fdatasync d2/d5/d37/f47 0 2024-09-17T04:20:54.674 INFO:tasks.workunit.client.0.smithi088.stdout:0/53: chown db/f11 3 1 2024-09-17T04:20:54.676 INFO:tasks.workunit.client.1.smithi134.stdout:8/403: rename d4/d23/d60/d6b/d13/f3d to d4/f7e 0 2024-09-17T04:20:54.678 INFO:tasks.workunit.client.1.smithi134.stdout:0/381: dwrite f0 [0,4194304] 0 2024-09-17T04:20:54.679 INFO:tasks.workunit.client.1.smithi134.stdout:0/382: write d11/d24/f28 [4781648,64691] 0 2024-09-17T04:20:54.680 INFO:tasks.workunit.client.1.smithi134.stdout:0/383: fsync d11/d22/f3e 0 2024-09-17T04:20:54.681 INFO:tasks.workunit.client.0.smithi088.stdout:0/54: dread db/f11 [0,4194304] 0 2024-09-17T04:20:54.683 INFO:tasks.workunit.client.0.smithi088.stdout:6/86: rename lf to d14/d15/d16/l1e 0 2024-09-17T04:20:54.684 INFO:tasks.workunit.client.0.smithi088.stdout:6/87: fdatasync f10 0 2024-09-17T04:20:54.686 INFO:tasks.workunit.client.0.smithi088.stdout:1/118: rename d0/f8 to d0/f28 0 2024-09-17T04:20:54.688 INFO:tasks.workunit.client.0.smithi088.stdout:6/88: dread f10 [0,4194304] 0 2024-09-17T04:20:54.689 INFO:tasks.workunit.client.0.smithi088.stdout:4/104: mknod d5/c1d 0 2024-09-17T04:20:54.692 INFO:tasks.workunit.client.1.smithi134.stdout:1/450: mknod d12/d1c/d56/c99 0 2024-09-17T04:20:54.693 INFO:tasks.workunit.client.0.smithi088.stdout:2/88: truncate d0/d1/f2 2081043 0 2024-09-17T04:20:54.693 INFO:tasks.workunit.client.1.smithi134.stdout:3/514: dread de/d10/f30 [0,4194304] 0 2024-09-17T04:20:54.696 INFO:tasks.workunit.client.0.smithi088.stdout:5/117: symlink d2/d9/l24 0 2024-09-17T04:20:54.699 INFO:tasks.workunit.client.0.smithi088.stdout:0/55: creat db/f13 x:0 0 0 2024-09-17T04:20:54.700 INFO:tasks.workunit.client.1.smithi134.stdout:4/479: mknod d0/df/d35/d5c/d8b/c97 0 2024-09-17T04:20:54.701 INFO:tasks.workunit.client.1.smithi134.stdout:4/480: fdatasync d0/d13/d40/d42/d92/f21 0 2024-09-17T04:20:54.702 INFO:tasks.workunit.client.1.smithi134.stdout:5/411: creat d0/d48/f87 x:0 0 0 2024-09-17T04:20:54.706 INFO:tasks.workunit.client.0.smithi088.stdout:4/105: symlink d5/l1e 0 2024-09-17T04:20:54.708 INFO:tasks.workunit.client.1.smithi134.stdout:9/803: creat d2/d5/d8/d16/d54/d5e/da0/f10e x:0 0 0 2024-09-17T04:20:54.708 INFO:tasks.workunit.client.1.smithi134.stdout:9/804: write d2/d78/fc7 [394571,84271] 0 2024-09-17T04:20:54.709 INFO:tasks.workunit.client.0.smithi088.stdout:6/89: rename c12 to d14/c1f 0 2024-09-17T04:20:54.711 INFO:tasks.workunit.client.0.smithi088.stdout:8/86: mknod d7/dd/c1d 0 2024-09-17T04:20:54.713 INFO:tasks.workunit.client.0.smithi088.stdout:2/89: write d0/d1/f2 [238165,107762] 0 2024-09-17T04:20:54.714 INFO:tasks.workunit.client.0.smithi088.stdout:2/90: dread d0/d1/fb [0,4194304] 0 2024-09-17T04:20:54.717 INFO:tasks.workunit.client.0.smithi088.stdout:2/91: dread d0/f9 [0,4194304] 0 2024-09-17T04:20:54.717 INFO:tasks.workunit.client.0.smithi088.stdout:2/92: dread - d0/fd zero size 2024-09-17T04:20:54.717 INFO:tasks.workunit.client.0.smithi088.stdout:5/118: mkdir d2/d9/d20/d25 0 2024-09-17T04:20:54.718 INFO:tasks.workunit.client.1.smithi134.stdout:6/536: getdents de/d5d/d67 0 2024-09-17T04:20:54.718 INFO:tasks.workunit.client.0.smithi088.stdout:2/93: rename d0/d14/d17 to d0/d14/d17/d1b 22 2024-09-17T04:20:54.719 INFO:tasks.workunit.client.0.smithi088.stdout:4/106: dread d5/f17 [0,4194304] 0 2024-09-17T04:20:54.719 INFO:tasks.workunit.client.1.smithi134.stdout:6/537: read f7 [2029878,49273] 0 2024-09-17T04:20:54.720 INFO:tasks.workunit.client.0.smithi088.stdout:0/56: creat db/f14 x:0 0 0 2024-09-17T04:20:54.722 INFO:tasks.workunit.client.0.smithi088.stdout:1/119: creat d0/d1/df/d20/f29 x:0 0 0 2024-09-17T04:20:54.725 INFO:tasks.workunit.client.0.smithi088.stdout:6/90: symlink d14/d15/l20 0 2024-09-17T04:20:54.727 INFO:tasks.workunit.client.1.smithi134.stdout:1/451: dwrite d12/d1c/d2e/f50 [0,4194304] 0 2024-09-17T04:20:54.727 INFO:tasks.workunit.client.0.smithi088.stdout:4/107: dwrite d5/f1a [0,4194304] 0 2024-09-17T04:20:54.729 INFO:tasks.workunit.client.1.smithi134.stdout:4/481: fdatasync d0/f5 0 2024-09-17T04:20:54.729 INFO:tasks.workunit.client.0.smithi088.stdout:7/131: getdents d2/d4/d7/d20 0 2024-09-17T04:20:54.729 INFO:tasks.workunit.client.0.smithi088.stdout:0/57: dwrite f1 [0,4194304] 0 2024-09-17T04:20:54.729 INFO:tasks.workunit.client.0.smithi088.stdout:6/91: dread f11 [0,4194304] 0 2024-09-17T04:20:54.731 INFO:tasks.workunit.client.0.smithi088.stdout:6/92: chown d14 2 1 2024-09-17T04:20:54.732 INFO:tasks.workunit.client.1.smithi134.stdout:5/412: rename d0/f8 to d0/d3a/d2b/d5a/f88 0 2024-09-17T04:20:54.735 INFO:tasks.workunit.client.0.smithi088.stdout:2/94: rename d0/c7 to d0/d1/c1c 0 2024-09-17T04:20:54.735 INFO:tasks.workunit.client.0.smithi088.stdout:6/93: dread f4 [0,4194304] 0 2024-09-17T04:20:54.735 INFO:tasks.workunit.client.1.smithi134.stdout:9/805: mkdir d2/d5/d37/d3f/d10f 0 2024-09-17T04:20:54.736 INFO:tasks.workunit.client.1.smithi134.stdout:9/806: readlink d2/d5/d9/df/lc8 0 2024-09-17T04:20:54.737 INFO:tasks.workunit.client.0.smithi088.stdout:2/95: chown d0/d1/f2 77058 1 2024-09-17T04:20:54.737 INFO:tasks.workunit.client.0.smithi088.stdout:2/96: stat d0/l4 0 2024-09-17T04:20:54.740 INFO:tasks.workunit.client.1.smithi134.stdout:0/384: fsync d11/d19/f6c 0 2024-09-17T04:20:54.741 INFO:tasks.workunit.client.1.smithi134.stdout:0/385: chown d11/d19/c5c 74 1 2024-09-17T04:20:54.741 INFO:tasks.workunit.client.0.smithi088.stdout:6/94: dread f9 [0,4194304] 0 2024-09-17T04:20:54.742 INFO:tasks.workunit.client.1.smithi134.stdout:6/538: symlink de/d19/d1f/d55/d77/lab 0 2024-09-17T04:20:54.745 INFO:tasks.workunit.client.0.smithi088.stdout:8/87: mknod d7/dd/c1e 0 2024-09-17T04:20:54.745 INFO:tasks.workunit.client.1.smithi134.stdout:2/440: getdents d19 0 2024-09-17T04:20:54.748 INFO:tasks.workunit.client.1.smithi134.stdout:1/452: symlink d12/d19/d1d/d5f/l9a 0 2024-09-17T04:20:54.749 INFO:tasks.workunit.client.0.smithi088.stdout:1/120: dwrite d0/d1/f1c [0,4194304] 0 2024-09-17T04:20:54.751 INFO:tasks.workunit.client.1.smithi134.stdout:8/404: link d4/d23/d60/d6b/d5e/l64 d4/d11/l7f 0 2024-09-17T04:20:54.752 INFO:tasks.workunit.client.0.smithi088.stdout:0/58: write f0 [1576188,129055] 0 2024-09-17T04:20:54.756 INFO:tasks.workunit.client.0.smithi088.stdout:4/108: rename d5/f10 to d5/f1f 0 2024-09-17T04:20:54.757 INFO:tasks.workunit.client.0.smithi088.stdout:4/109: readlink d5/l11 0 2024-09-17T04:20:54.759 INFO:tasks.workunit.client.0.smithi088.stdout:7/132: creat d2/d1e/f29 x:0 0 0 2024-09-17T04:20:54.760 INFO:tasks.workunit.client.0.smithi088.stdout:7/133: truncate d2/d1e/f24 587124 0 2024-09-17T04:20:54.761 INFO:tasks.workunit.client.1.smithi134.stdout:0/386: rmdir d11/d22/d1c 39 2024-09-17T04:20:54.762 INFO:tasks.workunit.client.1.smithi134.stdout:3/515: creat de/d12/d15/d1d/d8f/d90/fa8 x:0 0 0 2024-09-17T04:20:54.763 INFO:tasks.workunit.client.1.smithi134.stdout:3/516: chown de/d12/d15/d1d/f54 236 1 2024-09-17T04:20:54.765 INFO:tasks.workunit.client.1.smithi134.stdout:2/441: symlink d19/d27/d31/d49/d63/l8e 0 2024-09-17T04:20:54.767 INFO:tasks.workunit.client.0.smithi088.stdout:6/95: rename f7 to d14/d15/d16/f21 0 2024-09-17T04:20:54.769 INFO:tasks.workunit.client.0.smithi088.stdout:6/96: write f10 [700118,43485] 0 2024-09-17T04:20:54.769 INFO:tasks.workunit.client.1.smithi134.stdout:9/807: write d2/d5/d9/d6a/f7a [98728,58785] 0 2024-09-17T04:20:54.770 INFO:tasks.workunit.client.1.smithi134.stdout:8/405: rename d4/d1e/l2a to d4/l80 0 2024-09-17T04:20:54.771 INFO:tasks.workunit.client.1.smithi134.stdout:1/453: dwrite d12/d19/f25 [0,4194304] 0 2024-09-17T04:20:54.776 INFO:tasks.workunit.client.0.smithi088.stdout:4/110: readlink d5/l1c 0 2024-09-17T04:20:54.777 INFO:tasks.workunit.client.0.smithi088.stdout:4/111: fsync f1 0 2024-09-17T04:20:54.777 INFO:tasks.workunit.client.0.smithi088.stdout:2/97: dwrite d0/f9 [0,4194304] 0 2024-09-17T04:20:54.777 INFO:tasks.workunit.client.0.smithi088.stdout:4/112: stat l4 0 2024-09-17T04:20:54.778 INFO:tasks.workunit.client.1.smithi134.stdout:2/442: creat d19/d27/d31/d49/d63/f8f x:0 0 0 2024-09-17T04:20:54.778 INFO:tasks.workunit.client.0.smithi088.stdout:2/98: readlink d0/l4 0 2024-09-17T04:20:54.779 INFO:tasks.workunit.client.0.smithi088.stdout:4/113: write f1 [1130451,1425] 0 2024-09-17T04:20:54.780 INFO:tasks.workunit.client.1.smithi134.stdout:1/454: dread d12/d1c/f2f [0,4194304] 0 2024-09-17T04:20:54.780 INFO:tasks.workunit.client.0.smithi088.stdout:7/134: creat d2/d4/d7/f2a x:0 0 0 2024-09-17T04:20:54.782 INFO:tasks.workunit.client.0.smithi088.stdout:7/135: truncate d2/d4/d7/f9 5234858 0 2024-09-17T04:20:54.783 INFO:tasks.workunit.client.1.smithi134.stdout:4/482: creat d0/d13/d40/f98 x:0 0 0 2024-09-17T04:20:54.785 INFO:tasks.workunit.client.1.smithi134.stdout:9/808: creat d2/d25/f110 x:0 0 0 2024-09-17T04:20:54.789 INFO:tasks.workunit.client.0.smithi088.stdout:8/88: mknod d7/dd/c1f 0 2024-09-17T04:20:54.789 INFO:tasks.workunit.client.1.smithi134.stdout:0/387: creat d11/d22/d1c/d2f/d43/f85 x:0 0 0 2024-09-17T04:20:54.791 INFO:tasks.workunit.client.1.smithi134.stdout:1/455: chown d12/d1c/c2b 860346 1 2024-09-17T04:20:54.792 INFO:tasks.workunit.client.0.smithi088.stdout:5/119: getdents d2/d9 0 2024-09-17T04:20:54.793 INFO:tasks.workunit.client.1.smithi134.stdout:4/483: mknod d0/df/d35/d5c/d8b/c99 0 2024-09-17T04:20:54.794 INFO:tasks.workunit.client.0.smithi088.stdout:2/99: mknod d0/d13/c1d 0 2024-09-17T04:20:54.795 INFO:tasks.workunit.client.0.smithi088.stdout:2/100: chown d0/d1/f11 957649547 1 2024-09-17T04:20:54.796 INFO:tasks.workunit.client.1.smithi134.stdout:3/517: getdents de/d12/d15/d1d/d2d/d31/d6a/d78 0 2024-09-17T04:20:54.800 INFO:tasks.workunit.client.0.smithi088.stdout:5/120: dread d2/d9/f1b [0,4194304] 0 2024-09-17T04:20:54.802 INFO:tasks.workunit.client.0.smithi088.stdout:4/114: dwrite d5/f1f [0,4194304] 0 2024-09-17T04:20:54.803 INFO:tasks.workunit.client.0.smithi088.stdout:4/115: fdatasync f1 0 2024-09-17T04:20:54.807 INFO:tasks.workunit.client.0.smithi088.stdout:7/136: dread d2/d4/d7/fa [0,4194304] 0 2024-09-17T04:20:54.825 INFO:tasks.workunit.client.0.smithi088.stdout:2/101: creat d0/d1/f1e x:0 0 0 2024-09-17T04:20:54.825 INFO:tasks.workunit.client.1.smithi134.stdout:1/456: symlink d12/d19/d1d/d3e/l9b 0 2024-09-17T04:20:54.828 INFO:tasks.workunit.client.1.smithi134.stdout:0/388: write d11/f70 [3471016,1994] 0 2024-09-17T04:20:54.829 INFO:tasks.workunit.client.1.smithi134.stdout:0/389: chown d11/d19/d21/c69 1044829 1 2024-09-17T04:20:54.830 INFO:tasks.workunit.client.0.smithi088.stdout:5/121: mknod d2/d9/d20/c26 0 2024-09-17T04:20:54.834 INFO:tasks.workunit.client.1.smithi134.stdout:1/457: dread d12/d19/d5c/f69 [0,4194304] 0 2024-09-17T04:20:54.834 INFO:tasks.workunit.client.0.smithi088.stdout:2/102: dwrite d0/d18/f19 [0,4194304] 0 2024-09-17T04:20:54.836 INFO:tasks.workunit.client.1.smithi134.stdout:4/484: link d0/df/d35/f71 d0/df/d1e/d63/f9a 0 2024-09-17T04:20:54.836 INFO:tasks.workunit.client.1.smithi134.stdout:7/336: sync 2024-09-17T04:20:54.837 INFO:tasks.workunit.client.0.smithi088.stdout:7/137: mkdir d2/d2b 0 2024-09-17T04:20:54.839 INFO:tasks.workunit.client.1.smithi134.stdout:3/518: symlink de/d10/d3d/da2/la9 0 2024-09-17T04:20:54.839 INFO:tasks.workunit.client.1.smithi134.stdout:2/443: getdents d19/d27 0 2024-09-17T04:20:54.840 INFO:tasks.workunit.client.0.smithi088.stdout:5/122: dread d2/d9/fa [0,4194304] 0 2024-09-17T04:20:54.840 INFO:tasks.workunit.client.0.smithi088.stdout:6/97: dwrite d14/d15/d16/f21 [0,4194304] 0 2024-09-17T04:20:54.840 INFO:tasks.workunit.client.1.smithi134.stdout:1/458: creat d12/d36/f9c x:0 0 0 2024-09-17T04:20:54.842 INFO:tasks.workunit.client.0.smithi088.stdout:7/138: write d2/d4/d7/d20/f22 [552797,1857] 0 2024-09-17T04:20:54.842 INFO:tasks.workunit.client.1.smithi134.stdout:4/485: creat d0/d13/d40/d42/f9b x:0 0 0 2024-09-17T04:20:54.843 INFO:tasks.workunit.client.1.smithi134.stdout:7/337: rmdir d0/d16/d35/d4b/d65 39 2024-09-17T04:20:54.844 INFO:tasks.workunit.client.1.smithi134.stdout:7/338: chown d0/f20 11 1 2024-09-17T04:20:54.845 INFO:tasks.workunit.client.1.smithi134.stdout:9/809: getdents d2/d5/d37/d7c 0 2024-09-17T04:20:54.848 INFO:tasks.workunit.client.1.smithi134.stdout:0/390: mknod d11/d6f/c86 0 2024-09-17T04:20:54.848 INFO:tasks.workunit.client.0.smithi088.stdout:6/98: creat d14/d15/f22 x:0 0 0 2024-09-17T04:20:54.849 INFO:tasks.workunit.client.1.smithi134.stdout:0/391: write fe [5341164,103928] 0 2024-09-17T04:20:54.849 INFO:tasks.workunit.client.0.smithi088.stdout:2/103: dwrite d0/d1/f11 [0,4194304] 0 2024-09-17T04:20:54.851 INFO:tasks.workunit.client.1.smithi134.stdout:2/444: mknod d19/d27/d31/d49/d6f/d84/c90 0 2024-09-17T04:20:54.852 INFO:tasks.workunit.client.0.smithi088.stdout:7/139: mknod d2/d4/c2c 0 2024-09-17T04:20:54.853 INFO:tasks.workunit.client.0.smithi088.stdout:4/116: dwrite d5/fd [4194304,4194304] 0 2024-09-17T04:20:54.854 INFO:tasks.workunit.client.1.smithi134.stdout:1/459: unlink d12/d19/d1d/l32 0 2024-09-17T04:20:54.859 INFO:tasks.workunit.client.0.smithi088.stdout:6/99: rename d14/d15/c1c to d14/d15/d16/c23 0 2024-09-17T04:20:54.860 INFO:tasks.workunit.client.1.smithi134.stdout:7/339: rename d0 to d0/d16/d35/d4b/d65/d6b 22 2024-09-17T04:20:54.861 INFO:tasks.workunit.client.0.smithi088.stdout:6/100: dread f4 [0,4194304] 0 2024-09-17T04:20:54.861 INFO:tasks.workunit.client.0.smithi088.stdout:5/123: creat d2/f27 x:0 0 0 2024-09-17T04:20:54.864 INFO:tasks.workunit.client.1.smithi134.stdout:9/810: mkdir d2/d5/d9/df/d111 0 2024-09-17T04:20:54.864 INFO:tasks.workunit.client.0.smithi088.stdout:2/104: dread d0/d13/f16 [0,4194304] 0 2024-09-17T04:20:54.865 INFO:tasks.workunit.client.0.smithi088.stdout:2/105: write d0/d1/f11 [1286335,80604] 0 2024-09-17T04:20:54.869 INFO:tasks.workunit.client.1.smithi134.stdout:0/392: creat d11/d19/f87 x:0 0 0 2024-09-17T04:20:54.869 INFO:tasks.workunit.client.0.smithi088.stdout:4/117: rename d5/f17 to d5/f20 0 2024-09-17T04:20:54.870 INFO:tasks.workunit.client.1.smithi134.stdout:7/340: dwrite d0/d16/d35/d4b/f44 [0,4194304] 0 2024-09-17T04:20:54.870 INFO:tasks.workunit.client.0.smithi088.stdout:4/118: chown d5/l11 337 1 2024-09-17T04:20:54.871 INFO:tasks.workunit.client.1.smithi134.stdout:2/445: rmdir d19/d7e 39 2024-09-17T04:20:54.873 INFO:tasks.workunit.client.1.smithi134.stdout:3/519: dread de/d12/d22/f81 [0,4194304] 0 2024-09-17T04:20:54.875 INFO:tasks.workunit.client.0.smithi088.stdout:6/101: truncate f11 1443197 0 2024-09-17T04:20:54.875 INFO:tasks.workunit.client.1.smithi134.stdout:4/486: write d0/f22 [5189824,38815] 0 2024-09-17T04:20:54.875 INFO:tasks.workunit.client.1.smithi134.stdout:9/811: dwrite d2/d7/ff4 [0,4194304] 0 2024-09-17T04:20:54.876 INFO:tasks.workunit.client.1.smithi134.stdout:3/520: fdatasync de/d12/d15/d1d/f72 0 2024-09-17T04:20:54.881 INFO:tasks.workunit.client.1.smithi134.stdout:7/341: rmdir d0/dd 39 2024-09-17T04:20:54.882 INFO:tasks.workunit.client.1.smithi134.stdout:9/812: chown d2/d5/d8/d16/d54/daf/ded 957195 1 2024-09-17T04:20:54.884 INFO:tasks.workunit.client.1.smithi134.stdout:1/460: fdatasync d12/d19/d5d/f7a 0 2024-09-17T04:20:54.884 INFO:tasks.workunit.client.1.smithi134.stdout:2/446: dwrite f1 [0,4194304] 0 2024-09-17T04:20:54.884 INFO:tasks.workunit.client.1.smithi134.stdout:0/393: dwrite d11/d22/d1c/d2f/d43/f85 [0,4194304] 0 2024-09-17T04:20:54.885 INFO:tasks.workunit.client.0.smithi088.stdout:4/119: creat d5/f21 x:0 0 0 2024-09-17T04:20:54.886 INFO:tasks.workunit.client.1.smithi134.stdout:4/487: mkdir d0/df/d17/d9c 0 2024-09-17T04:20:54.887 INFO:tasks.workunit.client.1.smithi134.stdout:2/447: chown d19/d1c/d47/d50/f7c 392 1 2024-09-17T04:20:54.887 INFO:tasks.workunit.client.1.smithi134.stdout:0/394: stat d11/d22/d1c/d2f/d43/d5d 0 2024-09-17T04:20:54.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:54 smithi088 ceph-mon[27811]: pgmap v18: 65 pgs: 65 active+clean; 915 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 14 MiB/s rd, 111 MiB/s wr, 262 op/s 2024-09-17T04:20:54.888 INFO:tasks.workunit.client.1.smithi134.stdout:4/488: write d0/df/d17/f24 [8974519,37057] 0 2024-09-17T04:20:54.889 INFO:tasks.workunit.client.0.smithi088.stdout:5/124: creat d2/d9/d20/d25/f28 x:0 0 0 2024-09-17T04:20:54.893 INFO:tasks.workunit.client.0.smithi088.stdout:7/140: link d2/f19 d2/d1e/d23/f2d 0 2024-09-17T04:20:54.895 INFO:tasks.workunit.client.1.smithi134.stdout:0/395: dwrite d11/d19/d21/d37/f4b [0,4194304] 0 2024-09-17T04:20:54.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:54 smithi134 ceph-mon[35201]: pgmap v18: 65 pgs: 65 active+clean; 915 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 14 MiB/s rd, 111 MiB/s wr, 262 op/s 2024-09-17T04:20:54.896 INFO:tasks.workunit.client.1.smithi134.stdout:0/396: chown d11/d19/d21/d37/l6e 15243 1 2024-09-17T04:20:54.897 INFO:tasks.workunit.client.1.smithi134.stdout:5/413: sync 2024-09-17T04:20:54.898 INFO:tasks.workunit.client.0.smithi088.stdout:4/120: rename d5/c18 to d5/c22 0 2024-09-17T04:20:54.898 INFO:tasks.workunit.client.0.smithi088.stdout:2/106: write d0/d1/fb [1424289,61699] 0 2024-09-17T04:20:54.899 INFO:tasks.workunit.client.0.smithi088.stdout:6/102: fdatasync f11 0 2024-09-17T04:20:54.900 INFO:tasks.workunit.client.1.smithi134.stdout:9/813: mkdir d2/d5/d58/db5/d112 0 2024-09-17T04:20:54.901 INFO:tasks.workunit.client.1.smithi134.stdout:1/461: mknod d12/d19/d5d/d88/c9d 0 2024-09-17T04:20:54.906 INFO:tasks.workunit.client.0.smithi088.stdout:7/141: rename d2/d2b to d2/d1d/d2e 0 2024-09-17T04:20:54.906 INFO:tasks.workunit.client.1.smithi134.stdout:1/462: dread d12/d19/d5c/f6f [0,4194304] 0 2024-09-17T04:20:54.907 INFO:tasks.workunit.client.0.smithi088.stdout:4/121: creat d5/f23 x:0 0 0 2024-09-17T04:20:54.907 INFO:tasks.workunit.client.0.smithi088.stdout:7/142: dread d2/d4/f18 [0,4194304] 0 2024-09-17T04:20:54.907 INFO:tasks.workunit.client.1.smithi134.stdout:1/463: chown d12/d1c/d4a 164916 1 2024-09-17T04:20:54.909 INFO:tasks.workunit.client.1.smithi134.stdout:2/448: dread d19/d27/d31/d34/d42/f54 [0,4194304] 0 2024-09-17T04:20:54.909 INFO:tasks.workunit.client.1.smithi134.stdout:3/521: mknod de/d12/d15/d1d/d2d/d31/d6a/d78/d7c/caa 0 2024-09-17T04:20:54.910 INFO:tasks.workunit.client.0.smithi088.stdout:7/143: stat d2/d4/f28 0 2024-09-17T04:20:54.910 INFO:tasks.workunit.client.0.smithi088.stdout:2/107: creat d0/d14/d17/f1f x:0 0 0 2024-09-17T04:20:54.910 INFO:tasks.workunit.client.0.smithi088.stdout:7/144: read - d2/d4/f28 zero size 2024-09-17T04:20:54.910 INFO:tasks.workunit.client.0.smithi088.stdout:7/145: fsync d2/f6 0 2024-09-17T04:20:54.911 INFO:tasks.workunit.client.1.smithi134.stdout:0/397: rmdir d11/d19/d21/d37 39 2024-09-17T04:20:54.911 INFO:tasks.workunit.client.1.smithi134.stdout:0/398: chown d11/d18/l34 0 1 2024-09-17T04:20:54.912 INFO:tasks.workunit.client.0.smithi088.stdout:5/125: symlink d2/l29 0 2024-09-17T04:20:54.912 INFO:tasks.workunit.client.0.smithi088.stdout:5/126: fsync d2/d9/fa 0 2024-09-17T04:20:54.913 INFO:tasks.workunit.client.0.smithi088.stdout:5/127: write d2/d9/f1f [368354,59729] 0 2024-09-17T04:20:54.914 INFO:tasks.workunit.client.0.smithi088.stdout:5/128: fdatasync d2/d9/fa 0 2024-09-17T04:20:54.914 INFO:tasks.workunit.client.1.smithi134.stdout:4/489: rename d0/c60 to d0/df/d1e/d63/c9d 0 2024-09-17T04:20:54.914 INFO:tasks.workunit.client.1.smithi134.stdout:7/342: symlink d0/dd/d3a/d3d/d38/d60/l6c 0 2024-09-17T04:20:54.915 INFO:tasks.workunit.client.0.smithi088.stdout:4/122: symlink d5/l24 0 2024-09-17T04:20:54.915 INFO:tasks.workunit.client.1.smithi134.stdout:7/343: write d0/dd/d3a/d3d/f41 [87361,83103] 0 2024-09-17T04:20:54.915 INFO:tasks.workunit.client.1.smithi134.stdout:1/464: mknod d12/d19/d5c/c9e 0 2024-09-17T04:20:54.916 INFO:tasks.workunit.client.0.smithi088.stdout:2/108: mknod d0/c20 0 2024-09-17T04:20:54.918 INFO:tasks.workunit.client.1.smithi134.stdout:3/522: symlink de/d12/d15/d1d/d2d/d63/d77/lab 0 2024-09-17T04:20:54.919 INFO:tasks.workunit.client.1.smithi134.stdout:0/399: symlink d11/d4c/d76/l88 0 2024-09-17T04:20:54.920 INFO:tasks.workunit.client.1.smithi134.stdout:0/400: write d11/d18/f1e [403237,55830] 0 2024-09-17T04:20:54.920 INFO:tasks.workunit.client.0.smithi088.stdout:2/109: dread d0/f9 [0,4194304] 0 2024-09-17T04:20:54.924 INFO:tasks.workunit.client.0.smithi088.stdout:4/123: mknod d5/c25 0 2024-09-17T04:20:54.925 INFO:tasks.workunit.client.0.smithi088.stdout:4/124: chown d5/c1b 534484076 1 2024-09-17T04:20:54.926 INFO:tasks.workunit.client.0.smithi088.stdout:4/125: truncate d5/f23 944079 0 2024-09-17T04:20:54.926 INFO:tasks.workunit.client.1.smithi134.stdout:9/814: rename d2/d5/d9/d6b/lbb to d2/d7/d10a/l113 0 2024-09-17T04:20:54.929 INFO:tasks.workunit.client.0.smithi088.stdout:7/146: creat d2/d1e/d23/f2f x:0 0 0 2024-09-17T04:20:54.930 INFO:tasks.workunit.client.0.smithi088.stdout:7/147: fsync d2/f1a 0 2024-09-17T04:20:54.930 INFO:tasks.workunit.client.0.smithi088.stdout:2/110: mknod d0/d18/c21 0 2024-09-17T04:20:54.935 INFO:tasks.workunit.client.1.smithi134.stdout:3/523: symlink de/lac 0 2024-09-17T04:20:54.935 INFO:tasks.workunit.client.1.smithi134.stdout:3/524: stat de/d10/d70 0 2024-09-17T04:20:54.937 INFO:tasks.workunit.client.0.smithi088.stdout:6/103: dwrite f4 [0,4194304] 0 2024-09-17T04:20:54.937 INFO:tasks.workunit.client.0.smithi088.stdout:2/111: dread d0/d1/f11 [0,4194304] 0 2024-09-17T04:20:54.939 INFO:tasks.workunit.client.1.smithi134.stdout:0/401: rmdir d11/d6f 39 2024-09-17T04:20:54.942 INFO:tasks.workunit.client.0.smithi088.stdout:5/129: write d2/f10 [2009908,4743] 0 2024-09-17T04:20:54.946 INFO:tasks.workunit.client.0.smithi088.stdout:6/104: dread f4 [0,4194304] 0 2024-09-17T04:20:54.946 INFO:tasks.workunit.client.0.smithi088.stdout:5/130: dread - d2/d9/d20/d25/f28 zero size 2024-09-17T04:20:54.946 INFO:tasks.workunit.client.1.smithi134.stdout:4/490: unlink d0/d13/d40/c53 0 2024-09-17T04:20:54.947 INFO:tasks.workunit.client.0.smithi088.stdout:2/112: dwrite d0/d14/d17/f1f [0,4194304] 0 2024-09-17T04:20:54.953 INFO:tasks.workunit.client.1.smithi134.stdout:2/449: creat d19/d27/d31/d34/f91 x:0 0 0 2024-09-17T04:20:54.954 INFO:tasks.workunit.client.1.smithi134.stdout:2/450: chown d19/c28 9539585 1 2024-09-17T04:20:54.956 INFO:tasks.workunit.client.1.smithi134.stdout:0/402: mkdir d11/d24/d89 0 2024-09-17T04:20:54.959 INFO:tasks.workunit.client.0.smithi088.stdout:6/105: creat d14/f24 x:0 0 0 2024-09-17T04:20:54.960 INFO:tasks.workunit.client.0.smithi088.stdout:7/148: dwrite d2/d4/d7/fa [4194304,4194304] 0 2024-09-17T04:20:54.961 INFO:tasks.workunit.client.1.smithi134.stdout:5/414: getdents d0/da/d2c 0 2024-09-17T04:20:54.967 INFO:tasks.workunit.client.0.smithi088.stdout:2/113: mkdir d0/d14/d17/d22 0 2024-09-17T04:20:54.967 INFO:tasks.workunit.client.0.smithi088.stdout:2/114: chown d0/d1/f2 1049 1 2024-09-17T04:20:54.968 INFO:tasks.workunit.client.0.smithi088.stdout:4/126: link d5/f20 d5/f26 0 2024-09-17T04:20:54.969 INFO:tasks.workunit.client.0.smithi088.stdout:4/127: chown d5/c16 1678 1 2024-09-17T04:20:54.970 INFO:tasks.workunit.client.1.smithi134.stdout:1/465: link d12/d19/d5d/f95 d12/d19/d1d/f9f 0 2024-09-17T04:20:54.970 INFO:tasks.workunit.client.1.smithi134.stdout:1/466: stat d12/d36/l57 0 2024-09-17T04:20:54.972 INFO:tasks.workunit.client.1.smithi134.stdout:0/403: write d11/d19/d21/d37/f42 [1212277,118701] 0 2024-09-17T04:20:54.973 INFO:tasks.workunit.client.1.smithi134.stdout:5/415: mkdir d0/da/d69/d41/d6d/d89 0 2024-09-17T04:20:54.976 INFO:tasks.workunit.client.1.smithi134.stdout:1/467: rename d12/d1c/d4a/d63 to d12/d19/d1d/d61/da0 0 2024-09-17T04:20:54.977 INFO:tasks.workunit.client.1.smithi134.stdout:1/468: readlink d12/d19/d5d/d88/l8d 0 2024-09-17T04:20:54.978 INFO:tasks.workunit.client.1.smithi134.stdout:1/469: chown d12/d19/d5d/l6c 38071 1 2024-09-17T04:20:54.978 INFO:tasks.workunit.client.1.smithi134.stdout:1/470: stat d12/d1c/d2e/f5a 0 2024-09-17T04:20:54.979 INFO:tasks.workunit.client.1.smithi134.stdout:5/416: write d0/da/f46 [5047988,31396] 0 2024-09-17T04:20:54.979 INFO:tasks.workunit.client.1.smithi134.stdout:0/404: read d11/d19/d21/d37/f42 [2331554,95678] 0 2024-09-17T04:20:54.980 INFO:tasks.workunit.client.0.smithi088.stdout:7/149: getdents d2/d1d 0 2024-09-17T04:20:54.980 INFO:tasks.workunit.client.0.smithi088.stdout:7/150: rmdir d2/d1d 39 2024-09-17T04:20:54.981 INFO:tasks.workunit.client.1.smithi134.stdout:1/471: mkdir d12/d36/da1 0 2024-09-17T04:20:54.981 INFO:tasks.workunit.client.1.smithi134.stdout:0/405: chown d11/d19/d21/f27 44 1 2024-09-17T04:20:54.981 INFO:tasks.workunit.client.1.smithi134.stdout:0/406: truncate d11/f3b 2434992 0 2024-09-17T04:20:54.981 INFO:tasks.workunit.client.1.smithi134.stdout:5/417: mkdir d0/da/d2c/d73/d8a 0 2024-09-17T04:20:54.982 INFO:tasks.workunit.client.0.smithi088.stdout:7/151: creat d2/d1e/f30 x:0 0 0 2024-09-17T04:20:54.983 INFO:tasks.workunit.client.0.smithi088.stdout:7/152: chown d2/d4/d7/d20/f22 187973101 1 2024-09-17T04:20:54.983 INFO:tasks.workunit.client.1.smithi134.stdout:5/418: symlink d0/da/d29/d7c/l8b 0 2024-09-17T04:20:54.984 INFO:tasks.workunit.client.1.smithi134.stdout:0/407: rename d11/f14 to d11/d22/d1c/d2f/d45/f8a 0 2024-09-17T04:20:54.985 INFO:tasks.workunit.client.1.smithi134.stdout:0/408: chown d11/d22/d1c/d2f/d43/d5d/f6d 876015 1 2024-09-17T04:20:54.987 INFO:tasks.workunit.client.0.smithi088.stdout:7/153: rename d2/d4/d7/f9 to d2/f31 0 2024-09-17T04:20:54.988 INFO:tasks.workunit.client.0.smithi088.stdout:7/154: mknod d2/d1d/d2e/c32 0 2024-09-17T04:20:54.989 INFO:tasks.workunit.client.0.smithi088.stdout:7/155: readlink d2/d4/d7/l16 0 2024-09-17T04:20:54.993 INFO:tasks.workunit.client.0.smithi088.stdout:7/156: creat d2/d4/f33 x:0 0 0 2024-09-17T04:20:54.993 INFO:tasks.workunit.client.0.smithi088.stdout:7/157: dread - d2/d4/f33 zero size 2024-09-17T04:20:54.993 INFO:tasks.workunit.client.0.smithi088.stdout:7/158: read - d2/d4/ff zero size 2024-09-17T04:20:54.997 INFO:tasks.workunit.client.0.smithi088.stdout:7/159: dwrite d2/d1e/d23/f2f [0,4194304] 0 2024-09-17T04:20:55.002 INFO:tasks.workunit.client.0.smithi088.stdout:7/160: creat d2/d4/d7/f34 x:0 0 0 2024-09-17T04:20:55.003 INFO:tasks.workunit.client.0.smithi088.stdout:5/131: dwrite d2/d9/fc [0,4194304] 0 2024-09-17T04:20:55.004 INFO:tasks.workunit.client.0.smithi088.stdout:5/132: readlink d2/d9/l11 0 2024-09-17T04:20:55.008 INFO:tasks.workunit.client.0.smithi088.stdout:7/161: link d2/d4/f28 d2/d1e/d23/f35 0 2024-09-17T04:20:55.009 INFO:tasks.workunit.client.1.smithi134.stdout:8/406: sync 2024-09-17T04:20:55.010 INFO:tasks.workunit.client.1.smithi134.stdout:6/539: sync 2024-09-17T04:20:55.011 INFO:tasks.workunit.client.0.smithi088.stdout:5/133: dwrite d2/d9/fc [0,4194304] 0 2024-09-17T04:20:55.011 INFO:tasks.workunit.client.0.smithi088.stdout:7/162: creat d2/d4/d7/f36 x:0 0 0 2024-09-17T04:20:55.013 INFO:tasks.workunit.client.1.smithi134.stdout:8/407: dread d4/db/dd/f5b [0,4194304] 0 2024-09-17T04:20:55.015 INFO:tasks.workunit.client.0.smithi088.stdout:5/134: unlink d2/d9/d20/f22 0 2024-09-17T04:20:55.015 INFO:tasks.workunit.client.0.smithi088.stdout:5/135: read d2/f5 [258671,82061] 0 2024-09-17T04:20:55.017 INFO:tasks.workunit.client.0.smithi088.stdout:7/163: creat d2/d1d/f37 x:0 0 0 2024-09-17T04:20:55.018 INFO:tasks.workunit.client.1.smithi134.stdout:6/540: creat de/d19/d74/d94/d9e/fac x:0 0 0 2024-09-17T04:20:55.019 INFO:tasks.workunit.client.1.smithi134.stdout:8/408: creat d4/d1e/f81 x:0 0 0 2024-09-17T04:20:55.022 INFO:tasks.workunit.client.0.smithi088.stdout:7/164: symlink d2/d1e/d23/l38 0 2024-09-17T04:20:55.022 INFO:tasks.workunit.client.1.smithi134.stdout:1/472: dread d12/d1c/f24 [0,4194304] 0 2024-09-17T04:20:55.023 INFO:tasks.workunit.client.1.smithi134.stdout:1/473: truncate d12/d1c/d2e/f67 1448850 0 2024-09-17T04:20:55.024 INFO:tasks.workunit.client.1.smithi134.stdout:6/541: creat de/d2b/d8a/fad x:0 0 0 2024-09-17T04:20:55.026 INFO:tasks.workunit.client.1.smithi134.stdout:6/542: read de/d19/fa1 [137751,1720] 0 2024-09-17T04:20:55.027 INFO:tasks.workunit.client.1.smithi134.stdout:4/491: write d0/d13/f51 [492387,73654] 0 2024-09-17T04:20:55.027 INFO:tasks.workunit.client.0.smithi088.stdout:7/165: rename d2/d1d/c25 to d2/d4/c39 0 2024-09-17T04:20:55.028 INFO:tasks.workunit.client.1.smithi134.stdout:4/492: readlink d0/df/d35/d39/l6f 0 2024-09-17T04:20:55.032 INFO:tasks.workunit.client.0.smithi088.stdout:7/166: dread d2/d1e/d23/f2f [0,4194304] 0 2024-09-17T04:20:55.032 INFO:tasks.workunit.client.0.smithi088.stdout:7/167: chown d2/d1d/l27 4286020 1 2024-09-17T04:20:55.032 INFO:tasks.workunit.client.1.smithi134.stdout:9/815: truncate d2/d5/d8/d16/d54/daf/f95 4187337 0 2024-09-17T04:20:55.033 INFO:tasks.workunit.client.1.smithi134.stdout:6/543: chown la 1141096 1 2024-09-17T04:20:55.033 INFO:tasks.workunit.client.1.smithi134.stdout:5/419: dread d0/d3a/d2b/f31 [0,4194304] 0 2024-09-17T04:20:55.038 INFO:tasks.workunit.client.0.smithi088.stdout:7/168: creat d2/d4/d7/d20/f3a x:0 0 0 2024-09-17T04:20:55.038 INFO:tasks.workunit.client.0.smithi088.stdout:7/169: dread - d2/d4/f28 zero size 2024-09-17T04:20:55.040 INFO:tasks.workunit.client.0.smithi088.stdout:7/170: write d2/d1d/f37 [111884,50382] 0 2024-09-17T04:20:55.041 INFO:tasks.workunit.client.1.smithi134.stdout:5/420: dwrite d0/da/f54 [0,4194304] 0 2024-09-17T04:20:55.041 INFO:tasks.workunit.client.1.smithi134.stdout:9/816: rename d2/d5/f10b to d2/d5/d8/f114 0 2024-09-17T04:20:55.042 INFO:tasks.workunit.client.0.smithi088.stdout:2/115: write d0/f9 [2901285,54682] 0 2024-09-17T04:20:55.043 INFO:tasks.workunit.client.1.smithi134.stdout:3/525: dwrite de/f41 [4194304,4194304] 0 2024-09-17T04:20:55.045 INFO:tasks.workunit.client.0.smithi088.stdout:6/106: truncate f4 427759 0 2024-09-17T04:20:55.047 INFO:tasks.workunit.client.1.smithi134.stdout:3/526: stat de/d67/f95 0 2024-09-17T04:20:55.047 INFO:tasks.workunit.client.1.smithi134.stdout:5/421: write d0/d3a/f71 [835744,13460] 0 2024-09-17T04:20:55.047 INFO:tasks.workunit.client.0.smithi088.stdout:4/128: truncate d5/fd 1469673 0 2024-09-17T04:20:55.050 INFO:tasks.workunit.client.1.smithi134.stdout:2/451: dwrite d19/d27/d31/d34/f45 [0,4194304] 0 2024-09-17T04:20:55.051 INFO:tasks.workunit.client.0.smithi088.stdout:7/171: creat d2/d1e/f3b x:0 0 0 2024-09-17T04:20:55.053 INFO:tasks.workunit.client.0.smithi088.stdout:2/116: mknod d0/d14/d17/c23 0 2024-09-17T04:20:55.054 INFO:tasks.workunit.client.1.smithi134.stdout:2/452: fdatasync d19/d27/d31/d49/d63/f8f 0 2024-09-17T04:20:55.054 INFO:tasks.workunit.client.0.smithi088.stdout:6/107: dwrite d14/d15/d16/f21 [4194304,4194304] 0 2024-09-17T04:20:55.055 INFO:tasks.workunit.client.0.smithi088.stdout:2/117: write d0/d1/fb [361791,42586] 0 2024-09-17T04:20:55.056 INFO:tasks.workunit.client.0.smithi088.stdout:6/108: write d14/f24 [372737,80742] 0 2024-09-17T04:20:55.057 INFO:tasks.workunit.client.1.smithi134.stdout:6/544: dwrite de/d19/fa1 [0,4194304] 0 2024-09-17T04:20:55.058 INFO:tasks.workunit.client.1.smithi134.stdout:2/453: chown d19/d1c/d47 4049847 1 2024-09-17T04:20:55.060 INFO:tasks.workunit.client.0.smithi088.stdout:4/129: symlink d5/l27 0 2024-09-17T04:20:55.060 INFO:tasks.workunit.client.0.smithi088.stdout:4/130: chown d5 0 1 2024-09-17T04:20:55.061 INFO:tasks.workunit.client.1.smithi134.stdout:6/545: chown de/d19/d74/d94/d9e 9410 1 2024-09-17T04:20:55.061 INFO:tasks.workunit.client.1.smithi134.stdout:5/422: dwrite d0/d3a/fc [0,4194304] 0 2024-09-17T04:20:55.064 INFO:tasks.workunit.client.1.smithi134.stdout:5/423: truncate d0/da/d29/f84 626378 0 2024-09-17T04:20:55.065 INFO:tasks.workunit.client.1.smithi134.stdout:9/817: chown d2/d5/d8/d16/d54/daf/d6d/daa/de2/dcf/fdc 3073348 1 2024-09-17T04:20:55.067 INFO:tasks.workunit.client.1.smithi134.stdout:9/818: fdatasync d2/d78/fc6 0 2024-09-17T04:20:55.069 INFO:tasks.workunit.client.1.smithi134.stdout:3/527: write de/d12/d15/d1d/f61 [2904911,128116] 0 2024-09-17T04:20:55.070 INFO:tasks.workunit.client.0.smithi088.stdout:2/118: dread d0/d1/f11 [0,4194304] 0 2024-09-17T04:20:55.071 INFO:tasks.workunit.client.1.smithi134.stdout:4/493: rename d0/d13/d40/d42/l6c to d0/df/d1e/d73/l9e 0 2024-09-17T04:20:55.075 INFO:tasks.workunit.client.0.smithi088.stdout:7/172: unlink d2/d1e/d23/f2d 0 2024-09-17T04:20:55.076 INFO:tasks.workunit.client.0.smithi088.stdout:7/173: stat d2/d1e/d23 0 2024-09-17T04:20:55.076 INFO:tasks.workunit.client.1.smithi134.stdout:4/494: fdatasync d0/d13/f14 0 2024-09-17T04:20:55.077 INFO:tasks.workunit.client.0.smithi088.stdout:7/174: chown d2/f1a 1927516 1 2024-09-17T04:20:55.078 INFO:tasks.workunit.client.0.smithi088.stdout:7/175: write d2/d4/d7/f15 [971263,59088] 0 2024-09-17T04:20:55.079 INFO:tasks.workunit.client.0.smithi088.stdout:7/176: write d2/d4/d7/d20/f22 [2163,40634] 0 2024-09-17T04:20:55.080 INFO:tasks.workunit.client.1.smithi134.stdout:6/546: dwrite de/d2b/f45 [0,4194304] 0 2024-09-17T04:20:55.080 INFO:tasks.workunit.client.0.smithi088.stdout:7/177: chown d2/f3 1731 1 2024-09-17T04:20:55.081 INFO:tasks.workunit.client.1.smithi134.stdout:2/454: dwrite f11 [8388608,4194304] 0 2024-09-17T04:20:55.081 INFO:tasks.workunit.client.1.smithi134.stdout:3/528: mkdir de/d12/d15/d1d/d2d/d31/d6a/d78/d7c/dad 0 2024-09-17T04:20:55.084 INFO:tasks.workunit.client.1.smithi134.stdout:2/455: chown d19/d27/d31/d34/d6d/l8b 0 1 2024-09-17T04:20:55.085 INFO:tasks.workunit.client.1.smithi134.stdout:4/495: mkdir d0/d3b/d9f 0 2024-09-17T04:20:55.088 INFO:tasks.workunit.client.0.smithi088.stdout:7/178: creat d2/d4/d7/d20/f3c x:0 0 0 2024-09-17T04:20:55.089 INFO:tasks.workunit.client.1.smithi134.stdout:9/819: dwrite d2/d5/d9/df/fb8 [0,4194304] 0 2024-09-17T04:20:55.090 INFO:tasks.workunit.client.0.smithi088.stdout:7/179: dread d2/d1e/f24 [0,4194304] 0 2024-09-17T04:20:55.091 INFO:tasks.workunit.client.1.smithi134.stdout:6/547: dwrite de/d19/d62/d34/f72 [0,4194304] 0 2024-09-17T04:20:55.092 INFO:tasks.workunit.client.0.smithi088.stdout:5/136: truncate d2/f5 2246139 0 2024-09-17T04:20:55.095 INFO:tasks.workunit.client.1.smithi134.stdout:7/344: sync 2024-09-17T04:20:55.097 INFO:tasks.workunit.client.0.smithi088.stdout:7/180: creat d2/d1d/f3d x:0 0 0 2024-09-17T04:20:55.100 INFO:tasks.workunit.client.1.smithi134.stdout:9/820: creat d2/d5/d8/d16/f115 x:0 0 0 2024-09-17T04:20:55.101 INFO:tasks.workunit.client.0.smithi088.stdout:5/137: creat d2/d9/d20/f2a x:0 0 0 2024-09-17T04:20:55.102 INFO:tasks.workunit.client.1.smithi134.stdout:3/529: write de/d10/d3d/f43 [1216167,44119] 0 2024-09-17T04:20:55.102 INFO:tasks.workunit.client.1.smithi134.stdout:4/496: dwrite d0/df/d35/d39/f7c [0,4194304] 0 2024-09-17T04:20:55.103 INFO:tasks.workunit.client.1.smithi134.stdout:5/424: getdents d0/da/d69/d41/d72 0 2024-09-17T04:20:55.107 INFO:tasks.workunit.client.1.smithi134.stdout:4/497: write d0/d13/f33 [5084562,116675] 0 2024-09-17T04:20:55.108 INFO:tasks.workunit.client.0.smithi088.stdout:2/119: getdents d0 0 2024-09-17T04:20:55.108 INFO:tasks.workunit.client.1.smithi134.stdout:6/548: dread de/f30 [0,4194304] 0 2024-09-17T04:20:55.109 INFO:tasks.workunit.client.1.smithi134.stdout:1/474: dwrite d12/d1c/d2e/d7d/f97 [0,4194304] 0 2024-09-17T04:20:55.110 INFO:tasks.workunit.client.1.smithi134.stdout:6/549: stat de/d19/d62/d7c 0 2024-09-17T04:20:55.117 INFO:tasks.workunit.client.1.smithi134.stdout:1/475: dwrite d12/f42 [0,4194304] 0 2024-09-17T04:20:55.118 INFO:tasks.workunit.client.0.smithi088.stdout:5/138: symlink d2/l2b 0 2024-09-17T04:20:55.125 INFO:tasks.workunit.client.1.smithi134.stdout:5/425: rmdir d0/d3a/d2b/d5a 39 2024-09-17T04:20:55.129 INFO:tasks.workunit.client.1.smithi134.stdout:1/476: dwrite d12/d1c/d4a/f4c [0,4194304] 0 2024-09-17T04:20:55.131 INFO:tasks.workunit.client.1.smithi134.stdout:7/345: link d0/d16/f5a d0/dd/d57/d6a/f6d 0 2024-09-17T04:20:55.131 INFO:tasks.workunit.client.1.smithi134.stdout:3/530: dwrite de/d12/d22/d5a/f71 [0,4194304] 0 2024-09-17T04:20:55.136 INFO:tasks.workunit.client.0.smithi088.stdout:4/131: dwrite d5/fb [0,4194304] 0 2024-09-17T04:20:55.137 INFO:tasks.workunit.client.0.smithi088.stdout:6/109: truncate d14/d15/d16/f21 5661216 0 2024-09-17T04:20:55.137 INFO:tasks.workunit.client.1.smithi134.stdout:9/821: link d2/d25/f3c d2/d5/d8/d16/d54/daf/d6d/daa/de2/dcd/dd6/dff/f116 0 2024-09-17T04:20:55.138 INFO:tasks.workunit.client.0.smithi088.stdout:6/110: write d14/d15/f22 [415754,3186] 0 2024-09-17T04:20:55.139 INFO:tasks.workunit.client.1.smithi134.stdout:4/498: rename d0/df/d1e/d63/c7a to d0/d3b/ca0 0 2024-09-17T04:20:55.140 INFO:tasks.workunit.client.0.smithi088.stdout:6/111: dread f11 [0,4194304] 0 2024-09-17T04:20:55.145 INFO:tasks.workunit.client.0.smithi088.stdout:4/132: creat d5/f28 x:0 0 0 2024-09-17T04:20:55.145 INFO:tasks.workunit.client.0.smithi088.stdout:4/133: fdatasync d5/f23 0 2024-09-17T04:20:55.146 INFO:tasks.workunit.client.0.smithi088.stdout:4/134: chown d5/c1d 3463 1 2024-09-17T04:20:55.146 INFO:tasks.workunit.client.0.smithi088.stdout:4/135: fsync d5/f21 0 2024-09-17T04:20:55.148 INFO:tasks.workunit.client.1.smithi134.stdout:9/822: creat d2/d5/d37/f117 x:0 0 0 2024-09-17T04:20:55.149 INFO:tasks.workunit.client.1.smithi134.stdout:9/823: write d2/d7/ff4 [4067483,89992] 0 2024-09-17T04:20:55.152 INFO:tasks.workunit.client.1.smithi134.stdout:5/426: mknod d0/d3a/c8c 0 2024-09-17T04:20:55.152 INFO:tasks.workunit.client.0.smithi088.stdout:5/139: dread d2/f5 [0,4194304] 0 2024-09-17T04:20:55.153 INFO:tasks.workunit.client.0.smithi088.stdout:4/136: mkdir d5/d29 0 2024-09-17T04:20:55.156 INFO:tasks.workunit.client.1.smithi134.stdout:5/427: dwrite d0/d48/f80 [0,4194304] 0 2024-09-17T04:20:55.158 INFO:tasks.workunit.client.0.smithi088.stdout:5/140: mkdir d2/d9/d20/d25/d2c 0 2024-09-17T04:20:55.160 INFO:tasks.workunit.client.0.smithi088.stdout:7/181: write d2/d4/f18 [160485,90643] 0 2024-09-17T04:20:55.162 INFO:tasks.workunit.client.1.smithi134.stdout:2/456: truncate d19/f22 1103229 0 2024-09-17T04:20:55.164 INFO:tasks.workunit.client.0.smithi088.stdout:8/89: sync 2024-09-17T04:20:55.164 INFO:tasks.workunit.client.0.smithi088.stdout:1/121: sync 2024-09-17T04:20:55.164 INFO:tasks.workunit.client.0.smithi088.stdout:0/59: sync 2024-09-17T04:20:55.164 INFO:tasks.workunit.client.0.smithi088.stdout:3/33: sync 2024-09-17T04:20:55.165 INFO:tasks.workunit.client.0.smithi088.stdout:9/130: sync 2024-09-17T04:20:55.167 INFO:tasks.workunit.client.0.smithi088.stdout:4/137: link d5/f21 d5/f2a 0 2024-09-17T04:20:55.167 INFO:tasks.workunit.client.1.smithi134.stdout:1/477: link d12/d1c/c1f d12/d1c/d2e/d7d/ca2 0 2024-09-17T04:20:55.168 INFO:tasks.workunit.client.1.smithi134.stdout:1/478: write d12/f1a [956678,87750] 0 2024-09-17T04:20:55.168 INFO:tasks.workunit.client.1.smithi134.stdout:1/479: chown d12/d1c/f2f 1621962 1 2024-09-17T04:20:55.169 INFO:tasks.workunit.client.1.smithi134.stdout:5/428: fsync d0/da/f2e 0 2024-09-17T04:20:55.170 INFO:tasks.workunit.client.1.smithi134.stdout:5/429: chown d0/d3a/f5b 21808784 1 2024-09-17T04:20:55.172 INFO:tasks.workunit.client.1.smithi134.stdout:7/346: dread d0/dd/d3a/d3d/d38/f18 [0,4194304] 0 2024-09-17T04:20:55.173 INFO:tasks.workunit.client.0.smithi088.stdout:4/138: chown d5/c16 707435 1 2024-09-17T04:20:55.173 INFO:tasks.workunit.client.0.smithi088.stdout:5/141: dwrite d2/f1d [0,4194304] 0 2024-09-17T04:20:55.174 INFO:tasks.workunit.client.1.smithi134.stdout:5/430: dread d0/d3a/fc [0,4194304] 0 2024-09-17T04:20:55.174 INFO:tasks.workunit.client.1.smithi134.stdout:2/457: chown d19/l56 7712 1 2024-09-17T04:20:55.175 INFO:tasks.workunit.client.1.smithi134.stdout:5/431: write d0/f79 [950029,110363] 0 2024-09-17T04:20:55.176 INFO:tasks.workunit.client.1.smithi134.stdout:5/432: chown d0/cb 490716 1 2024-09-17T04:20:55.176 INFO:tasks.workunit.client.1.smithi134.stdout:5/433: dread - d0/d48/f82 zero size 2024-09-17T04:20:55.178 INFO:tasks.workunit.client.0.smithi088.stdout:5/142: readlink d2/d9/l24 0 2024-09-17T04:20:55.179 INFO:tasks.workunit.client.0.smithi088.stdout:2/120: dwrite d0/d1/f11 [0,4194304] 0 2024-09-17T04:20:55.181 INFO:tasks.workunit.client.0.smithi088.stdout:7/182: dwrite d2/d4/d7/f36 [0,4194304] 0 2024-09-17T04:20:55.182 INFO:tasks.workunit.client.0.smithi088.stdout:0/60: dread f5 [0,4194304] 0 2024-09-17T04:20:55.185 INFO:tasks.workunit.client.0.smithi088.stdout:1/122: mkdir d0/d1/d16/d2a 0 2024-09-17T04:20:55.186 INFO:tasks.workunit.client.0.smithi088.stdout:1/123: stat d0/d1/fe 0 2024-09-17T04:20:55.187 INFO:tasks.workunit.client.0.smithi088.stdout:3/34: dread d0/f3 [0,4194304] 0 2024-09-17T04:20:55.188 INFO:tasks.workunit.client.1.smithi134.stdout:7/347: chown d0/dd/d3a/d3d/d4c/c67 58047 1 2024-09-17T04:20:55.188 INFO:tasks.workunit.client.0.smithi088.stdout:1/124: write d0/d1/fd [3687074,6829] 0 2024-09-17T04:20:55.188 INFO:tasks.workunit.client.0.smithi088.stdout:3/35: read d0/f4 [179866,78356] 0 2024-09-17T04:20:55.189 INFO:tasks.workunit.client.1.smithi134.stdout:7/348: chown d0/dd/d57/d6a/l63 987 1 2024-09-17T04:20:55.190 INFO:tasks.workunit.client.1.smithi134.stdout:2/458: fsync d19/d1c/f87 0 2024-09-17T04:20:55.191 INFO:tasks.workunit.client.0.smithi088.stdout:3/36: dread d0/f4 [0,4194304] 0 2024-09-17T04:20:55.197 INFO:tasks.workunit.client.1.smithi134.stdout:9/824: fsync d2/d5/d37/f117 0 2024-09-17T04:20:55.198 INFO:tasks.workunit.client.1.smithi134.stdout:9/825: chown d2/d78/fc0 55925 1 2024-09-17T04:20:55.199 INFO:tasks.workunit.client.0.smithi088.stdout:2/121: mkdir d0/d14/d24 0 2024-09-17T04:20:55.199 INFO:tasks.workunit.client.1.smithi134.stdout:4/499: dwrite d0/df/d1e/d73/f88 [0,4194304] 0 2024-09-17T04:20:55.200 INFO:tasks.workunit.client.1.smithi134.stdout:4/500: write d0/d13/f51 [1042634,125228] 0 2024-09-17T04:20:55.200 INFO:tasks.workunit.client.0.smithi088.stdout:7/183: rename d2/d4/c17 to d2/d4/d7/c3e 0 2024-09-17T04:20:55.201 INFO:tasks.workunit.client.0.smithi088.stdout:6/112: dwrite f4 [0,4194304] 0 2024-09-17T04:20:55.201 INFO:tasks.workunit.client.1.smithi134.stdout:7/349: truncate d0/f15 239730 0 2024-09-17T04:20:55.202 INFO:tasks.workunit.client.0.smithi088.stdout:0/61: mknod db/c15 0 2024-09-17T04:20:55.205 INFO:tasks.workunit.client.1.smithi134.stdout:5/434: creat d0/da/d29/d78/f8d x:0 0 0 2024-09-17T04:20:55.206 INFO:tasks.workunit.client.1.smithi134.stdout:5/435: fdatasync d0/d3a/d2b/f34 0 2024-09-17T04:20:55.208 INFO:tasks.workunit.client.0.smithi088.stdout:5/143: symlink d2/d9/l2d 0 2024-09-17T04:20:55.209 INFO:tasks.workunit.client.0.smithi088.stdout:5/144: chown d2/d9/fa 11266 1 2024-09-17T04:20:55.209 INFO:tasks.workunit.client.1.smithi134.stdout:5/436: dread - d0/da/d69/d41/d6d/f76 zero size 2024-09-17T04:20:55.209 INFO:tasks.workunit.client.1.smithi134.stdout:2/459: mkdir d19/d1c/d92 0 2024-09-17T04:20:55.215 INFO:tasks.workunit.client.1.smithi134.stdout:5/437: dwrite d0/f39 [0,4194304] 0 2024-09-17T04:20:55.215 INFO:tasks.workunit.client.1.smithi134.stdout:2/460: dread d19/d1c/f1d [0,4194304] 0 2024-09-17T04:20:55.218 INFO:tasks.workunit.client.1.smithi134.stdout:4/501: symlink d0/d13/d40/d42/d92/d65/la1 0 2024-09-17T04:20:55.218 INFO:tasks.workunit.client.1.smithi134.stdout:5/438: read - d0/da/d69/d41/d6d/f76 zero size 2024-09-17T04:20:55.219 INFO:tasks.workunit.client.1.smithi134.stdout:7/350: truncate d0/dd/d3a/d3d/d38/f1d 1320533 0 2024-09-17T04:20:55.221 INFO:tasks.workunit.client.1.smithi134.stdout:1/480: dwrite d12/d19/d1d/f6b [0,4194304] 0 2024-09-17T04:20:55.222 INFO:tasks.workunit.client.0.smithi088.stdout:6/113: creat d14/d15/d16/f25 x:0 0 0 2024-09-17T04:20:55.223 INFO:tasks.workunit.client.0.smithi088.stdout:0/62: readlink db/le 0 2024-09-17T04:20:55.225 INFO:tasks.workunit.client.1.smithi134.stdout:0/409: sync 2024-09-17T04:20:55.225 INFO:tasks.workunit.client.1.smithi134.stdout:8/409: sync 2024-09-17T04:20:55.226 INFO:tasks.workunit.client.0.smithi088.stdout:4/139: mknod d5/d29/c2b 0 2024-09-17T04:20:55.226 INFO:tasks.workunit.client.1.smithi134.stdout:2/461: dwrite d19/d27/d31/f4c [4194304,4194304] 0 2024-09-17T04:20:55.226 INFO:tasks.workunit.client.1.smithi134.stdout:8/410: fsync d4/d1f/f71 0 2024-09-17T04:20:55.228 INFO:tasks.workunit.client.1.smithi134.stdout:8/411: chown d4/d1f/d2b/c4d 177 1 2024-09-17T04:20:55.229 INFO:tasks.workunit.client.1.smithi134.stdout:5/439: mkdir d0/da/d29/d8e 0 2024-09-17T04:20:55.233 INFO:tasks.workunit.client.1.smithi134.stdout:7/351: write d0/dd/d3a/f4f [1015408,115927] 0 2024-09-17T04:20:55.237 INFO:tasks.workunit.client.0.smithi088.stdout:8/90: rename d7/dd/d10 to d7/dd/d20 0 2024-09-17T04:20:55.237 INFO:tasks.workunit.client.0.smithi088.stdout:8/91: chown d7/dd 30 1 2024-09-17T04:20:55.239 INFO:tasks.workunit.client.0.smithi088.stdout:2/122: creat d0/d14/d17/d22/f25 x:0 0 0 2024-09-17T04:20:55.239 INFO:tasks.workunit.client.1.smithi134.stdout:8/412: creat d4/f82 x:0 0 0 2024-09-17T04:20:55.239 INFO:tasks.workunit.client.0.smithi088.stdout:2/123: fdatasync d0/f9 0 2024-09-17T04:20:55.241 INFO:tasks.workunit.client.1.smithi134.stdout:0/410: dwrite d11/d22/d1c/d2f/d45/f74 [0,4194304] 0 2024-09-17T04:20:55.241 INFO:tasks.workunit.client.0.smithi088.stdout:9/131: truncate d2/dd/fe 456327 0 2024-09-17T04:20:55.244 INFO:tasks.workunit.client.1.smithi134.stdout:0/411: dread - d11/d22/d1c/d2f/f55 zero size 2024-09-17T04:20:55.244 INFO:tasks.workunit.client.1.smithi134.stdout:9/826: dwrite d2/d5/d37/d7c/f8e [0,4194304] 0 2024-09-17T04:20:55.246 INFO:tasks.workunit.client.1.smithi134.stdout:9/827: chown d2/d7/d75/d96/dca 38 1 2024-09-17T04:20:55.246 INFO:tasks.workunit.client.0.smithi088.stdout:0/63: symlink db/l16 0 2024-09-17T04:20:55.248 INFO:tasks.workunit.client.0.smithi088.stdout:3/37: dwrite d0/f3 [0,4194304] 0 2024-09-17T04:20:55.249 INFO:tasks.workunit.client.0.smithi088.stdout:0/64: readlink db/le 0 2024-09-17T04:20:55.251 INFO:tasks.workunit.client.1.smithi134.stdout:6/550: sync 2024-09-17T04:20:55.251 INFO:tasks.workunit.client.1.smithi134.stdout:3/531: sync 2024-09-17T04:20:55.253 INFO:tasks.workunit.client.0.smithi088.stdout:2/124: dread d0/f9 [0,4194304] 0 2024-09-17T04:20:55.253 INFO:tasks.workunit.client.1.smithi134.stdout:8/413: creat d4/f83 x:0 0 0 2024-09-17T04:20:55.260 INFO:tasks.workunit.client.0.smithi088.stdout:6/114: dwrite f4 [4194304,4194304] 0 2024-09-17T04:20:55.261 INFO:tasks.workunit.client.1.smithi134.stdout:7/352: dread d0/dd/d3a/d3d/d38/f3c [0,4194304] 0 2024-09-17T04:20:55.262 INFO:tasks.workunit.client.1.smithi134.stdout:7/353: readlink d0/d16/l42 0 2024-09-17T04:20:55.262 INFO:tasks.workunit.client.0.smithi088.stdout:0/65: unlink f5 0 2024-09-17T04:20:55.263 INFO:tasks.workunit.client.0.smithi088.stdout:7/184: dwrite d2/d4/f14 [0,4194304] 0 2024-09-17T04:20:55.267 INFO:tasks.workunit.client.1.smithi134.stdout:6/551: read de/d19/d21/d2d/f39 [1352542,77084] 0 2024-09-17T04:20:55.268 INFO:tasks.workunit.client.1.smithi134.stdout:7/354: dread d0/dd/f54 [0,4194304] 0 2024-09-17T04:20:55.268 INFO:tasks.workunit.client.0.smithi088.stdout:8/92: symlink d7/dd/l21 0 2024-09-17T04:20:55.269 INFO:tasks.workunit.client.0.smithi088.stdout:3/38: dread d0/f4 [0,4194304] 0 2024-09-17T04:20:55.270 INFO:tasks.workunit.client.1.smithi134.stdout:6/552: stat de/d19/d62/d34/l7f 0 2024-09-17T04:20:55.270 INFO:tasks.workunit.client.1.smithi134.stdout:8/414: creat d4/d23/f84 x:0 0 0 2024-09-17T04:20:55.270 INFO:tasks.workunit.client.1.smithi134.stdout:9/828: dread d2/d5/d9/d6b/de1/f5c [0,4194304] 0 2024-09-17T04:20:55.271 INFO:tasks.workunit.client.1.smithi134.stdout:7/355: dread - d0/dd/d3a/d3d/f61 zero size 2024-09-17T04:20:55.271 INFO:tasks.workunit.client.1.smithi134.stdout:2/462: dread d19/d27/d31/d34/f82 [0,4194304] 0 2024-09-17T04:20:55.271 INFO:tasks.workunit.client.0.smithi088.stdout:0/66: creat db/f17 x:0 0 0 2024-09-17T04:20:55.271 INFO:tasks.workunit.client.0.smithi088.stdout:1/125: truncate d0/d13/f1e 3748640 0 2024-09-17T04:20:55.272 INFO:tasks.workunit.client.0.smithi088.stdout:1/126: chown d0/d1/f1a 65514 1 2024-09-17T04:20:55.273 INFO:tasks.workunit.client.1.smithi134.stdout:9/829: dread - d2/d5/d37/d83/fe9 zero size 2024-09-17T04:20:55.273 INFO:tasks.workunit.client.1.smithi134.stdout:1/481: getdents d12/d1c/d2e 0 2024-09-17T04:20:55.274 INFO:tasks.workunit.client.0.smithi088.stdout:6/115: creat d14/d15/d16/f26 x:0 0 0 2024-09-17T04:20:55.275 INFO:tasks.workunit.client.1.smithi134.stdout:1/482: write d12/d1c/d2e/f75 [68156,93666] 0 2024-09-17T04:20:55.276 INFO:tasks.workunit.client.1.smithi134.stdout:4/502: link d0/d13/d40/d72/c8a d0/d13/d40/ca2 0 2024-09-17T04:20:55.276 INFO:tasks.workunit.client.0.smithi088.stdout:7/185: rmdir d2/d4 39 2024-09-17T04:20:55.277 INFO:tasks.workunit.client.1.smithi134.stdout:5/440: write d0/d3a/fc [695665,97698] 0 2024-09-17T04:20:55.278 INFO:tasks.workunit.client.1.smithi134.stdout:4/503: write d0/df/f4e [866411,58637] 0 2024-09-17T04:20:55.279 INFO:tasks.workunit.client.1.smithi134.stdout:0/412: dread d11/d22/f3e [0,4194304] 0 2024-09-17T04:20:55.279 INFO:tasks.workunit.client.1.smithi134.stdout:1/483: truncate d12/d1c/d4a/f4c 4412624 0 2024-09-17T04:20:55.279 INFO:tasks.workunit.client.1.smithi134.stdout:5/441: chown d0/d3a/c7d 231389456 1 2024-09-17T04:20:55.279 INFO:tasks.workunit.client.1.smithi134.stdout:0/413: stat d11/d48 0 2024-09-17T04:20:55.280 INFO:tasks.workunit.client.1.smithi134.stdout:0/414: chown d11/d48/l53 2119 1 2024-09-17T04:20:55.281 INFO:tasks.workunit.client.1.smithi134.stdout:3/532: link de/d12/d22/f81 de/d12/d15/d1d/d2d/d63/fae 0 2024-09-17T04:20:55.282 INFO:tasks.workunit.client.0.smithi088.stdout:3/39: write d0/f3 [1369322,125577] 0 2024-09-17T04:20:55.282 INFO:tasks.workunit.client.0.smithi088.stdout:3/40: readlink d0/l5 0 2024-09-17T04:20:55.283 INFO:tasks.workunit.client.0.smithi088.stdout:0/67: mknod db/c18 0 2024-09-17T04:20:55.284 INFO:tasks.workunit.client.0.smithi088.stdout:3/41: write d0/f4 [1917354,53686] 0 2024-09-17T04:20:55.284 INFO:tasks.workunit.client.0.smithi088.stdout:0/68: fsync db/f10 0 2024-09-17T04:20:55.285 INFO:tasks.workunit.client.1.smithi134.stdout:4/504: dread d0/df/d35/f89 [0,4194304] 0 2024-09-17T04:20:55.285 INFO:tasks.workunit.client.1.smithi134.stdout:4/505: stat d0/df/d35/d39/f7c 0 2024-09-17T04:20:55.285 INFO:tasks.workunit.client.1.smithi134.stdout:7/356: unlink d0/dd/d57/f5f 0 2024-09-17T04:20:55.286 INFO:tasks.workunit.client.0.smithi088.stdout:6/116: write f9 [4094187,15199] 0 2024-09-17T04:20:55.287 INFO:tasks.workunit.client.1.smithi134.stdout:4/506: write d0/df/d17/f24 [2990771,62530] 0 2024-09-17T04:20:55.287 INFO:tasks.workunit.client.0.smithi088.stdout:6/117: read f10 [1464163,84683] 0 2024-09-17T04:20:55.287 INFO:tasks.workunit.client.1.smithi134.stdout:2/463: mkdir d19/d1c/d47/d50/d85/d93 0 2024-09-17T04:20:55.292 INFO:tasks.workunit.client.0.smithi088.stdout:7/186: dread d2/d4/d7/f15 [0,4194304] 0 2024-09-17T04:20:55.292 INFO:tasks.workunit.client.1.smithi134.stdout:8/415: rename d4/d23/d60/d6b/d5e/f66 to d4/d1f/d25/d6a/f85 0 2024-09-17T04:20:55.293 INFO:tasks.workunit.client.0.smithi088.stdout:7/187: write d2/d4/d7/f36 [4710222,48383] 0 2024-09-17T04:20:55.294 INFO:tasks.workunit.client.0.smithi088.stdout:7/188: truncate d2/d4/f33 264070 0 2024-09-17T04:20:55.296 INFO:tasks.workunit.client.0.smithi088.stdout:5/145: truncate d2/f10 2113396 0 2024-09-17T04:20:55.297 INFO:tasks.workunit.client.0.smithi088.stdout:3/42: rmdir d0 39 2024-09-17T04:20:55.300 INFO:tasks.workunit.client.0.smithi088.stdout:6/118: mknod d14/d15/d16/c27 0 2024-09-17T04:20:55.301 INFO:tasks.workunit.client.0.smithi088.stdout:4/140: truncate d5/f1f 2231319 0 2024-09-17T04:20:55.301 INFO:tasks.workunit.client.1.smithi134.stdout:0/415: rmdir d11/d48 39 2024-09-17T04:20:55.301 INFO:tasks.workunit.client.0.smithi088.stdout:4/141: write d5/f28 [1001670,46492] 0 2024-09-17T04:20:55.302 INFO:tasks.workunit.client.0.smithi088.stdout:4/142: chown d5/l1c 14167 1 2024-09-17T04:20:55.302 INFO:tasks.workunit.client.0.smithi088.stdout:4/143: dread - d5/f2a zero size 2024-09-17T04:20:55.304 INFO:tasks.workunit.client.1.smithi134.stdout:3/533: dread de/d12/d15/d1d/f62 [0,4194304] 0 2024-09-17T04:20:55.307 INFO:tasks.workunit.client.1.smithi134.stdout:7/357: rmdir d0/dd 39 2024-09-17T04:20:55.310 INFO:tasks.workunit.client.0.smithi088.stdout:5/146: creat d2/d9/d20/f2e x:0 0 0 2024-09-17T04:20:55.311 INFO:tasks.workunit.client.0.smithi088.stdout:5/147: write d2/d9/fc [4510547,25670] 0 2024-09-17T04:20:55.312 INFO:tasks.workunit.client.0.smithi088.stdout:8/93: write d7/dd/d20/f12 [4325102,78432] 0 2024-09-17T04:20:55.312 INFO:tasks.workunit.client.0.smithi088.stdout:5/148: fdatasync d2/d9/fa 0 2024-09-17T04:20:55.314 INFO:tasks.workunit.client.0.smithi088.stdout:8/94: read d7/f9 [3131433,89848] 0 2024-09-17T04:20:55.315 INFO:tasks.workunit.client.1.smithi134.stdout:3/534: dread de/d12/d15/f4d [0,4194304] 0 2024-09-17T04:20:55.317 INFO:tasks.workunit.client.0.smithi088.stdout:6/119: symlink d14/l28 0 2024-09-17T04:20:55.323 INFO:tasks.workunit.client.1.smithi134.stdout:2/464: dread d19/d1c/f2d [0,4194304] 0 2024-09-17T04:20:55.323 INFO:tasks.workunit.client.0.smithi088.stdout:4/144: chown d5/l19 5024 1 2024-09-17T04:20:55.325 INFO:tasks.workunit.client.1.smithi134.stdout:2/465: dread d19/d1c/f1d [4194304,4194304] 0 2024-09-17T04:20:55.326 INFO:tasks.workunit.client.1.smithi134.stdout:5/442: mknod d0/da/d29/d8e/c8f 0 2024-09-17T04:20:55.327 INFO:tasks.workunit.client.0.smithi088.stdout:1/127: dwrite d0/d1/fa [0,4194304] 0 2024-09-17T04:20:55.328 INFO:tasks.workunit.client.1.smithi134.stdout:0/416: creat d11/d19/d21/d37/f8b x:0 0 0 2024-09-17T04:20:55.329 INFO:tasks.workunit.client.0.smithi088.stdout:1/128: write d0/d1/df/f22 [966185,91873] 0 2024-09-17T04:20:55.335 INFO:tasks.workunit.client.1.smithi134.stdout:4/507: mkdir d0/df/d1e/da3 0 2024-09-17T04:20:55.338 INFO:tasks.workunit.client.0.smithi088.stdout:5/149: rename d2/fd to d2/d9/f2f 0 2024-09-17T04:20:55.339 INFO:tasks.workunit.client.0.smithi088.stdout:3/43: dwrite d0/f2 [0,4194304] 0 2024-09-17T04:20:55.340 INFO:tasks.workunit.client.1.smithi134.stdout:6/553: truncate de/d19/f61 1932396 0 2024-09-17T04:20:55.340 INFO:tasks.workunit.client.0.smithi088.stdout:5/150: fdatasync d2/d9/d20/f2e 0 2024-09-17T04:20:55.341 INFO:tasks.workunit.client.0.smithi088.stdout:3/44: write d0/f2 [3971044,77741] 0 2024-09-17T04:20:55.341 INFO:tasks.workunit.client.0.smithi088.stdout:8/95: mknod d7/c22 0 2024-09-17T04:20:55.342 INFO:tasks.workunit.client.0.smithi088.stdout:3/45: fdatasync d0/f4 0 2024-09-17T04:20:55.343 INFO:tasks.workunit.client.0.smithi088.stdout:3/46: stat d0/f2 0 2024-09-17T04:20:55.343 INFO:tasks.workunit.client.0.smithi088.stdout:0/69: truncate db/f11 3909860 0 2024-09-17T04:20:55.343 INFO:tasks.workunit.client.0.smithi088.stdout:3/47: chown d0/f4 1 1 2024-09-17T04:20:55.344 INFO:tasks.workunit.client.0.smithi088.stdout:0/70: dread - db/f12 zero size 2024-09-17T04:20:55.344 INFO:tasks.workunit.client.1.smithi134.stdout:8/416: mkdir d4/d1f/d86 0 2024-09-17T04:20:55.345 INFO:tasks.workunit.client.0.smithi088.stdout:6/120: mkdir d14/d15/d29 0 2024-09-17T04:20:55.345 INFO:tasks.workunit.client.0.smithi088.stdout:0/71: write db/fc [5624321,29852] 0 2024-09-17T04:20:55.346 INFO:tasks.workunit.client.0.smithi088.stdout:0/72: fsync db/f17 0 2024-09-17T04:20:55.346 INFO:tasks.workunit.client.0.smithi088.stdout:3/48: truncate d0/f3 5038342 0 2024-09-17T04:20:55.347 INFO:tasks.workunit.client.0.smithi088.stdout:0/73: write db/f13 [1018039,78288] 0 2024-09-17T04:20:55.347 INFO:tasks.workunit.client.0.smithi088.stdout:4/145: fsync d5/f26 0 2024-09-17T04:20:55.348 INFO:tasks.workunit.client.1.smithi134.stdout:1/484: creat d12/fa3 x:0 0 0 2024-09-17T04:20:55.349 INFO:tasks.workunit.client.1.smithi134.stdout:1/485: chown d12/d36/f9c 1712675 1 2024-09-17T04:20:55.349 INFO:tasks.workunit.client.0.smithi088.stdout:7/189: link d2/d4/c1f d2/d1e/d23/c3f 0 2024-09-17T04:20:55.352 INFO:tasks.workunit.client.1.smithi134.stdout:2/466: rename d19/d27/d64 to d19/d27/d31/d49/d63/d94 0 2024-09-17T04:20:55.352 INFO:tasks.workunit.client.0.smithi088.stdout:7/190: fsync d2/d4/d7/f34 0 2024-09-17T04:20:55.354 INFO:tasks.workunit.client.0.smithi088.stdout:0/74: dread f1 [0,4194304] 0 2024-09-17T04:20:55.355 INFO:tasks.workunit.client.0.smithi088.stdout:3/49: fdatasync d0/f2 0 2024-09-17T04:20:55.357 INFO:tasks.workunit.client.1.smithi134.stdout:0/417: write d11/d18/f1f [3944337,3733] 0 2024-09-17T04:20:55.359 INFO:tasks.workunit.client.1.smithi134.stdout:5/443: dwrite d0/d3a/d2b/f31 [0,4194304] 0 2024-09-17T04:20:55.360 INFO:tasks.workunit.client.1.smithi134.stdout:4/508: creat d0/df/d35/d5c/d8b/fa4 x:0 0 0 2024-09-17T04:20:55.361 INFO:tasks.workunit.client.0.smithi088.stdout:0/75: dread f0 [0,4194304] 0 2024-09-17T04:20:55.362 INFO:tasks.workunit.client.0.smithi088.stdout:7/191: dwrite d2/d1e/f30 [0,4194304] 0 2024-09-17T04:20:55.363 INFO:tasks.workunit.client.0.smithi088.stdout:1/129: rename d0/d1/df/f22 to d0/d1/d27/f2b 0 2024-09-17T04:20:55.363 INFO:tasks.workunit.client.1.smithi134.stdout:4/509: dread d0/df/d35/d39/f7c [0,4194304] 0 2024-09-17T04:20:55.367 INFO:tasks.workunit.client.1.smithi134.stdout:6/554: truncate de/d19/d21/f25 1302748 0 2024-09-17T04:20:55.369 INFO:tasks.workunit.client.0.smithi088.stdout:8/96: truncate f2 378329 0 2024-09-17T04:20:55.370 INFO:tasks.workunit.client.1.smithi134.stdout:9/830: getdents d2/d7/d75 0 2024-09-17T04:20:55.375 INFO:tasks.workunit.client.1.smithi134.stdout:7/358: rename d0/dd/d3a/f5c to d0/d16/d35/d4b/d65/f6e 0 2024-09-17T04:20:55.376 INFO:tasks.workunit.client.0.smithi088.stdout:6/121: mkdir d14/d15/d2a 0 2024-09-17T04:20:55.378 INFO:tasks.workunit.client.1.smithi134.stdout:2/467: creat d19/d1c/d47/d50/f95 x:0 0 0 2024-09-17T04:20:55.379 INFO:tasks.workunit.client.1.smithi134.stdout:0/418: read d11/d24/f7e [237747,93401] 0 2024-09-17T04:20:55.380 INFO:tasks.workunit.client.1.smithi134.stdout:5/444: mknod d0/da/d29/d8e/c90 0 2024-09-17T04:20:55.381 INFO:tasks.workunit.client.1.smithi134.stdout:5/445: truncate d0/da/d29/f84 1330734 0 2024-09-17T04:20:55.385 INFO:tasks.workunit.client.1.smithi134.stdout:1/486: dread d12/d19/d4f/f7f [0,4194304] 0 2024-09-17T04:20:55.386 INFO:tasks.workunit.client.1.smithi134.stdout:1/487: truncate d12/d19/d1d/d5f/f87 618436 0 2024-09-17T04:20:55.401 INFO:tasks.workunit.client.1.smithi134.stdout:0/419: dread f10 [0,4194304] 0 2024-09-17T04:20:55.402 INFO:tasks.workunit.client.1.smithi134.stdout:0/420: fdatasync d11/d22/f3e 0 2024-09-17T04:20:55.417 INFO:tasks.workunit.client.1.smithi134.stdout:6/555: unlink de/f30 0 2024-09-17T04:20:55.417 INFO:tasks.workunit.client.1.smithi134.stdout:3/535: truncate de/d12/d22/d5a/f71 777725 0 2024-09-17T04:20:55.419 INFO:tasks.workunit.client.1.smithi134.stdout:6/556: read de/d2b/f70 [969299,66680] 0 2024-09-17T04:20:55.419 INFO:tasks.workunit.client.1.smithi134.stdout:9/831: mkdir d2/d5/d37/d7c/d118 0 2024-09-17T04:20:55.427 INFO:tasks.workunit.client.1.smithi134.stdout:7/359: dread d0/f15 [0,4194304] 0 2024-09-17T04:20:55.428 INFO:tasks.workunit.client.1.smithi134.stdout:8/417: rename d4/d23/d60/d6b/d13/l41 to d4/d1f/d86/l87 0 2024-09-17T04:20:55.433 INFO:tasks.workunit.client.1.smithi134.stdout:2/468: read fc [5657923,113529] 0 2024-09-17T04:20:55.438 INFO:tasks.workunit.client.0.smithi088.stdout:0/76: creat db/f19 x:0 0 0 2024-09-17T04:20:55.446 INFO:tasks.workunit.client.0.smithi088.stdout:7/192: symlink d2/d1e/l40 0 2024-09-17T04:20:55.447 INFO:tasks.workunit.client.1.smithi134.stdout:8/418: dread f3 [4194304,4194304] 0 2024-09-17T04:20:55.451 INFO:tasks.workunit.client.0.smithi088.stdout:1/130: rename d0/d1/d27/f2b to d0/d1/f2c 0 2024-09-17T04:20:55.451 INFO:tasks.workunit.client.0.smithi088.stdout:1/131: fdatasync d0/d1/df/f10 0 2024-09-17T04:20:55.455 INFO:tasks.workunit.client.0.smithi088.stdout:6/122: mkdir d14/d15/d2b 0 2024-09-17T04:20:55.458 INFO:tasks.workunit.client.1.smithi134.stdout:3/536: dwrite de/d12/d15/d1d/f62 [0,4194304] 0 2024-09-17T04:20:55.459 INFO:tasks.workunit.client.1.smithi134.stdout:9/832: creat d2/d5/d58/f119 x:0 0 0 2024-09-17T04:20:55.459 INFO:tasks.workunit.client.0.smithi088.stdout:1/132: dwrite d0/d1/fa [0,4194304] 0 2024-09-17T04:20:55.463 INFO:tasks.workunit.client.0.smithi088.stdout:4/146: unlink d5/f26 0 2024-09-17T04:20:55.464 INFO:tasks.workunit.client.0.smithi088.stdout:4/147: chown d5/d29/c2b 199908157 1 2024-09-17T04:20:55.475 INFO:tasks.workunit.client.0.smithi088.stdout:7/193: symlink d2/d1e/l41 0 2024-09-17T04:20:55.477 INFO:tasks.workunit.client.1.smithi134.stdout:2/469: mkdir d19/d1c/d47/d50/d96 0 2024-09-17T04:20:55.480 INFO:tasks.workunit.client.1.smithi134.stdout:4/510: link d0/df/c15 d0/d78/ca5 0 2024-09-17T04:20:55.481 INFO:tasks.workunit.client.1.smithi134.stdout:4/511: write d0/df/d35/d5c/f94 [649114,83017] 0 2024-09-17T04:20:55.485 INFO:tasks.workunit.client.0.smithi088.stdout:8/97: symlink d7/dd/l23 0 2024-09-17T04:20:55.486 INFO:tasks.workunit.client.1.smithi134.stdout:4/512: dread d0/df/d35/d5c/f94 [0,4194304] 0 2024-09-17T04:20:55.490 INFO:tasks.workunit.client.0.smithi088.stdout:1/133: mknod d0/d1/d27/c2d 0 2024-09-17T04:20:55.493 INFO:tasks.workunit.client.0.smithi088.stdout:4/148: mkdir d5/d29/d2c 0 2024-09-17T04:20:55.493 INFO:tasks.workunit.client.0.smithi088.stdout:8/98: dwrite d7/dd/f16 [0,4194304] 0 2024-09-17T04:20:55.494 INFO:tasks.workunit.client.0.smithi088.stdout:8/99: dread - d7/dd/ff zero size 2024-09-17T04:20:55.496 INFO:tasks.workunit.client.0.smithi088.stdout:3/50: link d0/f2 d0/f6 0 2024-09-17T04:20:55.497 INFO:tasks.workunit.client.0.smithi088.stdout:3/51: chown d0/f2 999342017 1 2024-09-17T04:20:55.498 INFO:tasks.workunit.client.0.smithi088.stdout:7/194: fdatasync d2/d1e/d23/f2f 0 2024-09-17T04:20:55.500 INFO:tasks.workunit.client.1.smithi134.stdout:9/833: unlink d2/d5/d37/l46 0 2024-09-17T04:20:55.502 INFO:tasks.workunit.client.0.smithi088.stdout:6/123: creat d14/d15/d2b/f2c x:0 0 0 2024-09-17T04:20:55.502 INFO:tasks.workunit.client.0.smithi088.stdout:8/100: dwrite d7/dd/d20/f12 [0,4194304] 0 2024-09-17T04:20:55.503 INFO:tasks.workunit.client.1.smithi134.stdout:7/360: symlink d0/d16/l6f 0 2024-09-17T04:20:55.503 INFO:tasks.workunit.client.0.smithi088.stdout:6/124: read - d14/d15/d2b/f2c zero size 2024-09-17T04:20:55.507 INFO:tasks.workunit.client.0.smithi088.stdout:1/134: creat d0/d1/df/d20/f2e x:0 0 0 2024-09-17T04:20:55.508 INFO:tasks.workunit.client.0.smithi088.stdout:1/135: dread - d0/d1/df/d20/f29 zero size 2024-09-17T04:20:55.510 INFO:tasks.workunit.client.0.smithi088.stdout:4/149: creat d5/f2d x:0 0 0 2024-09-17T04:20:55.515 INFO:tasks.workunit.client.0.smithi088.stdout:8/101: creat d7/f24 x:0 0 0 2024-09-17T04:20:55.520 INFO:tasks.workunit.client.0.smithi088.stdout:1/136: creat d0/d13/f2f x:0 0 0 2024-09-17T04:20:55.524 INFO:tasks.workunit.client.0.smithi088.stdout:8/102: rename d7/dd/c1f to d7/dd/d20/c25 0 2024-09-17T04:20:55.525 INFO:tasks.workunit.client.0.smithi088.stdout:8/103: dread - d7/dd/f15 zero size 2024-09-17T04:20:55.527 INFO:tasks.workunit.client.0.smithi088.stdout:6/125: creat d14/d15/d29/f2d x:0 0 0 2024-09-17T04:20:55.528 INFO:tasks.workunit.client.0.smithi088.stdout:1/137: write d0/f4 [842827,72615] 0 2024-09-17T04:20:55.530 INFO:tasks.workunit.client.0.smithi088.stdout:3/52: creat d0/f7 x:0 0 0 2024-09-17T04:20:55.530 INFO:tasks.workunit.client.0.smithi088.stdout:3/53: chown d0/l5 80706 1 2024-09-17T04:20:55.531 INFO:tasks.workunit.client.1.smithi134.stdout:5/446: creat d0/da/d69/f91 x:0 0 0 2024-09-17T04:20:55.532 INFO:tasks.workunit.client.0.smithi088.stdout:4/150: dread f1 [0,4194304] 0 2024-09-17T04:20:55.532 INFO:tasks.workunit.client.1.smithi134.stdout:6/557: mkdir de/d19/d1f/dae 0 2024-09-17T04:20:55.534 INFO:tasks.workunit.client.0.smithi088.stdout:6/126: creat d14/d15/d16/f2e x:0 0 0 2024-09-17T04:20:55.536 INFO:tasks.workunit.client.0.smithi088.stdout:1/138: write d0/d1/f2c [2052987,96696] 0 2024-09-17T04:20:55.540 INFO:tasks.workunit.client.1.smithi134.stdout:4/513: write d0/f43 [2525034,16756] 0 2024-09-17T04:20:55.543 INFO:tasks.workunit.client.0.smithi088.stdout:6/127: mkdir d14/d2f 0 2024-09-17T04:20:55.544 INFO:tasks.workunit.client.0.smithi088.stdout:1/139: mknod d0/d1/d16/c30 0 2024-09-17T04:20:55.545 INFO:tasks.workunit.client.1.smithi134.stdout:9/834: mkdir d2/d7/d75/d11a 0 2024-09-17T04:20:55.546 INFO:tasks.workunit.client.0.smithi088.stdout:3/54: mknod d0/c8 0 2024-09-17T04:20:55.548 INFO:tasks.workunit.client.1.smithi134.stdout:7/361: mkdir d0/dd/d57/d6a/d70 0 2024-09-17T04:20:55.548 INFO:tasks.workunit.client.1.smithi134.stdout:7/362: write d0/d16/d35/f40 [160923,79516] 0 2024-09-17T04:20:55.548 INFO:tasks.workunit.client.0.smithi088.stdout:8/104: rename d7/dd/l23 to d7/dd/l26 0 2024-09-17T04:20:55.554 INFO:tasks.workunit.client.0.smithi088.stdout:6/128: creat d14/d15/d16/f30 x:0 0 0 2024-09-17T04:20:55.555 INFO:tasks.workunit.client.0.smithi088.stdout:6/129: write d14/d15/d2b/f2c [971120,19412] 0 2024-09-17T04:20:55.558 INFO:tasks.workunit.client.0.smithi088.stdout:3/55: unlink d0/l5 0 2024-09-17T04:20:55.562 INFO:tasks.workunit.client.0.smithi088.stdout:1/140: symlink d0/d1/d16/d2a/l31 0 2024-09-17T04:20:55.563 INFO:tasks.workunit.client.0.smithi088.stdout:8/105: dread f2 [0,4194304] 0 2024-09-17T04:20:55.564 INFO:tasks.workunit.client.0.smithi088.stdout:6/130: rmdir d14/d15/d16 39 2024-09-17T04:20:55.565 INFO:tasks.workunit.client.0.smithi088.stdout:6/131: dread - d14/d15/d29/f2d zero size 2024-09-17T04:20:55.570 INFO:tasks.workunit.client.1.smithi134.stdout:0/421: getdents d11/d4c/d76 0 2024-09-17T04:20:55.570 INFO:tasks.workunit.client.1.smithi134.stdout:9/835: rmdir d2/d78 39 2024-09-17T04:20:55.571 INFO:tasks.workunit.client.1.smithi134.stdout:6/558: symlink de/d5d/d67/laf 0 2024-09-17T04:20:55.571 INFO:tasks.workunit.client.1.smithi134.stdout:7/363: rename d0/dd/d3a/d3d/d38/c29 to d0/d16/d35/d4b/d65/c71 0 2024-09-17T04:20:55.571 INFO:tasks.workunit.client.1.smithi134.stdout:4/514: fdatasync d0/d13/d40/d42/f4f 0 2024-09-17T04:20:55.572 INFO:tasks.workunit.client.0.smithi088.stdout:3/56: dwrite d0/f2 [0,4194304] 0 2024-09-17T04:20:55.572 INFO:tasks.workunit.client.0.smithi088.stdout:8/106: mknod d7/c27 0 2024-09-17T04:20:55.573 INFO:tasks.workunit.client.1.smithi134.stdout:6/559: dread - de/d19/d21/d4d/fa4 zero size 2024-09-17T04:20:55.573 INFO:tasks.workunit.client.0.smithi088.stdout:8/107: chown d7/cb 58214114 1 2024-09-17T04:20:55.574 INFO:tasks.workunit.client.1.smithi134.stdout:6/560: write de/d2b/f45 [4316080,108347] 0 2024-09-17T04:20:55.574 INFO:tasks.workunit.client.1.smithi134.stdout:2/470: creat d19/d27/d31/d49/d6f/d84/f97 x:0 0 0 2024-09-17T04:20:55.578 INFO:tasks.workunit.client.0.smithi088.stdout:3/57: dread d0/f4 [0,4194304] 0 2024-09-17T04:20:55.579 INFO:tasks.workunit.client.1.smithi134.stdout:9/836: dwrite d2/d5/d8/d16/d54/d5e/da0/f10e [0,4194304] 0 2024-09-17T04:20:55.581 INFO:tasks.workunit.client.1.smithi134.stdout:4/515: rmdir d0/df/d17 39 2024-09-17T04:20:55.581 INFO:tasks.workunit.client.1.smithi134.stdout:9/837: chown d2/d5/d8/d16/d54/daf/d6d/daa/de2/fea 417 1 2024-09-17T04:20:55.583 INFO:tasks.workunit.client.0.smithi088.stdout:1/141: dread d0/f28 [4194304,4194304] 0 2024-09-17T04:20:55.586 INFO:tasks.workunit.client.0.smithi088.stdout:3/58: dwrite d0/f4 [4194304,4194304] 0 2024-09-17T04:20:55.588 INFO:tasks.workunit.client.1.smithi134.stdout:8/419: unlink d4/f10 0 2024-09-17T04:20:55.591 INFO:tasks.workunit.client.1.smithi134.stdout:2/471: mkdir d19/d27/d31/d49/d6f/d84/d98 0 2024-09-17T04:20:55.592 INFO:tasks.workunit.client.1.smithi134.stdout:1/488: write d12/f14 [3552049,10289] 0 2024-09-17T04:20:55.593 INFO:tasks.workunit.client.1.smithi134.stdout:1/489: fdatasync d12/d19/f64 0 2024-09-17T04:20:55.593 INFO:tasks.workunit.client.1.smithi134.stdout:6/561: mkdir de/d19/d62/db0 0 2024-09-17T04:20:55.593 INFO:tasks.workunit.client.1.smithi134.stdout:1/490: chown d12/d1c/d2e 2133621930 1 2024-09-17T04:20:55.598 INFO:tasks.workunit.client.1.smithi134.stdout:0/422: creat d11/f8c x:0 0 0 2024-09-17T04:20:55.599 INFO:tasks.workunit.client.1.smithi134.stdout:0/423: fsync d11/d24/d49/f68 0 2024-09-17T04:20:55.601 INFO:tasks.workunit.client.1.smithi134.stdout:8/420: rename d4/f83 to d4/db/dd/d72/f88 0 2024-09-17T04:20:55.605 INFO:tasks.workunit.client.1.smithi134.stdout:6/562: creat de/d19/d74/d94/d9e/fb1 x:0 0 0 2024-09-17T04:20:55.606 INFO:tasks.workunit.client.1.smithi134.stdout:8/421: symlink d4/d23/d60/d6b/d13/l89 0 2024-09-17T04:20:55.607 INFO:tasks.workunit.client.1.smithi134.stdout:6/563: chown de/d19/d21/d2d/f6a 2 1 2024-09-17T04:20:55.608 INFO:tasks.workunit.client.1.smithi134.stdout:4/516: link d0/df/d35/d5c/d8b/fa4 d0/d13/d40/d72/fa6 0 2024-09-17T04:20:55.609 INFO:tasks.workunit.client.1.smithi134.stdout:7/364: getdents d0/dd/d3a 0 2024-09-17T04:20:55.610 INFO:tasks.workunit.client.1.smithi134.stdout:8/422: mkdir d4/d1e/d8a 0 2024-09-17T04:20:55.610 INFO:tasks.workunit.client.1.smithi134.stdout:6/564: dread - de/d2b/f50 zero size 2024-09-17T04:20:55.612 INFO:tasks.workunit.client.1.smithi134.stdout:2/472: dwrite d19/d27/f8a [0,4194304] 0 2024-09-17T04:20:55.613 INFO:tasks.workunit.client.0.smithi088.stdout:1/142: symlink d0/l32 0 2024-09-17T04:20:55.614 INFO:tasks.workunit.client.1.smithi134.stdout:8/423: fdatasync d4/d23/f6d 0 2024-09-17T04:20:55.615 INFO:tasks.workunit.client.1.smithi134.stdout:2/473: chown c5 6 1 2024-09-17T04:20:55.616 INFO:tasks.workunit.client.1.smithi134.stdout:7/365: truncate d0/dd/f58 1128846 0 2024-09-17T04:20:55.617 INFO:tasks.workunit.client.1.smithi134.stdout:3/537: dwrite de/d10/f30 [4194304,4194304] 0 2024-09-17T04:20:55.617 INFO:tasks.workunit.client.1.smithi134.stdout:4/517: unlink d0/d13/d40/f98 0 2024-09-17T04:20:55.618 INFO:tasks.workunit.client.1.smithi134.stdout:6/565: fsync de/d19/d21/d2d/d4c/f83 0 2024-09-17T04:20:55.619 INFO:tasks.workunit.client.1.smithi134.stdout:0/424: dread d11/d22/d1c/d2f/d45/f59 [0,4194304] 0 2024-09-17T04:20:55.619 INFO:tasks.workunit.client.0.smithi088.stdout:1/143: dwrite d0/d13/f1e [0,4194304] 0 2024-09-17T04:20:55.621 INFO:tasks.workunit.client.0.smithi088.stdout:4/151: rename l4 to d5/d29/d2c/l2e 0 2024-09-17T04:20:55.622 INFO:tasks.workunit.client.0.smithi088.stdout:4/152: chown d5/l27 527 1 2024-09-17T04:20:55.626 INFO:tasks.workunit.client.0.smithi088.stdout:1/144: dwrite d0/d1/f1c [0,4194304] 0 2024-09-17T04:20:55.626 INFO:tasks.workunit.client.1.smithi134.stdout:0/425: rmdir d11 39 2024-09-17T04:20:55.628 INFO:tasks.workunit.client.0.smithi088.stdout:6/132: rename d14/d15/d2b to d14/d2f/d31 0 2024-09-17T04:20:55.631 INFO:tasks.workunit.client.0.smithi088.stdout:4/153: unlink d5/l11 0 2024-09-17T04:20:55.638 INFO:tasks.workunit.client.0.smithi088.stdout:1/145: mknod d0/d13/c33 0 2024-09-17T04:20:55.645 INFO:tasks.workunit.client.1.smithi134.stdout:8/424: dread d4/d1f/f3a [0,4194304] 0 2024-09-17T04:20:55.659 INFO:tasks.workunit.client.1.smithi134.stdout:3/538: dread de/d12/d15/d1d/d2d/d31/f55 [0,4194304] 0 2024-09-17T04:20:55.660 INFO:tasks.workunit.client.1.smithi134.stdout:3/539: chown de/d12/d15/f4b 222403 1 2024-09-17T04:20:55.660 INFO:tasks.workunit.client.1.smithi134.stdout:3/540: stat de/d67/f95 0 2024-09-17T04:20:55.661 INFO:tasks.workunit.client.1.smithi134.stdout:3/541: fsync de/f3b 0 2024-09-17T04:20:55.669 INFO:tasks.workunit.client.1.smithi134.stdout:5/447: sync 2024-09-17T04:20:55.710 INFO:tasks.workunit.client.0.smithi088.stdout:6/133: unlink f9 0 2024-09-17T04:20:55.711 INFO:tasks.workunit.client.0.smithi088.stdout:4/154: chown d5/fd 1903936774 1 2024-09-17T04:20:55.712 INFO:tasks.workunit.client.0.smithi088.stdout:1/146: symlink d0/d13/l34 0 2024-09-17T04:20:55.713 INFO:tasks.workunit.client.0.smithi088.stdout:1/147: write d0/d1/df/f10 [2118869,121780] 0 2024-09-17T04:20:55.714 INFO:tasks.workunit.client.1.smithi134.stdout:0/426: fsync d11/f3b 0 2024-09-17T04:20:55.752 INFO:tasks.workunit.client.1.smithi134.stdout:7/366: creat d0/dd/d57/d6a/d70/f72 x:0 0 0 2024-09-17T04:20:55.753 INFO:tasks.workunit.client.1.smithi134.stdout:4/518: getdents d0/d3b/d9f 0 2024-09-17T04:20:55.754 INFO:tasks.workunit.client.1.smithi134.stdout:7/367: dread d0/d16/d35/d4b/d65/f6e [0,4194304] 0 2024-09-17T04:20:55.754 INFO:tasks.workunit.client.1.smithi134.stdout:4/519: readlink d0/df/d35/l6e 0 2024-09-17T04:20:55.755 INFO:tasks.workunit.client.0.smithi088.stdout:4/155: creat d5/f2f x:0 0 0 2024-09-17T04:20:55.755 INFO:tasks.workunit.client.0.smithi088.stdout:4/156: chown d5/c1b 41407 1 2024-09-17T04:20:55.757 INFO:tasks.workunit.client.0.smithi088.stdout:1/148: mkdir d0/d1/d16/d35 0 2024-09-17T04:20:55.760 INFO:tasks.workunit.client.1.smithi134.stdout:3/542: creat de/faf x:0 0 0 2024-09-17T04:20:55.761 INFO:tasks.workunit.client.1.smithi134.stdout:3/543: fdatasync de/d12/d22/d5a/f9e 0 2024-09-17T04:20:55.765 INFO:tasks.workunit.client.0.smithi088.stdout:1/149: dwrite d0/d1/df/f10 [4194304,4194304] 0 2024-09-17T04:20:55.766 INFO:tasks.workunit.client.0.smithi088.stdout:6/134: link d14/d15/d16/f21 d14/f32 0 2024-09-17T04:20:55.766 INFO:tasks.workunit.client.0.smithi088.stdout:1/150: write d0/d1/f1c [1936656,49228] 0 2024-09-17T04:20:55.767 INFO:tasks.workunit.client.1.smithi134.stdout:2/474: rmdir d19/d1c/d47/d50/d96 0 2024-09-17T04:20:55.768 INFO:tasks.workunit.client.1.smithi134.stdout:2/475: chown d19/d27/d31/d49/d63/d94/d80 57 1 2024-09-17T04:20:55.771 INFO:tasks.workunit.client.0.smithi088.stdout:6/135: rmdir d14/d15/d16 39 2024-09-17T04:20:55.775 INFO:tasks.workunit.client.1.smithi134.stdout:8/425: dread f3 [0,4194304] 0 2024-09-17T04:20:55.776 INFO:tasks.workunit.client.1.smithi134.stdout:2/476: dwrite d19/d1c/f87 [0,4194304] 0 2024-09-17T04:20:55.776 INFO:tasks.workunit.client.0.smithi088.stdout:6/136: truncate d14/d15/d16/f2e 76482 0 2024-09-17T04:20:55.777 INFO:tasks.workunit.client.0.smithi088.stdout:1/151: creat d0/d1/d16/d35/f36 x:0 0 0 2024-09-17T04:20:55.779 INFO:tasks.workunit.client.0.smithi088.stdout:8/108: dwrite f2 [0,4194304] 0 2024-09-17T04:20:55.780 INFO:tasks.workunit.client.1.smithi134.stdout:3/544: unlink de/lac 0 2024-09-17T04:20:55.780 INFO:tasks.workunit.client.0.smithi088.stdout:8/109: dread - d7/f24 zero size 2024-09-17T04:20:55.781 INFO:tasks.workunit.client.1.smithi134.stdout:9/838: write d2/d5/d9/df/f79 [4489120,45597] 0 2024-09-17T04:20:55.782 INFO:tasks.workunit.client.1.smithi134.stdout:5/448: mknod d0/da/d69/d41/c92 0 2024-09-17T04:20:55.783 INFO:tasks.workunit.client.0.smithi088.stdout:3/59: truncate d0/f2 89624 0 2024-09-17T04:20:55.784 INFO:tasks.workunit.client.1.smithi134.stdout:3/545: read de/f2a [864066,112768] 0 2024-09-17T04:20:55.784 INFO:tasks.workunit.client.0.smithi088.stdout:1/152: fsync d0/f4 0 2024-09-17T04:20:55.787 INFO:tasks.workunit.client.0.smithi088.stdout:1/153: rename d0/d1/df to d0/d1/df/d20/d37 22 2024-09-17T04:20:55.788 INFO:tasks.workunit.client.0.smithi088.stdout:6/137: creat d14/d2f/d31/f33 x:0 0 0 2024-09-17T04:20:55.789 INFO:tasks.workunit.client.0.smithi088.stdout:8/110: dwrite d7/dd/d20/f12 [4194304,4194304] 0 2024-09-17T04:20:55.797 INFO:tasks.workunit.client.1.smithi134.stdout:1/491: dwrite d12/d19/f30 [0,4194304] 0 2024-09-17T04:20:55.797 INFO:tasks.workunit.client.1.smithi134.stdout:1/492: stat d12/d19/d1d/c47 0 2024-09-17T04:20:55.798 INFO:tasks.workunit.client.0.smithi088.stdout:1/154: dwrite d0/d1/df/f10 [8388608,4194304] 0 2024-09-17T04:20:55.800 INFO:tasks.workunit.client.1.smithi134.stdout:2/477: mknod d19/d27/d31/d49/d63/c99 0 2024-09-17T04:20:55.804 INFO:tasks.workunit.client.0.smithi088.stdout:3/60: symlink d0/l9 0 2024-09-17T04:20:55.805 INFO:tasks.workunit.client.0.smithi088.stdout:3/61: chown d0/f7 0 1 2024-09-17T04:20:55.811 INFO:tasks.workunit.client.1.smithi134.stdout:3/546: creat de/d12/d15/d1d/d2d/d31/d6a/d78/d7c/fb0 x:0 0 0 2024-09-17T04:20:55.811 INFO:tasks.workunit.client.1.smithi134.stdout:6/566: dwrite de/f2c [0,4194304] 0 2024-09-17T04:20:55.813 INFO:tasks.workunit.client.0.smithi088.stdout:6/138: link d14/d15/c1d d14/d15/d2a/c34 0 2024-09-17T04:20:55.814 INFO:tasks.workunit.client.0.smithi088.stdout:6/139: chown d14/l1b 249 1 2024-09-17T04:20:55.816 INFO:tasks.workunit.client.0.smithi088.stdout:8/111: rename d7/dd/d20/f1c to d7/dd/f28 0 2024-09-17T04:20:55.818 INFO:tasks.workunit.client.1.smithi134.stdout:1/493: mkdir d12/d19/d1d/d61/da0/da4 0 2024-09-17T04:20:55.818 INFO:tasks.workunit.client.1.smithi134.stdout:6/567: dwrite de/d19/f33 [0,4194304] 0 2024-09-17T04:20:55.819 INFO:tasks.workunit.client.1.smithi134.stdout:1/494: read d12/d19/f64 [3353607,7712] 0 2024-09-17T04:20:55.819 INFO:tasks.workunit.client.1.smithi134.stdout:6/568: write de/d2b/fa0 [229140,119118] 0 2024-09-17T04:20:55.820 INFO:tasks.workunit.client.1.smithi134.stdout:8/426: mkdir d4/db/dd/d43/d8b 0 2024-09-17T04:20:55.823 INFO:tasks.workunit.client.0.smithi088.stdout:4/157: write d5/f2a [606151,43630] 0 2024-09-17T04:20:55.823 INFO:tasks.workunit.client.1.smithi134.stdout:2/478: write d19/d27/f32 [5370105,67534] 0 2024-09-17T04:20:55.823 INFO:tasks.workunit.client.0.smithi088.stdout:4/158: stat d5/l1e 0 2024-09-17T04:20:55.826 INFO:tasks.workunit.client.1.smithi134.stdout:9/839: mknod d2/c11b 0 2024-09-17T04:20:55.828 INFO:tasks.workunit.client.0.smithi088.stdout:4/159: dread d5/f1a [0,4194304] 0 2024-09-17T04:20:55.830 INFO:tasks.workunit.client.1.smithi134.stdout:5/449: mknod d0/da/d69/d41/c93 0 2024-09-17T04:20:55.832 INFO:tasks.workunit.client.0.smithi088.stdout:4/160: dread d5/f28 [0,4194304] 0 2024-09-17T04:20:55.833 INFO:tasks.workunit.client.1.smithi134.stdout:0/427: write d11/d19/f6c [49704,63556] 0 2024-09-17T04:20:55.833 INFO:tasks.workunit.client.1.smithi134.stdout:9/840: dwrite d2/d25/f110 [0,4194304] 0 2024-09-17T04:20:55.833 INFO:tasks.workunit.client.0.smithi088.stdout:4/161: dread d5/f28 [0,4194304] 0 2024-09-17T04:20:55.834 INFO:tasks.workunit.client.0.smithi088.stdout:4/162: write d5/f2a [148922,6002] 0 2024-09-17T04:20:55.835 INFO:tasks.workunit.client.0.smithi088.stdout:4/163: chown d5/f2d 0 1 2024-09-17T04:20:55.837 INFO:tasks.workunit.client.1.smithi134.stdout:4/520: getdents d0/d13/d40 0 2024-09-17T04:20:55.838 INFO:tasks.workunit.client.1.smithi134.stdout:1/495: creat d12/d19/d5d/d88/fa5 x:0 0 0 2024-09-17T04:20:55.840 INFO:tasks.workunit.client.0.smithi088.stdout:3/62: rename d0/f6 to d0/fa 0 2024-09-17T04:20:55.843 INFO:tasks.workunit.client.1.smithi134.stdout:8/427: symlink d4/d23/l8c 0 2024-09-17T04:20:55.844 INFO:tasks.workunit.client.0.smithi088.stdout:3/63: dread d0/f3 [0,4194304] 0 2024-09-17T04:20:55.844 INFO:tasks.workunit.client.1.smithi134.stdout:7/368: write d0/dd/f1f [4565626,115513] 0 2024-09-17T04:20:55.846 INFO:tasks.workunit.client.1.smithi134.stdout:7/369: read d0/dd/f34 [1650509,8169] 0 2024-09-17T04:20:55.846 INFO:tasks.workunit.client.0.smithi088.stdout:4/164: symlink d5/d29/l30 0 2024-09-17T04:20:55.846 INFO:tasks.workunit.client.0.smithi088.stdout:4/165: stat d5/c1d 0 2024-09-17T04:20:55.847 INFO:tasks.workunit.client.1.smithi134.stdout:2/479: rmdir d19/d1c 39 2024-09-17T04:20:55.847 INFO:tasks.workunit.client.0.smithi088.stdout:6/140: getdents d14/d2f 0 2024-09-17T04:20:55.848 INFO:tasks.workunit.client.0.smithi088.stdout:6/141: read - d14/d15/d16/f25 zero size 2024-09-17T04:20:55.849 INFO:tasks.workunit.client.0.smithi088.stdout:6/142: read - d14/d15/d16/f25 zero size 2024-09-17T04:20:55.851 INFO:tasks.workunit.client.0.smithi088.stdout:8/112: rename d7/dd/d20 to d7/d29 0 2024-09-17T04:20:55.852 INFO:tasks.workunit.client.1.smithi134.stdout:5/450: mknod d0/d3a/d2b/d61/c94 0 2024-09-17T04:20:55.855 INFO:tasks.workunit.client.1.smithi134.stdout:0/428: creat d11/d19/f8d x:0 0 0 2024-09-17T04:20:55.856 INFO:tasks.workunit.client.0.smithi088.stdout:4/166: mknod d5/d29/c31 0 2024-09-17T04:20:55.860 INFO:tasks.workunit.client.0.smithi088.stdout:6/143: rename d14/c1a to d14/d15/d29/c35 0 2024-09-17T04:20:55.862 INFO:tasks.workunit.client.0.smithi088.stdout:8/113: mkdir d7/d29/d2a 0 2024-09-17T04:20:55.863 INFO:tasks.workunit.client.0.smithi088.stdout:4/167: dwrite d5/f2a [0,4194304] 0 2024-09-17T04:20:55.864 INFO:tasks.workunit.client.1.smithi134.stdout:6/569: creat de/d19/d74/d98/fb2 x:0 0 0 2024-09-17T04:20:55.864 INFO:tasks.workunit.client.1.smithi134.stdout:6/570: fsync de/d2b/d8a/fad 0 2024-09-17T04:20:55.865 INFO:tasks.workunit.client.0.smithi088.stdout:4/168: chown d5/d29/c2b 1685 1 2024-09-17T04:20:55.866 INFO:tasks.workunit.client.1.smithi134.stdout:8/428: fsync d4/db/dd/f5b 0 2024-09-17T04:20:55.871 INFO:tasks.workunit.client.0.smithi088.stdout:6/144: dwrite d14/d2f/d31/f33 [0,4194304] 0 2024-09-17T04:20:55.871 INFO:tasks.workunit.client.1.smithi134.stdout:4/521: dread d0/df/d17/f6d [0,4194304] 0 2024-09-17T04:20:55.875 INFO:tasks.workunit.client.1.smithi134.stdout:3/547: creat de/d12/fb1 x:0 0 0 2024-09-17T04:20:55.878 INFO:tasks.workunit.client.0.smithi088.stdout:3/64: creat d0/fb x:0 0 0 2024-09-17T04:20:55.879 INFO:tasks.workunit.client.1.smithi134.stdout:0/429: rename d11/d22/d1c/d2f/d45/f59 to d11/d22/d1c/d2f/d45/f8e 0 2024-09-17T04:20:55.879 INFO:tasks.workunit.client.0.smithi088.stdout:4/169: dread d5/f1f [0,4194304] 0 2024-09-17T04:20:55.881 INFO:tasks.workunit.client.0.smithi088.stdout:8/114: creat d7/d29/d2a/f2b x:0 0 0 2024-09-17T04:20:55.881 INFO:tasks.workunit.client.0.smithi088.stdout:6/145: dwrite d14/d15/d16/f30 [0,4194304] 0 2024-09-17T04:20:55.882 INFO:tasks.workunit.client.1.smithi134.stdout:3/548: dwrite f6 [4194304,4194304] 0 2024-09-17T04:20:55.884 INFO:tasks.workunit.client.0.smithi088.stdout:3/65: chown d0/f2 12203219 1 2024-09-17T04:20:55.885 INFO:tasks.workunit.client.0.smithi088.stdout:3/66: dread d0/f2 [0,4194304] 0 2024-09-17T04:20:55.886 INFO:tasks.workunit.client.0.smithi088.stdout:4/170: truncate d5/f1f 21954 0 2024-09-17T04:20:55.887 INFO:tasks.workunit.client.0.smithi088.stdout:4/171: dread - d5/f2f zero size 2024-09-17T04:20:55.887 INFO:tasks.workunit.client.1.smithi134.stdout:6/571: write de/d19/d1f/d55/f68 [23583,103999] 0 2024-09-17T04:20:55.889 INFO:tasks.workunit.client.0.smithi088.stdout:6/146: creat d14/d2f/f36 x:0 0 0 2024-09-17T04:20:55.889 INFO:tasks.workunit.client.1.smithi134.stdout:9/841: dwrite d2/d5/d58/ff1 [4194304,4194304] 0 2024-09-17T04:20:55.890 INFO:tasks.workunit.client.1.smithi134.stdout:6/572: write de/f13 [2344007,122757] 0 2024-09-17T04:20:55.891 INFO:tasks.workunit.client.1.smithi134.stdout:9/842: chown d2/d5/d58/db5/d112 0 1 2024-09-17T04:20:55.891 INFO:tasks.workunit.client.1.smithi134.stdout:6/573: stat de/d19/d1f/d85 0 2024-09-17T04:20:55.891 INFO:tasks.workunit.client.0.smithi088.stdout:8/115: rename d7/d29/c18 to d7/d29/d2a/c2c 0 2024-09-17T04:20:55.893 INFO:tasks.workunit.client.1.smithi134.stdout:7/370: mknod d0/c73 0 2024-09-17T04:20:55.894 INFO:tasks.workunit.client.0.smithi088.stdout:3/67: fdatasync d0/f4 0 2024-09-17T04:20:55.896 INFO:tasks.workunit.client.1.smithi134.stdout:4/522: mkdir d0/d13/d40/d72/da7 0 2024-09-17T04:20:55.899 INFO:tasks.workunit.client.0.smithi088.stdout:4/172: rename d5/d29 to d5/d32 0 2024-09-17T04:20:55.901 INFO:tasks.workunit.client.0.smithi088.stdout:6/147: unlink l13 0 2024-09-17T04:20:55.904 INFO:tasks.workunit.client.1.smithi134.stdout:0/430: mknod d11/d22/d1c/d2f/d43/d5d/c8f 0 2024-09-17T04:20:55.905 INFO:tasks.workunit.client.0.smithi088.stdout:6/148: creat d14/d2f/d31/f37 x:0 0 0 2024-09-17T04:20:55.912 INFO:tasks.workunit.client.1.smithi134.stdout:8/429: truncate d4/db/dd/f16 7123397 0 2024-09-17T04:20:55.913 INFO:tasks.workunit.client.0.smithi088.stdout:3/68: rename d0/l9 to d0/lc 0 2024-09-17T04:20:55.913 INFO:tasks.workunit.client.0.smithi088.stdout:6/149: dwrite d14/d15/d16/f26 [0,4194304] 0 2024-09-17T04:20:55.914 INFO:tasks.workunit.client.1.smithi134.stdout:9/843: rmdir d2/d5/d37/d83/da7 39 2024-09-17T04:20:55.917 INFO:tasks.workunit.client.1.smithi134.stdout:6/574: mkdir de/d19/d7b/db3 0 2024-09-17T04:20:55.918 INFO:tasks.workunit.client.0.smithi088.stdout:8/116: dread d7/f8 [0,4194304] 0 2024-09-17T04:20:55.919 INFO:tasks.workunit.client.1.smithi134.stdout:5/451: truncate d0/da/d69/d41/f4d 1108655 0 2024-09-17T04:20:55.920 INFO:tasks.workunit.client.1.smithi134.stdout:7/371: mkdir d0/dd/d3a/d3d/d38/d74 0 2024-09-17T04:20:55.921 INFO:tasks.workunit.client.1.smithi134.stdout:4/523: mknod d0/df/d17/ca8 0 2024-09-17T04:20:55.921 INFO:tasks.workunit.client.0.smithi088.stdout:6/150: truncate f10 730173 0 2024-09-17T04:20:55.922 INFO:tasks.workunit.client.1.smithi134.stdout:5/452: fsync d0/da/d69/f53 0 2024-09-17T04:20:55.923 INFO:tasks.workunit.client.1.smithi134.stdout:9/844: dwrite d2/d5/d9/f30 [4194304,4194304] 0 2024-09-17T04:20:55.923 INFO:tasks.workunit.client.1.smithi134.stdout:2/480: mkdir d19/d1c/d47/d50/d85/d93/d9a 0 2024-09-17T04:20:55.924 INFO:tasks.workunit.client.1.smithi134.stdout:0/431: fdatasync d11/d19/d21/d37/f42 0 2024-09-17T04:20:55.925 INFO:tasks.workunit.client.1.smithi134.stdout:2/481: truncate d19/d27/d31/f5c 5468782 0 2024-09-17T04:20:55.926 INFO:tasks.workunit.client.1.smithi134.stdout:1/496: getdents d12/d1c/d4a 0 2024-09-17T04:20:55.926 INFO:tasks.workunit.client.1.smithi134.stdout:0/432: dread - d11/d24/d49/f6a zero size 2024-09-17T04:20:55.930 INFO:tasks.workunit.client.0.smithi088.stdout:6/151: creat d14/d15/d29/f38 x:0 0 0 2024-09-17T04:20:55.931 INFO:tasks.workunit.client.1.smithi134.stdout:8/430: rmdir d4/d1e 39 2024-09-17T04:20:55.932 INFO:tasks.workunit.client.0.smithi088.stdout:8/117: dwrite d7/f8 [0,4194304] 0 2024-09-17T04:20:55.940 INFO:tasks.workunit.client.1.smithi134.stdout:7/372: dread d0/f19 [0,4194304] 0 2024-09-17T04:20:55.941 INFO:tasks.workunit.client.0.smithi088.stdout:3/69: creat d0/fd x:0 0 0 2024-09-17T04:20:55.941 INFO:tasks.workunit.client.1.smithi134.stdout:7/373: write d0/dd/d3a/d3d/d4c/f50 [793520,35155] 0 2024-09-17T04:20:55.945 INFO:tasks.workunit.client.0.smithi088.stdout:8/118: rmdir d7/dd 39 2024-09-17T04:20:55.946 INFO:tasks.workunit.client.1.smithi134.stdout:5/453: mknod d0/da/d29/d78/c95 0 2024-09-17T04:20:55.947 INFO:tasks.workunit.client.1.smithi134.stdout:4/524: mknod d0/d13/d40/d42/d92/d65/ca9 0 2024-09-17T04:20:55.949 INFO:tasks.workunit.client.1.smithi134.stdout:1/497: creat d12/d19/d1d/d3e/fa6 x:0 0 0 2024-09-17T04:20:55.951 INFO:tasks.workunit.client.1.smithi134.stdout:2/482: rename d19/d27/d31/d34/f45 to d19/d1c/d47/d50/d85/f9b 0 2024-09-17T04:20:55.953 INFO:tasks.workunit.client.0.smithi088.stdout:3/70: creat d0/fe x:0 0 0 2024-09-17T04:20:55.953 INFO:tasks.workunit.client.0.smithi088.stdout:4/173: dread d5/f1f [0,4194304] 0 2024-09-17T04:20:55.954 INFO:tasks.workunit.client.0.smithi088.stdout:6/152: getdents d14/d15 0 2024-09-17T04:20:55.954 INFO:tasks.workunit.client.1.smithi134.stdout:3/549: link de/d12/d22/d5a/la3 de/d10/d70/lb2 0 2024-09-17T04:20:55.955 INFO:tasks.workunit.client.0.smithi088.stdout:6/153: write d14/d15/f22 [246150,127214] 0 2024-09-17T04:20:55.957 INFO:tasks.workunit.client.1.smithi134.stdout:6/575: mkdir de/d19/d7b/db3/db4 0 2024-09-17T04:20:55.958 INFO:tasks.workunit.client.1.smithi134.stdout:6/576: chown de/d19/d1f/f73 1924 1 2024-09-17T04:20:55.958 INFO:tasks.workunit.client.1.smithi134.stdout:7/374: mkdir d0/dd/d3a/d3d/d38/d60/d75 0 2024-09-17T04:20:55.961 INFO:tasks.workunit.client.1.smithi134.stdout:9/845: dwrite d2/f4b [0,4194304] 0 2024-09-17T04:20:55.969 INFO:tasks.workunit.client.1.smithi134.stdout:5/454: stat d0/da/l14 0 2024-09-17T04:20:55.975 INFO:tasks.workunit.client.0.smithi088.stdout:3/71: dwrite d0/f3 [4194304,4194304] 0 2024-09-17T04:20:55.975 INFO:tasks.workunit.client.1.smithi134.stdout:0/433: mknod d11/d24/d49/d62/c90 0 2024-09-17T04:20:55.975 INFO:tasks.workunit.client.1.smithi134.stdout:0/434: fdatasync d11/d18/f40 0 2024-09-17T04:20:55.976 INFO:tasks.workunit.client.0.smithi088.stdout:4/174: getdents d5/d32 0 2024-09-17T04:20:55.976 INFO:tasks.workunit.client.0.smithi088.stdout:4/175: fsync d5/f23 0 2024-09-17T04:20:55.976 INFO:tasks.workunit.client.0.smithi088.stdout:3/72: write d0/f7 [989925,35026] 0 2024-09-17T04:20:55.978 INFO:tasks.workunit.client.1.smithi134.stdout:6/577: symlink de/d19/d1f/d55/d77/d89/lb5 0 2024-09-17T04:20:55.983 INFO:tasks.workunit.client.1.smithi134.stdout:7/375: creat d0/dd/d3a/d3d/d4c/f76 x:0 0 0 2024-09-17T04:20:55.984 INFO:tasks.workunit.client.0.smithi088.stdout:4/176: dwrite d5/f2a [0,4194304] 0 2024-09-17T04:20:55.989 INFO:tasks.workunit.client.0.smithi088.stdout:3/73: symlink d0/lf 0 2024-09-17T04:20:55.990 INFO:tasks.workunit.client.0.smithi088.stdout:4/177: rmdir d5 39 2024-09-17T04:20:55.993 INFO:tasks.workunit.client.0.smithi088.stdout:4/178: chown d5/f23 436345 1 2024-09-17T04:20:55.994 INFO:tasks.workunit.client.1.smithi134.stdout:1/498: dread d12/d19/d5c/f6f [0,4194304] 0 2024-09-17T04:20:55.995 INFO:tasks.workunit.client.1.smithi134.stdout:3/550: mkdir de/d12/db3 0 2024-09-17T04:20:55.996 INFO:tasks.workunit.client.1.smithi134.stdout:0/435: creat d11/d19/f91 x:0 0 0 2024-09-17T04:20:55.997 INFO:tasks.workunit.client.0.smithi088.stdout:4/179: truncate d5/f1f 591251 0 2024-09-17T04:20:55.998 INFO:tasks.workunit.client.1.smithi134.stdout:1/499: dread d12/f42 [0,4194304] 0 2024-09-17T04:20:55.999 INFO:tasks.workunit.client.1.smithi134.stdout:1/500: read d12/d19/d5c/f69 [906672,64444] 0 2024-09-17T04:20:55.999 INFO:tasks.workunit.client.1.smithi134.stdout:5/455: symlink d0/da/d2c/d73/d8a/l96 0 2024-09-17T04:20:56.000 INFO:tasks.workunit.client.1.smithi134.stdout:4/525: rename d0/df/d1e/da3 to d0/df/d1e/daa 0 2024-09-17T04:20:56.002 INFO:tasks.workunit.client.1.smithi134.stdout:8/431: rename d4/d1f/f44 to d4/f8d 0 2024-09-17T04:20:56.003 INFO:tasks.workunit.client.1.smithi134.stdout:2/483: link d19/d77/c7f d19/d67/c9c 0 2024-09-17T04:20:56.003 INFO:tasks.workunit.client.1.smithi134.stdout:8/432: readlink d4/d23/d60/d6b/l1a 0 2024-09-17T04:20:56.003 INFO:tasks.workunit.client.1.smithi134.stdout:8/433: fdatasync f0 0 2024-09-17T04:20:56.004 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:55 smithi134 ceph-mon[35201]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:20:56.004 INFO:tasks.workunit.client.1.smithi134.stdout:8/434: write d4/d1f/f3a [3718750,12221] 0 2024-09-17T04:20:56.006 INFO:tasks.workunit.client.1.smithi134.stdout:3/551: creat de/d12/d15/d1d/d2d/fb4 x:0 0 0 2024-09-17T04:20:56.006 INFO:tasks.workunit.client.0.smithi088.stdout:4/180: link d5/f20 d5/d32/d2c/f33 0 2024-09-17T04:20:56.007 INFO:tasks.workunit.client.1.smithi134.stdout:6/578: creat de/d19/da3/fb6 x:0 0 0 2024-09-17T04:20:56.008 INFO:tasks.workunit.client.0.smithi088.stdout:4/181: mknod d5/d32/c34 0 2024-09-17T04:20:56.012 INFO:tasks.workunit.client.1.smithi134.stdout:6/579: chown de/d19/d74/d94/d9e 2952089 1 2024-09-17T04:20:56.014 INFO:tasks.workunit.client.0.smithi088.stdout:4/182: truncate d5/fd 2037609 0 2024-09-17T04:20:56.014 INFO:tasks.workunit.client.1.smithi134.stdout:8/435: dwrite d4/d1f/f33 [0,4194304] 0 2024-09-17T04:20:56.015 INFO:tasks.workunit.client.1.smithi134.stdout:3/552: truncate de/d12/d15/d1d/d2d/d31/d6a/d78/d7c/fb0 263179 0 2024-09-17T04:20:56.015 INFO:tasks.workunit.client.1.smithi134.stdout:8/436: chown d4/d1f 58 1 2024-09-17T04:20:56.015 INFO:tasks.workunit.client.1.smithi134.stdout:4/526: symlink d0/df/d35/d5c/lab 0 2024-09-17T04:20:56.016 INFO:tasks.workunit.client.0.smithi088.stdout:3/74: truncate d0/f3 607824 0 2024-09-17T04:20:56.017 INFO:tasks.workunit.client.0.smithi088.stdout:4/183: mknod d5/c35 0 2024-09-17T04:20:56.017 INFO:tasks.workunit.client.1.smithi134.stdout:0/436: dread d11/d22/d1c/d2f/d43/f85 [0,4194304] 0 2024-09-17T04:20:56.018 INFO:tasks.workunit.client.1.smithi134.stdout:0/437: truncate d11/f7f 328671 0 2024-09-17T04:20:56.023 INFO:tasks.workunit.client.1.smithi134.stdout:7/376: rename d0/dd/f34 to d0/dd/f77 0 2024-09-17T04:20:56.026 INFO:tasks.workunit.client.0.smithi088.stdout:3/75: creat d0/f10 x:0 0 0 2024-09-17T04:20:56.026 INFO:tasks.workunit.client.1.smithi134.stdout:9/846: getdents d2/d5/d8/d16/d54/daf/d6d/daa/de2/dcd/dd6/dff 0 2024-09-17T04:20:56.027 INFO:tasks.workunit.client.1.smithi134.stdout:1/501: write d12/d19/d5c/f69 [1127296,60801] 0 2024-09-17T04:20:56.027 INFO:tasks.workunit.client.1.smithi134.stdout:9/847: dread - d2/d25/ff6 zero size 2024-09-17T04:20:56.029 INFO:tasks.workunit.client.1.smithi134.stdout:5/456: creat d0/d3a/d2b/d61/d7b/f97 x:0 0 0 2024-09-17T04:20:56.030 INFO:tasks.workunit.client.0.smithi088.stdout:3/76: mknod d0/c11 0 2024-09-17T04:20:56.030 INFO:tasks.workunit.client.1.smithi134.stdout:5/457: dread - d0/f6f zero size 2024-09-17T04:20:56.030 INFO:tasks.workunit.client.1.smithi134.stdout:5/458: fdatasync d0/da/f2e 0 2024-09-17T04:20:56.031 INFO:tasks.workunit.client.1.smithi134.stdout:2/484: mkdir d19/d27/d31/d49/d6f/d84/d98/d9d 0 2024-09-17T04:20:56.032 INFO:tasks.workunit.client.1.smithi134.stdout:2/485: chown d19/d27/d31/d49/d6f/d84 351815650 1 2024-09-17T04:20:56.035 INFO:tasks.workunit.client.1.smithi134.stdout:9/848: dwrite d2/d5/d8/d16/d54/daf/d6d/daa/ffe [0,4194304] 0 2024-09-17T04:20:56.036 INFO:tasks.workunit.client.1.smithi134.stdout:6/580: mknod de/d19/d62/d34/cb7 0 2024-09-17T04:20:56.038 INFO:tasks.workunit.client.0.smithi088.stdout:3/77: creat d0/f12 x:0 0 0 2024-09-17T04:20:56.038 INFO:tasks.workunit.client.0.smithi088.stdout:4/184: write d5/d32/d2c/f33 [81620,60207] 0 2024-09-17T04:20:56.040 INFO:tasks.workunit.client.1.smithi134.stdout:1/502: creat d12/d1c/d2e/d7d/fa7 x:0 0 0 2024-09-17T04:20:56.041 INFO:tasks.workunit.client.1.smithi134.stdout:8/437: mkdir d4/db/dd/d43/d8b/d8e 0 2024-09-17T04:20:56.042 INFO:tasks.workunit.client.1.smithi134.stdout:8/438: readlink d4/d11/l76 0 2024-09-17T04:20:56.043 INFO:tasks.workunit.client.1.smithi134.stdout:4/527: symlink d0/d13/d40/d42/d92/d86/lac 0 2024-09-17T04:20:56.045 INFO:tasks.workunit.client.0.smithi088.stdout:4/185: mkdir d5/d32/d36 0 2024-09-17T04:20:56.046 INFO:tasks.workunit.client.1.smithi134.stdout:3/553: dread de/d10/d3d/f7d [0,4194304] 0 2024-09-17T04:20:56.047 INFO:tasks.workunit.client.1.smithi134.stdout:3/554: chown de/d10/d3d/f9a 18321686 1 2024-09-17T04:20:56.048 INFO:tasks.workunit.client.0.smithi088.stdout:3/78: mkdir d0/d13 0 2024-09-17T04:20:56.048 INFO:tasks.workunit.client.1.smithi134.stdout:3/555: write de/d12/d15/d1d/d2d/f53 [685186,77478] 0 2024-09-17T04:20:56.049 INFO:tasks.workunit.client.0.smithi088.stdout:4/186: mknod d5/d32/d2c/c37 0 2024-09-17T04:20:56.050 INFO:tasks.workunit.client.0.smithi088.stdout:3/79: unlink d0/fe 0 2024-09-17T04:20:56.051 INFO:tasks.workunit.client.1.smithi134.stdout:4/528: dread d0/d3b/f74 [0,4194304] 0 2024-09-17T04:20:56.053 INFO:tasks.workunit.client.0.smithi088.stdout:4/187: dread d5/d32/d2c/f33 [0,4194304] 0 2024-09-17T04:20:56.054 INFO:tasks.workunit.client.1.smithi134.stdout:2/486: creat d19/d27/d31/d49/d6f/d84/f9e x:0 0 0 2024-09-17T04:20:56.056 INFO:tasks.workunit.client.1.smithi134.stdout:7/377: rename d0/dd/f27 to d0/dd/d3a/d3d/f78 0 2024-09-17T04:20:56.058 INFO:tasks.workunit.client.0.smithi088.stdout:3/80: rename d0/c8 to d0/d13/c14 0 2024-09-17T04:20:56.059 INFO:tasks.workunit.client.0.smithi088.stdout:4/188: read d5/fd [1639574,42056] 0 2024-09-17T04:20:56.060 INFO:tasks.workunit.client.1.smithi134.stdout:0/438: truncate d11/f7f 121077 0 2024-09-17T04:20:56.062 INFO:tasks.workunit.client.1.smithi134.stdout:5/459: dwrite d0/f2a [0,4194304] 0 2024-09-17T04:20:56.062 INFO:tasks.workunit.client.1.smithi134.stdout:6/581: mkdir de/d19/d1f/d55/d77/db8 0 2024-09-17T04:20:56.063 INFO:tasks.workunit.client.1.smithi134.stdout:6/582: write de/d2b/f45 [5057448,7503] 0 2024-09-17T04:20:56.064 INFO:tasks.workunit.client.1.smithi134.stdout:1/503: rmdir d12/d36 39 2024-09-17T04:20:56.064 INFO:tasks.workunit.client.1.smithi134.stdout:6/583: dread - de/d19/d74/d94/d9e/fac zero size 2024-09-17T04:20:56.064 INFO:tasks.workunit.client.1.smithi134.stdout:6/584: stat de/d19/d21/d4d/fa4 0 2024-09-17T04:20:56.066 INFO:tasks.workunit.client.1.smithi134.stdout:6/585: write de/d2b/f71 [3499949,110873] 0 2024-09-17T04:20:56.067 INFO:tasks.workunit.client.0.smithi088.stdout:3/81: mknod d0/c15 0 2024-09-17T04:20:56.068 INFO:tasks.workunit.client.1.smithi134.stdout:1/504: dread d12/d19/f64 [0,4194304] 0 2024-09-17T04:20:56.071 INFO:tasks.workunit.client.1.smithi134.stdout:7/378: chown d0/dd/d3a/d3d/d38/f1d 20379 1 2024-09-17T04:20:56.075 INFO:tasks.workunit.client.1.smithi134.stdout:0/439: creat d11/d4c/f92 x:0 0 0 2024-09-17T04:20:56.075 INFO:tasks.workunit.client.1.smithi134.stdout:2/487: dwrite d19/d27/d31/d34/f82 [0,4194304] 0 2024-09-17T04:20:56.076 INFO:tasks.workunit.client.1.smithi134.stdout:0/440: chown d11/d19/f6c 3616 1 2024-09-17T04:20:56.076 INFO:tasks.workunit.client.0.smithi088.stdout:3/82: dwrite d0/f4 [0,4194304] 0 2024-09-17T04:20:56.076 INFO:tasks.workunit.client.0.smithi088.stdout:3/83: chown d0/f7 288724 1 2024-09-17T04:20:56.081 INFO:tasks.workunit.client.1.smithi134.stdout:8/439: unlink d4/l80 0 2024-09-17T04:20:56.083 INFO:tasks.workunit.client.1.smithi134.stdout:8/440: dread - d4/d11/f7a zero size 2024-09-17T04:20:56.083 INFO:tasks.workunit.client.1.smithi134.stdout:2/488: dwrite d19/d1c/f2d [0,4194304] 0 2024-09-17T04:20:56.085 INFO:tasks.workunit.client.1.smithi134.stdout:6/586: rmdir de/d19 39 2024-09-17T04:20:56.085 INFO:tasks.workunit.client.1.smithi134.stdout:9/849: write d2/d5/d8/d1e/f29 [2395619,93041] 0 2024-09-17T04:20:56.088 INFO:tasks.workunit.client.1.smithi134.stdout:9/850: read d2/d5/d8/d16/d54/fde [776591,46500] 0 2024-09-17T04:20:56.088 INFO:tasks.workunit.client.0.smithi088.stdout:4/189: dwrite d5/f28 [0,4194304] 0 2024-09-17T04:20:56.089 INFO:tasks.workunit.client.0.smithi088.stdout:3/84: creat d0/f16 x:0 0 0 2024-09-17T04:20:56.090 INFO:tasks.workunit.client.1.smithi134.stdout:1/505: fdatasync d12/d19/d5c/f6f 0 2024-09-17T04:20:56.091 INFO:tasks.workunit.client.1.smithi134.stdout:5/460: write d0/d48/f80 [4443212,103646] 0 2024-09-17T04:20:56.092 INFO:tasks.workunit.client.1.smithi134.stdout:1/506: chown d12/d19/d1d/f6b 771 1 2024-09-17T04:20:56.092 INFO:tasks.workunit.client.1.smithi134.stdout:3/556: truncate de/d12/d22/d5a/f71 1477390 0 2024-09-17T04:20:56.093 INFO:tasks.workunit.client.1.smithi134.stdout:1/507: write d12/d1c/d2e/f67 [1952421,17929] 0 2024-09-17T04:20:56.094 INFO:tasks.workunit.client.0.smithi088.stdout:3/85: creat d0/d13/f17 x:0 0 0 2024-09-17T04:20:56.095 INFO:tasks.workunit.client.0.smithi088.stdout:3/86: dread - d0/fb zero size 2024-09-17T04:20:56.095 INFO:tasks.workunit.client.1.smithi134.stdout:7/379: symlink d0/dd/d3a/d3d/d4c/l79 0 2024-09-17T04:20:56.096 INFO:tasks.workunit.client.0.smithi088.stdout:4/190: symlink d5/d32/d2c/l38 0 2024-09-17T04:20:56.097 INFO:tasks.workunit.client.0.smithi088.stdout:3/87: write d0/fd [213512,104991] 0 2024-09-17T04:20:56.097 INFO:tasks.workunit.client.0.smithi088.stdout:3/88: chown d0/fd 1520370 1 2024-09-17T04:20:56.098 INFO:tasks.workunit.client.1.smithi134.stdout:3/557: dwrite de/d12/d22/f26 [0,4194304] 0 2024-09-17T04:20:56.098 INFO:tasks.workunit.client.1.smithi134.stdout:0/441: creat d11/d24/f93 x:0 0 0 2024-09-17T04:20:56.099 INFO:tasks.workunit.client.1.smithi134.stdout:2/489: mkdir d19/d27/d31/d49/d6f/d84/d98/d9f 0 2024-09-17T04:20:56.104 INFO:tasks.workunit.client.0.smithi088.stdout:3/89: symlink d0/l18 0 2024-09-17T04:20:56.105 INFO:tasks.workunit.client.1.smithi134.stdout:5/461: symlink d0/da/d69/d41/d6d/l98 0 2024-09-17T04:20:56.106 INFO:tasks.workunit.client.0.smithi088.stdout:3/90: symlink d0/d13/l19 0 2024-09-17T04:20:56.106 INFO:tasks.workunit.client.1.smithi134.stdout:9/851: stat d2/d5/d37/d83/da7/cab 0 2024-09-17T04:20:56.107 INFO:tasks.workunit.client.1.smithi134.stdout:1/508: mknod d12/d1c/d4a/ca8 0 2024-09-17T04:20:56.111 INFO:tasks.workunit.client.1.smithi134.stdout:1/509: dread - d12/d19/d1d/d3e/fa6 zero size 2024-09-17T04:20:56.111 INFO:tasks.workunit.client.1.smithi134.stdout:3/558: dwrite de/d12/d15/d1d/f72 [0,4194304] 0 2024-09-17T04:20:56.112 INFO:tasks.workunit.client.1.smithi134.stdout:4/529: truncate d0/df/f18 7867437 0 2024-09-17T04:20:56.113 INFO:tasks.workunit.client.0.smithi088.stdout:3/91: truncate d0/fa 27047 0 2024-09-17T04:20:56.113 INFO:tasks.workunit.client.1.smithi134.stdout:0/442: dwrite d11/d4c/f92 [0,4194304] 0 2024-09-17T04:20:56.114 INFO:tasks.workunit.client.1.smithi134.stdout:2/490: chown d19/d27/c33 354 1 2024-09-17T04:20:56.114 INFO:tasks.workunit.client.1.smithi134.stdout:0/443: fdatasync f0 0 2024-09-17T04:20:56.115 INFO:tasks.workunit.client.1.smithi134.stdout:6/587: unlink de/d19/d62/d34/d3b/l46 0 2024-09-17T04:20:56.115 INFO:tasks.workunit.client.1.smithi134.stdout:1/510: write d12/d1c/d2e/f75 [2223140,24494] 0 2024-09-17T04:20:56.118 INFO:tasks.workunit.client.1.smithi134.stdout:5/462: creat d0/da/d29/d78/f99 x:0 0 0 2024-09-17T04:20:56.118 INFO:tasks.workunit.client.1.smithi134.stdout:8/441: symlink d4/d1e/d8a/l8f 0 2024-09-17T04:20:56.119 INFO:tasks.workunit.client.0.smithi088.stdout:3/92: creat d0/f1a x:0 0 0 2024-09-17T04:20:56.119 INFO:tasks.workunit.client.0.smithi088.stdout:3/93: read d0/f3 [1235161,14296] 0 2024-09-17T04:20:56.120 INFO:tasks.workunit.client.1.smithi134.stdout:8/442: write d4/d1f/f71 [724565,66483] 0 2024-09-17T04:20:56.121 INFO:tasks.workunit.client.1.smithi134.stdout:8/443: write d4/f36 [407675,17753] 0 2024-09-17T04:20:56.122 INFO:tasks.workunit.client.0.smithi088.stdout:3/94: mkdir d0/d13/d1b 0 2024-09-17T04:20:56.123 INFO:tasks.workunit.client.1.smithi134.stdout:3/559: creat de/d12/d22/d5a/fb5 x:0 0 0 2024-09-17T04:20:56.123 INFO:tasks.workunit.client.1.smithi134.stdout:0/444: rmdir d11/d22/d1c/d2f 39 2024-09-17T04:20:56.124 INFO:tasks.workunit.client.1.smithi134.stdout:2/491: fsync d19/d1c/f52 0 2024-09-17T04:20:56.124 INFO:tasks.workunit.client.1.smithi134.stdout:3/560: dread - de/d12/d22/d5a/fb5 zero size 2024-09-17T04:20:56.125 INFO:tasks.workunit.client.1.smithi134.stdout:3/561: stat de/d12/d15/d1d/d2d/d31 0 2024-09-17T04:20:56.126 INFO:tasks.workunit.client.1.smithi134.stdout:3/562: fdatasync de/d12/fb1 0 2024-09-17T04:20:56.128 INFO:tasks.workunit.client.1.smithi134.stdout:1/511: creat d12/d19/d5d/fa9 x:0 0 0 2024-09-17T04:20:56.129 INFO:tasks.workunit.client.0.smithi088.stdout:3/95: rmdir d0/d13 39 2024-09-17T04:20:56.129 INFO:tasks.workunit.client.1.smithi134.stdout:1/512: write d12/f14 [2444519,15944] 0 2024-09-17T04:20:56.131 INFO:tasks.workunit.client.1.smithi134.stdout:5/463: symlink d0/da/d2c/l9a 0 2024-09-17T04:20:56.135 INFO:tasks.workunit.client.0.smithi088.stdout:4/191: write d5/f20 [626445,26686] 0 2024-09-17T04:20:56.136 INFO:tasks.workunit.client.0.smithi088.stdout:4/192: truncate d5/f2f 569986 0 2024-09-17T04:20:56.136 INFO:tasks.workunit.client.1.smithi134.stdout:2/492: unlink d19/f35 0 2024-09-17T04:20:56.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:55 smithi088 ceph-mon[27811]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:20:56.138 INFO:tasks.workunit.client.1.smithi134.stdout:1/513: dwrite d12/d1c/d2e/f75 [0,4194304] 0 2024-09-17T04:20:56.139 INFO:tasks.workunit.client.0.smithi088.stdout:4/193: creat d5/d32/d2c/f39 x:0 0 0 2024-09-17T04:20:56.140 INFO:tasks.workunit.client.0.smithi088.stdout:4/194: truncate d5/f2d 293472 0 2024-09-17T04:20:56.141 INFO:tasks.workunit.client.1.smithi134.stdout:5/464: dwrite d0/d3a/fc [4194304,4194304] 0 2024-09-17T04:20:56.143 INFO:tasks.workunit.client.1.smithi134.stdout:5/465: fdatasync d0/d3a/d2b/d61/d7b/f97 0 2024-09-17T04:20:56.144 INFO:tasks.workunit.client.1.smithi134.stdout:9/852: dread d2/d5/d8/d16/fd [0,4194304] 0 2024-09-17T04:20:56.145 INFO:tasks.workunit.client.1.smithi134.stdout:0/445: rename f0 to d11/d22/d1c/d2f/d43/f94 0 2024-09-17T04:20:56.145 INFO:tasks.workunit.client.0.smithi088.stdout:4/195: mknod d5/d32/c3a 0 2024-09-17T04:20:56.148 INFO:tasks.workunit.client.1.smithi134.stdout:3/563: creat de/d12/d15/d9f/fb6 x:0 0 0 2024-09-17T04:20:56.149 INFO:tasks.workunit.client.0.smithi088.stdout:3/96: dread d0/f2 [0,4194304] 0 2024-09-17T04:20:56.151 INFO:tasks.workunit.client.0.smithi088.stdout:4/196: creat d5/d32/d2c/f3b x:0 0 0 2024-09-17T04:20:56.152 INFO:tasks.workunit.client.1.smithi134.stdout:2/493: chown d19/f22 9262 1 2024-09-17T04:20:56.154 INFO:tasks.workunit.client.1.smithi134.stdout:1/514: unlink d12/d19/d5c/f69 0 2024-09-17T04:20:56.154 INFO:tasks.workunit.client.1.smithi134.stdout:7/380: dwrite d0/d16/f5a [0,4194304] 0 2024-09-17T04:20:56.155 INFO:tasks.workunit.client.1.smithi134.stdout:0/446: truncate d11/d22/d1c/d2f/d43/d5d/f78 527371 0 2024-09-17T04:20:56.156 INFO:tasks.workunit.client.1.smithi134.stdout:2/494: dread - d19/d27/d31/d49/d6f/d84/f9e zero size 2024-09-17T04:20:56.157 INFO:tasks.workunit.client.1.smithi134.stdout:4/530: dread d0/d13/f14 [0,4194304] 0 2024-09-17T04:20:56.158 INFO:tasks.workunit.client.1.smithi134.stdout:4/531: chown d0/df/d35/d39 27903815 1 2024-09-17T04:20:56.158 INFO:tasks.workunit.client.0.smithi088.stdout:4/197: mknod d5/d32/c3c 0 2024-09-17T04:20:56.159 INFO:tasks.workunit.client.0.smithi088.stdout:4/198: read d5/f2a [2568203,52407] 0 2024-09-17T04:20:56.163 INFO:tasks.workunit.client.1.smithi134.stdout:5/466: dwrite d0/f5c [0,4194304] 0 2024-09-17T04:20:56.164 INFO:tasks.workunit.client.1.smithi134.stdout:5/467: read - d0/d48/f82 zero size 2024-09-17T04:20:56.165 INFO:tasks.workunit.client.0.smithi088.stdout:4/199: mkdir d5/d3d 0 2024-09-17T04:20:56.167 INFO:tasks.workunit.client.0.smithi088.stdout:3/97: mknod d0/d13/d1b/c1c 0 2024-09-17T04:20:56.169 INFO:tasks.workunit.client.1.smithi134.stdout:7/381: creat d0/dd/d3a/d3d/d4c/f7a x:0 0 0 2024-09-17T04:20:56.170 INFO:tasks.workunit.client.1.smithi134.stdout:3/564: dwrite de/d12/d15/f4d [0,4194304] 0 2024-09-17T04:20:56.172 INFO:tasks.workunit.client.1.smithi134.stdout:7/382: dread d0/d16/d35/d4b/d65/f6e [0,4194304] 0 2024-09-17T04:20:56.175 INFO:tasks.workunit.client.1.smithi134.stdout:1/515: creat d12/d19/d5d/faa x:0 0 0 2024-09-17T04:20:56.176 INFO:tasks.workunit.client.1.smithi134.stdout:2/495: rename d19 to d19/d27/da0 22 2024-09-17T04:20:56.177 INFO:tasks.workunit.client.1.smithi134.stdout:1/516: write d12/d19/d1d/d3e/fa6 [981328,54463] 0 2024-09-17T04:20:56.177 INFO:tasks.workunit.client.1.smithi134.stdout:4/532: fsync d0/d13/d40/d42/f66 0 2024-09-17T04:20:56.178 INFO:tasks.workunit.client.1.smithi134.stdout:1/517: stat d12/d19/d1d/d5f/f87 0 2024-09-17T04:20:56.178 INFO:tasks.workunit.client.0.smithi088.stdout:3/98: dread d0/f3 [0,4194304] 0 2024-09-17T04:20:56.179 INFO:tasks.workunit.client.1.smithi134.stdout:4/533: write d0/df/d17/f24 [7408601,30732] 0 2024-09-17T04:20:56.179 INFO:tasks.workunit.client.1.smithi134.stdout:1/518: truncate d12/fa3 760943 0 2024-09-17T04:20:56.180 INFO:tasks.workunit.client.1.smithi134.stdout:1/519: dread - d12/f53 zero size 2024-09-17T04:20:56.182 INFO:tasks.workunit.client.0.smithi088.stdout:4/200: rmdir d5/d32/d36 0 2024-09-17T04:20:56.184 INFO:tasks.workunit.client.0.smithi088.stdout:4/201: write d5/fb [670340,108457] 0 2024-09-17T04:20:56.184 INFO:tasks.workunit.client.0.smithi088.stdout:3/99: fdatasync d0/f2 0 2024-09-17T04:20:56.185 INFO:tasks.workunit.client.0.smithi088.stdout:4/202: read - d5/d32/d2c/f3b zero size 2024-09-17T04:20:56.186 INFO:tasks.workunit.client.0.smithi088.stdout:3/100: truncate d0/f1a 602986 0 2024-09-17T04:20:56.187 INFO:tasks.workunit.client.0.smithi088.stdout:4/203: truncate d5/d32/d2c/f3b 200876 0 2024-09-17T04:20:56.187 INFO:tasks.workunit.client.1.smithi134.stdout:5/468: unlink d0/d3a/c8c 0 2024-09-17T04:20:56.188 INFO:tasks.workunit.client.1.smithi134.stdout:5/469: write d0/f39 [4196615,128249] 0 2024-09-17T04:20:56.189 INFO:tasks.workunit.client.1.smithi134.stdout:5/470: readlink d0/da/d69/d41/d6d/l98 0 2024-09-17T04:20:56.190 INFO:tasks.workunit.client.1.smithi134.stdout:3/565: creat de/d12/d15/d1d/d2d/d31/d6a/d83/fb7 x:0 0 0 2024-09-17T04:20:56.192 INFO:tasks.workunit.client.1.smithi134.stdout:0/447: unlink d11/d48/l53 0 2024-09-17T04:20:56.196 INFO:tasks.workunit.client.0.smithi088.stdout:4/204: link d5/c25 d5/d3d/c3e 0 2024-09-17T04:20:56.196 INFO:tasks.workunit.client.1.smithi134.stdout:3/566: dwrite de/d10/f68 [0,4194304] 0 2024-09-17T04:20:56.196 INFO:tasks.workunit.client.1.smithi134.stdout:3/567: stat de/d10/c19 0 2024-09-17T04:20:56.199 INFO:tasks.workunit.client.1.smithi134.stdout:4/534: read d0/df/d35/d39/f7c [1726576,56] 0 2024-09-17T04:20:56.199 INFO:tasks.workunit.client.0.smithi088.stdout:4/205: rename d5/d32/d2c to d5/d3f 0 2024-09-17T04:20:56.200 INFO:tasks.workunit.client.1.smithi134.stdout:1/520: truncate d12/f42 287800 0 2024-09-17T04:20:56.200 INFO:tasks.workunit.client.1.smithi134.stdout:0/448: dwrite d11/d19/f87 [0,4194304] 0 2024-09-17T04:20:56.201 INFO:tasks.workunit.client.1.smithi134.stdout:9/853: truncate d2/d5/d8/f19 3698332 0 2024-09-17T04:20:56.202 INFO:tasks.workunit.client.1.smithi134.stdout:1/521: write d12/d19/d1d/f6b [2998714,66427] 0 2024-09-17T04:20:56.202 INFO:tasks.workunit.client.1.smithi134.stdout:0/449: chown d11/d22/d1c/d2f/d43/l7a 276445 1 2024-09-17T04:20:56.202 INFO:tasks.workunit.client.1.smithi134.stdout:5/471: rename d0/da/d29/f60 to d0/da/d29/f9b 0 2024-09-17T04:20:56.205 INFO:tasks.workunit.client.1.smithi134.stdout:7/383: fsync d0/f1b 0 2024-09-17T04:20:56.207 INFO:tasks.workunit.client.1.smithi134.stdout:2/496: mkdir d19/da1 0 2024-09-17T04:20:56.209 INFO:tasks.workunit.client.1.smithi134.stdout:1/522: mknod d12/d19/d5d/cab 0 2024-09-17T04:20:56.211 INFO:tasks.workunit.client.1.smithi134.stdout:4/535: symlink d0/df/d1e/lad 0 2024-09-17T04:20:56.211 INFO:tasks.workunit.client.1.smithi134.stdout:2/497: symlink d19/d27/d31/d49/d63/la2 0 2024-09-17T04:20:56.212 INFO:tasks.workunit.client.1.smithi134.stdout:0/450: symlink d11/d22/l95 0 2024-09-17T04:20:56.213 INFO:tasks.workunit.client.1.smithi134.stdout:5/472: mkdir d0/d3a/d6b/d9c 0 2024-09-17T04:20:56.217 INFO:tasks.workunit.client.1.smithi134.stdout:9/854: creat d2/d5/d37/d83/f11c x:0 0 0 2024-09-17T04:20:56.217 INFO:tasks.workunit.client.1.smithi134.stdout:0/451: write d11/d22/d1c/f80 [474829,83708] 0 2024-09-17T04:20:56.217 INFO:tasks.workunit.client.1.smithi134.stdout:4/536: creat d0/d3b/d9f/fae x:0 0 0 2024-09-17T04:20:56.217 INFO:tasks.workunit.client.1.smithi134.stdout:2/498: mkdir d19/d1c/da3 0 2024-09-17T04:20:56.217 INFO:tasks.workunit.client.1.smithi134.stdout:9/855: chown d2/d5/d9/f2e 22327025 1 2024-09-17T04:20:56.218 INFO:tasks.workunit.client.1.smithi134.stdout:1/523: dwrite d12/f53 [0,4194304] 0 2024-09-17T04:20:56.222 INFO:tasks.workunit.client.1.smithi134.stdout:7/384: dread d0/d16/f13 [0,4194304] 0 2024-09-17T04:20:56.223 INFO:tasks.workunit.client.1.smithi134.stdout:1/524: mkdir d12/d19/d5d/d91/dac 0 2024-09-17T04:20:56.224 INFO:tasks.workunit.client.1.smithi134.stdout:3/568: dread de/d12/d22/d5a/f71 [0,4194304] 0 2024-09-17T04:20:56.227 INFO:tasks.workunit.client.1.smithi134.stdout:1/525: dread - d12/d19/d5d/f95 zero size 2024-09-17T04:20:56.228 INFO:tasks.workunit.client.1.smithi134.stdout:4/537: dwrite d0/f22 [0,4194304] 0 2024-09-17T04:20:56.230 INFO:tasks.workunit.client.1.smithi134.stdout:0/452: dwrite d11/d19/d21/d37/f42 [0,4194304] 0 2024-09-17T04:20:56.234 INFO:tasks.workunit.client.1.smithi134.stdout:1/526: write d12/d1c/d2e/d7d/f98 [751578,45261] 0 2024-09-17T04:20:56.234 INFO:tasks.workunit.client.1.smithi134.stdout:3/569: symlink de/d12/d9d/lb8 0 2024-09-17T04:20:56.238 INFO:tasks.workunit.client.1.smithi134.stdout:3/570: write de/f41 [247901,32640] 0 2024-09-17T04:20:56.238 INFO:tasks.workunit.client.1.smithi134.stdout:9/856: dwrite d2/d5/d9/df/f79 [0,4194304] 0 2024-09-17T04:20:56.239 INFO:tasks.workunit.client.1.smithi134.stdout:4/538: rename d0/d3b/f74 to d0/d13/d40/d42/d92/d86/faf 0 2024-09-17T04:20:56.240 INFO:tasks.workunit.client.1.smithi134.stdout:0/453: symlink d11/d24/d49/d62/l96 0 2024-09-17T04:20:56.241 INFO:tasks.workunit.client.1.smithi134.stdout:0/454: read d11/d24/f58 [34866,15484] 0 2024-09-17T04:20:56.243 INFO:tasks.workunit.client.1.smithi134.stdout:4/539: write d0/f22 [2669279,109810] 0 2024-09-17T04:20:56.244 INFO:tasks.workunit.client.1.smithi134.stdout:3/571: write de/d12/d15/d1d/d2d/d63/d77/f92 [3667071,29078] 0 2024-09-17T04:20:56.245 INFO:tasks.workunit.client.1.smithi134.stdout:4/540: fsync d0/d13/f33 0 2024-09-17T04:20:56.245 INFO:tasks.workunit.client.1.smithi134.stdout:0/455: chown d11/d4c/f92 872680029 1 2024-09-17T04:20:56.245 INFO:tasks.workunit.client.1.smithi134.stdout:1/527: truncate d12/d19/d1d/d61/f77 270428 0 2024-09-17T04:20:56.247 INFO:tasks.workunit.client.1.smithi134.stdout:0/456: write d11/d18/f1e [1693701,32066] 0 2024-09-17T04:20:56.248 INFO:tasks.workunit.client.1.smithi134.stdout:9/857: truncate d2/d5/d8/d16/d54/daf/d6d/daa/de2/dcd/fae 1274403 0 2024-09-17T04:20:56.249 INFO:tasks.workunit.client.1.smithi134.stdout:4/541: creat d0/df/d1e/daa/fb0 x:0 0 0 2024-09-17T04:20:56.249 INFO:tasks.workunit.client.1.smithi134.stdout:3/572: symlink de/d12/d15/d1d/d2d/d31/lb9 0 2024-09-17T04:20:56.251 INFO:tasks.workunit.client.1.smithi134.stdout:9/858: creat d2/d25/f11d x:0 0 0 2024-09-17T04:20:56.251 INFO:tasks.workunit.client.1.smithi134.stdout:3/573: chown de/d10/f68 3 1 2024-09-17T04:20:56.252 INFO:tasks.workunit.client.1.smithi134.stdout:9/859: chown d2/d5/d58 147940 1 2024-09-17T04:20:56.253 INFO:tasks.workunit.client.1.smithi134.stdout:1/528: dwrite d12/d19/d5d/f7a [0,4194304] 0 2024-09-17T04:20:56.254 INFO:tasks.workunit.client.1.smithi134.stdout:3/574: chown de/d10/d3d/f94 33060649 1 2024-09-17T04:20:56.256 INFO:tasks.workunit.client.1.smithi134.stdout:9/860: mkdir d2/d5/d8/d16/d54/daf/ded/d11e 0 2024-09-17T04:20:56.257 INFO:tasks.workunit.client.1.smithi134.stdout:3/575: rmdir de/d12/d15/d1d/d2d/d63/d77 39 2024-09-17T04:20:56.258 INFO:tasks.workunit.client.1.smithi134.stdout:1/529: mknod d12/d19/d5d/d91/dac/cad 0 2024-09-17T04:20:56.259 INFO:tasks.workunit.client.0.smithi088.stdout:9/132: sync 2024-09-17T04:20:56.260 INFO:tasks.workunit.client.1.smithi134.stdout:3/576: mkdir de/d12/d15/d9f/dba 0 2024-09-17T04:20:56.263 INFO:tasks.workunit.client.1.smithi134.stdout:9/861: mkdir d2/d5/d8/d16/d54/d5e/d11f 0 2024-09-17T04:20:56.265 INFO:tasks.workunit.client.0.smithi088.stdout:9/133: unlink d2/f18 0 2024-09-17T04:20:56.265 INFO:tasks.workunit.client.1.smithi134.stdout:3/577: creat de/fbb x:0 0 0 2024-09-17T04:20:56.266 INFO:tasks.workunit.client.0.smithi088.stdout:9/134: chown d2/dd/d14/d2a 2691017 1 2024-09-17T04:20:56.267 INFO:tasks.workunit.client.1.smithi134.stdout:1/530: creat d12/d36/fae x:0 0 0 2024-09-17T04:20:56.270 INFO:tasks.workunit.client.0.smithi088.stdout:9/135: rename d2/dd/d11/l21 to d2/d2b/d2e/l2f 0 2024-09-17T04:20:56.271 INFO:tasks.workunit.client.0.smithi088.stdout:9/136: stat d2/d2b/d2e 0 2024-09-17T04:20:56.272 INFO:tasks.workunit.client.1.smithi134.stdout:9/862: mknod d2/d5/d8/d16/d54/daf/d6d/daa/de2/dcd/dd6/de3/c120 0 2024-09-17T04:20:56.273 INFO:tasks.workunit.client.1.smithi134.stdout:1/531: dwrite d12/d19/d1d/d5f/f87 [0,4194304] 0 2024-09-17T04:20:56.277 INFO:tasks.workunit.client.1.smithi134.stdout:1/532: mknod d12/d19/d5d/d91/dac/caf 0 2024-09-17T04:20:56.281 INFO:tasks.workunit.client.1.smithi134.stdout:9/863: truncate d2/d5/d8/d16/d54/daf/d6d/daa/de2/dcd/dd6/dff/f116 4441015 0 2024-09-17T04:20:56.284 INFO:tasks.workunit.client.1.smithi134.stdout:9/864: mknod d2/d5/d8/d16/d54/daf/d6d/daa/de2/dcd/dd6/de3/c121 0 2024-09-17T04:20:56.284 INFO:tasks.workunit.client.1.smithi134.stdout:1/533: dread d12/d19/d1d/d3e/fa6 [0,4194304] 0 2024-09-17T04:20:56.286 INFO:tasks.workunit.client.1.smithi134.stdout:1/534: chown d12/d19/d5d/d88 43729 1 2024-09-17T04:20:56.289 INFO:tasks.workunit.client.1.smithi134.stdout:9/865: rename d2/d5/d37/d3f/cd3 to d2/d5/d9/df/d80/c122 0 2024-09-17T04:20:56.290 INFO:tasks.workunit.client.1.smithi134.stdout:1/535: creat d12/d19/d1d/d5f/fb0 x:0 0 0 2024-09-17T04:20:56.291 INFO:tasks.workunit.client.1.smithi134.stdout:9/866: rmdir d2/d5 39 2024-09-17T04:20:56.293 INFO:tasks.workunit.client.1.smithi134.stdout:1/536: unlink d12/d19/f64 0 2024-09-17T04:20:56.297 INFO:tasks.workunit.client.1.smithi134.stdout:1/537: mknod d12/d1c/d2e/d7d/cb1 0 2024-09-17T04:20:56.297 INFO:tasks.workunit.client.1.smithi134.stdout:9/867: mkdir d2/d5/d9/df/d38/d123 0 2024-09-17T04:20:56.299 INFO:tasks.workunit.client.1.smithi134.stdout:3/578: dread de/f2a [0,4194304] 0 2024-09-17T04:20:56.301 INFO:tasks.workunit.client.1.smithi134.stdout:9/868: symlink d2/d5/d8/d16/d54/daf/d6d/daa/de2/dcd/l124 0 2024-09-17T04:20:56.302 INFO:tasks.workunit.client.1.smithi134.stdout:3/579: symlink de/d67/lbc 0 2024-09-17T04:20:56.303 INFO:tasks.workunit.client.1.smithi134.stdout:3/580: write de/d12/d15/d1d/d2d/f53 [1765538,46060] 0 2024-09-17T04:20:56.307 INFO:tasks.workunit.client.1.smithi134.stdout:3/581: mkdir de/d12/d15/d1d/d2d/d63/d77/dbd 0 2024-09-17T04:20:56.307 INFO:tasks.workunit.client.1.smithi134.stdout:7/385: write d0/dd/d3a/d3d/f78 [124832,37544] 0 2024-09-17T04:20:56.309 INFO:tasks.workunit.client.1.smithi134.stdout:3/582: readlink de/d12/d15/l7a 0 2024-09-17T04:20:56.309 INFO:tasks.workunit.client.1.smithi134.stdout:3/583: read de/f3b [626733,51724] 0 2024-09-17T04:20:56.310 INFO:tasks.workunit.client.1.smithi134.stdout:7/386: creat d0/d16/d35/d4b/d65/f7b x:0 0 0 2024-09-17T04:20:56.315 INFO:tasks.workunit.client.1.smithi134.stdout:7/387: creat d0/d16/d35/d4b/f7c x:0 0 0 2024-09-17T04:20:56.315 INFO:tasks.workunit.client.1.smithi134.stdout:3/584: getdents de/d10 0 2024-09-17T04:20:56.316 INFO:tasks.workunit.client.1.smithi134.stdout:7/388: symlink d0/dd/d57/l7d 0 2024-09-17T04:20:56.317 INFO:tasks.workunit.client.1.smithi134.stdout:3/585: symlink de/d12/d22/d5a/lbe 0 2024-09-17T04:20:56.318 INFO:tasks.workunit.client.1.smithi134.stdout:3/586: chown de/d67 7528 1 2024-09-17T04:20:56.318 INFO:tasks.workunit.client.1.smithi134.stdout:7/389: truncate d0/f1b 103023 0 2024-09-17T04:20:56.320 INFO:tasks.workunit.client.1.smithi134.stdout:3/587: dread - de/d12/d15/d1d/d2d/d31/d6a/d83/fb7 zero size 2024-09-17T04:20:56.320 INFO:tasks.workunit.client.1.smithi134.stdout:4/542: dwrite d0/d13/d40/d72/fa6 [0,4194304] 0 2024-09-17T04:20:56.321 INFO:tasks.workunit.client.1.smithi134.stdout:4/543: fdatasync d0/df/d17/f6d 0 2024-09-17T04:20:56.324 INFO:tasks.workunit.client.1.smithi134.stdout:3/588: creat de/d12/d15/d1d/d2d/d31/d6a/fbf x:0 0 0 2024-09-17T04:20:56.329 INFO:tasks.workunit.client.1.smithi134.stdout:4/544: rename d0/df/d1e/d73/l7d to d0/df/d35/d5c/lb1 0 2024-09-17T04:20:56.330 INFO:tasks.workunit.client.1.smithi134.stdout:4/545: chown d0/df/d1e/lad 1 1 2024-09-17T04:20:56.330 INFO:tasks.workunit.client.1.smithi134.stdout:3/589: unlink de/fbb 0 2024-09-17T04:20:56.331 INFO:tasks.workunit.client.1.smithi134.stdout:3/590: chown de/c40 12160865 1 2024-09-17T04:20:56.336 INFO:tasks.workunit.client.0.smithi088.stdout:9/137: dwrite d2/dd/f15 [0,4194304] 0 2024-09-17T04:20:56.339 INFO:tasks.workunit.client.0.smithi088.stdout:9/138: mkdir d2/dd/d11/d30 0 2024-09-17T04:20:56.344 INFO:tasks.workunit.client.0.smithi088.stdout:9/139: read d2/dd/fe [215880,12921] 0 2024-09-17T04:20:56.345 INFO:tasks.workunit.client.1.smithi134.stdout:1/538: truncate d12/d1c/d56/f70 938258 0 2024-09-17T04:20:56.345 INFO:tasks.workunit.client.0.smithi088.stdout:9/140: rename d2/d2b/d2e to d2/d2b/d2e/d31 22 2024-09-17T04:20:56.345 INFO:tasks.workunit.client.1.smithi134.stdout:1/539: write d12/d19/d5d/f7a [4577140,30214] 0 2024-09-17T04:20:56.347 INFO:tasks.workunit.client.0.smithi088.stdout:9/141: symlink d2/dd/d11/d30/l32 0 2024-09-17T04:20:56.350 INFO:tasks.workunit.client.1.smithi134.stdout:9/869: dwrite d2/d5/d37/fa8 [0,4194304] 0 2024-09-17T04:20:56.351 INFO:tasks.workunit.client.0.smithi088.stdout:9/142: mknod d2/dd/d11/d30/c33 0 2024-09-17T04:20:56.353 INFO:tasks.workunit.client.1.smithi134.stdout:1/540: rmdir d12/d1c/d59 0 2024-09-17T04:20:56.355 INFO:tasks.workunit.client.1.smithi134.stdout:1/541: truncate d12/d19/d1d/d5f/fb0 770992 0 2024-09-17T04:20:56.355 INFO:tasks.workunit.client.1.smithi134.stdout:9/870: dread d2/d5/d8/d16/d54/daf/d6d/daa/ffe [0,4194304] 0 2024-09-17T04:20:56.356 INFO:tasks.workunit.client.1.smithi134.stdout:1/542: readlink d12/d36/l6e 0 2024-09-17T04:20:56.356 INFO:tasks.workunit.client.1.smithi134.stdout:7/390: write d0/d16/f13 [501920,2925] 0 2024-09-17T04:20:56.362 INFO:tasks.workunit.client.1.smithi134.stdout:2/499: sync 2024-09-17T04:20:56.362 INFO:tasks.workunit.client.1.smithi134.stdout:0/457: sync 2024-09-17T04:20:56.362 INFO:tasks.workunit.client.1.smithi134.stdout:6/588: sync 2024-09-17T04:20:56.362 INFO:tasks.workunit.client.1.smithi134.stdout:8/444: sync 2024-09-17T04:20:56.362 INFO:tasks.workunit.client.1.smithi134.stdout:5/473: sync 2024-09-17T04:20:56.365 INFO:tasks.workunit.client.1.smithi134.stdout:6/589: fsync de/d19/d62/f20 0 2024-09-17T04:20:56.367 INFO:tasks.workunit.client.1.smithi134.stdout:9/871: dwrite d2/d5/d8/d16/f115 [0,4194304] 0 2024-09-17T04:20:56.368 INFO:tasks.workunit.client.1.smithi134.stdout:0/458: write d11/d18/f67 [508100,119653] 0 2024-09-17T04:20:56.368 INFO:tasks.workunit.client.1.smithi134.stdout:7/391: dwrite d0/d16/d35/d4b/f69 [0,4194304] 0 2024-09-17T04:20:56.370 INFO:tasks.workunit.client.1.smithi134.stdout:6/590: dread - de/d19/d1f/d85/fa7 zero size 2024-09-17T04:20:56.371 INFO:tasks.workunit.client.1.smithi134.stdout:7/392: readlink d0/dd/d57/l7d 0 2024-09-17T04:20:56.374 INFO:tasks.workunit.client.1.smithi134.stdout:6/591: chown de/l32 720114 1 2024-09-17T04:20:56.374 INFO:tasks.workunit.client.1.smithi134.stdout:5/474: dwrite d0/f2a [0,4194304] 0 2024-09-17T04:20:56.377 INFO:tasks.workunit.client.1.smithi134.stdout:5/475: write d0/d3a/f5b [652015,76996] 0 2024-09-17T04:20:56.377 INFO:tasks.workunit.client.1.smithi134.stdout:6/592: truncate de/d19/d1f/f73 708529 0 2024-09-17T04:20:56.377 INFO:tasks.workunit.client.1.smithi134.stdout:5/476: chown d0/da/d29/c38 415 1 2024-09-17T04:20:56.438 INFO:tasks.workunit.client.1.smithi134.stdout:1/543: write d12/d19/d66/f82 [364142,2692] 0 2024-09-17T04:20:56.443 INFO:tasks.workunit.client.1.smithi134.stdout:3/591: write de/d12/d22/f81 [4398923,20253] 0 2024-09-17T04:20:56.444 INFO:tasks.workunit.client.1.smithi134.stdout:9/872: symlink d2/d7/l125 0 2024-09-17T04:20:56.445 INFO:tasks.workunit.client.1.smithi134.stdout:2/500: dwrite d19/d1c/f30 [0,4194304] 0 2024-09-17T04:20:56.446 INFO:tasks.workunit.client.1.smithi134.stdout:4/546: truncate d0/df/d1e/f5e 2242620 0 2024-09-17T04:20:56.446 INFO:tasks.workunit.client.1.smithi134.stdout:9/873: fdatasync d2/d5/d37/d7c/f8e 0 2024-09-17T04:20:56.447 INFO:tasks.workunit.client.1.smithi134.stdout:2/501: chown f16 2005050589 1 2024-09-17T04:20:56.453 INFO:tasks.workunit.client.1.smithi134.stdout:8/445: link d4/d1e/f81 d4/d11/f90 0 2024-09-17T04:20:56.460 INFO:tasks.workunit.client.1.smithi134.stdout:4/547: mknod d0/d13/d40/cb2 0 2024-09-17T04:20:56.462 INFO:tasks.workunit.client.1.smithi134.stdout:2/502: chown d19/d27/d31/d34/l78 1 1 2024-09-17T04:20:56.464 INFO:tasks.workunit.client.1.smithi134.stdout:9/874: rename d2/d5/d37/d7c to d2/d5/d9/d6b/de1/d126 0 2024-09-17T04:20:56.465 INFO:tasks.workunit.client.1.smithi134.stdout:9/875: write d2/d5/d37/f47 [2575235,90980] 0 2024-09-17T04:20:56.465 INFO:tasks.workunit.client.1.smithi134.stdout:1/544: mkdir d12/db2 0 2024-09-17T04:20:56.468 INFO:tasks.workunit.client.1.smithi134.stdout:8/446: unlink d4/d23/d60/d6b/d13/f2c 0 2024-09-17T04:20:56.469 INFO:tasks.workunit.client.1.smithi134.stdout:3/592: mkdir de/d12/d15/d9f/dba/dc0 0 2024-09-17T04:20:56.471 INFO:tasks.workunit.client.1.smithi134.stdout:3/593: chown de/d12/f3a 303393 1 2024-09-17T04:20:56.473 INFO:tasks.workunit.client.1.smithi134.stdout:0/459: truncate d11/d19/d21/f60 2921376 0 2024-09-17T04:20:56.473 INFO:tasks.workunit.client.1.smithi134.stdout:3/594: dread - de/d10/f79 zero size 2024-09-17T04:20:56.475 INFO:tasks.workunit.client.1.smithi134.stdout:7/393: truncate d0/f6 2256995 0 2024-09-17T04:20:56.475 INFO:tasks.workunit.client.1.smithi134.stdout:8/447: write d4/d23/d60/d6b/d13/f78 [1140738,7317] 0 2024-09-17T04:20:56.476 INFO:tasks.workunit.client.1.smithi134.stdout:9/876: dwrite d2/d25/f11d [0,4194304] 0 2024-09-17T04:20:56.476 INFO:tasks.workunit.client.1.smithi134.stdout:6/593: dwrite de/d19/d21/d2d/f3e [0,4194304] 0 2024-09-17T04:20:56.481 INFO:tasks.workunit.client.1.smithi134.stdout:3/595: fsync de/d10/d3d/f94 0 2024-09-17T04:20:56.482 INFO:tasks.workunit.client.1.smithi134.stdout:0/460: fdatasync d11/d22/d1c/d2f/d43/f44 0 2024-09-17T04:20:56.483 INFO:tasks.workunit.client.1.smithi134.stdout:1/545: fdatasync d12/d1c/d2e/d7d/fa7 0 2024-09-17T04:20:56.484 INFO:tasks.workunit.client.1.smithi134.stdout:5/477: truncate d0/f39 2540703 0 2024-09-17T04:20:56.485 INFO:tasks.workunit.client.1.smithi134.stdout:2/503: creat d19/d27/d31/d34/fa4 x:0 0 0 2024-09-17T04:20:56.487 INFO:tasks.workunit.client.1.smithi134.stdout:7/394: chown d0/dd/d3a/d3d/d4c 515 1 2024-09-17T04:20:56.489 INFO:tasks.workunit.client.1.smithi134.stdout:0/461: chown d11/d22/d1c/d2f/d43/l73 720685844 1 2024-09-17T04:20:56.492 INFO:tasks.workunit.client.1.smithi134.stdout:6/594: creat de/d19/d62/fb9 x:0 0 0 2024-09-17T04:20:56.493 INFO:tasks.workunit.client.1.smithi134.stdout:8/448: write d4/db/dd/f30 [8737,73863] 0 2024-09-17T04:20:56.496 INFO:tasks.workunit.client.1.smithi134.stdout:1/546: creat d12/d19/d4f/fb3 x:0 0 0 2024-09-17T04:20:56.499 INFO:tasks.workunit.client.1.smithi134.stdout:2/504: chown d19/d27/d31/d34/d6d/l79 104437 1 2024-09-17T04:20:56.499 INFO:tasks.workunit.client.1.smithi134.stdout:6/595: dwrite de/f2c [0,4194304] 0 2024-09-17T04:20:56.501 INFO:tasks.workunit.client.1.smithi134.stdout:3/596: mknod de/d12/d15/d1d/d2d/d63/d77/cc1 0 2024-09-17T04:20:56.501 INFO:tasks.workunit.client.1.smithi134.stdout:0/462: mkdir d11/d18/d97 0 2024-09-17T04:20:56.502 INFO:tasks.workunit.client.1.smithi134.stdout:4/548: fdatasync d0/d13/d40/d42/d92/f21 0 2024-09-17T04:20:56.503 INFO:tasks.workunit.client.1.smithi134.stdout:8/449: fdatasync d4/d1f/d25/d6a/f85 0 2024-09-17T04:20:56.504 INFO:tasks.workunit.client.1.smithi134.stdout:9/877: getdents d2/d5/d8/d16/d54/d5e/d11f 0 2024-09-17T04:20:56.506 INFO:tasks.workunit.client.1.smithi134.stdout:6/596: fdatasync de/f12 0 2024-09-17T04:20:56.507 INFO:tasks.workunit.client.1.smithi134.stdout:6/597: dread - de/d2b/f80 zero size 2024-09-17T04:20:56.509 INFO:tasks.workunit.client.1.smithi134.stdout:0/463: creat d11/d19/f98 x:0 0 0 2024-09-17T04:20:56.510 INFO:tasks.workunit.client.1.smithi134.stdout:8/450: dwrite d4/db/f20 [0,4194304] 0 2024-09-17T04:20:56.511 INFO:tasks.workunit.client.1.smithi134.stdout:5/478: write d0/d48/f82 [21219,37171] 0 2024-09-17T04:20:56.512 INFO:tasks.workunit.client.1.smithi134.stdout:1/547: symlink d12/db2/lb4 0 2024-09-17T04:20:56.513 INFO:tasks.workunit.client.1.smithi134.stdout:9/878: rmdir d2/d5/dd0 39 2024-09-17T04:20:56.515 INFO:tasks.workunit.client.1.smithi134.stdout:6/598: rmdir de 39 2024-09-17T04:20:56.516 INFO:tasks.workunit.client.1.smithi134.stdout:7/395: link d0/dd/d3a/d3d/c47 d0/dd/d57/d6a/c7e 0 2024-09-17T04:20:56.517 INFO:tasks.workunit.client.1.smithi134.stdout:0/464: creat d11/d19/f99 x:0 0 0 2024-09-17T04:20:56.519 INFO:tasks.workunit.client.1.smithi134.stdout:8/451: rmdir d4/db/dd/d43 39 2024-09-17T04:20:56.519 INFO:tasks.workunit.client.1.smithi134.stdout:9/879: read d2/d5/d8/d16/d54/d5e/da0/f10e [2628800,21788] 0 2024-09-17T04:20:56.520 INFO:tasks.workunit.client.1.smithi134.stdout:5/479: creat d0/da/d2c/f9d x:0 0 0 2024-09-17T04:20:56.523 INFO:tasks.workunit.client.1.smithi134.stdout:9/880: write d2/d5/d9/d6b/de1/f65 [4136199,87865] 0 2024-09-17T04:20:56.523 INFO:tasks.workunit.client.1.smithi134.stdout:1/548: dwrite d12/d19/d1d/f44 [0,4194304] 0 2024-09-17T04:20:56.525 INFO:tasks.workunit.client.1.smithi134.stdout:8/452: truncate d4/d23/d60/d6b/d13/f61 1023653 0 2024-09-17T04:20:56.537 INFO:tasks.workunit.client.1.smithi134.stdout:3/597: getdents de/d12/d9d 0 2024-09-17T04:20:56.538 INFO:tasks.workunit.client.1.smithi134.stdout:6/599: truncate de/d19/d74/d94/d9e/fb1 234154 0 2024-09-17T04:20:56.538 INFO:tasks.workunit.client.1.smithi134.stdout:5/480: mkdir d0/da/d29/d7c/d9e 0 2024-09-17T04:20:56.539 INFO:tasks.workunit.client.1.smithi134.stdout:1/549: dread - d12/d19/f54 zero size 2024-09-17T04:20:56.539 INFO:tasks.workunit.client.1.smithi134.stdout:9/881: mkdir d2/d5/d8/d1e/d127 0 2024-09-17T04:20:56.539 INFO:tasks.workunit.client.1.smithi134.stdout:4/549: write d0/df/d35/d5c/f6b [1321543,70720] 0 2024-09-17T04:20:56.539 INFO:tasks.workunit.client.0.smithi088.stdout:2/125: sync 2024-09-17T04:20:56.540 INFO:tasks.workunit.client.0.smithi088.stdout:5/151: sync 2024-09-17T04:20:56.540 INFO:tasks.workunit.client.1.smithi134.stdout:0/465: rmdir d11/d24/d89 0 2024-09-17T04:20:56.540 INFO:tasks.workunit.client.0.smithi088.stdout:5/152: chown d2/d9/f2f 1038932929 1 2024-09-17T04:20:56.541 INFO:tasks.workunit.client.1.smithi134.stdout:5/481: chown d0/d3a/ff 1 1 2024-09-17T04:20:56.541 INFO:tasks.workunit.client.1.smithi134.stdout:9/882: stat d2/d5/d9/d6a/f7a 0 2024-09-17T04:20:56.542 INFO:tasks.workunit.client.0.smithi088.stdout:5/153: write d2/d9/d20/f2a [187226,116709] 0 2024-09-17T04:20:56.542 INFO:tasks.workunit.client.0.smithi088.stdout:5/154: fsync d2/d9/f21 0 2024-09-17T04:20:56.543 INFO:tasks.workunit.client.1.smithi134.stdout:4/550: fsync d0/df/d35/d5c/f81 0 2024-09-17T04:20:56.543 INFO:tasks.workunit.client.1.smithi134.stdout:3/598: mknod de/d12/d15/d1d/d2d/d31/d6a/cc2 0 2024-09-17T04:20:56.544 INFO:tasks.workunit.client.1.smithi134.stdout:1/550: read - d12/d1c/d2e/d7d/fa7 zero size 2024-09-17T04:20:56.544 INFO:tasks.workunit.client.1.smithi134.stdout:0/466: chown d11/d22/d1c/d2f/d43 290 1 2024-09-17T04:20:56.545 INFO:tasks.workunit.client.0.smithi088.stdout:2/126: dread d0/d1/fb [0,4194304] 0 2024-09-17T04:20:56.545 INFO:tasks.workunit.client.1.smithi134.stdout:8/453: dwrite d4/f36 [0,4194304] 0 2024-09-17T04:20:56.546 INFO:tasks.workunit.client.1.smithi134.stdout:4/551: write d0/d3b/f52 [2658410,25305] 0 2024-09-17T04:20:56.548 INFO:tasks.workunit.client.1.smithi134.stdout:7/396: truncate d0/dd/d57/d6a/f6d 1884163 0 2024-09-17T04:20:56.550 INFO:tasks.workunit.client.1.smithi134.stdout:9/883: mknod d2/d5/d58/db5/c128 0 2024-09-17T04:20:56.550 INFO:tasks.workunit.client.0.smithi088.stdout:5/155: dwrite d2/f15 [0,4194304] 0 2024-09-17T04:20:56.550 INFO:tasks.workunit.client.1.smithi134.stdout:3/599: stat de/d12/d15/d1d/d2d/d31/d6a/d78 0 2024-09-17T04:20:56.552 INFO:tasks.workunit.client.1.smithi134.stdout:0/467: rmdir d11/d19/d21 39 2024-09-17T04:20:56.552 INFO:tasks.workunit.client.0.smithi088.stdout:2/127: dread d0/d1/fe [0,4194304] 0 2024-09-17T04:20:56.553 INFO:tasks.workunit.client.1.smithi134.stdout:8/454: symlink d4/d1f/d25/d6a/l91 0 2024-09-17T04:20:56.555 INFO:tasks.workunit.client.1.smithi134.stdout:9/884: chown d2/d5/d37/d83/da7 5429751 1 2024-09-17T04:20:56.555 INFO:tasks.workunit.client.1.smithi134.stdout:4/552: creat d0/df/d17/d9c/fb3 x:0 0 0 2024-09-17T04:20:56.556 INFO:tasks.workunit.client.0.smithi088.stdout:2/128: mkdir d0/d14/d17/d26 0 2024-09-17T04:20:56.559 INFO:tasks.workunit.client.0.smithi088.stdout:5/156: dwrite d2/d9/fa [0,4194304] 0 2024-09-17T04:20:56.562 INFO:tasks.workunit.client.1.smithi134.stdout:0/468: mkdir d11/d22/d1c/d2f/d9a 0 2024-09-17T04:20:56.563 INFO:tasks.workunit.client.1.smithi134.stdout:8/455: stat d4/db/dd/f16 0 2024-09-17T04:20:56.563 INFO:tasks.workunit.client.0.smithi088.stdout:2/129: dread d0/d1/fe [0,4194304] 0 2024-09-17T04:20:56.564 INFO:tasks.workunit.client.1.smithi134.stdout:5/482: dwrite d0/da/d69/d41/f49 [4194304,4194304] 0 2024-09-17T04:20:56.566 INFO:tasks.workunit.client.1.smithi134.stdout:7/397: rename d0/dd/f77 to d0/dd/d3a/d3d/d38/d74/f7f 0 2024-09-17T04:20:56.568 INFO:tasks.workunit.client.0.smithi088.stdout:2/130: symlink d0/d14/d17/d26/l27 0 2024-09-17T04:20:56.568 INFO:tasks.workunit.client.1.smithi134.stdout:6/600: dwrite de/d19/f22 [0,4194304] 0 2024-09-17T04:20:56.570 INFO:tasks.workunit.client.1.smithi134.stdout:9/885: chown d2/d5/d8/d16/d54/daf/d6d/daa/de2/fef 15930 1 2024-09-17T04:20:56.575 INFO:tasks.workunit.client.1.smithi134.stdout:7/398: write d0/d16/d35/f40 [2093596,62835] 0 2024-09-17T04:20:56.577 INFO:tasks.workunit.client.1.smithi134.stdout:1/551: dwrite d12/d19/d1d/d3e/f48 [0,4194304] 0 2024-09-17T04:20:56.577 INFO:tasks.workunit.client.1.smithi134.stdout:0/469: mkdir d11/d24/d49/d9b 0 2024-09-17T04:20:56.578 INFO:tasks.workunit.client.1.smithi134.stdout:4/553: dread d0/df/d35/d5c/f94 [0,4194304] 0 2024-09-17T04:20:56.581 INFO:tasks.workunit.client.1.smithi134.stdout:6/601: symlink de/d19/d1f/d55/d77/d89/lba 0 2024-09-17T04:20:56.582 INFO:tasks.workunit.client.1.smithi134.stdout:7/399: stat d0/d16/d35 0 2024-09-17T04:20:56.584 INFO:tasks.workunit.client.1.smithi134.stdout:0/470: fdatasync d11/f3b 0 2024-09-17T04:20:56.585 INFO:tasks.workunit.client.1.smithi134.stdout:3/600: dwrite de/d12/d22/d5a/f9e [0,4194304] 0 2024-09-17T04:20:56.585 INFO:tasks.workunit.client.0.smithi088.stdout:5/157: truncate d2/f1c 3413897 0 2024-09-17T04:20:56.589 INFO:tasks.workunit.client.0.smithi088.stdout:5/158: mkdir d2/d9/d20/d30 0 2024-09-17T04:20:56.590 INFO:tasks.workunit.client.1.smithi134.stdout:4/554: fdatasync d0/df/d35/f89 0 2024-09-17T04:20:56.590 INFO:tasks.workunit.client.1.smithi134.stdout:7/400: chown d0/dd/d3a/f4f 1625703 1 2024-09-17T04:20:56.591 INFO:tasks.workunit.client.0.smithi088.stdout:5/159: write d2/d9/fc [4661242,102426] 0 2024-09-17T04:20:56.592 INFO:tasks.workunit.client.1.smithi134.stdout:6/602: mknod de/d2b/d8a/cbb 0 2024-09-17T04:20:56.593 INFO:tasks.workunit.client.0.smithi088.stdout:2/131: truncate d0/d1/f11 4153994 0 2024-09-17T04:20:56.593 INFO:tasks.workunit.client.1.smithi134.stdout:5/483: dwrite d0/da/d29/d78/f99 [0,4194304] 0 2024-09-17T04:20:56.593 INFO:tasks.workunit.client.1.smithi134.stdout:4/555: chown d0/df/d35/l6e 11 1 2024-09-17T04:20:56.594 INFO:tasks.workunit.client.0.smithi088.stdout:2/132: write d0/d1/f2 [550836,66467] 0 2024-09-17T04:20:56.597 INFO:tasks.workunit.client.1.smithi134.stdout:9/886: write d2/d5/d8/d16/d54/daf/f95 [3428042,17872] 0 2024-09-17T04:20:56.598 INFO:tasks.workunit.client.0.smithi088.stdout:2/133: creat d0/d14/f28 x:0 0 0 2024-09-17T04:20:56.601 INFO:tasks.workunit.client.0.smithi088.stdout:5/160: mkdir d2/d31 0 2024-09-17T04:20:56.602 INFO:tasks.workunit.client.1.smithi134.stdout:8/456: dread d4/db/dd/f1b [0,4194304] 0 2024-09-17T04:20:56.602 INFO:tasks.workunit.client.1.smithi134.stdout:1/552: write d12/d1c/d2e/d7d/f97 [4166834,43714] 0 2024-09-17T04:20:56.602 INFO:tasks.workunit.client.0.smithi088.stdout:5/161: write d2/f1d [2611186,25646] 0 2024-09-17T04:20:56.603 INFO:tasks.workunit.client.1.smithi134.stdout:9/887: readlink d2/d5/d9/d6b/de1/l9b 0 2024-09-17T04:20:56.603 INFO:tasks.workunit.client.0.smithi088.stdout:2/134: dread d0/d14/d17/f1f [0,4194304] 0 2024-09-17T04:20:56.603 INFO:tasks.workunit.client.0.smithi088.stdout:5/162: chown d2/d9/d20/d30 277207 1 2024-09-17T04:20:56.604 INFO:tasks.workunit.client.0.smithi088.stdout:2/135: fdatasync d0/d1/f1e 0 2024-09-17T04:20:56.605 INFO:tasks.workunit.client.0.smithi088.stdout:2/136: stat d0/d14/d17/d26 0 2024-09-17T04:20:56.606 INFO:tasks.workunit.client.1.smithi134.stdout:6/603: dwrite de/d2b/f45 [0,4194304] 0 2024-09-17T04:20:56.606 INFO:tasks.workunit.client.0.smithi088.stdout:2/137: fdatasync d0/fd 0 2024-09-17T04:20:56.609 INFO:tasks.workunit.client.1.smithi134.stdout:3/601: mkdir de/d12/d15/d1d/d2d/d63/d77/dbd/dc3 0 2024-09-17T04:20:56.610 INFO:tasks.workunit.client.0.smithi088.stdout:2/138: mknod d0/d14/c29 0 2024-09-17T04:20:56.610 INFO:tasks.workunit.client.0.smithi088.stdout:5/163: creat d2/d9/d20/d30/f32 x:0 0 0 2024-09-17T04:20:56.613 INFO:tasks.workunit.client.1.smithi134.stdout:9/888: mknod d2/d5/d8/d16/d54/daf/d6d/daa/de2/dcf/c129 0 2024-09-17T04:20:56.616 INFO:tasks.workunit.client.1.smithi134.stdout:4/556: unlink d0/d13/d40/d72/l82 0 2024-09-17T04:20:56.617 INFO:tasks.workunit.client.0.smithi088.stdout:5/164: stat d2/l1e 0 2024-09-17T04:20:56.619 INFO:tasks.workunit.client.1.smithi134.stdout:9/889: dwrite d2/d5/d8/d16/d54/daf/f95 [0,4194304] 0 2024-09-17T04:20:56.620 INFO:tasks.workunit.client.0.smithi088.stdout:2/139: creat d0/d14/d24/f2a x:0 0 0 2024-09-17T04:20:56.621 INFO:tasks.workunit.client.1.smithi134.stdout:6/604: dread de/d19/d21/f7a [0,4194304] 0 2024-09-17T04:20:56.621 INFO:tasks.workunit.client.1.smithi134.stdout:3/602: mkdir de/d12/d15/d9f/dba/dc4 0 2024-09-17T04:20:56.622 INFO:tasks.workunit.client.1.smithi134.stdout:7/401: dread d0/d16/d35/d4b/f48 [4194304,4194304] 0 2024-09-17T04:20:56.624 INFO:tasks.workunit.client.1.smithi134.stdout:5/484: creat d0/d3a/d2b/f9f x:0 0 0 2024-09-17T04:20:56.624 INFO:tasks.workunit.client.1.smithi134.stdout:5/485: fdatasync d0/d48/f4f 0 2024-09-17T04:20:56.628 INFO:tasks.workunit.client.0.smithi088.stdout:2/140: dwrite d0/d1/f2 [0,4194304] 0 2024-09-17T04:20:56.631 INFO:tasks.workunit.client.1.smithi134.stdout:0/471: link d11/d4c/d76/l77 d11/l9c 0 2024-09-17T04:20:56.631 INFO:tasks.workunit.client.1.smithi134.stdout:6/605: rmdir de 39 2024-09-17T04:20:56.631 INFO:tasks.workunit.client.0.smithi088.stdout:2/141: mkdir d0/d14/d2b 0 2024-09-17T04:20:56.634 INFO:tasks.workunit.client.0.smithi088.stdout:5/165: rename d2/d9 to d2/d31/d33 0 2024-09-17T04:20:56.634 INFO:tasks.workunit.client.0.smithi088.stdout:5/166: readlink d2/d31/d33/l11 0 2024-09-17T04:20:56.635 INFO:tasks.workunit.client.1.smithi134.stdout:3/603: rmdir de 39 2024-09-17T04:20:56.635 INFO:tasks.workunit.client.0.smithi088.stdout:5/167: fsync d2/d31/d33/d20/f2e 0 2024-09-17T04:20:56.635 INFO:tasks.workunit.client.0.smithi088.stdout:2/142: creat d0/d14/d24/f2c x:0 0 0 2024-09-17T04:20:56.642 INFO:tasks.workunit.client.0.smithi088.stdout:2/143: dwrite d0/f9 [0,4194304] 0 2024-09-17T04:20:56.644 INFO:tasks.workunit.client.0.smithi088.stdout:2/144: truncate d0/d1/fe 4653835 0 2024-09-17T04:20:56.646 INFO:tasks.workunit.client.1.smithi134.stdout:0/472: mknod d11/d24/d49/c9d 0 2024-09-17T04:20:56.646 INFO:tasks.workunit.client.1.smithi134.stdout:4/557: write d0/df/d35/d5c/f94 [1174428,77097] 0 2024-09-17T04:20:56.649 INFO:tasks.workunit.client.0.smithi088.stdout:0/77: sync 2024-09-17T04:20:56.649 INFO:tasks.workunit.client.0.smithi088.stdout:0/78: readlink db/l16 0 2024-09-17T04:20:56.650 INFO:tasks.workunit.client.1.smithi134.stdout:7/402: creat d0/dd/d3a/d3d/d38/d60/d75/f80 x:0 0 0 2024-09-17T04:20:56.651 INFO:tasks.workunit.client.0.smithi088.stdout:0/79: mkdir db/d1a 0 2024-09-17T04:20:56.651 INFO:tasks.workunit.client.0.smithi088.stdout:0/80: chown f0 681605 1 2024-09-17T04:20:56.652 INFO:tasks.workunit.client.1.smithi134.stdout:1/553: getdents d12/d19 0 2024-09-17T04:20:56.652 INFO:tasks.workunit.client.0.smithi088.stdout:0/81: chown db/le 21203020 1 2024-09-17T04:20:56.654 INFO:tasks.workunit.client.1.smithi134.stdout:9/890: rmdir d2/d7/d75/d11a 0 2024-09-17T04:20:56.654 INFO:tasks.workunit.client.1.smithi134.stdout:4/558: mknod d0/d78/cb4 0 2024-09-17T04:20:56.655 INFO:tasks.workunit.client.1.smithi134.stdout:1/554: write d12/d19/d5d/f7a [2286736,9617] 0 2024-09-17T04:20:56.655 INFO:tasks.workunit.client.0.smithi088.stdout:0/82: unlink db/f17 0 2024-09-17T04:20:56.657 INFO:tasks.workunit.client.1.smithi134.stdout:5/486: creat d0/da/fa0 x:0 0 0 2024-09-17T04:20:56.658 INFO:tasks.workunit.client.1.smithi134.stdout:6/606: creat de/d19/d1f/d55/da9/fbc x:0 0 0 2024-09-17T04:20:56.658 INFO:tasks.workunit.client.0.smithi088.stdout:5/168: write d2/d31/d33/f18 [2739194,8051] 0 2024-09-17T04:20:56.659 INFO:tasks.workunit.client.0.smithi088.stdout:0/83: mkdir db/d1b 0 2024-09-17T04:20:56.660 INFO:tasks.workunit.client.0.smithi088.stdout:0/84: chown db/c18 1085 1 2024-09-17T04:20:56.661 INFO:tasks.workunit.client.0.smithi088.stdout:0/85: chown db/fc 468 1 2024-09-17T04:20:56.661 INFO:tasks.workunit.client.0.smithi088.stdout:2/145: truncate d0/d1/fb 361599 0 2024-09-17T04:20:56.662 INFO:tasks.workunit.client.1.smithi134.stdout:3/604: dwrite de/d12/d15/d1d/d2d/d31/d6a/d83/fb7 [0,4194304] 0 2024-09-17T04:20:56.662 INFO:tasks.workunit.client.0.smithi088.stdout:5/169: unlink d2/d31/d33/d20/f2a 0 2024-09-17T04:20:56.663 INFO:tasks.workunit.client.0.smithi088.stdout:5/170: chown d2/d31/d33/l2d 194 1 2024-09-17T04:20:56.664 INFO:tasks.workunit.client.1.smithi134.stdout:7/403: symlink d0/dd/d3a/d3d/d38/d60/d75/l81 0 2024-09-17T04:20:56.664 INFO:tasks.workunit.client.0.smithi088.stdout:2/146: mkdir d0/d1/d2d 0 2024-09-17T04:20:56.665 INFO:tasks.workunit.client.0.smithi088.stdout:5/171: write d2/d31/d33/f21 [1078653,19652] 0 2024-09-17T04:20:56.669 INFO:tasks.workunit.client.1.smithi134.stdout:1/555: truncate d12/d19/f54 107780 0 2024-09-17T04:20:56.671 INFO:tasks.workunit.client.1.smithi134.stdout:6/607: dwrite de/d19/d21/d2d/d4c/f83 [0,4194304] 0 2024-09-17T04:20:56.672 INFO:tasks.workunit.client.1.smithi134.stdout:6/608: dread - de/d2b/f50 zero size 2024-09-17T04:20:56.672 INFO:tasks.workunit.client.0.smithi088.stdout:2/147: dwrite d0/d1/f1e [0,4194304] 0 2024-09-17T04:20:56.673 INFO:tasks.workunit.client.1.smithi134.stdout:6/609: readlink de/d19/d74/d94/l96 0 2024-09-17T04:20:56.676 INFO:tasks.workunit.client.0.smithi088.stdout:6/154: sync 2024-09-17T04:20:56.676 INFO:tasks.workunit.client.0.smithi088.stdout:7/195: sync 2024-09-17T04:20:56.676 INFO:tasks.workunit.client.0.smithi088.stdout:3/101: sync 2024-09-17T04:20:56.676 INFO:tasks.workunit.client.0.smithi088.stdout:8/119: sync 2024-09-17T04:20:56.676 INFO:tasks.workunit.client.0.smithi088.stdout:4/206: sync 2024-09-17T04:20:56.677 INFO:tasks.workunit.client.0.smithi088.stdout:1/155: sync 2024-09-17T04:20:56.677 INFO:tasks.workunit.client.0.smithi088.stdout:9/143: sync 2024-09-17T04:20:56.677 INFO:tasks.workunit.client.1.smithi134.stdout:2/505: sync 2024-09-17T04:20:56.678 INFO:tasks.workunit.client.0.smithi088.stdout:5/172: symlink d2/d31/d33/d20/d25/d2c/l34 0 2024-09-17T04:20:56.680 INFO:tasks.workunit.client.0.smithi088.stdout:7/196: rename d2 to d2/d4/d7/d42 22 2024-09-17T04:20:56.681 INFO:tasks.workunit.client.0.smithi088.stdout:7/197: stat d2/f21 0 2024-09-17T04:20:56.681 INFO:tasks.workunit.client.0.smithi088.stdout:2/148: unlink d0/d18/c21 0 2024-09-17T04:20:56.684 INFO:tasks.workunit.client.0.smithi088.stdout:2/149: dread - d0/d14/f28 zero size 2024-09-17T04:20:56.684 INFO:tasks.workunit.client.1.smithi134.stdout:0/473: getdents d11/d22/d1c/d2f 0 2024-09-17T04:20:56.685 INFO:tasks.workunit.client.0.smithi088.stdout:8/120: write d7/dd/ff [139530,40655] 0 2024-09-17T04:20:56.685 INFO:tasks.workunit.client.0.smithi088.stdout:6/155: creat d14/d15/f39 x:0 0 0 2024-09-17T04:20:56.687 INFO:tasks.workunit.client.0.smithi088.stdout:2/150: stat d0/d14/d17/l1a 0 2024-09-17T04:20:56.689 INFO:tasks.workunit.client.1.smithi134.stdout:7/404: dread d0/dd/d57/d6a/f6d [0,4194304] 0 2024-09-17T04:20:56.689 INFO:tasks.workunit.client.0.smithi088.stdout:3/102: dwrite d0/f16 [0,4194304] 0 2024-09-17T04:20:56.691 INFO:tasks.workunit.client.0.smithi088.stdout:1/156: rmdir d0/d1/d27 39 2024-09-17T04:20:56.692 INFO:tasks.workunit.client.1.smithi134.stdout:5/487: dread d0/f47 [0,4194304] 0 2024-09-17T04:20:56.694 INFO:tasks.workunit.client.1.smithi134.stdout:9/891: rename d2/d5/d8/d16 to d2/d5/d37/d83/d12a 0 2024-09-17T04:20:56.696 INFO:tasks.workunit.client.0.smithi088.stdout:0/86: truncate db/fc 678147 0 2024-09-17T04:20:56.697 INFO:tasks.workunit.client.1.smithi134.stdout:7/405: dread d0/dd/f1f [4194304,4194304] 0 2024-09-17T04:20:56.698 INFO:tasks.workunit.client.0.smithi088.stdout:0/87: dread - db/f12 zero size 2024-09-17T04:20:56.699 INFO:tasks.workunit.client.0.smithi088.stdout:8/121: dwrite d7/dd/ff [0,4194304] 0 2024-09-17T04:20:56.700 INFO:tasks.workunit.client.0.smithi088.stdout:7/198: symlink d2/d4/d7/d20/l43 0 2024-09-17T04:20:56.701 INFO:tasks.workunit.client.0.smithi088.stdout:3/103: dwrite d0/f10 [0,4194304] 0 2024-09-17T04:20:56.701 INFO:tasks.workunit.client.0.smithi088.stdout:8/122: chown d7/dd/f16 607575623 1 2024-09-17T04:20:56.702 INFO:tasks.workunit.client.1.smithi134.stdout:1/556: symlink d12/d19/d1d/lb5 0 2024-09-17T04:20:56.703 INFO:tasks.workunit.client.0.smithi088.stdout:3/104: dread - d0/fb zero size 2024-09-17T04:20:56.703 INFO:tasks.workunit.client.0.smithi088.stdout:8/123: write f2 [3911419,33661] 0 2024-09-17T04:20:56.704 INFO:tasks.workunit.client.1.smithi134.stdout:4/559: dwrite d0/df/d1e/d73/f95 [0,4194304] 0 2024-09-17T04:20:56.709 INFO:tasks.workunit.client.0.smithi088.stdout:6/156: mkdir d14/d3a 0 2024-09-17T04:20:56.710 INFO:tasks.workunit.client.0.smithi088.stdout:7/199: dwrite d2/d1d/f3d [0,4194304] 0 2024-09-17T04:20:56.711 INFO:tasks.workunit.client.0.smithi088.stdout:2/151: rmdir d0/d1 39 2024-09-17T04:20:56.715 INFO:tasks.workunit.client.1.smithi134.stdout:3/605: rename de/d12/db3 to de/d67/dc5 0 2024-09-17T04:20:56.718 INFO:tasks.workunit.client.1.smithi134.stdout:3/606: read de/d12/d15/d1d/f72 [864043,9465] 0 2024-09-17T04:20:56.719 INFO:tasks.workunit.client.1.smithi134.stdout:8/457: sync 2024-09-17T04:20:56.720 INFO:tasks.workunit.client.0.smithi088.stdout:6/157: dwrite d14/d2f/f36 [0,4194304] 0 2024-09-17T04:20:56.720 INFO:tasks.workunit.client.0.smithi088.stdout:7/200: dread d2/d4/f14 [0,4194304] 0 2024-09-17T04:20:56.721 INFO:tasks.workunit.client.0.smithi088.stdout:1/157: mknod d0/d1/d16/d2a/c38 0 2024-09-17T04:20:56.721 INFO:tasks.workunit.client.1.smithi134.stdout:8/458: write d4/db/dd/f30 [278798,5026] 0 2024-09-17T04:20:56.721 INFO:tasks.workunit.client.1.smithi134.stdout:0/474: dwrite d11/d24/f7e [0,4194304] 0 2024-09-17T04:20:56.722 INFO:tasks.workunit.client.0.smithi088.stdout:7/201: chown d2/d1e/f24 364 1 2024-09-17T04:20:56.722 INFO:tasks.workunit.client.0.smithi088.stdout:1/158: fsync d0/d1/f1a 0 2024-09-17T04:20:56.723 INFO:tasks.workunit.client.0.smithi088.stdout:1/159: dread - d0/d13/f1b zero size 2024-09-17T04:20:56.724 INFO:tasks.workunit.client.1.smithi134.stdout:1/557: creat d12/db2/fb6 x:0 0 0 2024-09-17T04:20:56.724 INFO:tasks.workunit.client.1.smithi134.stdout:4/560: creat d0/d13/d40/d42/fb5 x:0 0 0 2024-09-17T04:20:56.726 INFO:tasks.workunit.client.1.smithi134.stdout:4/561: stat d0/l9 0 2024-09-17T04:20:56.729 INFO:tasks.workunit.client.1.smithi134.stdout:9/892: fsync d2/d78/fc0 0 2024-09-17T04:20:56.729 INFO:tasks.workunit.client.1.smithi134.stdout:4/562: read d0/d13/d40/d42/d92/f21 [198399,44616] 0 2024-09-17T04:20:56.729 INFO:tasks.workunit.client.0.smithi088.stdout:0/88: creat db/f1c x:0 0 0 2024-09-17T04:20:56.731 INFO:tasks.workunit.client.1.smithi134.stdout:4/563: write d0/df/d1e/f2e [295537,41216] 0 2024-09-17T04:20:56.731 INFO:tasks.workunit.client.1.smithi134.stdout:8/459: dread d4/d1f/f71 [0,4194304] 0 2024-09-17T04:20:56.733 INFO:tasks.workunit.client.1.smithi134.stdout:9/893: write d2/d5/d58/db5/fdd [130018,129569] 0 2024-09-17T04:20:56.734 INFO:tasks.workunit.client.1.smithi134.stdout:8/460: chown d4/d23/d60/d6b/c6f 3 1 2024-09-17T04:20:56.734 INFO:tasks.workunit.client.1.smithi134.stdout:4/564: stat d0/df/d17/f90 0 2024-09-17T04:20:56.734 INFO:tasks.workunit.client.1.smithi134.stdout:6/610: rename de/d19/fa1 to de/d5d/d67/fbd 0 2024-09-17T04:20:56.735 INFO:tasks.workunit.client.0.smithi088.stdout:3/105: symlink d0/d13/d1b/l1d 0 2024-09-17T04:20:56.739 INFO:tasks.workunit.client.1.smithi134.stdout:9/894: read d2/d5/d58/f85 [567738,96800] 0 2024-09-17T04:20:56.740 INFO:tasks.workunit.client.1.smithi134.stdout:3/607: rmdir de/d12/d15/d1d/d2d/d31/d6a 39 2024-09-17T04:20:56.741 INFO:tasks.workunit.client.0.smithi088.stdout:3/106: chown d0/f10 223561483 1 2024-09-17T04:20:56.741 INFO:tasks.workunit.client.0.smithi088.stdout:8/124: dwrite d7/dd/f28 [0,4194304] 0 2024-09-17T04:20:56.742 INFO:tasks.workunit.client.1.smithi134.stdout:0/475: dread d11/d22/d1c/d2f/d45/f8e [0,4194304] 0 2024-09-17T04:20:56.742 INFO:tasks.workunit.client.1.smithi134.stdout:8/461: dwrite d4/d1f/f67 [0,4194304] 0 2024-09-17T04:20:56.743 INFO:tasks.workunit.client.0.smithi088.stdout:5/173: truncate d2/f15 2013521 0 2024-09-17T04:20:56.744 INFO:tasks.workunit.client.1.smithi134.stdout:8/462: chown d4/d1f/d2b/f7b 1138596 1 2024-09-17T04:20:56.745 INFO:tasks.workunit.client.0.smithi088.stdout:5/174: fsync d2/d31/d33/f18 0 2024-09-17T04:20:56.747 INFO:tasks.workunit.client.0.smithi088.stdout:2/152: creat d0/d14/f2e x:0 0 0 2024-09-17T04:20:56.747 INFO:tasks.workunit.client.1.smithi134.stdout:5/488: creat d0/da/d69/d41/fa1 x:0 0 0 2024-09-17T04:20:56.748 INFO:tasks.workunit.client.0.smithi088.stdout:2/153: chown d0/l4 2935221 1 2024-09-17T04:20:56.750 INFO:tasks.workunit.client.0.smithi088.stdout:2/154: stat d0/d14/d17/l1a 0 2024-09-17T04:20:56.751 INFO:tasks.workunit.client.0.smithi088.stdout:2/155: chown d0/f12 37721 1 2024-09-17T04:20:56.753 INFO:tasks.workunit.client.1.smithi134.stdout:1/558: dwrite d12/d1c/d2e/f3b [0,4194304] 0 2024-09-17T04:20:56.754 INFO:tasks.workunit.client.0.smithi088.stdout:2/156: write d0/d14/f2e [421578,61616] 0 2024-09-17T04:20:56.755 INFO:tasks.workunit.client.0.smithi088.stdout:7/202: mknod d2/d4/c44 0 2024-09-17T04:20:56.755 INFO:tasks.workunit.client.0.smithi088.stdout:6/158: creat d14/d2f/d31/f3b x:0 0 0 2024-09-17T04:20:56.756 INFO:tasks.workunit.client.0.smithi088.stdout:1/160: mknod d0/d1/d16/d2a/c39 0 2024-09-17T04:20:56.757 INFO:tasks.workunit.client.1.smithi134.stdout:4/565: symlink d0/d3b/lb6 0 2024-09-17T04:20:56.758 INFO:tasks.workunit.client.0.smithi088.stdout:5/175: dwrite d2/d31/d33/fc [4194304,4194304] 0 2024-09-17T04:20:56.759 INFO:tasks.workunit.client.0.smithi088.stdout:1/161: readlink d0/d1/d16/d2a/l31 0 2024-09-17T04:20:56.761 INFO:tasks.workunit.client.0.smithi088.stdout:1/162: write d0/d1/fa [5056468,89462] 0 2024-09-17T04:20:56.762 INFO:tasks.workunit.client.1.smithi134.stdout:9/895: fdatasync d2/d5/d9/df/f48 0 2024-09-17T04:20:56.763 INFO:tasks.workunit.client.0.smithi088.stdout:3/107: creat d0/d13/d1b/f1e x:0 0 0 2024-09-17T04:20:56.763 INFO:tasks.workunit.client.1.smithi134.stdout:9/896: write d2/d25/ff6 [183560,125310] 0 2024-09-17T04:20:56.765 INFO:tasks.workunit.client.1.smithi134.stdout:3/608: mkdir de/d12/d15/d1d/d2d/d63/d77/dbd/dc6 0 2024-09-17T04:20:56.766 INFO:tasks.workunit.client.1.smithi134.stdout:0/476: creat d11/d4c/d76/f9e x:0 0 0 2024-09-17T04:20:56.767 INFO:tasks.workunit.client.1.smithi134.stdout:8/463: fsync d4/f8d 0 2024-09-17T04:20:56.768 INFO:tasks.workunit.client.0.smithi088.stdout:9/144: getdents d2/dd/d11/d1d 0 2024-09-17T04:20:56.769 INFO:tasks.workunit.client.0.smithi088.stdout:4/207: getdents d5/d3d 0 2024-09-17T04:20:56.770 INFO:tasks.workunit.client.0.smithi088.stdout:3/108: dwrite d0/f16 [0,4194304] 0 2024-09-17T04:20:56.771 INFO:tasks.workunit.client.1.smithi134.stdout:9/897: dwrite d2/d7/ff4 [0,4194304] 0 2024-09-17T04:20:56.775 INFO:tasks.workunit.client.1.smithi134.stdout:2/506: rename d19/d1c/c29 to d19/d27/d31/d49/d6f/d84/ca5 0 2024-09-17T04:20:56.778 INFO:tasks.workunit.client.1.smithi134.stdout:6/611: fsync de/d19/d21/f25 0 2024-09-17T04:20:56.779 INFO:tasks.workunit.client.0.smithi088.stdout:5/176: rename d2/d31/d33/d20/d25/d2c/l34 to d2/d31/d33/d20/l35 0 2024-09-17T04:20:56.780 INFO:tasks.workunit.client.0.smithi088.stdout:5/177: read d2/d31/d33/fc [2127848,119131] 0 2024-09-17T04:20:56.781 INFO:tasks.workunit.client.0.smithi088.stdout:8/125: mknod d7/c2d 0 2024-09-17T04:20:56.782 INFO:tasks.workunit.client.0.smithi088.stdout:8/126: dread - d7/d29/d2a/f2b zero size 2024-09-17T04:20:56.782 INFO:tasks.workunit.client.1.smithi134.stdout:3/609: rmdir de/d12/d15/d9f/dba 39 2024-09-17T04:20:56.783 INFO:tasks.workunit.client.0.smithi088.stdout:5/178: truncate d2/d31/d33/d20/d30/f32 69636 0 2024-09-17T04:20:56.783 INFO:tasks.workunit.client.0.smithi088.stdout:8/127: write f2 [1344785,56301] 0 2024-09-17T04:20:56.784 INFO:tasks.workunit.client.0.smithi088.stdout:8/128: dread - d7/d29/d2a/f2b zero size 2024-09-17T04:20:56.790 INFO:tasks.workunit.client.0.smithi088.stdout:6/159: write d14/d15/d16/f26 [3908729,37819] 0 2024-09-17T04:20:56.793 INFO:tasks.workunit.client.0.smithi088.stdout:1/163: rename d0/d1/d16/l26 to d0/d1/df/l3a 0 2024-09-17T04:20:56.793 INFO:tasks.workunit.client.0.smithi088.stdout:6/160: rename d14/d15/d16 to d14/d15/d16/d3c 22 2024-09-17T04:20:56.795 INFO:tasks.workunit.client.1.smithi134.stdout:2/507: creat d19/d27/d31/d49/d6f/fa6 x:0 0 0 2024-09-17T04:20:56.797 INFO:tasks.workunit.client.1.smithi134.stdout:9/898: dwrite d2/d5/dd0/fd9 [0,4194304] 0 2024-09-17T04:20:56.798 INFO:tasks.workunit.client.1.smithi134.stdout:9/899: dread - d2/d5/d37/f117 zero size 2024-09-17T04:20:56.801 INFO:tasks.workunit.client.0.smithi088.stdout:5/179: creat d2/d31/f36 x:0 0 0 2024-09-17T04:20:56.803 INFO:tasks.workunit.client.1.smithi134.stdout:3/610: truncate de/d12/d15/d1d/d2d/d31/f55 943989 0 2024-09-17T04:20:56.803 INFO:tasks.workunit.client.0.smithi088.stdout:8/129: stat d7/d29/c25 0 2024-09-17T04:20:56.805 INFO:tasks.workunit.client.1.smithi134.stdout:0/477: link d11/d24/d49/f5b d11/d18/f9f 0 2024-09-17T04:20:56.807 INFO:tasks.workunit.client.0.smithi088.stdout:9/145: dread d2/fc [0,4194304] 0 2024-09-17T04:20:56.807 INFO:tasks.workunit.client.0.smithi088.stdout:2/157: mknod d0/d1/d2d/c2f 0 2024-09-17T04:20:56.811 INFO:tasks.workunit.client.0.smithi088.stdout:9/146: dread d2/f9 [0,4194304] 0 2024-09-17T04:20:56.812 INFO:tasks.workunit.client.0.smithi088.stdout:1/164: rmdir d0/d1 39 2024-09-17T04:20:56.819 INFO:tasks.workunit.client.0.smithi088.stdout:8/130: creat d7/d29/f2e x:0 0 0 2024-09-17T04:20:56.820 INFO:tasks.workunit.client.0.smithi088.stdout:7/203: write d2/d1e/d23/f35 [201063,20816] 0 2024-09-17T04:20:56.821 INFO:tasks.workunit.client.1.smithi134.stdout:8/464: link d4/d11/d5f/l68 d4/d1f/d25/d6a/l92 0 2024-09-17T04:20:56.822 INFO:tasks.workunit.client.1.smithi134.stdout:1/559: link d12/d19/f54 d12/d1c/d4a/fb7 0 2024-09-17T04:20:56.823 INFO:tasks.workunit.client.1.smithi134.stdout:5/489: dwrite d0/d3a/d2b/d61/f65 [0,4194304] 0 2024-09-17T04:20:56.823 INFO:tasks.workunit.client.0.smithi088.stdout:9/147: rmdir d2/d2b 39 2024-09-17T04:20:56.829 INFO:tasks.workunit.client.1.smithi134.stdout:7/406: rename d0/d16/l37 to d0/l82 0 2024-09-17T04:20:56.829 INFO:tasks.workunit.client.1.smithi134.stdout:7/407: fdatasync d0/dd/d3a/d3d/f56 0 2024-09-17T04:20:56.829 INFO:tasks.workunit.client.0.smithi088.stdout:6/161: creat d14/d15/d29/f3d x:0 0 0 2024-09-17T04:20:56.830 INFO:tasks.workunit.client.1.smithi134.stdout:4/566: link d0/d13/d40/d72/c91 d0/df/d35/d39/cb7 0 2024-09-17T04:20:56.831 INFO:tasks.workunit.client.1.smithi134.stdout:7/408: dwrite d0/d16/d35/d4b/f7c [0,4194304] 0 2024-09-17T04:20:56.834 INFO:tasks.workunit.client.0.smithi088.stdout:8/131: rename d7/dd/c1d to d7/d29/c2f 0 2024-09-17T04:20:56.835 INFO:tasks.workunit.client.0.smithi088.stdout:4/208: dwrite d5/f1a [0,4194304] 0 2024-09-17T04:20:56.837 INFO:tasks.workunit.client.0.smithi088.stdout:1/165: dwrite d0/d1/f1c [0,4194304] 0 2024-09-17T04:20:56.838 INFO:tasks.workunit.client.1.smithi134.stdout:4/567: dread d0/d13/d40/d42/f87 [0,4194304] 0 2024-09-17T04:20:56.840 INFO:tasks.workunit.client.1.smithi134.stdout:0/478: getdents d11/d22/d1c/d2f/d9a 0 2024-09-17T04:20:56.841 INFO:tasks.workunit.client.1.smithi134.stdout:0/479: chown d11/d24/f58 9 1 2024-09-17T04:20:56.842 INFO:tasks.workunit.client.1.smithi134.stdout:0/480: fdatasync d11/d22/d1c/d2f/d45/f74 0 2024-09-17T04:20:56.844 INFO:tasks.workunit.client.0.smithi088.stdout:3/109: getdents d0/d13/d1b 0 2024-09-17T04:20:56.845 INFO:tasks.workunit.client.0.smithi088.stdout:3/110: read d0/f1a [386130,120660] 0 2024-09-17T04:20:56.847 INFO:tasks.workunit.client.1.smithi134.stdout:5/490: fdatasync d0/d3a/d2b/f62 0 2024-09-17T04:20:56.848 INFO:tasks.workunit.client.0.smithi088.stdout:1/166: dwrite d0/d1/d16/d35/f36 [0,4194304] 0 2024-09-17T04:20:56.848 INFO:tasks.workunit.client.0.smithi088.stdout:9/148: truncate d2/dd/fe 537618 0 2024-09-17T04:20:56.850 INFO:tasks.workunit.client.1.smithi134.stdout:6/612: rename de/d5d/f9a to de/d19/d62/db0/fbe 0 2024-09-17T04:20:56.851 INFO:tasks.workunit.client.1.smithi134.stdout:6/613: chown de/d19/d21/d4d 1075854865 1 2024-09-17T04:20:56.852 INFO:tasks.workunit.client.0.smithi088.stdout:3/111: dread d0/f10 [0,4194304] 0 2024-09-17T04:20:56.852 INFO:tasks.workunit.client.1.smithi134.stdout:2/508: write d19/f22 [203880,1643] 0 2024-09-17T04:20:56.852 INFO:tasks.workunit.client.1.smithi134.stdout:6/614: dread - de/d2b/f80 zero size 2024-09-17T04:20:56.853 INFO:tasks.workunit.client.1.smithi134.stdout:2/509: chown d19/d1c/f30 52 1 2024-09-17T04:20:56.854 INFO:tasks.workunit.client.1.smithi134.stdout:6/615: chown de/d2b/f9f 583519378 1 2024-09-17T04:20:56.854 INFO:tasks.workunit.client.1.smithi134.stdout:9/900: write d2/d5/d9/df/f70 [748456,78040] 0 2024-09-17T04:20:56.855 INFO:tasks.workunit.client.1.smithi134.stdout:6/616: fdatasync f9 0 2024-09-17T04:20:56.858 INFO:tasks.workunit.client.0.smithi088.stdout:6/162: rename d14/d2f/d31 to d14/d15/d29/d3e 0 2024-09-17T04:20:56.860 INFO:tasks.workunit.client.1.smithi134.stdout:7/409: stat d0/dd/d3a/d3d/c47 0 2024-09-17T04:20:56.861 INFO:tasks.workunit.client.1.smithi134.stdout:3/611: truncate de/d10/f30 4771769 0 2024-09-17T04:20:56.862 INFO:tasks.workunit.client.1.smithi134.stdout:4/568: symlink d0/d13/d40/d42/d92/d86/lb8 0 2024-09-17T04:20:56.863 INFO:tasks.workunit.client.0.smithi088.stdout:2/158: truncate d0/d18/f19 3259176 0 2024-09-17T04:20:56.866 INFO:tasks.workunit.client.1.smithi134.stdout:3/612: dwrite de/d12/fb1 [0,4194304] 0 2024-09-17T04:20:56.869 INFO:tasks.workunit.client.0.smithi088.stdout:9/149: creat d2/d16/f34 x:0 0 0 2024-09-17T04:20:56.871 INFO:tasks.workunit.client.0.smithi088.stdout:9/150: truncate d2/fb 1212557 0 2024-09-17T04:20:56.872 INFO:tasks.workunit.client.1.smithi134.stdout:1/560: rename d12/d19/d1d/d61/l79 to d12/d19/d4f/lb8 0 2024-09-17T04:20:56.873 INFO:tasks.workunit.client.0.smithi088.stdout:5/180: getdents d2/d31/d33/d20 0 2024-09-17T04:20:56.873 INFO:tasks.workunit.client.1.smithi134.stdout:1/561: dread - d12/d19/d5d/faa zero size 2024-09-17T04:20:56.876 INFO:tasks.workunit.client.0.smithi088.stdout:6/163: mknod d14/d15/d29/d3e/c3f 0 2024-09-17T04:20:56.879 INFO:tasks.workunit.client.0.smithi088.stdout:2/159: mknod d0/d14/d17/d26/c30 0 2024-09-17T04:20:56.879 INFO:tasks.workunit.client.0.smithi088.stdout:2/160: stat d0/d1/d2d/c2f 0 2024-09-17T04:20:56.880 INFO:tasks.workunit.client.0.smithi088.stdout:2/161: chown d0/d1/f3 30 1 2024-09-17T04:20:56.881 INFO:tasks.workunit.client.0.smithi088.stdout:2/162: read d0/f9 [809979,102327] 0 2024-09-17T04:20:56.882 INFO:tasks.workunit.client.0.smithi088.stdout:2/163: dread - d0/d14/d17/d22/f25 zero size 2024-09-17T04:20:56.886 INFO:tasks.workunit.client.0.smithi088.stdout:9/151: mkdir d2/dd/d11/d1d/d35 0 2024-09-17T04:20:56.888 INFO:tasks.workunit.client.1.smithi134.stdout:0/481: mknod d11/d22/d1c/d81/ca0 0 2024-09-17T04:20:56.889 INFO:tasks.workunit.client.0.smithi088.stdout:5/181: creat d2/d31/d33/f37 x:0 0 0 2024-09-17T04:20:56.891 INFO:tasks.workunit.client.1.smithi134.stdout:5/491: mknod d0/d3a/d6b/d9c/ca2 0 2024-09-17T04:20:56.891 INFO:tasks.workunit.client.0.smithi088.stdout:6/164: mknod d14/d2f/c40 0 2024-09-17T04:20:56.892 INFO:tasks.workunit.client.0.smithi088.stdout:7/204: truncate d2/d4/d7/d20/f22 257568 0 2024-09-17T04:20:56.893 INFO:tasks.workunit.client.1.smithi134.stdout:3/613: dread de/d12/d15/d1d/f62 [0,4194304] 0 2024-09-17T04:20:56.893 INFO:tasks.workunit.client.1.smithi134.stdout:9/901: rename d2/d5/ca4 to d2/d78/c12b 0 2024-09-17T04:20:56.895 INFO:tasks.workunit.client.0.smithi088.stdout:4/209: link d5/c35 d5/d3d/c40 0 2024-09-17T04:20:56.897 INFO:tasks.workunit.client.0.smithi088.stdout:4/210: dread f1 [0,4194304] 0 2024-09-17T04:20:56.898 INFO:tasks.workunit.client.0.smithi088.stdout:2/164: mknod d0/d14/d17/c31 0 2024-09-17T04:20:56.900 INFO:tasks.workunit.client.1.smithi134.stdout:6/617: creat de/d19/d1f/dae/fbf x:0 0 0 2024-09-17T04:20:56.900 INFO:tasks.workunit.client.1.smithi134.stdout:6/618: write de/d19/d1f/d55/f82 [1812536,9647] 0 2024-09-17T04:20:56.901 INFO:tasks.workunit.client.1.smithi134.stdout:7/410: mknod d0/d16/c83 0 2024-09-17T04:20:56.902 INFO:tasks.workunit.client.0.smithi088.stdout:9/152: rmdir d2/dd/d11/d30 39 2024-09-17T04:20:56.902 INFO:tasks.workunit.client.0.smithi088.stdout:9/153: truncate d2/fc 4906007 0 2024-09-17T04:20:56.905 INFO:tasks.workunit.client.0.smithi088.stdout:8/132: rename c4 to d7/dd/c30 0 2024-09-17T04:20:56.906 INFO:tasks.workunit.client.0.smithi088.stdout:8/133: readlink d7/l17 0 2024-09-17T04:20:56.907 INFO:tasks.workunit.client.1.smithi134.stdout:0/482: creat d11/d48/fa1 x:0 0 0 2024-09-17T04:20:56.911 INFO:tasks.workunit.client.0.smithi088.stdout:7/205: mkdir d2/d1e/d23/d45 0 2024-09-17T04:20:56.911 INFO:tasks.workunit.client.1.smithi134.stdout:5/492: creat d0/da/d2c/d73/fa3 x:0 0 0 2024-09-17T04:20:56.912 INFO:tasks.workunit.client.0.smithi088.stdout:2/165: dread d0/d1/f3 [4194304,4194304] 0 2024-09-17T04:20:56.913 INFO:tasks.workunit.client.0.smithi088.stdout:8/134: dwrite d7/d29/d2a/f2b [0,4194304] 0 2024-09-17T04:20:56.915 INFO:tasks.workunit.client.0.smithi088.stdout:4/211: creat d5/d3f/f41 x:0 0 0 2024-09-17T04:20:56.915 INFO:tasks.workunit.client.1.smithi134.stdout:9/902: unlink d2/d5/d37/d83/d12a/d54/daf/d6d/daa/fd7 0 2024-09-17T04:20:56.918 INFO:tasks.workunit.client.0.smithi088.stdout:3/112: getdents d0/d13 0 2024-09-17T04:20:56.921 INFO:tasks.workunit.client.0.smithi088.stdout:3/113: write d0/d13/d1b/f1e [12093,9449] 0 2024-09-17T04:20:56.924 INFO:tasks.workunit.client.1.smithi134.stdout:2/510: rmdir d19/d1c/d47/d50/d85/d93/d9a 0 2024-09-17T04:20:56.925 INFO:tasks.workunit.client.0.smithi088.stdout:8/135: dwrite d7/dd/fe [0,4194304] 0 2024-09-17T04:20:56.925 INFO:tasks.workunit.client.1.smithi134.stdout:2/511: dread d19/d1c/f52 [0,4194304] 0 2024-09-17T04:20:56.926 INFO:tasks.workunit.client.0.smithi088.stdout:8/136: dread - d7/dd/f15 zero size 2024-09-17T04:20:56.927 INFO:tasks.workunit.client.1.smithi134.stdout:4/569: truncate d0/df/d35/d5c/d8b/fa4 2843647 0 2024-09-17T04:20:56.928 INFO:tasks.workunit.client.0.smithi088.stdout:4/212: dwrite d5/d3f/f33 [0,4194304] 0 2024-09-17T04:20:56.930 INFO:tasks.workunit.client.1.smithi134.stdout:6/619: unlink de/d19/d7b/l90 0 2024-09-17T04:20:56.930 INFO:tasks.workunit.client.0.smithi088.stdout:3/114: dread d0/f4 [0,4194304] 0 2024-09-17T04:20:56.931 INFO:tasks.workunit.client.0.smithi088.stdout:3/115: chown d0/f12 152757577 1 2024-09-17T04:20:56.935 INFO:tasks.workunit.client.0.smithi088.stdout:6/165: mkdir d14/d3a/d41 0 2024-09-17T04:20:56.939 INFO:tasks.workunit.client.1.smithi134.stdout:7/411: dread d0/f1b [0,4194304] 0 2024-09-17T04:20:56.941 INFO:tasks.workunit.client.1.smithi134.stdout:2/512: dread d19/d1c/d47/d50/d85/f9b [0,4194304] 0 2024-09-17T04:20:56.942 INFO:tasks.workunit.client.1.smithi134.stdout:5/493: mknod d0/da/d69/d41/d72/ca4 0 2024-09-17T04:20:56.942 INFO:tasks.workunit.client.1.smithi134.stdout:1/562: truncate d12/d19/d4f/f7f 2180004 0 2024-09-17T04:20:56.946 INFO:tasks.workunit.client.1.smithi134.stdout:9/903: mkdir d2/d5/d37/d83/d12a/d54/daf/d6d/d12c 0 2024-09-17T04:20:56.948 INFO:tasks.workunit.client.0.smithi088.stdout:5/182: creat d2/f38 x:0 0 0 2024-09-17T04:20:56.949 INFO:tasks.workunit.client.1.smithi134.stdout:6/620: unlink de/d2b/f43 0 2024-09-17T04:20:56.950 INFO:tasks.workunit.client.1.smithi134.stdout:0/483: creat d11/d19/d21/d37/fa2 x:0 0 0 2024-09-17T04:20:56.951 INFO:tasks.workunit.client.0.smithi088.stdout:4/213: creat d5/d3d/f42 x:0 0 0 2024-09-17T04:20:56.952 INFO:tasks.workunit.client.0.smithi088.stdout:4/214: chown d5/l27 3 1 2024-09-17T04:20:56.953 INFO:tasks.workunit.client.0.smithi088.stdout:9/154: dwrite d2/dd/d14/f19 [0,4194304] 0 2024-09-17T04:20:56.953 INFO:tasks.workunit.client.1.smithi134.stdout:7/412: rename d0/dd/d3a/d3d/d38/f5d to d0/dd/d3a/d3d/d38/d60/f84 0 2024-09-17T04:20:56.954 INFO:tasks.workunit.client.0.smithi088.stdout:4/215: write d5/d3f/f3b [856951,125113] 0 2024-09-17T04:20:56.954 INFO:tasks.workunit.client.0.smithi088.stdout:9/155: chown d2/dd/f1b 29885010 1 2024-09-17T04:20:56.955 INFO:tasks.workunit.client.0.smithi088.stdout:9/156: chown d2/d16/f28 29 1 2024-09-17T04:20:56.956 INFO:tasks.workunit.client.1.smithi134.stdout:7/413: read d0/dd/d3a/d3d/d38/d74/f7f [4075083,93903] 0 2024-09-17T04:20:56.957 INFO:tasks.workunit.client.1.smithi134.stdout:2/513: creat d19/d67/fa7 x:0 0 0 2024-09-17T04:20:56.958 INFO:tasks.workunit.client.0.smithi088.stdout:0/89: sync 2024-09-17T04:20:56.958 INFO:tasks.workunit.client.0.smithi088.stdout:3/116: mknod d0/d13/d1b/c1f 0 2024-09-17T04:20:56.958 INFO:tasks.workunit.client.1.smithi134.stdout:7/414: truncate d0/dd/d3a/d3d/d38/f23 4925858 0 2024-09-17T04:20:56.959 INFO:tasks.workunit.client.1.smithi134.stdout:7/415: chown d0/d16/d35/f49 18 1 2024-09-17T04:20:56.960 INFO:tasks.workunit.client.0.smithi088.stdout:6/166: mkdir d14/d15/d16/d42 0 2024-09-17T04:20:56.961 INFO:tasks.workunit.client.1.smithi134.stdout:3/614: creat de/d12/d15/d1d/d2d/d63/fc7 x:0 0 0 2024-09-17T04:20:56.963 INFO:tasks.workunit.client.1.smithi134.stdout:9/904: creat d2/d5/d9/d6a/f12d x:0 0 0 2024-09-17T04:20:56.965 INFO:tasks.workunit.client.1.smithi134.stdout:4/570: mknod d0/cb9 0 2024-09-17T04:20:56.966 INFO:tasks.workunit.client.1.smithi134.stdout:5/494: dwrite d0/f4 [8388608,4194304] 0 2024-09-17T04:20:56.968 INFO:tasks.workunit.client.1.smithi134.stdout:6/621: creat de/d19/d62/d34/d3b/fc0 x:0 0 0 2024-09-17T04:20:56.970 INFO:tasks.workunit.client.1.smithi134.stdout:0/484: symlink d11/d48/la3 0 2024-09-17T04:20:56.971 INFO:tasks.workunit.client.0.smithi088.stdout:8/137: mkdir d7/dd/d31 0 2024-09-17T04:20:56.972 INFO:tasks.workunit.client.0.smithi088.stdout:2/166: dwrite d0/f9 [4194304,4194304] 0 2024-09-17T04:20:56.974 INFO:tasks.workunit.client.1.smithi134.stdout:9/905: dwrite d2/d5/d37/d83/d12a/d54/daf/d6d/daa/de2/fea [0,4194304] 0 2024-09-17T04:20:56.976 INFO:tasks.workunit.client.0.smithi088.stdout:5/183: symlink d2/d31/d33/d20/d25/d2c/l39 0 2024-09-17T04:20:56.977 INFO:tasks.workunit.client.1.smithi134.stdout:2/514: write d19/d27/d31/d49/d63/d94/f7d [755190,30678] 0 2024-09-17T04:20:56.978 INFO:tasks.workunit.client.1.smithi134.stdout:6/622: dwrite de/d19/d1f/d85/fa7 [0,4194304] 0 2024-09-17T04:20:56.980 INFO:tasks.workunit.client.1.smithi134.stdout:4/571: dread d0/df/d17/f6d [0,4194304] 0 2024-09-17T04:20:56.980 INFO:tasks.workunit.client.1.smithi134.stdout:7/416: mkdir d0/dd/d57/d6a/d70/d85 0 2024-09-17T04:20:56.981 INFO:tasks.workunit.client.1.smithi134.stdout:7/417: write d0/dd/d3a/f4f [364240,96046] 0 2024-09-17T04:20:56.986 INFO:tasks.workunit.client.0.smithi088.stdout:1/167: rename d0/d1/f2c to d0/f3b 0 2024-09-17T04:20:56.988 INFO:tasks.workunit.client.1.smithi134.stdout:5/495: mkdir d0/da/d29/d78/da5 0 2024-09-17T04:20:56.988 INFO:tasks.workunit.client.0.smithi088.stdout:4/216: rmdir d5/d3d 39 2024-09-17T04:20:56.989 INFO:tasks.workunit.client.1.smithi134.stdout:7/418: dwrite d0/dd/d3a/d3d/f41 [0,4194304] 0 2024-09-17T04:20:56.992 INFO:tasks.workunit.client.0.smithi088.stdout:7/206: truncate d2/d4/f18 122966 0 2024-09-17T04:20:56.996 INFO:tasks.workunit.client.1.smithi134.stdout:0/485: creat d11/d22/d1c/d2f/d43/d5d/fa4 x:0 0 0 2024-09-17T04:20:56.997 INFO:tasks.workunit.client.0.smithi088.stdout:0/90: creat db/f1d x:0 0 0 2024-09-17T04:20:56.997 INFO:tasks.workunit.client.1.smithi134.stdout:9/906: creat d2/d7/d75/d96/f12e x:0 0 0 2024-09-17T04:20:56.999 INFO:tasks.workunit.client.1.smithi134.stdout:6/623: symlink de/d19/d21/d2d/d92/lc1 0 2024-09-17T04:20:57.001 INFO:tasks.workunit.client.1.smithi134.stdout:4/572: mknod d0/df/d17/d9c/cba 0 2024-09-17T04:20:57.001 INFO:tasks.workunit.client.0.smithi088.stdout:7/207: dwrite d2/d1e/f3b [0,4194304] 0 2024-09-17T04:20:57.002 INFO:tasks.workunit.client.0.smithi088.stdout:7/208: chown d2/f21 15245560 1 2024-09-17T04:20:57.003 INFO:tasks.workunit.client.1.smithi134.stdout:0/486: dwrite d11/d19/f99 [0,4194304] 0 2024-09-17T04:20:57.003 INFO:tasks.workunit.client.1.smithi134.stdout:0/487: read d11/d24/f7e [3521811,28856] 0 2024-09-17T04:20:57.004 INFO:tasks.workunit.client.0.smithi088.stdout:7/209: truncate d2/d4/f33 726280 0 2024-09-17T04:20:57.005 INFO:tasks.workunit.client.0.smithi088.stdout:2/167: mknod d0/d14/d17/d26/c32 0 2024-09-17T04:20:57.005 INFO:tasks.workunit.client.0.smithi088.stdout:5/184: symlink d2/d31/d33/d20/d30/l3a 0 2024-09-17T04:20:57.007 INFO:tasks.workunit.client.1.smithi134.stdout:3/615: creat de/d12/d15/d1d/d2d/d31/d6a/d83/fc8 x:0 0 0 2024-09-17T04:20:57.009 INFO:tasks.workunit.client.1.smithi134.stdout:3/616: write de/d12/d22/d5a/fb5 [682866,45018] 0 2024-09-17T04:20:57.009 INFO:tasks.workunit.client.0.smithi088.stdout:9/157: mknod d2/dd/d14/c36 0 2024-09-17T04:20:57.010 INFO:tasks.workunit.client.1.smithi134.stdout:5/496: mknod d0/da/d29/d78/ca6 0 2024-09-17T04:20:57.011 INFO:tasks.workunit.client.0.smithi088.stdout:3/117: symlink d0/l20 0 2024-09-17T04:20:57.011 INFO:tasks.workunit.client.1.smithi134.stdout:5/497: stat d0/d3a/l3d 0 2024-09-17T04:20:57.012 INFO:tasks.workunit.client.0.smithi088.stdout:0/91: mkdir db/d1e 0 2024-09-17T04:20:57.012 INFO:tasks.workunit.client.1.smithi134.stdout:5/498: write d0/da/f46 [3159727,109564] 0 2024-09-17T04:20:57.013 INFO:tasks.workunit.client.0.smithi088.stdout:6/167: mknod d14/d3a/d41/c43 0 2024-09-17T04:20:57.014 INFO:tasks.workunit.client.1.smithi134.stdout:9/907: symlink d2/d5/d37/d83/d12a/d54/daf/d6d/daa/de2/dcd/dd6/de3/l12f 0 2024-09-17T04:20:57.015 INFO:tasks.workunit.client.0.smithi088.stdout:6/168: read d14/d15/d29/d3e/f2c [500874,86807] 0 2024-09-17T04:20:57.016 INFO:tasks.workunit.client.0.smithi088.stdout:6/169: stat d14/d15/d29/f38 0 2024-09-17T04:20:57.017 INFO:tasks.workunit.client.1.smithi134.stdout:4/573: chown d0/df/c15 3481 1 2024-09-17T04:20:57.018 INFO:tasks.workunit.client.1.smithi134.stdout:6/624: rename de/d19/d1f/d55/c5e to de/d19/d74/d98/cc2 0 2024-09-17T04:20:57.018 INFO:tasks.workunit.client.1.smithi134.stdout:9/908: truncate d2/d5/d58/f119 175138 0 2024-09-17T04:20:57.019 INFO:tasks.workunit.client.0.smithi088.stdout:2/168: mkdir d0/d1/d2d/d33 0 2024-09-17T04:20:57.019 INFO:tasks.workunit.client.1.smithi134.stdout:3/617: dwrite de/d12/d22/d5a/f5d [4194304,4194304] 0 2024-09-17T04:20:57.020 INFO:tasks.workunit.client.0.smithi088.stdout:5/185: symlink d2/d31/d33/d20/d30/l3b 0 2024-09-17T04:20:57.021 INFO:tasks.workunit.client.0.smithi088.stdout:5/186: readlink d2/d31/d33/l11 0 2024-09-17T04:20:57.022 INFO:tasks.workunit.client.0.smithi088.stdout:9/158: creat d2/dd/d11/d1d/f37 x:0 0 0 2024-09-17T04:20:57.024 INFO:tasks.workunit.client.1.smithi134.stdout:7/419: truncate d0/dd/d3a/d3d/f56 3544910 0 2024-09-17T04:20:57.025 INFO:tasks.workunit.client.0.smithi088.stdout:3/118: creat d0/d13/d1b/f21 x:0 0 0 2024-09-17T04:20:57.026 INFO:tasks.workunit.client.1.smithi134.stdout:4/574: dwrite d0/f5 [0,4194304] 0 2024-09-17T04:20:57.029 INFO:tasks.workunit.client.1.smithi134.stdout:4/575: fdatasync d0/df/d1e/d73/f88 0 2024-09-17T04:20:57.033 INFO:tasks.workunit.client.1.smithi134.stdout:5/499: creat d0/da/d2c/fa7 x:0 0 0 2024-09-17T04:20:57.033 INFO:tasks.workunit.client.1.smithi134.stdout:9/909: dwrite d2/d5/d37/d83/d12a/d54/daf/d6d/daa/de2/dcd/fee [0,4194304] 0 2024-09-17T04:20:57.033 INFO:tasks.workunit.client.1.smithi134.stdout:5/500: truncate d0/f6f 275794 0 2024-09-17T04:20:57.034 INFO:tasks.workunit.client.0.smithi088.stdout:6/170: mkdir d14/d44 0 2024-09-17T04:20:57.035 INFO:tasks.workunit.client.0.smithi088.stdout:0/92: dwrite f1 [0,4194304] 0 2024-09-17T04:20:57.041 INFO:tasks.workunit.client.0.smithi088.stdout:2/169: creat d0/d18/f34 x:0 0 0 2024-09-17T04:20:57.046 INFO:tasks.workunit.client.0.smithi088.stdout:5/187: dread d2/d31/d33/d20/f23 [0,4194304] 0 2024-09-17T04:20:57.048 INFO:tasks.workunit.client.0.smithi088.stdout:0/93: dwrite db/f14 [0,4194304] 0 2024-09-17T04:20:57.048 INFO:tasks.workunit.client.0.smithi088.stdout:9/159: stat d2/dd/d11/l13 0 2024-09-17T04:20:57.049 INFO:tasks.workunit.client.0.smithi088.stdout:0/94: write db/f1c [500808,73485] 0 2024-09-17T04:20:57.050 INFO:tasks.workunit.client.0.smithi088.stdout:9/160: dread - d2/d16/f28 zero size 2024-09-17T04:20:57.051 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:56 smithi088 ceph-mon[27811]: pgmap v19: 65 pgs: 65 active+clean; 1.5 GiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 43 MiB/s rd, 227 MiB/s wr, 465 op/s 2024-09-17T04:20:57.052 INFO:tasks.workunit.client.1.smithi134.stdout:7/420: creat d0/dd/d3a/d3d/d4c/f86 x:0 0 0 2024-09-17T04:20:57.053 INFO:tasks.workunit.client.0.smithi088.stdout:9/161: chown d2/d16/f28 0 1 2024-09-17T04:20:57.057 INFO:tasks.workunit.client.0.smithi088.stdout:0/95: dwrite db/f10 [0,4194304] 0 2024-09-17T04:20:57.058 INFO:tasks.workunit.client.0.smithi088.stdout:0/96: stat db/d1e 0 2024-09-17T04:20:57.058 INFO:tasks.workunit.client.0.smithi088.stdout:0/97: chown db/f19 1 1 2024-09-17T04:20:57.058 INFO:tasks.workunit.client.0.smithi088.stdout:2/170: symlink d0/d14/d24/l35 0 2024-09-17T04:20:57.059 INFO:tasks.workunit.client.0.smithi088.stdout:2/171: dread - d0/d18/f34 zero size 2024-09-17T04:20:57.060 INFO:tasks.workunit.client.0.smithi088.stdout:8/138: write f6 [2280267,104394] 0 2024-09-17T04:20:57.062 INFO:tasks.workunit.client.1.smithi134.stdout:5/501: mknod d0/da/d2c/d73/d8a/ca8 0 2024-09-17T04:20:57.062 INFO:tasks.workunit.client.0.smithi088.stdout:8/139: write d7/dd/fe [1998750,128867] 0 2024-09-17T04:20:57.063 INFO:tasks.workunit.client.0.smithi088.stdout:0/98: dread db/f13 [0,4194304] 0 2024-09-17T04:20:57.064 INFO:tasks.workunit.client.0.smithi088.stdout:6/171: unlink d14/d15/d16/c23 0 2024-09-17T04:20:57.067 INFO:tasks.workunit.client.1.smithi134.stdout:3/618: symlink de/d12/d15/d9f/lc9 0 2024-09-17T04:20:57.068 INFO:tasks.workunit.client.1.smithi134.stdout:3/619: readlink de/d12/d15/d1d/d2d/d63/l65 0 2024-09-17T04:20:57.069 INFO:tasks.workunit.client.1.smithi134.stdout:3/620: read - de/d12/d22/f82 zero size 2024-09-17T04:20:57.074 INFO:tasks.workunit.client.1.smithi134.stdout:0/488: rename d11/l17 to d11/d22/d1c/la5 0 2024-09-17T04:20:57.075 INFO:tasks.workunit.client.1.smithi134.stdout:0/489: truncate d11/d19/d21/d37/f4b 4772502 0 2024-09-17T04:20:57.075 INFO:tasks.workunit.client.1.smithi134.stdout:4/576: unlink d0/df/d35/d5c/d8b/fa4 0 2024-09-17T04:20:57.075 INFO:tasks.workunit.client.1.smithi134.stdout:0/490: fsync d11/d22/f3a 0 2024-09-17T04:20:57.078 INFO:tasks.workunit.client.1.smithi134.stdout:5/502: write d0/d3a/fc [1973896,40120] 0 2024-09-17T04:20:57.081 INFO:tasks.workunit.client.1.smithi134.stdout:5/503: write d0/da/d69/d41/d6d/f7f [484090,97785] 0 2024-09-17T04:20:57.082 INFO:tasks.workunit.client.1.smithi134.stdout:4/577: dwrite d0/df/d17/d9c/fb3 [0,4194304] 0 2024-09-17T04:20:57.087 INFO:tasks.workunit.client.1.smithi134.stdout:9/910: creat d2/f130 x:0 0 0 2024-09-17T04:20:57.087 INFO:tasks.workunit.client.0.smithi088.stdout:5/188: truncate d2/d31/d33/f18 2486973 0 2024-09-17T04:20:57.087 INFO:tasks.workunit.client.1.smithi134.stdout:9/911: chown d2/d7/d75/d96/fbe 94686 1 2024-09-17T04:20:57.089 INFO:tasks.workunit.client.0.smithi088.stdout:9/162: creat d2/d2b/f38 x:0 0 0 2024-09-17T04:20:57.090 INFO:tasks.workunit.client.0.smithi088.stdout:9/163: chown d2/c1c 1 1 2024-09-17T04:20:57.091 INFO:tasks.workunit.client.0.smithi088.stdout:9/164: fsync d2/f8 0 2024-09-17T04:20:57.091 INFO:tasks.workunit.client.1.smithi134.stdout:0/491: unlink d11/d24/f71 0 2024-09-17T04:20:57.093 INFO:tasks.workunit.client.1.smithi134.stdout:0/492: read d11/d24/f47 [2373021,124014] 0 2024-09-17T04:20:57.094 INFO:tasks.workunit.client.1.smithi134.stdout:8/465: sync 2024-09-17T04:20:57.095 INFO:tasks.workunit.client.1.smithi134.stdout:8/466: write d4/d23/d60/d6b/d13/f78 [1487002,48712] 0 2024-09-17T04:20:57.095 INFO:tasks.workunit.client.1.smithi134.stdout:2/515: sync 2024-09-17T04:20:57.095 INFO:tasks.workunit.client.1.smithi134.stdout:6/625: sync 2024-09-17T04:20:57.096 INFO:tasks.workunit.client.1.smithi134.stdout:1/563: sync 2024-09-17T04:20:57.096 INFO:tasks.workunit.client.0.smithi088.stdout:2/172: mknod d0/c36 0 2024-09-17T04:20:57.097 INFO:tasks.workunit.client.1.smithi134.stdout:8/467: chown d4/d1f/d25/f50 387303 1 2024-09-17T04:20:57.097 INFO:tasks.workunit.client.1.smithi134.stdout:6/626: chown de/d19/d62/d34/c58 3112 1 2024-09-17T04:20:57.097 INFO:tasks.workunit.client.0.smithi088.stdout:8/140: mknod d7/c32 0 2024-09-17T04:20:57.099 INFO:tasks.workunit.client.1.smithi134.stdout:4/578: creat d0/d13/d40/d42/d92/d86/fbb x:0 0 0 2024-09-17T04:20:57.102 INFO:tasks.workunit.client.0.smithi088.stdout:6/172: mkdir d14/d44/d45 0 2024-09-17T04:20:57.102 INFO:tasks.workunit.client.1.smithi134.stdout:1/564: dwrite d12/f90 [0,4194304] 0 2024-09-17T04:20:57.104 INFO:tasks.workunit.client.1.smithi134.stdout:8/468: dwrite d4/d23/d60/d6b/f35 [0,4194304] 0 2024-09-17T04:20:57.105 INFO:tasks.workunit.client.0.smithi088.stdout:6/173: write f4 [4653126,105662] 0 2024-09-17T04:20:57.105 INFO:tasks.workunit.client.0.smithi088.stdout:5/189: write d2/d31/d33/f2f [597994,90911] 0 2024-09-17T04:20:57.106 INFO:tasks.workunit.client.1.smithi134.stdout:9/912: creat d2/d7/d75/d96/f131 x:0 0 0 2024-09-17T04:20:57.111 INFO:tasks.workunit.client.0.smithi088.stdout:3/119: dwrite d0/f4 [0,4194304] 0 2024-09-17T04:20:57.114 INFO:tasks.workunit.client.0.smithi088.stdout:8/141: dwrite d7/d29/f2e [0,4194304] 0 2024-09-17T04:20:57.118 INFO:tasks.workunit.client.0.smithi088.stdout:0/99: link db/c18 db/d1a/c1f 0 2024-09-17T04:20:57.120 INFO:tasks.workunit.client.0.smithi088.stdout:7/210: dwrite d2/d4/f18 [0,4194304] 0 2024-09-17T04:20:57.122 INFO:tasks.workunit.client.1.smithi134.stdout:7/421: truncate d0/f33 318147 0 2024-09-17T04:20:57.124 INFO:tasks.workunit.client.0.smithi088.stdout:2/173: dread d0/d1/fb [0,4194304] 0 2024-09-17T04:20:57.129 INFO:tasks.workunit.client.0.smithi088.stdout:9/165: dread d2/dd/fe [0,4194304] 0 2024-09-17T04:20:57.129 INFO:tasks.workunit.client.0.smithi088.stdout:6/174: fsync d14/d15/d16/f21 0 2024-09-17T04:20:57.132 INFO:tasks.workunit.client.0.smithi088.stdout:9/166: fsync d2/dd/f1b 0 2024-09-17T04:20:57.133 INFO:tasks.workunit.client.1.smithi134.stdout:3/621: mkdir de/d12/d15/d9f/dba/dc4/dca 0 2024-09-17T04:20:57.134 INFO:tasks.workunit.client.1.smithi134.stdout:3/622: fdatasync de/d12/d15/d1d/d8f/d90/fa8 0 2024-09-17T04:20:57.135 INFO:tasks.workunit.client.1.smithi134.stdout:3/623: chown de/d12/d15/d1d/d2d/d63/d77/cc1 6088 1 2024-09-17T04:20:57.135 INFO:tasks.workunit.client.0.smithi088.stdout:3/120: dwrite d0/fd [0,4194304] 0 2024-09-17T04:20:57.136 INFO:tasks.workunit.client.0.smithi088.stdout:3/121: chown d0/c11 79 1 2024-09-17T04:20:57.136 INFO:tasks.workunit.client.0.smithi088.stdout:8/142: dwrite d7/f8 [0,4194304] 0 2024-09-17T04:20:57.137 INFO:tasks.workunit.client.1.smithi134.stdout:8/469: rename d4/d23/l29 to d4/d1f/d86/l93 0 2024-09-17T04:20:57.139 INFO:tasks.workunit.client.1.smithi134.stdout:8/470: write d4/d23/d60/d6b/d13/f78 [1200717,122669] 0 2024-09-17T04:20:57.141 INFO:tasks.workunit.client.1.smithi134.stdout:9/913: chown d2/d5/d9/cf9 62 1 2024-09-17T04:20:57.142 INFO:tasks.workunit.client.1.smithi134.stdout:9/914: chown d2/d5/d37/d83/d12a/df3 62020059 1 2024-09-17T04:20:57.142 INFO:tasks.workunit.client.1.smithi134.stdout:9/915: chown d2/d25/ff6 2 1 2024-09-17T04:20:57.144 INFO:tasks.workunit.client.1.smithi134.stdout:9/916: readlink d2/d5/d37/d83/d12a/d54/daf/d6d/daa/de2/dcd/lc9 0 2024-09-17T04:20:57.145 INFO:tasks.workunit.client.1.smithi134.stdout:9/917: fsync d2/d78/fc6 0 2024-09-17T04:20:57.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:56 smithi134 ceph-mon[35201]: pgmap v19: 65 pgs: 65 active+clean; 1.5 GiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 43 MiB/s rd, 227 MiB/s wr, 465 op/s 2024-09-17T04:20:57.149 INFO:tasks.workunit.client.0.smithi088.stdout:7/211: fsync d2/d1e/f24 0 2024-09-17T04:20:57.155 INFO:tasks.workunit.client.1.smithi134.stdout:5/504: creat d0/d3a/fa9 x:0 0 0 2024-09-17T04:20:57.156 INFO:tasks.workunit.client.1.smithi134.stdout:6/627: symlink de/d19/d62/d34/d8e/lc3 0 2024-09-17T04:20:57.159 INFO:tasks.workunit.client.1.smithi134.stdout:1/565: symlink d12/d36/da1/lb9 0 2024-09-17T04:20:57.159 INFO:tasks.workunit.client.1.smithi134.stdout:1/566: dread - d12/d1c/d2e/f5a zero size 2024-09-17T04:20:57.159 INFO:tasks.workunit.client.0.smithi088.stdout:3/122: creat d0/d13/f22 x:0 0 0 2024-09-17T04:20:57.161 INFO:tasks.workunit.client.1.smithi134.stdout:7/422: rename d0/d16/d35/d4b/c46 to d0/dd/d57/d6a/d70/c87 0 2024-09-17T04:20:57.161 INFO:tasks.workunit.client.0.smithi088.stdout:0/100: mkdir db/d1a/d20 0 2024-09-17T04:20:57.162 INFO:tasks.workunit.client.1.smithi134.stdout:7/423: write d0/dd/d3a/d3d/d38/f23 [3408243,93752] 0 2024-09-17T04:20:57.163 INFO:tasks.workunit.client.1.smithi134.stdout:1/567: read d12/d19/f25 [897576,127959] 0 2024-09-17T04:20:57.166 INFO:tasks.workunit.client.0.smithi088.stdout:0/101: dread db/f1c [0,4194304] 0 2024-09-17T04:20:57.169 INFO:tasks.workunit.client.0.smithi088.stdout:7/212: mkdir d2/d4/d7/d46 0 2024-09-17T04:20:57.170 INFO:tasks.workunit.client.1.smithi134.stdout:5/505: creat d0/da/d29/d8e/faa x:0 0 0 2024-09-17T04:20:57.172 INFO:tasks.workunit.client.1.smithi134.stdout:0/493: truncate d11/d19/f6c 141499 0 2024-09-17T04:20:57.173 INFO:tasks.workunit.client.0.smithi088.stdout:6/175: mknod d14/d15/c46 0 2024-09-17T04:20:57.174 INFO:tasks.workunit.client.1.smithi134.stdout:2/516: write d19/d1c/f1f [1361042,16348] 0 2024-09-17T04:20:57.174 INFO:tasks.workunit.client.0.smithi088.stdout:5/190: write d2/f15 [2354417,3730] 0 2024-09-17T04:20:57.175 INFO:tasks.workunit.client.0.smithi088.stdout:5/191: chown d2/d31 2752095 1 2024-09-17T04:20:57.177 INFO:tasks.workunit.client.0.smithi088.stdout:3/123: unlink d0/f7 0 2024-09-17T04:20:57.180 INFO:tasks.workunit.client.1.smithi134.stdout:4/579: write d0/df/d1e/f50 [639136,79521] 0 2024-09-17T04:20:57.180 INFO:tasks.workunit.client.1.smithi134.stdout:4/580: dread - d0/df/d17/f90 zero size 2024-09-17T04:20:57.183 INFO:tasks.workunit.client.1.smithi134.stdout:7/424: creat d0/dd/d57/d6a/f88 x:0 0 0 2024-09-17T04:20:57.186 INFO:tasks.workunit.client.0.smithi088.stdout:2/174: write d0/d18/f19 [4248897,66988] 0 2024-09-17T04:20:57.187 INFO:tasks.workunit.client.0.smithi088.stdout:2/175: chown d0/d14/d24 33586 1 2024-09-17T04:20:57.187 INFO:tasks.workunit.client.0.smithi088.stdout:7/213: creat d2/d4/f47 x:0 0 0 2024-09-17T04:20:57.188 INFO:tasks.workunit.client.0.smithi088.stdout:7/214: dread - d2/f21 zero size 2024-09-17T04:20:57.188 INFO:tasks.workunit.client.1.smithi134.stdout:9/918: mkdir d2/d5/d9/df/d111/d132 0 2024-09-17T04:20:57.190 INFO:tasks.workunit.client.0.smithi088.stdout:9/167: rename d2/d2b/d2e/l2f to d2/l39 0 2024-09-17T04:20:57.191 INFO:tasks.workunit.client.0.smithi088.stdout:6/176: mknod d14/d15/d29/d3e/c47 0 2024-09-17T04:20:57.192 INFO:tasks.workunit.client.0.smithi088.stdout:6/177: dread d14/d15/d16/f2e [0,4194304] 0 2024-09-17T04:20:57.194 INFO:tasks.workunit.client.0.smithi088.stdout:5/192: creat d2/d31/d33/d20/d25/d2c/f3c x:0 0 0 2024-09-17T04:20:57.195 INFO:tasks.workunit.client.0.smithi088.stdout:5/193: chown d2/f27 66949041 1 2024-09-17T04:20:57.195 INFO:tasks.workunit.client.1.smithi134.stdout:0/494: write d11/d22/d1c/d2f/d43/f85 [2506015,123414] 0 2024-09-17T04:20:57.199 INFO:tasks.workunit.client.0.smithi088.stdout:3/124: mknod d0/d13/d1b/c23 0 2024-09-17T04:20:57.201 INFO:tasks.workunit.client.1.smithi134.stdout:8/471: write d4/f7e [553270,72810] 0 2024-09-17T04:20:57.202 INFO:tasks.workunit.client.0.smithi088.stdout:3/125: dread d0/fd [0,4194304] 0 2024-09-17T04:20:57.203 INFO:tasks.workunit.client.1.smithi134.stdout:8/472: write d4/d23/d60/f7d [3769496,29534] 0 2024-09-17T04:20:57.203 INFO:tasks.workunit.client.1.smithi134.stdout:3/624: creat de/d12/d15/d1d/fcb x:0 0 0 2024-09-17T04:20:57.204 INFO:tasks.workunit.client.1.smithi134.stdout:3/625: fdatasync de/d12/d15/d1d/d8f/d90/fa8 0 2024-09-17T04:20:57.205 INFO:tasks.workunit.client.0.smithi088.stdout:2/176: mknod d0/d14/d17/c37 0 2024-09-17T04:20:57.207 INFO:tasks.workunit.client.1.smithi134.stdout:4/581: unlink d0/df/d1e/f25 0 2024-09-17T04:20:57.208 INFO:tasks.workunit.client.0.smithi088.stdout:7/215: chown d2/d4/d7/c12 1 1 2024-09-17T04:20:57.208 INFO:tasks.workunit.client.1.smithi134.stdout:8/473: dwrite d4/d1f/d2b/f7b [0,4194304] 0 2024-09-17T04:20:57.210 INFO:tasks.workunit.client.0.smithi088.stdout:9/168: rmdir d2/d16 39 2024-09-17T04:20:57.210 INFO:tasks.workunit.client.1.smithi134.stdout:7/425: unlink d0/d16/d35/d4b/d65/f6e 0 2024-09-17T04:20:57.210 INFO:tasks.workunit.client.1.smithi134.stdout:4/582: truncate d0/d13/d40/d42/d92/d86/faf 857492 0 2024-09-17T04:20:57.211 INFO:tasks.workunit.client.1.smithi134.stdout:7/426: write d0/dd/f58 [1889114,69294] 0 2024-09-17T04:20:57.212 INFO:tasks.workunit.client.0.smithi088.stdout:6/178: symlink d14/d15/d29/d3e/l48 0 2024-09-17T04:20:57.212 INFO:tasks.workunit.client.0.smithi088.stdout:6/179: fdatasync d14/d15/d29/d3e/f33 0 2024-09-17T04:20:57.213 INFO:tasks.workunit.client.1.smithi134.stdout:9/919: creat d2/d5/d9/d6b/f133 x:0 0 0 2024-09-17T04:20:57.214 INFO:tasks.workunit.client.0.smithi088.stdout:6/180: chown d14/d15/d29/d3e/f33 0 1 2024-09-17T04:20:57.214 INFO:tasks.workunit.client.0.smithi088.stdout:5/194: mkdir d2/d31/d33/d20/d25/d2c/d3d 0 2024-09-17T04:20:57.214 INFO:tasks.workunit.client.0.smithi088.stdout:5/195: readlink d2/d31/d33/l1a 0 2024-09-17T04:20:57.215 INFO:tasks.workunit.client.0.smithi088.stdout:5/196: chown d2/d31/d33/d20/c26 5593966 1 2024-09-17T04:20:57.216 INFO:tasks.workunit.client.1.smithi134.stdout:5/506: symlink d0/da/d69/d41/lab 0 2024-09-17T04:20:57.216 INFO:tasks.workunit.client.1.smithi134.stdout:8/474: dwrite d4/f7e [0,4194304] 0 2024-09-17T04:20:57.218 INFO:tasks.workunit.client.0.smithi088.stdout:3/126: creat d0/d13/f24 x:0 0 0 2024-09-17T04:20:57.219 INFO:tasks.workunit.client.0.smithi088.stdout:3/127: dread - d0/d13/f17 zero size 2024-09-17T04:20:57.225 INFO:tasks.workunit.client.1.smithi134.stdout:0/495: dwrite d11/d22/d1c/d2f/d45/f8e [0,4194304] 0 2024-09-17T04:20:57.227 INFO:tasks.workunit.client.1.smithi134.stdout:1/568: write d12/d1c/d4a/fb7 [856047,65135] 0 2024-09-17T04:20:57.229 INFO:tasks.workunit.client.1.smithi134.stdout:1/569: dread - d12/d1c/d56/f76 zero size 2024-09-17T04:20:57.231 INFO:tasks.workunit.client.1.smithi134.stdout:1/570: write d12/d1c/d4a/f4c [700834,117776] 0 2024-09-17T04:20:57.232 INFO:tasks.workunit.client.1.smithi134.stdout:0/496: dwrite fe [0,4194304] 0 2024-09-17T04:20:57.236 INFO:tasks.workunit.client.1.smithi134.stdout:1/571: write d12/d1c/f2f [236835,101995] 0 2024-09-17T04:20:57.237 INFO:tasks.workunit.client.0.smithi088.stdout:3/128: creat d0/d13/f25 x:0 0 0 2024-09-17T04:20:57.238 INFO:tasks.workunit.client.0.smithi088.stdout:0/102: link db/d1a/c1f db/c21 0 2024-09-17T04:20:57.238 INFO:tasks.workunit.client.0.smithi088.stdout:3/129: write d0/f16 [866319,76097] 0 2024-09-17T04:20:57.239 INFO:tasks.workunit.client.1.smithi134.stdout:9/920: symlink d2/d5/d58/db5/l134 0 2024-09-17T04:20:57.242 INFO:tasks.workunit.client.1.smithi134.stdout:5/507: rename d0/d3a/l3d to d0/da/d29/lac 0 2024-09-17T04:20:57.242 INFO:tasks.workunit.client.1.smithi134.stdout:5/508: readlink d0/da/l64 0 2024-09-17T04:20:57.243 INFO:tasks.workunit.client.0.smithi088.stdout:7/216: symlink d2/d1e/d23/d45/l48 0 2024-09-17T04:20:57.243 INFO:tasks.workunit.client.1.smithi134.stdout:8/475: fdatasync d4/d23/d60/d6b/d13/f73 0 2024-09-17T04:20:57.243 INFO:tasks.workunit.client.1.smithi134.stdout:5/509: chown d0/da/d29/d78/f8d 3781543 1 2024-09-17T04:20:57.244 INFO:tasks.workunit.client.1.smithi134.stdout:6/628: getdents de/d19/d1f/d85 0 2024-09-17T04:20:57.244 INFO:tasks.workunit.client.1.smithi134.stdout:6/629: chown de/f12 0 1 2024-09-17T04:20:57.245 INFO:tasks.workunit.client.0.smithi088.stdout:9/169: symlink d2/dd/d11/d1d/d35/l3a 0 2024-09-17T04:20:57.246 INFO:tasks.workunit.client.1.smithi134.stdout:3/626: symlink de/d10/d3d/lcc 0 2024-09-17T04:20:57.247 INFO:tasks.workunit.client.0.smithi088.stdout:3/130: rmdir d0/d13/d1b 39 2024-09-17T04:20:57.248 INFO:tasks.workunit.client.0.smithi088.stdout:3/131: chown d0/c11 1966555 1 2024-09-17T04:20:57.249 INFO:tasks.workunit.client.0.smithi088.stdout:3/132: dread - d0/d13/f17 zero size 2024-09-17T04:20:57.249 INFO:tasks.workunit.client.1.smithi134.stdout:1/572: creat d12/d19/d5d/d91/dac/fba x:0 0 0 2024-09-17T04:20:57.249 INFO:tasks.workunit.client.0.smithi088.stdout:0/103: truncate db/f13 1376339 0 2024-09-17T04:20:57.250 INFO:tasks.workunit.client.0.smithi088.stdout:0/104: chown db/d1a/d20 569 1 2024-09-17T04:20:57.250 INFO:tasks.workunit.client.1.smithi134.stdout:4/583: mkdir d0/df/d1e/dbc 0 2024-09-17T04:20:57.251 INFO:tasks.workunit.client.1.smithi134.stdout:7/427: unlink d0/l22 0 2024-09-17T04:20:57.253 INFO:tasks.workunit.client.1.smithi134.stdout:0/497: rename cb to d11/d22/d1c/d2f/d9a/ca6 0 2024-09-17T04:20:57.254 INFO:tasks.workunit.client.1.smithi134.stdout:0/498: chown d11/d22/f3a 10285377 1 2024-09-17T04:20:57.254 INFO:tasks.workunit.client.0.smithi088.stdout:6/181: creat d14/d15/d2a/f49 x:0 0 0 2024-09-17T04:20:57.255 INFO:tasks.workunit.client.0.smithi088.stdout:6/182: chown d14/d15/d16/f26 0 1 2024-09-17T04:20:57.255 INFO:tasks.workunit.client.1.smithi134.stdout:8/476: chown d4/l4f 113963579 1 2024-09-17T04:20:57.256 INFO:tasks.workunit.client.0.smithi088.stdout:2/177: write d0/d1/f11 [301068,129482] 0 2024-09-17T04:20:57.256 INFO:tasks.workunit.client.1.smithi134.stdout:7/428: dread d0/dd/d3a/d3d/f78 [0,4194304] 0 2024-09-17T04:20:57.257 INFO:tasks.workunit.client.0.smithi088.stdout:6/183: write d14/d15/d16/f26 [1036077,1398] 0 2024-09-17T04:20:57.260 INFO:tasks.workunit.client.0.smithi088.stdout:5/197: rename d2/d31/d33/d20/c26 to d2/c3e 0 2024-09-17T04:20:57.262 INFO:tasks.workunit.client.1.smithi134.stdout:5/510: dread d0/da/d69/d41/f4d [0,4194304] 0 2024-09-17T04:20:57.263 INFO:tasks.workunit.client.1.smithi134.stdout:6/630: symlink de/d19/d62/d34/d8e/lc4 0 2024-09-17T04:20:57.263 INFO:tasks.workunit.client.1.smithi134.stdout:6/631: readlink de/d19/d21/d2d/d92/lc1 0 2024-09-17T04:20:57.263 INFO:tasks.workunit.client.1.smithi134.stdout:6/632: readlink de/d19/d74/l8b 0 2024-09-17T04:20:57.264 INFO:tasks.workunit.client.0.smithi088.stdout:0/105: symlink db/d1a/l22 0 2024-09-17T04:20:57.265 INFO:tasks.workunit.client.1.smithi134.stdout:1/573: creat d12/d19/d5c/d85/fbb x:0 0 0 2024-09-17T04:20:57.266 INFO:tasks.workunit.client.0.smithi088.stdout:2/178: dwrite d0/d14/d24/f2c [0,4194304] 0 2024-09-17T04:20:57.266 INFO:tasks.workunit.client.0.smithi088.stdout:6/184: dwrite d14/d15/d29/d3e/f37 [0,4194304] 0 2024-09-17T04:20:57.267 INFO:tasks.workunit.client.0.smithi088.stdout:7/217: mknod d2/d4/d7/d46/c49 0 2024-09-17T04:20:57.268 INFO:tasks.workunit.client.0.smithi088.stdout:6/185: dread - d14/d15/d29/f38 zero size 2024-09-17T04:20:57.269 INFO:tasks.workunit.client.0.smithi088.stdout:9/170: mkdir d2/dd/d11/d3b 0 2024-09-17T04:20:57.270 INFO:tasks.workunit.client.1.smithi134.stdout:9/921: rename d2/d5/d9/d6b/l102 to d2/d5/d9/df/d111/l135 0 2024-09-17T04:20:57.273 INFO:tasks.workunit.client.0.smithi088.stdout:9/171: dread d2/dd/f15 [0,4194304] 0 2024-09-17T04:20:57.275 INFO:tasks.workunit.client.0.smithi088.stdout:0/106: rmdir db/d1a 39 2024-09-17T04:20:57.275 INFO:tasks.workunit.client.0.smithi088.stdout:0/107: readlink db/le 0 2024-09-17T04:20:57.275 INFO:tasks.workunit.client.1.smithi134.stdout:2/517: link d19/d27/d31/l4f d19/d27/la8 0 2024-09-17T04:20:57.276 INFO:tasks.workunit.client.1.smithi134.stdout:8/477: stat d4/d11/l7f 0 2024-09-17T04:20:57.276 INFO:tasks.workunit.client.1.smithi134.stdout:2/518: fdatasync d19/d27/f32 0 2024-09-17T04:20:57.276 INFO:tasks.workunit.client.0.smithi088.stdout:0/108: chown db/lf 9595011 1 2024-09-17T04:20:57.277 INFO:tasks.workunit.client.1.smithi134.stdout:6/633: creat de/d5d/d67/fc5 x:0 0 0 2024-09-17T04:20:57.278 INFO:tasks.workunit.client.1.smithi134.stdout:6/634: readlink de/d19/d1f/d55/d77/lab 0 2024-09-17T04:20:57.279 INFO:tasks.workunit.client.1.smithi134.stdout:1/574: symlink d12/d1c/d56/lbc 0 2024-09-17T04:20:57.280 INFO:tasks.workunit.client.0.smithi088.stdout:6/186: mknod d14/d15/d29/c4a 0 2024-09-17T04:20:57.281 INFO:tasks.workunit.client.0.smithi088.stdout:9/172: dread d2/f7 [0,4194304] 0 2024-09-17T04:20:57.288 INFO:tasks.workunit.client.0.smithi088.stdout:3/133: creat d0/f26 x:0 0 0 2024-09-17T04:20:57.288 INFO:tasks.workunit.client.0.smithi088.stdout:3/134: chown d0/l20 3 1 2024-09-17T04:20:57.289 INFO:tasks.workunit.client.1.smithi134.stdout:9/922: creat d2/d5/d37/d83/d12a/d54/daf/d6d/daa/de2/dcd/dd6/de3/f136 x:0 0 0 2024-09-17T04:20:57.292 INFO:tasks.workunit.client.0.smithi088.stdout:2/179: creat d0/d1/d2d/d33/f38 x:0 0 0 2024-09-17T04:20:57.292 INFO:tasks.workunit.client.0.smithi088.stdout:2/180: truncate d0/d18/f19 4379529 0 2024-09-17T04:20:57.296 INFO:tasks.workunit.client.1.smithi134.stdout:2/519: mkdir d19/d27/d31/d49/d6f/da9 0 2024-09-17T04:20:57.297 INFO:tasks.workunit.client.1.smithi134.stdout:1/575: symlink d12/d1c/d56/lbd 0 2024-09-17T04:20:57.298 INFO:tasks.workunit.client.0.smithi088.stdout:9/173: dread - d2/d16/f34 zero size 2024-09-17T04:20:57.299 INFO:tasks.workunit.client.1.smithi134.stdout:0/499: dwrite d11/d24/f47 [0,4194304] 0 2024-09-17T04:20:57.299 INFO:tasks.workunit.client.1.smithi134.stdout:2/520: truncate d19/d27/d31/d49/d6f/d84/f9e 676136 0 2024-09-17T04:20:57.304 INFO:tasks.workunit.client.1.smithi134.stdout:2/521: dwrite d19/d27/d31/d49/d63/f68 [0,4194304] 0 2024-09-17T04:20:57.308 INFO:tasks.workunit.client.1.smithi134.stdout:8/478: creat d4/db/dd/d43/f94 x:0 0 0 2024-09-17T04:20:57.309 INFO:tasks.workunit.client.0.smithi088.stdout:9/174: dread d2/fc [0,4194304] 0 2024-09-17T04:20:57.310 INFO:tasks.workunit.client.0.smithi088.stdout:0/109: mknod db/d1e/c23 0 2024-09-17T04:20:57.310 INFO:tasks.workunit.client.0.smithi088.stdout:7/218: dwrite d2/d4/f14 [0,4194304] 0 2024-09-17T04:20:57.311 INFO:tasks.workunit.client.1.smithi134.stdout:2/522: dwrite d19/f73 [0,4194304] 0 2024-09-17T04:20:57.314 INFO:tasks.workunit.client.0.smithi088.stdout:2/181: symlink d0/d14/l39 0 2024-09-17T04:20:57.315 INFO:tasks.workunit.client.1.smithi134.stdout:4/584: symlink d0/d13/d40/d72/da7/lbd 0 2024-09-17T04:20:57.315 INFO:tasks.workunit.client.0.smithi088.stdout:5/198: dwrite d2/d31/d33/f18 [0,4194304] 0 2024-09-17T04:20:57.317 INFO:tasks.workunit.client.0.smithi088.stdout:3/135: dwrite d0/fd [0,4194304] 0 2024-09-17T04:20:57.320 INFO:tasks.workunit.client.1.smithi134.stdout:5/511: dwrite d0/da/d29/f9b [0,4194304] 0 2024-09-17T04:20:57.321 INFO:tasks.workunit.client.1.smithi134.stdout:0/500: rmdir d11/d24/d49 39 2024-09-17T04:20:57.323 INFO:tasks.workunit.client.1.smithi134.stdout:9/923: write d2/d5/d37/d3f/f7d [175842,114938] 0 2024-09-17T04:20:57.326 INFO:tasks.workunit.client.0.smithi088.stdout:9/175: rmdir d2/d2b 39 2024-09-17T04:20:57.327 INFO:tasks.workunit.client.1.smithi134.stdout:3/627: rename de/d12/d15/d1d/f61 to de/d12/d22/fcd 0 2024-09-17T04:20:57.327 INFO:tasks.workunit.client.0.smithi088.stdout:2/182: write d0/f12 [4731261,27813] 0 2024-09-17T04:20:57.329 INFO:tasks.workunit.client.0.smithi088.stdout:2/183: dread - d0/d18/f34 zero size 2024-09-17T04:20:57.329 INFO:tasks.workunit.client.0.smithi088.stdout:9/176: write d2/dd/d11/f25 [641113,83178] 0 2024-09-17T04:20:57.329 INFO:tasks.workunit.client.0.smithi088.stdout:6/187: rename d14/d15/d16/f21 to d14/d15/f4b 0 2024-09-17T04:20:57.330 INFO:tasks.workunit.client.0.smithi088.stdout:2/184: stat d0/d14/f28 0 2024-09-17T04:20:57.331 INFO:tasks.workunit.client.0.smithi088.stdout:2/185: write d0/d18/f34 [566117,63734] 0 2024-09-17T04:20:57.332 INFO:tasks.workunit.client.0.smithi088.stdout:2/186: chown d0/d1/fe 62143 1 2024-09-17T04:20:57.332 INFO:tasks.workunit.client.1.smithi134.stdout:1/576: symlink d12/lbe 0 2024-09-17T04:20:57.334 INFO:tasks.workunit.client.1.smithi134.stdout:2/523: unlink d19/d27/d31/l6c 0 2024-09-17T04:20:57.334 INFO:tasks.workunit.client.1.smithi134.stdout:4/585: dwrite d0/df/f31 [0,4194304] 0 2024-09-17T04:20:57.334 INFO:tasks.workunit.client.0.smithi088.stdout:0/110: symlink db/d1a/l24 0 2024-09-17T04:20:57.336 INFO:tasks.workunit.client.1.smithi134.stdout:3/628: chown de/d12/d22/f26 9 1 2024-09-17T04:20:57.337 INFO:tasks.workunit.client.0.smithi088.stdout:9/177: write d2/f9 [1942531,16486] 0 2024-09-17T04:20:57.338 INFO:tasks.workunit.client.1.smithi134.stdout:5/512: mkdir d0/d3a/d6b/d9c/dad 0 2024-09-17T04:20:57.338 INFO:tasks.workunit.client.0.smithi088.stdout:3/136: creat d0/d13/d1b/f27 x:0 0 0 2024-09-17T04:20:57.339 INFO:tasks.workunit.client.0.smithi088.stdout:9/178: dread d2/dd/fe [0,4194304] 0 2024-09-17T04:20:57.339 INFO:tasks.workunit.client.1.smithi134.stdout:0/501: dwrite d11/d22/d1c/d2f/d45/f74 [0,4194304] 0 2024-09-17T04:20:57.340 INFO:tasks.workunit.client.0.smithi088.stdout:3/137: stat d0/d13/f17 0 2024-09-17T04:20:57.341 INFO:tasks.workunit.client.1.smithi134.stdout:5/513: write d0/da/d29/d78/f8d [469848,83395] 0 2024-09-17T04:20:57.341 INFO:tasks.workunit.client.1.smithi134.stdout:5/514: fsync d0/f3c 0 2024-09-17T04:20:57.342 INFO:tasks.workunit.client.0.smithi088.stdout:2/187: fsync d0/d14/d17/f1f 0 2024-09-17T04:20:57.344 INFO:tasks.workunit.client.1.smithi134.stdout:7/429: rename d0/dd/d3a/d3d/f41 to d0/d16/d35/d4b/d65/f89 0 2024-09-17T04:20:57.347 INFO:tasks.workunit.client.1.smithi134.stdout:1/577: unlink d12/d1c/d4a/c5b 0 2024-09-17T04:20:57.348 INFO:tasks.workunit.client.0.smithi088.stdout:5/199: link d2/l2b d2/d31/d33/d20/d25/d2c/l3f 0 2024-09-17T04:20:57.349 INFO:tasks.workunit.client.1.smithi134.stdout:5/515: dwrite d0/da/d2c/d73/fa3 [0,4194304] 0 2024-09-17T04:20:57.349 INFO:tasks.workunit.client.1.smithi134.stdout:2/524: mkdir d19/d67/daa 0 2024-09-17T04:20:57.349 INFO:tasks.workunit.client.0.smithi088.stdout:5/200: chown d2/d31/d33/d20/l35 386 1 2024-09-17T04:20:57.351 INFO:tasks.workunit.client.0.smithi088.stdout:5/201: write d2/d31/d33/d20/d30/f32 [298743,2939] 0 2024-09-17T04:20:57.351 INFO:tasks.workunit.client.0.smithi088.stdout:9/179: mknod d2/dd/d11/d1d/d35/c3c 0 2024-09-17T04:20:57.352 INFO:tasks.workunit.client.0.smithi088.stdout:2/188: creat d0/d1/d2d/f3a x:0 0 0 2024-09-17T04:20:57.355 INFO:tasks.workunit.client.1.smithi134.stdout:9/924: link d2/d5/d58/f119 d2/d5/d37/d83/da7/f137 0 2024-09-17T04:20:57.357 INFO:tasks.workunit.client.1.smithi134.stdout:5/516: dwrite d0/f6f [0,4194304] 0 2024-09-17T04:20:57.358 INFO:tasks.workunit.client.0.smithi088.stdout:9/180: write d2/f7 [73502,43181] 0 2024-09-17T04:20:57.359 INFO:tasks.workunit.client.0.smithi088.stdout:0/111: creat db/f25 x:0 0 0 2024-09-17T04:20:57.362 INFO:tasks.workunit.client.0.smithi088.stdout:2/189: rename d0/d14/d17 to d0/d14/d24/d3b 0 2024-09-17T04:20:57.365 INFO:tasks.workunit.client.0.smithi088.stdout:9/181: readlink d2/dd/d11/l13 0 2024-09-17T04:20:57.369 INFO:tasks.workunit.client.0.smithi088.stdout:2/190: creat d0/d1/d2d/f3c x:0 0 0 2024-09-17T04:20:57.371 INFO:tasks.workunit.client.0.smithi088.stdout:5/202: creat d2/f40 x:0 0 0 2024-09-17T04:20:57.372 INFO:tasks.workunit.client.1.smithi134.stdout:6/635: sync 2024-09-17T04:20:57.374 INFO:tasks.workunit.client.0.smithi088.stdout:0/112: link db/f25 db/d1e/f26 0 2024-09-17T04:20:57.374 INFO:tasks.workunit.client.0.smithi088.stdout:9/182: dwrite d2/f9 [0,4194304] 0 2024-09-17T04:20:57.375 INFO:tasks.workunit.client.1.smithi134.stdout:8/479: getdents d4/db/dd/d43/d8b 0 2024-09-17T04:20:57.376 INFO:tasks.workunit.client.0.smithi088.stdout:9/183: fdatasync d2/f26 0 2024-09-17T04:20:57.377 INFO:tasks.workunit.client.1.smithi134.stdout:7/430: mkdir d0/d16/d35/d4b/d8a 0 2024-09-17T04:20:57.380 INFO:tasks.workunit.client.1.smithi134.stdout:5/517: creat d0/d3a/d2b/d61/d7b/fae x:0 0 0 2024-09-17T04:20:57.381 INFO:tasks.workunit.client.0.smithi088.stdout:2/191: dwrite d0/d1/d2d/f3c [0,4194304] 0 2024-09-17T04:20:57.381 INFO:tasks.workunit.client.1.smithi134.stdout:0/502: dread d11/d24/d49/f5b [0,4194304] 0 2024-09-17T04:20:57.383 INFO:tasks.workunit.client.1.smithi134.stdout:5/518: write d0/da/d29/f4e [806329,49076] 0 2024-09-17T04:20:57.385 INFO:tasks.workunit.client.1.smithi134.stdout:8/480: dwrite d4/d1f/f33 [0,4194304] 0 2024-09-17T04:20:57.386 INFO:tasks.workunit.client.1.smithi134.stdout:2/525: symlink d19/d1c/d92/lab 0 2024-09-17T04:20:57.388 INFO:tasks.workunit.client.1.smithi134.stdout:3/629: link de/d12/d9d/lb8 de/d12/d15/d1d/d2d/d63/d77/dbd/dc6/lce 0 2024-09-17T04:20:57.390 INFO:tasks.workunit.client.0.smithi088.stdout:2/192: creat d0/d14/f3d x:0 0 0 2024-09-17T04:20:57.394 INFO:tasks.workunit.client.1.smithi134.stdout:0/503: dwrite d11/f8c [0,4194304] 0 2024-09-17T04:20:57.395 INFO:tasks.workunit.client.0.smithi088.stdout:9/184: symlink d2/dd/d11/d3b/l3d 0 2024-09-17T04:20:57.396 INFO:tasks.workunit.client.1.smithi134.stdout:9/925: truncate d2/d78/fc6 4159761 0 2024-09-17T04:20:57.396 INFO:tasks.workunit.client.0.smithi088.stdout:9/185: read d2/f7 [120199,95966] 0 2024-09-17T04:20:57.398 INFO:tasks.workunit.client.1.smithi134.stdout:2/526: dwrite d19/d27/d31/f89 [0,4194304] 0 2024-09-17T04:20:57.398 INFO:tasks.workunit.client.1.smithi134.stdout:9/926: chown d2/d5/d37 11894 1 2024-09-17T04:20:57.398 INFO:tasks.workunit.client.0.smithi088.stdout:5/203: link d2/d31/d33/d20/d25/f28 d2/d31/d33/d20/d25/f41 0 2024-09-17T04:20:57.402 INFO:tasks.workunit.client.0.smithi088.stdout:2/193: creat d0/d18/f3e x:0 0 0 2024-09-17T04:20:57.405 INFO:tasks.workunit.client.1.smithi134.stdout:2/527: dwrite d19/d1c/f30 [0,4194304] 0 2024-09-17T04:20:57.411 INFO:tasks.workunit.client.0.smithi088.stdout:2/194: dread d0/d14/d24/f2c [0,4194304] 0 2024-09-17T04:20:57.419 INFO:tasks.workunit.client.1.smithi134.stdout:6/636: dread f9 [0,4194304] 0 2024-09-17T04:20:57.424 INFO:tasks.workunit.client.1.smithi134.stdout:3/630: creat de/d12/d15/d1d/d2d/d31/d6a/d78/d7c/fcf x:0 0 0 2024-09-17T04:20:57.425 INFO:tasks.workunit.client.0.smithi088.stdout:2/195: mkdir d0/d3f 0 2024-09-17T04:20:57.426 INFO:tasks.workunit.client.1.smithi134.stdout:6/637: dwrite de/d19/d1f/f28 [0,4194304] 0 2024-09-17T04:20:57.428 INFO:tasks.workunit.client.1.smithi134.stdout:4/586: dwrite d0/d13/d40/d72/fa6 [0,4194304] 0 2024-09-17T04:20:57.430 INFO:tasks.workunit.client.1.smithi134.stdout:3/631: truncate de/d12/d15/d1d/d2d/d31/d6a/fbf 115223 0 2024-09-17T04:20:57.430 INFO:tasks.workunit.client.1.smithi134.stdout:4/587: readlink d0/df/d35/l6e 0 2024-09-17T04:20:57.430 INFO:tasks.workunit.client.1.smithi134.stdout:4/588: stat d0/df/d1e/l6a 0 2024-09-17T04:20:57.431 INFO:tasks.workunit.client.0.smithi088.stdout:2/196: dread d0/d1/d2d/f3c [0,4194304] 0 2024-09-17T04:20:57.432 INFO:tasks.workunit.client.0.smithi088.stdout:2/197: write d0/d1/f11 [3936529,65396] 0 2024-09-17T04:20:57.433 INFO:tasks.workunit.client.0.smithi088.stdout:2/198: chown d0/d1/f3 14 1 2024-09-17T04:20:57.436 INFO:tasks.workunit.client.1.smithi134.stdout:4/589: dwrite d0/d13/d40/d42/f4f [0,4194304] 0 2024-09-17T04:20:57.441 INFO:tasks.workunit.client.1.smithi134.stdout:2/528: mknod d19/d27/d31/d49/d6f/cac 0 2024-09-17T04:20:57.441 INFO:tasks.workunit.client.1.smithi134.stdout:1/578: getdents d12/d1c/d56 0 2024-09-17T04:20:57.443 INFO:tasks.workunit.client.0.smithi088.stdout:9/186: link d2/dd/d14/c2c d2/d2b/d2e/c3e 0 2024-09-17T04:20:57.443 INFO:tasks.workunit.client.1.smithi134.stdout:9/927: dread d2/d5/d58/ff1 [0,4194304] 0 2024-09-17T04:20:57.448 INFO:tasks.workunit.client.1.smithi134.stdout:9/928: dwrite d2/d5/dd0/fd9 [4194304,4194304] 0 2024-09-17T04:20:57.448 INFO:tasks.workunit.client.0.smithi088.stdout:9/187: creat d2/d16/f3f x:0 0 0 2024-09-17T04:20:57.450 INFO:tasks.workunit.client.1.smithi134.stdout:9/929: truncate d2/d5/d58/db5/fe5 751362 0 2024-09-17T04:20:57.454 INFO:tasks.workunit.client.1.smithi134.stdout:7/431: rename d0/dd/d57 to d0/d16/d8b 0 2024-09-17T04:20:57.455 INFO:tasks.workunit.client.1.smithi134.stdout:7/432: chown d0/dd/d3a 38538885 1 2024-09-17T04:20:57.458 INFO:tasks.workunit.client.0.smithi088.stdout:2/199: link d0/d14/d24/f2a d0/d18/f40 0 2024-09-17T04:20:57.459 INFO:tasks.workunit.client.1.smithi134.stdout:5/519: creat d0/d3a/d2b/faf x:0 0 0 2024-09-17T04:20:57.459 INFO:tasks.workunit.client.0.smithi088.stdout:2/200: dread - d0/d14/d24/f2a zero size 2024-09-17T04:20:57.461 INFO:tasks.workunit.client.1.smithi134.stdout:7/433: dwrite d0/dd/d3a/d3d/d38/f24 [0,4194304] 0 2024-09-17T04:20:57.465 INFO:tasks.workunit.client.1.smithi134.stdout:6/638: symlink de/d19/d62/d34/lc6 0 2024-09-17T04:20:57.472 INFO:tasks.workunit.client.1.smithi134.stdout:0/504: rename d11/d22/d1c/d2f/d43/l7a to d11/d22/d1c/d2f/d43/d5d/la7 0 2024-09-17T04:20:57.472 INFO:tasks.workunit.client.0.smithi088.stdout:9/188: symlink d2/dd/d11/d30/l40 0 2024-09-17T04:20:57.474 INFO:tasks.workunit.client.1.smithi134.stdout:1/579: link d12/d19/d1d/d61/f77 d12/d19/d5d/d88/fbf 0 2024-09-17T04:20:57.474 INFO:tasks.workunit.client.1.smithi134.stdout:6/639: dwrite de/d19/d1f/dae/fbf [0,4194304] 0 2024-09-17T04:20:57.475 INFO:tasks.workunit.client.1.smithi134.stdout:8/481: getdents d4/d1f 0 2024-09-17T04:20:57.476 INFO:tasks.workunit.client.0.smithi088.stdout:2/201: symlink d0/l41 0 2024-09-17T04:20:57.477 INFO:tasks.workunit.client.0.smithi088.stdout:2/202: write d0/d14/f2e [1382297,92714] 0 2024-09-17T04:20:57.477 INFO:tasks.workunit.client.1.smithi134.stdout:9/930: dwrite d2/d5/d8/f114 [0,4194304] 0 2024-09-17T04:20:57.479 INFO:tasks.workunit.client.0.smithi088.stdout:9/189: truncate d2/dd/fe 1136553 0 2024-09-17T04:20:57.480 INFO:tasks.workunit.client.0.smithi088.stdout:9/190: fdatasync d2/dd/d11/f1e 0 2024-09-17T04:20:57.480 INFO:tasks.workunit.client.1.smithi134.stdout:9/931: stat d2/d5/d37/d83/d12a/f72 0 2024-09-17T04:20:57.481 INFO:tasks.workunit.client.1.smithi134.stdout:9/932: fdatasync d2/f130 0 2024-09-17T04:20:57.489 INFO:tasks.workunit.client.1.smithi134.stdout:5/520: symlink d0/d3a/d6b/d9c/dad/lb0 0 2024-09-17T04:20:57.490 INFO:tasks.workunit.client.0.smithi088.stdout:2/203: symlink d0/l42 0 2024-09-17T04:20:57.490 INFO:tasks.workunit.client.1.smithi134.stdout:4/590: getdents d0/df/d1e/d63 0 2024-09-17T04:20:57.490 INFO:tasks.workunit.client.0.smithi088.stdout:2/204: read d0/d1/fb [65264,20369] 0 2024-09-17T04:20:57.491 INFO:tasks.workunit.client.1.smithi134.stdout:8/482: dread d4/d1f/f67 [0,4194304] 0 2024-09-17T04:20:57.491 INFO:tasks.workunit.client.1.smithi134.stdout:0/505: dwrite d11/d24/f28 [0,4194304] 0 2024-09-17T04:20:57.491 INFO:tasks.workunit.client.1.smithi134.stdout:5/521: chown d0/d3a/d6b/d9c/ca2 230205 1 2024-09-17T04:20:57.492 INFO:tasks.workunit.client.1.smithi134.stdout:4/591: dread - d0/d13/d40/d42/d92/d86/fbb zero size 2024-09-17T04:20:57.493 INFO:tasks.workunit.client.1.smithi134.stdout:8/483: truncate d4/f82 66175 0 2024-09-17T04:20:57.496 INFO:tasks.workunit.client.0.smithi088.stdout:9/191: creat d2/dd/d14/d2a/f41 x:0 0 0 2024-09-17T04:20:57.497 INFO:tasks.workunit.client.0.smithi088.stdout:9/192: write f1 [485642,104905] 0 2024-09-17T04:20:57.500 INFO:tasks.workunit.client.0.smithi088.stdout:2/205: unlink d0/d14/d24/d3b/d22/f25 0 2024-09-17T04:20:57.502 INFO:tasks.workunit.client.0.smithi088.stdout:9/193: dread d2/dd/d14/f19 [0,4194304] 0 2024-09-17T04:20:57.503 INFO:tasks.workunit.client.0.smithi088.stdout:9/194: dread - d2/dd/d11/d1d/f37 zero size 2024-09-17T04:20:57.504 INFO:tasks.workunit.client.0.smithi088.stdout:9/195: chown d2/dd/l29 13223 1 2024-09-17T04:20:57.507 INFO:tasks.workunit.client.0.smithi088.stdout:2/206: unlink d0/d14/f28 0 2024-09-17T04:20:57.510 INFO:tasks.workunit.client.1.smithi134.stdout:0/506: rmdir d11/d22/d1c/d2f/d43 39 2024-09-17T04:20:57.510 INFO:tasks.workunit.client.1.smithi134.stdout:0/507: readlink d11/d22/d1c/d2f/l6b 0 2024-09-17T04:20:57.511 INFO:tasks.workunit.client.0.smithi088.stdout:2/207: mknod d0/c43 0 2024-09-17T04:20:57.512 INFO:tasks.workunit.client.0.smithi088.stdout:2/208: readlink d0/d14/d24/l35 0 2024-09-17T04:20:57.513 INFO:tasks.workunit.client.1.smithi134.stdout:6/640: mkdir de/d19/d1f/d55/d77/db8/dc7 0 2024-09-17T04:20:57.515 INFO:tasks.workunit.client.1.smithi134.stdout:4/592: truncate d0/d13/d40/d42/f66 501763 0 2024-09-17T04:20:57.517 INFO:tasks.workunit.client.0.smithi088.stdout:2/209: symlink d0/d14/d24/d3b/d22/l44 0 2024-09-17T04:20:57.519 INFO:tasks.workunit.client.1.smithi134.stdout:7/434: rename d0/d16/d35/d4b/c64 to d0/c8c 0 2024-09-17T04:20:57.519 INFO:tasks.workunit.client.0.smithi088.stdout:9/196: dread d2/dd/f1b [0,4194304] 0 2024-09-17T04:20:57.520 INFO:tasks.workunit.client.0.smithi088.stdout:9/197: chown d2/d16/f3f 113248 1 2024-09-17T04:20:57.520 INFO:tasks.workunit.client.1.smithi134.stdout:9/933: mknod d2/d5/d37/d83/d12a/d54/daf/c138 0 2024-09-17T04:20:57.521 INFO:tasks.workunit.client.1.smithi134.stdout:1/580: dread d12/d19/f25 [0,4194304] 0 2024-09-17T04:20:57.522 INFO:tasks.workunit.client.1.smithi134.stdout:8/484: mkdir d4/db/dd/d95 0 2024-09-17T04:20:57.523 INFO:tasks.workunit.client.0.smithi088.stdout:9/198: unlink d2/d16/f28 0 2024-09-17T04:20:57.524 INFO:tasks.workunit.client.1.smithi134.stdout:6/641: rmdir de/d19/d1f/dae 39 2024-09-17T04:20:57.525 INFO:tasks.workunit.client.1.smithi134.stdout:5/522: link d0/d3a/f3b d0/da/d29/d78/da5/fb1 0 2024-09-17T04:20:57.526 INFO:tasks.workunit.client.1.smithi134.stdout:5/523: read - d0/da/fa0 zero size 2024-09-17T04:20:57.526 INFO:tasks.workunit.client.1.smithi134.stdout:7/435: mkdir d0/d16/d35/d8d 0 2024-09-17T04:20:57.528 INFO:tasks.workunit.client.0.smithi088.stdout:9/199: unlink d2/dd/d14/l23 0 2024-09-17T04:20:57.528 INFO:tasks.workunit.client.1.smithi134.stdout:0/508: mkdir d11/d6f/da8 0 2024-09-17T04:20:57.529 INFO:tasks.workunit.client.1.smithi134.stdout:1/581: readlink d12/d19/d4f/lb8 0 2024-09-17T04:20:57.531 INFO:tasks.workunit.client.1.smithi134.stdout:6/642: creat de/d19/d62/fc8 x:0 0 0 2024-09-17T04:20:57.534 INFO:tasks.workunit.client.0.smithi088.stdout:9/200: dwrite d2/f3 [0,4194304] 0 2024-09-17T04:20:57.536 INFO:tasks.workunit.client.0.smithi088.stdout:2/210: dread d0/f12 [0,4194304] 0 2024-09-17T04:20:57.536 INFO:tasks.workunit.client.1.smithi134.stdout:1/582: dwrite d12/f86 [0,4194304] 0 2024-09-17T04:20:57.536 INFO:tasks.workunit.client.1.smithi134.stdout:8/485: dread d4/f36 [0,4194304] 0 2024-09-17T04:20:57.537 INFO:tasks.workunit.client.1.smithi134.stdout:3/632: sync 2024-09-17T04:20:57.538 INFO:tasks.workunit.client.1.smithi134.stdout:8/486: chown d4/d1e/f81 8661 1 2024-09-17T04:20:57.538 INFO:tasks.workunit.client.1.smithi134.stdout:1/583: write d12/d1c/d2e/d7d/fa7 [523803,20328] 0 2024-09-17T04:20:57.539 INFO:tasks.workunit.client.0.smithi088.stdout:9/201: creat d2/dd/d11/d3b/f42 x:0 0 0 2024-09-17T04:20:57.542 INFO:tasks.workunit.client.1.smithi134.stdout:0/509: rename d11/d22/d1c/d2f/l6b to d11/d6f/da8/la9 0 2024-09-17T04:20:57.543 INFO:tasks.workunit.client.1.smithi134.stdout:0/510: chown d11/f8c 31 1 2024-09-17T04:20:57.543 INFO:tasks.workunit.client.0.smithi088.stdout:2/211: mknod d0/d14/d24/d3b/d22/c45 0 2024-09-17T04:20:57.543 INFO:tasks.workunit.client.1.smithi134.stdout:4/593: link d0/df/d1e/d73/l96 d0/df/d1e/d73/lbe 0 2024-09-17T04:20:57.547 INFO:tasks.workunit.client.0.smithi088.stdout:9/202: dwrite d2/dd/d11/f1e [0,4194304] 0 2024-09-17T04:20:57.552 INFO:tasks.workunit.client.0.smithi088.stdout:2/212: dwrite d0/d18/f3e [0,4194304] 0 2024-09-17T04:20:57.556 INFO:tasks.workunit.client.1.smithi134.stdout:0/511: creat d11/d19/d21/d37/faa x:0 0 0 2024-09-17T04:20:57.558 INFO:tasks.workunit.client.0.smithi088.stdout:9/203: dwrite d2/dd/d11/f1e [0,4194304] 0 2024-09-17T04:20:57.559 INFO:tasks.workunit.client.0.smithi088.stdout:9/204: truncate f1 819009 0 2024-09-17T04:20:57.560 INFO:tasks.workunit.client.1.smithi134.stdout:5/524: creat d0/da/d69/d41/fb2 x:0 0 0 2024-09-17T04:20:57.561 INFO:tasks.workunit.client.1.smithi134.stdout:3/633: dread de/d10/d3d/f7d [0,4194304] 0 2024-09-17T04:20:57.563 INFO:tasks.workunit.client.1.smithi134.stdout:5/525: write d0/d3a/d2b/f58 [2072981,125225] 0 2024-09-17T04:20:57.563 INFO:tasks.workunit.client.1.smithi134.stdout:5/526: stat d0 0 2024-09-17T04:20:57.564 INFO:tasks.workunit.client.0.smithi088.stdout:2/213: dwrite d0/d18/f3e [0,4194304] 0 2024-09-17T04:20:57.564 INFO:tasks.workunit.client.1.smithi134.stdout:3/634: chown de/d12/d22/d5a/c7f 11057 1 2024-09-17T04:20:57.564 INFO:tasks.workunit.client.0.smithi088.stdout:2/214: chown d0/d13 2 1 2024-09-17T04:20:57.565 INFO:tasks.workunit.client.1.smithi134.stdout:5/527: write d0/d48/f87 [131454,124946] 0 2024-09-17T04:20:57.567 INFO:tasks.workunit.client.1.smithi134.stdout:4/594: rename d0/d13/f51 to d0/d13/d40/d72/da7/fbf 0 2024-09-17T04:20:57.568 INFO:tasks.workunit.client.0.smithi088.stdout:9/205: mkdir d2/dd/d11/d1d/d43 0 2024-09-17T04:20:57.571 INFO:tasks.workunit.client.1.smithi134.stdout:4/595: dread - d0/df/d1e/d73/f8f zero size 2024-09-17T04:20:57.572 INFO:tasks.workunit.client.1.smithi134.stdout:1/584: mkdir d12/d1c/dc0 0 2024-09-17T04:20:57.573 INFO:tasks.workunit.client.0.smithi088.stdout:9/206: unlink d2/dd/d11/d30/c33 0 2024-09-17T04:20:57.575 INFO:tasks.workunit.client.1.smithi134.stdout:8/487: creat d4/db/dd/d95/f96 x:0 0 0 2024-09-17T04:20:57.576 INFO:tasks.workunit.client.1.smithi134.stdout:9/934: write d2/d5/d8/f19 [2147529,55782] 0 2024-09-17T04:20:57.577 INFO:tasks.workunit.client.1.smithi134.stdout:0/512: creat d11/d48/fab x:0 0 0 2024-09-17T04:20:57.578 INFO:tasks.workunit.client.0.smithi088.stdout:9/207: mknod d2/dd/c44 0 2024-09-17T04:20:57.579 INFO:tasks.workunit.client.1.smithi134.stdout:3/635: dwrite de/d12/d15/d1d/f8b [0,4194304] 0 2024-09-17T04:20:57.580 INFO:tasks.workunit.client.1.smithi134.stdout:0/513: fsync d11/d22/d1c/f54 0 2024-09-17T04:20:57.582 INFO:tasks.workunit.client.1.smithi134.stdout:6/643: link de/d19/d62/c38 de/d19/d74/d98/cc9 0 2024-09-17T04:20:57.584 INFO:tasks.workunit.client.1.smithi134.stdout:3/636: write de/d12/d22/f82 [134569,20734] 0 2024-09-17T04:20:57.584 INFO:tasks.workunit.client.0.smithi088.stdout:2/215: getdents d0/d13 0 2024-09-17T04:20:57.586 INFO:tasks.workunit.client.1.smithi134.stdout:9/935: read d2/d7/d75/fb0 [3380358,30795] 0 2024-09-17T04:20:57.587 INFO:tasks.workunit.client.1.smithi134.stdout:7/436: dwrite d0/f55 [0,4194304] 0 2024-09-17T04:20:57.588 INFO:tasks.workunit.client.0.smithi088.stdout:9/208: link d2/dd/d11/f25 d2/dd/d11/d3b/f45 0 2024-09-17T04:20:57.588 INFO:tasks.workunit.client.1.smithi134.stdout:3/637: write de/d10/d3d/f43 [153154,31107] 0 2024-09-17T04:20:57.589 INFO:tasks.workunit.client.1.smithi134.stdout:8/488: dread d4/d23/f6d [0,4194304] 0 2024-09-17T04:20:57.589 INFO:tasks.workunit.client.1.smithi134.stdout:7/437: chown d0/dd/d3a/d3d/d38/c21 173 1 2024-09-17T04:20:57.591 INFO:tasks.workunit.client.1.smithi134.stdout:1/585: creat d12/db2/fc1 x:0 0 0 2024-09-17T04:20:57.592 INFO:tasks.workunit.client.1.smithi134.stdout:4/596: creat d0/df/d35/d5c/d8b/fc0 x:0 0 0 2024-09-17T04:20:57.593 INFO:tasks.workunit.client.1.smithi134.stdout:4/597: readlink d0/d13/d40/d42/d92/d86/lb8 0 2024-09-17T04:20:57.594 INFO:tasks.workunit.client.0.smithi088.stdout:9/209: rename d2/l22 to d2/dd/d11/d1d/d43/l46 0 2024-09-17T04:20:57.596 INFO:tasks.workunit.client.1.smithi134.stdout:6/644: creat de/d19/d62/d7c/fca x:0 0 0 2024-09-17T04:20:57.597 INFO:tasks.workunit.client.0.smithi088.stdout:9/210: mknod d2/d16/c47 0 2024-09-17T04:20:57.598 INFO:tasks.workunit.client.1.smithi134.stdout:0/514: creat d11/d22/d1c/d2f/d9a/fac x:0 0 0 2024-09-17T04:20:57.599 INFO:tasks.workunit.client.1.smithi134.stdout:9/936: mknod d2/d5/d37/d83/d12a/d54/c139 0 2024-09-17T04:20:57.601 INFO:tasks.workunit.client.1.smithi134.stdout:6/645: dread de/d19/d21/d4d/f6f [0,4194304] 0 2024-09-17T04:20:57.602 INFO:tasks.workunit.client.1.smithi134.stdout:8/489: fdatasync d4/db/dd/f16 0 2024-09-17T04:20:57.604 INFO:tasks.workunit.client.1.smithi134.stdout:2/529: sync 2024-09-17T04:20:57.606 INFO:tasks.workunit.client.1.smithi134.stdout:1/586: rename d12/d1c/d4a/fb7 to d12/d36/fc2 0 2024-09-17T04:20:57.607 INFO:tasks.workunit.client.1.smithi134.stdout:0/515: creat d11/d24/d49/d62/fad x:0 0 0 2024-09-17T04:20:57.607 INFO:tasks.workunit.client.1.smithi134.stdout:9/937: rmdir d2/d5/d9/d6a 39 2024-09-17T04:20:57.609 INFO:tasks.workunit.client.1.smithi134.stdout:8/490: creat d4/d1f/f97 x:0 0 0 2024-09-17T04:20:57.611 INFO:tasks.workunit.client.0.smithi088.stdout:2/216: dread d0/d1/f3 [0,4194304] 0 2024-09-17T04:20:57.612 INFO:tasks.workunit.client.0.smithi088.stdout:2/217: dread - d0/d14/d24/f2a zero size 2024-09-17T04:20:57.613 INFO:tasks.workunit.client.1.smithi134.stdout:2/530: fdatasync d19/d7e/f81 0 2024-09-17T04:20:57.616 INFO:tasks.workunit.client.1.smithi134.stdout:6/646: link de/d19/d62/f20 de/d19/d1f/d85/d88/fcb 0 2024-09-17T04:20:57.617 INFO:tasks.workunit.client.1.smithi134.stdout:4/598: dread d0/fa [0,4194304] 0 2024-09-17T04:20:57.617 INFO:tasks.workunit.client.1.smithi134.stdout:9/938: creat d2/d5/d37/d83/d12a/d54/daf/d6d/daa/de2/dcd/dd6/dff/f13a x:0 0 0 2024-09-17T04:20:57.619 INFO:tasks.workunit.client.1.smithi134.stdout:5/528: write d0/da/d69/d41/f4d [1188342,109093] 0 2024-09-17T04:20:57.619 INFO:tasks.workunit.client.1.smithi134.stdout:1/587: mknod d12/d19/d1d/cc3 0 2024-09-17T04:20:57.620 INFO:tasks.workunit.client.1.smithi134.stdout:5/529: write d0/d48/f80 [226385,22716] 0 2024-09-17T04:20:57.621 INFO:tasks.workunit.client.1.smithi134.stdout:1/588: rename d12 to d12/d19/d5d/d91/dac/dc4 22 2024-09-17T04:20:57.622 INFO:tasks.workunit.client.1.smithi134.stdout:5/530: chown d0/da/d29/c5d 12853 1 2024-09-17T04:20:57.624 INFO:tasks.workunit.client.1.smithi134.stdout:9/939: dwrite d2/d25/ff6 [0,4194304] 0 2024-09-17T04:20:57.627 INFO:tasks.workunit.client.1.smithi134.stdout:0/516: creat d11/d22/d1c/fae x:0 0 0 2024-09-17T04:20:57.628 INFO:tasks.workunit.client.1.smithi134.stdout:9/940: dread d2/d5/d9/df/d38/f99 [0,4194304] 0 2024-09-17T04:20:57.628 INFO:tasks.workunit.client.1.smithi134.stdout:9/941: readlink d2/d25/l35 0 2024-09-17T04:20:57.629 INFO:tasks.workunit.client.1.smithi134.stdout:4/599: mkdir d0/df/dc1 0 2024-09-17T04:20:57.629 INFO:tasks.workunit.client.1.smithi134.stdout:1/589: mknod d12/d19/d4f/cc5 0 2024-09-17T04:20:57.630 INFO:tasks.workunit.client.1.smithi134.stdout:9/942: read d2/d5/d9/d6b/de1/d126/f8e [560070,12334] 0 2024-09-17T04:20:57.635 INFO:tasks.workunit.client.1.smithi134.stdout:0/517: mkdir d11/d24/d49/d62/daf 0 2024-09-17T04:20:57.635 INFO:tasks.workunit.client.1.smithi134.stdout:1/590: dwrite d12/f90 [4194304,4194304] 0 2024-09-17T04:20:57.637 INFO:tasks.workunit.client.1.smithi134.stdout:3/638: write de/d12/f3a [1068669,59250] 0 2024-09-17T04:20:57.637 INFO:tasks.workunit.client.1.smithi134.stdout:4/600: mkdir d0/d13/d40/d42/d92/d65/dc2 0 2024-09-17T04:20:57.638 INFO:tasks.workunit.client.0.smithi088.stdout:9/211: truncate f1 213996 0 2024-09-17T04:20:57.639 INFO:tasks.workunit.client.1.smithi134.stdout:9/943: mknod d2/d5/d8/c13b 0 2024-09-17T04:20:57.639 INFO:tasks.workunit.client.1.smithi134.stdout:5/531: truncate d0/da/d2c/f37 2037196 0 2024-09-17T04:20:57.640 INFO:tasks.workunit.client.1.smithi134.stdout:2/531: link d19/l4a d19/d27/d31/d34/lad 0 2024-09-17T04:20:57.653 INFO:tasks.workunit.client.0.smithi088.stdout:9/212: getdents d2/dd/d11/d1d 0 2024-09-17T04:20:57.653 INFO:tasks.workunit.client.0.smithi088.stdout:9/213: rmdir d2/dd/d11 39 2024-09-17T04:20:57.660 INFO:tasks.workunit.client.0.smithi088.stdout:9/214: dread f1 [0,4194304] 0 2024-09-17T04:20:57.661 INFO:tasks.workunit.client.0.smithi088.stdout:9/215: dread - d2/d2b/f38 zero size 2024-09-17T04:20:57.662 INFO:tasks.workunit.client.1.smithi134.stdout:3/639: mkdir de/d12/d15/dd0 0 2024-09-17T04:20:57.662 INFO:tasks.workunit.client.1.smithi134.stdout:4/601: rename d0/d13/d40/d72/da7 to d0/d13/d40/d42/d92/dc3 0 2024-09-17T04:20:57.663 INFO:tasks.workunit.client.0.smithi088.stdout:9/216: symlink d2/l48 0 2024-09-17T04:20:57.664 INFO:tasks.workunit.client.1.smithi134.stdout:7/438: dwrite d0/d16/d8b/d6a/f6d [0,4194304] 0 2024-09-17T04:20:57.664 INFO:tasks.workunit.client.1.smithi134.stdout:2/532: mkdir d19/d1c/d47/dae 0 2024-09-17T04:20:57.665 INFO:tasks.workunit.client.1.smithi134.stdout:1/591: fdatasync d12/f42 0 2024-09-17T04:20:57.667 INFO:tasks.workunit.client.1.smithi134.stdout:1/592: fdatasync d12/d1c/f34 0 2024-09-17T04:20:57.670 INFO:tasks.workunit.client.1.smithi134.stdout:6/647: dwrite de/d19/f24 [0,4194304] 0 2024-09-17T04:20:57.671 INFO:tasks.workunit.client.0.smithi088.stdout:9/217: dwrite d2/dd/d11/f1e [4194304,4194304] 0 2024-09-17T04:20:57.678 INFO:tasks.workunit.client.1.smithi134.stdout:9/944: rename d2/d5/d8 to d2/d5/d9/df/d13c 0 2024-09-17T04:20:57.679 INFO:tasks.workunit.client.1.smithi134.stdout:2/533: symlink d19/d7e/laf 0 2024-09-17T04:20:57.752 INFO:tasks.workunit.client.1.smithi134.stdout:0/518: sync 2024-09-17T04:20:57.765 INFO:tasks.workunit.client.1.smithi134.stdout:0/519: dread d11/d4c/f92 [0,4194304] 0 2024-09-17T04:20:57.779 INFO:tasks.workunit.client.1.smithi134.stdout:1/593: sync 2024-09-17T04:20:57.779 INFO:tasks.workunit.client.1.smithi134.stdout:1/594: write d12/d19/d5c/d85/fbb [957712,125316] 0 2024-09-17T04:20:57.818 INFO:tasks.workunit.client.1.smithi134.stdout:4/602: creat d0/df/d35/d5c/d8b/fc4 x:0 0 0 2024-09-17T04:20:57.819 INFO:tasks.workunit.client.1.smithi134.stdout:3/640: creat de/d12/d15/d1d/d8f/d90/fd1 x:0 0 0 2024-09-17T04:20:57.822 INFO:tasks.workunit.client.1.smithi134.stdout:3/641: dread de/d12/d15/d1d/d2d/f36 [0,4194304] 0 2024-09-17T04:20:57.823 INFO:tasks.workunit.client.1.smithi134.stdout:6/648: stat de/d19/d62/c38 0 2024-09-17T04:20:57.825 INFO:tasks.workunit.client.1.smithi134.stdout:2/534: rename d19/d67 to d19/d27/d31/d49/d6f/da9/db0 0 2024-09-17T04:20:57.826 INFO:tasks.workunit.client.1.smithi134.stdout:2/535: chown d19/d7e/f81 2073504597 1 2024-09-17T04:20:57.827 INFO:tasks.workunit.client.1.smithi134.stdout:5/532: dwrite d0/da/f1e [0,4194304] 0 2024-09-17T04:20:57.830 INFO:tasks.workunit.client.1.smithi134.stdout:6/649: dread de/d19/d21/f7a [0,4194304] 0 2024-09-17T04:20:57.830 INFO:tasks.workunit.client.0.smithi088.stdout:9/218: write d2/dd/fe [872327,4472] 0 2024-09-17T04:20:57.831 INFO:tasks.workunit.client.1.smithi134.stdout:4/603: mkdir d0/d13/d40/d42/dc5 0 2024-09-17T04:20:57.835 INFO:tasks.workunit.client.0.smithi088.stdout:9/219: rename d2/dd/d11/d3b to d2/dd/d11/d30/d49 0 2024-09-17T04:20:57.839 INFO:tasks.workunit.client.1.smithi134.stdout:5/533: mkdir d0/da/d29/d7c/db3 0 2024-09-17T04:20:57.840 INFO:tasks.workunit.client.1.smithi134.stdout:0/520: creat d11/d24/d49/d62/daf/fb0 x:0 0 0 2024-09-17T04:20:57.842 INFO:tasks.workunit.client.1.smithi134.stdout:7/439: getdents d0/dd/d3a 0 2024-09-17T04:20:57.842 INFO:tasks.workunit.client.1.smithi134.stdout:8/491: link d4/d23/d60/d6b/d5e/l64 d4/d1f/d25/l98 0 2024-09-17T04:20:57.843 INFO:tasks.workunit.client.1.smithi134.stdout:7/440: write d0/dd/f58 [2965574,9312] 0 2024-09-17T04:20:57.844 INFO:tasks.workunit.client.1.smithi134.stdout:7/441: chown d0/dd/d3a/d3d/d38/f24 713586 1 2024-09-17T04:20:57.845 INFO:tasks.workunit.client.1.smithi134.stdout:1/595: link d12/d19/d1d/d61/f77 d12/d19/d66/fc6 0 2024-09-17T04:20:57.850 INFO:tasks.workunit.client.1.smithi134.stdout:5/534: rename d0/da/f1e to d0/da/d69/d41/d6d/d89/fb4 0 2024-09-17T04:20:57.850 INFO:tasks.workunit.client.1.smithi134.stdout:0/521: truncate d11/d18/f57 4640919 0 2024-09-17T04:20:57.850 INFO:tasks.workunit.client.1.smithi134.stdout:8/492: creat d4/db/dd/d95/f99 x:0 0 0 2024-09-17T04:20:57.852 INFO:tasks.workunit.client.1.smithi134.stdout:2/536: link d19/d27/d31/d49/d6f/d84/c90 d19/d27/d31/d49/cb1 0 2024-09-17T04:20:57.852 INFO:tasks.workunit.client.1.smithi134.stdout:9/945: truncate d2/d5/d9/f1c 579138 0 2024-09-17T04:20:57.853 INFO:tasks.workunit.client.1.smithi134.stdout:7/442: chown d0/dd/c28 94 1 2024-09-17T04:20:57.856 INFO:tasks.workunit.client.1.smithi134.stdout:1/596: mknod d12/d19/d5c/d85/cc7 0 2024-09-17T04:20:57.857 INFO:tasks.workunit.client.0.smithi088.stdout:9/220: dread d2/dd/d11/f25 [0,4194304] 0 2024-09-17T04:20:57.859 INFO:tasks.workunit.client.0.smithi088.stdout:9/221: chown d2/dd/d11/d1d/d35/l3a 328413323 1 2024-09-17T04:20:57.860 INFO:tasks.workunit.client.1.smithi134.stdout:8/493: truncate d4/fe 2492522 0 2024-09-17T04:20:57.860 INFO:tasks.workunit.client.1.smithi134.stdout:3/642: truncate de/d12/d15/d1d/d2d/d31/d6a/d83/fb7 2763657 0 2024-09-17T04:20:57.863 INFO:tasks.workunit.client.0.smithi088.stdout:1/168: sync 2024-09-17T04:20:57.865 INFO:tasks.workunit.client.1.smithi134.stdout:9/946: dread d2/d5/d37/d83/d12a/f72 [0,4194304] 0 2024-09-17T04:20:57.866 INFO:tasks.workunit.client.1.smithi134.stdout:1/597: dread d12/d19/d5d/d88/fbf [0,4194304] 0 2024-09-17T04:20:57.867 INFO:tasks.workunit.client.1.smithi134.stdout:1/598: dread - d12/d36/f9c zero size 2024-09-17T04:20:57.870 INFO:tasks.workunit.client.1.smithi134.stdout:0/522: mknod d11/d22/d1c/cb1 0 2024-09-17T04:20:57.871 INFO:tasks.workunit.client.1.smithi134.stdout:0/523: chown d11/d22/d1c 2100831 1 2024-09-17T04:20:57.872 INFO:tasks.workunit.client.1.smithi134.stdout:9/947: dwrite d2/d7/d75/d96/fbe [0,4194304] 0 2024-09-17T04:20:57.873 INFO:tasks.workunit.client.1.smithi134.stdout:3/643: rename de/d12/l2f to de/d12/d9d/ld2 0 2024-09-17T04:20:57.875 INFO:tasks.workunit.client.1.smithi134.stdout:7/443: unlink d0/dd/f2d 0 2024-09-17T04:20:57.876 INFO:tasks.workunit.client.1.smithi134.stdout:3/644: readlink de/d12/d15/d1d/d2d/l86 0 2024-09-17T04:20:57.876 INFO:tasks.workunit.client.1.smithi134.stdout:1/599: dwrite d12/d1c/f34 [0,4194304] 0 2024-09-17T04:20:57.877 INFO:tasks.workunit.client.0.smithi088.stdout:9/222: dread d2/dd/d11/d1d/f24 [0,4194304] 0 2024-09-17T04:20:57.878 INFO:tasks.workunit.client.0.smithi088.stdout:9/223: chown d2/dd/d11/d1d/d43 997 1 2024-09-17T04:20:57.883 INFO:tasks.workunit.client.0.smithi088.stdout:1/169: dread d0/d1/fd [0,4194304] 0 2024-09-17T04:20:57.887 INFO:tasks.workunit.client.1.smithi134.stdout:0/524: creat d11/d6f/da8/fb2 x:0 0 0 2024-09-17T04:20:57.890 INFO:tasks.workunit.client.0.smithi088.stdout:9/224: creat d2/dd/f4a x:0 0 0 2024-09-17T04:20:57.891 INFO:tasks.workunit.client.1.smithi134.stdout:2/537: dread d19/d27/f5b [0,4194304] 0 2024-09-17T04:20:57.891 INFO:tasks.workunit.client.1.smithi134.stdout:0/525: read d11/d19/f99 [3330890,53625] 0 2024-09-17T04:20:57.892 INFO:tasks.workunit.client.1.smithi134.stdout:1/600: symlink d12/d19/d5c/lc8 0 2024-09-17T04:20:57.894 INFO:tasks.workunit.client.1.smithi134.stdout:3/645: unlink de/d12/c3c 0 2024-09-17T04:20:57.894 INFO:tasks.workunit.client.0.smithi088.stdout:1/170: truncate d0/d1/f1a 2365765 0 2024-09-17T04:20:57.897 INFO:tasks.workunit.client.0.smithi088.stdout:9/225: dwrite d2/fc [0,4194304] 0 2024-09-17T04:20:57.899 INFO:tasks.workunit.client.1.smithi134.stdout:7/444: mknod d0/dd/c8e 0 2024-09-17T04:20:57.901 INFO:tasks.workunit.client.1.smithi134.stdout:9/948: creat d2/d5/d37/d83/d12a/d54/daf/d6d/daa/d104/f13d x:0 0 0 2024-09-17T04:20:57.901 INFO:tasks.workunit.client.1.smithi134.stdout:5/535: dwrite d0/d3a/d2b/d5a/f88 [0,4194304] 0 2024-09-17T04:20:57.902 INFO:tasks.workunit.client.0.smithi088.stdout:9/226: rmdir d2/dd/d11/d1d/d35 39 2024-09-17T04:20:57.902 INFO:tasks.workunit.client.1.smithi134.stdout:8/494: dwrite d4/d1f/f71 [0,4194304] 0 2024-09-17T04:20:57.906 INFO:tasks.workunit.client.0.smithi088.stdout:1/171: truncate d0/f4 3844561 0 2024-09-17T04:20:57.909 INFO:tasks.workunit.client.1.smithi134.stdout:1/601: unlink d12/d19/d1d/c47 0 2024-09-17T04:20:57.911 INFO:tasks.workunit.client.1.smithi134.stdout:2/538: rmdir d19/d27/d31/d49/d6f/d84 39 2024-09-17T04:20:57.917 INFO:tasks.workunit.client.0.smithi088.stdout:9/227: creat d2/dd/d11/f4b x:0 0 0 2024-09-17T04:20:57.919 INFO:tasks.workunit.client.1.smithi134.stdout:7/445: mknod d0/dd/d3a/c8f 0 2024-09-17T04:20:57.920 INFO:tasks.workunit.client.1.smithi134.stdout:5/536: rmdir d0/da/d29/d7c 39 2024-09-17T04:20:57.922 INFO:tasks.workunit.client.1.smithi134.stdout:1/602: rmdir d12/d19/d5d 39 2024-09-17T04:20:57.923 INFO:tasks.workunit.client.0.smithi088.stdout:9/228: creat d2/dd/f4c x:0 0 0 2024-09-17T04:20:57.924 INFO:tasks.workunit.client.1.smithi134.stdout:2/539: chown d19/d27/d31/l4f 12246 1 2024-09-17T04:20:57.924 INFO:tasks.workunit.client.1.smithi134.stdout:7/446: read d0/dd/d3a/d3d/d38/d74/f7f [1848305,64940] 0 2024-09-17T04:20:57.925 INFO:tasks.workunit.client.1.smithi134.stdout:9/949: unlink d2/d5/d9/df/d13c/d1e/f9c 0 2024-09-17T04:20:57.926 INFO:tasks.workunit.client.1.smithi134.stdout:5/537: unlink d0/d3a/d2b/f31 0 2024-09-17T04:20:57.926 INFO:tasks.workunit.client.0.smithi088.stdout:9/229: dread d2/dd/f1b [0,4194304] 0 2024-09-17T04:20:57.927 INFO:tasks.workunit.client.1.smithi134.stdout:6/650: sync 2024-09-17T04:20:57.927 INFO:tasks.workunit.client.1.smithi134.stdout:3/646: dread de/d12/d22/fcd [0,4194304] 0 2024-09-17T04:20:57.928 INFO:tasks.workunit.client.1.smithi134.stdout:0/526: link d11/d22/d1c/d2f/f55 d11/d22/d1c/d2f/fb3 0 2024-09-17T04:20:57.929 INFO:tasks.workunit.client.1.smithi134.stdout:6/651: write de/d2b/f50 [484161,75733] 0 2024-09-17T04:20:57.929 INFO:tasks.workunit.client.1.smithi134.stdout:1/603: dwrite d12/d1c/f24 [4194304,4194304] 0 2024-09-17T04:20:57.931 INFO:tasks.workunit.client.1.smithi134.stdout:0/527: write d11/d19/d21/d37/faa [918855,110551] 0 2024-09-17T04:20:57.933 INFO:tasks.workunit.client.0.smithi088.stdout:9/230: creat d2/dd/d11/d1d/f4d x:0 0 0 2024-09-17T04:20:57.944 INFO:tasks.workunit.client.0.smithi088.stdout:9/231: link d2/dd/l29 d2/l4e 0 2024-09-17T04:20:57.950 INFO:tasks.workunit.client.0.smithi088.stdout:9/232: dwrite d2/dd/d11/d1d/f37 [0,4194304] 0 2024-09-17T04:20:57.952 INFO:tasks.workunit.client.0.smithi088.stdout:9/233: write d2/dd/d11/d1d/f4d [612748,3600] 0 2024-09-17T04:20:57.956 INFO:tasks.workunit.client.0.smithi088.stdout:9/234: mkdir d2/dd/d11/d4f 0 2024-09-17T04:20:57.963 INFO:tasks.workunit.client.0.smithi088.stdout:9/235: dwrite d2/dd/f15 [0,4194304] 0 2024-09-17T04:20:57.969 INFO:tasks.workunit.client.0.smithi088.stdout:9/236: dwrite d2/dd/f15 [0,4194304] 0 2024-09-17T04:20:57.973 INFO:tasks.workunit.client.0.smithi088.stdout:9/237: unlink d2/dd/d11/l13 0 2024-09-17T04:20:57.974 INFO:tasks.workunit.client.1.smithi134.stdout:2/540: creat d19/d1c/d47/d50/d85/fb2 x:0 0 0 2024-09-17T04:20:57.975 INFO:tasks.workunit.client.0.smithi088.stdout:9/238: chown d2/dd/d11/d1d/d35 17197 1 2024-09-17T04:20:57.976 INFO:tasks.workunit.client.1.smithi134.stdout:9/950: truncate d2/d5/d9/d6a/f12d 618295 0 2024-09-17T04:20:57.977 INFO:tasks.workunit.client.1.smithi134.stdout:1/604: fsync d12/d19/d5d/faa 0 2024-09-17T04:20:57.978 INFO:tasks.workunit.client.1.smithi134.stdout:1/605: readlink d12/l2c 0 2024-09-17T04:20:57.979 INFO:tasks.workunit.client.1.smithi134.stdout:3/647: dread de/d12/d22/d5a/f71 [0,4194304] 0 2024-09-17T04:20:57.979 INFO:tasks.workunit.client.1.smithi134.stdout:0/528: write d11/d19/d21/d37/f4b [5696230,111708] 0 2024-09-17T04:20:57.979 INFO:tasks.workunit.client.1.smithi134.stdout:1/606: chown d12/d36/da1 86249235 1 2024-09-17T04:20:57.981 INFO:tasks.workunit.client.0.smithi088.stdout:9/239: creat d2/f50 x:0 0 0 2024-09-17T04:20:57.981 INFO:tasks.workunit.client.1.smithi134.stdout:3/648: chown de/d10/d3d/f43 64309 1 2024-09-17T04:20:57.981 INFO:tasks.workunit.client.1.smithi134.stdout:7/447: creat d0/d16/d35/d4b/d8a/f90 x:0 0 0 2024-09-17T04:20:57.982 INFO:tasks.workunit.client.1.smithi134.stdout:7/448: chown d0/f55 79372 1 2024-09-17T04:20:57.982 INFO:tasks.workunit.client.1.smithi134.stdout:9/951: fdatasync d2/d5/d37/d83/ff2 0 2024-09-17T04:20:57.983 INFO:tasks.workunit.client.1.smithi134.stdout:9/952: fdatasync d2/d25/ff6 0 2024-09-17T04:20:57.984 INFO:tasks.workunit.client.1.smithi134.stdout:0/529: creat d11/d6f/fb4 x:0 0 0 2024-09-17T04:20:57.986 INFO:tasks.workunit.client.1.smithi134.stdout:9/953: truncate d2/d5/d37/d83/d12a/d54/daf/d6d/daa/de2/dcf/ff5 615477 0 2024-09-17T04:20:57.987 INFO:tasks.workunit.client.1.smithi134.stdout:8/495: dread f3 [0,4194304] 0 2024-09-17T04:20:57.987 INFO:tasks.workunit.client.1.smithi134.stdout:6/652: creat de/d19/d74/fcc x:0 0 0 2024-09-17T04:20:57.988 INFO:tasks.workunit.client.1.smithi134.stdout:9/954: read d2/d25/ff6 [662012,9776] 0 2024-09-17T04:20:57.990 INFO:tasks.workunit.client.1.smithi134.stdout:8/496: dread d4/f57 [0,4194304] 0 2024-09-17T04:20:57.990 INFO:tasks.workunit.client.1.smithi134.stdout:3/649: chown de/d12/d9d/ld2 3164 1 2024-09-17T04:20:57.991 INFO:tasks.workunit.client.1.smithi134.stdout:8/497: read d4/d23/d60/d6b/f35 [1935245,19509] 0 2024-09-17T04:20:57.992 INFO:tasks.workunit.client.1.smithi134.stdout:8/498: chown d4/f57 33 1 2024-09-17T04:20:57.995 INFO:tasks.workunit.client.1.smithi134.stdout:2/541: write d19/f76 [2549366,16693] 0 2024-09-17T04:20:58.001 INFO:tasks.workunit.client.1.smithi134.stdout:9/955: chown d2/d5/d9/df/d80/cbc 16 1 2024-09-17T04:20:58.003 INFO:tasks.workunit.client.1.smithi134.stdout:3/650: symlink de/d12/d9d/ld3 0 2024-09-17T04:20:58.003 INFO:tasks.workunit.client.1.smithi134.stdout:4/604: sync 2024-09-17T04:20:58.003 INFO:tasks.workunit.client.1.smithi134.stdout:8/499: truncate f3 84547 0 2024-09-17T04:20:58.004 INFO:tasks.workunit.client.1.smithi134.stdout:7/449: mknod d0/c91 0 2024-09-17T04:20:58.005 INFO:tasks.workunit.client.1.smithi134.stdout:2/542: rmdir d19/d27/d31 39 2024-09-17T04:20:58.009 INFO:tasks.workunit.client.1.smithi134.stdout:9/956: write d2/d5/d58/ff1 [5836308,41976] 0 2024-09-17T04:20:58.011 INFO:tasks.workunit.client.0.smithi088.stdout:9/240: truncate d2/f3 5273102 0 2024-09-17T04:20:58.011 INFO:tasks.workunit.client.1.smithi134.stdout:8/500: symlink d4/d1e/l9a 0 2024-09-17T04:20:58.014 INFO:tasks.workunit.client.1.smithi134.stdout:7/450: dwrite d0/d16/d35/d4b/f69 [0,4194304] 0 2024-09-17T04:20:58.014 INFO:tasks.workunit.client.1.smithi134.stdout:3/651: unlink de/d10/f30 0 2024-09-17T04:20:58.016 INFO:tasks.workunit.client.1.smithi134.stdout:2/543: dwrite d19/d1c/f52 [0,4194304] 0 2024-09-17T04:20:58.016 INFO:tasks.workunit.client.1.smithi134.stdout:1/607: dwrite d12/d19/d5d/f95 [0,4194304] 0 2024-09-17T04:20:58.017 INFO:tasks.workunit.client.1.smithi134.stdout:3/652: chown de/d10/f64 342897957 1 2024-09-17T04:20:58.018 INFO:tasks.workunit.client.1.smithi134.stdout:6/653: write de/d2b/f70 [242540,89274] 0 2024-09-17T04:20:58.020 INFO:tasks.workunit.client.1.smithi134.stdout:9/957: mkdir d2/d78/d13e 0 2024-09-17T04:20:58.026 INFO:tasks.workunit.client.1.smithi134.stdout:1/608: dwrite d12/d19/d5d/d91/dac/fba [0,4194304] 0 2024-09-17T04:20:58.030 INFO:tasks.workunit.client.1.smithi134.stdout:3/653: unlink de/f41 0 2024-09-17T04:20:58.035 INFO:tasks.workunit.client.0.smithi088.stdout:9/241: mkdir d2/dd/d11/d1d/d43/d51 0 2024-09-17T04:20:58.037 INFO:tasks.workunit.client.1.smithi134.stdout:9/958: mkdir d2/d7/d13f 0 2024-09-17T04:20:58.039 INFO:tasks.workunit.client.1.smithi134.stdout:4/605: truncate d0/f22 2634787 0 2024-09-17T04:20:58.043 INFO:tasks.workunit.client.0.smithi088.stdout:9/242: symlink d2/d2b/l52 0 2024-09-17T04:20:58.044 INFO:tasks.workunit.client.1.smithi134.stdout:2/544: symlink d19/d27/d31/d34/d6d/lb3 0 2024-09-17T04:20:58.045 INFO:tasks.workunit.client.1.smithi134.stdout:3/654: mkdir de/d12/d9d/dd4 0 2024-09-17T04:20:58.054 INFO:tasks.workunit.client.1.smithi134.stdout:3/655: dread de/d12/d15/d1d/f62 [0,4194304] 0 2024-09-17T04:20:58.054 INFO:tasks.workunit.client.1.smithi134.stdout:5/538: sync 2024-09-17T04:20:58.056 INFO:tasks.workunit.client.1.smithi134.stdout:6/654: dread fd [0,4194304] 0 2024-09-17T04:20:58.059 INFO:tasks.workunit.client.1.smithi134.stdout:9/959: dread d2/d5/d37/d83/d12a/d54/daf/d6d/daa/de2/fea [0,4194304] 0 2024-09-17T04:20:58.061 INFO:tasks.workunit.client.1.smithi134.stdout:5/539: dwrite d0/da/d2c/f9d [0,4194304] 0 2024-09-17T04:20:58.062 INFO:tasks.workunit.client.1.smithi134.stdout:2/545: dread d19/d1c/d47/d50/d85/f9b [0,4194304] 0 2024-09-17T04:20:58.066 INFO:tasks.workunit.client.1.smithi134.stdout:6/655: dwrite de/d19/d1f/d55/d77/f95 [0,4194304] 0 2024-09-17T04:20:58.067 INFO:tasks.workunit.client.1.smithi134.stdout:6/656: chown de/d19/d1f/d85/fa7 16 1 2024-09-17T04:20:58.069 INFO:tasks.workunit.client.1.smithi134.stdout:6/657: dread - de/d19/da3/fb6 zero size 2024-09-17T04:20:58.070 INFO:tasks.workunit.client.1.smithi134.stdout:5/540: dwrite d0/d3a/fa9 [0,4194304] 0 2024-09-17T04:20:58.079 INFO:tasks.workunit.client.1.smithi134.stdout:0/530: sync 2024-09-17T04:20:58.103 INFO:tasks.workunit.client.1.smithi134.stdout:1/609: rename d12/d1c/d2e/f50 to d12/d1c/d2e/d7d/fc9 0 2024-09-17T04:20:58.104 INFO:tasks.workunit.client.1.smithi134.stdout:1/610: write d12/d1c/f34 [2575500,13869] 0 2024-09-17T04:20:58.104 INFO:tasks.workunit.client.1.smithi134.stdout:3/656: unlink de/d12/d15/d9f/lc9 0 2024-09-17T04:20:58.105 INFO:tasks.workunit.client.1.smithi134.stdout:3/657: chown de/l38 160763 1 2024-09-17T04:20:58.107 INFO:tasks.workunit.client.1.smithi134.stdout:3/658: dread - de/d12/d15/d1d/d2d/d31/d6a/d78/d7c/fcf zero size 2024-09-17T04:20:58.110 INFO:tasks.workunit.client.1.smithi134.stdout:8/501: truncate d4/f36 1316137 0 2024-09-17T04:20:58.112 INFO:tasks.workunit.client.1.smithi134.stdout:5/541: unlink d0/d3a/d2b/d5a/f5e 0 2024-09-17T04:20:58.112 INFO:tasks.workunit.client.1.smithi134.stdout:7/451: write d0/dd/d3a/d3d/f56 [270858,673] 0 2024-09-17T04:20:58.114 INFO:tasks.workunit.client.1.smithi134.stdout:4/606: rename d0/df/d35/d5c/f94 to d0/df/d1e/dbc/fc6 0 2024-09-17T04:20:58.115 INFO:tasks.workunit.client.1.smithi134.stdout:7/452: write d0/dd/d3a/d3d/d38/f23 [3274832,41911] 0 2024-09-17T04:20:58.116 INFO:tasks.workunit.client.1.smithi134.stdout:2/546: mknod d19/d1c/da3/cb4 0 2024-09-17T04:20:58.116 INFO:tasks.workunit.client.1.smithi134.stdout:4/607: write d0/d3b/f52 [4349368,888] 0 2024-09-17T04:20:58.117 INFO:tasks.workunit.client.1.smithi134.stdout:3/659: symlink de/d10/d70/ld5 0 2024-09-17T04:20:58.117 INFO:tasks.workunit.client.1.smithi134.stdout:7/453: stat d0/dd/f54 0 2024-09-17T04:20:58.118 INFO:tasks.workunit.client.1.smithi134.stdout:1/611: dread d12/d1c/f2f [0,4194304] 0 2024-09-17T04:20:58.118 INFO:tasks.workunit.client.1.smithi134.stdout:7/454: chown d0/d16/d35 1 1 2024-09-17T04:20:58.119 INFO:tasks.workunit.client.1.smithi134.stdout:0/531: mknod d11/d19/cb5 0 2024-09-17T04:20:58.122 INFO:tasks.workunit.client.1.smithi134.stdout:9/960: rename d2/d5/d37/c39 to d2/d5/d37/d83/d12a/df3/c140 0 2024-09-17T04:20:58.125 INFO:tasks.workunit.client.1.smithi134.stdout:2/547: unlink fc 0 2024-09-17T04:20:58.126 INFO:tasks.workunit.client.1.smithi134.stdout:4/608: write d0/fa [1862185,57994] 0 2024-09-17T04:20:58.126 INFO:tasks.workunit.client.1.smithi134.stdout:6/658: link de/d19/d21/d4d/f6f de/d19/d21/d4d/fcd 0 2024-09-17T04:20:58.127 INFO:tasks.workunit.client.1.smithi134.stdout:5/542: mkdir d0/da/d29/db5 0 2024-09-17T04:20:58.127 INFO:tasks.workunit.client.1.smithi134.stdout:6/659: dread - de/d19/d62/d34/d3b/fc0 zero size 2024-09-17T04:20:58.128 INFO:tasks.workunit.client.1.smithi134.stdout:3/660: creat de/d12/d15/d9f/dba/fd6 x:0 0 0 2024-09-17T04:20:58.131 INFO:tasks.workunit.client.1.smithi134.stdout:9/961: creat d2/d5/d37/d3f/f141 x:0 0 0 2024-09-17T04:20:58.131 INFO:tasks.workunit.client.1.smithi134.stdout:9/962: chown d2/d5/d9/d6a/l10d 55 1 2024-09-17T04:20:58.132 INFO:tasks.workunit.client.1.smithi134.stdout:9/963: dread - d2/d7/d75/d96/f131 zero size 2024-09-17T04:20:58.132 INFO:tasks.workunit.client.1.smithi134.stdout:2/548: creat d19/d27/d31/d34/d6d/fb5 x:0 0 0 2024-09-17T04:20:58.133 INFO:tasks.workunit.client.1.smithi134.stdout:2/549: chown d19/d27/d31/l4f 373 1 2024-09-17T04:20:58.133 INFO:tasks.workunit.client.1.smithi134.stdout:2/550: fsync d19/d27/f32 0 2024-09-17T04:20:58.135 INFO:tasks.workunit.client.1.smithi134.stdout:5/543: unlink d0/da/d69/f53 0 2024-09-17T04:20:58.136 INFO:tasks.workunit.client.1.smithi134.stdout:6/660: mkdir de/d19/d62/d34/d3b/dce 0 2024-09-17T04:20:58.136 INFO:tasks.workunit.client.1.smithi134.stdout:5/544: fdatasync d0/da/d29/f4e 0 2024-09-17T04:20:58.136 INFO:tasks.workunit.client.1.smithi134.stdout:3/661: creat de/d67/fd7 x:0 0 0 2024-09-17T04:20:58.137 INFO:tasks.workunit.client.1.smithi134.stdout:5/545: readlink d0/da/d69/l27 0 2024-09-17T04:20:58.137 INFO:tasks.workunit.client.1.smithi134.stdout:6/661: write de/d2b/fa0 [276695,71861] 0 2024-09-17T04:20:58.137 INFO:tasks.workunit.client.1.smithi134.stdout:2/551: dread d19/d27/d31/d49/d63/d94/f7d [0,4194304] 0 2024-09-17T04:20:58.138 INFO:tasks.workunit.client.1.smithi134.stdout:7/455: symlink d0/d16/d35/d4b/l92 0 2024-09-17T04:20:58.138 INFO:tasks.workunit.client.1.smithi134.stdout:3/662: chown de/d10/f8c 185 1 2024-09-17T04:20:58.140 INFO:tasks.workunit.client.1.smithi134.stdout:5/546: read d0/d3a/d2b/f62 [2682632,119319] 0 2024-09-17T04:20:58.141 INFO:tasks.workunit.client.1.smithi134.stdout:9/964: mknod d2/d5/d9/df/d13c/d1e/c142 0 2024-09-17T04:20:58.147 INFO:tasks.workunit.client.1.smithi134.stdout:4/609: write d0/df/d35/d39/f7c [1798553,36467] 0 2024-09-17T04:20:58.148 INFO:tasks.workunit.client.1.smithi134.stdout:0/532: link d11/d19/d21/c3c d11/d24/d49/cb6 0 2024-09-17T04:20:58.151 INFO:tasks.workunit.client.1.smithi134.stdout:9/965: creat d2/d5/d37/d83/d12a/f143 x:0 0 0 2024-09-17T04:20:58.151 INFO:tasks.workunit.client.1.smithi134.stdout:7/456: dread d0/dd/d3a/d3d/d38/d74/f7f [0,4194304] 0 2024-09-17T04:20:58.153 INFO:tasks.workunit.client.1.smithi134.stdout:1/612: truncate d12/d19/d1d/f9f 1424803 0 2024-09-17T04:20:58.155 INFO:tasks.workunit.client.1.smithi134.stdout:0/533: dwrite d11/d4c/d76/f9e [0,4194304] 0 2024-09-17T04:20:58.157 INFO:tasks.workunit.client.1.smithi134.stdout:5/547: dread d0/d3a/d2b/f58 [0,4194304] 0 2024-09-17T04:20:58.157 INFO:tasks.workunit.client.1.smithi134.stdout:4/610: mkdir d0/df/d1e/d73/dc7 0 2024-09-17T04:20:58.159 INFO:tasks.workunit.client.1.smithi134.stdout:3/663: write de/f3b [847429,433] 0 2024-09-17T04:20:58.161 INFO:tasks.workunit.client.1.smithi134.stdout:1/613: mknod d12/d19/d5d/d91/dac/cca 0 2024-09-17T04:20:58.164 INFO:tasks.workunit.client.1.smithi134.stdout:5/548: dwrite d0/d3a/d2b/faf [0,4194304] 0 2024-09-17T04:20:58.167 INFO:tasks.workunit.client.1.smithi134.stdout:4/611: unlink d0/d13/d40/d42/d92/f80 0 2024-09-17T04:20:58.167 INFO:tasks.workunit.client.1.smithi134.stdout:6/662: write de/d19/d21/d4d/fcd [135921,111324] 0 2024-09-17T04:20:58.169 INFO:tasks.workunit.client.1.smithi134.stdout:7/457: creat d0/d16/d8b/d6a/d70/d85/f93 x:0 0 0 2024-09-17T04:20:58.171 INFO:tasks.workunit.client.1.smithi134.stdout:3/664: unlink de/d10/d3d/d4f/l9b 0 2024-09-17T04:20:58.172 INFO:tasks.workunit.client.1.smithi134.stdout:0/534: symlink d11/d24/d49/d9b/lb7 0 2024-09-17T04:20:58.173 INFO:tasks.workunit.client.1.smithi134.stdout:3/665: fsync de/d12/d22/d5a/f5d 0 2024-09-17T04:20:58.178 INFO:tasks.workunit.client.1.smithi134.stdout:6/663: rmdir de/d5d 39 2024-09-17T04:20:58.178 INFO:tasks.workunit.client.1.smithi134.stdout:7/458: dwrite d0/dd/d3a/d3d/d38/f24 [0,4194304] 0 2024-09-17T04:20:58.179 INFO:tasks.workunit.client.1.smithi134.stdout:6/664: dread - de/d19/d21/d2d/f5b zero size 2024-09-17T04:20:58.180 INFO:tasks.workunit.client.1.smithi134.stdout:9/966: link d2/d7/d75/ld8 d2/d5/l144 0 2024-09-17T04:20:58.182 INFO:tasks.workunit.client.1.smithi134.stdout:3/666: mkdir de/d12/d15/d1d/d2d/d31/d6a/d83/dd8 0 2024-09-17T04:20:58.183 INFO:tasks.workunit.client.1.smithi134.stdout:5/549: mkdir d0/da/d69/d41/db6 0 2024-09-17T04:20:58.186 INFO:tasks.workunit.client.1.smithi134.stdout:9/967: mknod d2/d5/d37/d83/d12a/d54/daf/d6d/daa/d104/c145 0 2024-09-17T04:20:58.186 INFO:tasks.workunit.client.1.smithi134.stdout:1/614: dread d12/d1c/f24 [0,4194304] 0 2024-09-17T04:20:58.188 INFO:tasks.workunit.client.1.smithi134.stdout:6/665: creat de/d19/d1f/dae/fcf x:0 0 0 2024-09-17T04:20:58.189 INFO:tasks.workunit.client.1.smithi134.stdout:3/667: truncate de/d12/d15/f4b 907399 0 2024-09-17T04:20:58.190 INFO:tasks.workunit.client.1.smithi134.stdout:5/550: mknod d0/da/d69/cb7 0 2024-09-17T04:20:58.191 INFO:tasks.workunit.client.1.smithi134.stdout:1/615: mkdir d12/d19/d1d/d3e/dcb 0 2024-09-17T04:20:58.191 INFO:tasks.workunit.client.1.smithi134.stdout:6/666: symlink de/d19/d74/d98/ld0 0 2024-09-17T04:20:58.191 INFO:tasks.workunit.client.1.smithi134.stdout:5/551: write d0/da/d69/d41/d6d/f7f [334646,123084] 0 2024-09-17T04:20:58.192 INFO:tasks.workunit.client.1.smithi134.stdout:7/459: getdents d0/d16/d35/d4b 0 2024-09-17T04:20:58.192 INFO:tasks.workunit.client.1.smithi134.stdout:9/968: symlink d2/d5/d58/db5/d112/l146 0 2024-09-17T04:20:58.194 INFO:tasks.workunit.client.1.smithi134.stdout:7/460: write d0/f15 [4777651,306] 0 2024-09-17T04:20:58.198 INFO:tasks.workunit.client.1.smithi134.stdout:3/668: rename de/d12/d15/d1d/d2d/d63/d77 to de/d10/d3d/dd9 0 2024-09-17T04:20:58.201 INFO:tasks.workunit.client.1.smithi134.stdout:1/616: dwrite d12/d1c/d2e/d7d/fc9 [4194304,4194304] 0 2024-09-17T04:20:58.202 INFO:tasks.workunit.client.1.smithi134.stdout:6/667: getdents de/d19/d1f 0 2024-09-17T04:20:58.203 INFO:tasks.workunit.client.1.smithi134.stdout:5/552: getdents d0/d3a/d6b/d9c/dad 0 2024-09-17T04:20:58.204 INFO:tasks.workunit.client.1.smithi134.stdout:8/502: sync 2024-09-17T04:20:58.206 INFO:tasks.workunit.client.1.smithi134.stdout:1/617: fdatasync d12/d19/f54 0 2024-09-17T04:20:58.207 INFO:tasks.workunit.client.1.smithi134.stdout:6/668: dread de/d19/d1f/f26 [0,4194304] 0 2024-09-17T04:20:58.207 INFO:tasks.workunit.client.1.smithi134.stdout:8/503: creat d4/d1e/f9b x:0 0 0 2024-09-17T04:20:58.208 INFO:tasks.workunit.client.1.smithi134.stdout:5/553: creat d0/da/d69/d41/d6d/fb8 x:0 0 0 2024-09-17T04:20:58.208 INFO:tasks.workunit.client.1.smithi134.stdout:4/612: dread d0/df/f4e [0,4194304] 0 2024-09-17T04:20:58.208 INFO:tasks.workunit.client.1.smithi134.stdout:3/669: write de/f2a [3999563,111908] 0 2024-09-17T04:20:58.211 INFO:tasks.workunit.client.1.smithi134.stdout:8/504: fsync d4/d1f/d25/d6a/f85 0 2024-09-17T04:20:58.211 INFO:tasks.workunit.client.1.smithi134.stdout:5/554: readlink d0/da/d2c/l3e 0 2024-09-17T04:20:58.211 INFO:tasks.workunit.client.1.smithi134.stdout:1/618: mkdir d12/dcc 0 2024-09-17T04:20:58.212 INFO:tasks.workunit.client.1.smithi134.stdout:6/669: fsync de/d19/d1f/d85/d88/fcb 0 2024-09-17T04:20:58.215 INFO:tasks.workunit.client.1.smithi134.stdout:9/969: dwrite d2/d5/d37/d83/ff2 [0,4194304] 0 2024-09-17T04:20:58.218 INFO:tasks.workunit.client.1.smithi134.stdout:5/555: creat d0/da/d29/d8e/fb9 x:0 0 0 2024-09-17T04:20:58.220 INFO:tasks.workunit.client.1.smithi134.stdout:4/613: rename d0/df/d35/f89 to d0/d13/d40/d42/d92/d7b/fc8 0 2024-09-17T04:20:58.221 INFO:tasks.workunit.client.1.smithi134.stdout:3/670: dwrite de/f3b [0,4194304] 0 2024-09-17T04:20:58.221 INFO:tasks.workunit.client.1.smithi134.stdout:6/670: dread de/d19/d21/d4d/f6f [0,4194304] 0 2024-09-17T04:20:58.223 INFO:tasks.workunit.client.1.smithi134.stdout:8/505: dread d4/d1f/f67 [0,4194304] 0 2024-09-17T04:20:58.223 INFO:tasks.workunit.client.1.smithi134.stdout:1/619: link d12/db2/fc1 d12/d36/fcd 0 2024-09-17T04:20:58.224 INFO:tasks.workunit.client.1.smithi134.stdout:5/556: fdatasync d0/d3a/d2b/d61/d7b/fae 0 2024-09-17T04:20:58.225 INFO:tasks.workunit.client.1.smithi134.stdout:3/671: chown de/d10/d3d/f43 3 1 2024-09-17T04:20:58.227 INFO:tasks.workunit.client.1.smithi134.stdout:3/672: fdatasync de/d10/f97 0 2024-09-17T04:20:58.228 INFO:tasks.workunit.client.1.smithi134.stdout:9/970: creat d2/d5/f147 x:0 0 0 2024-09-17T04:20:58.229 INFO:tasks.workunit.client.1.smithi134.stdout:5/557: mknod d0/d3a/d6b/cba 0 2024-09-17T04:20:58.232 INFO:tasks.workunit.client.1.smithi134.stdout:1/620: creat d12/d1c/d2e/d7d/fce x:0 0 0 2024-09-17T04:20:58.234 INFO:tasks.workunit.client.1.smithi134.stdout:4/614: dwrite d0/df/d35/d5c/f6b [0,4194304] 0 2024-09-17T04:20:58.236 INFO:tasks.workunit.client.1.smithi134.stdout:1/621: write d12/f14 [4982079,66124] 0 2024-09-17T04:20:58.237 INFO:tasks.workunit.client.0.smithi088.stdout:8/143: sync 2024-09-17T04:20:58.237 INFO:tasks.workunit.client.0.smithi088.stdout:7/219: sync 2024-09-17T04:20:58.237 INFO:tasks.workunit.client.0.smithi088.stdout:4/217: sync 2024-09-17T04:20:58.237 INFO:tasks.workunit.client.0.smithi088.stdout:6/188: sync 2024-09-17T04:20:58.238 INFO:tasks.workunit.client.0.smithi088.stdout:4/218: chown d5/d3f 87913 1 2024-09-17T04:20:58.240 INFO:tasks.workunit.client.1.smithi134.stdout:6/671: truncate de/d2b/f70 3048115 0 2024-09-17T04:20:58.240 INFO:tasks.workunit.client.1.smithi134.stdout:8/506: dwrite d4/d23/f6d [0,4194304] 0 2024-09-17T04:20:58.242 INFO:tasks.workunit.client.0.smithi088.stdout:6/189: symlink d14/d44/l4c 0 2024-09-17T04:20:58.243 INFO:tasks.workunit.client.1.smithi134.stdout:9/971: dwrite d2/d5/d9/d6b/de1/d126/ffa [0,4194304] 0 2024-09-17T04:20:58.243 INFO:tasks.workunit.client.0.smithi088.stdout:6/190: fdatasync f4 0 2024-09-17T04:20:58.246 INFO:tasks.workunit.client.1.smithi134.stdout:4/615: mkdir d0/d13/d40/d42/d92/d7b/dc9 0 2024-09-17T04:20:58.246 INFO:tasks.workunit.client.0.smithi088.stdout:4/219: dread d5/d3f/f33 [0,4194304] 0 2024-09-17T04:20:58.247 INFO:tasks.workunit.client.0.smithi088.stdout:7/220: dwrite d2/d1e/f3b [0,4194304] 0 2024-09-17T04:20:58.251 INFO:tasks.workunit.client.1.smithi134.stdout:9/972: creat d2/d5/d9/df/d13c/f148 x:0 0 0 2024-09-17T04:20:58.252 INFO:tasks.workunit.client.1.smithi134.stdout:6/672: dwrite de/d19/d74/d94/d9e/fac [0,4194304] 0 2024-09-17T04:20:58.252 INFO:tasks.workunit.client.1.smithi134.stdout:1/622: mknod d12/d19/d1d/d61/da0/da4/ccf 0 2024-09-17T04:20:58.253 INFO:tasks.workunit.client.1.smithi134.stdout:3/673: dread de/d12/fb1 [0,4194304] 0 2024-09-17T04:20:58.257 INFO:tasks.workunit.client.0.smithi088.stdout:8/144: link d7/dd/f15 d7/d29/d2a/f33 0 2024-09-17T04:20:58.259 INFO:tasks.workunit.client.1.smithi134.stdout:8/507: symlink d4/db/dd/d43/d8b/d8e/l9c 0 2024-09-17T04:20:58.259 INFO:tasks.workunit.client.0.smithi088.stdout:6/191: mkdir d14/d44/d45/d4d 0 2024-09-17T04:20:58.260 INFO:tasks.workunit.client.1.smithi134.stdout:3/674: dwrite de/d10/f5f [0,4194304] 0 2024-09-17T04:20:58.261 INFO:tasks.workunit.client.1.smithi134.stdout:8/508: dread - d4/d1f/d25/f75 zero size 2024-09-17T04:20:58.261 INFO:tasks.workunit.client.1.smithi134.stdout:8/509: readlink d4/d1e/l9a 0 2024-09-17T04:20:58.262 INFO:tasks.workunit.client.1.smithi134.stdout:4/616: unlink d0/df/d35/d5c/f6b 0 2024-09-17T04:20:58.263 INFO:tasks.workunit.client.0.smithi088.stdout:7/221: creat d2/d1e/f4a x:0 0 0 2024-09-17T04:20:58.265 INFO:tasks.workunit.client.0.smithi088.stdout:4/220: mknod d5/d3d/c43 0 2024-09-17T04:20:58.266 INFO:tasks.workunit.client.0.smithi088.stdout:7/222: write d2/d4/d7/f2a [1005452,110293] 0 2024-09-17T04:20:58.266 INFO:tasks.workunit.client.0.smithi088.stdout:8/145: dwrite d7/dd/fe [0,4194304] 0 2024-09-17T04:20:58.269 INFO:tasks.workunit.client.0.smithi088.stdout:8/146: chown d7/dd/f1a 1408487205 1 2024-09-17T04:20:58.271 INFO:tasks.workunit.client.0.smithi088.stdout:6/192: chown d14/d15/c1d 13026 1 2024-09-17T04:20:58.273 INFO:tasks.workunit.client.1.smithi134.stdout:2/552: sync 2024-09-17T04:20:58.273 INFO:tasks.workunit.client.0.smithi088.stdout:4/221: dread d5/f1a [0,4194304] 0 2024-09-17T04:20:58.275 INFO:tasks.workunit.client.0.smithi088.stdout:8/147: rename d7/c2d to d7/dd/d31/c34 0 2024-09-17T04:20:58.276 INFO:tasks.workunit.client.1.smithi134.stdout:6/673: symlink de/d19/d21/ld1 0 2024-09-17T04:20:58.277 INFO:tasks.workunit.client.0.smithi088.stdout:6/193: symlink d14/d2f/l4e 0 2024-09-17T04:20:58.282 INFO:tasks.workunit.client.0.smithi088.stdout:4/222: rename d5/f2f to d5/d32/f44 0 2024-09-17T04:20:58.283 INFO:tasks.workunit.client.1.smithi134.stdout:8/510: mkdir d4/db/d6e/d9d 0 2024-09-17T04:20:58.284 INFO:tasks.workunit.client.0.smithi088.stdout:8/148: dwrite d7/d29/f12 [8388608,4194304] 0 2024-09-17T04:20:58.286 INFO:tasks.workunit.client.1.smithi134.stdout:6/674: unlink de/d19/d62/d34/f72 0 2024-09-17T04:20:58.287 INFO:tasks.workunit.client.0.smithi088.stdout:6/194: rmdir d14/d44 39 2024-09-17T04:20:58.289 INFO:tasks.workunit.client.1.smithi134.stdout:4/617: mknod d0/df/d1e/d73/dc7/cca 0 2024-09-17T04:20:58.291 INFO:tasks.workunit.client.1.smithi134.stdout:8/511: creat d4/d23/d60/d6b/d5e/f9e x:0 0 0 2024-09-17T04:20:58.293 INFO:tasks.workunit.client.0.smithi088.stdout:4/223: symlink d5/l45 0 2024-09-17T04:20:58.293 INFO:tasks.workunit.client.1.smithi134.stdout:8/512: dread - d4/d23/f84 zero size 2024-09-17T04:20:58.295 INFO:tasks.workunit.client.0.smithi088.stdout:4/224: rename d5/c1b to d5/d32/c46 0 2024-09-17T04:20:58.296 INFO:tasks.workunit.client.1.smithi134.stdout:4/618: dwrite d0/d13/f8d [4194304,4194304] 0 2024-09-17T04:20:58.296 INFO:tasks.workunit.client.0.smithi088.stdout:4/225: chown d5/l24 5463355 1 2024-09-17T04:20:58.300 INFO:tasks.workunit.client.1.smithi134.stdout:3/675: dread de/d12/d15/d1d/f72 [0,4194304] 0 2024-09-17T04:20:58.301 INFO:tasks.workunit.client.0.smithi088.stdout:4/226: link d5/fb d5/d3d/f47 0 2024-09-17T04:20:58.304 INFO:tasks.workunit.client.1.smithi134.stdout:8/513: dwrite d4/db/dd/d72/f88 [0,4194304] 0 2024-09-17T04:20:58.304 INFO:tasks.workunit.client.1.smithi134.stdout:3/676: mknod de/d12/d15/d1d/d8f/cda 0 2024-09-17T04:20:58.306 INFO:tasks.workunit.client.1.smithi134.stdout:3/677: chown de/d12/d15/d1d/fcb 248 1 2024-09-17T04:20:58.306 INFO:tasks.workunit.client.1.smithi134.stdout:1/623: dread d12/d1c/d4a/f4c [0,4194304] 0 2024-09-17T04:20:58.307 INFO:tasks.workunit.client.0.smithi088.stdout:4/227: link d5/c1d d5/d3d/c48 0 2024-09-17T04:20:58.307 INFO:tasks.workunit.client.1.smithi134.stdout:1/624: dread - d12/d36/fae zero size 2024-09-17T04:20:58.308 INFO:tasks.workunit.client.0.smithi088.stdout:7/223: dread d2/f6 [0,4194304] 0 2024-09-17T04:20:58.308 INFO:tasks.workunit.client.1.smithi134.stdout:1/625: fsync d12/fa3 0 2024-09-17T04:20:58.311 INFO:tasks.workunit.client.1.smithi134.stdout:8/514: dwrite f0 [0,4194304] 0 2024-09-17T04:20:58.311 INFO:tasks.workunit.client.0.smithi088.stdout:7/224: symlink d2/d1e/d23/l4b 0 2024-09-17T04:20:58.312 INFO:tasks.workunit.client.0.smithi088.stdout:7/225: fdatasync d2/d4/f18 0 2024-09-17T04:20:58.314 INFO:tasks.workunit.client.1.smithi134.stdout:3/678: dwrite de/d12/d22/f81 [0,4194304] 0 2024-09-17T04:20:58.316 INFO:tasks.workunit.client.0.smithi088.stdout:4/228: dwrite d5/d3f/f41 [0,4194304] 0 2024-09-17T04:20:58.317 INFO:tasks.workunit.client.0.smithi088.stdout:4/229: chown d5/fd 27 1 2024-09-17T04:20:58.317 INFO:tasks.workunit.client.0.smithi088.stdout:7/226: symlink d2/d1d/d2e/l4c 0 2024-09-17T04:20:58.318 INFO:tasks.workunit.client.0.smithi088.stdout:4/230: fdatasync d5/f2d 0 2024-09-17T04:20:58.328 INFO:tasks.workunit.client.0.smithi088.stdout:4/231: dread d5/d3f/f3b [0,4194304] 0 2024-09-17T04:20:58.329 INFO:tasks.workunit.client.1.smithi134.stdout:3/679: creat de/d12/d9d/dd4/fdb x:0 0 0 2024-09-17T04:20:58.329 INFO:tasks.workunit.client.1.smithi134.stdout:6/675: dread de/d2b/f71 [0,4194304] 0 2024-09-17T04:20:58.331 INFO:tasks.workunit.client.0.smithi088.stdout:7/227: creat d2/d1e/d23/d45/f4d x:0 0 0 2024-09-17T04:20:58.336 INFO:tasks.workunit.client.1.smithi134.stdout:6/676: dwrite de/f13 [0,4194304] 0 2024-09-17T04:20:58.336 INFO:tasks.workunit.client.0.smithi088.stdout:4/232: mkdir d5/d3d/d49 0 2024-09-17T04:20:58.339 INFO:tasks.workunit.client.0.smithi088.stdout:4/233: dread d5/f23 [0,4194304] 0 2024-09-17T04:20:58.340 INFO:tasks.workunit.client.1.smithi134.stdout:1/626: link d12/c2a d12/d19/cd0 0 2024-09-17T04:20:58.342 INFO:tasks.workunit.client.1.smithi134.stdout:0/535: sync 2024-09-17T04:20:58.342 INFO:tasks.workunit.client.1.smithi134.stdout:7/461: sync 2024-09-17T04:20:58.342 INFO:tasks.workunit.client.1.smithi134.stdout:0/536: fdatasync d11/d19/f87 0 2024-09-17T04:20:58.343 INFO:tasks.workunit.client.1.smithi134.stdout:0/537: read - d11/d24/d49/f68 zero size 2024-09-17T04:20:58.343 INFO:tasks.workunit.client.0.smithi088.stdout:7/228: read d2/d4/d7/f10 [3219625,90266] 0 2024-09-17T04:20:58.345 INFO:tasks.workunit.client.0.smithi088.stdout:4/234: fdatasync d5/fd 0 2024-09-17T04:20:58.346 INFO:tasks.workunit.client.0.smithi088.stdout:4/235: chown d5/d32/c2b 203 1 2024-09-17T04:20:58.347 INFO:tasks.workunit.client.1.smithi134.stdout:1/627: mkdir d12/d36/da1/dd1 0 2024-09-17T04:20:58.347 INFO:tasks.workunit.client.0.smithi088.stdout:4/236: stat d5/d3d/c43 0 2024-09-17T04:20:58.348 INFO:tasks.workunit.client.0.smithi088.stdout:4/237: read d5/f2d [106231,29329] 0 2024-09-17T04:20:58.349 INFO:tasks.workunit.client.0.smithi088.stdout:7/229: creat d2/d4/d7/d46/f4e x:0 0 0 2024-09-17T04:20:58.353 INFO:tasks.workunit.client.0.smithi088.stdout:8/149: truncate d7/f8 1840772 0 2024-09-17T04:20:58.353 INFO:tasks.workunit.client.0.smithi088.stdout:4/238: dread d5/d3f/f3b [0,4194304] 0 2024-09-17T04:20:58.355 INFO:tasks.workunit.client.0.smithi088.stdout:4/239: read d5/d3f/f3b [829489,64727] 0 2024-09-17T04:20:58.355 INFO:tasks.workunit.client.1.smithi134.stdout:6/677: unlink de/d19/d7b/c97 0 2024-09-17T04:20:58.355 INFO:tasks.workunit.client.1.smithi134.stdout:6/678: fsync de/d19/d62/d34/d3b/fc0 0 2024-09-17T04:20:58.356 INFO:tasks.workunit.client.1.smithi134.stdout:2/553: truncate d19/d27/f2f 791502 0 2024-09-17T04:20:58.359 INFO:tasks.workunit.client.1.smithi134.stdout:1/628: symlink d12/d19/d1d/d61/da0/da4/ld2 0 2024-09-17T04:20:58.360 INFO:tasks.workunit.client.1.smithi134.stdout:1/629: dread d12/fa3 [0,4194304] 0 2024-09-17T04:20:58.363 INFO:tasks.workunit.client.1.smithi134.stdout:2/554: write d19/d27/d31/f5c [234161,67272] 0 2024-09-17T04:20:58.364 INFO:tasks.workunit.client.1.smithi134.stdout:4/619: dwrite d0/df/f18 [4194304,4194304] 0 2024-09-17T04:20:58.364 INFO:tasks.workunit.client.1.smithi134.stdout:9/973: sync 2024-09-17T04:20:58.364 INFO:tasks.workunit.client.1.smithi134.stdout:5/558: sync 2024-09-17T04:20:58.371 INFO:tasks.workunit.client.1.smithi134.stdout:0/538: creat d11/d19/d21/fb8 x:0 0 0 2024-09-17T04:20:58.374 INFO:tasks.workunit.client.0.smithi088.stdout:4/240: dread d5/f28 [0,4194304] 0 2024-09-17T04:20:58.374 INFO:tasks.workunit.client.1.smithi134.stdout:7/462: getdents d0/d16/d35 0 2024-09-17T04:20:58.375 INFO:tasks.workunit.client.1.smithi134.stdout:3/680: write de/d12/d15/f4b [1255604,23788] 0 2024-09-17T04:20:58.376 INFO:tasks.workunit.client.1.smithi134.stdout:8/515: dwrite d4/f7e [4194304,4194304] 0 2024-09-17T04:20:58.377 INFO:tasks.workunit.client.1.smithi134.stdout:4/620: dwrite d0/f5 [0,4194304] 0 2024-09-17T04:20:58.378 INFO:tasks.workunit.client.1.smithi134.stdout:8/516: read - d4/d23/f84 zero size 2024-09-17T04:20:58.378 INFO:tasks.workunit.client.0.smithi088.stdout:7/230: getdents d2/d1e/d23 0 2024-09-17T04:20:58.379 INFO:tasks.workunit.client.1.smithi134.stdout:1/630: fdatasync d12/d19/d1d/f9f 0 2024-09-17T04:20:58.384 INFO:tasks.workunit.client.0.smithi088.stdout:8/150: getdents d7/d29/d2a 0 2024-09-17T04:20:58.388 INFO:tasks.workunit.client.0.smithi088.stdout:7/231: unlink d2/d1d/l27 0 2024-09-17T04:20:58.393 INFO:tasks.workunit.client.1.smithi134.stdout:5/559: mknod d0/da/d69/d41/d6d/d89/cbb 0 2024-09-17T04:20:58.394 INFO:tasks.workunit.client.1.smithi134.stdout:0/539: symlink d11/d6f/da8/lb9 0 2024-09-17T04:20:58.394 INFO:tasks.workunit.client.0.smithi088.stdout:8/151: creat d7/d29/d2a/f35 x:0 0 0 2024-09-17T04:20:58.395 INFO:tasks.workunit.client.1.smithi134.stdout:6/679: dread de/d5d/d67/fbd [0,4194304] 0 2024-09-17T04:20:58.395 INFO:tasks.workunit.client.1.smithi134.stdout:2/555: creat d19/d27/d31/d49/d6f/d84/fb6 x:0 0 0 2024-09-17T04:20:58.396 INFO:tasks.workunit.client.0.smithi088.stdout:7/232: mknod d2/d1e/d23/c4f 0 2024-09-17T04:20:58.396 INFO:tasks.workunit.client.1.smithi134.stdout:7/463: creat d0/d16/d35/d4b/d8a/f94 x:0 0 0 2024-09-17T04:20:58.397 INFO:tasks.workunit.client.0.smithi088.stdout:4/241: link d5/l24 d5/d3d/d49/l4a 0 2024-09-17T04:20:58.398 INFO:tasks.workunit.client.1.smithi134.stdout:9/974: write d2/d5/d58/f119 [655018,83964] 0 2024-09-17T04:20:58.398 INFO:tasks.workunit.client.1.smithi134.stdout:5/560: stat d0/d3a/d2b/d61/d7b/f97 0 2024-09-17T04:20:58.399 INFO:tasks.workunit.client.0.smithi088.stdout:7/233: write d2/d4/f47 [185255,117521] 0 2024-09-17T04:20:58.400 INFO:tasks.workunit.client.0.smithi088.stdout:7/234: dread - d2/d1e/f29 zero size 2024-09-17T04:20:58.401 INFO:tasks.workunit.client.1.smithi134.stdout:1/631: dwrite d12/d19/d4f/fb3 [0,4194304] 0 2024-09-17T04:20:58.401 INFO:tasks.workunit.client.0.smithi088.stdout:8/152: dwrite d7/dd/f28 [0,4194304] 0 2024-09-17T04:20:58.402 INFO:tasks.workunit.client.0.smithi088.stdout:4/242: unlink d5/l1e 0 2024-09-17T04:20:58.403 INFO:tasks.workunit.client.1.smithi134.stdout:0/540: write d11/d4c/d76/f9e [4577983,128444] 0 2024-09-17T04:20:58.403 INFO:tasks.workunit.client.0.smithi088.stdout:8/153: truncate d7/d29/f2e 4773513 0 2024-09-17T04:20:58.403 INFO:tasks.workunit.client.1.smithi134.stdout:4/621: truncate d0/d13/d40/d42/f87 765203 0 2024-09-17T04:20:58.404 INFO:tasks.workunit.client.0.smithi088.stdout:4/243: dread d5/d3f/f3b [0,4194304] 0 2024-09-17T04:20:58.406 INFO:tasks.workunit.client.1.smithi134.stdout:7/464: read d0/d16/d35/d4b/f48 [102432,50717] 0 2024-09-17T04:20:58.408 INFO:tasks.workunit.client.1.smithi134.stdout:1/632: read d12/d19/d1d/f6b [3036936,3850] 0 2024-09-17T04:20:58.410 INFO:tasks.workunit.client.1.smithi134.stdout:4/622: chown d0/d13/f8d 1 1 2024-09-17T04:20:58.411 INFO:tasks.workunit.client.1.smithi134.stdout:8/517: mkdir d4/d1f/d86/d9f 0 2024-09-17T04:20:58.412 INFO:tasks.workunit.client.0.smithi088.stdout:8/154: creat d7/dd/d31/f36 x:0 0 0 2024-09-17T04:20:58.413 INFO:tasks.workunit.client.0.smithi088.stdout:8/155: chown d7/dd 1794429009 1 2024-09-17T04:20:58.414 INFO:tasks.workunit.client.1.smithi134.stdout:0/541: truncate d11/d24/d49/f68 322279 0 2024-09-17T04:20:58.414 INFO:tasks.workunit.client.1.smithi134.stdout:2/556: creat d19/d1c/d92/fb7 x:0 0 0 2024-09-17T04:20:58.416 INFO:tasks.workunit.client.1.smithi134.stdout:6/680: dwrite de/d19/d62/fb9 [0,4194304] 0 2024-09-17T04:20:58.416 INFO:tasks.workunit.client.0.smithi088.stdout:4/244: chown d5/c22 25 1 2024-09-17T04:20:58.418 INFO:tasks.workunit.client.0.smithi088.stdout:4/245: dread - d5/d3d/f42 zero size 2024-09-17T04:20:58.418 INFO:tasks.workunit.client.1.smithi134.stdout:9/975: dwrite d2/d5/d9/f36 [0,4194304] 0 2024-09-17T04:20:58.418 INFO:tasks.workunit.client.0.smithi088.stdout:8/156: dwrite d7/dd/ff [0,4194304] 0 2024-09-17T04:20:58.419 INFO:tasks.workunit.client.0.smithi088.stdout:7/235: mknod d2/c50 0 2024-09-17T04:20:58.420 INFO:tasks.workunit.client.1.smithi134.stdout:2/557: dread - d19/d27/d31/d49/d6f/da9/db0/fa7 zero size 2024-09-17T04:20:58.426 INFO:tasks.workunit.client.0.smithi088.stdout:7/236: symlink d2/d1e/d23/d45/l51 0 2024-09-17T04:20:58.428 INFO:tasks.workunit.client.1.smithi134.stdout:1/633: mkdir d12/d19/d1d/d61/dd3 0 2024-09-17T04:20:58.430 INFO:tasks.workunit.client.1.smithi134.stdout:7/465: rename d0/d16 to d0/d16/d95 22 2024-09-17T04:20:58.434 INFO:tasks.workunit.client.1.smithi134.stdout:8/518: unlink d4/d1f/f71 0 2024-09-17T04:20:58.436 INFO:tasks.workunit.client.0.smithi088.stdout:7/237: dread d2/d4/d7/f2a [0,4194304] 0 2024-09-17T04:20:58.437 INFO:tasks.workunit.client.0.smithi088.stdout:4/246: creat d5/f4b x:0 0 0 2024-09-17T04:20:58.438 INFO:tasks.workunit.client.1.smithi134.stdout:0/542: mkdir d11/d4c/d76/dba 0 2024-09-17T04:20:58.438 INFO:tasks.workunit.client.0.smithi088.stdout:7/238: write d2/d1e/d23/f35 [699349,50854] 0 2024-09-17T04:20:58.439 INFO:tasks.workunit.client.1.smithi134.stdout:8/519: dwrite d4/db/dd/f2e [4194304,4194304] 0 2024-09-17T04:20:58.439 INFO:tasks.workunit.client.1.smithi134.stdout:6/681: mkdir de/d5d/dd2 0 2024-09-17T04:20:58.441 INFO:tasks.workunit.client.1.smithi134.stdout:5/561: creat d0/da/d29/d78/da5/fbc x:0 0 0 2024-09-17T04:20:58.441 INFO:tasks.workunit.client.1.smithi134.stdout:0/543: read - d11/d22/d1c/d2f/d9a/fac zero size 2024-09-17T04:20:58.443 INFO:tasks.workunit.client.1.smithi134.stdout:9/976: creat d2/d5/d37/d83/d12a/d54/daf/d6d/daa/de2/dcd/f149 x:0 0 0 2024-09-17T04:20:58.443 INFO:tasks.workunit.client.1.smithi134.stdout:5/562: read - d0/da/d29/d78/da5/fbc zero size 2024-09-17T04:20:58.443 INFO:tasks.workunit.client.1.smithi134.stdout:9/977: read - d2/d5/f147 zero size 2024-09-17T04:20:58.444 INFO:tasks.workunit.client.1.smithi134.stdout:9/978: readlink d2/l4 0 2024-09-17T04:20:58.445 INFO:tasks.workunit.client.0.smithi088.stdout:7/239: creat d2/d4/f52 x:0 0 0 2024-09-17T04:20:58.447 INFO:tasks.workunit.client.1.smithi134.stdout:1/634: symlink d12/d19/d4f/ld4 0 2024-09-17T04:20:58.447 INFO:tasks.workunit.client.1.smithi134.stdout:3/681: sync 2024-09-17T04:20:58.449 INFO:tasks.workunit.client.1.smithi134.stdout:7/466: write d0/dd/d3a/d3d/d38/d60/f84 [257771,29143] 0 2024-09-17T04:20:58.450 INFO:tasks.workunit.client.1.smithi134.stdout:1/635: dread d12/d19/d66/f82 [0,4194304] 0 2024-09-17T04:20:58.451 INFO:tasks.workunit.client.1.smithi134.stdout:4/623: mkdir d0/d13/d40/d42/dc5/dcb 0 2024-09-17T04:20:58.452 INFO:tasks.workunit.client.0.smithi088.stdout:7/240: dwrite d2/d4/d7/d20/f3a [0,4194304] 0 2024-09-17T04:20:58.454 INFO:tasks.workunit.client.0.smithi088.stdout:8/157: write d7/f8 [1129886,54853] 0 2024-09-17T04:20:58.455 INFO:tasks.workunit.client.1.smithi134.stdout:6/682: symlink de/d19/da3/ld3 0 2024-09-17T04:20:58.455 INFO:tasks.workunit.client.0.smithi088.stdout:7/241: write d2/d1e/d23/d45/f4d [491173,86040] 0 2024-09-17T04:20:58.456 INFO:tasks.workunit.client.1.smithi134.stdout:5/563: write d0/d3a/d2b/f58 [110789,57399] 0 2024-09-17T04:20:58.457 INFO:tasks.workunit.client.0.smithi088.stdout:7/242: write d2/d1e/d23/f35 [1728716,73887] 0 2024-09-17T04:20:58.461 INFO:tasks.workunit.client.1.smithi134.stdout:7/467: dwrite d0/d16/d35/d4b/d65/f7b [0,4194304] 0 2024-09-17T04:20:58.461 INFO:tasks.workunit.client.1.smithi134.stdout:5/564: write d0/da/d2c/f4c [970857,47698] 0 2024-09-17T04:20:58.461 INFO:tasks.workunit.client.1.smithi134.stdout:3/682: creat de/d12/d9d/fdc x:0 0 0 2024-09-17T04:20:58.461 INFO:tasks.workunit.client.1.smithi134.stdout:8/520: dread d4/db/fc [0,4194304] 0 2024-09-17T04:20:58.462 INFO:tasks.workunit.client.1.smithi134.stdout:7/468: chown d0/d16/d35/d4b/d8a 1093108 1 2024-09-17T04:20:58.462 INFO:tasks.workunit.client.1.smithi134.stdout:3/683: stat de/d10/d3d/dd9/lab 0 2024-09-17T04:20:58.463 INFO:tasks.workunit.client.1.smithi134.stdout:2/558: rename d19/d27/f8a to d19/d27/d31/d34/d42/fb8 0 2024-09-17T04:20:58.464 INFO:tasks.workunit.client.0.smithi088.stdout:7/243: mkdir d2/d1e/d23/d45/d53 0 2024-09-17T04:20:58.465 INFO:tasks.workunit.client.0.smithi088.stdout:7/244: chown d2/d4/f18 621493668 1 2024-09-17T04:20:58.467 INFO:tasks.workunit.client.1.smithi134.stdout:1/636: fdatasync d12/d19/d66/fc6 0 2024-09-17T04:20:58.467 INFO:tasks.workunit.client.1.smithi134.stdout:8/521: dread f0 [0,4194304] 0 2024-09-17T04:20:58.473 INFO:tasks.workunit.client.0.smithi088.stdout:7/245: dwrite d2/d4/d7/d46/f4e [0,4194304] 0 2024-09-17T04:20:58.474 INFO:tasks.workunit.client.0.smithi088.stdout:7/246: stat d2/d1e/f24 0 2024-09-17T04:20:58.480 INFO:tasks.workunit.client.1.smithi134.stdout:5/565: creat d0/da/d2c/d73/d8a/fbd x:0 0 0 2024-09-17T04:20:58.481 INFO:tasks.workunit.client.1.smithi134.stdout:6/683: rename de/l32 to de/d19/d1f/d5c/ld4 0 2024-09-17T04:20:58.483 INFO:tasks.workunit.client.1.smithi134.stdout:7/469: symlink d0/dd/d3a/d3d/l96 0 2024-09-17T04:20:58.483 INFO:tasks.workunit.client.1.smithi134.stdout:6/684: dread - de/d19/da3/fb6 zero size 2024-09-17T04:20:58.483 INFO:tasks.workunit.client.1.smithi134.stdout:3/684: rmdir de/d12/d15/d1d/d2d/d31/d6a/d83 39 2024-09-17T04:20:58.485 INFO:tasks.workunit.client.0.smithi088.stdout:8/158: dread d7/d29/f12 [4194304,4194304] 0 2024-09-17T04:20:58.485 INFO:tasks.workunit.client.1.smithi134.stdout:1/637: readlink d12/d36/l89 0 2024-09-17T04:20:58.486 INFO:tasks.workunit.client.0.smithi088.stdout:8/159: chown d7/ca 94513565 1 2024-09-17T04:20:58.486 INFO:tasks.workunit.client.1.smithi134.stdout:8/522: mknod d4/d23/d60/ca0 0 2024-09-17T04:20:58.487 INFO:tasks.workunit.client.0.smithi088.stdout:8/160: read d7/dd/f28 [3108359,106827] 0 2024-09-17T04:20:58.487 INFO:tasks.workunit.client.0.smithi088.stdout:8/161: stat d7/ca 0 2024-09-17T04:20:58.491 INFO:tasks.workunit.client.0.smithi088.stdout:8/162: mknod d7/dd/d31/c37 0 2024-09-17T04:20:58.492 INFO:tasks.workunit.client.1.smithi134.stdout:4/624: unlink d0/df/d1e/l28 0 2024-09-17T04:20:58.493 INFO:tasks.workunit.client.1.smithi134.stdout:9/979: creat d2/d5/d9/f14a x:0 0 0 2024-09-17T04:20:58.493 INFO:tasks.workunit.client.1.smithi134.stdout:8/523: write d4/db/f2d [2331714,31702] 0 2024-09-17T04:20:58.494 INFO:tasks.workunit.client.1.smithi134.stdout:7/470: dwrite d0/dd/d3a/d3d/d38/d60/d75/f80 [0,4194304] 0 2024-09-17T04:20:58.495 INFO:tasks.workunit.client.1.smithi134.stdout:5/566: rename d0/da/d2c/f37 to d0/da/d2c/fbe 0 2024-09-17T04:20:58.498 INFO:tasks.workunit.client.1.smithi134.stdout:2/559: rename d19/d27/d31/d49/d63/d94/f7d to d19/da1/fb9 0 2024-09-17T04:20:58.498 INFO:tasks.workunit.client.0.smithi088.stdout:8/163: dwrite f2 [4194304,4194304] 0 2024-09-17T04:20:58.499 INFO:tasks.workunit.client.1.smithi134.stdout:6/685: creat de/d19/d62/d34/d3b/fd5 x:0 0 0 2024-09-17T04:20:58.500 INFO:tasks.workunit.client.1.smithi134.stdout:6/686: fsync de/d19/d1f/d55/da9/fbc 0 2024-09-17T04:20:58.503 INFO:tasks.workunit.client.0.smithi088.stdout:7/247: dwrite d2/d4/d7/f15 [0,4194304] 0 2024-09-17T04:20:58.510 INFO:tasks.workunit.client.0.smithi088.stdout:7/248: symlink d2/d4/d7/l54 0 2024-09-17T04:20:58.510 INFO:tasks.workunit.client.0.smithi088.stdout:8/164: dwrite d7/dd/d31/f36 [0,4194304] 0 2024-09-17T04:20:58.511 INFO:tasks.workunit.client.0.smithi088.stdout:7/249: fsync d2/d1e/f4a 0 2024-09-17T04:20:58.512 INFO:tasks.workunit.client.0.smithi088.stdout:8/165: chown d7/dd/f1a 7968108 1 2024-09-17T04:20:58.513 INFO:tasks.workunit.client.0.smithi088.stdout:7/250: write d2/d4/d7/f15 [3256866,97029] 0 2024-09-17T04:20:58.521 INFO:tasks.workunit.client.0.smithi088.stdout:8/166: mkdir d7/d29/d2a/d38 0 2024-09-17T04:20:58.522 INFO:tasks.workunit.client.0.smithi088.stdout:7/251: mknod d2/d1d/c55 0 2024-09-17T04:20:58.523 INFO:tasks.workunit.client.0.smithi088.stdout:7/252: rename d2 to d2/d4/d7/d56 22 2024-09-17T04:20:58.526 INFO:tasks.workunit.client.0.smithi088.stdout:7/253: rmdir d2/d4/d7/d46 39 2024-09-17T04:20:58.531 INFO:tasks.workunit.client.1.smithi134.stdout:0/544: getdents d11/d4c/d76 0 2024-09-17T04:20:58.532 INFO:tasks.workunit.client.0.smithi088.stdout:8/167: getdents d7/dd 0 2024-09-17T04:20:58.533 INFO:tasks.workunit.client.1.smithi134.stdout:4/625: creat d0/df/d35/d5c/fcc x:0 0 0 2024-09-17T04:20:58.534 INFO:tasks.workunit.client.1.smithi134.stdout:8/524: fdatasync d4/f57 0 2024-09-17T04:20:58.535 INFO:tasks.workunit.client.1.smithi134.stdout:8/525: write d4/d1f/f97 [321098,41035] 0 2024-09-17T04:20:58.537 INFO:tasks.workunit.client.1.smithi134.stdout:5/567: symlink d0/d48/lbf 0 2024-09-17T04:20:58.537 INFO:tasks.workunit.client.0.smithi088.stdout:8/168: unlink d7/dd/d31/c34 0 2024-09-17T04:20:58.538 INFO:tasks.workunit.client.0.smithi088.stdout:8/169: fsync d7/d29/f2e 0 2024-09-17T04:20:58.540 INFO:tasks.workunit.client.1.smithi134.stdout:9/980: rename d2/d5/d37/d83/d12a/d54/daf/d6d/daa/de2/dcd/dd6 to d2/d5/d9/df/d13c/d1e/d127/d14b 0 2024-09-17T04:20:58.540 INFO:tasks.workunit.client.1.smithi134.stdout:3/685: mkdir de/d12/d15/d1d/d2d/d31/d6a/d83/ddd 0 2024-09-17T04:20:58.542 INFO:tasks.workunit.client.1.smithi134.stdout:2/560: mknod d19/d27/d31/d49/d6f/d84/d98/cba 0 2024-09-17T04:20:58.543 INFO:tasks.workunit.client.0.smithi088.stdout:8/170: unlink d7/dd/f15 0 2024-09-17T04:20:58.544 INFO:tasks.workunit.client.1.smithi134.stdout:6/687: symlink de/d19/d1f/d55/d77/ld6 0 2024-09-17T04:20:58.545 INFO:tasks.workunit.client.1.smithi134.stdout:9/981: dwrite d2/d5/d58/f119 [0,4194304] 0 2024-09-17T04:20:58.545 INFO:tasks.workunit.client.1.smithi134.stdout:6/688: readlink de/d19/d1f/d55/d77/d89/lba 0 2024-09-17T04:20:58.548 INFO:tasks.workunit.client.1.smithi134.stdout:4/626: rmdir d0/df/d1e/dbc 39 2024-09-17T04:20:58.550 INFO:tasks.workunit.client.1.smithi134.stdout:8/526: mkdir d4/d11/da1 0 2024-09-17T04:20:58.553 INFO:tasks.workunit.client.1.smithi134.stdout:3/686: rename de/d12/d15/d1d/d2d/d31/d6a/d78/c85 to de/d12/d15/d1d/d2d/d31/d6a/d78/cde 0 2024-09-17T04:20:58.554 INFO:tasks.workunit.client.1.smithi134.stdout:9/982: mkdir d2/d5/d37/d83/d12a/d54/d14c 0 2024-09-17T04:20:58.556 INFO:tasks.workunit.client.1.smithi134.stdout:9/983: write d2/d5/d9/df/d13c/f114 [4597429,103138] 0 2024-09-17T04:20:58.556 INFO:tasks.workunit.client.0.smithi088.stdout:7/254: getdents d2/d1d 0 2024-09-17T04:20:58.557 INFO:tasks.workunit.client.1.smithi134.stdout:0/545: dread d11/d24/f28 [0,4194304] 0 2024-09-17T04:20:58.558 INFO:tasks.workunit.client.1.smithi134.stdout:4/627: unlink d0/df/d17/c64 0 2024-09-17T04:20:58.558 INFO:tasks.workunit.client.1.smithi134.stdout:4/628: readlink d0/d78/l93 0 2024-09-17T04:20:58.559 INFO:tasks.workunit.client.0.smithi088.stdout:7/255: creat d2/d1e/d23/d45/f57 x:0 0 0 2024-09-17T04:20:58.560 INFO:tasks.workunit.client.1.smithi134.stdout:4/629: write d0/df/d35/d39/f7c [3727911,11407] 0 2024-09-17T04:20:58.561 INFO:tasks.workunit.client.1.smithi134.stdout:4/630: write d0/df/d35/d5c/d8b/fc0 [213100,17098] 0 2024-09-17T04:20:58.562 INFO:tasks.workunit.client.0.smithi088.stdout:7/256: creat d2/d1d/f58 x:0 0 0 2024-09-17T04:20:58.562 INFO:tasks.workunit.client.0.smithi088.stdout:7/257: chown d2/d4/c44 4920 1 2024-09-17T04:20:58.563 INFO:tasks.workunit.client.1.smithi134.stdout:2/561: symlink d19/d1c/d47/dae/lbb 0 2024-09-17T04:20:58.563 INFO:tasks.workunit.client.1.smithi134.stdout:3/687: dread - de/d10/f8c zero size 2024-09-17T04:20:58.566 INFO:tasks.workunit.client.0.smithi088.stdout:7/258: rmdir d2/d1e 39 2024-09-17T04:20:58.567 INFO:tasks.workunit.client.1.smithi134.stdout:6/689: mkdir de/d19/d7b/db3/db4/dd7 0 2024-09-17T04:20:58.568 INFO:tasks.workunit.client.1.smithi134.stdout:6/690: write de/d2b/f80 [435318,75648] 0 2024-09-17T04:20:58.568 INFO:tasks.workunit.client.1.smithi134.stdout:9/984: creat d2/d5/d9/df/d80/f14d x:0 0 0 2024-09-17T04:20:58.571 INFO:tasks.workunit.client.1.smithi134.stdout:0/546: rename d11/d18/l34 to d11/d18/d97/lbb 0 2024-09-17T04:20:58.572 INFO:tasks.workunit.client.1.smithi134.stdout:1/638: truncate d12/d19/d5d/d91/dac/fba 3079944 0 2024-09-17T04:20:58.574 INFO:tasks.workunit.client.1.smithi134.stdout:7/471: link d0/dd/c4d d0/dd/d3a/d3d/d38/d60/c97 0 2024-09-17T04:20:58.575 INFO:tasks.workunit.client.0.smithi088.stdout:7/259: dread d2/d1e/d23/f35 [0,4194304] 0 2024-09-17T04:20:58.576 INFO:tasks.workunit.client.1.smithi134.stdout:5/568: creat d0/d3a/fc0 x:0 0 0 2024-09-17T04:20:58.580 INFO:tasks.workunit.client.1.smithi134.stdout:4/631: creat d0/d13/d40/d42/d92/d65/fcd x:0 0 0 2024-09-17T04:20:58.581 INFO:tasks.workunit.client.0.smithi088.stdout:7/260: dwrite d2/d4/d7/f34 [0,4194304] 0 2024-09-17T04:20:58.582 INFO:tasks.workunit.client.1.smithi134.stdout:4/632: dread - d0/df/d35/d5c/d8b/fc4 zero size 2024-09-17T04:20:58.582 INFO:tasks.workunit.client.1.smithi134.stdout:5/569: dwrite d0/d3a/d2b/d61/d7b/fae [0,4194304] 0 2024-09-17T04:20:58.583 INFO:tasks.workunit.client.1.smithi134.stdout:5/570: write d0/d48/f52 [227612,109783] 0 2024-09-17T04:20:58.586 INFO:tasks.workunit.client.1.smithi134.stdout:9/985: creat d2/d5/d9/d6b/f14e x:0 0 0 2024-09-17T04:20:58.587 INFO:tasks.workunit.client.1.smithi134.stdout:9/986: readlink d2/d5/d9/df/d80/la9 0 2024-09-17T04:20:58.589 INFO:tasks.workunit.client.1.smithi134.stdout:0/547: chown d11/l9c 260876 1 2024-09-17T04:20:58.590 INFO:tasks.workunit.client.0.smithi088.stdout:5/204: sync 2024-09-17T04:20:58.590 INFO:tasks.workunit.client.0.smithi088.stdout:6/195: sync 2024-09-17T04:20:58.590 INFO:tasks.workunit.client.0.smithi088.stdout:1/172: sync 2024-09-17T04:20:58.590 INFO:tasks.workunit.client.0.smithi088.stdout:9/243: sync 2024-09-17T04:20:58.590 INFO:tasks.workunit.client.0.smithi088.stdout:0/113: sync 2024-09-17T04:20:58.590 INFO:tasks.workunit.client.0.smithi088.stdout:3/138: sync 2024-09-17T04:20:58.590 INFO:tasks.workunit.client.0.smithi088.stdout:2/218: sync 2024-09-17T04:20:58.591 INFO:tasks.workunit.client.1.smithi134.stdout:5/571: dwrite d0/da/d29/d78/f8d [0,4194304] 0 2024-09-17T04:20:58.591 INFO:tasks.workunit.client.1.smithi134.stdout:0/548: chown d11/l16 1 1 2024-09-17T04:20:58.593 INFO:tasks.workunit.client.0.smithi088.stdout:0/114: read - db/f12 zero size 2024-09-17T04:20:58.594 INFO:tasks.workunit.client.1.smithi134.stdout:2/562: rename d19/d27/d31/d34/d6d to d19/d77/dbc 0 2024-09-17T04:20:58.594 INFO:tasks.workunit.client.1.smithi134.stdout:1/639: rmdir d12/d19/d1d/d61/da0/da4 39 2024-09-17T04:20:58.594 INFO:tasks.workunit.client.1.smithi134.stdout:5/572: chown d0/da/d29/d78/da5/fbc 51865 1 2024-09-17T04:20:58.594 INFO:tasks.workunit.client.0.smithi088.stdout:5/205: write d2/d31/d33/f21 [665340,91516] 0 2024-09-17T04:20:58.595 INFO:tasks.workunit.client.0.smithi088.stdout:0/115: readlink db/l16 0 2024-09-17T04:20:58.598 INFO:tasks.workunit.client.1.smithi134.stdout:9/987: dwrite d2/d5/d9/df/d13c/f148 [0,4194304] 0 2024-09-17T04:20:58.600 INFO:tasks.workunit.client.1.smithi134.stdout:2/563: dread d19/d1c/f52 [0,4194304] 0 2024-09-17T04:20:58.604 INFO:tasks.workunit.client.1.smithi134.stdout:7/472: dread d0/f1c [0,4194304] 0 2024-09-17T04:20:58.604 INFO:tasks.workunit.client.0.smithi088.stdout:3/139: rmdir d0/d13 39 2024-09-17T04:20:58.606 INFO:tasks.workunit.client.1.smithi134.stdout:4/633: unlink d0/l30 0 2024-09-17T04:20:58.609 INFO:tasks.workunit.client.0.smithi088.stdout:6/196: mknod d14/d3a/d41/c4f 0 2024-09-17T04:20:58.610 INFO:tasks.workunit.client.1.smithi134.stdout:2/564: dwrite d19/d27/d31/d49/d63/f68 [4194304,4194304] 0 2024-09-17T04:20:58.611 INFO:tasks.workunit.client.0.smithi088.stdout:7/261: link d2/d1e/d23/l4b d2/d1e/d23/l59 0 2024-09-17T04:20:58.612 INFO:tasks.workunit.client.1.smithi134.stdout:0/549: rmdir d11/d22/d1c 39 2024-09-17T04:20:58.614 INFO:tasks.workunit.client.0.smithi088.stdout:5/206: unlink d2/d31/d33/d20/d30/f32 0 2024-09-17T04:20:58.615 INFO:tasks.workunit.client.0.smithi088.stdout:5/207: fsync d2/d31/d33/fa 0 2024-09-17T04:20:58.617 INFO:tasks.workunit.client.1.smithi134.stdout:6/691: rename de/d19/d74/d98/fb2 to de/d19/d62/db0/fd8 0 2024-09-17T04:20:58.617 INFO:tasks.workunit.client.1.smithi134.stdout:6/692: chown de/d2b/d8a/fad 44 1 2024-09-17T04:20:58.618 INFO:tasks.workunit.client.0.smithi088.stdout:2/219: symlink d0/l46 0 2024-09-17T04:20:58.619 INFO:tasks.workunit.client.0.smithi088.stdout:1/173: fdatasync d0/f28 0 2024-09-17T04:20:58.619 INFO:tasks.workunit.client.0.smithi088.stdout:2/220: dread - d0/d14/f3d zero size 2024-09-17T04:20:58.620 INFO:tasks.workunit.client.1.smithi134.stdout:1/640: mkdir d12/d19/d5d/d91/dac/dd5 0 2024-09-17T04:20:58.621 INFO:tasks.workunit.client.1.smithi134.stdout:1/641: chown d12/d19/d66/f82 15845273 1 2024-09-17T04:20:58.623 INFO:tasks.workunit.client.0.smithi088.stdout:6/197: unlink d14/d15/d16/f25 0 2024-09-17T04:20:58.623 INFO:tasks.workunit.client.1.smithi134.stdout:3/688: link de/d12/d15/c4c de/d10/d3d/dd9/dbd/dc6/cdf 0 2024-09-17T04:20:58.625 INFO:tasks.workunit.client.1.smithi134.stdout:4/634: chown d0/d3b/ca0 20879 1 2024-09-17T04:20:58.627 INFO:tasks.workunit.client.1.smithi134.stdout:0/550: chown d11/d22/d1c/d2f/d45/f8e 267230 1 2024-09-17T04:20:58.629 INFO:tasks.workunit.client.1.smithi134.stdout:3/689: dread de/d10/d3d/f9a [0,4194304] 0 2024-09-17T04:20:58.629 INFO:tasks.workunit.client.1.smithi134.stdout:6/693: truncate de/d19/d21/d2d/f39 935380 0 2024-09-17T04:20:58.631 INFO:tasks.workunit.client.1.smithi134.stdout:1/642: creat d12/d19/d5d/d88/fd6 x:0 0 0 2024-09-17T04:20:58.635 INFO:tasks.workunit.client.1.smithi134.stdout:0/551: symlink d11/d22/d1c/d81/lbc 0 2024-09-17T04:20:58.636 INFO:tasks.workunit.client.0.smithi088.stdout:8/171: truncate d7/dd/fe 793474 0 2024-09-17T04:20:58.637 INFO:tasks.workunit.client.1.smithi134.stdout:3/690: write de/d12/f48 [1442376,26208] 0 2024-09-17T04:20:58.637 INFO:tasks.workunit.client.0.smithi088.stdout:5/208: dread d2/f5 [0,4194304] 0 2024-09-17T04:20:58.638 INFO:tasks.workunit.client.1.smithi134.stdout:3/691: truncate de/faf 355698 0 2024-09-17T04:20:58.639 INFO:tasks.workunit.client.0.smithi088.stdout:9/244: link d2/dd/d11/d30/l32 d2/dd/d11/d30/l53 0 2024-09-17T04:20:58.640 INFO:tasks.workunit.client.1.smithi134.stdout:1/643: mkdir d12/d19/d1d/d5f/dd7 0 2024-09-17T04:20:58.641 INFO:tasks.workunit.client.1.smithi134.stdout:1/644: readlink d12/l2c 0 2024-09-17T04:20:58.641 INFO:tasks.workunit.client.1.smithi134.stdout:1/645: readlink d12/d36/l89 0 2024-09-17T04:20:58.642 INFO:tasks.workunit.client.0.smithi088.stdout:6/198: dread d14/d15/f22 [0,4194304] 0 2024-09-17T04:20:58.644 INFO:tasks.workunit.client.1.smithi134.stdout:2/565: creat d19/d27/d31/d34/fbd x:0 0 0 2024-09-17T04:20:58.645 INFO:tasks.workunit.client.1.smithi134.stdout:2/566: chown cd 17 1 2024-09-17T04:20:58.648 INFO:tasks.workunit.client.1.smithi134.stdout:6/694: mknod de/d19/d74/d94/d9b/cd9 0 2024-09-17T04:20:58.650 INFO:tasks.workunit.client.0.smithi088.stdout:1/174: link d0/d1/fd d0/d1/d16/f3c 0 2024-09-17T04:20:58.651 INFO:tasks.workunit.client.0.smithi088.stdout:1/175: dread - d0/d1/df/d20/f29 zero size 2024-09-17T04:20:58.654 INFO:tasks.workunit.client.1.smithi134.stdout:2/567: stat l18 0 2024-09-17T04:20:58.655 INFO:tasks.workunit.client.1.smithi134.stdout:2/568: chown d19/d1c/d92/fb7 7 1 2024-09-17T04:20:58.658 INFO:tasks.workunit.client.0.smithi088.stdout:5/209: rename d2/d31/d33/l11 to d2/d31/d33/d20/d25/l42 0 2024-09-17T04:20:58.661 INFO:tasks.workunit.client.1.smithi134.stdout:6/695: creat de/d19/d1f/d5c/fda x:0 0 0 2024-09-17T04:20:58.662 INFO:tasks.workunit.client.0.smithi088.stdout:7/262: rmdir d2/d1e/d23/d45/d53 0 2024-09-17T04:20:58.663 INFO:tasks.workunit.client.0.smithi088.stdout:5/210: dwrite d2/d31/d33/fa [0,4194304] 0 2024-09-17T04:20:58.669 INFO:tasks.workunit.client.0.smithi088.stdout:2/221: rmdir d0/d14/d2b 0 2024-09-17T04:20:58.669 INFO:tasks.workunit.client.1.smithi134.stdout:4/635: getdents d0/df 0 2024-09-17T04:20:58.670 INFO:tasks.workunit.client.0.smithi088.stdout:0/116: truncate f1 3841650 0 2024-09-17T04:20:58.671 INFO:tasks.workunit.client.0.smithi088.stdout:3/140: creat d0/d13/f28 x:0 0 0 2024-09-17T04:20:58.672 INFO:tasks.workunit.client.1.smithi134.stdout:6/696: fsync de/d19/d62/f20 0 2024-09-17T04:20:58.674 INFO:tasks.workunit.client.0.smithi088.stdout:8/172: write d7/d29/d2a/f35 [691369,25480] 0 2024-09-17T04:20:58.674 INFO:tasks.workunit.client.1.smithi134.stdout:3/692: link de/d12/d15/c21 de/d12/d15/d1d/d2d/d31/d6a/d83/ddd/ce0 0 2024-09-17T04:20:58.677 INFO:tasks.workunit.client.1.smithi134.stdout:4/636: rename d0/d78/l93 to d0/d13/d40/d42/lce 0 2024-09-17T04:20:58.680 INFO:tasks.workunit.client.0.smithi088.stdout:9/245: rename d2/dd/d14/d2a/f41 to d2/d2b/f54 0 2024-09-17T04:20:58.684 INFO:tasks.workunit.client.0.smithi088.stdout:7/263: creat d2/d1e/f5a x:0 0 0 2024-09-17T04:20:58.685 INFO:tasks.workunit.client.0.smithi088.stdout:7/264: fsync d2/d4/d7/d20/f3c 0 2024-09-17T04:20:58.685 INFO:tasks.workunit.client.1.smithi134.stdout:6/697: mkdir de/d19/d62/d7c/ddb 0 2024-09-17T04:20:58.686 INFO:tasks.workunit.client.0.smithi088.stdout:4/247: sync 2024-09-17T04:20:58.686 INFO:tasks.workunit.client.0.smithi088.stdout:4/248: fdatasync d5/f4b 0 2024-09-17T04:20:58.687 INFO:tasks.workunit.client.1.smithi134.stdout:0/552: dwrite d11/d24/d49/f5b [0,4194304] 0 2024-09-17T04:20:58.688 INFO:tasks.workunit.client.0.smithi088.stdout:2/222: chown d0/d1/cf 903 1 2024-09-17T04:20:58.690 INFO:tasks.workunit.client.1.smithi134.stdout:4/637: creat d0/d13/d40/d42/d92/fcf x:0 0 0 2024-09-17T04:20:58.690 INFO:tasks.workunit.client.0.smithi088.stdout:1/176: symlink d0/d1/l3d 0 2024-09-17T04:20:58.695 INFO:tasks.workunit.client.0.smithi088.stdout:2/223: dwrite d0/d1/f11 [4194304,4194304] 0 2024-09-17T04:20:58.703 INFO:tasks.workunit.client.1.smithi134.stdout:6/698: dread fb [0,4194304] 0 2024-09-17T04:20:58.704 INFO:tasks.workunit.client.0.smithi088.stdout:8/173: dread d7/dd/d31/f36 [0,4194304] 0 2024-09-17T04:20:58.707 INFO:tasks.workunit.client.1.smithi134.stdout:2/569: getdents d19/d27 0 2024-09-17T04:20:58.707 INFO:tasks.workunit.client.1.smithi134.stdout:0/553: dread d11/d18/f36 [0,4194304] 0 2024-09-17T04:20:58.708 INFO:tasks.workunit.client.0.smithi088.stdout:9/246: fdatasync d2/fc 0 2024-09-17T04:20:58.710 INFO:tasks.workunit.client.1.smithi134.stdout:4/638: rename d0/d13/d40/d42/d92/c32 to d0/d13/cd0 0 2024-09-17T04:20:58.712 INFO:tasks.workunit.client.1.smithi134.stdout:2/570: dwrite d19/f22 [0,4194304] 0 2024-09-17T04:20:58.713 INFO:tasks.workunit.client.0.smithi088.stdout:7/265: unlink d2/d1d/d2e/c32 0 2024-09-17T04:20:58.713 INFO:tasks.workunit.client.0.smithi088.stdout:6/199: write d14/d15/f4b [1809829,67725] 0 2024-09-17T04:20:58.713 INFO:tasks.workunit.client.0.smithi088.stdout:7/266: chown d2/f1b 61830307 1 2024-09-17T04:20:58.716 INFO:tasks.workunit.client.0.smithi088.stdout:4/249: rmdir d5/d3d 39 2024-09-17T04:20:58.718 INFO:tasks.workunit.client.1.smithi134.stdout:3/693: write de/d12/d15/d1d/f72 [2208537,62445] 0 2024-09-17T04:20:58.720 INFO:tasks.workunit.client.1.smithi134.stdout:6/699: rename de/d19/d7b to de/d19/d1f/d55/d77/db8/dc7/ddc 0 2024-09-17T04:20:58.720 INFO:tasks.workunit.client.0.smithi088.stdout:0/117: getdents db/d1b 0 2024-09-17T04:20:58.722 INFO:tasks.workunit.client.0.smithi088.stdout:1/177: truncate d0/d1/fe 288741 0 2024-09-17T04:20:58.724 INFO:tasks.workunit.client.1.smithi134.stdout:2/571: creat d19/d1c/d47/fbe x:0 0 0 2024-09-17T04:20:58.724 INFO:tasks.workunit.client.1.smithi134.stdout:8/527: sync 2024-09-17T04:20:58.726 INFO:tasks.workunit.client.1.smithi134.stdout:3/694: mkdir de/d12/d15/d1d/d2d/d31/d6a/d78/de1 0 2024-09-17T04:20:58.726 INFO:tasks.workunit.client.0.smithi088.stdout:3/141: write d0/f10 [1316464,116837] 0 2024-09-17T04:20:58.730 INFO:tasks.workunit.client.1.smithi134.stdout:0/554: rename d11/d22/d1c/d2f/c33 to d11/d24/d49/d9b/cbd 0 2024-09-17T04:20:58.731 INFO:tasks.workunit.client.1.smithi134.stdout:0/555: fsync f10 0 2024-09-17T04:20:58.731 INFO:tasks.workunit.client.0.smithi088.stdout:3/142: dread d0/f4 [0,4194304] 0 2024-09-17T04:20:58.732 INFO:tasks.workunit.client.0.smithi088.stdout:3/143: read - d0/fb zero size 2024-09-17T04:20:58.732 INFO:tasks.workunit.client.1.smithi134.stdout:0/556: write d11/d18/f30 [511303,6886] 0 2024-09-17T04:20:58.733 INFO:tasks.workunit.client.1.smithi134.stdout:3/695: dwrite de/d12/d15/d1d/d8f/d90/fd1 [0,4194304] 0 2024-09-17T04:20:58.734 INFO:tasks.workunit.client.0.smithi088.stdout:1/178: dread d0/f3b [0,4194304] 0 2024-09-17T04:20:58.734 INFO:tasks.workunit.client.1.smithi134.stdout:0/557: chown d11/d24/d49/c9d 1547096343 1 2024-09-17T04:20:58.736 INFO:tasks.workunit.client.0.smithi088.stdout:9/247: fsync d2/d16/f3f 0 2024-09-17T04:20:58.736 INFO:tasks.workunit.client.0.smithi088.stdout:8/174: dread d7/dd/f28 [0,4194304] 0 2024-09-17T04:20:58.737 INFO:tasks.workunit.client.1.smithi134.stdout:2/572: mknod d19/d27/d31/d49/d63/cbf 0 2024-09-17T04:20:58.742 INFO:tasks.workunit.client.0.smithi088.stdout:6/200: creat d14/d15/d2a/f50 x:0 0 0 2024-09-17T04:20:58.743 INFO:tasks.workunit.client.0.smithi088.stdout:5/211: link d2/d31/d33/d20/d30/l3b d2/d31/d33/d20/d25/l43 0 2024-09-17T04:20:58.745 INFO:tasks.workunit.client.0.smithi088.stdout:2/224: write d0/d1/f11 [9066593,8057] 0 2024-09-17T04:20:58.746 INFO:tasks.workunit.client.0.smithi088.stdout:2/225: write d0/d14/f3d [587144,65483] 0 2024-09-17T04:20:58.747 INFO:tasks.workunit.client.0.smithi088.stdout:2/226: stat d0/d14/d24/f2a 0 2024-09-17T04:20:58.748 INFO:tasks.workunit.client.0.smithi088.stdout:2/227: chown d0/d1/fb 256675553 1 2024-09-17T04:20:58.749 INFO:tasks.workunit.client.0.smithi088.stdout:2/228: read d0/d1/d2d/f3c [2404419,42012] 0 2024-09-17T04:20:58.750 INFO:tasks.workunit.client.1.smithi134.stdout:8/528: mkdir d4/db/dd/da2 0 2024-09-17T04:20:58.751 INFO:tasks.workunit.client.0.smithi088.stdout:2/229: write d0/f9 [4208534,15031] 0 2024-09-17T04:20:58.755 INFO:tasks.workunit.client.1.smithi134.stdout:2/573: rename d19/f74 to d19/d77/fc0 0 2024-09-17T04:20:58.756 INFO:tasks.workunit.client.1.smithi134.stdout:6/700: write de/d19/f61 [2130730,18605] 0 2024-09-17T04:20:58.756 INFO:tasks.workunit.client.1.smithi134.stdout:3/696: dread de/d10/f2e [0,4194304] 0 2024-09-17T04:20:58.756 INFO:tasks.workunit.client.1.smithi134.stdout:2/574: chown c10 871055 1 2024-09-17T04:20:58.757 INFO:tasks.workunit.client.1.smithi134.stdout:4/639: getdents d0/d3b 0 2024-09-17T04:20:58.758 INFO:tasks.workunit.client.0.smithi088.stdout:8/175: write d7/d29/d2a/f2b [4958609,116577] 0 2024-09-17T04:20:58.758 INFO:tasks.workunit.client.1.smithi134.stdout:4/640: fdatasync d0/d13/d40/d42/d92/d86/faf 0 2024-09-17T04:20:58.759 INFO:tasks.workunit.client.0.smithi088.stdout:9/248: creat d2/dd/d11/d1d/d43/f55 x:0 0 0 2024-09-17T04:20:58.759 INFO:tasks.workunit.client.1.smithi134.stdout:4/641: readlink d0/d13/d40/d42/d92/dc3/lbd 0 2024-09-17T04:20:58.759 INFO:tasks.workunit.client.1.smithi134.stdout:0/558: symlink d11/d22/d1c/d2f/lbe 0 2024-09-17T04:20:58.760 INFO:tasks.workunit.client.1.smithi134.stdout:0/559: fdatasync d11/d24/f93 0 2024-09-17T04:20:58.763 INFO:tasks.workunit.client.1.smithi134.stdout:8/529: dread d4/f8d [0,4194304] 0 2024-09-17T04:20:58.763 INFO:tasks.workunit.client.0.smithi088.stdout:6/201: unlink d14/d15/d29/d3e/f2c 0 2024-09-17T04:20:58.767 INFO:tasks.workunit.client.0.smithi088.stdout:8/176: dwrite f2 [0,4194304] 0 2024-09-17T04:20:58.767 INFO:tasks.workunit.client.1.smithi134.stdout:2/575: mkdir d19/d1c/d47/d50/d85/d93/dc1 0 2024-09-17T04:20:58.768 INFO:tasks.workunit.client.0.smithi088.stdout:1/179: dread d0/d1/f1a [0,4194304] 0 2024-09-17T04:20:58.772 INFO:tasks.workunit.client.0.smithi088.stdout:6/202: dwrite f11 [0,4194304] 0 2024-09-17T04:20:58.774 INFO:tasks.workunit.client.0.smithi088.stdout:1/180: dread d0/d1/f1a [0,4194304] 0 2024-09-17T04:20:58.774 INFO:tasks.workunit.client.1.smithi134.stdout:4/642: creat d0/df/d35/fd1 x:0 0 0 2024-09-17T04:20:58.775 INFO:tasks.workunit.client.0.smithi088.stdout:1/181: truncate d0/d1/fd 4203410 0 2024-09-17T04:20:58.775 INFO:tasks.workunit.client.1.smithi134.stdout:4/643: fdatasync d0/d13/d40/d42/d92/d65/fcd 0 2024-09-17T04:20:58.776 INFO:tasks.workunit.client.1.smithi134.stdout:4/644: chown d0/d13/d40/d42/f9b 38 1 2024-09-17T04:20:58.777 INFO:tasks.workunit.client.0.smithi088.stdout:2/230: symlink d0/d1/l47 0 2024-09-17T04:20:58.778 INFO:tasks.workunit.client.1.smithi134.stdout:3/697: mkdir de/d10/d3d/de2 0 2024-09-17T04:20:58.778 INFO:tasks.workunit.client.0.smithi088.stdout:4/250: write d5/f1f [1401463,14621] 0 2024-09-17T04:20:58.779 INFO:tasks.workunit.client.0.smithi088.stdout:4/251: write d5/f23 [1384218,83568] 0 2024-09-17T04:20:58.780 INFO:tasks.workunit.client.0.smithi088.stdout:0/118: write db/f13 [1483625,404] 0 2024-09-17T04:20:58.782 INFO:tasks.workunit.client.0.smithi088.stdout:2/231: dread d0/d1/f3 [0,4194304] 0 2024-09-17T04:20:58.784 INFO:tasks.workunit.client.0.smithi088.stdout:9/249: mknod d2/d2b/d2e/c56 0 2024-09-17T04:20:58.784 INFO:tasks.workunit.client.1.smithi134.stdout:2/576: read d19/f7b [306012,17204] 0 2024-09-17T04:20:58.785 INFO:tasks.workunit.client.1.smithi134.stdout:4/645: dwrite d0/df/f31 [0,4194304] 0 2024-09-17T04:20:58.786 INFO:tasks.workunit.client.0.smithi088.stdout:7/267: rename d2/d4/d7/l54 to d2/d4/d7/l5b 0 2024-09-17T04:20:58.787 INFO:tasks.workunit.client.1.smithi134.stdout:3/698: rmdir de/d12/d15/d1d/d2d 39 2024-09-17T04:20:58.790 INFO:tasks.workunit.client.1.smithi134.stdout:6/701: link de/lf de/d19/d62/d7c/ddb/ldd 0 2024-09-17T04:20:58.791 INFO:tasks.workunit.client.0.smithi088.stdout:8/177: write d7/dd/ff [1381060,85055] 0 2024-09-17T04:20:58.794 INFO:tasks.workunit.client.1.smithi134.stdout:2/577: dwrite d19/d27/d31/d49/d6f/fa6 [0,4194304] 0 2024-09-17T04:20:58.796 INFO:tasks.workunit.client.1.smithi134.stdout:4/646: creat d0/df/d1e/d73/dc7/fd2 x:0 0 0 2024-09-17T04:20:58.797 INFO:tasks.workunit.client.0.smithi088.stdout:6/203: creat d14/d15/d16/f51 x:0 0 0 2024-09-17T04:20:58.799 INFO:tasks.workunit.client.0.smithi088.stdout:1/182: unlink d0/d13/c33 0 2024-09-17T04:20:58.801 INFO:tasks.workunit.client.1.smithi134.stdout:6/702: mkdir de/d19/d1f/d85/dde 0 2024-09-17T04:20:58.802 INFO:tasks.workunit.client.1.smithi134.stdout:0/560: link d11/d19/d21/d37/l6e d11/d19/lbf 0 2024-09-17T04:20:58.803 INFO:tasks.workunit.client.1.smithi134.stdout:2/578: dwrite d19/d27/d31/d34/fbd [0,4194304] 0 2024-09-17T04:20:58.804 INFO:tasks.workunit.client.0.smithi088.stdout:2/232: mknod d0/d14/d24/d3b/d26/c48 0 2024-09-17T04:20:58.804 INFO:tasks.workunit.client.1.smithi134.stdout:3/699: mknod de/d12/d15/dd0/ce3 0 2024-09-17T04:20:58.804 INFO:tasks.workunit.client.0.smithi088.stdout:2/233: stat d0/d1/d2d/f3a 0 2024-09-17T04:20:58.805 INFO:tasks.workunit.client.0.smithi088.stdout:9/250: creat d2/d2b/d2e/f57 x:0 0 0 2024-09-17T04:20:58.806 INFO:tasks.workunit.client.0.smithi088.stdout:2/234: write d0/d1/d2d/f3a [306957,126493] 0 2024-09-17T04:20:58.806 INFO:tasks.workunit.client.0.smithi088.stdout:5/212: link d2/d31/d33/d20/d25/f28 d2/d31/f44 0 2024-09-17T04:20:58.807 INFO:tasks.workunit.client.1.smithi134.stdout:6/703: read de/f2c [978059,41681] 0 2024-09-17T04:20:58.810 INFO:tasks.workunit.client.1.smithi134.stdout:0/561: mknod d11/d24/d49/d62/cc0 0 2024-09-17T04:20:58.811 INFO:tasks.workunit.client.1.smithi134.stdout:0/562: chown d11/d19/d21/d37/fa2 710532 1 2024-09-17T04:20:58.812 INFO:tasks.workunit.client.1.smithi134.stdout:2/579: mkdir d19/d27/d31/d49/d6f/d84/d98/dc2 0 2024-09-17T04:20:58.813 INFO:tasks.workunit.client.0.smithi088.stdout:2/235: dwrite d0/d18/f3e [0,4194304] 0 2024-09-17T04:20:58.814 INFO:tasks.workunit.client.1.smithi134.stdout:2/580: truncate d19/d1c/d47/d50/f7c 4333971 0 2024-09-17T04:20:58.815 INFO:tasks.workunit.client.0.smithi088.stdout:6/204: mkdir d14/d15/d2a/d52 0 2024-09-17T04:20:58.816 INFO:tasks.workunit.client.0.smithi088.stdout:1/183: creat d0/d1/df/f3e x:0 0 0 2024-09-17T04:20:58.820 INFO:tasks.workunit.client.1.smithi134.stdout:6/704: symlink de/d19/d1f/d55/d77/db8/ldf 0 2024-09-17T04:20:58.821 INFO:tasks.workunit.client.0.smithi088.stdout:9/251: stat d2/dd/l29 0 2024-09-17T04:20:58.822 INFO:tasks.workunit.client.0.smithi088.stdout:9/252: dread - d2/d2b/d2e/f57 zero size 2024-09-17T04:20:58.823 INFO:tasks.workunit.client.1.smithi134.stdout:0/563: creat d11/d6f/fc1 x:0 0 0 2024-09-17T04:20:58.824 INFO:tasks.workunit.client.1.smithi134.stdout:0/564: fsync d11/f70 0 2024-09-17T04:20:58.824 INFO:tasks.workunit.client.0.smithi088.stdout:5/213: fsync d2/d31/d33/f12 0 2024-09-17T04:20:58.826 INFO:tasks.workunit.client.1.smithi134.stdout:2/581: mkdir d19/d27/d31/d49/dc3 0 2024-09-17T04:20:58.827 INFO:tasks.workunit.client.0.smithi088.stdout:0/119: dread db/fc [0,4194304] 0 2024-09-17T04:20:58.827 INFO:tasks.workunit.client.1.smithi134.stdout:2/582: chown d19/d1c/d47/d50 0 1 2024-09-17T04:20:58.832 INFO:tasks.workunit.client.0.smithi088.stdout:5/214: dwrite d2/d31/d33/d20/d25/d2c/f3c [0,4194304] 0 2024-09-17T04:20:58.834 INFO:tasks.workunit.client.0.smithi088.stdout:6/205: symlink d14/d15/d29/d3e/l53 0 2024-09-17T04:20:58.835 INFO:tasks.workunit.client.1.smithi134.stdout:0/565: symlink d11/d48/lc2 0 2024-09-17T04:20:58.835 INFO:tasks.workunit.client.0.smithi088.stdout:5/215: write d2/d31/d33/fa [417890,17736] 0 2024-09-17T04:20:58.837 INFO:tasks.workunit.client.0.smithi088.stdout:8/178: dwrite d7/dd/f28 [0,4194304] 0 2024-09-17T04:20:58.838 INFO:tasks.workunit.client.0.smithi088.stdout:8/179: chown f6 184045532 1 2024-09-17T04:20:58.840 INFO:tasks.workunit.client.1.smithi134.stdout:2/583: write d19/d1c/f1d [6126355,66809] 0 2024-09-17T04:20:58.842 INFO:tasks.workunit.client.1.smithi134.stdout:2/584: chown d19/d27/la8 9 1 2024-09-17T04:20:58.842 INFO:tasks.workunit.client.0.smithi088.stdout:9/253: dread - d2/f26 zero size 2024-09-17T04:20:58.842 INFO:tasks.workunit.client.1.smithi134.stdout:6/705: creat de/d19/d62/d34/d3b/dce/fe0 x:0 0 0 2024-09-17T04:20:58.843 INFO:tasks.workunit.client.0.smithi088.stdout:9/254: chown d2/fc 92 1 2024-09-17T04:20:58.844 INFO:tasks.workunit.client.1.smithi134.stdout:2/585: truncate d19/d27/d31/d49/d6f/d84/f97 1029689 0 2024-09-17T04:20:58.845 INFO:tasks.workunit.client.1.smithi134.stdout:3/700: link de/d12/d15/l7a de/d12/d15/d1d/d2d/d31/d6a/d83/ddd/le4 0 2024-09-17T04:20:58.851 INFO:tasks.workunit.client.0.smithi088.stdout:1/184: write d0/d1/fd [4601452,117047] 0 2024-09-17T04:20:58.852 INFO:tasks.workunit.client.1.smithi134.stdout:6/706: mknod de/d19/d1f/d55/d77/db8/dc7/ce1 0 2024-09-17T04:20:58.853 INFO:tasks.workunit.client.1.smithi134.stdout:2/586: creat d19/d1c/d47/dae/fc4 x:0 0 0 2024-09-17T04:20:58.854 INFO:tasks.workunit.client.0.smithi088.stdout:5/216: dread d2/f15 [0,4194304] 0 2024-09-17T04:20:58.856 INFO:tasks.workunit.client.0.smithi088.stdout:5/217: truncate d2/d31/d33/f21 4243114 0 2024-09-17T04:20:58.857 INFO:tasks.workunit.client.1.smithi134.stdout:3/701: dwrite de/d12/d15/d1d/d2d/d31/d6a/d78/d7c/fcf [0,4194304] 0 2024-09-17T04:20:58.857 INFO:tasks.workunit.client.0.smithi088.stdout:0/120: write db/f25 [471717,54584] 0 2024-09-17T04:20:58.859 INFO:tasks.workunit.client.0.smithi088.stdout:2/236: truncate d0/d1/fe 1437194 0 2024-09-17T04:20:58.860 INFO:tasks.workunit.client.0.smithi088.stdout:9/255: mkdir d2/d2b/d58 0 2024-09-17T04:20:58.861 INFO:tasks.workunit.client.1.smithi134.stdout:0/566: dread d11/d19/d21/d37/f42 [0,4194304] 0 2024-09-17T04:20:58.865 INFO:tasks.workunit.client.0.smithi088.stdout:2/237: dread d0/d1/d2d/f3a [0,4194304] 0 2024-09-17T04:20:58.866 INFO:tasks.workunit.client.1.smithi134.stdout:0/567: creat d11/d18/d97/fc3 x:0 0 0 2024-09-17T04:20:58.866 INFO:tasks.workunit.client.0.smithi088.stdout:2/238: fdatasync d0/f9 0 2024-09-17T04:20:58.870 INFO:tasks.workunit.client.1.smithi134.stdout:0/568: chown d11/d24/d49/d9b/cbd 257 1 2024-09-17T04:20:58.872 INFO:tasks.workunit.client.0.smithi088.stdout:4/252: link d5/d3d/c40 d5/d32/c4c 0 2024-09-17T04:20:58.872 INFO:tasks.workunit.client.0.smithi088.stdout:1/185: write d0/f28 [1454079,99713] 0 2024-09-17T04:20:58.873 INFO:tasks.workunit.client.0.smithi088.stdout:4/253: write f1 [1563881,109247] 0 2024-09-17T04:20:58.874 INFO:tasks.workunit.client.1.smithi134.stdout:0/569: dread d11/d22/d1c/f80 [0,4194304] 0 2024-09-17T04:20:58.874 INFO:tasks.workunit.client.0.smithi088.stdout:0/121: rmdir db/d1e 39 2024-09-17T04:20:58.876 INFO:tasks.workunit.client.1.smithi134.stdout:3/702: dwrite de/d12/d22/f46 [0,4194304] 0 2024-09-17T04:20:58.878 INFO:tasks.workunit.client.0.smithi088.stdout:6/206: mknod d14/d44/d45/d4d/c54 0 2024-09-17T04:20:58.879 INFO:tasks.workunit.client.1.smithi134.stdout:0/570: symlink d11/d22/d1c/d2f/d9a/lc4 0 2024-09-17T04:20:58.881 INFO:tasks.workunit.client.0.smithi088.stdout:1/186: dread d0/d1/d16/f3c [0,4194304] 0 2024-09-17T04:20:58.881 INFO:tasks.workunit.client.0.smithi088.stdout:2/239: rename d0/d13/c1d to d0/d13/c49 0 2024-09-17T04:20:58.884 INFO:tasks.workunit.client.0.smithi088.stdout:4/254: dread d5/f20 [0,4194304] 0 2024-09-17T04:20:58.884 INFO:tasks.workunit.client.1.smithi134.stdout:3/703: dwrite de/d10/f2e [0,4194304] 0 2024-09-17T04:20:58.885 INFO:tasks.workunit.client.0.smithi088.stdout:8/180: dwrite d7/dd/fe [0,4194304] 0 2024-09-17T04:20:58.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:20:58 smithi088 ceph-mon[27811]: pgmap v20: 65 pgs: 65 active+clean; 1.5 GiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 41 MiB/s rd, 205 MiB/s wr, 342 op/s 2024-09-17T04:20:58.889 INFO:tasks.workunit.client.1.smithi134.stdout:0/571: creat d11/d22/d1c/d2f/d43/d5d/fc5 x:0 0 0 2024-09-17T04:20:58.891 INFO:tasks.workunit.client.1.smithi134.stdout:7/473: sync 2024-09-17T04:20:58.891 INFO:tasks.workunit.client.1.smithi134.stdout:5/573: sync 2024-09-17T04:20:58.891 INFO:tasks.workunit.client.1.smithi134.stdout:9/988: sync 2024-09-17T04:20:58.891 INFO:tasks.workunit.client.1.smithi134.stdout:1/646: sync 2024-09-17T04:20:58.891 INFO:tasks.workunit.client.0.smithi088.stdout:9/256: mknod d2/c59 0 2024-09-17T04:20:58.893 INFO:tasks.workunit.client.1.smithi134.stdout:3/704: mknod de/d12/ce5 0 2024-09-17T04:20:58.894 INFO:tasks.workunit.client.0.smithi088.stdout:6/207: mknod d14/d44/d45/c55 0 2024-09-17T04:20:58.895 INFO:tasks.workunit.client.0.smithi088.stdout:2/240: mknod d0/d13/c4a 0 2024-09-17T04:20:58.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:20:58 smithi134 ceph-mon[35201]: pgmap v20: 65 pgs: 65 active+clean; 1.5 GiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 41 MiB/s rd, 205 MiB/s wr, 342 op/s 2024-09-17T04:20:58.896 INFO:tasks.workunit.client.1.smithi134.stdout:9/989: fdatasync d2/d7/d75/d96/dca/feb 0 2024-09-17T04:20:58.896 INFO:tasks.workunit.client.0.smithi088.stdout:2/241: dread d0/d1/fb [0,4194304] 0 2024-09-17T04:20:58.897 INFO:tasks.workunit.client.0.smithi088.stdout:1/187: unlink d0/d1/d16/c30 0 2024-09-17T04:20:58.899 INFO:tasks.workunit.client.0.smithi088.stdout:8/181: mkdir d7/d29/d39 0 2024-09-17T04:20:58.902 INFO:tasks.workunit.client.0.smithi088.stdout:4/255: unlink d5/c22 0 2024-09-17T04:20:58.903 INFO:tasks.workunit.client.0.smithi088.stdout:9/257: readlink d2/dd/d11/l17 0 2024-09-17T04:20:58.904 INFO:tasks.workunit.client.0.smithi088.stdout:9/258: chown d2/dd/l29 252008 1 2024-09-17T04:20:58.905 INFO:tasks.workunit.client.0.smithi088.stdout:2/242: rename d0/d14 to d0/d1/d2d/d33/d4b 0 2024-09-17T04:20:58.907 INFO:tasks.workunit.client.0.smithi088.stdout:4/256: symlink d5/d32/l4d 0 2024-09-17T04:20:58.907 INFO:tasks.workunit.client.0.smithi088.stdout:8/182: truncate d7/d29/d2a/f33 716387 0 2024-09-17T04:20:58.908 INFO:tasks.workunit.client.0.smithi088.stdout:8/183: write d7/dd/f28 [3145233,21475] 0 2024-09-17T04:20:58.910 INFO:tasks.workunit.client.0.smithi088.stdout:2/243: creat d0/d18/f4c x:0 0 0 2024-09-17T04:20:58.910 INFO:tasks.workunit.client.0.smithi088.stdout:6/208: creat d14/f56 x:0 0 0 2024-09-17T04:20:58.911 INFO:tasks.workunit.client.0.smithi088.stdout:6/209: write f4 [5676767,19345] 0 2024-09-17T04:20:58.912 INFO:tasks.workunit.client.0.smithi088.stdout:4/257: unlink d5/d32/l30 0 2024-09-17T04:20:58.915 INFO:tasks.workunit.client.0.smithi088.stdout:6/210: mknod d14/d15/d29/d3e/c57 0 2024-09-17T04:20:58.917 INFO:tasks.workunit.client.0.smithi088.stdout:8/184: mkdir d7/d29/d2a/d3a 0 2024-09-17T04:20:58.921 INFO:tasks.workunit.client.0.smithi088.stdout:4/258: creat d5/f4e x:0 0 0 2024-09-17T04:20:58.923 INFO:tasks.workunit.client.0.smithi088.stdout:5/218: dwrite d2/d31/d33/d20/d25/f41 [0,4194304] 0 2024-09-17T04:20:58.928 INFO:tasks.workunit.client.0.smithi088.stdout:4/259: rename d5/d32/l4d to d5/d3d/d49/l4f 0 2024-09-17T04:20:58.929 INFO:tasks.workunit.client.0.smithi088.stdout:5/219: creat d2/d31/f45 x:0 0 0 2024-09-17T04:20:58.930 INFO:tasks.workunit.client.0.smithi088.stdout:8/185: dwrite d7/dd/f16 [4194304,4194304] 0 2024-09-17T04:20:58.932 INFO:tasks.workunit.client.0.smithi088.stdout:4/260: symlink d5/d3d/d49/l50 0 2024-09-17T04:20:58.934 INFO:tasks.workunit.client.0.smithi088.stdout:1/188: write d0/d1/fe [251643,128400] 0 2024-09-17T04:20:58.939 INFO:tasks.workunit.client.0.smithi088.stdout:9/259: write d2/f3 [3549415,26466] 0 2024-09-17T04:20:58.944 INFO:tasks.workunit.client.0.smithi088.stdout:8/186: dwrite d7/f8 [0,4194304] 0 2024-09-17T04:20:58.947 INFO:tasks.workunit.client.0.smithi088.stdout:1/189: link d0/f4 d0/d13/f3f 0 2024-09-17T04:20:58.947 INFO:tasks.workunit.client.0.smithi088.stdout:4/261: dwrite d5/d3f/f33 [0,4194304] 0 2024-09-17T04:20:58.951 INFO:tasks.workunit.client.1.smithi134.stdout:0/572: dwrite d11/d22/d1c/d2f/d43/f44 [0,4194304] 0 2024-09-17T04:20:58.953 INFO:tasks.workunit.client.1.smithi134.stdout:9/990: write d2/d5/d9/d6b/f133 [399347,13466] 0 2024-09-17T04:20:58.953 INFO:tasks.workunit.client.0.smithi088.stdout:2/244: read d0/f9 [989883,83181] 0 2024-09-17T04:20:58.955 INFO:tasks.workunit.client.0.smithi088.stdout:2/245: chown d0 7 1 2024-09-17T04:20:58.958 INFO:tasks.workunit.client.0.smithi088.stdout:8/187: dwrite f6 [0,4194304] 0 2024-09-17T04:20:58.959 INFO:tasks.workunit.client.1.smithi134.stdout:1/647: dwrite d12/d19/d5d/fa9 [0,4194304] 0 2024-09-17T04:20:58.959 INFO:tasks.workunit.client.0.smithi088.stdout:9/260: symlink d2/dd/d14/l5a 0 2024-09-17T04:20:58.960 INFO:tasks.workunit.client.0.smithi088.stdout:2/246: chown d0/d1/d2d/d33/d4b/d24/d3b/c23 26 1 2024-09-17T04:20:58.961 INFO:tasks.workunit.client.0.smithi088.stdout:5/220: truncate d2/d31/d33/d20/d25/f41 1578817 0 2024-09-17T04:20:58.961 INFO:tasks.workunit.client.0.smithi088.stdout:9/261: write d2/dd/fe [682882,20690] 0 2024-09-17T04:20:58.963 INFO:tasks.workunit.client.1.smithi134.stdout:5/574: dwrite d0/da/d2c/f4b [0,4194304] 0 2024-09-17T04:20:58.963 INFO:tasks.workunit.client.1.smithi134.stdout:3/705: rename de/d12/d9d/ld3 to de/d12/d15/d1d/d2d/d31/d6a/d83/dd8/le6 0 2024-09-17T04:20:58.964 INFO:tasks.workunit.client.0.smithi088.stdout:4/262: symlink d5/d3d/d49/l51 0 2024-09-17T04:20:58.965 INFO:tasks.workunit.client.0.smithi088.stdout:8/188: readlink d7/dd/l21 0 2024-09-17T04:20:58.967 INFO:tasks.workunit.client.0.smithi088.stdout:8/189: readlink d7/l17 0 2024-09-17T04:20:58.968 INFO:tasks.workunit.client.1.smithi134.stdout:1/648: creat d12/d19/d1d/d61/fd8 x:0 0 0 2024-09-17T04:20:58.969 INFO:tasks.workunit.client.0.smithi088.stdout:6/211: dread f10 [0,4194304] 0 2024-09-17T04:20:58.970 INFO:tasks.workunit.client.1.smithi134.stdout:0/573: rename d11/d48/c75 to d11/d4c/d76/cc6 0 2024-09-17T04:20:58.972 INFO:tasks.workunit.client.0.smithi088.stdout:5/221: rmdir d2/d31/d33/d20/d25 39 2024-09-17T04:20:58.973 INFO:tasks.workunit.client.1.smithi134.stdout:5/575: chown d0/da/d29/d7c/l8b 46167781 1 2024-09-17T04:20:58.973 INFO:tasks.workunit.client.0.smithi088.stdout:6/212: write d14/d15/d29/f38 [460022,14711] 0 2024-09-17T04:20:58.974 INFO:tasks.workunit.client.0.smithi088.stdout:2/247: dread d0/d1/f3 [0,4194304] 0 2024-09-17T04:20:58.977 INFO:tasks.workunit.client.0.smithi088.stdout:2/248: chown d0/d1/d2d/f3a 501138404 1 2024-09-17T04:20:58.978 INFO:tasks.workunit.client.1.smithi134.stdout:0/574: dwrite d11/d19/d21/d37/faa [0,4194304] 0 2024-09-17T04:20:58.980 INFO:tasks.workunit.client.0.smithi088.stdout:4/263: dread d5/d3f/f33 [0,4194304] 0 2024-09-17T04:20:58.982 INFO:tasks.workunit.client.0.smithi088.stdout:5/222: chown d2/d31/d33/f1f 7332131 1 2024-09-17T04:20:58.982 INFO:tasks.workunit.client.0.smithi088.stdout:2/249: dread - d0/d1/d2d/d33/f38 zero size 2024-09-17T04:20:58.983 INFO:tasks.workunit.client.0.smithi088.stdout:8/190: creat d7/dd/d31/f3b x:0 0 0 2024-09-17T04:20:58.983 INFO:tasks.workunit.client.0.smithi088.stdout:9/262: creat d2/d2b/d58/f5b x:0 0 0 2024-09-17T04:20:58.985 INFO:tasks.workunit.client.1.smithi134.stdout:0/575: symlink d11/d4c/d76/lc7 0 2024-09-17T04:20:58.986 INFO:tasks.workunit.client.0.smithi088.stdout:2/250: write d0/d18/f34 [183136,51510] 0 2024-09-17T04:20:58.987 INFO:tasks.workunit.client.1.smithi134.stdout:1/649: creat d12/d19/d1d/d61/da0/da4/fd9 x:0 0 0 2024-09-17T04:20:58.987 INFO:tasks.workunit.client.1.smithi134.stdout:3/706: dread de/d12/d15/d1d/f8b [0,4194304] 0 2024-09-17T04:20:58.988 INFO:tasks.workunit.client.1.smithi134.stdout:8/530: sync 2024-09-17T04:20:58.988 INFO:tasks.workunit.client.1.smithi134.stdout:5/576: creat d0/da/d29/d7c/d9e/fc1 x:0 0 0 2024-09-17T04:20:58.989 INFO:tasks.workunit.client.1.smithi134.stdout:9/991: getdents d2/d5/d9/df/d13c 0 2024-09-17T04:20:58.990 INFO:tasks.workunit.client.1.smithi134.stdout:0/576: creat d11/d48/fc8 x:0 0 0 2024-09-17T04:20:58.991 INFO:tasks.workunit.client.1.smithi134.stdout:9/992: fdatasync d2/d5/d37/d83/ff2 0 2024-09-17T04:20:58.992 INFO:tasks.workunit.client.1.smithi134.stdout:1/650: rename d12/d19/d5c to d12/d19/d1d/d61/dd3/dda 0 2024-09-17T04:20:58.993 INFO:tasks.workunit.client.1.smithi134.stdout:8/531: creat d4/db/dd/d43/d8b/fa3 x:0 0 0 2024-09-17T04:20:58.993 INFO:tasks.workunit.client.1.smithi134.stdout:5/577: rmdir d0/d3a/d6b/d9c/dad 39 2024-09-17T04:20:58.994 INFO:tasks.workunit.client.1.smithi134.stdout:3/707: mknod de/d12/ce7 0 2024-09-17T04:20:58.994 INFO:tasks.workunit.client.1.smithi134.stdout:5/578: chown d0/d3a/f3b 3586316 1 2024-09-17T04:20:58.995 INFO:tasks.workunit.client.1.smithi134.stdout:0/577: symlink d11/d19/d21/d37/lc9 0 2024-09-17T04:20:58.995 INFO:tasks.workunit.client.1.smithi134.stdout:3/708: write de/d12/d22/d5a/fb5 [1253376,18150] 0 2024-09-17T04:20:58.996 INFO:tasks.workunit.client.1.smithi134.stdout:0/578: chown d11/d24/d49/c9d 956972501 1 2024-09-17T04:20:59.001 INFO:tasks.workunit.client.1.smithi134.stdout:1/651: mknod d12/d19/d5d/d91/dac/cdb 0 2024-09-17T04:20:59.002 INFO:tasks.workunit.client.1.smithi134.stdout:1/652: stat d12/d19/d1d/d5f/f87 0 2024-09-17T04:20:59.002 INFO:tasks.workunit.client.0.smithi088.stdout:5/223: dwrite d2/d31/d33/f1b [0,4194304] 0 2024-09-17T04:20:59.002 INFO:tasks.workunit.client.1.smithi134.stdout:8/532: rmdir d4/db/d6e 39 2024-09-17T04:20:59.003 INFO:tasks.workunit.client.0.smithi088.stdout:6/213: link d14/l28 d14/d15/d29/d3e/l58 0 2024-09-17T04:20:59.005 INFO:tasks.workunit.client.0.smithi088.stdout:6/214: chown d14/d15/d29 4346 1 2024-09-17T04:20:59.006 INFO:tasks.workunit.client.0.smithi088.stdout:9/263: mkdir d2/dd/d11/d4f/d5c 0 2024-09-17T04:20:59.007 INFO:tasks.workunit.client.0.smithi088.stdout:9/264: stat d2/dd/d11/d1d 0 2024-09-17T04:20:59.008 INFO:tasks.workunit.client.0.smithi088.stdout:1/190: dread d0/d1/d16/d35/f36 [0,4194304] 0 2024-09-17T04:20:59.009 INFO:tasks.workunit.client.0.smithi088.stdout:8/191: rmdir d7/d29/d39 0 2024-09-17T04:20:59.009 INFO:tasks.workunit.client.1.smithi134.stdout:7/474: truncate d0/dd/d3a/d3d/d4c/f50 636612 0 2024-09-17T04:20:59.010 INFO:tasks.workunit.client.1.smithi134.stdout:5/579: mknod d0/da/d29/d78/cc2 0 2024-09-17T04:20:59.011 INFO:tasks.workunit.client.1.smithi134.stdout:7/475: write d0/d16/d8b/d6a/f88 [578583,43616] 0 2024-09-17T04:20:59.012 INFO:tasks.workunit.client.1.smithi134.stdout:5/580: readlink d0/da/d69/l5f 0 2024-09-17T04:20:59.014 INFO:tasks.workunit.client.1.smithi134.stdout:0/579: rmdir d11/d24/d49/d62 39 2024-09-17T04:20:59.014 INFO:tasks.workunit.client.1.smithi134.stdout:0/580: fsync f10 0 2024-09-17T04:20:59.014 INFO:tasks.workunit.client.0.smithi088.stdout:6/215: symlink d14/d3a/l59 0 2024-09-17T04:20:59.015 INFO:tasks.workunit.client.0.smithi088.stdout:9/265: rmdir d2/dd/d14 39 2024-09-17T04:20:59.015 INFO:tasks.workunit.client.1.smithi134.stdout:5/581: dread d0/d48/f82 [0,4194304] 0 2024-09-17T04:20:59.016 INFO:tasks.workunit.client.1.smithi134.stdout:1/653: mkdir d12/d19/d1d/d5f/ddc 0 2024-09-17T04:20:59.016 INFO:tasks.workunit.client.1.smithi134.stdout:5/582: chown d0/da/d69/d41/c92 2635953 1 2024-09-17T04:20:59.019 INFO:tasks.workunit.client.1.smithi134.stdout:8/533: read d4/d1f/d2b/f2f [4020833,102524] 0 2024-09-17T04:20:59.020 INFO:tasks.workunit.client.1.smithi134.stdout:3/709: unlink de/d10/d3d/dd9/l84 0 2024-09-17T04:20:59.023 INFO:tasks.workunit.client.1.smithi134.stdout:5/583: mknod d0/d3a/d2b/d5a/cc3 0 2024-09-17T04:20:59.023 INFO:tasks.workunit.client.0.smithi088.stdout:5/224: creat d2/d31/d33/d20/f46 x:0 0 0 2024-09-17T04:20:59.025 INFO:tasks.workunit.client.1.smithi134.stdout:4/647: sync 2024-09-17T04:20:59.025 INFO:tasks.workunit.client.1.smithi134.stdout:6/707: sync 2024-09-17T04:20:59.025 INFO:tasks.workunit.client.0.smithi088.stdout:9/266: symlink d2/dd/d14/d2a/l5d 0 2024-09-17T04:20:59.025 INFO:tasks.workunit.client.0.smithi088.stdout:4/264: dread d5/f2a [0,4194304] 0 2024-09-17T04:20:59.026 INFO:tasks.workunit.client.1.smithi134.stdout:8/534: dwrite d4/d1f/f97 [0,4194304] 0 2024-09-17T04:20:59.032 INFO:tasks.workunit.client.0.smithi088.stdout:9/267: truncate d2/d16/f34 139620 0 2024-09-17T04:20:59.033 INFO:tasks.workunit.client.1.smithi134.stdout:4/648: dwrite d0/df/d1e/f2e [0,4194304] 0 2024-09-17T04:20:59.033 INFO:tasks.workunit.client.1.smithi134.stdout:4/649: fdatasync d0/df/d35/fd1 0 2024-09-17T04:20:59.034 INFO:tasks.workunit.client.0.smithi088.stdout:4/265: rmdir d5/d3d/d49 39 2024-09-17T04:20:59.036 INFO:tasks.workunit.client.0.smithi088.stdout:1/191: link d0/f28 d0/d1/d27/f40 0 2024-09-17T04:20:59.037 INFO:tasks.workunit.client.0.smithi088.stdout:1/192: chown d0/d1/c11 399 1 2024-09-17T04:20:59.037 INFO:tasks.workunit.client.1.smithi134.stdout:3/710: rmdir de/d12/d22/d5a 39 2024-09-17T04:20:59.040 INFO:tasks.workunit.client.0.smithi088.stdout:1/193: dread d0/d1/fe [0,4194304] 0 2024-09-17T04:20:59.043 INFO:tasks.workunit.client.1.smithi134.stdout:1/654: rename d12/d19/cd0 to d12/d19/d5d/d91/dac/cdd 0 2024-09-17T04:20:59.044 INFO:tasks.workunit.client.0.smithi088.stdout:9/268: mknod d2/d16/c5e 0 2024-09-17T04:20:59.046 INFO:tasks.workunit.client.0.smithi088.stdout:9/269: write d2/d16/f34 [1010789,53729] 0 2024-09-17T04:20:59.046 INFO:tasks.workunit.client.0.smithi088.stdout:5/225: dwrite d2/d31/d33/d20/d25/f41 [0,4194304] 0 2024-09-17T04:20:59.048 INFO:tasks.workunit.client.0.smithi088.stdout:9/270: write d2/d2b/f38 [114368,5559] 0 2024-09-17T04:20:59.055 INFO:tasks.workunit.client.0.smithi088.stdout:1/194: fdatasync d0/d1/d16/f3c 0 2024-09-17T04:20:59.058 INFO:tasks.workunit.client.1.smithi134.stdout:4/650: creat d0/df/d35/fd3 x:0 0 0 2024-09-17T04:20:59.062 INFO:tasks.workunit.client.0.smithi088.stdout:4/266: creat d5/d3d/d49/f52 x:0 0 0 2024-09-17T04:20:59.063 INFO:tasks.workunit.client.1.smithi134.stdout:9/993: dwrite d2/d5/d37/d83/d12a/d54/d5e/da0/f10e [0,4194304] 0 2024-09-17T04:20:59.067 INFO:tasks.workunit.client.1.smithi134.stdout:0/581: getdents d11/d22/d1c 0 2024-09-17T04:20:59.069 INFO:tasks.workunit.client.0.smithi088.stdout:5/226: mkdir d2/d31/d33/d20/d47 0 2024-09-17T04:20:59.070 INFO:tasks.workunit.client.1.smithi134.stdout:1/655: mkdir d12/d1c/dc0/dde 0 2024-09-17T04:20:59.072 INFO:tasks.workunit.client.0.smithi088.stdout:4/267: mknod d5/d3f/c53 0 2024-09-17T04:20:59.072 INFO:tasks.workunit.client.0.smithi088.stdout:5/227: dread d2/f5 [0,4194304] 0 2024-09-17T04:20:59.077 INFO:tasks.workunit.client.0.smithi088.stdout:4/268: dread - d5/f4e zero size 2024-09-17T04:20:59.077 INFO:tasks.workunit.client.1.smithi134.stdout:9/994: rmdir d2/d5/d9/d6b/de1/d126 39 2024-09-17T04:20:59.077 INFO:tasks.workunit.client.1.smithi134.stdout:7/476: dwrite d0/dd/d3a/d3d/d38/f1d [0,4194304] 0 2024-09-17T04:20:59.078 INFO:tasks.workunit.client.1.smithi134.stdout:9/995: chown d2/d5/d9/df/d13c/d1e/d127/d14b/de3/f136 799934 1 2024-09-17T04:20:59.078 INFO:tasks.workunit.client.1.smithi134.stdout:5/584: rename d0/d3a/fc to d0/d3a/d6b/d9c/fc4 0 2024-09-17T04:20:59.078 INFO:tasks.workunit.client.0.smithi088.stdout:6/216: dwrite d14/d15/d16/f2e [0,4194304] 0 2024-09-17T04:20:59.078 INFO:tasks.workunit.client.0.smithi088.stdout:6/217: dread - d14/d15/d16/f51 zero size 2024-09-17T04:20:59.080 INFO:tasks.workunit.client.0.smithi088.stdout:4/269: symlink d5/d3f/l54 0 2024-09-17T04:20:59.082 INFO:tasks.workunit.client.1.smithi134.stdout:8/535: getdents d4/d23/d60/d6b/d13 0 2024-09-17T04:20:59.084 INFO:tasks.workunit.client.0.smithi088.stdout:1/195: creat d0/f41 x:0 0 0 2024-09-17T04:20:59.085 INFO:tasks.workunit.client.1.smithi134.stdout:4/651: dread d0/d13/f14 [0,4194304] 0 2024-09-17T04:20:59.086 INFO:tasks.workunit.client.1.smithi134.stdout:4/652: write d0/df/d1e/d73/f95 [1259741,60938] 0 2024-09-17T04:20:59.088 INFO:tasks.workunit.client.1.smithi134.stdout:6/708: rename f7 to de/d19/d1f/d55/d77/db8/dc7/fe2 0 2024-09-17T04:20:59.088 INFO:tasks.workunit.client.1.smithi134.stdout:4/653: write d0/d13/f8d [4559876,87793] 0 2024-09-17T04:20:59.089 INFO:tasks.workunit.client.0.smithi088.stdout:9/271: getdents d2/dd/d14 0 2024-09-17T04:20:59.090 INFO:tasks.workunit.client.1.smithi134.stdout:4/654: chown d0/df/d35/d5c/d8b/fc0 3 1 2024-09-17T04:20:59.091 INFO:tasks.workunit.client.0.smithi088.stdout:5/228: creat d2/d31/d33/d20/d47/f48 x:0 0 0 2024-09-17T04:20:59.092 INFO:tasks.workunit.client.1.smithi134.stdout:4/655: write d0/df/d35/d5c/d8b/fc0 [846907,31] 0 2024-09-17T04:20:59.092 INFO:tasks.workunit.client.0.smithi088.stdout:5/229: readlink d2/l1e 0 2024-09-17T04:20:59.092 INFO:tasks.workunit.client.1.smithi134.stdout:4/656: write d0/df/d1e/f2e [1961849,85264] 0 2024-09-17T04:20:59.093 INFO:tasks.workunit.client.0.smithi088.stdout:1/196: mkdir d0/d1/d16/d35/d42 0 2024-09-17T04:20:59.095 INFO:tasks.workunit.client.0.smithi088.stdout:9/272: chown d2/cf 2056326816 1 2024-09-17T04:20:59.098 INFO:tasks.workunit.client.0.smithi088.stdout:5/230: mkdir d2/d31/d33/d20/d25/d49 0 2024-09-17T04:20:59.100 INFO:tasks.workunit.client.1.smithi134.stdout:7/477: rename d0/d16/d35/d4b/d8a to d0/dd/d3a/d3d/d38/d74/d98 0 2024-09-17T04:20:59.100 INFO:tasks.workunit.client.0.smithi088.stdout:1/197: creat d0/d1/d16/d35/f43 x:0 0 0 2024-09-17T04:20:59.101 INFO:tasks.workunit.client.0.smithi088.stdout:1/198: truncate d0/d1/df/f3e 780403 0 2024-09-17T04:20:59.102 INFO:tasks.workunit.client.0.smithi088.stdout:9/273: creat d2/dd/d11/d1d/d35/f5f x:0 0 0 2024-09-17T04:20:59.102 INFO:tasks.workunit.client.0.smithi088.stdout:1/199: write d0/d1/df/d20/f2e [249457,15937] 0 2024-09-17T04:20:59.103 INFO:tasks.workunit.client.1.smithi134.stdout:6/709: mkdir de/d19/d1f/d55/d77/d89/de3 0 2024-09-17T04:20:59.155 INFO:tasks.workunit.client.1.smithi134.stdout:2/587: sync 2024-09-17T04:20:59.158 INFO:tasks.workunit.client.1.smithi134.stdout:2/588: dread d19/f22 [0,4194304] 0 2024-09-17T04:20:59.199 INFO:tasks.workunit.client.1.smithi134.stdout:3/711: sync 2024-09-17T04:20:59.200 INFO:tasks.workunit.client.1.smithi134.stdout:5/585: mkdir d0/da/d69/d41/db6/dc5 0 2024-09-17T04:20:59.201 INFO:tasks.workunit.client.0.smithi088.stdout:5/231: chown d2/c19 18011491 1 2024-09-17T04:20:59.202 INFO:tasks.workunit.client.0.smithi088.stdout:9/274: creat d2/dd/d14/d2a/f60 x:0 0 0 2024-09-17T04:20:59.203 INFO:tasks.workunit.client.1.smithi134.stdout:9/996: mknod d2/d5/d37/d83/d12a/d54/daf/d6d/d12c/c14f 0 2024-09-17T04:20:59.204 INFO:tasks.workunit.client.0.smithi088.stdout:1/200: fsync d0/f3b 0 2024-09-17T04:20:59.205 INFO:tasks.workunit.client.0.smithi088.stdout:4/270: link d5/d3d/c43 d5/d3d/c55 0 2024-09-17T04:20:59.208 INFO:tasks.workunit.client.1.smithi134.stdout:8/536: creat d4/d1f/d25/fa4 x:0 0 0 2024-09-17T04:20:59.210 INFO:tasks.workunit.client.1.smithi134.stdout:1/656: getdents d12/d19/d1d/d61/dd3 0 2024-09-17T04:20:59.213 INFO:tasks.workunit.client.0.smithi088.stdout:5/232: truncate d2/f1c 1367922 0 2024-09-17T04:20:59.213 INFO:tasks.workunit.client.1.smithi134.stdout:7/478: dwrite d0/d16/d35/d4b/f48 [0,4194304] 0 2024-09-17T04:20:59.215 INFO:tasks.workunit.client.1.smithi134.stdout:7/479: dread - d0/dd/d3a/d3d/d38/d74/d98/f94 zero size 2024-09-17T04:20:59.216 INFO:tasks.workunit.client.1.smithi134.stdout:2/589: unlink d19/f7b 0 2024-09-17T04:20:59.216 INFO:tasks.workunit.client.0.smithi088.stdout:1/201: dwrite d0/d1/d16/d35/f36 [0,4194304] 0 2024-09-17T04:20:59.216 INFO:tasks.workunit.client.1.smithi134.stdout:2/590: chown d19/d1c 18794 1 2024-09-17T04:20:59.216 INFO:tasks.workunit.client.1.smithi134.stdout:3/712: rmdir de/d12/d15/d9f 39 2024-09-17T04:20:59.217 INFO:tasks.workunit.client.1.smithi134.stdout:6/710: dwrite fb [0,4194304] 0 2024-09-17T04:20:59.219 INFO:tasks.workunit.client.1.smithi134.stdout:2/591: readlink d19/d27/d31/l61 0 2024-09-17T04:20:59.221 INFO:tasks.workunit.client.0.smithi088.stdout:1/202: read d0/d1/df/d20/f2e [32381,78756] 0 2024-09-17T04:20:59.221 INFO:tasks.workunit.client.0.smithi088.stdout:5/233: dwrite d2/d31/d33/fa [0,4194304] 0 2024-09-17T04:20:59.222 INFO:tasks.workunit.client.0.smithi088.stdout:5/234: chown d2/d31/d33/d20/f2e 9 1 2024-09-17T04:20:59.225 INFO:tasks.workunit.client.1.smithi134.stdout:9/997: mkdir d2/d7/d75/d96/d150 0 2024-09-17T04:20:59.227 INFO:tasks.workunit.client.0.smithi088.stdout:9/275: link d2/c4 d2/dd/d11/d4f/d5c/c61 0 2024-09-17T04:20:59.230 INFO:tasks.workunit.client.1.smithi134.stdout:4/657: unlink d0/d13/d40/c41 0 2024-09-17T04:20:59.231 INFO:tasks.workunit.client.0.smithi088.stdout:1/203: creat d0/d13/f44 x:0 0 0 2024-09-17T04:20:59.231 INFO:tasks.workunit.client.1.smithi134.stdout:4/658: write d0/df/d35/d5c/f81 [767746,66828] 0 2024-09-17T04:20:59.233 INFO:tasks.workunit.client.1.smithi134.stdout:8/537: mkdir d4/db/dd/d43/da5 0 2024-09-17T04:20:59.236 INFO:tasks.workunit.client.1.smithi134.stdout:1/657: unlink d12/d1c/d56/c7b 0 2024-09-17T04:20:59.239 INFO:tasks.workunit.client.0.smithi088.stdout:9/276: creat d2/dd/d11/d30/f62 x:0 0 0 2024-09-17T04:20:59.241 INFO:tasks.workunit.client.0.smithi088.stdout:1/204: rename d0/d1/l24 to d0/d1/d27/l45 0 2024-09-17T04:20:59.242 INFO:tasks.workunit.client.0.smithi088.stdout:4/271: write d5/fb [4736448,62209] 0 2024-09-17T04:20:59.243 INFO:tasks.workunit.client.1.smithi134.stdout:3/713: creat de/d12/d15/dd0/fe8 x:0 0 0 2024-09-17T04:20:59.243 INFO:tasks.workunit.client.0.smithi088.stdout:4/272: read - d5/d3d/d49/f52 zero size 2024-09-17T04:20:59.245 INFO:tasks.workunit.client.0.smithi088.stdout:5/235: creat d2/d31/d33/d20/d25/d49/f4a x:0 0 0 2024-09-17T04:20:59.249 INFO:tasks.workunit.client.1.smithi134.stdout:3/714: dwrite de/d10/d3d/f94 [0,4194304] 0 2024-09-17T04:20:59.249 INFO:tasks.workunit.client.1.smithi134.stdout:2/592: creat d19/d1c/d92/fc5 x:0 0 0 2024-09-17T04:20:59.249 INFO:tasks.workunit.client.0.smithi088.stdout:4/273: mknod d5/d3d/d49/c56 0 2024-09-17T04:20:59.250 INFO:tasks.workunit.client.1.smithi134.stdout:2/593: write d19/d1c/f2d [4235616,125931] 0 2024-09-17T04:20:59.251 INFO:tasks.workunit.client.1.smithi134.stdout:9/998: mknod d2/d5/d9/df/d13c/d1e/d127/d14b/c151 0 2024-09-17T04:20:59.251 INFO:tasks.workunit.client.0.smithi088.stdout:5/236: dwrite d2/d31/d33/d20/f23 [0,4194304] 0 2024-09-17T04:20:59.252 INFO:tasks.workunit.client.1.smithi134.stdout:2/594: read d19/d27/d31/d34/fbd [2518682,58364] 0 2024-09-17T04:20:59.258 INFO:tasks.workunit.client.1.smithi134.stdout:8/538: symlink d4/d1f/d2b/la6 0 2024-09-17T04:20:59.259 INFO:tasks.workunit.client.0.smithi088.stdout:5/237: dwrite d2/d31/d33/d20/f46 [0,4194304] 0 2024-09-17T04:20:59.261 INFO:tasks.workunit.client.0.smithi088.stdout:1/205: unlink d0/c14 0 2024-09-17T04:20:59.265 INFO:tasks.workunit.client.1.smithi134.stdout:6/711: symlink de/d19/le4 0 2024-09-17T04:20:59.269 INFO:tasks.workunit.client.1.smithi134.stdout:1/658: dread d12/d1c/d2e/f3b [0,4194304] 0 2024-09-17T04:20:59.270 INFO:tasks.workunit.client.1.smithi134.stdout:3/715: stat de/d12/d15/d9f/dba 0 2024-09-17T04:20:59.272 INFO:tasks.workunit.client.0.smithi088.stdout:5/238: creat d2/d31/d33/d20/d25/d2c/f4b x:0 0 0 2024-09-17T04:20:59.274 INFO:tasks.workunit.client.1.smithi134.stdout:5/586: truncate d0/da/d2c/f4b 3966932 0 2024-09-17T04:20:59.275 INFO:tasks.workunit.client.0.smithi088.stdout:9/277: getdents d2/dd/d11/d4f/d5c 0 2024-09-17T04:20:59.276 INFO:tasks.workunit.client.0.smithi088.stdout:9/278: read d2/dd/f1b [1058405,70330] 0 2024-09-17T04:20:59.277 INFO:tasks.workunit.client.0.smithi088.stdout:5/239: mknod d2/d31/c4c 0 2024-09-17T04:20:59.277 INFO:tasks.workunit.client.0.smithi088.stdout:5/240: chown d2/d31/d33/d20/d30/l3b 98567 1 2024-09-17T04:20:59.278 INFO:tasks.workunit.client.1.smithi134.stdout:2/595: rename d19/d77 to d19/d1c/da3/dc6 0 2024-09-17T04:20:59.279 INFO:tasks.workunit.client.0.smithi088.stdout:5/241: readlink d2/d31/d33/d20/d25/l43 0 2024-09-17T04:20:59.279 INFO:tasks.workunit.client.0.smithi088.stdout:9/279: dread d2/dd/d11/f25 [0,4194304] 0 2024-09-17T04:20:59.280 INFO:tasks.workunit.client.1.smithi134.stdout:4/659: fsync d0/df/d1e/dbc/fc6 0 2024-09-17T04:20:59.281 INFO:tasks.workunit.client.1.smithi134.stdout:3/716: dread de/d10/f64 [0,4194304] 0 2024-09-17T04:20:59.285 INFO:tasks.workunit.client.1.smithi134.stdout:8/539: unlink d4/db/dd/d43/f94 0 2024-09-17T04:20:59.285 INFO:tasks.workunit.client.1.smithi134.stdout:8/540: write d4/d1e/f9b [230107,94875] 0 2024-09-17T04:20:59.286 INFO:tasks.workunit.client.1.smithi134.stdout:3/717: chown de/d12/d15/d1d/d2d/d31/lb9 78481 1 2024-09-17T04:20:59.286 INFO:tasks.workunit.client.0.smithi088.stdout:5/242: dwrite d2/d31/d33/d20/f2e [0,4194304] 0 2024-09-17T04:20:59.286 INFO:tasks.workunit.client.0.smithi088.stdout:9/280: unlink d2/l48 0 2024-09-17T04:20:59.287 INFO:tasks.workunit.client.1.smithi134.stdout:5/587: dread d0/d3a/d2b/faf [0,4194304] 0 2024-09-17T04:20:59.287 INFO:tasks.workunit.client.1.smithi134.stdout:5/588: readlink d0/da/d29/l6e 0 2024-09-17T04:20:59.288 INFO:tasks.workunit.client.1.smithi134.stdout:5/589: readlink d0/da/d2c/l3e 0 2024-09-17T04:20:59.288 INFO:tasks.workunit.client.1.smithi134.stdout:5/590: stat d0/d48/lbf 0 2024-09-17T04:20:59.289 INFO:tasks.workunit.client.1.smithi134.stdout:0/582: sync 2024-09-17T04:20:59.290 INFO:tasks.workunit.client.1.smithi134.stdout:0/583: stat d11/d19/d21/l50 0 2024-09-17T04:20:59.294 INFO:tasks.workunit.client.0.smithi088.stdout:9/281: creat d2/dd/d11/d4f/f63 x:0 0 0 2024-09-17T04:20:59.296 INFO:tasks.workunit.client.1.smithi134.stdout:6/712: rename de/d19/d62/d34/c58 to de/d19/d1f/d55/d77/db8/dc7/ddc/db3/db4/ce5 0 2024-09-17T04:20:59.297 INFO:tasks.workunit.client.1.smithi134.stdout:0/584: dread d11/f3b [0,4194304] 0 2024-09-17T04:20:59.299 INFO:tasks.workunit.client.0.smithi088.stdout:4/274: dwrite d5/d3f/f3b [0,4194304] 0 2024-09-17T04:20:59.299 INFO:tasks.workunit.client.1.smithi134.stdout:6/713: chown de/d19/d1f/d55/d77/db8/dc7/ddc/db3/db4/dd7 5 1 2024-09-17T04:20:59.299 INFO:tasks.workunit.client.1.smithi134.stdout:2/596: mknod d19/d1c/d47/d50/d85/d93/cc7 0 2024-09-17T04:20:59.299 INFO:tasks.workunit.client.0.smithi088.stdout:5/243: dwrite d2/f15 [0,4194304] 0 2024-09-17T04:20:59.300 INFO:tasks.workunit.client.1.smithi134.stdout:2/597: write d19/d1c/f2d [801573,27532] 0 2024-09-17T04:20:59.305 INFO:tasks.workunit.client.0.smithi088.stdout:9/282: write d2/dd/d11/d1d/f24 [1997717,124368] 0 2024-09-17T04:20:59.305 INFO:tasks.workunit.client.1.smithi134.stdout:1/659: symlink d12/d19/d1d/d5f/ddc/ldf 0 2024-09-17T04:20:59.305 INFO:tasks.workunit.client.1.smithi134.stdout:0/585: dwrite d11/d6f/fb4 [0,4194304] 0 2024-09-17T04:20:59.309 INFO:tasks.workunit.client.1.smithi134.stdout:3/718: symlink de/d10/d70/le9 0 2024-09-17T04:20:59.309 INFO:tasks.workunit.client.1.smithi134.stdout:7/480: sync 2024-09-17T04:20:59.311 INFO:tasks.workunit.client.1.smithi134.stdout:3/719: readlink de/l38 0 2024-09-17T04:20:59.311 INFO:tasks.workunit.client.0.smithi088.stdout:5/244: mknod d2/c4d 0 2024-09-17T04:20:59.313 INFO:tasks.workunit.client.1.smithi134.stdout:7/481: fsync d0/dd/d3a/d3d/d38/d74/d98/f90 0 2024-09-17T04:20:59.313 INFO:tasks.workunit.client.1.smithi134.stdout:5/591: mknod d0/da/d69/d41/db6/cc6 0 2024-09-17T04:20:59.321 INFO:tasks.workunit.client.1.smithi134.stdout:8/541: rename f0 to d4/d11/da1/fa7 0 2024-09-17T04:20:59.323 INFO:tasks.workunit.client.0.smithi088.stdout:5/245: unlink d2/d31/d33/l14 0 2024-09-17T04:20:59.323 INFO:tasks.workunit.client.0.smithi088.stdout:5/246: read - d2/d31/d33/f37 zero size 2024-09-17T04:20:59.324 INFO:tasks.workunit.client.1.smithi134.stdout:6/714: mkdir de/d19/da3/de6 0 2024-09-17T04:20:59.326 INFO:tasks.workunit.client.0.smithi088.stdout:9/283: fdatasync d2/dd/d14/f20 0 2024-09-17T04:20:59.327 INFO:tasks.workunit.client.0.smithi088.stdout:5/247: creat d2/d31/d33/d20/d30/f4e x:0 0 0 2024-09-17T04:20:59.330 INFO:tasks.workunit.client.1.smithi134.stdout:2/598: mkdir d19/d1c/d47/dae/dc8 0 2024-09-17T04:20:59.331 INFO:tasks.workunit.client.0.smithi088.stdout:9/284: dread - d2/f26 zero size 2024-09-17T04:20:59.331 INFO:tasks.workunit.client.1.smithi134.stdout:2/599: chown d19/d27/d31/d49/d63/la2 465240588 1 2024-09-17T04:20:59.331 INFO:tasks.workunit.client.1.smithi134.stdout:2/600: stat d19/d27/d31/d34/fbd 0 2024-09-17T04:20:59.333 INFO:tasks.workunit.client.1.smithi134.stdout:0/586: creat d11/d4c/fca x:0 0 0 2024-09-17T04:20:59.333 INFO:tasks.workunit.client.0.smithi088.stdout:4/275: truncate d5/fb 2467970 0 2024-09-17T04:20:59.334 INFO:tasks.workunit.client.1.smithi134.stdout:0/587: truncate d11/d22/f3a 4493367 0 2024-09-17T04:20:59.335 INFO:tasks.workunit.client.0.smithi088.stdout:5/248: mknod d2/c4f 0 2024-09-17T04:20:59.336 INFO:tasks.workunit.client.1.smithi134.stdout:7/482: mknod d0/d16/d8b/d6a/c99 0 2024-09-17T04:20:59.337 INFO:tasks.workunit.client.1.smithi134.stdout:2/601: dwrite d19/d27/d31/d49/d6f/fa6 [0,4194304] 0 2024-09-17T04:20:59.338 INFO:tasks.workunit.client.1.smithi134.stdout:5/592: mknod d0/da/d29/d78/cc7 0 2024-09-17T04:20:59.342 INFO:tasks.workunit.client.0.smithi088.stdout:4/276: unlink d5/fd 0 2024-09-17T04:20:59.343 INFO:tasks.workunit.client.1.smithi134.stdout:9/999: getdents d2/d5/d9/df/d13c/d1e/d127/d14b/de3 0 2024-09-17T04:20:59.346 INFO:tasks.workunit.client.0.smithi088.stdout:9/285: rename d2/dd/d11/d30/l53 to d2/d2b/d2e/l64 0 2024-09-17T04:20:59.349 INFO:tasks.workunit.client.1.smithi134.stdout:7/483: dread d0/d16/f26 [0,4194304] 0 2024-09-17T04:20:59.351 INFO:tasks.workunit.client.0.smithi088.stdout:4/277: creat d5/d32/f57 x:0 0 0 2024-09-17T04:20:59.352 INFO:tasks.workunit.client.1.smithi134.stdout:1/660: dread d12/d19/d4f/f7f [0,4194304] 0 2024-09-17T04:20:59.353 INFO:tasks.workunit.client.1.smithi134.stdout:8/542: creat d4/d1e/d8a/fa8 x:0 0 0 2024-09-17T04:20:59.353 INFO:tasks.workunit.client.1.smithi134.stdout:1/661: dread - d12/d1c/d2e/f5a zero size 2024-09-17T04:20:59.354 INFO:tasks.workunit.client.1.smithi134.stdout:8/543: read - d4/d23/f84 zero size 2024-09-17T04:20:59.356 INFO:tasks.workunit.client.0.smithi088.stdout:9/286: mknod d2/dd/d11/d4f/c65 0 2024-09-17T04:20:59.359 INFO:tasks.workunit.client.1.smithi134.stdout:4/660: mknod d0/d13/d40/d42/d92/d65/dc2/cd4 0 2024-09-17T04:20:59.361 INFO:tasks.workunit.client.0.smithi088.stdout:5/249: rename d2/f1c to d2/d31/d33/d20/d25/d2c/f50 0 2024-09-17T04:20:59.361 INFO:tasks.workunit.client.0.smithi088.stdout:4/278: chown d5/d3d/d49/l4f 719359231 1 2024-09-17T04:20:59.362 INFO:tasks.workunit.client.1.smithi134.stdout:6/715: write de/d19/d1f/d55/f63 [4194526,120718] 0 2024-09-17T04:20:59.362 INFO:tasks.workunit.client.1.smithi134.stdout:6/716: write de/d19/d21/d2d/f6a [1803176,83896] 0 2024-09-17T04:20:59.364 INFO:tasks.workunit.client.1.smithi134.stdout:0/588: creat d11/d19/d21/d37/fcb x:0 0 0 2024-09-17T04:20:59.368 INFO:tasks.workunit.client.0.smithi088.stdout:9/287: dwrite d2/fc [4194304,4194304] 0 2024-09-17T04:20:59.370 INFO:tasks.workunit.client.0.smithi088.stdout:9/288: symlink d2/dd/d14/d2a/l66 0 2024-09-17T04:20:59.371 INFO:tasks.workunit.client.0.smithi088.stdout:9/289: stat d2/d16/c5e 0 2024-09-17T04:20:59.372 INFO:tasks.workunit.client.1.smithi134.stdout:7/484: creat d0/dd/d3a/f9a x:0 0 0 2024-09-17T04:20:59.372 INFO:tasks.workunit.client.1.smithi134.stdout:7/485: stat d0/dd/d3a 0 2024-09-17T04:20:59.373 INFO:tasks.workunit.client.1.smithi134.stdout:7/486: chown d0/d16/l31 280129 1 2024-09-17T04:20:59.374 INFO:tasks.workunit.client.1.smithi134.stdout:1/662: mknod d12/d36/ce0 0 2024-09-17T04:20:59.375 INFO:tasks.workunit.client.1.smithi134.stdout:4/661: mkdir d0/df/dd5 0 2024-09-17T04:20:59.375 INFO:tasks.workunit.client.0.smithi088.stdout:4/279: dwrite d5/f20 [4194304,4194304] 0 2024-09-17T04:20:59.376 INFO:tasks.workunit.client.1.smithi134.stdout:6/717: stat de/c84 0 2024-09-17T04:20:59.376 INFO:tasks.workunit.client.1.smithi134.stdout:6/718: chown de 415318858 1 2024-09-17T04:20:59.377 INFO:tasks.workunit.client.1.smithi134.stdout:0/589: creat d11/d22/d1c/fcc x:0 0 0 2024-09-17T04:20:59.378 INFO:tasks.workunit.client.0.smithi088.stdout:9/290: dread d2/dd/f15 [0,4194304] 0 2024-09-17T04:20:59.378 INFO:tasks.workunit.client.0.smithi088.stdout:5/250: dread d2/d31/d33/d20/d25/d2c/f3c [0,4194304] 0 2024-09-17T04:20:59.382 INFO:tasks.workunit.client.0.smithi088.stdout:4/280: readlink d5/l24 0 2024-09-17T04:20:59.382 INFO:tasks.workunit.client.1.smithi134.stdout:5/593: getdents d0/da/d69/d41/db6/dc5 0 2024-09-17T04:20:59.383 INFO:tasks.workunit.client.0.smithi088.stdout:4/281: write d5/d3d/d49/f52 [95842,125898] 0 2024-09-17T04:20:59.385 INFO:tasks.workunit.client.1.smithi134.stdout:3/720: rename de/d12/d9d/fdc to de/d12/fea 0 2024-09-17T04:20:59.386 INFO:tasks.workunit.client.1.smithi134.stdout:8/544: rename d4 to d4/d11/da1/da9 22 2024-09-17T04:20:59.386 INFO:tasks.workunit.client.0.smithi088.stdout:4/282: dread d5/f21 [0,4194304] 0 2024-09-17T04:20:59.387 INFO:tasks.workunit.client.0.smithi088.stdout:5/251: mkdir d2/d31/d33/d20/d30/d51 0 2024-09-17T04:20:59.391 INFO:tasks.workunit.client.1.smithi134.stdout:3/721: dread de/d12/d15/d1d/d2d/d31/d6a/d78/d7c/fb0 [0,4194304] 0 2024-09-17T04:20:59.392 INFO:tasks.workunit.client.1.smithi134.stdout:6/719: mknod de/d19/d62/d34/d3b/ce7 0 2024-09-17T04:20:59.393 INFO:tasks.workunit.client.1.smithi134.stdout:5/594: dwrite d0/f3c [0,4194304] 0 2024-09-17T04:20:59.393 INFO:tasks.workunit.client.0.smithi088.stdout:9/291: link d2/d16/c47 d2/d2b/c67 0 2024-09-17T04:20:59.394 INFO:tasks.workunit.client.1.smithi134.stdout:7/487: dwrite d0/dd/d3a/d3d/d38/d74/f7f [0,4194304] 0 2024-09-17T04:20:59.395 INFO:tasks.workunit.client.1.smithi134.stdout:0/590: creat d11/d24/d49/d9b/fcd x:0 0 0 2024-09-17T04:20:59.396 INFO:tasks.workunit.client.0.smithi088.stdout:4/283: dwrite d5/f2d [0,4194304] 0 2024-09-17T04:20:59.397 INFO:tasks.workunit.client.0.smithi088.stdout:4/284: fsync d5/f1f 0 2024-09-17T04:20:59.400 INFO:tasks.workunit.client.0.smithi088.stdout:9/292: unlink d2/dd/f4a 0 2024-09-17T04:20:59.401 INFO:tasks.workunit.client.1.smithi134.stdout:7/488: truncate d0/dd/d3a/d3d/d4c/f7a 699604 0 2024-09-17T04:20:59.401 INFO:tasks.workunit.client.0.smithi088.stdout:5/252: dwrite d2/f10 [4194304,4194304] 0 2024-09-17T04:20:59.402 INFO:tasks.workunit.client.1.smithi134.stdout:1/663: creat d12/dcc/fe1 x:0 0 0 2024-09-17T04:20:59.402 INFO:tasks.workunit.client.1.smithi134.stdout:2/602: dwrite d19/da1/fb9 [0,4194304] 0 2024-09-17T04:20:59.403 INFO:tasks.workunit.client.1.smithi134.stdout:7/489: fdatasync d0/dd/d3a/d3d/d38/f23 0 2024-09-17T04:20:59.404 INFO:tasks.workunit.client.1.smithi134.stdout:8/545: rmdir d4/db/dd/d95 39 2024-09-17T04:20:59.405 INFO:tasks.workunit.client.1.smithi134.stdout:8/546: chown d4/f82 1218010 1 2024-09-17T04:20:59.410 INFO:tasks.workunit.client.0.smithi088.stdout:9/293: mknod d2/d2b/c68 0 2024-09-17T04:20:59.411 INFO:tasks.workunit.client.0.smithi088.stdout:5/253: dwrite d2/d31/d33/f1b [0,4194304] 0 2024-09-17T04:20:59.413 INFO:tasks.workunit.client.0.smithi088.stdout:4/285: unlink d5/d3d/c43 0 2024-09-17T04:20:59.414 INFO:tasks.workunit.client.1.smithi134.stdout:6/720: mknod de/d19/d62/db0/ce8 0 2024-09-17T04:20:59.416 INFO:tasks.workunit.client.1.smithi134.stdout:3/722: rename de/d10/d3d/dd9/dbd/dc6 to de/d12/d15/d1d/d8f/deb 0 2024-09-17T04:20:59.416 INFO:tasks.workunit.client.0.smithi088.stdout:5/254: creat d2/d31/d33/d20/d25/d2c/f52 x:0 0 0 2024-09-17T04:20:59.417 INFO:tasks.workunit.client.1.smithi134.stdout:3/723: write de/d10/f79 [964544,51121] 0 2024-09-17T04:20:59.421 INFO:tasks.workunit.client.0.smithi088.stdout:5/255: mknod d2/d31/d33/d20/d47/c53 0 2024-09-17T04:20:59.422 INFO:tasks.workunit.client.1.smithi134.stdout:7/490: creat d0/d16/d8b/f9b x:0 0 0 2024-09-17T04:20:59.424 INFO:tasks.workunit.client.0.smithi088.stdout:5/256: creat d2/d31/d33/f54 x:0 0 0 2024-09-17T04:20:59.426 INFO:tasks.workunit.client.0.smithi088.stdout:5/257: write d2/d31/d33/f37 [43898,96876] 0 2024-09-17T04:20:59.426 INFO:tasks.workunit.client.1.smithi134.stdout:5/595: link d0/f47 d0/da/d69/d41/d6d/d89/fc8 0 2024-09-17T04:20:59.427 INFO:tasks.workunit.client.0.smithi088.stdout:4/286: getdents d5/d3d/d49 0 2024-09-17T04:20:59.428 INFO:tasks.workunit.client.0.smithi088.stdout:5/258: rmdir d2/d31/d33/d20 39 2024-09-17T04:20:59.429 INFO:tasks.workunit.client.1.smithi134.stdout:7/491: dwrite d0/d16/d8b/d6a/d70/d85/f93 [0,4194304] 0 2024-09-17T04:20:59.430 INFO:tasks.workunit.client.1.smithi134.stdout:7/492: dread - d0/dd/d3a/d3d/d38/d74/d98/f90 zero size 2024-09-17T04:20:59.430 INFO:tasks.workunit.client.1.smithi134.stdout:1/664: rename d12/d1c/f2f to d12/d19/d1d/d61/fe2 0 2024-09-17T04:20:59.431 INFO:tasks.workunit.client.0.smithi088.stdout:4/287: mknod d5/d3d/d49/c58 0 2024-09-17T04:20:59.433 INFO:tasks.workunit.client.1.smithi134.stdout:0/591: mkdir d11/d24/d49/d62/dce 0 2024-09-17T04:20:59.434 INFO:tasks.workunit.client.0.smithi088.stdout:4/288: dread d5/d3f/f3b [0,4194304] 0 2024-09-17T04:20:59.435 INFO:tasks.workunit.client.0.smithi088.stdout:5/259: read - d2/d31/d33/d20/d25/d49/f4a zero size 2024-09-17T04:20:59.437 INFO:tasks.workunit.client.0.smithi088.stdout:5/260: write d2/d31/d33/d20/d25/d2c/f4b [19647,105011] 0 2024-09-17T04:20:59.438 INFO:tasks.workunit.client.1.smithi134.stdout:1/665: dwrite d12/d19/d5d/d88/fd6 [0,4194304] 0 2024-09-17T04:20:59.443 INFO:tasks.workunit.client.1.smithi134.stdout:3/724: symlink de/d12/d15/d1d/d2d/d31/d6a/d83/dd8/lec 0 2024-09-17T04:20:59.443 INFO:tasks.workunit.client.1.smithi134.stdout:3/725: fdatasync de/d10/f68 0 2024-09-17T04:20:59.444 INFO:tasks.workunit.client.0.smithi088.stdout:5/261: dwrite d2/d31/d33/d20/f23 [0,4194304] 0 2024-09-17T04:20:59.445 INFO:tasks.workunit.client.1.smithi134.stdout:4/662: getdents d0/df 0 2024-09-17T04:20:59.445 INFO:tasks.workunit.client.1.smithi134.stdout:3/726: dread de/d12/d15/d1d/d2d/d31/d6a/fbf [0,4194304] 0 2024-09-17T04:20:59.446 INFO:tasks.workunit.client.1.smithi134.stdout:4/663: dread - d0/df/d35/d5c/d8b/fc4 zero size 2024-09-17T04:20:59.449 INFO:tasks.workunit.client.1.smithi134.stdout:5/596: rmdir d0/da/d29/d8e 39 2024-09-17T04:20:59.452 INFO:tasks.workunit.client.0.smithi088.stdout:5/262: chown d2/l1e 32716 1 2024-09-17T04:20:59.454 INFO:tasks.workunit.client.1.smithi134.stdout:6/721: rename de/d19/d74/d94/d9e/fb1 to de/d19/d62/db0/fe9 0 2024-09-17T04:20:59.461 INFO:tasks.workunit.client.1.smithi134.stdout:2/603: rmdir d19/d27/d31/d49/d6f/d84/d98/d9d 0 2024-09-17T04:20:59.461 INFO:tasks.workunit.client.1.smithi134.stdout:1/666: mkdir d12/d1c/d56/de3 0 2024-09-17T04:20:59.462 INFO:tasks.workunit.client.0.smithi088.stdout:5/263: creat d2/d31/d33/d20/f55 x:0 0 0 2024-09-17T04:20:59.465 INFO:tasks.workunit.client.1.smithi134.stdout:4/664: mkdir d0/df/dd6 0 2024-09-17T04:20:59.466 INFO:tasks.workunit.client.0.smithi088.stdout:4/289: getdents d5/d3d 0 2024-09-17T04:20:59.467 INFO:tasks.workunit.client.1.smithi134.stdout:8/547: dwrite d4/f26 [0,4194304] 0 2024-09-17T04:20:59.470 INFO:tasks.workunit.client.0.smithi088.stdout:5/264: rename d2/d31/d33/d20/d25/d2c/l3f to d2/d31/d33/d20/d25/d2c/l56 0 2024-09-17T04:20:59.471 INFO:tasks.workunit.client.1.smithi134.stdout:6/722: symlink de/d19/d1f/d55/lea 0 2024-09-17T04:20:59.473 INFO:tasks.workunit.client.1.smithi134.stdout:6/723: dread de/d19/d21/f25 [0,4194304] 0 2024-09-17T04:20:59.474 INFO:tasks.workunit.client.0.smithi088.stdout:4/290: dread d5/f1f [0,4194304] 0 2024-09-17T04:20:59.475 INFO:tasks.workunit.client.0.smithi088.stdout:4/291: readlink d5/l12 0 2024-09-17T04:20:59.480 INFO:tasks.workunit.client.0.smithi088.stdout:4/292: unlink d5/d3f/c53 0 2024-09-17T04:20:59.481 INFO:tasks.workunit.client.0.smithi088.stdout:5/265: dwrite d2/d31/d33/fc [4194304,4194304] 0 2024-09-17T04:20:59.482 INFO:tasks.workunit.client.1.smithi134.stdout:5/597: symlink d0/da/d69/lc9 0 2024-09-17T04:20:59.482 INFO:tasks.workunit.client.1.smithi134.stdout:1/667: dwrite d12/d19/d1d/d61/fe2 [0,4194304] 0 2024-09-17T04:20:59.483 INFO:tasks.workunit.client.0.smithi088.stdout:4/293: symlink d5/d32/l59 0 2024-09-17T04:20:59.488 INFO:tasks.workunit.client.0.smithi088.stdout:4/294: symlink d5/l5a 0 2024-09-17T04:20:59.489 INFO:tasks.workunit.client.1.smithi134.stdout:0/592: write d11/d22/d1c/f80 [998533,80057] 0 2024-09-17T04:20:59.492 INFO:tasks.workunit.client.0.smithi088.stdout:4/295: symlink d5/d32/l5b 0 2024-09-17T04:20:59.497 INFO:tasks.workunit.client.1.smithi134.stdout:8/548: write d4/d1f/d2b/f2f [1231087,61374] 0 2024-09-17T04:20:59.497 INFO:tasks.workunit.client.1.smithi134.stdout:3/727: rename de/d12/d15/d1d/d2d/d63/fc7 to de/d12/d15/d1d/d2d/d31/d6a/fed 0 2024-09-17T04:20:59.497 INFO:tasks.workunit.client.0.smithi088.stdout:5/266: truncate d2/f10 5167884 0 2024-09-17T04:20:59.498 INFO:tasks.workunit.client.1.smithi134.stdout:3/728: chown de/d12/d15 32009 1 2024-09-17T04:20:59.498 INFO:tasks.workunit.client.1.smithi134.stdout:2/604: dread d19/d27/d31/f5c [0,4194304] 0 2024-09-17T04:20:59.499 INFO:tasks.workunit.client.1.smithi134.stdout:7/493: getdents d0/d16/d35/d4b 0 2024-09-17T04:20:59.499 INFO:tasks.workunit.client.1.smithi134.stdout:6/724: mknod de/ceb 0 2024-09-17T04:20:59.499 INFO:tasks.workunit.client.0.smithi088.stdout:4/296: dwrite d5/d3f/f39 [0,4194304] 0 2024-09-17T04:20:59.501 INFO:tasks.workunit.client.0.smithi088.stdout:5/267: write d2/f1d [1723332,6861] 0 2024-09-17T04:20:59.505 INFO:tasks.workunit.client.1.smithi134.stdout:1/668: dread d12/d1c/d2e/d7d/fa7 [0,4194304] 0 2024-09-17T04:20:59.510 INFO:tasks.workunit.client.0.smithi088.stdout:5/268: fsync d2/d31/d33/d20/f23 0 2024-09-17T04:20:59.515 INFO:tasks.workunit.client.0.smithi088.stdout:5/269: fsync d2/f40 0 2024-09-17T04:20:59.518 INFO:tasks.workunit.client.0.smithi088.stdout:5/270: creat d2/d31/d33/d20/d25/f57 x:0 0 0 2024-09-17T04:20:59.523 INFO:tasks.workunit.client.1.smithi134.stdout:3/729: mknod de/d12/d15/d1d/d8f/deb/cee 0 2024-09-17T04:20:59.524 INFO:tasks.workunit.client.1.smithi134.stdout:0/593: link d11/d6f/da8/fb2 d11/d18/d97/fcf 0 2024-09-17T04:20:59.524 INFO:tasks.workunit.client.1.smithi134.stdout:2/605: symlink d19/d27/d31/d49/d6f/da9/lc9 0 2024-09-17T04:20:59.525 INFO:tasks.workunit.client.1.smithi134.stdout:2/606: fdatasync d19/d1c/d47/dae/fc4 0 2024-09-17T04:20:59.526 INFO:tasks.workunit.client.1.smithi134.stdout:7/494: creat d0/dd/d3a/d3d/d38/d74/d98/f9c x:0 0 0 2024-09-17T04:20:59.526 INFO:tasks.workunit.client.1.smithi134.stdout:4/665: getdents d0/d13/d40/d42/d92/d86 0 2024-09-17T04:20:59.526 INFO:tasks.workunit.client.1.smithi134.stdout:4/666: chown d0/ld 595808 1 2024-09-17T04:20:59.527 INFO:tasks.workunit.client.1.smithi134.stdout:2/607: write d19/d1c/d47/dae/fc4 [266885,66740] 0 2024-09-17T04:20:59.527 INFO:tasks.workunit.client.1.smithi134.stdout:6/725: rename de/d19/d1f/d55/d77/c91 to de/d19/d1f/d55/d77/db8/cec 0 2024-09-17T04:20:59.527 INFO:tasks.workunit.client.1.smithi134.stdout:1/669: creat d12/d19/d1d/d5f/ddc/fe4 x:0 0 0 2024-09-17T04:20:59.528 INFO:tasks.workunit.client.1.smithi134.stdout:8/549: truncate d4/f36 1792512 0 2024-09-17T04:20:59.529 INFO:tasks.workunit.client.1.smithi134.stdout:3/730: symlink de/d10/d3d/d4f/lef 0 2024-09-17T04:20:59.529 INFO:tasks.workunit.client.1.smithi134.stdout:0/594: mknod d11/d19/d21/d37/cd0 0 2024-09-17T04:20:59.530 INFO:tasks.workunit.client.1.smithi134.stdout:5/598: getdents d0/da/d29/d78/da5 0 2024-09-17T04:20:59.533 INFO:tasks.workunit.client.1.smithi134.stdout:0/595: rename d11/d24/f47 to d11/d48/fd1 0 2024-09-17T04:20:59.534 INFO:tasks.workunit.client.1.smithi134.stdout:0/596: dread - d11/d19/f8d zero size 2024-09-17T04:20:59.535 INFO:tasks.workunit.client.1.smithi134.stdout:4/667: read d0/df/d1e/f5e [1969630,87688] 0 2024-09-17T04:20:59.536 INFO:tasks.workunit.client.1.smithi134.stdout:1/670: link d12/d19/d1d/f44 d12/d19/d1d/d61/fe5 0 2024-09-17T04:20:59.540 INFO:tasks.workunit.client.1.smithi134.stdout:5/599: dwrite d0/da/d69/d41/d6d/d89/fb4 [0,4194304] 0 2024-09-17T04:20:59.541 INFO:tasks.workunit.client.1.smithi134.stdout:0/597: mkdir d11/d48/dd2 0 2024-09-17T04:20:59.542 INFO:tasks.workunit.client.1.smithi134.stdout:2/608: getdents d19/d27/d31 0 2024-09-17T04:20:59.543 INFO:tasks.workunit.client.1.smithi134.stdout:8/550: link d4/db/dd/c39 d4/db/dd/d43/d8b/caa 0 2024-09-17T04:20:59.543 INFO:tasks.workunit.client.1.smithi134.stdout:5/600: rmdir d0/d3a/d2b/d5a 39 2024-09-17T04:20:59.545 INFO:tasks.workunit.client.1.smithi134.stdout:1/671: getdents d12/d19/d5d/d91/dac/dd5 0 2024-09-17T04:20:59.546 INFO:tasks.workunit.client.1.smithi134.stdout:0/598: write d11/d22/d1c/f54 [4343423,34425] 0 2024-09-17T04:20:59.546 INFO:tasks.workunit.client.1.smithi134.stdout:1/672: chown d12/d19/d66 7904 1 2024-09-17T04:20:59.547 INFO:tasks.workunit.client.1.smithi134.stdout:0/599: chown d11/d48 1818781 1 2024-09-17T04:20:59.547 INFO:tasks.workunit.client.1.smithi134.stdout:8/551: symlink d4/d23/d60/d6b/d5e/lab 0 2024-09-17T04:20:59.548 INFO:tasks.workunit.client.1.smithi134.stdout:4/668: creat d0/df/fd7 x:0 0 0 2024-09-17T04:20:59.549 INFO:tasks.workunit.client.1.smithi134.stdout:1/673: write d12/d19/f54 [208552,121589] 0 2024-09-17T04:20:59.550 INFO:tasks.workunit.client.1.smithi134.stdout:0/600: write d11/d18/f1f [1068371,20567] 0 2024-09-17T04:20:59.551 INFO:tasks.workunit.client.1.smithi134.stdout:2/609: dwrite d19/d1c/d47/dae/fc4 [0,4194304] 0 2024-09-17T04:20:59.554 INFO:tasks.workunit.client.1.smithi134.stdout:5/601: creat d0/d3a/fca x:0 0 0 2024-09-17T04:20:59.555 INFO:tasks.workunit.client.1.smithi134.stdout:0/601: chown d11/d18/f1f 1 1 2024-09-17T04:20:59.558 INFO:tasks.workunit.client.0.smithi088.stdout:7/268: sync 2024-09-17T04:20:59.558 INFO:tasks.workunit.client.0.smithi088.stdout:2/251: sync 2024-09-17T04:20:59.558 INFO:tasks.workunit.client.0.smithi088.stdout:8/192: sync 2024-09-17T04:20:59.558 INFO:tasks.workunit.client.0.smithi088.stdout:0/122: sync 2024-09-17T04:20:59.558 INFO:tasks.workunit.client.0.smithi088.stdout:3/144: sync 2024-09-17T04:20:59.558 INFO:tasks.workunit.client.0.smithi088.stdout:6/218: sync 2024-09-17T04:20:59.559 INFO:tasks.workunit.client.1.smithi134.stdout:3/731: truncate de/d10/d70/f87 506001 0 2024-09-17T04:20:59.560 INFO:tasks.workunit.client.1.smithi134.stdout:1/674: mknod d12/d19/d1d/d61/dd3/dda/d85/ce6 0 2024-09-17T04:20:59.560 INFO:tasks.workunit.client.0.smithi088.stdout:2/252: stat d0/d1/l47 0 2024-09-17T04:20:59.561 INFO:tasks.workunit.client.0.smithi088.stdout:0/123: write db/f1d [358988,99951] 0 2024-09-17T04:20:59.561 INFO:tasks.workunit.client.1.smithi134.stdout:0/602: chown d11/d4c/d76/c83 859 1 2024-09-17T04:20:59.561 INFO:tasks.workunit.client.1.smithi134.stdout:2/610: mkdir d19/d27/d31/d49/d6f/da9/db0/dca 0 2024-09-17T04:20:59.561 INFO:tasks.workunit.client.0.smithi088.stdout:8/193: chown d7/dd/f16 3 1 2024-09-17T04:20:59.563 INFO:tasks.workunit.client.0.smithi088.stdout:6/219: creat d14/d15/d2a/f5a x:0 0 0 2024-09-17T04:20:59.563 INFO:tasks.workunit.client.0.smithi088.stdout:3/145: mkdir d0/d13/d1b/d29 0 2024-09-17T04:20:59.563 INFO:tasks.workunit.client.0.smithi088.stdout:0/124: read db/fc [139425,2726] 0 2024-09-17T04:20:59.564 INFO:tasks.workunit.client.0.smithi088.stdout:6/220: dread - d14/f56 zero size 2024-09-17T04:20:59.564 INFO:tasks.workunit.client.1.smithi134.stdout:8/552: dwrite d4/d23/d60/d6b/d5e/f9e [0,4194304] 0 2024-09-17T04:20:59.564 INFO:tasks.workunit.client.1.smithi134.stdout:4/669: rename d0/d13/f1f to d0/df/fd8 0 2024-09-17T04:20:59.565 INFO:tasks.workunit.client.0.smithi088.stdout:3/146: rename d0/d13/d1b to d0/d13/d1b/d29/d2a 22 2024-09-17T04:20:59.565 INFO:tasks.workunit.client.0.smithi088.stdout:7/269: symlink d2/d1e/d23/d45/l5c 0 2024-09-17T04:20:59.566 INFO:tasks.workunit.client.1.smithi134.stdout:3/732: fsync de/d12/d15/d1d/d2d/d63/fae 0 2024-09-17T04:20:59.566 INFO:tasks.workunit.client.1.smithi134.stdout:6/726: dwrite de/d19/d21/f64 [0,4194304] 0 2024-09-17T04:20:59.567 INFO:tasks.workunit.client.1.smithi134.stdout:1/675: creat d12/d19/d5d/d91/fe7 x:0 0 0 2024-09-17T04:20:59.567 INFO:tasks.workunit.client.0.smithi088.stdout:7/270: stat d2/d4/f18 0 2024-09-17T04:20:59.567 INFO:tasks.workunit.client.1.smithi134.stdout:6/727: stat de/d19/d21/d2d 0 2024-09-17T04:20:59.568 INFO:tasks.workunit.client.0.smithi088.stdout:2/253: mkdir d0/d1/d2d/d33/d4b/d24/d4d 0 2024-09-17T04:20:59.569 INFO:tasks.workunit.client.0.smithi088.stdout:2/254: fsync d0/d18/f3e 0 2024-09-17T04:20:59.569 INFO:tasks.workunit.client.0.smithi088.stdout:7/271: readlink d2/d1e/d23/d45/l51 0 2024-09-17T04:20:59.571 INFO:tasks.workunit.client.1.smithi134.stdout:2/611: fsync d19/d27/d31/d34/d42/f5e 0 2024-09-17T04:20:59.574 INFO:tasks.workunit.client.0.smithi088.stdout:8/194: dwrite d7/dd/f28 [0,4194304] 0 2024-09-17T04:20:59.578 INFO:tasks.workunit.client.0.smithi088.stdout:6/221: rename d14/d3a/d41/c43 to d14/d15/d16/c5b 0 2024-09-17T04:20:59.581 INFO:tasks.workunit.client.1.smithi134.stdout:5/602: rename d0/da/d69/d41/d72/c7e to d0/da/d29/db5/ccb 0 2024-09-17T04:20:59.582 INFO:tasks.workunit.client.1.smithi134.stdout:5/603: write d0/da/d69/d41/fb2 [112433,49198] 0 2024-09-17T04:20:59.584 INFO:tasks.workunit.client.0.smithi088.stdout:7/272: dwrite d2/d1e/f3b [4194304,4194304] 0 2024-09-17T04:20:59.585 INFO:tasks.workunit.client.1.smithi134.stdout:3/733: mkdir de/d12/d15/d9f/dba/df0 0 2024-09-17T04:20:59.586 INFO:tasks.workunit.client.1.smithi134.stdout:3/734: dread - de/d12/d9d/dd4/fdb zero size 2024-09-17T04:20:59.587 INFO:tasks.workunit.client.0.smithi088.stdout:6/222: dwrite f4 [8388608,4194304] 0 2024-09-17T04:20:59.592 INFO:tasks.workunit.client.0.smithi088.stdout:8/195: creat d7/d29/f3c x:0 0 0 2024-09-17T04:20:59.601 INFO:tasks.workunit.client.0.smithi088.stdout:2/255: rename d0/d1/d2d/d33/d4b/f3d to d0/d1/d2d/d33/d4b/d24/d3b/d26/f4e 0 2024-09-17T04:20:59.601 INFO:tasks.workunit.client.0.smithi088.stdout:6/223: rename d14/d44/d45/d4d to d14/d44/d45/d4d/d5c 22 2024-09-17T04:20:59.602 INFO:tasks.workunit.client.0.smithi088.stdout:6/224: fdatasync d14/d15/d2a/f50 0 2024-09-17T04:20:59.603 INFO:tasks.workunit.client.0.smithi088.stdout:3/147: mkdir d0/d13/d1b/d29/d2b 0 2024-09-17T04:20:59.603 INFO:tasks.workunit.client.0.smithi088.stdout:3/148: fsync d0/d13/f24 0 2024-09-17T04:20:59.620 INFO:tasks.workunit.client.1.smithi134.stdout:2/612: creat d19/d1c/d47/d50/fcb x:0 0 0 2024-09-17T04:20:59.620 INFO:tasks.workunit.client.1.smithi134.stdout:8/553: unlink d4/l1d 0 2024-09-17T04:20:59.620 INFO:tasks.workunit.client.1.smithi134.stdout:0/603: rename d11/d22/d1c to d11/d4c/dd3 0 2024-09-17T04:20:59.621 INFO:tasks.workunit.client.1.smithi134.stdout:5/604: creat d0/da/d2c/d73/fcc x:0 0 0 2024-09-17T04:20:59.621 INFO:tasks.workunit.client.1.smithi134.stdout:4/670: creat d0/df/d17/fd9 x:0 0 0 2024-09-17T04:20:59.622 INFO:tasks.workunit.client.1.smithi134.stdout:1/676: write d12/db2/fc1 [931982,113550] 0 2024-09-17T04:20:59.622 INFO:tasks.workunit.client.1.smithi134.stdout:8/554: fdatasync d4/f82 0 2024-09-17T04:20:59.623 INFO:tasks.workunit.client.1.smithi134.stdout:2/613: read d19/f76 [1304759,102608] 0 2024-09-17T04:20:59.623 INFO:tasks.workunit.client.1.smithi134.stdout:1/677: fsync d12/dcc/fe1 0 2024-09-17T04:20:59.624 INFO:tasks.workunit.client.1.smithi134.stdout:3/735: creat de/d10/d3d/dd9/ff1 x:0 0 0 2024-09-17T04:20:59.628 INFO:tasks.workunit.client.1.smithi134.stdout:4/671: creat d0/df/d1e/d73/fda x:0 0 0 2024-09-17T04:20:59.628 INFO:tasks.workunit.client.1.smithi134.stdout:5/605: truncate d0/da/d29/d8e/fb9 889476 0 2024-09-17T04:20:59.630 INFO:tasks.workunit.client.1.smithi134.stdout:2/614: dwrite d19/d7e/f81 [0,4194304] 0 2024-09-17T04:20:59.630 INFO:tasks.workunit.client.1.smithi134.stdout:8/555: rename d4/d11/f47 to d4/d1f/d2b/fac 0 2024-09-17T04:20:59.630 INFO:tasks.workunit.client.1.smithi134.stdout:3/736: rmdir de/d10/d3d 39 2024-09-17T04:20:59.631 INFO:tasks.workunit.client.1.smithi134.stdout:1/678: truncate d12/f42 549321 0 2024-09-17T04:20:59.634 INFO:tasks.workunit.client.1.smithi134.stdout:4/672: mkdir d0/df/d1e/d73/ddb 0 2024-09-17T04:20:59.635 INFO:tasks.workunit.client.1.smithi134.stdout:5/606: symlink d0/da/d69/d41/d72/lcd 0 2024-09-17T04:20:59.636 INFO:tasks.workunit.client.1.smithi134.stdout:8/556: chown d4/db/d6e 11519350 1 2024-09-17T04:20:59.636 INFO:tasks.workunit.client.1.smithi134.stdout:1/679: dread d12/db2/fc1 [0,4194304] 0 2024-09-17T04:20:59.636 INFO:tasks.workunit.client.1.smithi134.stdout:2/615: fsync d19/d27/d31/d34/f70 0 2024-09-17T04:20:59.637 INFO:tasks.workunit.client.1.smithi134.stdout:8/557: stat d4/d23/l4e 0 2024-09-17T04:20:59.637 INFO:tasks.workunit.client.1.smithi134.stdout:4/673: readlink d0/d13/d40/d42/l55 0 2024-09-17T04:20:59.638 INFO:tasks.workunit.client.1.smithi134.stdout:2/616: chown d19/d1c/d47/d50/f7c 10732 1 2024-09-17T04:20:59.638 INFO:tasks.workunit.client.1.smithi134.stdout:4/674: write d0/df/d1e/daa/fb0 [961596,1754] 0 2024-09-17T04:20:59.641 INFO:tasks.workunit.client.1.smithi134.stdout:5/607: mkdir d0/da/d29/d78/da5/dce 0 2024-09-17T04:20:59.643 INFO:tasks.workunit.client.1.smithi134.stdout:5/608: fsync d0/da/d29/f4e 0 2024-09-17T04:20:59.643 INFO:tasks.workunit.client.1.smithi134.stdout:1/680: creat d12/d1c/d2e/fe8 x:0 0 0 2024-09-17T04:20:59.644 INFO:tasks.workunit.client.1.smithi134.stdout:0/604: dwrite d11/d19/d21/f60 [0,4194304] 0 2024-09-17T04:20:59.644 INFO:tasks.workunit.client.1.smithi134.stdout:8/558: symlink d4/d1f/d86/lad 0 2024-09-17T04:20:59.646 INFO:tasks.workunit.client.1.smithi134.stdout:4/675: unlink d0/df/d1e/d73/l9e 0 2024-09-17T04:20:59.647 INFO:tasks.workunit.client.1.smithi134.stdout:1/681: read d12/d19/d1d/d61/fe5 [3240784,30053] 0 2024-09-17T04:20:59.648 INFO:tasks.workunit.client.1.smithi134.stdout:0/605: creat d11/d24/d49/d62/daf/fd4 x:0 0 0 2024-09-17T04:20:59.651 INFO:tasks.workunit.client.1.smithi134.stdout:5/609: truncate d0/da/d29/d78/da5/fb1 1155745 0 2024-09-17T04:20:59.653 INFO:tasks.workunit.client.1.smithi134.stdout:5/610: write d0/f79 [1683656,52469] 0 2024-09-17T04:20:59.653 INFO:tasks.workunit.client.1.smithi134.stdout:2/617: truncate d19/d1c/d47/d50/d85/f9b 1410114 0 2024-09-17T04:20:59.655 INFO:tasks.workunit.client.1.smithi134.stdout:8/559: dwrite d4/f8d [4194304,4194304] 0 2024-09-17T04:20:59.656 INFO:tasks.workunit.client.1.smithi134.stdout:1/682: rename d12/d19/d5d/d88/fa5 to d12/d19/d1d/d61/fe9 0 2024-09-17T04:20:59.657 INFO:tasks.workunit.client.1.smithi134.stdout:1/683: write d12/d1c/d2e/d7d/f97 [4891000,8856] 0 2024-09-17T04:20:59.660 INFO:tasks.workunit.client.1.smithi134.stdout:7/495: sync 2024-09-17T04:20:59.662 INFO:tasks.workunit.client.1.smithi134.stdout:8/560: creat d4/db/d6e/fae x:0 0 0 2024-09-17T04:20:59.662 INFO:tasks.workunit.client.1.smithi134.stdout:0/606: creat d11/fd5 x:0 0 0 2024-09-17T04:20:59.665 INFO:tasks.workunit.client.1.smithi134.stdout:1/684: mkdir d12/d1c/d2e/dea 0 2024-09-17T04:20:59.665 INFO:tasks.workunit.client.1.smithi134.stdout:8/561: chown d4/d11/l76 1003 1 2024-09-17T04:20:59.665 INFO:tasks.workunit.client.1.smithi134.stdout:7/496: stat d0/f6 0 2024-09-17T04:20:59.666 INFO:tasks.workunit.client.1.smithi134.stdout:5/611: rmdir d0/d3a/d6b/d9c/dad 39 2024-09-17T04:20:59.666 INFO:tasks.workunit.client.1.smithi134.stdout:4/676: dwrite d0/d13/d40/d42/d92/d7b/fc8 [0,4194304] 0 2024-09-17T04:20:59.668 INFO:tasks.workunit.client.1.smithi134.stdout:0/607: stat d11/d4c/dd3/d2f/c82 0 2024-09-17T04:20:59.668 INFO:tasks.workunit.client.1.smithi134.stdout:7/497: readlink d0/dd/d3a/d3d/d4c/l79 0 2024-09-17T04:20:59.670 INFO:tasks.workunit.client.1.smithi134.stdout:8/562: rename d4/d23 to d4/d1e/daf 0 2024-09-17T04:20:59.672 INFO:tasks.workunit.client.1.smithi134.stdout:0/608: readlink d11/d4c/dd3/d2f/d43/d5d/la7 0 2024-09-17T04:20:59.673 INFO:tasks.workunit.client.1.smithi134.stdout:0/609: write d11/f3b [2199147,109960] 0 2024-09-17T04:20:59.678 INFO:tasks.workunit.client.1.smithi134.stdout:0/610: dread d11/d19/d21/d37/faa [0,4194304] 0 2024-09-17T04:20:59.678 INFO:tasks.workunit.client.0.smithi088.stdout:6/225: unlink d14/l19 0 2024-09-17T04:20:59.679 INFO:tasks.workunit.client.1.smithi134.stdout:2/618: dread d19/d27/d31/d34/d42/f54 [0,4194304] 0 2024-09-17T04:20:59.679 INFO:tasks.workunit.client.0.smithi088.stdout:3/149: dwrite d0/f12 [0,4194304] 0 2024-09-17T04:20:59.679 INFO:tasks.workunit.client.0.smithi088.stdout:2/256: rename d0/d3f to d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f 0 2024-09-17T04:20:59.680 INFO:tasks.workunit.client.0.smithi088.stdout:7/273: link d2/d1e/f29 d2/d1e/d23/d45/f5d 0 2024-09-17T04:20:59.680 INFO:tasks.workunit.client.1.smithi134.stdout:4/677: write d0/d13/d40/d42/f87 [739139,20776] 0 2024-09-17T04:20:59.681 INFO:tasks.workunit.client.0.smithi088.stdout:6/226: write d14/d15/d16/f51 [643437,53842] 0 2024-09-17T04:20:59.682 INFO:tasks.workunit.client.0.smithi088.stdout:3/150: write d0/fb [906839,33888] 0 2024-09-17T04:20:59.682 INFO:tasks.workunit.client.1.smithi134.stdout:1/685: rename d12/d1c/d2e/d7d/fa7 to d12/d19/d1d/d61/da0/feb 0 2024-09-17T04:20:59.684 INFO:tasks.workunit.client.0.smithi088.stdout:0/125: link ca db/d1a/d20/c27 0 2024-09-17T04:20:59.684 INFO:tasks.workunit.client.0.smithi088.stdout:7/274: dread - d2/d1e/d23/d45/f5d zero size 2024-09-17T04:20:59.684 INFO:tasks.workunit.client.0.smithi088.stdout:2/257: readlink d0/d1/d2d/d33/d4b/d24/d3b/l1a 0 2024-09-17T04:20:59.684 INFO:tasks.workunit.client.1.smithi134.stdout:1/686: chown d12/d19/d5d 11709 1 2024-09-17T04:20:59.684 INFO:tasks.workunit.client.0.smithi088.stdout:3/151: fsync d0/fa 0 2024-09-17T04:20:59.686 INFO:tasks.workunit.client.0.smithi088.stdout:3/152: chown d0/l20 274990355 1 2024-09-17T04:20:59.687 INFO:tasks.workunit.client.1.smithi134.stdout:0/611: read d11/d19/d21/f5f [1985061,12942] 0 2024-09-17T04:20:59.688 INFO:tasks.workunit.client.0.smithi088.stdout:2/258: dread - d0/d1/d2d/d33/d4b/d24/f2a zero size 2024-09-17T04:20:59.689 INFO:tasks.workunit.client.1.smithi134.stdout:8/563: write d4/d1e/daf/d60/d6b/d13/f61 [1826660,76787] 0 2024-09-17T04:20:59.690 INFO:tasks.workunit.client.1.smithi134.stdout:0/612: write d11/d19/f98 [227189,58303] 0 2024-09-17T04:20:59.690 INFO:tasks.workunit.client.1.smithi134.stdout:4/678: dwrite d0/df/d1e/d73/fda [0,4194304] 0 2024-09-17T04:20:59.697 INFO:tasks.workunit.client.0.smithi088.stdout:6/227: dwrite d14/d15/d16/f26 [0,4194304] 0 2024-09-17T04:20:59.697 INFO:tasks.workunit.client.0.smithi088.stdout:6/228: write f11 [4203441,98412] 0 2024-09-17T04:20:59.697 INFO:tasks.workunit.client.0.smithi088.stdout:0/126: dwrite db/f25 [0,4194304] 0 2024-09-17T04:20:59.697 INFO:tasks.workunit.client.0.smithi088.stdout:7/275: creat d2/d1e/f5e x:0 0 0 2024-09-17T04:20:59.698 INFO:tasks.workunit.client.1.smithi134.stdout:5/612: dread d0/d3a/f3b [0,4194304] 0 2024-09-17T04:20:59.698 INFO:tasks.workunit.client.1.smithi134.stdout:1/687: rmdir d12/d19/d5d/d88 39 2024-09-17T04:20:59.698 INFO:tasks.workunit.client.1.smithi134.stdout:1/688: chown d12/d1c/dc0 65 1 2024-09-17T04:20:59.698 INFO:tasks.workunit.client.1.smithi134.stdout:2/619: write d19/d27/d31/d34/fbd [1814870,129974] 0 2024-09-17T04:20:59.698 INFO:tasks.workunit.client.1.smithi134.stdout:5/613: truncate d0/da/d29/d8e/fb9 984535 0 2024-09-17T04:20:59.700 INFO:tasks.workunit.client.0.smithi088.stdout:3/153: unlink d0/fd 0 2024-09-17T04:20:59.701 INFO:tasks.workunit.client.0.smithi088.stdout:3/154: truncate d0/f26 1041455 0 2024-09-17T04:20:59.703 INFO:tasks.workunit.client.0.smithi088.stdout:6/229: creat d14/d44/f5d x:0 0 0 2024-09-17T04:20:59.703 INFO:tasks.workunit.client.1.smithi134.stdout:4/679: write d0/df/d35/fd1 [428257,76484] 0 2024-09-17T04:20:59.704 INFO:tasks.workunit.client.1.smithi134.stdout:0/613: rmdir d11/d4c 39 2024-09-17T04:20:59.705 INFO:tasks.workunit.client.1.smithi134.stdout:1/689: dread d12/d36/fc2 [0,4194304] 0 2024-09-17T04:20:59.706 INFO:tasks.workunit.client.1.smithi134.stdout:7/498: rename d0/d16/d35/d4b/d65/c71 to d0/d16/d8b/d6a/d70/c9d 0 2024-09-17T04:20:59.707 INFO:tasks.workunit.client.1.smithi134.stdout:6/728: sync 2024-09-17T04:20:59.708 INFO:tasks.workunit.client.0.smithi088.stdout:3/155: rmdir d0 39 2024-09-17T04:20:59.731 INFO:tasks.workunit.client.1.smithi134.stdout:5/614: dread d0/d3a/ff [4194304,4194304] 0 2024-09-17T04:20:59.741 INFO:tasks.workunit.client.1.smithi134.stdout:3/737: sync 2024-09-17T04:20:59.752 INFO:tasks.workunit.client.0.smithi088.stdout:9/294: sync 2024-09-17T04:20:59.752 INFO:tasks.workunit.client.0.smithi088.stdout:1/206: sync 2024-09-17T04:20:59.752 INFO:tasks.workunit.client.0.smithi088.stdout:9/295: readlink d2/dd/d14/l5a 0 2024-09-17T04:20:59.761 INFO:tasks.workunit.client.0.smithi088.stdout:0/127: mkdir db/d1a/d20/d28 0 2024-09-17T04:20:59.763 INFO:tasks.workunit.client.1.smithi134.stdout:2/620: creat d19/d1c/da3/dc6/dbc/fcc x:0 0 0 2024-09-17T04:20:59.764 INFO:tasks.workunit.client.1.smithi134.stdout:8/564: mknod d4/d1f/cb0 0 2024-09-17T04:20:59.770 INFO:tasks.workunit.client.1.smithi134.stdout:7/499: creat d0/d16/d8b/d6a/d70/d85/f9e x:0 0 0 2024-09-17T04:20:59.771 INFO:tasks.workunit.client.0.smithi088.stdout:6/230: unlink d14/c1f 0 2024-09-17T04:20:59.772 INFO:tasks.workunit.client.1.smithi134.stdout:6/729: chown de/d19/d1f/d55/d77/db8/dc7/ddc/c81 149399 1 2024-09-17T04:20:59.773 INFO:tasks.workunit.client.0.smithi088.stdout:7/276: creat d2/d4/d7/f5f x:0 0 0 2024-09-17T04:20:59.773 INFO:tasks.workunit.client.0.smithi088.stdout:7/277: stat d2/d4/d7/f5f 0 2024-09-17T04:20:59.774 INFO:tasks.workunit.client.0.smithi088.stdout:3/156: mknod d0/d13/d1b/d29/c2c 0 2024-09-17T04:20:59.775 INFO:tasks.workunit.client.1.smithi134.stdout:7/500: dwrite d0/dd/d3a/d3d/d4c/f7a [0,4194304] 0 2024-09-17T04:20:59.775 INFO:tasks.workunit.client.0.smithi088.stdout:3/157: fdatasync d0/f16 0 2024-09-17T04:20:59.775 INFO:tasks.workunit.client.0.smithi088.stdout:7/278: read d2/d4/f18 [3966775,97561] 0 2024-09-17T04:20:59.776 INFO:tasks.workunit.client.1.smithi134.stdout:3/738: fsync de/d12/d22/d5a/f9e 0 2024-09-17T04:20:59.777 INFO:tasks.workunit.client.0.smithi088.stdout:7/279: readlink d2/d1e/l40 0 2024-09-17T04:20:59.777 INFO:tasks.workunit.client.1.smithi134.stdout:8/565: mknod d4/db/dd/d43/cb1 0 2024-09-17T04:20:59.779 INFO:tasks.workunit.client.0.smithi088.stdout:6/231: mkdir d14/d15/d29/d5e 0 2024-09-17T04:20:59.780 INFO:tasks.workunit.client.1.smithi134.stdout:4/680: dwrite d0/df/d35/f71 [0,4194304] 0 2024-09-17T04:20:59.782 INFO:tasks.workunit.client.1.smithi134.stdout:4/681: truncate d0/d13/d40/d42/d92/dc3/fbf 2160222 0 2024-09-17T04:20:59.783 INFO:tasks.workunit.client.0.smithi088.stdout:1/207: dwrite d0/d1/df/d20/f2e [0,4194304] 0 2024-09-17T04:20:59.784 INFO:tasks.workunit.client.0.smithi088.stdout:3/158: rename d0/f3 to d0/d13/d1b/d29/f2d 0 2024-09-17T04:20:59.785 INFO:tasks.workunit.client.1.smithi134.stdout:4/682: dread d0/df/d1e/f2e [0,4194304] 0 2024-09-17T04:20:59.785 INFO:tasks.workunit.client.1.smithi134.stdout:6/730: creat de/d19/d74/d94/d9e/fed x:0 0 0 2024-09-17T04:20:59.787 INFO:tasks.workunit.client.1.smithi134.stdout:4/683: write d0/df/d1e/d73/fda [4468698,88635] 0 2024-09-17T04:20:59.787 INFO:tasks.workunit.client.0.smithi088.stdout:6/232: creat d14/d15/d29/f5f x:0 0 0 2024-09-17T04:20:59.788 INFO:tasks.workunit.client.1.smithi134.stdout:5/615: mknod d0/da/d29/d78/da5/dce/ccf 0 2024-09-17T04:20:59.788 INFO:tasks.workunit.client.1.smithi134.stdout:5/616: chown d0/d3a/l35 112139 1 2024-09-17T04:20:59.789 INFO:tasks.workunit.client.0.smithi088.stdout:9/296: getdents d2/d16 0 2024-09-17T04:20:59.789 INFO:tasks.workunit.client.1.smithi134.stdout:5/617: write d0/da/d29/d8e/faa [983263,100855] 0 2024-09-17T04:20:59.790 INFO:tasks.workunit.client.0.smithi088.stdout:9/297: write d2/d2b/d58/f5b [931663,33645] 0 2024-09-17T04:20:59.792 INFO:tasks.workunit.client.1.smithi134.stdout:7/501: rmdir d0/d16/d35/d4b 39 2024-09-17T04:20:59.794 INFO:tasks.workunit.client.1.smithi134.stdout:2/621: link d19/d1c/d47/d50/f7c d19/d1c/d47/fcd 0 2024-09-17T04:20:59.794 INFO:tasks.workunit.client.0.smithi088.stdout:3/159: rmdir d0 39 2024-09-17T04:20:59.797 INFO:tasks.workunit.client.0.smithi088.stdout:6/233: creat d14/d3a/d41/f60 x:0 0 0 2024-09-17T04:20:59.797 INFO:tasks.workunit.client.1.smithi134.stdout:3/739: read de/d10/d3d/f43 [224436,18723] 0 2024-09-17T04:20:59.798 INFO:tasks.workunit.client.0.smithi088.stdout:6/234: write d14/d15/d29/f3d [550564,23041] 0 2024-09-17T04:20:59.800 INFO:tasks.workunit.client.0.smithi088.stdout:0/128: getdents db/d1e 0 2024-09-17T04:20:59.801 INFO:tasks.workunit.client.0.smithi088.stdout:0/129: readlink db/d1a/l22 0 2024-09-17T04:20:59.801 INFO:tasks.workunit.client.1.smithi134.stdout:8/566: symlink d4/d1f/d25/lb2 0 2024-09-17T04:20:59.803 INFO:tasks.workunit.client.1.smithi134.stdout:1/690: truncate d12/f53 3929259 0 2024-09-17T04:20:59.806 INFO:tasks.workunit.client.1.smithi134.stdout:6/731: mknod de/d19/d1f/d55/d77/db8/dc7/ddc/cee 0 2024-09-17T04:20:59.808 INFO:tasks.workunit.client.0.smithi088.stdout:6/235: mkdir d14/d44/d61 0 2024-09-17T04:20:59.808 INFO:tasks.workunit.client.0.smithi088.stdout:6/236: chown d14/d15/d29/f5f 575885 1 2024-09-17T04:20:59.810 INFO:tasks.workunit.client.1.smithi134.stdout:1/691: dread d12/d1c/d2e/f67 [0,4194304] 0 2024-09-17T04:20:59.814 INFO:tasks.workunit.client.0.smithi088.stdout:7/280: rename d2/d4/f47 to d2/f60 0 2024-09-17T04:20:59.816 INFO:tasks.workunit.client.1.smithi134.stdout:2/622: creat d19/d27/d31/d49/d6f/d84/d98/fce x:0 0 0 2024-09-17T04:20:59.817 INFO:tasks.workunit.client.0.smithi088.stdout:3/160: symlink d0/d13/d1b/d29/l2e 0 2024-09-17T04:20:59.817 INFO:tasks.workunit.client.1.smithi134.stdout:2/623: write d19/d1c/d92/fc5 [965907,33088] 0 2024-09-17T04:20:59.821 INFO:tasks.workunit.client.1.smithi134.stdout:0/614: link d11/d4c/d76/c83 d11/d24/d49/d62/dce/cd6 0 2024-09-17T04:20:59.823 INFO:tasks.workunit.client.1.smithi134.stdout:8/567: mkdir d4/d11/da1/db3 0 2024-09-17T04:20:59.825 INFO:tasks.workunit.client.1.smithi134.stdout:3/740: dread de/d12/d15/d1d/d2d/d31/f3e [0,4194304] 0 2024-09-17T04:20:59.827 INFO:tasks.workunit.client.1.smithi134.stdout:8/568: write d4/d1f/d25/fa4 [615451,60893] 0 2024-09-17T04:20:59.827 INFO:tasks.workunit.client.0.smithi088.stdout:0/130: dwrite f0 [0,4194304] 0 2024-09-17T04:20:59.828 INFO:tasks.workunit.client.1.smithi134.stdout:3/741: fsync de/faf 0 2024-09-17T04:20:59.830 INFO:tasks.workunit.client.1.smithi134.stdout:6/732: creat de/d19/d1f/d55/d77/db8/fef x:0 0 0 2024-09-17T04:20:59.831 INFO:tasks.workunit.client.0.smithi088.stdout:6/237: getdents d14/d15/d2a/d52 0 2024-09-17T04:20:59.833 INFO:tasks.workunit.client.1.smithi134.stdout:4/684: mknod d0/df/cdc 0 2024-09-17T04:20:59.833 INFO:tasks.workunit.client.0.smithi088.stdout:9/298: getdents d2/d2b 0 2024-09-17T04:20:59.833 INFO:tasks.workunit.client.1.smithi134.stdout:0/615: dwrite d11/d19/f8d [0,4194304] 0 2024-09-17T04:20:59.835 INFO:tasks.workunit.client.0.smithi088.stdout:3/161: getdents d0/d13/d1b/d29/d2b 0 2024-09-17T04:20:59.836 INFO:tasks.workunit.client.1.smithi134.stdout:7/502: dwrite d0/f1b [0,4194304] 0 2024-09-17T04:20:59.836 INFO:tasks.workunit.client.1.smithi134.stdout:5/618: dwrite d0/d3a/d2b/f51 [0,4194304] 0 2024-09-17T04:20:59.837 INFO:tasks.workunit.client.1.smithi134.stdout:2/624: mkdir d19/d1c/da3/dcf 0 2024-09-17T04:20:59.837 INFO:tasks.workunit.client.0.smithi088.stdout:6/238: creat d14/d15/d16/f62 x:0 0 0 2024-09-17T04:20:59.839 INFO:tasks.workunit.client.1.smithi134.stdout:7/503: truncate d0/dd/d3a/f9a 245938 0 2024-09-17T04:20:59.841 INFO:tasks.workunit.client.0.smithi088.stdout:7/281: rename d2/d4/d7/f15 to d2/d4/d7/f61 0 2024-09-17T04:20:59.842 INFO:tasks.workunit.client.0.smithi088.stdout:7/282: chown d2/f21 263 1 2024-09-17T04:20:59.843 INFO:tasks.workunit.client.0.smithi088.stdout:7/283: chown d2/d1e/f3b 355787860 1 2024-09-17T04:20:59.845 INFO:tasks.workunit.client.0.smithi088.stdout:7/284: chown d2/d4/f14 124375352 1 2024-09-17T04:20:59.845 INFO:tasks.workunit.client.0.smithi088.stdout:9/299: dread d2/dd/fe [0,4194304] 0 2024-09-17T04:20:59.851 INFO:tasks.workunit.client.0.smithi088.stdout:0/131: rename db/d1e to db/d29 0 2024-09-17T04:20:59.854 INFO:tasks.workunit.client.1.smithi134.stdout:6/733: unlink de/d5d/d67/fc5 0 2024-09-17T04:20:59.855 INFO:tasks.workunit.client.0.smithi088.stdout:6/239: mkdir d14/d63 0 2024-09-17T04:20:59.855 INFO:tasks.workunit.client.1.smithi134.stdout:4/685: readlink d0/df/d1e/d73/l96 0 2024-09-17T04:20:59.856 INFO:tasks.workunit.client.0.smithi088.stdout:7/285: mkdir d2/d1e/d23/d45/d62 0 2024-09-17T04:20:59.857 INFO:tasks.workunit.client.1.smithi134.stdout:4/686: write d0/df/d1e/dbc/fc6 [882674,53373] 0 2024-09-17T04:20:59.858 INFO:tasks.workunit.client.0.smithi088.stdout:9/300: mknod d2/dd/d14/d2a/c69 0 2024-09-17T04:20:59.858 INFO:tasks.workunit.client.1.smithi134.stdout:4/687: truncate d0/d13/d40/d42/fb5 633719 0 2024-09-17T04:20:59.862 INFO:tasks.workunit.client.1.smithi134.stdout:7/504: symlink d0/dd/d3a/l9f 0 2024-09-17T04:20:59.863 INFO:tasks.workunit.client.1.smithi134.stdout:8/569: symlink d4/db/d6e/d9d/lb4 0 2024-09-17T04:20:59.864 INFO:tasks.workunit.client.1.smithi134.stdout:4/688: dread d0/df/d35/d5c/d8b/fc0 [0,4194304] 0 2024-09-17T04:20:59.865 INFO:tasks.workunit.client.1.smithi134.stdout:8/570: read d4/f57 [97339,73287] 0 2024-09-17T04:20:59.866 INFO:tasks.workunit.client.0.smithi088.stdout:6/240: dwrite d14/d3a/d41/f60 [0,4194304] 0 2024-09-17T04:20:59.867 INFO:tasks.workunit.client.1.smithi134.stdout:8/571: read d4/d1e/daf/d60/f7d [1469032,70147] 0 2024-09-17T04:20:59.871 INFO:tasks.workunit.client.0.smithi088.stdout:6/241: dread - d14/d15/f39 zero size 2024-09-17T04:20:59.871 INFO:tasks.workunit.client.0.smithi088.stdout:7/286: dwrite d2/d1d/f37 [0,4194304] 0 2024-09-17T04:20:59.873 INFO:tasks.workunit.client.0.smithi088.stdout:6/242: fdatasync d14/f32 0 2024-09-17T04:20:59.874 INFO:tasks.workunit.client.0.smithi088.stdout:0/132: rename f1 to db/f2a 0 2024-09-17T04:20:59.875 INFO:tasks.workunit.client.0.smithi088.stdout:3/162: dread d0/f10 [0,4194304] 0 2024-09-17T04:20:59.875 INFO:tasks.workunit.client.1.smithi134.stdout:0/616: mkdir d11/d48/dd2/dd7 0 2024-09-17T04:20:59.875 INFO:tasks.workunit.client.0.smithi088.stdout:9/301: dwrite d2/dd/d11/d1d/f37 [0,4194304] 0 2024-09-17T04:20:59.876 INFO:tasks.workunit.client.1.smithi134.stdout:0/617: write d11/d24/d49/f6a [188513,33758] 0 2024-09-17T04:20:59.877 INFO:tasks.workunit.client.1.smithi134.stdout:2/625: fsync d19/d1c/d47/d50/d85/f9b 0 2024-09-17T04:20:59.878 INFO:tasks.workunit.client.0.smithi088.stdout:6/243: chown d14/d15/d29/d3e/c47 252 1 2024-09-17T04:20:59.878 INFO:tasks.workunit.client.0.smithi088.stdout:0/133: dread - db/f12 zero size 2024-09-17T04:20:59.878 INFO:tasks.workunit.client.0.smithi088.stdout:3/163: truncate d0/d13/f17 945588 0 2024-09-17T04:20:59.880 INFO:tasks.workunit.client.0.smithi088.stdout:6/244: write d14/d15/d16/f2e [2558353,80967] 0 2024-09-17T04:20:59.883 INFO:tasks.workunit.client.0.smithi088.stdout:9/302: creat d2/d2b/d58/f6a x:0 0 0 2024-09-17T04:20:59.883 INFO:tasks.workunit.client.1.smithi134.stdout:7/505: symlink d0/dd/d3a/d3d/d38/la0 0 2024-09-17T04:20:59.884 INFO:tasks.workunit.client.0.smithi088.stdout:3/164: write d0/d13/f24 [491534,71240] 0 2024-09-17T04:20:59.885 INFO:tasks.workunit.client.0.smithi088.stdout:3/165: chown d0/d13/d1b/f1e 668382969 1 2024-09-17T04:20:59.886 INFO:tasks.workunit.client.0.smithi088.stdout:9/303: dread - d2/dd/d11/d30/d49/f42 zero size 2024-09-17T04:20:59.887 INFO:tasks.workunit.client.0.smithi088.stdout:7/287: creat d2/d1e/d23/d45/f63 x:0 0 0 2024-09-17T04:20:59.887 INFO:tasks.workunit.client.0.smithi088.stdout:9/304: write d2/dd/f4c [263860,90434] 0 2024-09-17T04:20:59.892 INFO:tasks.workunit.client.0.smithi088.stdout:6/245: fdatasync d14/d15/f22 0 2024-09-17T04:20:59.896 INFO:tasks.workunit.client.0.smithi088.stdout:3/166: mknod d0/d13/d1b/c2f 0 2024-09-17T04:20:59.896 INFO:tasks.workunit.client.1.smithi134.stdout:5/619: dread d0/d3a/d2b/d61/d7b/fae [0,4194304] 0 2024-09-17T04:20:59.902 INFO:tasks.workunit.client.1.smithi134.stdout:1/692: dwrite d12/d19/d1d/d61/f77 [0,4194304] 0 2024-09-17T04:20:59.902 INFO:tasks.workunit.client.1.smithi134.stdout:8/572: creat d4/d11/d5f/fb5 x:0 0 0 2024-09-17T04:20:59.902 INFO:tasks.workunit.client.1.smithi134.stdout:5/620: readlink d0/da/d2c/d73/d8a/l96 0 2024-09-17T04:20:59.903 INFO:tasks.workunit.client.0.smithi088.stdout:0/134: creat db/d1b/f2b x:0 0 0 2024-09-17T04:20:59.903 INFO:tasks.workunit.client.1.smithi134.stdout:4/689: dread d0/df/d1e/d73/f95 [0,4194304] 0 2024-09-17T04:20:59.906 INFO:tasks.workunit.client.0.smithi088.stdout:3/167: fsync d0/f1a 0 2024-09-17T04:20:59.906 INFO:tasks.workunit.client.1.smithi134.stdout:2/626: rename d19/d27/d31/d34/d42/f5e to d19/d27/d31/d49/d6f/da9/db0/daa/fd0 0 2024-09-17T04:20:59.909 INFO:tasks.workunit.client.1.smithi134.stdout:4/690: write d0/df/d1e/d73/f8f [62245,29375] 0 2024-09-17T04:20:59.909 INFO:tasks.workunit.client.0.smithi088.stdout:7/288: mknod d2/d4/d7/d46/c64 0 2024-09-17T04:20:59.911 INFO:tasks.workunit.client.1.smithi134.stdout:3/742: dwrite de/d10/f8c [0,4194304] 0 2024-09-17T04:20:59.911 INFO:tasks.workunit.client.0.smithi088.stdout:9/305: creat d2/dd/d11/d1d/d43/d51/f6b x:0 0 0 2024-09-17T04:20:59.912 INFO:tasks.workunit.client.1.smithi134.stdout:0/618: dwrite d11/d4c/f92 [0,4194304] 0 2024-09-17T04:20:59.913 INFO:tasks.workunit.client.0.smithi088.stdout:0/135: creat db/d1a/d20/f2c x:0 0 0 2024-09-17T04:20:59.922 INFO:tasks.workunit.client.1.smithi134.stdout:6/734: dwrite de/d19/d21/d4d/f6f [0,4194304] 0 2024-09-17T04:20:59.923 INFO:tasks.workunit.client.0.smithi088.stdout:3/168: mkdir d0/d13/d1b/d29/d30 0 2024-09-17T04:20:59.926 INFO:tasks.workunit.client.0.smithi088.stdout:7/289: creat d2/d1e/d23/d45/f65 x:0 0 0 2024-09-17T04:20:59.929 INFO:tasks.workunit.client.0.smithi088.stdout:9/306: rmdir d2/dd/d11/d30 39 2024-09-17T04:20:59.932 INFO:tasks.workunit.client.1.smithi134.stdout:5/621: rename d0/da/d29/d7c/f81 to d0/da/d2c/d73/fd0 0 2024-09-17T04:20:59.934 INFO:tasks.workunit.client.0.smithi088.stdout:0/136: symlink db/d1a/d20/l2d 0 2024-09-17T04:20:59.935 INFO:tasks.workunit.client.1.smithi134.stdout:2/627: fdatasync d19/f76 0 2024-09-17T04:20:59.935 INFO:tasks.workunit.client.0.smithi088.stdout:0/137: chown db/le 5459748 1 2024-09-17T04:20:59.936 INFO:tasks.workunit.client.1.smithi134.stdout:2/628: chown d19/d27/d31/l5d 44 1 2024-09-17T04:20:59.936 INFO:tasks.workunit.client.1.smithi134.stdout:8/573: dread d4/db/dd/d72/f88 [0,4194304] 0 2024-09-17T04:20:59.937 INFO:tasks.workunit.client.0.smithi088.stdout:9/307: dwrite d2/d16/f3f [0,4194304] 0 2024-09-17T04:20:59.942 INFO:tasks.workunit.client.1.smithi134.stdout:3/743: mkdir de/d12/d15/d1d/d2d/d31/d6a/d83/dd8/df2 0 2024-09-17T04:20:59.944 INFO:tasks.workunit.client.0.smithi088.stdout:7/290: rename d2/d1e/l40 to d2/d1e/d23/d45/l66 0 2024-09-17T04:20:59.945 INFO:tasks.workunit.client.0.smithi088.stdout:7/291: chown d2/d4/d7/l1c 5344 1 2024-09-17T04:20:59.946 INFO:tasks.workunit.client.1.smithi134.stdout:0/619: dread d11/d4c/dd3/d2f/d43/f44 [0,4194304] 0 2024-09-17T04:20:59.946 INFO:tasks.workunit.client.0.smithi088.stdout:3/169: write d0/f1a [26917,125256] 0 2024-09-17T04:20:59.948 INFO:tasks.workunit.client.0.smithi088.stdout:6/246: getdents d14/d15/d16 0 2024-09-17T04:20:59.950 INFO:tasks.workunit.client.1.smithi134.stdout:0/620: dread d11/d19/d21/f60 [0,4194304] 0 2024-09-17T04:20:59.953 INFO:tasks.workunit.client.0.smithi088.stdout:9/308: creat d2/dd/d11/d1d/d35/f6c x:0 0 0 2024-09-17T04:20:59.954 INFO:tasks.workunit.client.1.smithi134.stdout:7/506: link d0/dd/d3a/d3d/l96 d0/dd/d3a/la1 0 2024-09-17T04:20:59.954 INFO:tasks.workunit.client.1.smithi134.stdout:7/507: chown d0/d16/d35/l62 180442909 1 2024-09-17T04:20:59.957 INFO:tasks.workunit.client.1.smithi134.stdout:4/691: rename d0/d3b/ca0 to d0/d13/d40/d42/d92/cdd 0 2024-09-17T04:20:59.957 INFO:tasks.workunit.client.0.smithi088.stdout:7/292: mkdir d2/d4/d7/d46/d67 0 2024-09-17T04:20:59.958 INFO:tasks.workunit.client.1.smithi134.stdout:4/692: write d0/d13/d40/d42/d92/fcf [796276,126135] 0 2024-09-17T04:20:59.959 INFO:tasks.workunit.client.1.smithi134.stdout:5/622: unlink d0/da/d69/d41/c92 0 2024-09-17T04:20:59.959 INFO:tasks.workunit.client.0.smithi088.stdout:3/170: mknod d0/d13/d1b/d29/c31 0 2024-09-17T04:20:59.962 INFO:tasks.workunit.client.1.smithi134.stdout:5/623: dread d0/da/d69/d41/d6d/d89/fb4 [0,4194304] 0 2024-09-17T04:20:59.963 INFO:tasks.workunit.client.1.smithi134.stdout:5/624: write d0/da/d2c/d73/fcc [404472,30781] 0 2024-09-17T04:20:59.966 INFO:tasks.workunit.client.0.smithi088.stdout:9/309: symlink d2/dd/d11/d1d/d43/l6d 0 2024-09-17T04:20:59.968 INFO:tasks.workunit.client.0.smithi088.stdout:7/293: rename d2/d4/d7/d20/l43 to d2/d1e/d23/l68 0 2024-09-17T04:20:59.972 INFO:tasks.workunit.client.0.smithi088.stdout:6/247: creat d14/d15/d2a/d52/f64 x:0 0 0 2024-09-17T04:20:59.973 INFO:tasks.workunit.client.0.smithi088.stdout:6/248: chown f11 30752 1 2024-09-17T04:20:59.974 INFO:tasks.workunit.client.0.smithi088.stdout:6/249: chown d14/d15/d16/l18 1311 1 2024-09-17T04:20:59.974 INFO:tasks.workunit.client.1.smithi134.stdout:0/621: mkdir d11/d24/d49/d9b/dd8 0 2024-09-17T04:20:59.974 INFO:tasks.workunit.client.1.smithi134.stdout:0/622: write d11/d19/d21/d37/fcb [977979,13296] 0 2024-09-17T04:20:59.975 INFO:tasks.workunit.client.1.smithi134.stdout:0/623: chown d11/d4c/d76/l77 0 1 2024-09-17T04:20:59.976 INFO:tasks.workunit.client.0.smithi088.stdout:0/138: link db/c18 db/d1a/d20/d28/c2e 0 2024-09-17T04:20:59.977 INFO:tasks.workunit.client.1.smithi134.stdout:0/624: dread - d11/fd5 zero size 2024-09-17T04:20:59.977 INFO:tasks.workunit.client.0.smithi088.stdout:0/139: write db/f12 [281834,114287] 0 2024-09-17T04:20:59.978 INFO:tasks.workunit.client.0.smithi088.stdout:0/140: fsync db/f19 0 2024-09-17T04:20:59.978 INFO:tasks.workunit.client.1.smithi134.stdout:6/735: getdents de/d19/d1f/d55/d77/db8/dc7/ddc/db3/db4/dd7 0 2024-09-17T04:20:59.978 INFO:tasks.workunit.client.0.smithi088.stdout:0/141: readlink db/le 0 2024-09-17T04:20:59.980 INFO:tasks.workunit.client.1.smithi134.stdout:7/508: mknod d0/dd/d3a/ca2 0 2024-09-17T04:20:59.980 INFO:tasks.workunit.client.1.smithi134.stdout:8/574: write d4/db/fc [1711779,95641] 0 2024-09-17T04:20:59.984 INFO:tasks.workunit.client.1.smithi134.stdout:4/693: unlink d0/c5f 0 2024-09-17T04:20:59.985 INFO:tasks.workunit.client.0.smithi088.stdout:3/171: symlink d0/l32 0 2024-09-17T04:20:59.986 INFO:tasks.workunit.client.1.smithi134.stdout:3/744: write de/d12/d15/d1d/d2d/f36 [708142,85267] 0 2024-09-17T04:20:59.988 INFO:tasks.workunit.client.0.smithi088.stdout:6/250: symlink d14/d15/d2a/l65 0 2024-09-17T04:20:59.989 INFO:tasks.workunit.client.0.smithi088.stdout:6/251: chown d14/d2f/f36 12554 1 2024-09-17T04:20:59.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:59.991+0000 7f606c7e7640 1 -- 172.21.15.88:0/4256079492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6064100860 msgr2=0x7f6064100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:20:59.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:59.991+0000 7f606c7e7640 1 --2- 172.21.15.88:0/4256079492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6064100860 0x7f6064100c60 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f606000d890 tx=0x7f606002a220 comp rx=0 tx=0).stop 2024-09-17T04:20:59.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:59.991+0000 7f606c7e7640 1 -- 172.21.15.88:0/4256079492 shutdown_connections 2024-09-17T04:20:59.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:59.991+0000 7f606c7e7640 1 --2- 172.21.15.88:0/4256079492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6064101a60 0x7f6064101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:20:59.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:59.991+0000 7f606c7e7640 1 --2- 172.21.15.88:0/4256079492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6064100860 0x7f6064100c60 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:20:59.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:59.991+0000 7f606c7e7640 1 -- 172.21.15.88:0/4256079492 >> 172.21.15.88:0/4256079492 conn(0x7f60640fc010 msgr2=0x7f60640fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:20:59.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:59.991+0000 7f606c7e7640 1 -- 172.21.15.88:0/4256079492 shutdown_connections 2024-09-17T04:20:59.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:59.991+0000 7f606c7e7640 1 -- 172.21.15.88:0/4256079492 wait complete. 2024-09-17T04:20:59.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:59.992+0000 7f606c7e7640 1 Processor -- start 2024-09-17T04:20:59.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:59.992+0000 7f606c7e7640 1 -- start start 2024-09-17T04:20:59.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:59.992+0000 7f606c7e7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6064100860 0x7f606418e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:20:59.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:59.992+0000 7f606c7e7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6064101a60 0x7f606418e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:20:59.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:59.992+0000 7f606c7e7640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f6064108570 con 0x7f6064100860 2024-09-17T04:20:59.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:59.992+0000 7f606c7e7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f60641083f0 con 0x7f6064101a60 2024-09-17T04:20:59.994 INFO:tasks.workunit.client.0.smithi088.stdout:9/310: rename d2/dd/d11/d30/l40 to d2/dd/d14/d2a/l6e 0 2024-09-17T04:20:59.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:59.992+0000 7f606a583640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6064100860 0x7f606418e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:20:59.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:59.993+0000 7f606a583640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6064100860 0x7f606418e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46326/0 (socket says 172.21.15.88:46326) 2024-09-17T04:20:59.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:59.993+0000 7f606a583640 1 -- 172.21.15.88:0/2208385484 learned_addr learned my addr 172.21.15.88:0/2208385484 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:20:59.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:59.993+0000 7f6069d82640 1 --2- 172.21.15.88:0/2208385484 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6064101a60 0x7f606418e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:20:59.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:59.993+0000 7f606a583640 1 -- 172.21.15.88:0/2208385484 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6064101a60 msgr2=0x7f606418e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:20:59.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:59.993+0000 7f606a583640 1 --2- 172.21.15.88:0/2208385484 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6064101a60 0x7f606418e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:20:59.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:59.993+0000 7f606a583640 1 -- 172.21.15.88:0/2208385484 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f606418ec00 con 0x7f6064100860 2024-09-17T04:20:59.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:59.993+0000 7f606a583640 1 --2- 172.21.15.88:0/2208385484 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6064100860 0x7f606418e040 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f6060006010 tx=0x7f606002cff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:20:59.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:59.993+0000 7f605b7fe640 1 -- 172.21.15.88:0/2208385484 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6060004030 con 0x7f6064100860 2024-09-17T04:20:59.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:59.994+0000 7f605b7fe640 1 -- 172.21.15.88:0/2208385484 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f606000ccb0 con 0x7f6064100860 2024-09-17T04:20:59.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:59.994+0000 7f605b7fe640 1 -- 172.21.15.88:0/2208385484 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6060003ca0 con 0x7f6064100860 2024-09-17T04:20:59.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:59.994+0000 7f606c7e7640 1 -- 172.21.15.88:0/2208385484 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60641935e0 con 0x7f6064100860 2024-09-17T04:20:59.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:59.994+0000 7f606c7e7640 1 -- 172.21.15.88:0/2208385484 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6064193bf0 con 0x7f6064100860 2024-09-17T04:20:59.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:59.995+0000 7f606c7e7640 1 -- 172.21.15.88:0/2208385484 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6064100c60 con 0x7f6064100860 2024-09-17T04:20:59.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:59.996+0000 7f605b7fe640 1 -- 172.21.15.88:0/2208385484 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f606003a070 con 0x7f6064100860 2024-09-17T04:20:59.997 INFO:tasks.workunit.client.1.smithi134.stdout:7/509: dread d0/dd/d3a/d3d/d38/f18 [0,4194304] 0 2024-09-17T04:20:59.997 INFO:tasks.workunit.client.1.smithi134.stdout:1/693: getdents d12/db2 0 2024-09-17T04:20:59.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:59.997+0000 7f605b7fe640 1 --2- 172.21.15.88:0/2208385484 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f6050074ad0 0x7f6050076f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:20:59.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:59.997+0000 7f605b7fe640 1 -- 172.21.15.88:0/2208385484 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f6060037050 con 0x7f6064100860 2024-09-17T04:20:59.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:20:59.998+0000 7f6069d82640 1 --2- 172.21.15.88:0/2208385484 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f6050074ad0 0x7f6050076f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:21:00.000 INFO:tasks.workunit.client.0.smithi088.stdout:7/294: dwrite d2/d1e/f24 [0,4194304] 0 2024-09-17T04:21:00.001 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.000+0000 7f6069d82640 1 --2- 172.21.15.88:0/2208385484 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f6050074ad0 0x7f6050076f90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f605400f660 tx=0x7f6054005f90 comp rx=0 tx=0).ready entity=mgr.24431 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:21:00.004 INFO:tasks.workunit.client.1.smithi134.stdout:6/736: rename de/d2b/c2e to de/d19/d1f/d55/da9/cf0 0 2024-09-17T04:21:00.004 INFO:tasks.workunit.client.1.smithi134.stdout:4/694: creat d0/df/d1e/d73/dc7/fde x:0 0 0 2024-09-17T04:21:00.005 INFO:tasks.workunit.client.1.smithi134.stdout:6/737: write de/d19/d1f/d55/d77/f95 [3054012,7815] 0 2024-09-17T04:21:00.006 INFO:tasks.workunit.client.0.smithi088.stdout:9/311: write d2/dd/d11/d30/d49/f45 [4613983,45932] 0 2024-09-17T04:21:00.006 INFO:tasks.workunit.client.1.smithi134.stdout:6/738: fdatasync de/f13 0 2024-09-17T04:21:00.006 INFO:tasks.workunit.client.1.smithi134.stdout:6/739: chown de/d19/d21/d2d 2165347 1 2024-09-17T04:21:00.007 INFO:tasks.workunit.client.1.smithi134.stdout:6/740: readlink de/d19/d1f/d55/d77/d89/l9c 0 2024-09-17T04:21:00.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.008+0000 7f605b7fe640 1 -- 172.21.15.88:0/2208385484 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f6060081610 con 0x7f6064100860 2024-09-17T04:21:00.009 INFO:tasks.workunit.client.1.smithi134.stdout:3/745: creat de/d12/d22/d5a/ff3 x:0 0 0 2024-09-17T04:21:00.009 INFO:tasks.workunit.client.1.smithi134.stdout:5/625: truncate d0/d3a/d6b/d9c/fc4 2109273 0 2024-09-17T04:21:00.011 INFO:tasks.workunit.client.0.smithi088.stdout:7/295: dwrite d2/d1e/f5a [0,4194304] 0 2024-09-17T04:21:00.011 INFO:tasks.workunit.client.1.smithi134.stdout:5/626: chown d0/da/d29/d78/da5 8 1 2024-09-17T04:21:00.012 INFO:tasks.workunit.client.1.smithi134.stdout:1/694: unlink d12/d19/d5d/d91/dac/cad 0 2024-09-17T04:21:00.013 INFO:tasks.workunit.client.0.smithi088.stdout:4/297: sync 2024-09-17T04:21:00.013 INFO:tasks.workunit.client.0.smithi088.stdout:4/298: readlink d5/d3d/d49/l51 0 2024-09-17T04:21:00.014 INFO:tasks.workunit.client.1.smithi134.stdout:5/627: write d0/da/d2c/d73/fcc [501413,23264] 0 2024-09-17T04:21:00.015 INFO:tasks.workunit.client.1.smithi134.stdout:6/741: dwrite f9 [0,4194304] 0 2024-09-17T04:21:00.017 INFO:tasks.workunit.client.1.smithi134.stdout:7/510: rename d0/f53 to d0/d16/d8b/d6a/d70/fa3 0 2024-09-17T04:21:00.018 INFO:tasks.workunit.client.0.smithi088.stdout:3/172: creat d0/f33 x:0 0 0 2024-09-17T04:21:00.023 INFO:tasks.workunit.client.1.smithi134.stdout:4/695: symlink d0/df/d1e/dbc/ldf 0 2024-09-17T04:21:00.027 INFO:tasks.workunit.client.0.smithi088.stdout:9/312: mknod d2/dd/d14/c6f 0 2024-09-17T04:21:00.027 INFO:tasks.workunit.client.0.smithi088.stdout:9/313: chown d2/d16 424 1 2024-09-17T04:21:00.031 INFO:tasks.workunit.client.0.smithi088.stdout:0/142: dwrite db/f2a [0,4194304] 0 2024-09-17T04:21:00.033 INFO:tasks.workunit.client.0.smithi088.stdout:0/143: write db/f2a [4285618,76598] 0 2024-09-17T04:21:00.033 INFO:tasks.workunit.client.0.smithi088.stdout:6/252: creat d14/d15/f66 x:0 0 0 2024-09-17T04:21:00.034 INFO:tasks.workunit.client.0.smithi088.stdout:0/144: fdatasync db/f12 0 2024-09-17T04:21:00.035 INFO:tasks.workunit.client.0.smithi088.stdout:0/145: write db/f10 [4863658,37800] 0 2024-09-17T04:21:00.036 INFO:tasks.workunit.client.0.smithi088.stdout:6/253: read d14/d3a/d41/f60 [483841,105931] 0 2024-09-17T04:21:00.044 INFO:tasks.workunit.client.1.smithi134.stdout:5/628: symlink d0/da/d29/d7c/d9e/ld1 0 2024-09-17T04:21:00.045 INFO:tasks.workunit.client.1.smithi134.stdout:5/629: fsync d0/da/d69/d41/d6d/f7f 0 2024-09-17T04:21:00.045 INFO:tasks.workunit.client.1.smithi134.stdout:7/511: write d0/dd/d3a/d3d/d38/f3c [203321,71866] 0 2024-09-17T04:21:00.046 INFO:tasks.workunit.client.1.smithi134.stdout:1/695: dread d12/d1c/d2e/d7d/f98 [0,4194304] 0 2024-09-17T04:21:00.047 INFO:tasks.workunit.client.1.smithi134.stdout:1/696: readlink d12/l55 0 2024-09-17T04:21:00.048 INFO:tasks.workunit.client.1.smithi134.stdout:0/625: dread d11/d19/d21/f27 [0,4194304] 0 2024-09-17T04:21:00.048 INFO:tasks.workunit.client.1.smithi134.stdout:1/697: chown d12/d19/d1d/d3e 1 1 2024-09-17T04:21:00.049 INFO:tasks.workunit.client.1.smithi134.stdout:7/512: write d0/dd/d3a/d3d/d38/f23 [3892534,31570] 0 2024-09-17T04:21:00.050 INFO:tasks.workunit.client.1.smithi134.stdout:3/746: mkdir de/d10/d3d/df4 0 2024-09-17T04:21:00.051 INFO:tasks.workunit.client.1.smithi134.stdout:0/626: dread - d11/d19/d21/fb8 zero size 2024-09-17T04:21:00.054 INFO:tasks.workunit.client.1.smithi134.stdout:5/630: dwrite d0/da/f46 [4194304,4194304] 0 2024-09-17T04:21:00.055 INFO:tasks.workunit.client.0.smithi088.stdout:6/254: creat d14/d2f/f67 x:0 0 0 2024-09-17T04:21:00.056 INFO:tasks.workunit.client.0.smithi088.stdout:6/255: write d14/d15/d16/f26 [69238,59370] 0 2024-09-17T04:21:00.057 INFO:tasks.workunit.client.0.smithi088.stdout:6/256: chown d14/d15/c46 59348 1 2024-09-17T04:21:00.058 INFO:tasks.workunit.client.0.smithi088.stdout:4/299: mknod d5/c5c 0 2024-09-17T04:21:00.058 INFO:tasks.workunit.client.0.smithi088.stdout:6/257: fdatasync d14/d15/d29/d3e/f37 0 2024-09-17T04:21:00.061 INFO:tasks.workunit.client.0.smithi088.stdout:3/173: link d0/d13/f17 d0/d13/d1b/d29/d2b/f34 0 2024-09-17T04:21:00.062 INFO:tasks.workunit.client.1.smithi134.stdout:7/513: rmdir d0 39 2024-09-17T04:21:00.063 INFO:tasks.workunit.client.1.smithi134.stdout:4/696: dwrite d0/df/d1e/f2e [0,4194304] 0 2024-09-17T04:21:00.064 INFO:tasks.workunit.client.1.smithi134.stdout:1/698: creat d12/d19/d1d/d61/dd3/dda/fec x:0 0 0 2024-09-17T04:21:00.065 INFO:tasks.workunit.client.0.smithi088.stdout:6/258: dwrite d14/d15/f39 [0,4194304] 0 2024-09-17T04:21:00.066 INFO:tasks.workunit.client.1.smithi134.stdout:0/627: rmdir d11/d24/d49 39 2024-09-17T04:21:00.069 INFO:tasks.workunit.client.0.smithi088.stdout:4/300: mknod d5/d32/c5d 0 2024-09-17T04:21:00.071 INFO:tasks.workunit.client.1.smithi134.stdout:5/631: read d0/f39 [1600296,11815] 0 2024-09-17T04:21:00.073 INFO:tasks.workunit.client.0.smithi088.stdout:9/314: creat d2/dd/f70 x:0 0 0 2024-09-17T04:21:00.075 INFO:tasks.workunit.client.1.smithi134.stdout:4/697: symlink d0/d13/d40/d42/d92/d65/dc2/le0 0 2024-09-17T04:21:00.077 INFO:tasks.workunit.client.1.smithi134.stdout:0/628: creat d11/d18/fd9 x:0 0 0 2024-09-17T04:21:00.077 INFO:tasks.workunit.client.1.smithi134.stdout:3/747: getdents de/d67/dc5 0 2024-09-17T04:21:00.077 INFO:tasks.workunit.client.0.smithi088.stdout:9/315: write d2/d2b/f54 [373002,99391] 0 2024-09-17T04:21:00.078 INFO:tasks.workunit.client.0.smithi088.stdout:3/174: mkdir d0/d13/d1b/d29/d30/d35 0 2024-09-17T04:21:00.079 INFO:tasks.workunit.client.0.smithi088.stdout:9/316: readlink d2/dd/d14/d2a/l66 0 2024-09-17T04:21:00.080 INFO:tasks.workunit.client.1.smithi134.stdout:7/514: creat d0/d16/d8b/d6a/d70/d85/fa4 x:0 0 0 2024-09-17T04:21:00.080 INFO:tasks.workunit.client.0.smithi088.stdout:0/146: link db/c15 db/c2f 0 2024-09-17T04:21:00.081 INFO:tasks.workunit.client.0.smithi088.stdout:0/147: chown db/f10 1965500 1 2024-09-17T04:21:00.081 INFO:tasks.workunit.client.1.smithi134.stdout:7/515: fdatasync d0/dd/d3a/d3d/d4c/f76 0 2024-09-17T04:21:00.082 INFO:tasks.workunit.client.1.smithi134.stdout:7/516: chown d0/d16/d8b/d6a/d70/d85 41103 1 2024-09-17T04:21:00.083 INFO:tasks.workunit.client.0.smithi088.stdout:3/175: creat d0/d13/d1b/d29/f36 x:0 0 0 2024-09-17T04:21:00.083 INFO:tasks.workunit.client.0.smithi088.stdout:9/317: read d2/dd/d14/f20 [2898009,49578] 0 2024-09-17T04:21:00.085 INFO:tasks.workunit.client.0.smithi088.stdout:0/148: rmdir db 39 2024-09-17T04:21:00.085 INFO:tasks.workunit.client.1.smithi134.stdout:1/699: creat d12/d1c/d2e/d7d/fed x:0 0 0 2024-09-17T04:21:00.086 INFO:tasks.workunit.client.0.smithi088.stdout:9/318: chown d2/dd/d14/c2c 821853 1 2024-09-17T04:21:00.086 INFO:tasks.workunit.client.0.smithi088.stdout:9/319: dread - d2/dd/d14/d2a/f60 zero size 2024-09-17T04:21:00.087 INFO:tasks.workunit.client.0.smithi088.stdout:3/176: mknod d0/d13/d1b/d29/d30/c37 0 2024-09-17T04:21:00.088 INFO:tasks.workunit.client.1.smithi134.stdout:0/629: dwrite d11/d19/f99 [0,4194304] 0 2024-09-17T04:21:00.090 INFO:tasks.workunit.client.1.smithi134.stdout:4/698: creat d0/fe1 x:0 0 0 2024-09-17T04:21:00.090 INFO:tasks.workunit.client.1.smithi134.stdout:7/517: dwrite d0/d16/f13 [0,4194304] 0 2024-09-17T04:21:00.091 INFO:tasks.workunit.client.0.smithi088.stdout:9/320: creat d2/dd/d11/d1d/d43/d51/f71 x:0 0 0 2024-09-17T04:21:00.091 INFO:tasks.workunit.client.0.smithi088.stdout:6/259: dread d14/d15/f4b [4194304,4194304] 0 2024-09-17T04:21:00.097 INFO:tasks.workunit.client.1.smithi134.stdout:3/748: getdents de/d10/d3d 0 2024-09-17T04:21:00.097 INFO:tasks.workunit.client.0.smithi088.stdout:9/321: fdatasync d2/f50 0 2024-09-17T04:21:00.098 INFO:tasks.workunit.client.1.smithi134.stdout:3/749: stat de/d12/d15/d9f/dba/fd6 0 2024-09-17T04:21:00.098 INFO:tasks.workunit.client.1.smithi134.stdout:7/518: dread d0/dd/d3a/d3d/d38/f18 [0,4194304] 0 2024-09-17T04:21:00.099 INFO:tasks.workunit.client.0.smithi088.stdout:0/149: creat db/d1a/d20/d28/f30 x:0 0 0 2024-09-17T04:21:00.099 INFO:tasks.workunit.client.1.smithi134.stdout:7/519: chown d0/d16/f13 201676167 1 2024-09-17T04:21:00.099 INFO:tasks.workunit.client.1.smithi134.stdout:3/750: write de/d12/d22/f81 [3310982,38693] 0 2024-09-17T04:21:00.101 INFO:tasks.workunit.client.1.smithi134.stdout:1/700: unlink d12/d19/d5d/d88/c9d 0 2024-09-17T04:21:00.105 INFO:tasks.workunit.client.0.smithi088.stdout:6/260: rename d14/d15/d16/c27 to d14/d15/d16/c68 0 2024-09-17T04:21:00.106 INFO:tasks.workunit.client.0.smithi088.stdout:3/177: creat d0/f38 x:0 0 0 2024-09-17T04:21:00.106 INFO:tasks.workunit.client.1.smithi134.stdout:1/701: write d12/d36/f9c [780711,65785] 0 2024-09-17T04:21:00.106 INFO:tasks.workunit.client.1.smithi134.stdout:0/630: fdatasync d11/f7f 0 2024-09-17T04:21:00.107 INFO:tasks.workunit.client.1.smithi134.stdout:3/751: dwrite de/d12/d15/d1d/d2d/d31/d6a/d78/d7c/fcf [0,4194304] 0 2024-09-17T04:21:00.107 INFO:tasks.workunit.client.0.smithi088.stdout:6/261: dread d14/d15/d16/f2e [0,4194304] 0 2024-09-17T04:21:00.107 INFO:tasks.workunit.client.1.smithi134.stdout:5/632: dread d0/da/d29/f9b [0,4194304] 0 2024-09-17T04:21:00.108 INFO:tasks.workunit.client.0.smithi088.stdout:9/322: chown d2/d2b/c67 455 1 2024-09-17T04:21:00.110 INFO:tasks.workunit.client.1.smithi134.stdout:2/629: sync 2024-09-17T04:21:00.112 INFO:tasks.workunit.client.0.smithi088.stdout:0/150: mknod db/d1a/c31 0 2024-09-17T04:21:00.112 INFO:tasks.workunit.client.1.smithi134.stdout:0/631: dwrite d11/d48/fa1 [0,4194304] 0 2024-09-17T04:21:00.114 INFO:tasks.workunit.client.1.smithi134.stdout:0/632: write d11/d19/d21/d37/fcb [1840171,14519] 0 2024-09-17T04:21:00.115 INFO:tasks.workunit.client.0.smithi088.stdout:6/262: dwrite d14/d15/d29/f3d [0,4194304] 0 2024-09-17T04:21:00.117 INFO:tasks.workunit.client.0.smithi088.stdout:3/178: rmdir d0/d13/d1b 39 2024-09-17T04:21:00.120 INFO:tasks.workunit.client.1.smithi134.stdout:2/630: dwrite d19/d1c/d92/fb7 [0,4194304] 0 2024-09-17T04:21:00.124 INFO:tasks.workunit.client.0.smithi088.stdout:6/263: dwrite d14/d15/f39 [0,4194304] 0 2024-09-17T04:21:00.126 INFO:tasks.workunit.client.1.smithi134.stdout:7/520: unlink d0/dd/c4d 0 2024-09-17T04:21:00.127 INFO:tasks.workunit.client.0.smithi088.stdout:9/323: mkdir d2/dd/d11/d4f/d72 0 2024-09-17T04:21:00.129 INFO:tasks.workunit.client.1.smithi134.stdout:3/752: creat de/d10/d3d/ff5 x:0 0 0 2024-09-17T04:21:00.131 INFO:tasks.workunit.client.0.smithi088.stdout:0/151: creat db/d1a/d20/d28/f32 x:0 0 0 2024-09-17T04:21:00.134 INFO:tasks.workunit.client.1.smithi134.stdout:7/521: dwrite d0/dd/d3a/d3d/d4c/f7a [0,4194304] 0 2024-09-17T04:21:00.139 INFO:tasks.workunit.client.1.smithi134.stdout:3/753: read de/d12/d15/d1d/d8f/d90/fd1 [3191292,99374] 0 2024-09-17T04:21:00.139 INFO:tasks.workunit.client.1.smithi134.stdout:1/702: mknod d12/cee 0 2024-09-17T04:21:00.140 INFO:tasks.workunit.client.1.smithi134.stdout:7/522: dread d0/dd/d3a/d3d/d4c/f7a [0,4194304] 0 2024-09-17T04:21:00.140 INFO:tasks.workunit.client.1.smithi134.stdout:1/703: write d12/d19/d1d/d5f/fb0 [1538175,83021] 0 2024-09-17T04:21:00.141 INFO:tasks.workunit.client.0.smithi088.stdout:0/152: dwrite db/d1a/d20/f2c [0,4194304] 0 2024-09-17T04:21:00.141 INFO:tasks.workunit.client.0.smithi088.stdout:3/179: chown d0/d13/d1b/f27 24 1 2024-09-17T04:21:00.142 INFO:tasks.workunit.client.1.smithi134.stdout:0/633: unlink d11/d19/d21/d37/fa2 0 2024-09-17T04:21:00.144 INFO:tasks.workunit.client.0.smithi088.stdout:9/324: creat d2/dd/d14/f73 x:0 0 0 2024-09-17T04:21:00.144 INFO:tasks.workunit.client.1.smithi134.stdout:0/634: chown d11/d4c/dd3/d2f/d43/f94 1818239329 1 2024-09-17T04:21:00.145 INFO:tasks.workunit.client.1.smithi134.stdout:3/754: dwrite de/d10/f8c [4194304,4194304] 0 2024-09-17T04:21:00.146 INFO:tasks.workunit.client.0.smithi088.stdout:9/325: dread - d2/dd/d11/d1d/d35/f5f zero size 2024-09-17T04:21:00.146 INFO:tasks.workunit.client.0.smithi088.stdout:9/326: fdatasync d2/dd/d11/f25 0 2024-09-17T04:21:00.147 INFO:tasks.workunit.client.1.smithi134.stdout:0/635: chown d11/d4c/d76/lc7 430389 1 2024-09-17T04:21:00.149 INFO:tasks.workunit.client.1.smithi134.stdout:4/699: getdents d0/d3b/d9f 0 2024-09-17T04:21:00.149 INFO:tasks.workunit.client.0.smithi088.stdout:0/153: symlink db/d1a/l33 0 2024-09-17T04:21:00.150 INFO:tasks.workunit.client.0.smithi088.stdout:0/154: write f0 [749699,42737] 0 2024-09-17T04:21:00.151 INFO:tasks.workunit.client.1.smithi134.stdout:4/700: write d0/df/d35/d5c/d8b/fc4 [751786,34592] 0 2024-09-17T04:21:00.151 INFO:tasks.workunit.client.0.smithi088.stdout:0/155: fsync db/f10 0 2024-09-17T04:21:00.155 INFO:tasks.workunit.client.0.smithi088.stdout:9/327: rmdir d2/dd/d11/d1d/d43/d51 39 2024-09-17T04:21:00.159 INFO:tasks.workunit.client.1.smithi134.stdout:4/701: dwrite d0/df/d1e/d73/f95 [0,4194304] 0 2024-09-17T04:21:00.165 INFO:tasks.workunit.client.1.smithi134.stdout:5/633: write d0/d3a/ff [554943,29550] 0 2024-09-17T04:21:00.168 INFO:tasks.workunit.client.0.smithi088.stdout:3/180: unlink d0/f38 0 2024-09-17T04:21:00.170 INFO:tasks.workunit.client.1.smithi134.stdout:1/704: truncate d12/d19/d1d/f6b 8844114 0 2024-09-17T04:21:00.172 INFO:tasks.workunit.client.1.smithi134.stdout:7/523: dread d0/dd/d3a/d3d/f78 [0,4194304] 0 2024-09-17T04:21:00.174 INFO:tasks.workunit.client.0.smithi088.stdout:0/156: symlink db/d1a/d20/l34 0 2024-09-17T04:21:00.174 INFO:tasks.workunit.client.0.smithi088.stdout:0/157: dread - db/d1b/f2b zero size 2024-09-17T04:21:00.175 INFO:tasks.workunit.client.0.smithi088.stdout:3/181: truncate d0/d13/d1b/d29/d2b/f34 1145855 0 2024-09-17T04:21:00.176 INFO:tasks.workunit.client.0.smithi088.stdout:3/182: readlink d0/d13/d1b/l1d 0 2024-09-17T04:21:00.178 INFO:tasks.workunit.client.0.smithi088.stdout:6/264: truncate d14/d15/d29/f3d 983515 0 2024-09-17T04:21:00.180 INFO:tasks.workunit.client.0.smithi088.stdout:0/158: creat db/d1a/f35 x:0 0 0 2024-09-17T04:21:00.180 INFO:tasks.workunit.client.1.smithi134.stdout:2/631: dwrite d19/d1c/d47/d50/d85/f9b [0,4194304] 0 2024-09-17T04:21:00.182 INFO:tasks.workunit.client.1.smithi134.stdout:2/632: dread - d19/d27/d31/d49/d6f/d84/d98/fce zero size 2024-09-17T04:21:00.184 INFO:tasks.workunit.client.0.smithi088.stdout:3/183: dwrite d0/d13/d1b/f27 [0,4194304] 0 2024-09-17T04:21:00.186 INFO:tasks.workunit.client.0.smithi088.stdout:1/208: sync 2024-09-17T04:21:00.186 INFO:tasks.workunit.client.0.smithi088.stdout:6/265: dread d14/d15/f39 [0,4194304] 0 2024-09-17T04:21:00.186 INFO:tasks.workunit.client.0.smithi088.stdout:5/271: sync 2024-09-17T04:21:00.186 INFO:tasks.workunit.client.0.smithi088.stdout:2/259: sync 2024-09-17T04:21:00.186 INFO:tasks.workunit.client.0.smithi088.stdout:8/196: sync 2024-09-17T04:21:00.187 INFO:tasks.workunit.client.0.smithi088.stdout:5/272: dread - d2/d31/f45 zero size 2024-09-17T04:21:00.188 INFO:tasks.workunit.client.0.smithi088.stdout:6/266: read - d14/d15/d2a/d52/f64 zero size 2024-09-17T04:21:00.198 INFO:tasks.workunit.client.0.smithi088.stdout:0/159: mkdir db/d1b/d36 0 2024-09-17T04:21:00.198 INFO:tasks.workunit.client.1.smithi134.stdout:6/742: sync 2024-09-17T04:21:00.198 INFO:tasks.workunit.client.1.smithi134.stdout:8/575: sync 2024-09-17T04:21:00.200 INFO:tasks.workunit.client.0.smithi088.stdout:8/197: unlink d7/dd/ff 0 2024-09-17T04:21:00.202 INFO:tasks.workunit.client.0.smithi088.stdout:6/267: creat d14/d3a/d41/f69 x:0 0 0 2024-09-17T04:21:00.204 INFO:tasks.workunit.client.0.smithi088.stdout:3/184: creat d0/d13/d1b/d29/d30/f39 x:0 0 0 2024-09-17T04:21:00.205 INFO:tasks.workunit.client.1.smithi134.stdout:7/524: dwrite d0/d16/d35/d4b/f69 [0,4194304] 0 2024-09-17T04:21:00.206 INFO:tasks.workunit.client.1.smithi134.stdout:2/633: creat d19/da1/fd1 x:0 0 0 2024-09-17T04:21:00.207 INFO:tasks.workunit.client.0.smithi088.stdout:1/209: rename d0/d1/d16/l1f to d0/d1/d16/l46 0 2024-09-17T04:21:00.207 INFO:tasks.workunit.client.1.smithi134.stdout:4/702: symlink d0/df/dd5/le2 0 2024-09-17T04:21:00.209 INFO:tasks.workunit.client.1.smithi134.stdout:4/703: write d0/fa [5124240,34640] 0 2024-09-17T04:21:00.210 INFO:tasks.workunit.client.1.smithi134.stdout:1/705: mkdir d12/d19/d5d/d91/dac/dd5/def 0 2024-09-17T04:21:00.213 INFO:tasks.workunit.client.0.smithi088.stdout:3/185: dwrite d0/fb [0,4194304] 0 2024-09-17T04:21:00.217 INFO:tasks.workunit.client.1.smithi134.stdout:0/636: sync 2024-09-17T04:21:00.221 INFO:tasks.workunit.client.0.smithi088.stdout:2/260: dread d0/f9 [4194304,4194304] 0 2024-09-17T04:21:00.228 INFO:tasks.workunit.client.0.smithi088.stdout:6/268: rename d14/d15/d29/d3e/f3b to d14/d15/d16/f6a 0 2024-09-17T04:21:00.228 INFO:tasks.workunit.client.0.smithi088.stdout:8/198: dwrite d7/dd/f28 [0,4194304] 0 2024-09-17T04:21:00.228 INFO:tasks.workunit.client.0.smithi088.stdout:6/269: readlink d14/l17 0 2024-09-17T04:21:00.229 INFO:tasks.workunit.client.0.smithi088.stdout:8/199: chown d7 161569 1 2024-09-17T04:21:00.229 INFO:tasks.workunit.client.0.smithi088.stdout:6/270: dread - d14/d15/d2a/d52/f64 zero size 2024-09-17T04:21:00.230 INFO:tasks.workunit.client.1.smithi134.stdout:6/743: dwrite de/d19/d62/db0/fe9 [0,4194304] 0 2024-09-17T04:21:00.230 INFO:tasks.workunit.client.1.smithi134.stdout:6/744: chown de/d19/d74 543965 1 2024-09-17T04:21:00.233 INFO:tasks.workunit.client.1.smithi134.stdout:7/525: write d0/dd/d3a/d3d/d38/f18 [2096248,124484] 0 2024-09-17T04:21:00.234 INFO:tasks.workunit.client.0.smithi088.stdout:1/210: creat d0/d13/f47 x:0 0 0 2024-09-17T04:21:00.235 INFO:tasks.workunit.client.1.smithi134.stdout:7/526: chown d0/d16/c30 10 1 2024-09-17T04:21:00.236 INFO:tasks.workunit.client.1.smithi134.stdout:2/634: creat d19/d1c/d47/fd2 x:0 0 0 2024-09-17T04:21:00.237 INFO:tasks.workunit.client.0.smithi088.stdout:0/160: getdents db/d1b/d36 0 2024-09-17T04:21:00.237 INFO:tasks.workunit.client.1.smithi134.stdout:8/576: write d4/d1e/daf/f4b [969788,39821] 0 2024-09-17T04:21:00.239 INFO:tasks.workunit.client.1.smithi134.stdout:8/577: readlink d4/db/dd/d43/d8b/d8e/l9c 0 2024-09-17T04:21:00.239 INFO:tasks.workunit.client.0.smithi088.stdout:3/186: symlink d0/d13/d1b/d29/l3a 0 2024-09-17T04:21:00.240 INFO:tasks.workunit.client.1.smithi134.stdout:5/634: creat d0/da/d69/fd2 x:0 0 0 2024-09-17T04:21:00.242 INFO:tasks.workunit.client.1.smithi134.stdout:5/635: dread - d0/da/fa0 zero size 2024-09-17T04:21:00.242 INFO:tasks.workunit.client.1.smithi134.stdout:4/704: rename d0/df/d1e/f50 to d0/d13/d40/d42/d92/fe3 0 2024-09-17T04:21:00.243 INFO:tasks.workunit.client.1.smithi134.stdout:2/635: dread d19/d1c/d47/d50/d85/f9b [0,4194304] 0 2024-09-17T04:21:00.243 INFO:tasks.workunit.client.1.smithi134.stdout:5/636: chown d0/da/d29/f9b 116573053 1 2024-09-17T04:21:00.244 INFO:tasks.workunit.client.1.smithi134.stdout:1/706: write d12/d19/f30 [2893478,49185] 0 2024-09-17T04:21:00.245 INFO:tasks.workunit.client.0.smithi088.stdout:5/273: creat d2/d31/d33/f58 x:0 0 0 2024-09-17T04:21:00.245 INFO:tasks.workunit.client.1.smithi134.stdout:5/637: chown d0/da/d29/d7c/d9e/fc1 243496582 1 2024-09-17T04:21:00.246 INFO:tasks.workunit.client.1.smithi134.stdout:5/638: chown d0/da/d29/c38 96 1 2024-09-17T04:21:00.247 INFO:tasks.workunit.client.0.smithi088.stdout:2/261: rename d0/d1/d2d/d33/d4b/d24/l35 to d0/d1/d2d/d33/d4b/d24/d4d/l50 0 2024-09-17T04:21:00.247 INFO:tasks.workunit.client.1.smithi134.stdout:0/637: dread d11/d18/f30 [0,4194304] 0 2024-09-17T04:21:00.250 INFO:tasks.workunit.client.1.smithi134.stdout:1/707: dwrite d12/f86 [0,4194304] 0 2024-09-17T04:21:00.250 INFO:tasks.workunit.client.1.smithi134.stdout:3/755: link l2 de/d12/d15/d1d/d2d/d31/d6a/d83/dd8/lf6 0 2024-09-17T04:21:00.251 INFO:tasks.workunit.client.1.smithi134.stdout:1/708: write d12/db2/fb6 [640643,114] 0 2024-09-17T04:21:00.253 INFO:tasks.workunit.client.1.smithi134.stdout:6/745: creat de/d19/d1f/d55/d77/db8/dc7/ddc/db3/ff1 x:0 0 0 2024-09-17T04:21:00.253 INFO:tasks.workunit.client.1.smithi134.stdout:3/756: write de/d12/d15/d1d/d2d/d31/d6a/d78/d7c/fcf [3554506,62493] 0 2024-09-17T04:21:00.260 INFO:tasks.workunit.client.1.smithi134.stdout:8/578: symlink d4/d1e/daf/lb6 0 2024-09-17T04:21:00.260 INFO:tasks.workunit.client.1.smithi134.stdout:6/746: dwrite de/d19/d21/d2d/f6a [0,4194304] 0 2024-09-17T04:21:00.261 INFO:tasks.workunit.client.1.smithi134.stdout:6/747: chown de/d19/d21/d2d/f6a 40937766 1 2024-09-17T04:21:00.262 INFO:tasks.workunit.client.0.smithi088.stdout:0/161: rename db/d29 to db/d1a/d20/d28/d37 0 2024-09-17T04:21:00.266 INFO:tasks.workunit.client.0.smithi088.stdout:2/262: fdatasync d0/d13/f16 0 2024-09-17T04:21:00.269 INFO:tasks.workunit.client.1.smithi134.stdout:7/527: rename d0/dd/f1f to d0/d16/d8b/d6a/d70/d85/fa5 0 2024-09-17T04:21:00.273 INFO:tasks.workunit.client.0.smithi088.stdout:2/263: dwrite d0/d1/f11 [4194304,4194304] 0 2024-09-17T04:21:00.275 INFO:tasks.workunit.client.0.smithi088.stdout:1/211: fdatasync d0/f4 0 2024-09-17T04:21:00.275 INFO:tasks.workunit.client.0.smithi088.stdout:2/264: read - d0/d1/d2d/d33/f38 zero size 2024-09-17T04:21:00.276 INFO:tasks.workunit.client.1.smithi134.stdout:4/705: symlink d0/d13/d40/d42/d92/d65/le4 0 2024-09-17T04:21:00.280 INFO:tasks.workunit.client.0.smithi088.stdout:8/200: dwrite d7/dd/d31/f36 [4194304,4194304] 0 2024-09-17T04:21:00.282 INFO:tasks.workunit.client.0.smithi088.stdout:1/212: dread d0/d1/df/f3e [0,4194304] 0 2024-09-17T04:21:00.283 INFO:tasks.workunit.client.1.smithi134.stdout:5/639: symlink d0/d3a/d2b/d61/d7b/ld3 0 2024-09-17T04:21:00.284 INFO:tasks.workunit.client.1.smithi134.stdout:5/640: write d0/da/d2c/fa7 [133073,13841] 0 2024-09-17T04:21:00.288 INFO:tasks.workunit.client.0.smithi088.stdout:2/265: unlink d0/l41 0 2024-09-17T04:21:00.289 INFO:tasks.workunit.client.0.smithi088.stdout:5/274: dwrite d2/d31/d33/f12 [0,4194304] 0 2024-09-17T04:21:00.290 INFO:tasks.workunit.client.0.smithi088.stdout:2/266: chown d0/d1/l47 33937629 1 2024-09-17T04:21:00.292 INFO:tasks.workunit.client.1.smithi134.stdout:8/579: write d4/d1e/daf/d60/d6b/d13/f73 [6963590,121359] 0 2024-09-17T04:21:00.293 INFO:tasks.workunit.client.0.smithi088.stdout:0/162: mknod db/c38 0 2024-09-17T04:21:00.294 INFO:tasks.workunit.client.0.smithi088.stdout:1/213: chown d0/d1/df/c17 90070 1 2024-09-17T04:21:00.295 INFO:tasks.workunit.client.0.smithi088.stdout:0/163: chown db/d1a/d20/d28/d37/f26 20289 1 2024-09-17T04:21:00.297 INFO:tasks.workunit.client.1.smithi134.stdout:2/636: symlink d19/d27/d31/d34/ld3 0 2024-09-17T04:21:00.297 INFO:tasks.workunit.client.0.smithi088.stdout:2/267: fdatasync d0/d1/d2d/d33/d4b/d24/d3b/d26/f4e 0 2024-09-17T04:21:00.298 INFO:tasks.workunit.client.0.smithi088.stdout:2/268: chown d0/d13/f16 0 1 2024-09-17T04:21:00.300 INFO:tasks.workunit.client.0.smithi088.stdout:8/201: read d7/f9 [2032146,86621] 0 2024-09-17T04:21:00.300 INFO:tasks.workunit.client.0.smithi088.stdout:0/164: rmdir db/d1a/d20 39 2024-09-17T04:21:00.301 INFO:tasks.workunit.client.0.smithi088.stdout:0/165: readlink db/lf 0 2024-09-17T04:21:00.302 INFO:tasks.workunit.client.0.smithi088.stdout:0/166: truncate db/f2a 4761664 0 2024-09-17T04:21:00.302 INFO:tasks.workunit.client.0.smithi088.stdout:0/167: fsync db/f14 0 2024-09-17T04:21:00.303 INFO:tasks.workunit.client.1.smithi134.stdout:1/709: mknod d12/d1c/d2e/dea/cf0 0 2024-09-17T04:21:00.303 INFO:tasks.workunit.client.0.smithi088.stdout:0/168: fdatasync db/d1a/f35 0 2024-09-17T04:21:00.304 INFO:tasks.workunit.client.0.smithi088.stdout:2/269: creat d0/d1/d2d/d33/d4b/d24/f51 x:0 0 0 2024-09-17T04:21:00.309 INFO:tasks.workunit.client.0.smithi088.stdout:8/202: chown d7/dd/c1e 41409 1 2024-09-17T04:21:00.310 INFO:tasks.workunit.client.0.smithi088.stdout:5/275: link d2/d31/d33/l24 d2/d31/d33/d20/d25/d49/l59 0 2024-09-17T04:21:00.310 INFO:tasks.workunit.client.0.smithi088.stdout:5/276: fdatasync d2/d31/d33/d20/d30/f4e 0 2024-09-17T04:21:00.310 INFO:tasks.workunit.client.1.smithi134.stdout:6/748: mkdir de/d19/d21/df2 0 2024-09-17T04:21:00.312 INFO:tasks.workunit.client.1.smithi134.stdout:6/749: dwrite de/d19/d1f/d55/f68 [0,4194304] 0 2024-09-17T04:21:00.312 INFO:tasks.workunit.client.0.smithi088.stdout:0/169: mkdir db/d1b/d39 0 2024-09-17T04:21:00.312 INFO:tasks.workunit.client.0.smithi088.stdout:3/187: write d0/d13/d1b/d29/f2d [4078667,31721] 0 2024-09-17T04:21:00.313 INFO:tasks.workunit.client.1.smithi134.stdout:6/750: write de/d19/d1f/d55/da9/fbc [671391,116288] 0 2024-09-17T04:21:00.315 INFO:tasks.workunit.client.1.smithi134.stdout:6/751: fsync de/d19/d74/d94/d9e/fac 0 2024-09-17T04:21:00.317 INFO:tasks.workunit.client.1.smithi134.stdout:2/637: fdatasync d19/d1c/d47/d50/f7c 0 2024-09-17T04:21:00.318 INFO:tasks.workunit.client.1.smithi134.stdout:6/752: readlink de/d19/d1f/d55/d77/d89/l9c 0 2024-09-17T04:21:00.319 INFO:tasks.workunit.client.1.smithi134.stdout:6/753: stat de/d19/d1f/la6 0 2024-09-17T04:21:00.319 INFO:tasks.workunit.client.1.smithi134.stdout:6/754: chown de/d19/f24 61424952 1 2024-09-17T04:21:00.321 INFO:tasks.workunit.client.1.smithi134.stdout:6/755: dread de/d19/d1f/f26 [0,4194304] 0 2024-09-17T04:21:00.321 INFO:tasks.workunit.client.0.smithi088.stdout:2/270: dread d0/d1/d2d/f3a [0,4194304] 0 2024-09-17T04:21:00.322 INFO:tasks.workunit.client.1.smithi134.stdout:4/706: mknod d0/d13/d40/ce5 0 2024-09-17T04:21:00.322 INFO:tasks.workunit.client.0.smithi088.stdout:1/214: dread d0/f28 [0,4194304] 0 2024-09-17T04:21:00.322 INFO:tasks.workunit.client.1.smithi134.stdout:6/756: chown de/d19/d62/d34/d3b/fd5 1 1 2024-09-17T04:21:00.323 INFO:tasks.workunit.client.1.smithi134.stdout:5/641: dread d0/da/d69/d41/d6d/d89/fc8 [0,4194304] 0 2024-09-17T04:21:00.323 INFO:tasks.workunit.client.1.smithi134.stdout:4/707: chown d0/d13/d40/d42/d92/f45 7318814 1 2024-09-17T04:21:00.324 INFO:tasks.workunit.client.0.smithi088.stdout:1/215: dread - d0/d13/f2f zero size 2024-09-17T04:21:00.324 INFO:tasks.workunit.client.1.smithi134.stdout:5/642: chown d0/da/d2c/d73 1885093 1 2024-09-17T04:21:00.326 INFO:tasks.workunit.client.0.smithi088.stdout:3/188: rename d0/d13/d1b/f1e to d0/d13/d1b/d29/f3b 0 2024-09-17T04:21:00.329 INFO:tasks.workunit.client.1.smithi134.stdout:3/757: rename de/d12/d15/d1d/d2d/d31/d6a/d83/ddd to de/d12/d15/d9f/df7 0 2024-09-17T04:21:00.329 INFO:tasks.workunit.client.1.smithi134.stdout:4/708: dwrite d0/d13/d40/d42/fb5 [0,4194304] 0 2024-09-17T04:21:00.330 INFO:tasks.workunit.client.1.smithi134.stdout:0/638: truncate d11/d4c/dd3/d2f/d45/f74 2438732 0 2024-09-17T04:21:00.331 INFO:tasks.workunit.client.1.smithi134.stdout:7/528: creat d0/fa6 x:0 0 0 2024-09-17T04:21:00.332 INFO:tasks.workunit.client.1.smithi134.stdout:8/580: dread d4/d11/da1/fa7 [0,4194304] 0 2024-09-17T04:21:00.333 INFO:tasks.workunit.client.0.smithi088.stdout:5/277: symlink d2/d31/d33/d20/l5a 0 2024-09-17T04:21:00.335 INFO:tasks.workunit.client.1.smithi134.stdout:8/581: dread d4/db/dd/f30 [0,4194304] 0 2024-09-17T04:21:00.335 INFO:tasks.workunit.client.0.smithi088.stdout:5/278: chown d2/d31/d33/d20/d47/c53 37863 1 2024-09-17T04:21:00.337 INFO:tasks.workunit.client.0.smithi088.stdout:2/271: creat d0/d1/d2d/d33/f52 x:0 0 0 2024-09-17T04:21:00.340 INFO:tasks.workunit.client.0.smithi088.stdout:0/170: creat db/d1b/d39/f3a x:0 0 0 2024-09-17T04:21:00.341 INFO:tasks.workunit.client.1.smithi134.stdout:1/710: mkdir d12/d19/d5d/d91/dac/dd5/def/df1 0 2024-09-17T04:21:00.347 INFO:tasks.workunit.client.0.smithi088.stdout:0/171: dwrite db/f13 [0,4194304] 0 2024-09-17T04:21:00.349 INFO:tasks.workunit.client.0.smithi088.stdout:3/189: mkdir d0/d13/d1b/d29/d30/d3c 0 2024-09-17T04:21:00.354 INFO:tasks.workunit.client.0.smithi088.stdout:8/203: mkdir d7/d29/d2a/d38/d3d 0 2024-09-17T04:21:00.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.356+0000 7f606c7e7640 1 -- 172.21.15.88:0/2208385484 --> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6064062630 con 0x7f6050074ad0 2024-09-17T04:21:00.358 INFO:tasks.workunit.client.0.smithi088.stdout:2/272: creat d0/d1/d2d/f53 x:0 0 0 2024-09-17T04:21:00.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.358+0000 7f605b7fe640 1 -- 172.21.15.88:0/2208385484 <== mgr.24431 v2:172.21.15.134:6828/1122341233 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+318 (secure 0 0 0) 0x7f6064062630 con 0x7f6050074ad0 2024-09-17T04:21:00.359 INFO:tasks.workunit.client.1.smithi134.stdout:7/529: dread d0/dd/d3a/d3d/f56 [0,4194304] 0 2024-09-17T04:21:00.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.361+0000 7f606c7e7640 1 -- 172.21.15.88:0/2208385484 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f6050074ad0 msgr2=0x7f6050076f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:00.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.361+0000 7f606c7e7640 1 --2- 172.21.15.88:0/2208385484 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f6050074ad0 0x7f6050076f90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f605400f660 tx=0x7f6054005f90 comp rx=0 tx=0).stop 2024-09-17T04:21:00.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.361+0000 7f606c7e7640 1 -- 172.21.15.88:0/2208385484 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6064100860 msgr2=0x7f606418e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:00.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.361+0000 7f606c7e7640 1 --2- 172.21.15.88:0/2208385484 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6064100860 0x7f606418e040 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f6060006010 tx=0x7f606002cff0 comp rx=0 tx=0).stop 2024-09-17T04:21:00.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.361+0000 7f606c7e7640 1 -- 172.21.15.88:0/2208385484 shutdown_connections 2024-09-17T04:21:00.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.361+0000 7f606c7e7640 1 --2- 172.21.15.88:0/2208385484 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f6050074ad0 0x7f6050076f90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:00.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.362+0000 7f606c7e7640 1 --2- 172.21.15.88:0/2208385484 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6064101a60 0x7f606418e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:00.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.362+0000 7f606c7e7640 1 --2- 172.21.15.88:0/2208385484 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6064100860 0x7f606418e040 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:00.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.362+0000 7f606c7e7640 1 -- 172.21.15.88:0/2208385484 >> 172.21.15.88:0/2208385484 conn(0x7f60640fc010 msgr2=0x7f6064104fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:21:00.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.362+0000 7f606c7e7640 1 -- 172.21.15.88:0/2208385484 shutdown_connections 2024-09-17T04:21:00.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.362+0000 7f606c7e7640 1 -- 172.21.15.88:0/2208385484 wait complete. 2024-09-17T04:21:00.364 INFO:tasks.workunit.client.0.smithi088.stdout:0/172: rmdir db/d1b/d39 39 2024-09-17T04:21:00.366 INFO:tasks.workunit.client.0.smithi088.stdout:3/190: rename d0/f26 to d0/d13/d1b/d29/d30/d35/f3d 0 2024-09-17T04:21:00.369 INFO:tasks.workunit.client.1.smithi134.stdout:1/711: fsync d12/d19/d1d/f44 0 2024-09-17T04:21:00.370 INFO:tasks.workunit.client.1.smithi134.stdout:1/712: chown d12/d19/d1d/d3e/c96 2868117 1 2024-09-17T04:21:00.372 INFO:tasks.workunit.client.0.smithi088.stdout:2/273: creat d0/d1/d2d/d33/d4b/d24/d3b/f54 x:0 0 0 2024-09-17T04:21:00.373 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-09-17T04:21:00.374 INFO:tasks.workunit.client.0.smithi088.stdout:2/274: write d0/d18/f3e [666047,108893] 0 2024-09-17T04:21:00.374 INFO:tasks.workunit.client.1.smithi134.stdout:5/643: dwrite d0/da/d69/d41/d6d/f76 [0,4194304] 0 2024-09-17T04:21:00.374 INFO:tasks.workunit.client.1.smithi134.stdout:5/644: readlink d0/l56 0 2024-09-17T04:21:00.375 INFO:tasks.workunit.client.0.smithi088.stdout:1/216: link d0/d1/df/c19 d0/d1/d16/d35/c48 0 2024-09-17T04:21:00.378 INFO:tasks.workunit.client.1.smithi134.stdout:0/639: creat d11/d24/d49/d62/fda x:0 0 0 2024-09-17T04:21:00.379 INFO:tasks.workunit.client.1.smithi134.stdout:0/640: write d11/d24/d49/d62/daf/fb0 [825977,89011] 0 2024-09-17T04:21:00.382 INFO:tasks.workunit.client.0.smithi088.stdout:1/217: dwrite d0/d1/df/f10 [4194304,4194304] 0 2024-09-17T04:21:00.383 INFO:tasks.workunit.client.0.smithi088.stdout:1/218: write d0/d1/fa [4717987,55901] 0 2024-09-17T04:21:00.384 INFO:tasks.workunit.client.1.smithi134.stdout:7/530: symlink d0/d16/d8b/d6a/la7 0 2024-09-17T04:21:00.385 INFO:tasks.workunit.client.0.smithi088.stdout:1/219: write d0/d13/f1b [636765,54762] 0 2024-09-17T04:21:00.393 INFO:tasks.workunit.client.0.smithi088.stdout:7/296: sync 2024-09-17T04:21:00.394 INFO:tasks.workunit.client.0.smithi088.stdout:7/297: dread - d2/d1e/f5e zero size 2024-09-17T04:21:00.408 INFO:tasks.workunit.client.0.smithi088.stdout:1/220: dread d0/d13/f1b [0,4194304] 0 2024-09-17T04:21:00.434 INFO:tasks.workunit.client.1.smithi134.stdout:8/582: sync 2024-09-17T04:21:00.434 INFO:tasks.workunit.client.1.smithi134.stdout:6/757: sync 2024-09-17T04:21:00.452 INFO:tasks.workunit.client.1.smithi134.stdout:5/645: creat d0/da/d29/d78/fd4 x:0 0 0 2024-09-17T04:21:00.452 INFO:tasks.workunit.client.1.smithi134.stdout:5/646: chown d0/da/d29/d78 15947 1 2024-09-17T04:21:00.456 INFO:tasks.workunit.client.0.smithi088.stdout:3/191: creat d0/d13/d1b/d29/d30/d35/f3e x:0 0 0 2024-09-17T04:21:00.457 INFO:tasks.workunit.client.0.smithi088.stdout:3/192: write d0/d13/f22 [838362,16032] 0 2024-09-17T04:21:00.458 INFO:tasks.workunit.client.0.smithi088.stdout:3/193: readlink d0/lf 0 2024-09-17T04:21:00.458 INFO:tasks.workunit.client.1.smithi134.stdout:0/641: unlink d11/d48/lc2 0 2024-09-17T04:21:00.459 INFO:tasks.workunit.client.0.smithi088.stdout:3/194: dread - d0/d13/d1b/f21 zero size 2024-09-17T04:21:00.462 INFO:tasks.workunit.client.0.smithi088.stdout:8/204: creat d7/d29/d2a/d3a/f3e x:0 0 0 2024-09-17T04:21:00.472 INFO:tasks.workunit.client.1.smithi134.stdout:2/638: link d19/d27/f2f d19/d1c/d92/fd4 0 2024-09-17T04:21:00.477 INFO:tasks.workunit.client.0.smithi088.stdout:8/205: dread d7/d29/f2e [0,4194304] 0 2024-09-17T04:21:00.478 INFO:tasks.workunit.client.0.smithi088.stdout:7/298: creat d2/d4/f69 x:0 0 0 2024-09-17T04:21:00.480 INFO:tasks.workunit.client.1.smithi134.stdout:3/758: creat de/d10/d3d/de2/ff8 x:0 0 0 2024-09-17T04:21:00.480 INFO:tasks.workunit.client.1.smithi134.stdout:3/759: fdatasync de/d12/d15/d1d/fcb 0 2024-09-17T04:21:00.482 INFO:tasks.workunit.client.0.smithi088.stdout:1/221: rename d0/d13/f2f to d0/d1/df/d20/f49 0 2024-09-17T04:21:00.484 INFO:tasks.workunit.client.1.smithi134.stdout:5/647: mkdir d0/da/d69/d41/d6d/d89/dd5 0 2024-09-17T04:21:00.485 INFO:tasks.workunit.client.1.smithi134.stdout:5/648: write d0/d3a/d2b/f34 [1641394,8701] 0 2024-09-17T04:21:00.486 INFO:tasks.workunit.client.0.smithi088.stdout:0/173: symlink db/d1b/l3b 0 2024-09-17T04:21:00.487 INFO:tasks.workunit.client.1.smithi134.stdout:4/709: link d0/d13/f33 d0/d13/d40/d72/fe6 0 2024-09-17T04:21:00.488 INFO:tasks.workunit.client.1.smithi134.stdout:4/710: chown d0/df/d1e/lad 115594535 1 2024-09-17T04:21:00.490 INFO:tasks.workunit.client.0.smithi088.stdout:9/328: sync 2024-09-17T04:21:00.490 INFO:tasks.workunit.client.0.smithi088.stdout:4/301: sync 2024-09-17T04:21:00.492 INFO:tasks.workunit.client.1.smithi134.stdout:4/711: dwrite d0/d13/f8d [4194304,4194304] 0 2024-09-17T04:21:00.498 INFO:tasks.workunit.client.0.smithi088.stdout:3/195: dwrite d0/d13/d1b/d29/d30/d35/f3d [0,4194304] 0 2024-09-17T04:21:00.500 INFO:tasks.workunit.client.1.smithi134.stdout:8/583: creat d4/d11/da1/db3/fb7 x:0 0 0 2024-09-17T04:21:00.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.500+0000 7fc9e6f7d640 1 -- 172.21.15.88:0/1576840431 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9e0101a60 msgr2=0x7fc9e0101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:00.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.500+0000 7fc9e6f7d640 1 --2- 172.21.15.88:0/1576840431 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9e0101a60 0x7fc9e0101ee0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc9d0009880 tx=0x7fc9d002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:21:00.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.500+0000 7fc9e6f7d640 1 -- 172.21.15.88:0/1576840431 shutdown_connections 2024-09-17T04:21:00.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.500+0000 7fc9e6f7d640 1 --2- 172.21.15.88:0/1576840431 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9e0101a60 0x7fc9e0101ee0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:00.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.500+0000 7fc9e6f7d640 1 --2- 172.21.15.88:0/1576840431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9e0100860 0x7fc9e0100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:00.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.500+0000 7fc9e6f7d640 1 -- 172.21.15.88:0/1576840431 >> 172.21.15.88:0/1576840431 conn(0x7fc9e00fc010 msgr2=0x7fc9e00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:21:00.501 INFO:tasks.workunit.client.1.smithi134.stdout:8/584: chown d4/d1f/cb0 105431 1 2024-09-17T04:21:00.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.502+0000 7fc9e6f7d640 1 -- 172.21.15.88:0/1576840431 shutdown_connections 2024-09-17T04:21:00.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.502+0000 7fc9e6f7d640 1 -- 172.21.15.88:0/1576840431 wait complete. 2024-09-17T04:21:00.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.502+0000 7fc9e6f7d640 1 Processor -- start 2024-09-17T04:21:00.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.503+0000 7fc9e6f7d640 1 -- start start 2024-09-17T04:21:00.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.503+0000 7fc9e6f7d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9e0100860 0x7fc9e00731d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:21:00.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.503+0000 7fc9e6f7d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9e0101a60 0x7fc9e0073710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:21:00.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.503+0000 7fc9e6f7d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e0108590 con 0x7fc9e0101a60 2024-09-17T04:21:00.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.503+0000 7fc9e6f7d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e0108410 con 0x7fc9e0100860 2024-09-17T04:21:00.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.503+0000 7fc9e4d19640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9e0100860 0x7fc9e00731d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:21:00.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.503+0000 7fc9e4d19640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9e0100860 0x7fc9e00731d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.88:55578/0 (socket says 172.21.15.88:55578) 2024-09-17T04:21:00.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.503+0000 7fc9e4d19640 1 -- 172.21.15.88:0/869085387 learned_addr learned my addr 172.21.15.88:0/869085387 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:21:00.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.503+0000 7fc9dffff640 1 --2- 172.21.15.88:0/869085387 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9e0101a60 0x7fc9e0073710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:21:00.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.504+0000 7fc9e4d19640 1 -- 172.21.15.88:0/869085387 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9e0101a60 msgr2=0x7fc9e0073710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:00.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.504+0000 7fc9e4d19640 1 --2- 172.21.15.88:0/869085387 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9e0101a60 0x7fc9e0073710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:00.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.504+0000 7fc9e4d19640 1 -- 172.21.15.88:0/869085387 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9e0073dc0 con 0x7fc9e0100860 2024-09-17T04:21:00.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.504+0000 7fc9e4d19640 1 --2- 172.21.15.88:0/869085387 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9e0100860 0x7fc9e00731d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc9d400d8d0 tx=0x7fc9d400dd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:21:00.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.504+0000 7fc9ddffb640 1 -- 172.21.15.88:0/869085387 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc9d4017070 con 0x7fc9e0100860 2024-09-17T04:21:00.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.504+0000 7fc9e6f7d640 1 -- 172.21.15.88:0/869085387 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9e01a7490 con 0x7fc9e0100860 2024-09-17T04:21:00.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.505+0000 7fc9e6f7d640 1 -- 172.21.15.88:0/869085387 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9e01a79f0 con 0x7fc9e0100860 2024-09-17T04:21:00.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.505+0000 7fc9ddffb640 1 -- 172.21.15.88:0/869085387 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc9d400be10 con 0x7fc9e0100860 2024-09-17T04:21:00.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.505+0000 7fc9ddffb640 1 -- 172.21.15.88:0/869085387 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc9d400f3c0 con 0x7fc9e0100860 2024-09-17T04:21:00.506 INFO:tasks.workunit.client.0.smithi088.stdout:3/196: dwrite d0/f4 [0,4194304] 0 2024-09-17T04:21:00.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.507+0000 7fc9ddffb640 1 -- 172.21.15.88:0/869085387 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7fc9d401a070 con 0x7fc9e0100860 2024-09-17T04:21:00.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.508+0000 7fc9e6f7d640 1 -- 172.21.15.88:0/869085387 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9cc0052c0 con 0x7fc9e0100860 2024-09-17T04:21:00.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.509+0000 7fc9ddffb640 1 --2- 172.21.15.88:0/869085387 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7fc9c8074a60 0x7fc9c8076f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:21:00.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.509+0000 7fc9dffff640 1 --2- 172.21.15.88:0/869085387 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7fc9c8074a60 0x7fc9c8076f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:21:00.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.510+0000 7fc9dffff640 1 --2- 172.21.15.88:0/869085387 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7fc9c8074a60 0x7fc9c8076f20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc9e019eed0 tx=0x7fc9d0005b50 comp rx=0 tx=0).ready entity=mgr.24431 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:21:00.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.510+0000 7fc9ddffb640 1 -- 172.21.15.88:0/869085387 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7fc9d4095d90 con 0x7fc9e0100860 2024-09-17T04:21:00.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.514+0000 7fc9ddffb640 1 -- 172.21.15.88:0/869085387 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7fc9d4061340 con 0x7fc9e0100860 2024-09-17T04:21:00.517 INFO:tasks.workunit.client.0.smithi088.stdout:8/206: dwrite d7/d29/f12 [12582912,4194304] 0 2024-09-17T04:21:00.526 INFO:tasks.workunit.client.0.smithi088.stdout:0/174: dwrite db/d1b/d39/f3a [0,4194304] 0 2024-09-17T04:21:00.533 INFO:tasks.workunit.client.0.smithi088.stdout:1/222: truncate d0/d1/fd 581855 0 2024-09-17T04:21:00.533 INFO:tasks.workunit.client.0.smithi088.stdout:1/223: readlink d0/d1/df/l1d 0 2024-09-17T04:21:00.538 INFO:tasks.workunit.client.0.smithi088.stdout:9/329: mkdir d2/dd/d11/d4f/d72/d74 0 2024-09-17T04:21:00.542 INFO:tasks.workunit.client.0.smithi088.stdout:3/197: creat d0/d13/d1b/d29/d2b/f3f x:0 0 0 2024-09-17T04:21:00.546 INFO:tasks.workunit.client.1.smithi134.stdout:5/649: rmdir d0/da/d69/d41/d72 39 2024-09-17T04:21:00.548 INFO:tasks.workunit.client.0.smithi088.stdout:6/271: sync 2024-09-17T04:21:00.560 INFO:tasks.workunit.client.0.smithi088.stdout:0/175: mkdir db/d3c 0 2024-09-17T04:21:00.560 INFO:tasks.workunit.client.0.smithi088.stdout:1/224: dread d0/d1/fe [0,4194304] 0 2024-09-17T04:21:00.563 INFO:tasks.workunit.client.0.smithi088.stdout:1/225: write d0/d13/f44 [1045553,125138] 0 2024-09-17T04:21:00.565 INFO:tasks.workunit.client.0.smithi088.stdout:3/198: mkdir d0/d13/d1b/d29/d2b/d40 0 2024-09-17T04:21:00.573 INFO:tasks.workunit.client.1.smithi134.stdout:6/758: rename de/d19/d62/d34/d3b/dce to de/d2b/df3 0 2024-09-17T04:21:00.573 INFO:tasks.workunit.client.0.smithi088.stdout:0/176: dwrite db/f19 [0,4194304] 0 2024-09-17T04:21:00.573 INFO:tasks.workunit.client.0.smithi088.stdout:7/299: rename d2/f3 to d2/d1d/f6a 0 2024-09-17T04:21:00.578 INFO:tasks.workunit.client.0.smithi088.stdout:7/300: chown d2/d1e/d23/c4f 1777 1 2024-09-17T04:21:00.579 INFO:tasks.workunit.client.0.smithi088.stdout:3/199: dread d0/d13/d1b/f27 [0,4194304] 0 2024-09-17T04:21:00.580 INFO:tasks.workunit.client.0.smithi088.stdout:1/226: dwrite d0/d13/f44 [0,4194304] 0 2024-09-17T04:21:00.582 INFO:tasks.workunit.client.0.smithi088.stdout:7/301: write d2/d4/f69 [967893,95163] 0 2024-09-17T04:21:00.583 INFO:tasks.workunit.client.0.smithi088.stdout:3/200: chown d0/d13/d1b/l1d 504 1 2024-09-17T04:21:00.584 INFO:tasks.workunit.client.0.smithi088.stdout:7/302: dread - d2/d1d/f58 zero size 2024-09-17T04:21:00.584 INFO:tasks.workunit.client.0.smithi088.stdout:8/207: link d7/dd/l21 d7/d29/d2a/d3a/l3f 0 2024-09-17T04:21:00.591 INFO:tasks.workunit.client.0.smithi088.stdout:0/177: creat db/d1b/d39/f3d x:0 0 0 2024-09-17T04:21:00.593 INFO:tasks.workunit.client.0.smithi088.stdout:9/330: link d2/c1c d2/dd/d11/d4f/d72/d74/c75 0 2024-09-17T04:21:00.595 INFO:tasks.workunit.client.1.smithi134.stdout:8/585: unlink d4/d11/l4a 0 2024-09-17T04:21:00.595 INFO:tasks.workunit.client.1.smithi134.stdout:1/713: write d12/d36/fcd [955499,85001] 0 2024-09-17T04:21:00.597 INFO:tasks.workunit.client.1.smithi134.stdout:1/714: write d12/d19/d1d/d61/fd8 [886595,37002] 0 2024-09-17T04:21:00.598 INFO:tasks.workunit.client.0.smithi088.stdout:8/208: symlink d7/d29/l40 0 2024-09-17T04:21:00.598 INFO:tasks.workunit.client.1.smithi134.stdout:1/715: stat d12/d19/d1d/d61/dd3/dda/c73 0 2024-09-17T04:21:00.600 INFO:tasks.workunit.client.0.smithi088.stdout:3/201: creat d0/d13/d1b/d29/d2b/f41 x:0 0 0 2024-09-17T04:21:00.601 INFO:tasks.workunit.client.0.smithi088.stdout:3/202: write d0/d13/f24 [74768,102218] 0 2024-09-17T04:21:00.603 INFO:tasks.workunit.client.1.smithi134.stdout:7/531: creat d0/dd/d3a/d3d/d38/d60/fa8 x:0 0 0 2024-09-17T04:21:00.603 INFO:tasks.workunit.client.1.smithi134.stdout:7/532: readlink d0/d16/la 0 2024-09-17T04:21:00.604 INFO:tasks.workunit.client.1.smithi134.stdout:7/533: chown d0/dd/d3a/c68 834 1 2024-09-17T04:21:00.604 INFO:tasks.workunit.client.1.smithi134.stdout:7/534: fsync d0/d16/d8b/d6a/d70/f72 0 2024-09-17T04:21:00.605 INFO:tasks.workunit.client.0.smithi088.stdout:7/303: creat d2/d4/d7/d20/f6b x:0 0 0 2024-09-17T04:21:00.606 INFO:tasks.workunit.client.1.smithi134.stdout:5/650: mknod d0/da/d29/d78/da5/dce/cd6 0 2024-09-17T04:21:00.609 INFO:tasks.workunit.client.1.smithi134.stdout:6/759: mkdir de/d19/d1f/d5c/df4 0 2024-09-17T04:21:00.609 INFO:tasks.workunit.client.1.smithi134.stdout:6/760: chown de/d19/d1f/d55/d77/lab 0 1 2024-09-17T04:21:00.611 INFO:tasks.workunit.client.0.smithi088.stdout:9/331: mkdir d2/dd/d14/d2a/d76 0 2024-09-17T04:21:00.613 INFO:tasks.workunit.client.1.smithi134.stdout:8/586: read - d4/d1f/d2b/fac zero size 2024-09-17T04:21:00.614 INFO:tasks.workunit.client.0.smithi088.stdout:8/209: symlink d7/d29/d2a/d38/l41 0 2024-09-17T04:21:00.615 INFO:tasks.workunit.client.1.smithi134.stdout:3/760: mknod de/d10/d3d/dd9/dbd/dc3/cf9 0 2024-09-17T04:21:00.616 INFO:tasks.workunit.client.1.smithi134.stdout:3/761: chown de/d12/d15/d1d/d2d/l51 860283 1 2024-09-17T04:21:00.616 INFO:tasks.workunit.client.1.smithi134.stdout:3/762: dread - de/d10/d3d/dd9/ff1 zero size 2024-09-17T04:21:00.617 INFO:tasks.workunit.client.1.smithi134.stdout:3/763: dread - de/d10/d3d/dd9/ff1 zero size 2024-09-17T04:21:00.620 INFO:tasks.workunit.client.0.smithi088.stdout:3/203: creat d0/d13/d1b/d29/d2b/f42 x:0 0 0 2024-09-17T04:21:00.624 INFO:tasks.workunit.client.0.smithi088.stdout:7/304: creat d2/d1d/f6c x:0 0 0 2024-09-17T04:21:00.624 INFO:tasks.workunit.client.0.smithi088.stdout:7/305: stat d2/d4/d7/c12 0 2024-09-17T04:21:00.627 INFO:tasks.workunit.client.0.smithi088.stdout:8/210: dread d7/f8 [0,4194304] 0 2024-09-17T04:21:00.627 INFO:tasks.workunit.client.0.smithi088.stdout:0/178: mknod db/c3e 0 2024-09-17T04:21:00.628 INFO:tasks.workunit.client.1.smithi134.stdout:3/764: dread de/d12/d15/f4d [0,4194304] 0 2024-09-17T04:21:00.628 INFO:tasks.workunit.client.0.smithi088.stdout:0/179: truncate db/f1d 470611 0 2024-09-17T04:21:00.629 INFO:tasks.workunit.client.1.smithi134.stdout:8/587: mknod d4/d1f/d25/cb8 0 2024-09-17T04:21:00.631 INFO:tasks.workunit.client.0.smithi088.stdout:9/332: creat d2/dd/d11/d4f/d5c/f77 x:0 0 0 2024-09-17T04:21:00.633 INFO:tasks.workunit.client.1.smithi134.stdout:8/588: dwrite d4/d1e/d8a/fa8 [0,4194304] 0 2024-09-17T04:21:00.634 INFO:tasks.workunit.client.0.smithi088.stdout:9/333: dread d2/d16/f3f [0,4194304] 0 2024-09-17T04:21:00.635 INFO:tasks.workunit.client.0.smithi088.stdout:9/334: chown d2/dd/d11/d1d 689948 1 2024-09-17T04:21:00.635 INFO:tasks.workunit.client.1.smithi134.stdout:1/716: rename d12/d19/d1d/l84 to d12/db2/lf2 0 2024-09-17T04:21:00.636 INFO:tasks.workunit.client.0.smithi088.stdout:9/335: stat d2/dd/d11/d4f/c65 0 2024-09-17T04:21:00.636 INFO:tasks.workunit.client.1.smithi134.stdout:1/717: read - d12/d1c/d2e/fe8 zero size 2024-09-17T04:21:00.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:00 smithi088 ceph-mon[27811]: from='client.14798 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:21:00.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:00 smithi088 ceph-mon[27811]: pgmap v21: 65 pgs: 65 active+clean; 1.5 GiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 41 MiB/s rd, 205 MiB/s wr, 342 op/s 2024-09-17T04:21:00.638 INFO:tasks.workunit.client.1.smithi134.stdout:4/712: link d0/df/d35/d39/cb7 d0/d3b/ce7 0 2024-09-17T04:21:00.638 INFO:tasks.workunit.client.1.smithi134.stdout:1/718: write d12/d19/d1d/d3e/f48 [4833358,61989] 0 2024-09-17T04:21:00.638 INFO:tasks.workunit.client.1.smithi134.stdout:4/713: dread - d0/d3b/d9f/fae zero size 2024-09-17T04:21:00.639 INFO:tasks.workunit.client.0.smithi088.stdout:7/306: mkdir d2/d1e/d23/d45/d6d 0 2024-09-17T04:21:00.639 INFO:tasks.workunit.client.1.smithi134.stdout:1/719: fsync d12/d19/d4f/fb3 0 2024-09-17T04:21:00.642 INFO:tasks.workunit.client.0.smithi088.stdout:8/211: mkdir d7/d29/d2a/d38/d42 0 2024-09-17T04:21:00.644 INFO:tasks.workunit.client.1.smithi134.stdout:3/765: creat de/d67/ffa x:0 0 0 2024-09-17T04:21:00.644 INFO:tasks.workunit.client.1.smithi134.stdout:4/714: dread d0/df/d35/d5c/f81 [0,4194304] 0 2024-09-17T04:21:00.644 INFO:tasks.workunit.client.0.smithi088.stdout:8/212: write f2 [7761969,28095] 0 2024-09-17T04:21:00.645 INFO:tasks.workunit.client.0.smithi088.stdout:0/180: rmdir db/d1a 39 2024-09-17T04:21:00.647 INFO:tasks.workunit.client.0.smithi088.stdout:7/307: dwrite d2/d4/f69 [0,4194304] 0 2024-09-17T04:21:00.649 INFO:tasks.workunit.client.1.smithi134.stdout:3/766: dwrite de/d10/f79 [0,4194304] 0 2024-09-17T04:21:00.651 INFO:tasks.workunit.client.0.smithi088.stdout:0/181: dread db/f13 [0,4194304] 0 2024-09-17T04:21:00.652 INFO:tasks.workunit.client.0.smithi088.stdout:7/308: dread d2/d1d/f37 [0,4194304] 0 2024-09-17T04:21:00.654 INFO:tasks.workunit.client.1.smithi134.stdout:8/589: write d4/d1f/f3a [2568656,45015] 0 2024-09-17T04:21:00.654 INFO:tasks.workunit.client.1.smithi134.stdout:0/642: write d11/d6f/da8/fb2 [546292,42453] 0 2024-09-17T04:21:00.657 INFO:tasks.workunit.client.0.smithi088.stdout:9/336: creat d2/dd/d11/d1d/d35/f78 x:0 0 0 2024-09-17T04:21:00.661 INFO:tasks.workunit.client.0.smithi088.stdout:2/275: truncate d0/d18/f19 1106215 0 2024-09-17T04:21:00.664 INFO:tasks.workunit.client.1.smithi134.stdout:1/720: rmdir d12/d19/d5d 39 2024-09-17T04:21:00.666 INFO:tasks.workunit.client.1.smithi134.stdout:2/639: write d19/d1c/d47/fcd [996620,121696] 0 2024-09-17T04:21:00.667 INFO:tasks.workunit.client.1.smithi134.stdout:4/715: symlink d0/df/d35/d5c/d8b/le8 0 2024-09-17T04:21:00.669 INFO:tasks.workunit.client.0.smithi088.stdout:2/276: dwrite d0/d18/f3e [0,4194304] 0 2024-09-17T04:21:00.672 INFO:tasks.workunit.client.1.smithi134.stdout:0/643: rmdir d11/d18/d97 39 2024-09-17T04:21:00.673 INFO:tasks.workunit.client.1.smithi134.stdout:0/644: dread - d11/fd5 zero size 2024-09-17T04:21:00.675 INFO:tasks.workunit.client.0.smithi088.stdout:7/309: chown d2/d1e/d23/l68 3239 1 2024-09-17T04:21:00.676 INFO:tasks.workunit.client.0.smithi088.stdout:4/302: write d5/f21 [521274,78431] 0 2024-09-17T04:21:00.679 INFO:tasks.workunit.client.0.smithi088.stdout:8/213: dread f2 [0,4194304] 0 2024-09-17T04:21:00.681 INFO:tasks.workunit.client.1.smithi134.stdout:1/721: mknod d12/db2/cf3 0 2024-09-17T04:21:00.689 INFO:tasks.workunit.client.0.smithi088.stdout:2/277: symlink d0/d1/d2d/d33/l55 0 2024-09-17T04:21:00.689 INFO:tasks.workunit.client.1.smithi134.stdout:3/767: truncate de/d12/d22/d5a/f5d 7798442 0 2024-09-17T04:21:00.690 INFO:tasks.workunit.client.1.smithi134.stdout:3/768: stat de/d12/d15/d1d/la4 0 2024-09-17T04:21:00.693 INFO:tasks.workunit.client.0.smithi088.stdout:0/182: write db/d1a/d20/f2c [1818154,118554] 0 2024-09-17T04:21:00.694 INFO:tasks.workunit.client.0.smithi088.stdout:3/204: getdents d0/d13 0 2024-09-17T04:21:00.698 INFO:tasks.workunit.client.0.smithi088.stdout:4/303: mkdir d5/d3d/d49/d5e 0 2024-09-17T04:21:00.702 INFO:tasks.workunit.client.1.smithi134.stdout:0/645: link d11/d48/fa1 d11/d24/d49/d9b/dd8/fdb 0 2024-09-17T04:21:00.703 INFO:tasks.workunit.client.0.smithi088.stdout:2/278: symlink d0/d1/d2d/d33/d4b/d24/d3b/d26/l56 0 2024-09-17T04:21:00.704 INFO:tasks.workunit.client.0.smithi088.stdout:4/304: dwrite d5/d3f/f33 [4194304,4194304] 0 2024-09-17T04:21:00.705 INFO:tasks.workunit.client.1.smithi134.stdout:2/640: rename d19/l1e to d19/d1c/ld5 0 2024-09-17T04:21:00.709 INFO:tasks.workunit.client.1.smithi134.stdout:7/535: sync 2024-09-17T04:21:00.711 INFO:tasks.workunit.client.0.smithi088.stdout:9/337: link d2/fc d2/dd/d11/f79 0 2024-09-17T04:21:00.718 INFO:tasks.workunit.client.1.smithi134.stdout:3/769: creat de/d10/ffb x:0 0 0 2024-09-17T04:21:00.718 INFO:tasks.workunit.client.1.smithi134.stdout:3/770: chown de/d10/d3d/dd9/f92 146 1 2024-09-17T04:21:00.718 INFO:tasks.workunit.client.1.smithi134.stdout:1/722: rename d12/d1c/d2e/d7d/ca2 to d12/d19/d1d/d61/dd3/dda/cf4 0 2024-09-17T04:21:00.718 INFO:tasks.workunit.client.1.smithi134.stdout:1/723: read - d12/dcc/fe1 zero size 2024-09-17T04:21:00.720 INFO:tasks.workunit.client.1.smithi134.stdout:7/536: mkdir d0/dd/d3a/d3d/d38/da9 0 2024-09-17T04:21:00.721 INFO:tasks.workunit.client.1.smithi134.stdout:7/537: fsync d0/dd/d3a/f4f 0 2024-09-17T04:21:00.722 INFO:tasks.workunit.client.1.smithi134.stdout:2/641: symlink d19/d27/d31/d34/ld6 0 2024-09-17T04:21:00.723 INFO:tasks.workunit.client.0.smithi088.stdout:3/205: creat d0/d13/d1b/d29/d2b/d40/f43 x:0 0 0 2024-09-17T04:21:00.724 INFO:tasks.workunit.client.0.smithi088.stdout:2/279: symlink d0/d1/d2d/d33/d4b/l57 0 2024-09-17T04:21:00.725 INFO:tasks.workunit.client.0.smithi088.stdout:2/280: chown d0/d1/d2d/d33 1137 1 2024-09-17T04:21:00.726 INFO:tasks.workunit.client.0.smithi088.stdout:3/206: dread d0/d13/d1b/d29/f3b [0,4194304] 0 2024-09-17T04:21:00.726 INFO:tasks.workunit.client.0.smithi088.stdout:9/338: mknod d2/dd/d11/d4f/d5c/c7a 0 2024-09-17T04:21:00.727 INFO:tasks.workunit.client.1.smithi134.stdout:0/646: dread d11/d24/f7e [0,4194304] 0 2024-09-17T04:21:00.727 INFO:tasks.workunit.client.1.smithi134.stdout:0/647: readlink d11/d19/l2a 0 2024-09-17T04:21:00.728 INFO:tasks.workunit.client.0.smithi088.stdout:3/207: chown d0/d13/d1b/d29/d2b/d40/f43 27 1 2024-09-17T04:21:00.728 INFO:tasks.workunit.client.0.smithi088.stdout:9/339: dread - d2/dd/d11/d1d/d35/f5f zero size 2024-09-17T04:21:00.729 INFO:tasks.workunit.client.0.smithi088.stdout:8/214: creat d7/f43 x:0 0 0 2024-09-17T04:21:00.731 INFO:tasks.workunit.client.0.smithi088.stdout:4/305: mknod d5/d3d/d49/d5e/c5f 0 2024-09-17T04:21:00.732 INFO:tasks.workunit.client.1.smithi134.stdout:3/771: dread de/d12/d22/f26 [0,4194304] 0 2024-09-17T04:21:00.732 INFO:tasks.workunit.client.0.smithi088.stdout:4/306: read f1 [2889978,61055] 0 2024-09-17T04:21:00.732 INFO:tasks.workunit.client.1.smithi134.stdout:3/772: chown de/d12/d22 76331 1 2024-09-17T04:21:00.733 INFO:tasks.workunit.client.0.smithi088.stdout:2/281: mknod d0/d1/d2d/d33/d4b/c58 0 2024-09-17T04:21:00.733 INFO:tasks.workunit.client.1.smithi134.stdout:3/773: truncate de/d12/d15/d1d/d2d/fb4 964361 0 2024-09-17T04:21:00.734 INFO:tasks.workunit.client.0.smithi088.stdout:9/340: chown d2/c1c 19 1 2024-09-17T04:21:00.736 INFO:tasks.workunit.client.0.smithi088.stdout:9/341: write d2/dd/d11/d1d/d35/f78 [56817,123055] 0 2024-09-17T04:21:00.736 INFO:tasks.workunit.client.0.smithi088.stdout:3/208: symlink d0/d13/d1b/d29/l44 0 2024-09-17T04:21:00.737 INFO:tasks.workunit.client.1.smithi134.stdout:1/724: creat d12/d19/d1d/d5f/dd7/ff5 x:0 0 0 2024-09-17T04:21:00.739 INFO:tasks.workunit.client.0.smithi088.stdout:8/215: creat d7/d29/d2a/d38/f44 x:0 0 0 2024-09-17T04:21:00.742 INFO:tasks.workunit.client.1.smithi134.stdout:7/538: unlink d0/dd/d3a/d3d/d4c/f50 0 2024-09-17T04:21:00.743 INFO:tasks.workunit.client.0.smithi088.stdout:3/209: dwrite d0/d13/d1b/d29/d30/f39 [0,4194304] 0 2024-09-17T04:21:00.743 INFO:tasks.workunit.client.0.smithi088.stdout:4/307: creat d5/d3d/d49/d5e/f60 x:0 0 0 2024-09-17T04:21:00.745 INFO:tasks.workunit.client.1.smithi134.stdout:3/774: read de/d10/f64 [3494316,55593] 0 2024-09-17T04:21:00.746 INFO:tasks.workunit.client.1.smithi134.stdout:3/775: stat de/d12/d15/d1d/d8f 0 2024-09-17T04:21:00.749 INFO:tasks.workunit.client.0.smithi088.stdout:9/342: symlink d2/dd/d14/d2a/l7b 0 2024-09-17T04:21:00.751 INFO:tasks.workunit.client.0.smithi088.stdout:5/279: rename d2/l8 to d2/l5b 0 2024-09-17T04:21:00.751 INFO:tasks.workunit.client.0.smithi088.stdout:9/343: truncate d2/d2b/d58/f5b 1349911 0 2024-09-17T04:21:00.752 INFO:tasks.workunit.client.0.smithi088.stdout:9/344: dread - d2/dd/d11/d1d/d43/f55 zero size 2024-09-17T04:21:00.754 INFO:tasks.workunit.client.1.smithi134.stdout:0/648: mkdir d11/d19/ddc 0 2024-09-17T04:21:00.755 INFO:tasks.workunit.client.1.smithi134.stdout:0/649: readlink d11/d24/d49/d9b/lb7 0 2024-09-17T04:21:00.756 INFO:tasks.workunit.client.1.smithi134.stdout:7/539: rmdir d0/d16 39 2024-09-17T04:21:00.760 INFO:tasks.workunit.client.1.smithi134.stdout:3/776: symlink de/d12/d15/d1d/d2d/d31/d6a/d83/lfc 0 2024-09-17T04:21:00.761 INFO:tasks.workunit.client.0.smithi088.stdout:8/216: dwrite d7/dd/f16 [8388608,4194304] 0 2024-09-17T04:21:00.763 INFO:tasks.workunit.client.0.smithi088.stdout:9/345: dwrite d2/dd/d11/d4f/d5c/f77 [0,4194304] 0 2024-09-17T04:21:00.766 INFO:tasks.workunit.client.0.smithi088.stdout:4/308: write d5/f28 [298802,117223] 0 2024-09-17T04:21:00.774 INFO:tasks.workunit.client.1.smithi134.stdout:6/761: sync 2024-09-17T04:21:00.774 INFO:tasks.workunit.client.0.smithi088.stdout:3/210: mknod d0/c45 0 2024-09-17T04:21:00.775 INFO:tasks.workunit.client.1.smithi134.stdout:2/642: getdents d19/d27/d31 0 2024-09-17T04:21:00.777 INFO:tasks.workunit.client.0.smithi088.stdout:8/217: write d7/f8 [1655850,33049] 0 2024-09-17T04:21:00.779 INFO:tasks.workunit.client.1.smithi134.stdout:5/651: dwrite d0/da/d69/d41/d6d/d89/fb4 [0,4194304] 0 2024-09-17T04:21:00.779 INFO:tasks.workunit.client.0.smithi088.stdout:4/309: creat d5/d3d/d49/d5e/f61 x:0 0 0 2024-09-17T04:21:00.780 INFO:tasks.workunit.client.1.smithi134.stdout:5/652: chown d0/da/d29/db5 2613 1 2024-09-17T04:21:00.781 INFO:tasks.workunit.client.1.smithi134.stdout:5/653: readlink d0/d3a/d2b/d61/d7b/ld3 0 2024-09-17T04:21:00.785 INFO:tasks.workunit.client.1.smithi134.stdout:3/777: mkdir de/d12/d22/dfd 0 2024-09-17T04:21:00.786 INFO:tasks.workunit.client.0.smithi088.stdout:3/211: symlink d0/d13/d1b/d29/d30/d35/l46 0 2024-09-17T04:21:00.787 INFO:tasks.workunit.client.1.smithi134.stdout:6/762: symlink de/d19/d1f/d55/d77/db8/dc7/lf5 0 2024-09-17T04:21:00.792 INFO:tasks.workunit.client.1.smithi134.stdout:8/590: dwrite d4/d1e/d8a/fa8 [4194304,4194304] 0 2024-09-17T04:21:00.813 INFO:tasks.workunit.client.1.smithi134.stdout:7/540: dread d0/d16/d35/d4b/f44 [0,4194304] 0 2024-09-17T04:21:00.817 INFO:tasks.workunit.client.0.smithi088.stdout:4/310: rename d5/c35 to d5/d3d/d49/c62 0 2024-09-17T04:21:00.821 INFO:tasks.workunit.client.1.smithi134.stdout:6/763: dread de/d19/d74/d94/d9e/fac [0,4194304] 0 2024-09-17T04:21:00.821 INFO:tasks.workunit.client.1.smithi134.stdout:0/650: creat d11/d4c/dd3/d2f/fdd x:0 0 0 2024-09-17T04:21:00.822 INFO:tasks.workunit.client.0.smithi088.stdout:9/346: truncate d2/dd/d11/d30/d49/f45 2128144 0 2024-09-17T04:21:00.823 INFO:tasks.workunit.client.1.smithi134.stdout:5/654: creat d0/da/d29/d7c/fd7 x:0 0 0 2024-09-17T04:21:00.825 INFO:tasks.workunit.client.0.smithi088.stdout:3/212: dread d0/d13/d1b/d29/d2b/f34 [0,4194304] 0 2024-09-17T04:21:00.827 INFO:tasks.workunit.client.0.smithi088.stdout:3/213: dread - d0/d13/d1b/d29/f36 zero size 2024-09-17T04:21:00.831 INFO:tasks.workunit.client.1.smithi134.stdout:8/591: rmdir d4/d1e/daf 39 2024-09-17T04:21:00.832 INFO:tasks.workunit.client.0.smithi088.stdout:3/214: dread d0/d13/d1b/d29/f2d [0,4194304] 0 2024-09-17T04:21:00.835 INFO:tasks.workunit.client.1.smithi134.stdout:7/541: rename d0/dd/c28 to d0/d16/d8b/d6a/d70/d85/caa 0 2024-09-17T04:21:00.836 INFO:tasks.workunit.client.1.smithi134.stdout:1/725: getdents d12/d19/d5d/d91 0 2024-09-17T04:21:00.839 INFO:tasks.workunit.client.1.smithi134.stdout:0/651: unlink d11/d4c/dd3/d2f/d45/f8e 0 2024-09-17T04:21:00.840 INFO:tasks.workunit.client.0.smithi088.stdout:4/311: rename d5/d3d/c48 to d5/d3f/c63 0 2024-09-17T04:21:00.842 INFO:tasks.workunit.client.0.smithi088.stdout:3/215: creat d0/d13/d1b/d29/d2b/f47 x:0 0 0 2024-09-17T04:21:00.842 INFO:tasks.workunit.client.0.smithi088.stdout:3/216: fsync d0/f16 0 2024-09-17T04:21:00.843 INFO:tasks.workunit.client.1.smithi134.stdout:4/716: write d0/d13/f33 [1901112,9064] 0 2024-09-17T04:21:00.844 INFO:tasks.workunit.client.1.smithi134.stdout:8/592: write d4/db/dd/d95/f96 [212317,57060] 0 2024-09-17T04:21:00.846 INFO:tasks.workunit.client.1.smithi134.stdout:8/593: chown d4/d1e/l9a 136363349 1 2024-09-17T04:21:00.846 INFO:tasks.workunit.client.1.smithi134.stdout:4/717: dread d0/d13/d40/d42/d92/f21 [0,4194304] 0 2024-09-17T04:21:00.846 INFO:tasks.workunit.client.1.smithi134.stdout:6/764: rename de/d19/d21/f25 to de/d19/da3/de6/ff6 0 2024-09-17T04:21:00.847 INFO:tasks.workunit.client.0.smithi088.stdout:8/218: link d7/l11 d7/dd/l45 0 2024-09-17T04:21:00.847 INFO:tasks.workunit.client.1.smithi134.stdout:8/594: dread - d4/d1f/d25/d6a/f85 zero size 2024-09-17T04:21:00.849 INFO:tasks.workunit.client.0.smithi088.stdout:1/227: truncate d0/d1/d16/f3c 849894 0 2024-09-17T04:21:00.849 INFO:tasks.workunit.client.1.smithi134.stdout:8/595: truncate d4/db/d6e/fae 279457 0 2024-09-17T04:21:00.850 INFO:tasks.workunit.client.0.smithi088.stdout:1/228: chown d0/d13/f47 654607186 1 2024-09-17T04:21:00.850 INFO:tasks.workunit.client.1.smithi134.stdout:1/726: rmdir d12/d1c/dc0 39 2024-09-17T04:21:00.852 INFO:tasks.workunit.client.1.smithi134.stdout:8/596: truncate d4/d1f/d25/d6a/f85 200844 0 2024-09-17T04:21:00.853 INFO:tasks.workunit.client.1.smithi134.stdout:6/765: dwrite de/d19/d1f/d55/f87 [4194304,4194304] 0 2024-09-17T04:21:00.854 INFO:tasks.workunit.client.1.smithi134.stdout:6/766: chown de/d19/d62/db0 58575 1 2024-09-17T04:21:00.854 INFO:tasks.workunit.client.0.smithi088.stdout:3/217: write d0/d13/d1b/d29/f2d [2064134,41212] 0 2024-09-17T04:21:00.855 INFO:tasks.workunit.client.1.smithi134.stdout:0/652: readlink d11/d19/d21/d37/l6e 0 2024-09-17T04:21:00.856 INFO:tasks.workunit.client.1.smithi134.stdout:0/653: chown d11/d24/d49/d9b/dd8/fdb 227 1 2024-09-17T04:21:00.856 INFO:tasks.workunit.client.1.smithi134.stdout:0/654: readlink d11/d4c/dd3/d2f/lbe 0 2024-09-17T04:21:00.858 INFO:tasks.workunit.client.0.smithi088.stdout:3/218: fsync d0/d13/d1b/d29/f36 0 2024-09-17T04:21:00.858 INFO:tasks.workunit.client.0.smithi088.stdout:7/310: dwrite d2/d1e/f29 [0,4194304] 0 2024-09-17T04:21:00.859 INFO:tasks.workunit.client.1.smithi134.stdout:5/655: creat d0/da/d29/d7c/db3/fd8 x:0 0 0 2024-09-17T04:21:00.860 INFO:tasks.workunit.client.0.smithi088.stdout:7/311: write d2/d4/f69 [1983044,53323] 0 2024-09-17T04:21:00.860 INFO:tasks.workunit.client.1.smithi134.stdout:5/656: chown d0/d3a/f71 195177111 1 2024-09-17T04:21:00.861 INFO:tasks.workunit.client.1.smithi134.stdout:5/657: chown d0/da/d29/d7c/d9e/ld1 99913 1 2024-09-17T04:21:00.861 INFO:tasks.workunit.client.0.smithi088.stdout:9/347: getdents d2/dd/d11/d4f/d72/d74 0 2024-09-17T04:21:00.861 INFO:tasks.workunit.client.1.smithi134.stdout:5/658: readlink d0/da/d2c/l9a 0 2024-09-17T04:21:00.864 INFO:tasks.workunit.client.0.smithi088.stdout:1/229: unlink d0/d1/c11 0 2024-09-17T04:21:00.867 INFO:tasks.workunit.client.1.smithi134.stdout:4/718: mkdir d0/df/dd5/de9 0 2024-09-17T04:21:00.870 INFO:tasks.workunit.client.0.smithi088.stdout:9/348: dwrite d2/dd/d11/d1d/d43/f55 [0,4194304] 0 2024-09-17T04:21:00.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.875+0000 7fc9e6f7d640 1 -- 172.21.15.88:0/869085387 --> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc9cc000bf0 con 0x7fc9c8074a60 2024-09-17T04:21:00.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.877+0000 7fc9ddffb640 1 -- 172.21.15.88:0/869085387 <== mgr.24431 v2:172.21.15.134:6828/1122341233 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+318 (secure 0 0 0) 0x7fc9cc000bf0 con 0x7fc9c8074a60 2024-09-17T04:21:00.878 INFO:tasks.workunit.client.1.smithi134.stdout:7/542: link d0/d16/d35/f40 d0/d16/d8b/d6a/d70/d85/fab 0 2024-09-17T04:21:00.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.880+0000 7fc9e6f7d640 1 -- 172.21.15.88:0/869085387 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7fc9c8074a60 msgr2=0x7fc9c8076f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:00.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.880+0000 7fc9e6f7d640 1 --2- 172.21.15.88:0/869085387 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7fc9c8074a60 0x7fc9c8076f20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc9e019eed0 tx=0x7fc9d0005b50 comp rx=0 tx=0).stop 2024-09-17T04:21:00.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.880+0000 7fc9e6f7d640 1 -- 172.21.15.88:0/869085387 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9e0100860 msgr2=0x7fc9e00731d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:00.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.880+0000 7fc9e6f7d640 1 --2- 172.21.15.88:0/869085387 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9e0100860 0x7fc9e00731d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc9d400d8d0 tx=0x7fc9d400dd90 comp rx=0 tx=0).stop 2024-09-17T04:21:00.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.880+0000 7fc9e6f7d640 1 -- 172.21.15.88:0/869085387 shutdown_connections 2024-09-17T04:21:00.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.880+0000 7fc9e6f7d640 1 --2- 172.21.15.88:0/869085387 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7fc9c8074a60 0x7fc9c8076f20 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:00.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.880+0000 7fc9e6f7d640 1 --2- 172.21.15.88:0/869085387 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9e0101a60 0x7fc9e0073710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:00.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.880+0000 7fc9e6f7d640 1 --2- 172.21.15.88:0/869085387 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9e0100860 0x7fc9e00731d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:00.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.880+0000 7fc9e6f7d640 1 -- 172.21.15.88:0/869085387 >> 172.21.15.88:0/869085387 conn(0x7fc9e00fc010 msgr2=0x7fc9e0104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:21:00.881 INFO:tasks.workunit.client.0.smithi088.stdout:3/219: unlink d0/d13/d1b/c1f 0 2024-09-17T04:21:00.881 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.881+0000 7fc9e6f7d640 1 -- 172.21.15.88:0/869085387 shutdown_connections 2024-09-17T04:21:00.881 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:00.881+0000 7fc9e6f7d640 1 -- 172.21.15.88:0/869085387 wait complete. 2024-09-17T04:21:00.881 INFO:tasks.workunit.client.0.smithi088.stdout:3/220: fdatasync d0/d13/d1b/f21 0 2024-09-17T04:21:00.882 INFO:tasks.workunit.client.1.smithi134.stdout:1/727: mknod d12/d19/d5d/d88/cf6 0 2024-09-17T04:21:00.882 INFO:tasks.workunit.client.0.smithi088.stdout:3/221: dread - d0/d13/d1b/d29/d2b/f42 zero size 2024-09-17T04:21:00.887 INFO:tasks.workunit.client.1.smithi134.stdout:6/767: creat de/d19/d74/d98/ff7 x:0 0 0 2024-09-17T04:21:00.893 INFO:tasks.workunit.client.1.smithi134.stdout:6/768: dread de/d19/d1f/d55/f82 [0,4194304] 0 2024-09-17T04:21:00.894 INFO:tasks.workunit.client.0.smithi088.stdout:8/219: dread d7/dd/f1a [0,4194304] 0 2024-09-17T04:21:00.894 INFO:tasks.workunit.client.1.smithi134.stdout:4/719: symlink d0/df/d35/d5c/d8b/lea 0 2024-09-17T04:21:00.895 INFO:tasks.workunit.client.0.smithi088.stdout:7/312: mknod d2/d4/d7/c6e 0 2024-09-17T04:21:00.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:00 smithi134 ceph-mon[35201]: from='client.14798 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:21:00.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:00 smithi134 ceph-mon[35201]: pgmap v21: 65 pgs: 65 active+clean; 1.5 GiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 41 MiB/s rd, 205 MiB/s wr, 342 op/s 2024-09-17T04:21:00.897 INFO:tasks.workunit.client.0.smithi088.stdout:3/222: rmdir d0/d13/d1b/d29/d2b 39 2024-09-17T04:21:00.900 INFO:tasks.workunit.client.1.smithi134.stdout:1/728: mkdir d12/d19/d5d/d91/df7 0 2024-09-17T04:21:00.902 INFO:tasks.workunit.client.1.smithi134.stdout:8/597: creat d4/d1e/daf/fb9 x:0 0 0 2024-09-17T04:21:00.903 INFO:tasks.workunit.client.1.smithi134.stdout:8/598: dread - d4/d11/f90 zero size 2024-09-17T04:21:00.904 INFO:tasks.workunit.client.0.smithi088.stdout:2/282: write d0/d1/fe [1718079,58347] 0 2024-09-17T04:21:00.905 INFO:tasks.workunit.client.0.smithi088.stdout:2/283: dread - d0/d1/d2d/d33/f52 zero size 2024-09-17T04:21:00.907 INFO:tasks.workunit.client.1.smithi134.stdout:0/655: symlink d11/d24/d49/d62/dce/lde 0 2024-09-17T04:21:00.908 INFO:tasks.workunit.client.0.smithi088.stdout:3/223: creat d0/d13/d1b/d29/d30/f48 x:0 0 0 2024-09-17T04:21:00.911 INFO:tasks.workunit.client.0.smithi088.stdout:8/220: rename d7/d29/d2a/c2c to d7/d29/d2a/d38/c46 0 2024-09-17T04:21:00.915 INFO:tasks.workunit.client.1.smithi134.stdout:4/720: mknod d0/df/d1e/daa/ceb 0 2024-09-17T04:21:00.917 INFO:tasks.workunit.client.1.smithi134.stdout:4/721: chown d0/df/d1e/daa/fb0 21184 1 2024-09-17T04:21:00.917 INFO:tasks.workunit.client.1.smithi134.stdout:7/543: mknod d0/d16/d35/cac 0 2024-09-17T04:21:00.919 INFO:tasks.workunit.client.1.smithi134.stdout:7/544: chown d0/dd/d3a/l9f 1633 1 2024-09-17T04:21:00.920 INFO:tasks.workunit.client.1.smithi134.stdout:1/729: stat d12/d1c/d2e/d7d/cb1 0 2024-09-17T04:21:00.920 INFO:tasks.workunit.client.1.smithi134.stdout:2/643: dwrite d19/d7e/f86 [0,4194304] 0 2024-09-17T04:21:00.921 INFO:tasks.workunit.client.1.smithi134.stdout:2/644: chown d19/d27/d31/l43 63047 1 2024-09-17T04:21:00.921 INFO:tasks.workunit.client.0.smithi088.stdout:3/224: chown d0/d13/d1b/d29/d2b/f3f 3603 1 2024-09-17T04:21:00.922 INFO:tasks.workunit.client.0.smithi088.stdout:3/225: write d0/fa [469158,57037] 0 2024-09-17T04:21:00.927 INFO:tasks.workunit.client.1.smithi134.stdout:1/730: dwrite d12/d19/d1d/d61/fe2 [0,4194304] 0 2024-09-17T04:21:00.928 INFO:tasks.workunit.client.1.smithi134.stdout:3/778: write de/d12/d15/d1d/d2d/d31/f3e [1087003,22721] 0 2024-09-17T04:21:00.929 INFO:tasks.workunit.client.0.smithi088.stdout:2/284: link d0/d1/d2d/d33/d4b/d24/d3b/d26/f4e d0/d1/d2d/d33/d4b/d24/d3b/f59 0 2024-09-17T04:21:00.929 INFO:tasks.workunit.client.0.smithi088.stdout:2/285: chown d0/d18 5636604 1 2024-09-17T04:21:00.929 INFO:tasks.workunit.client.1.smithi134.stdout:3/779: chown de/d12/d15/d1d/d2d/c57 1486 1 2024-09-17T04:21:00.931 INFO:tasks.workunit.client.0.smithi088.stdout:2/286: stat d0/d1/d2d/d33/l55 0 2024-09-17T04:21:00.931 INFO:tasks.workunit.client.0.smithi088.stdout:8/221: dread d7/dd/f16 [4194304,4194304] 0 2024-09-17T04:21:00.932 INFO:tasks.workunit.client.1.smithi134.stdout:8/599: creat d4/db/dd/d43/d8b/d8e/fba x:0 0 0 2024-09-17T04:21:00.932 INFO:tasks.workunit.client.0.smithi088.stdout:8/222: read f2 [2246994,42322] 0 2024-09-17T04:21:00.933 INFO:tasks.workunit.client.1.smithi134.stdout:8/600: chown d4/d1f/d25/c59 0 1 2024-09-17T04:21:00.935 INFO:tasks.workunit.client.0.smithi088.stdout:3/226: dread d0/d13/f22 [0,4194304] 0 2024-09-17T04:21:00.940 INFO:tasks.workunit.client.0.smithi088.stdout:8/223: dwrite d7/d29/f12 [4194304,4194304] 0 2024-09-17T04:21:00.945 INFO:tasks.workunit.client.1.smithi134.stdout:6/769: rename de/d19/d1f/d55/d77/db8/cec to de/d19/d74/d94/d9e/cf8 0 2024-09-17T04:21:00.950 INFO:tasks.workunit.client.0.smithi088.stdout:2/287: mknod d0/d1/d2d/d33/d4b/d24/d3b/d26/c5a 0 2024-09-17T04:21:00.951 INFO:tasks.workunit.client.1.smithi134.stdout:6/770: dwrite de/d19/d74/d98/ff7 [0,4194304] 0 2024-09-17T04:21:00.953 INFO:tasks.workunit.client.1.smithi134.stdout:8/601: rmdir d4/db 39 2024-09-17T04:21:00.956 INFO:tasks.workunit.client.0.smithi088.stdout:3/227: mknod d0/d13/d1b/d29/d30/c49 0 2024-09-17T04:21:00.957 INFO:tasks.workunit.client.0.smithi088.stdout:2/288: dwrite d0/d1/f2 [0,4194304] 0 2024-09-17T04:21:00.958 INFO:tasks.workunit.client.1.smithi134.stdout:0/656: symlink d11/d19/d21/ldf 0 2024-09-17T04:21:00.959 INFO:tasks.workunit.client.1.smithi134.stdout:6/771: dread de/d19/d21/d2d/f6a [0,4194304] 0 2024-09-17T04:21:00.959 INFO:tasks.workunit.client.1.smithi134.stdout:5/659: link d0/da/d29/d78/da5/dce/ccf d0/da/d69/d41/d72/cd9 0 2024-09-17T04:21:00.961 INFO:tasks.workunit.client.0.smithi088.stdout:8/224: mkdir d7/dd/d31/d47 0 2024-09-17T04:21:00.961 INFO:tasks.workunit.client.0.smithi088.stdout:8/225: chown d7/f8 1459 1 2024-09-17T04:21:00.962 INFO:tasks.workunit.client.1.smithi134.stdout:8/602: dwrite d4/f26 [4194304,4194304] 0 2024-09-17T04:21:00.962 INFO:tasks.workunit.client.0.smithi088.stdout:8/226: write d7/d29/d2a/f2b [4366568,30612] 0 2024-09-17T04:21:00.966 INFO:tasks.workunit.client.1.smithi134.stdout:4/722: rename d0/df/d17/ca8 to d0/df/d35/d39/cec 0 2024-09-17T04:21:00.969 INFO:tasks.workunit.client.1.smithi134.stdout:4/723: truncate d0/d13/d40/d42/d92/d86/faf 1368931 0 2024-09-17T04:21:00.971 INFO:tasks.workunit.client.0.smithi088.stdout:1/230: dwrite d0/f4 [0,4194304] 0 2024-09-17T04:21:00.973 INFO:tasks.workunit.client.0.smithi088.stdout:3/228: mknod d0/d13/c4a 0 2024-09-17T04:21:00.974 INFO:tasks.workunit.client.0.smithi088.stdout:1/231: truncate d0/d13/f47 47638 0 2024-09-17T04:21:00.976 INFO:tasks.workunit.client.0.smithi088.stdout:9/349: dwrite d2/fc [4194304,4194304] 0 2024-09-17T04:21:00.981 INFO:tasks.workunit.client.0.smithi088.stdout:4/312: rmdir d5/d3d/d49/d5e 39 2024-09-17T04:21:00.987 INFO:tasks.workunit.client.0.smithi088.stdout:7/313: truncate d2/d4/d7/d46/f4e 3892868 0 2024-09-17T04:21:00.990 INFO:tasks.workunit.client.1.smithi134.stdout:1/731: rename d12/d19/d4f/ld4 to d12/d19/d1d/d61/dd3/lf8 0 2024-09-17T04:21:00.992 INFO:tasks.workunit.client.1.smithi134.stdout:4/724: creat d0/d13/d40/d42/dc5/fed x:0 0 0 2024-09-17T04:21:00.993 INFO:tasks.workunit.client.0.smithi088.stdout:8/227: dwrite d7/dd/f16 [0,4194304] 0 2024-09-17T04:21:00.996 INFO:tasks.workunit.client.0.smithi088.stdout:9/350: mkdir d2/d2b/d7c 0 2024-09-17T04:21:00.997 INFO:tasks.workunit.client.1.smithi134.stdout:0/657: creat d11/d4c/dd3/d81/fe0 x:0 0 0 2024-09-17T04:21:01.000 INFO:tasks.workunit.client.0.smithi088.stdout:4/313: write d5/d32/f44 [219201,86241] 0 2024-09-17T04:21:01.002 INFO:tasks.workunit.client.0.smithi088.stdout:7/314: rename d2/d4/d7/d46/c64 to d2/d4/c6f 0 2024-09-17T04:21:01.004 INFO:tasks.workunit.client.1.smithi134.stdout:3/780: rename de/d12/d15/d1d/d2d/d31/d6a/d83/dd8 to de/d12/d15/dd0/dfe 0 2024-09-17T04:21:01.005 INFO:tasks.workunit.client.0.smithi088.stdout:9/351: symlink d2/d16/l7d 0 2024-09-17T04:21:01.006 INFO:tasks.workunit.client.1.smithi134.stdout:3/781: truncate de/d12/d9d/dd4/fdb 1045306 0 2024-09-17T04:21:01.007 INFO:tasks.workunit.client.1.smithi134.stdout:4/725: symlink d0/d13/d40/d42/d92/dc3/lee 0 2024-09-17T04:21:01.011 INFO:tasks.workunit.client.1.smithi134.stdout:2/645: write d19/f1a [5000561,26801] 0 2024-09-17T04:21:01.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.013+0000 7f88d14c7640 1 -- 172.21.15.88:0/815401254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88cc102430 msgr2=0x7f88cc104820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:01.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.013+0000 7f88d14c7640 1 --2- 172.21.15.88:0/815401254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88cc102430 0x7f88cc104820 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f88bc009880 tx=0x7f88bc02a4a0 comp rx=0 tx=0).stop 2024-09-17T04:21:01.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.013+0000 7f88d14c7640 1 -- 172.21.15.88:0/815401254 shutdown_connections 2024-09-17T04:21:01.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.013+0000 7f88d14c7640 1 --2- 172.21.15.88:0/815401254 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88cc104d60 0x7f88cc107150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:01.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.013+0000 7f88d14c7640 1 --2- 172.21.15.88:0/815401254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88cc102430 0x7f88cc104820 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:01.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.013+0000 7f88d14c7640 1 -- 172.21.15.88:0/815401254 >> 172.21.15.88:0/815401254 conn(0x7f88cc0fc010 msgr2=0x7f88cc0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:21:01.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.014+0000 7f88d14c7640 1 -- 172.21.15.88:0/815401254 shutdown_connections 2024-09-17T04:21:01.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.014+0000 7f88d14c7640 1 -- 172.21.15.88:0/815401254 wait complete. 2024-09-17T04:21:01.015 INFO:tasks.workunit.client.1.smithi134.stdout:0/658: dwrite d11/d18/d97/fcf [0,4194304] 0 2024-09-17T04:21:01.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.014+0000 7f88d14c7640 1 Processor -- start 2024-09-17T04:21:01.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.015+0000 7f88d14c7640 1 -- start start 2024-09-17T04:21:01.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.015+0000 7f88d14c7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88cc102430 0x7f88cc1937b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:21:01.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.015+0000 7f88d14c7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88cc104d60 0x7f88cc193cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:21:01.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.015+0000 7f88d14c7640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f88cc10a7b0 con 0x7f88cc102430 2024-09-17T04:21:01.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.015+0000 7f88d14c7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f88cc10a630 con 0x7f88cc104d60 2024-09-17T04:21:01.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.015+0000 7f88caffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88cc102430 0x7f88cc1937b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:21:01.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.016+0000 7f88caffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88cc102430 0x7f88cc1937b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46354/0 (socket says 172.21.15.88:46354) 2024-09-17T04:21:01.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.016+0000 7f88caffd640 1 -- 172.21.15.88:0/4155908244 learned_addr learned my addr 172.21.15.88:0/4155908244 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:21:01.016 INFO:tasks.workunit.client.0.smithi088.stdout:2/289: getdents d0/d1/d2d/d33 0 2024-09-17T04:21:01.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.016+0000 7f88ca7fc640 1 --2- 172.21.15.88:0/4155908244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88cc104d60 0x7f88cc193cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:21:01.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.016+0000 7f88caffd640 1 -- 172.21.15.88:0/4155908244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88cc104d60 msgr2=0x7f88cc193cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:01.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.016+0000 7f88caffd640 1 --2- 172.21.15.88:0/4155908244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88cc104d60 0x7f88cc193cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:01.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.016+0000 7f88caffd640 1 -- 172.21.15.88:0/4155908244 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88cc190330 con 0x7f88cc102430 2024-09-17T04:21:01.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.016+0000 7f88ca7fc640 1 --2- 172.21.15.88:0/4155908244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88cc104d60 0x7f88cc193cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:21:01.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.016+0000 7f88caffd640 1 --2- 172.21.15.88:0/4155908244 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88cc102430 0x7f88cc1937b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f88bc02aa90 tx=0x7f88bc004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:21:01.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.017+0000 7f88b3fff640 1 -- 172.21.15.88:0/4155908244 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f88bc03f070 con 0x7f88cc102430 2024-09-17T04:21:01.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.017+0000 7f88d14c7640 1 -- 172.21.15.88:0/4155908244 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88cc1905c0 con 0x7f88cc102430 2024-09-17T04:21:01.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.017+0000 7f88d14c7640 1 -- 172.21.15.88:0/4155908244 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88cc190af0 con 0x7f88cc102430 2024-09-17T04:21:01.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.017+0000 7f88b3fff640 1 -- 172.21.15.88:0/4155908244 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f88bc0035f0 con 0x7f88cc102430 2024-09-17T04:21:01.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.017+0000 7f88b3fff640 1 -- 172.21.15.88:0/4155908244 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f88bc035030 con 0x7f88cc102430 2024-09-17T04:21:01.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.019+0000 7f88d14c7640 1 -- 172.21.15.88:0/4155908244 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88b80052c0 con 0x7f88cc102430 2024-09-17T04:21:01.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.019+0000 7f88b3fff640 1 -- 172.21.15.88:0/4155908244 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f88bc042070 con 0x7f88cc102430 2024-09-17T04:21:01.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.020+0000 7f88b3fff640 1 --2- 172.21.15.88:0/4155908244 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f88b4074ad0 0x7f88b4076f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:21:01.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.020+0000 7f88b3fff640 1 -- 172.21.15.88:0/4155908244 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f88bc0b6d20 con 0x7f88cc102430 2024-09-17T04:21:01.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.021+0000 7f88ca7fc640 1 --2- 172.21.15.88:0/4155908244 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f88b4074ad0 0x7f88b4076f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:21:01.021 INFO:tasks.workunit.client.0.smithi088.stdout:7/315: rename d2/f19 to d2/d1e/d23/d45/d62/f70 0 2024-09-17T04:21:01.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.022+0000 7f88ca7fc640 1 --2- 172.21.15.88:0/4155908244 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f88b4074ad0 0x7f88b4076f90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f88cc191730 tx=0x7f88c0005f90 comp rx=0 tx=0).ready entity=mgr.24431 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:21:01.029 INFO:tasks.workunit.client.1.smithi134.stdout:2/646: symlink d19/d27/d31/d49/d6f/da9/db0/daa/ld7 0 2024-09-17T04:21:01.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.029+0000 7f88b3fff640 1 -- 172.21.15.88:0/4155908244 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f88bc0822d0 con 0x7f88cc102430 2024-09-17T04:21:01.030 INFO:tasks.workunit.client.1.smithi134.stdout:2/647: dread - d19/d27/d31/f6e zero size 2024-09-17T04:21:01.035 INFO:tasks.workunit.client.1.smithi134.stdout:3/782: rmdir de/d12/d15/d9f/dba/df0 0 2024-09-17T04:21:01.036 INFO:tasks.workunit.client.1.smithi134.stdout:3/783: dread - de/d12/d15/d1d/d8f/d90/fa8 zero size 2024-09-17T04:21:01.038 INFO:tasks.workunit.client.1.smithi134.stdout:2/648: symlink d19/da1/ld8 0 2024-09-17T04:21:01.041 INFO:tasks.workunit.client.1.smithi134.stdout:0/659: mkdir d11/d19/ddc/de1 0 2024-09-17T04:21:01.041 INFO:tasks.workunit.client.1.smithi134.stdout:5/660: dwrite d0/da/d29/f84 [0,4194304] 0 2024-09-17T04:21:01.042 INFO:tasks.workunit.client.0.smithi088.stdout:1/232: truncate d0/d1/d16/d35/f36 4258352 0 2024-09-17T04:21:01.045 INFO:tasks.workunit.client.1.smithi134.stdout:6/772: dwrite de/d19/d62/d7c/f7d [0,4194304] 0 2024-09-17T04:21:01.051 INFO:tasks.workunit.client.0.smithi088.stdout:7/316: rename d2/d1e/d23/c3f to d2/d1e/d23/d45/d6d/c71 0 2024-09-17T04:21:01.053 INFO:tasks.workunit.client.0.smithi088.stdout:7/317: truncate d2/d4/d7/f5f 255669 0 2024-09-17T04:21:01.054 INFO:tasks.workunit.client.0.smithi088.stdout:7/318: fdatasync d2/d1e/f3b 0 2024-09-17T04:21:01.055 INFO:tasks.workunit.client.0.smithi088.stdout:7/319: read - d2/d1e/d23/d45/f57 zero size 2024-09-17T04:21:01.056 INFO:tasks.workunit.client.0.smithi088.stdout:7/320: chown d2/d1e/d23/d45/d6d 65311133 1 2024-09-17T04:21:01.057 INFO:tasks.workunit.client.0.smithi088.stdout:3/229: symlink d0/d13/d1b/d29/d30/l4b 0 2024-09-17T04:21:01.058 INFO:tasks.workunit.client.1.smithi134.stdout:6/773: fsync de/d19/d21/d2d/f6a 0 2024-09-17T04:21:01.059 INFO:tasks.workunit.client.0.smithi088.stdout:3/230: readlink d0/d13/d1b/d29/l2e 0 2024-09-17T04:21:01.061 INFO:tasks.workunit.client.0.smithi088.stdout:3/231: truncate d0/f33 98173 0 2024-09-17T04:21:01.063 INFO:tasks.workunit.client.1.smithi134.stdout:2/649: creat d19/d1c/d47/dae/dc8/fd9 x:0 0 0 2024-09-17T04:21:01.063 INFO:tasks.workunit.client.0.smithi088.stdout:7/321: dwrite d2/f21 [0,4194304] 0 2024-09-17T04:21:01.064 INFO:tasks.workunit.client.1.smithi134.stdout:2/650: write d19/d27/d31/d34/fbd [4116759,57827] 0 2024-09-17T04:21:01.066 INFO:tasks.workunit.client.0.smithi088.stdout:1/233: fdatasync d0/d13/f1e 0 2024-09-17T04:21:01.069 INFO:tasks.workunit.client.0.smithi088.stdout:7/322: dread d2/d1e/f5a [0,4194304] 0 2024-09-17T04:21:01.071 INFO:tasks.workunit.client.0.smithi088.stdout:7/323: chown d2/d4/d7/f5f 3451179 1 2024-09-17T04:21:01.072 INFO:tasks.workunit.client.1.smithi134.stdout:2/651: dwrite d19/d1c/d47/d50/d85/fb2 [0,4194304] 0 2024-09-17T04:21:01.074 INFO:tasks.workunit.client.1.smithi134.stdout:3/784: creat de/d12/d15/d1d/d2d/d63/fff x:0 0 0 2024-09-17T04:21:01.079 INFO:tasks.workunit.client.0.smithi088.stdout:9/352: write d2/dd/d11/d30/d49/f45 [1039010,64874] 0 2024-09-17T04:21:01.080 INFO:tasks.workunit.client.1.smithi134.stdout:5/661: getdents d0/d3a/d6b/d9c/dad 0 2024-09-17T04:21:01.086 INFO:tasks.workunit.client.1.smithi134.stdout:2/652: rename d19/d27/d31/d34/l39 to d19/d27/d31/d49/dc3/lda 0 2024-09-17T04:21:01.088 INFO:tasks.workunit.client.0.smithi088.stdout:7/324: creat d2/d4/d7/d46/d67/f72 x:0 0 0 2024-09-17T04:21:01.088 INFO:tasks.workunit.client.0.smithi088.stdout:3/232: dread d0/f12 [0,4194304] 0 2024-09-17T04:21:01.089 INFO:tasks.workunit.client.1.smithi134.stdout:3/785: creat de/d12/d15/d1d/d8f/deb/f100 x:0 0 0 2024-09-17T04:21:01.090 INFO:tasks.workunit.client.0.smithi088.stdout:2/290: truncate d0/d18/f34 608148 0 2024-09-17T04:21:01.095 INFO:tasks.workunit.client.0.smithi088.stdout:3/233: truncate d0/d13/d1b/f27 1462258 0 2024-09-17T04:21:01.095 INFO:tasks.workunit.client.0.smithi088.stdout:3/234: chown d0/fb 182378224 1 2024-09-17T04:21:01.096 INFO:tasks.workunit.client.0.smithi088.stdout:3/235: fdatasync d0/d13/d1b/f21 0 2024-09-17T04:21:01.098 INFO:tasks.workunit.client.0.smithi088.stdout:9/353: creat d2/dd/d11/d1d/f7e x:0 0 0 2024-09-17T04:21:01.100 INFO:tasks.workunit.client.1.smithi134.stdout:2/653: creat d19/d1c/d92/fdb x:0 0 0 2024-09-17T04:21:01.100 INFO:tasks.workunit.client.1.smithi134.stdout:0/660: truncate d11/d4c/dd3/f80 1017428 0 2024-09-17T04:21:01.105 INFO:tasks.workunit.client.1.smithi134.stdout:5/662: rename d0/da/d69/c77 to d0/da/d29/d78/da5/dce/cda 0 2024-09-17T04:21:01.105 INFO:tasks.workunit.client.1.smithi134.stdout:5/663: write d0/f79 [1467862,85544] 0 2024-09-17T04:21:01.108 INFO:tasks.workunit.client.0.smithi088.stdout:3/236: symlink d0/l4c 0 2024-09-17T04:21:01.109 INFO:tasks.workunit.client.0.smithi088.stdout:9/354: link d2/f3 d2/dd/d11/d30/f7f 0 2024-09-17T04:21:01.110 INFO:tasks.workunit.client.0.smithi088.stdout:9/355: chown d2/dd/d11/f79 0 1 2024-09-17T04:21:01.111 INFO:tasks.workunit.client.0.smithi088.stdout:9/356: chown d2/dd/d11/d30/f7f 2014 1 2024-09-17T04:21:01.112 INFO:tasks.workunit.client.0.smithi088.stdout:1/234: truncate d0/d1/d16/f3c 1223236 0 2024-09-17T04:21:01.115 INFO:tasks.workunit.client.0.smithi088.stdout:2/291: link d0/d1/d2d/d33/d4b/d24/f2a d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/f5b 0 2024-09-17T04:21:01.115 INFO:tasks.workunit.client.1.smithi134.stdout:6/774: write de/d19/d21/d2d/f39 [1434590,68019] 0 2024-09-17T04:21:01.116 INFO:tasks.workunit.client.1.smithi134.stdout:5/664: mknod d0/da/d69/d41/db6/cdb 0 2024-09-17T04:21:01.120 INFO:tasks.workunit.client.0.smithi088.stdout:9/357: creat d2/d2b/f80 x:0 0 0 2024-09-17T04:21:01.120 INFO:tasks.workunit.client.0.smithi088.stdout:9/358: stat f1 0 2024-09-17T04:21:01.125 INFO:tasks.workunit.client.0.smithi088.stdout:2/292: unlink d0/d1/d2d/d33/l55 0 2024-09-17T04:21:01.125 INFO:tasks.workunit.client.0.smithi088.stdout:9/359: dread d2/fc [4194304,4194304] 0 2024-09-17T04:21:01.127 INFO:tasks.workunit.client.0.smithi088.stdout:2/293: truncate d0/d1/d2d/d33/d4b/d24/f51 728284 0 2024-09-17T04:21:01.129 INFO:tasks.workunit.client.0.smithi088.stdout:1/235: dread d0/d1/f1a [0,4194304] 0 2024-09-17T04:21:01.129 INFO:tasks.workunit.client.1.smithi134.stdout:6/775: rename de/d19/d21/f7a to de/d19/d21/d4d/ff9 0 2024-09-17T04:21:01.131 INFO:tasks.workunit.client.0.smithi088.stdout:1/236: chown d0/d13/f47 23776339 1 2024-09-17T04:21:01.133 INFO:tasks.workunit.client.0.smithi088.stdout:3/237: dwrite d0/d13/f22 [0,4194304] 0 2024-09-17T04:21:01.134 INFO:tasks.workunit.client.1.smithi134.stdout:0/661: write d11/d4c/dd3/d2f/d43/d5d/f6d [333307,52251] 0 2024-09-17T04:21:01.137 INFO:tasks.workunit.client.0.smithi088.stdout:3/238: truncate d0/d13/d1b/d29/d30/f48 847556 0 2024-09-17T04:21:01.137 INFO:tasks.workunit.client.1.smithi134.stdout:3/786: getdents de/d12/d15/d1d/d2d/d31/d6a/d78/d7c 0 2024-09-17T04:21:01.140 INFO:tasks.workunit.client.0.smithi088.stdout:3/239: dread d0/f10 [0,4194304] 0 2024-09-17T04:21:01.141 INFO:tasks.workunit.client.1.smithi134.stdout:6/776: symlink de/d19/d74/d98/lfa 0 2024-09-17T04:21:01.143 INFO:tasks.workunit.client.0.smithi088.stdout:1/237: chown d0/d1/d16/d35/c48 248 1 2024-09-17T04:21:01.144 INFO:tasks.workunit.client.1.smithi134.stdout:5/665: mknod d0/cdc 0 2024-09-17T04:21:01.145 INFO:tasks.workunit.client.1.smithi134.stdout:5/666: chown d0/da/d69/d41/db6/cc6 56560 1 2024-09-17T04:21:01.146 INFO:tasks.workunit.client.0.smithi088.stdout:1/238: truncate d0/f4 4370641 0 2024-09-17T04:21:01.146 INFO:tasks.workunit.client.1.smithi134.stdout:2/654: getdents d19/d27/d31/d49/d6f 0 2024-09-17T04:21:01.147 INFO:tasks.workunit.client.1.smithi134.stdout:2/655: chown d19/d27/d31/d49/d6f/d84/d98/fce 0 1 2024-09-17T04:21:01.148 INFO:tasks.workunit.client.0.smithi088.stdout:2/294: dread d0/f12 [0,4194304] 0 2024-09-17T04:21:01.150 INFO:tasks.workunit.client.0.smithi088.stdout:3/240: dwrite d0/d13/d1b/d29/d2b/f47 [0,4194304] 0 2024-09-17T04:21:01.151 INFO:tasks.workunit.client.1.smithi134.stdout:3/787: symlink de/d10/d70/l101 0 2024-09-17T04:21:01.152 INFO:tasks.workunit.client.0.smithi088.stdout:6/272: sync 2024-09-17T04:21:01.152 INFO:tasks.workunit.client.1.smithi134.stdout:3/788: write de/d12/d9d/dd4/fdb [1079168,16812] 0 2024-09-17T04:21:01.153 INFO:tasks.workunit.client.1.smithi134.stdout:6/777: creat de/d19/d1f/d85/d88/ffb x:0 0 0 2024-09-17T04:21:01.154 INFO:tasks.workunit.client.0.smithi088.stdout:6/273: write d14/d2f/f36 [1084185,51836] 0 2024-09-17T04:21:01.155 INFO:tasks.workunit.client.1.smithi134.stdout:2/656: read d19/d27/d31/d49/d63/f68 [712907,96143] 0 2024-09-17T04:21:01.158 INFO:tasks.workunit.client.0.smithi088.stdout:1/239: dread d0/d13/f1b [0,4194304] 0 2024-09-17T04:21:01.159 INFO:tasks.workunit.client.0.smithi088.stdout:1/240: dread - d0/d1/df/d20/f29 zero size 2024-09-17T04:21:01.161 INFO:tasks.workunit.client.1.smithi134.stdout:0/662: mkdir d11/d24/d49/d9b/dd8/de2 0 2024-09-17T04:21:01.162 INFO:tasks.workunit.client.1.smithi134.stdout:0/663: chown d11/d24/d49/d9b 128738 1 2024-09-17T04:21:01.162 INFO:tasks.workunit.client.0.smithi088.stdout:2/295: mknod d0/d18/c5c 0 2024-09-17T04:21:01.165 INFO:tasks.workunit.client.0.smithi088.stdout:2/296: dread d0/d1/fb [0,4194304] 0 2024-09-17T04:21:01.166 INFO:tasks.workunit.client.0.smithi088.stdout:2/297: fsync d0/d18/f3e 0 2024-09-17T04:21:01.167 INFO:tasks.workunit.client.1.smithi134.stdout:3/789: creat de/d12/d22/d5a/f102 x:0 0 0 2024-09-17T04:21:01.167 INFO:tasks.workunit.client.1.smithi134.stdout:7/545: sync 2024-09-17T04:21:01.168 INFO:tasks.workunit.client.1.smithi134.stdout:7/546: write d0/dd/d3a/d3d/d4c/f76 [852135,108890] 0 2024-09-17T04:21:01.169 INFO:tasks.workunit.client.1.smithi134.stdout:6/778: mknod de/d5d/d67/cfc 0 2024-09-17T04:21:01.169 INFO:tasks.workunit.client.1.smithi134.stdout:6/779: chown f9 25918 1 2024-09-17T04:21:01.169 INFO:tasks.workunit.client.1.smithi134.stdout:7/547: readlink d0/dd/d3a/d3d/l45 0 2024-09-17T04:21:01.170 INFO:tasks.workunit.client.1.smithi134.stdout:5/667: fsync d0/d3a/f50 0 2024-09-17T04:21:01.170 INFO:tasks.workunit.client.1.smithi134.stdout:7/548: stat d0/d16/d35/f49 0 2024-09-17T04:21:01.173 INFO:tasks.workunit.client.1.smithi134.stdout:2/657: rename d19/d1c/da3 to d19/d1c/d92/ddc 0 2024-09-17T04:21:01.173 INFO:tasks.workunit.client.0.smithi088.stdout:9/360: link d2/l4e d2/dd/d11/d4f/d72/l81 0 2024-09-17T04:21:01.174 INFO:tasks.workunit.client.0.smithi088.stdout:9/361: dread - d2/d2b/d58/f6a zero size 2024-09-17T04:21:01.175 INFO:tasks.workunit.client.1.smithi134.stdout:0/664: write d11/d19/d21/d37/f42 [35452,18531] 0 2024-09-17T04:21:01.176 INFO:tasks.workunit.client.0.smithi088.stdout:3/241: mkdir d0/d13/d4d 0 2024-09-17T04:21:01.178 INFO:tasks.workunit.client.1.smithi134.stdout:6/780: creat de/d19/d62/d34/d8e/ffd x:0 0 0 2024-09-17T04:21:01.179 INFO:tasks.workunit.client.0.smithi088.stdout:2/298: chown d0/d1/c1c 1127339 1 2024-09-17T04:21:01.179 INFO:tasks.workunit.client.1.smithi134.stdout:5/668: rmdir d0/da/d69/d41/db6 39 2024-09-17T04:21:01.180 INFO:tasks.workunit.client.1.smithi134.stdout:7/549: creat d0/d16/d8b/fad x:0 0 0 2024-09-17T04:21:01.182 INFO:tasks.workunit.client.1.smithi134.stdout:2/658: symlink d19/d1c/d92/ddc/dc6/dbc/ldd 0 2024-09-17T04:21:01.182 INFO:tasks.workunit.client.0.smithi088.stdout:9/362: rmdir d2/d16 39 2024-09-17T04:21:01.183 INFO:tasks.workunit.client.1.smithi134.stdout:0/665: mknod d11/d6f/ce3 0 2024-09-17T04:21:01.185 INFO:tasks.workunit.client.0.smithi088.stdout:3/242: readlink d0/d13/d1b/d29/l3a 0 2024-09-17T04:21:01.186 INFO:tasks.workunit.client.0.smithi088.stdout:3/243: chown d0/d13/d1b/d29/l2e 7418114 1 2024-09-17T04:21:01.190 INFO:tasks.workunit.client.1.smithi134.stdout:5/669: unlink d0/d3a/d6b/d9c/fc4 0 2024-09-17T04:21:01.191 INFO:tasks.workunit.client.0.smithi088.stdout:9/363: mkdir d2/d2b/d58/d82 0 2024-09-17T04:21:01.192 INFO:tasks.workunit.client.0.smithi088.stdout:1/241: dwrite d0/d1/fd [0,4194304] 0 2024-09-17T04:21:01.193 INFO:tasks.workunit.client.1.smithi134.stdout:2/659: mknod d19/d27/d31/d49/d6f/cde 0 2024-09-17T04:21:01.195 INFO:tasks.workunit.client.0.smithi088.stdout:3/244: rename d0/d13/d1b/c23 to d0/d13/d1b/d29/d30/d3c/c4e 0 2024-09-17T04:21:01.197 INFO:tasks.workunit.client.0.smithi088.stdout:6/274: getdents d14/d2f 0 2024-09-17T04:21:01.198 INFO:tasks.workunit.client.1.smithi134.stdout:3/790: creat de/d12/d22/f103 x:0 0 0 2024-09-17T04:21:01.199 INFO:tasks.workunit.client.1.smithi134.stdout:5/670: rmdir d0/da/d29/d78/da5/dce 39 2024-09-17T04:21:01.202 INFO:tasks.workunit.client.1.smithi134.stdout:1/732: sync 2024-09-17T04:21:01.202 INFO:tasks.workunit.client.1.smithi134.stdout:4/726: sync 2024-09-17T04:21:01.202 INFO:tasks.workunit.client.1.smithi134.stdout:8/603: sync 2024-09-17T04:21:01.202 INFO:tasks.workunit.client.1.smithi134.stdout:7/550: link d0/d16/d35/d4b/d65/f7b d0/dd/d3a/fae 0 2024-09-17T04:21:01.202 INFO:tasks.workunit.client.1.smithi134.stdout:0/666: dread d11/d4c/d76/f9e [0,4194304] 0 2024-09-17T04:21:01.203 INFO:tasks.workunit.client.0.smithi088.stdout:2/299: creat d0/f5d x:0 0 0 2024-09-17T04:21:01.204 INFO:tasks.workunit.client.1.smithi134.stdout:4/727: fdatasync d0/df/d1e/d73/f95 0 2024-09-17T04:21:01.204 INFO:tasks.workunit.client.1.smithi134.stdout:0/667: dread - d11/d4c/fca zero size 2024-09-17T04:21:01.205 INFO:tasks.workunit.client.0.smithi088.stdout:2/300: write d0/d1/d2d/d33/d4b/d24/d3b/f54 [511678,108552] 0 2024-09-17T04:21:01.212 INFO:tasks.workunit.client.0.smithi088.stdout:3/245: write d0/d13/f22 [52617,14623] 0 2024-09-17T04:21:01.212 INFO:tasks.workunit.client.1.smithi134.stdout:6/781: dread de/d2b/f70 [0,4194304] 0 2024-09-17T04:21:01.213 INFO:tasks.workunit.client.1.smithi134.stdout:5/671: creat d0/da/d29/d7c/db3/fdd x:0 0 0 2024-09-17T04:21:01.215 INFO:tasks.workunit.client.0.smithi088.stdout:6/275: rename d14/d15 to d14/d44/d45/d6b 0 2024-09-17T04:21:01.216 INFO:tasks.workunit.client.0.smithi088.stdout:9/364: write d2/fc [7296342,91779] 0 2024-09-17T04:21:01.217 INFO:tasks.workunit.client.1.smithi134.stdout:2/660: mknod d19/d27/d31/d34/cdf 0 2024-09-17T04:21:01.218 INFO:tasks.workunit.client.0.smithi088.stdout:6/276: truncate d14/d44/d45/d6b/d29/f5f 940024 0 2024-09-17T04:21:01.218 INFO:tasks.workunit.client.0.smithi088.stdout:2/301: fsync d0/d1/d2d/d33/d4b/d24/f2c 0 2024-09-17T04:21:01.220 INFO:tasks.workunit.client.1.smithi134.stdout:1/733: truncate d12/d19/d4f/f7f 2470606 0 2024-09-17T04:21:01.221 INFO:tasks.workunit.client.1.smithi134.stdout:1/734: chown d12/d19/d5d/d91/dac/cca 2139169 1 2024-09-17T04:21:01.222 INFO:tasks.workunit.client.0.smithi088.stdout:1/242: creat d0/f4a x:0 0 0 2024-09-17T04:21:01.223 INFO:tasks.workunit.client.1.smithi134.stdout:7/551: rename d0/dd/d3a/d3d/d4c/f86 to d0/dd/d3a/d3d/d38/d74/faf 0 2024-09-17T04:21:01.223 INFO:tasks.workunit.client.0.smithi088.stdout:2/302: dread d0/d1/d2d/d33/d4b/d24/d3b/f59 [0,4194304] 0 2024-09-17T04:21:01.226 INFO:tasks.workunit.client.1.smithi134.stdout:3/791: creat de/d10/d3d/da2/f104 x:0 0 0 2024-09-17T04:21:01.226 INFO:tasks.workunit.client.1.smithi134.stdout:3/792: stat de/d12/d15/d1d/la4 0 2024-09-17T04:21:01.227 INFO:tasks.workunit.client.1.smithi134.stdout:3/793: write de/d12/d15/d1d/fcb [999426,98040] 0 2024-09-17T04:21:01.234 INFO:tasks.workunit.client.0.smithi088.stdout:3/246: mknod d0/d13/d4d/c4f 0 2024-09-17T04:21:01.234 INFO:tasks.workunit.client.0.smithi088.stdout:3/247: readlink d0/l4c 0 2024-09-17T04:21:01.235 INFO:tasks.workunit.client.1.smithi134.stdout:8/604: fsync d4/fe 0 2024-09-17T04:21:01.235 INFO:tasks.workunit.client.1.smithi134.stdout:8/605: fdatasync d4/d1f/d25/d6a/f85 0 2024-09-17T04:21:01.236 INFO:tasks.workunit.client.0.smithi088.stdout:1/243: mknod d0/d1/d16/d35/c4b 0 2024-09-17T04:21:01.237 INFO:tasks.workunit.client.0.smithi088.stdout:1/244: chown d0/d1/f1c 23520228 1 2024-09-17T04:21:01.240 INFO:tasks.workunit.client.0.smithi088.stdout:9/365: creat d2/d2b/d58/d82/f83 x:0 0 0 2024-09-17T04:21:01.241 INFO:tasks.workunit.client.0.smithi088.stdout:9/366: truncate d2/dd/d11/f79 9208081 0 2024-09-17T04:21:01.242 INFO:tasks.workunit.client.0.smithi088.stdout:2/303: mknod d0/d1/d2d/d33/c5e 0 2024-09-17T04:21:01.242 INFO:tasks.workunit.client.0.smithi088.stdout:9/367: fsync d2/dd/d11/d1d/d35/f6c 0 2024-09-17T04:21:01.243 INFO:tasks.workunit.client.1.smithi134.stdout:1/735: mkdir d12/d19/d1d/d61/dd3/dda/d85/df9 0 2024-09-17T04:21:01.243 INFO:tasks.workunit.client.0.smithi088.stdout:6/277: mknod d14/d63/c6c 0 2024-09-17T04:21:01.244 INFO:tasks.workunit.client.0.smithi088.stdout:2/304: write d0/d1/d2d/d33/d4b/d24/d3b/f54 [58183,123554] 0 2024-09-17T04:21:01.247 INFO:tasks.workunit.client.0.smithi088.stdout:9/368: creat d2/d2b/d2e/f84 x:0 0 0 2024-09-17T04:21:01.248 INFO:tasks.workunit.client.1.smithi134.stdout:6/782: creat de/d19/d1f/d55/d77/db8/dc7/ddc/db3/db4/dd7/ffe x:0 0 0 2024-09-17T04:21:01.252 INFO:tasks.workunit.client.0.smithi088.stdout:6/278: stat d14/d44/d45/d6b/d29/d3e/l58 0 2024-09-17T04:21:01.253 INFO:tasks.workunit.client.0.smithi088.stdout:2/305: mknod d0/d13/c5f 0 2024-09-17T04:21:01.254 INFO:tasks.workunit.client.1.smithi134.stdout:8/606: rmdir d4/d11/da1/db3 39 2024-09-17T04:21:01.256 INFO:tasks.workunit.client.1.smithi134.stdout:7/552: dwrite d0/dd/d3a/d3d/f61 [0,4194304] 0 2024-09-17T04:21:01.257 INFO:tasks.workunit.client.1.smithi134.stdout:5/672: dread - d0/da/d29/d7c/d9e/fc1 zero size 2024-09-17T04:21:01.257 INFO:tasks.workunit.client.1.smithi134.stdout:7/553: chown d0/dd/f54 591995 1 2024-09-17T04:21:01.258 INFO:tasks.workunit.client.0.smithi088.stdout:9/369: unlink f1 0 2024-09-17T04:21:01.258 INFO:tasks.workunit.client.1.smithi134.stdout:4/728: creat d0/df/d1e/fef x:0 0 0 2024-09-17T04:21:01.259 INFO:tasks.workunit.client.1.smithi134.stdout:0/668: creat d11/d24/d49/fe4 x:0 0 0 2024-09-17T04:21:01.260 INFO:tasks.workunit.client.1.smithi134.stdout:0/669: readlink d11/l9c 0 2024-09-17T04:21:01.260 INFO:tasks.workunit.client.1.smithi134.stdout:0/670: chown d11/d22/c7d 662640550 1 2024-09-17T04:21:01.261 INFO:tasks.workunit.client.0.smithi088.stdout:3/248: dwrite d0/d13/f17 [0,4194304] 0 2024-09-17T04:21:01.264 INFO:tasks.workunit.client.0.smithi088.stdout:1/245: rmdir d0/d1/d16/d35/d42 0 2024-09-17T04:21:01.265 INFO:tasks.workunit.client.1.smithi134.stdout:6/783: mkdir de/d19/d1f/d55/d77/db8/dc7/dff 0 2024-09-17T04:21:01.268 INFO:tasks.workunit.client.0.smithi088.stdout:2/306: fsync d0/d18/f19 0 2024-09-17T04:21:01.269 INFO:tasks.workunit.client.0.smithi088.stdout:9/370: dwrite d2/dd/d11/d1d/d43/f55 [4194304,4194304] 0 2024-09-17T04:21:01.270 INFO:tasks.workunit.client.1.smithi134.stdout:8/607: fdatasync d4/d1e/f81 0 2024-09-17T04:21:01.271 INFO:tasks.workunit.client.0.smithi088.stdout:2/307: dread - d0/d1/d2d/d33/f38 zero size 2024-09-17T04:21:01.271 INFO:tasks.workunit.client.0.smithi088.stdout:3/249: mkdir d0/d13/d1b/d29/d2b/d50 0 2024-09-17T04:21:01.273 INFO:tasks.workunit.client.0.smithi088.stdout:2/308: chown d0/d1/d2d/d33/d4b 60568 1 2024-09-17T04:21:01.273 INFO:tasks.workunit.client.0.smithi088.stdout:1/246: symlink d0/d13/l4c 0 2024-09-17T04:21:01.274 INFO:tasks.workunit.client.1.smithi134.stdout:2/661: creat d19/d27/d31/d49/d6f/d84/d98/fe0 x:0 0 0 2024-09-17T04:21:01.275 INFO:tasks.workunit.client.1.smithi134.stdout:5/673: chown d0/d3a/fa9 0 1 2024-09-17T04:21:01.275 INFO:tasks.workunit.client.1.smithi134.stdout:7/554: mknod d0/d16/d8b/d6a/d70/d85/cb0 0 2024-09-17T04:21:01.278 INFO:tasks.workunit.client.1.smithi134.stdout:1/736: creat d12/d19/d1d/d3e/dcb/ffa x:0 0 0 2024-09-17T04:21:01.281 INFO:tasks.workunit.client.1.smithi134.stdout:4/729: rename d0/df/d1e/d73/dc7/fd2 to d0/d3b/d9f/ff0 0 2024-09-17T04:21:01.282 INFO:tasks.workunit.client.0.smithi088.stdout:3/250: creat d0/d13/d1b/d29/d30/d3c/f51 x:0 0 0 2024-09-17T04:21:01.282 INFO:tasks.workunit.client.1.smithi134.stdout:4/730: write d0/fe1 [1019935,77693] 0 2024-09-17T04:21:01.282 INFO:tasks.workunit.client.0.smithi088.stdout:3/251: dread - d0/d13/d1b/d29/f36 zero size 2024-09-17T04:21:01.283 INFO:tasks.workunit.client.1.smithi134.stdout:7/555: dwrite d0/dd/d3a/d3d/d38/f24 [0,4194304] 0 2024-09-17T04:21:01.283 INFO:tasks.workunit.client.0.smithi088.stdout:6/279: getdents d14/d3a/d41 0 2024-09-17T04:21:01.284 INFO:tasks.workunit.client.1.smithi134.stdout:7/556: chown d0/dd/d3a/f9a 18477852 1 2024-09-17T04:21:01.285 INFO:tasks.workunit.client.0.smithi088.stdout:6/280: write d14/d44/d45/d6b/d29/f2d [217299,107927] 0 2024-09-17T04:21:01.285 INFO:tasks.workunit.client.0.smithi088.stdout:2/309: mknod d0/d1/d2d/d33/d4b/d24/d3b/d26/c60 0 2024-09-17T04:21:01.289 INFO:tasks.workunit.client.0.smithi088.stdout:0/183: sync 2024-09-17T04:21:01.290 INFO:tasks.workunit.client.0.smithi088.stdout:6/281: write d14/d2f/f67 [863521,18434] 0 2024-09-17T04:21:01.290 INFO:tasks.workunit.client.1.smithi134.stdout:8/608: symlink d4/d1f/d2b/lbb 0 2024-09-17T04:21:01.291 INFO:tasks.workunit.client.1.smithi134.stdout:2/662: fdatasync d19/d27/d31/d34/d42/fb8 0 2024-09-17T04:21:01.292 INFO:tasks.workunit.client.1.smithi134.stdout:2/663: write d19/d1c/d47/fcd [92630,12197] 0 2024-09-17T04:21:01.293 INFO:tasks.workunit.client.0.smithi088.stdout:3/252: dwrite d0/d13/d1b/d29/f36 [0,4194304] 0 2024-09-17T04:21:01.295 INFO:tasks.workunit.client.0.smithi088.stdout:1/247: symlink d0/d1/d16/d2a/l4d 0 2024-09-17T04:21:01.296 INFO:tasks.workunit.client.0.smithi088.stdout:1/248: fsync d0/d13/f3f 0 2024-09-17T04:21:01.297 INFO:tasks.workunit.client.0.smithi088.stdout:1/249: write d0/f41 [356309,63342] 0 2024-09-17T04:21:01.297 INFO:tasks.workunit.client.0.smithi088.stdout:6/282: unlink d14/d44/d45/d6b/f4b 0 2024-09-17T04:21:01.298 INFO:tasks.workunit.client.1.smithi134.stdout:0/671: symlink d11/d19/le5 0 2024-09-17T04:21:01.300 INFO:tasks.workunit.client.0.smithi088.stdout:2/310: unlink d0/d1/d2d/d33/d4b/d24/f2a 0 2024-09-17T04:21:01.302 INFO:tasks.workunit.client.1.smithi134.stdout:3/794: getdents de/d12/d15 0 2024-09-17T04:21:01.303 INFO:tasks.workunit.client.1.smithi134.stdout:3/795: readlink de/d10/d70/ld5 0 2024-09-17T04:21:01.305 INFO:tasks.workunit.client.1.smithi134.stdout:7/557: creat d0/dd/d3a/d3d/d4c/fb1 x:0 0 0 2024-09-17T04:21:01.306 INFO:tasks.workunit.client.0.smithi088.stdout:9/371: getdents d2/dd/d11/d30/d49 0 2024-09-17T04:21:01.309 INFO:tasks.workunit.client.1.smithi134.stdout:8/609: write d4/db/fc [1305086,85390] 0 2024-09-17T04:21:01.314 INFO:tasks.workunit.client.0.smithi088.stdout:1/250: mkdir d0/d1/df/d20/d4e 0 2024-09-17T04:21:01.315 INFO:tasks.workunit.client.1.smithi134.stdout:5/674: truncate d0/da/f2e 141265 0 2024-09-17T04:21:01.317 INFO:tasks.workunit.client.0.smithi088.stdout:0/184: creat db/f3f x:0 0 0 2024-09-17T04:21:01.317 INFO:tasks.workunit.client.0.smithi088.stdout:0/185: stat db/f19 0 2024-09-17T04:21:01.318 INFO:tasks.workunit.client.1.smithi134.stdout:6/784: dwrite de/d2b/f9f [0,4194304] 0 2024-09-17T04:21:01.319 INFO:tasks.workunit.client.0.smithi088.stdout:0/186: write db/d1b/f2b [943206,90315] 0 2024-09-17T04:21:01.320 INFO:tasks.workunit.client.1.smithi134.stdout:0/672: dread d11/d19/d21/f5f [0,4194304] 0 2024-09-17T04:21:01.321 INFO:tasks.workunit.client.0.smithi088.stdout:3/253: fsync d0/d13/d1b/f27 0 2024-09-17T04:21:01.326 INFO:tasks.workunit.client.0.smithi088.stdout:9/372: rename d2/dd/d14/f73 to d2/d2b/d58/d82/f85 0 2024-09-17T04:21:01.328 INFO:tasks.workunit.client.1.smithi134.stdout:6/785: dwrite de/d19/d21/f64 [0,4194304] 0 2024-09-17T04:21:01.328 INFO:tasks.workunit.client.1.smithi134.stdout:7/558: dread d0/dd/d3a/d3d/d38/f23 [0,4194304] 0 2024-09-17T04:21:01.330 INFO:tasks.workunit.client.0.smithi088.stdout:3/254: dwrite d0/f33 [0,4194304] 0 2024-09-17T04:21:01.332 INFO:tasks.workunit.client.1.smithi134.stdout:4/731: dwrite d0/df/d35/d5c/d8b/fc0 [0,4194304] 0 2024-09-17T04:21:01.332 INFO:tasks.workunit.client.0.smithi088.stdout:6/283: mknod d14/d44/d45/d6b/d29/d5e/c6d 0 2024-09-17T04:21:01.334 INFO:tasks.workunit.client.1.smithi134.stdout:4/732: write d0/df/d17/d9c/fb3 [1631923,64609] 0 2024-09-17T04:21:01.336 INFO:tasks.workunit.client.1.smithi134.stdout:4/733: write d0/df/d35/d5c/d8b/fc4 [1442742,130304] 0 2024-09-17T04:21:01.337 INFO:tasks.workunit.client.0.smithi088.stdout:9/373: dwrite d2/d2b/d58/f5b [0,4194304] 0 2024-09-17T04:21:01.341 INFO:tasks.workunit.client.1.smithi134.stdout:1/737: truncate d12/d19/d1d/d5f/fb0 1133386 0 2024-09-17T04:21:01.345 INFO:tasks.workunit.client.1.smithi134.stdout:2/664: dread d19/d27/d31/d49/d6f/fa6 [0,4194304] 0 2024-09-17T04:21:01.346 INFO:tasks.workunit.client.1.smithi134.stdout:1/738: read d12/d19/d1d/d3e/fa6 [588494,103990] 0 2024-09-17T04:21:01.347 INFO:tasks.workunit.client.1.smithi134.stdout:1/739: fdatasync d12/d1c/d56/f76 0 2024-09-17T04:21:01.348 INFO:tasks.workunit.client.1.smithi134.stdout:5/675: rename d0/da/d2c/d73/d8a/ca8 to d0/da/d69/d41/d72/cde 0 2024-09-17T04:21:01.350 INFO:tasks.workunit.client.1.smithi134.stdout:2/665: dread d19/d27/d31/d49/d6f/fa6 [0,4194304] 0 2024-09-17T04:21:01.350 INFO:tasks.workunit.client.1.smithi134.stdout:2/666: readlink d19/d27/la8 0 2024-09-17T04:21:01.353 INFO:tasks.workunit.client.1.smithi134.stdout:6/786: creat de/d19/d62/d34/d3b/f100 x:0 0 0 2024-09-17T04:21:01.353 INFO:tasks.workunit.client.0.smithi088.stdout:3/255: truncate d0/d13/f24 842082 0 2024-09-17T04:21:01.354 INFO:tasks.workunit.client.1.smithi134.stdout:6/787: readlink de/d19/d74/d98/lfa 0 2024-09-17T04:21:01.354 INFO:tasks.workunit.client.0.smithi088.stdout:3/256: stat d0/d13/d1b/d29/d2b 0 2024-09-17T04:21:01.354 INFO:tasks.workunit.client.1.smithi134.stdout:3/796: unlink de/d12/d15/d1d/d2d/d63/ca1 0 2024-09-17T04:21:01.356 INFO:tasks.workunit.client.0.smithi088.stdout:2/311: creat d0/f61 x:0 0 0 2024-09-17T04:21:01.359 INFO:tasks.workunit.client.1.smithi134.stdout:6/788: dwrite de/d19/d21/d2d/f3e [0,4194304] 0 2024-09-17T04:21:01.359 INFO:tasks.workunit.client.0.smithi088.stdout:1/251: creat d0/f4f x:0 0 0 2024-09-17T04:21:01.361 INFO:tasks.workunit.client.0.smithi088.stdout:9/374: symlink d2/l86 0 2024-09-17T04:21:01.361 INFO:tasks.workunit.client.0.smithi088.stdout:1/252: write d0/d1/d16/d35/f36 [1593102,1300] 0 2024-09-17T04:21:01.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.363+0000 7f88d14c7640 1 -- 172.21.15.88:0/4155908244 --> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f88b8000bf0 con 0x7f88b4074ad0 2024-09-17T04:21:01.363 INFO:tasks.workunit.client.0.smithi088.stdout:0/187: link db/f12 db/d1a/f40 0 2024-09-17T04:21:01.367 INFO:tasks.workunit.client.0.smithi088.stdout:2/312: rmdir d0/d1/d2d/d33/d4b 39 2024-09-17T04:21:01.367 INFO:tasks.workunit.client.0.smithi088.stdout:0/188: stat db/f19 0 2024-09-17T04:21:01.372 INFO:tasks.workunit.client.0.smithi088.stdout:3/257: dwrite d0/d13/d1b/d29/f3b [0,4194304] 0 2024-09-17T04:21:01.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.375+0000 7f88b3fff640 1 -- 172.21.15.88:0/4155908244 <== mgr.24431 v2:172.21.15.134:6828/1122341233 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f88b8000bf0 con 0x7f88b4074ad0 2024-09-17T04:21:01.375 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T04:21:01.375 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (6m) 19s ago 8m 25.7M - 0.25.0 c8568f914cd2 f2dbac7e939f 2024-09-17T04:21:01.375 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi088 smithi088 running (8m) 19s ago 8m 8560k - 19.1.1-330-gc2ddf972 ebb0615149de 6ec56b3c8d6d 2024-09-17T04:21:01.375 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi134 smithi134 running (7m) 27s ago 7m 5272k - 19.1.1-330-gc2ddf972 ebb0615149de 6c2b7072b682 2024-09-17T04:21:01.375 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (8m) 19s ago 8m 6903k - 19.1.1-330-gc2ddf972 ebb0615149de de17f5571330 2024-09-17T04:21:01.375 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi134 smithi134 running (7m) 27s ago 7m 6899k - 19.1.1-330-gc2ddf972 ebb0615149de 27f7ef172a1c 2024-09-17T04:21:01.375 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (6m) 19s ago 7m 78.3M - 9.4.12 2bacad6d85d8 a6cff57a23f9 2024-09-17T04:21:01.376 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.giqrgt smithi088 running (2m) 19s ago 2m 164M - 19.1.1-330-gc2ddf972 ebb0615149de f724660799a1 2024-09-17T04:21:01.376 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.lgavsv smithi088 running (2m) 19s ago 2m 13.3M - 19.1.1-330-gc2ddf972 ebb0615149de 6cc0fe8a6aa9 2024-09-17T04:21:01.376 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi134.ktuhce smithi134 running (2m) 27s ago 2m 12.3M - 19.1.1-330-gc2ddf972 ebb0615149de 7ff5b70ca9cb 2024-09-17T04:21:01.376 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi134.psnynp smithi134 running (2m) 27s ago 2m 164M - 19.1.1-330-gc2ddf972 ebb0615149de 5326974fa3dd 2024-09-17T04:21:01.376 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.wmndiv smithi088 *:9283,8765,8443 running (9m) 19s ago 9m 253M - 19.1.1-330-gc2ddf972 ebb0615149de 2067eec66468 2024-09-17T04:21:01.376 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi134.vwdxcb smithi134 *:8443,9283,8765 running (60s) 27s ago 7m 564M - 19.3.0-4989-gce1b342b 8e039cb7fe1e efa5f0c9df8c 2024-09-17T04:21:01.376 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (9m) 19s ago 9m 50.2M 2048M 19.1.1-330-gc2ddf972 ebb0615149de bbeb722f42bc 2024-09-17T04:21:01.376 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi134 smithi134 running (7m) 27s ago 7m 39.8M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 89de63fb6386 2024-09-17T04:21:01.376 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (8m) 19s ago 8m 16.5M - 1.5.0 0da6a335fe13 9ba03800993b 2024-09-17T04:21:01.376 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi134 smithi134 *:9100 running (7m) 27s ago 7m 17.2M - 1.5.0 0da6a335fe13 6deac483827f 2024-09-17T04:21:01.376 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (6m) 19s ago 6m 78.6M 1216M 19.1.1-330-gc2ddf972 ebb0615149de e309427ee12c 2024-09-17T04:21:01.376 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (5m) 19s ago 5m 93.2M 1216M 19.1.1-330-gc2ddf972 ebb0615149de cc68d92b3333 2024-09-17T04:21:01.376 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (5m) 19s ago 5m 78.6M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 1ba92f2bfce6 2024-09-17T04:21:01.377 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi134 running (4m) 27s ago 4m 93.1M 2240M 19.1.1-330-gc2ddf972 ebb0615149de ebd528c3ce1b 2024-09-17T04:21:01.377 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi134 running (4m) 27s ago 4m 80.9M 2240M 19.1.1-330-gc2ddf972 ebb0615149de eacc25537b3a 2024-09-17T04:21:01.377 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi134 running (3m) 27s ago 3m 84.7M 2240M 19.1.1-330-gc2ddf972 ebb0615149de bc1b434a92a8 2024-09-17T04:21:01.377 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (6m) 19s ago 7m 63.5M - 2.43.0 a07b618ecd1d 3c7fe8c3d4b0 2024-09-17T04:21:01.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.379+0000 7f88d14c7640 1 -- 172.21.15.88:0/4155908244 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f88b4074ad0 msgr2=0x7f88b4076f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:01.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.379+0000 7f88d14c7640 1 --2- 172.21.15.88:0/4155908244 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f88b4074ad0 0x7f88b4076f90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f88cc191730 tx=0x7f88c0005f90 comp rx=0 tx=0).stop 2024-09-17T04:21:01.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.379+0000 7f88d14c7640 1 -- 172.21.15.88:0/4155908244 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88cc102430 msgr2=0x7f88cc1937b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:01.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.379+0000 7f88d14c7640 1 --2- 172.21.15.88:0/4155908244 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88cc102430 0x7f88cc1937b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f88bc02aa90 tx=0x7f88bc004570 comp rx=0 tx=0).stop 2024-09-17T04:21:01.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.379+0000 7f88d14c7640 1 -- 172.21.15.88:0/4155908244 shutdown_connections 2024-09-17T04:21:01.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.379+0000 7f88d14c7640 1 --2- 172.21.15.88:0/4155908244 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f88b4074ad0 0x7f88b4076f90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:01.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.379+0000 7f88d14c7640 1 --2- 172.21.15.88:0/4155908244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88cc104d60 0x7f88cc193cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:01.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.379+0000 7f88d14c7640 1 --2- 172.21.15.88:0/4155908244 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88cc102430 0x7f88cc1937b0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:01.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.379+0000 7f88d14c7640 1 -- 172.21.15.88:0/4155908244 >> 172.21.15.88:0/4155908244 conn(0x7f88cc0fc010 msgr2=0x7f88cc101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:21:01.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.379+0000 7f88d14c7640 1 -- 172.21.15.88:0/4155908244 shutdown_connections 2024-09-17T04:21:01.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.379+0000 7f88d14c7640 1 -- 172.21.15.88:0/4155908244 wait complete. 2024-09-17T04:21:01.386 INFO:tasks.workunit.client.1.smithi134.stdout:3/797: mknod de/d12/d15/d9f/df7/c105 0 2024-09-17T04:21:01.392 INFO:tasks.workunit.client.0.smithi088.stdout:0/189: creat db/d1a/d20/f41 x:0 0 0 2024-09-17T04:21:01.397 INFO:tasks.workunit.client.1.smithi134.stdout:5/676: dread d0/d3a/f71 [0,4194304] 0 2024-09-17T04:21:01.397 INFO:tasks.workunit.client.0.smithi088.stdout:3/258: rename d0/c45 to d0/d13/d1b/d29/d2b/d40/c52 0 2024-09-17T04:21:01.399 INFO:tasks.workunit.client.0.smithi088.stdout:0/190: dwrite db/d1b/d39/f3a [0,4194304] 0 2024-09-17T04:21:01.399 INFO:tasks.workunit.client.1.smithi134.stdout:7/559: symlink d0/dd/d3a/d3d/d38/d60/d75/lb2 0 2024-09-17T04:21:01.400 INFO:tasks.workunit.client.1.smithi134.stdout:1/740: dwrite d12/d1c/d56/f70 [0,4194304] 0 2024-09-17T04:21:01.400 INFO:tasks.workunit.client.1.smithi134.stdout:0/673: truncate d11/f3b 783929 0 2024-09-17T04:21:01.400 INFO:tasks.workunit.client.0.smithi088.stdout:3/259: write d0/d13/d1b/d29/f36 [2962440,120482] 0 2024-09-17T04:21:01.401 INFO:tasks.workunit.client.1.smithi134.stdout:1/741: truncate d12/dcc/fe1 220287 0 2024-09-17T04:21:01.403 INFO:tasks.workunit.client.0.smithi088.stdout:1/253: write d0/d13/f1b [1224766,53248] 0 2024-09-17T04:21:01.403 INFO:tasks.workunit.client.1.smithi134.stdout:1/742: dread d12/dcc/fe1 [0,4194304] 0 2024-09-17T04:21:01.404 INFO:tasks.workunit.client.1.smithi134.stdout:1/743: readlink d12/d36/l6e 0 2024-09-17T04:21:01.404 INFO:tasks.workunit.client.1.smithi134.stdout:3/798: symlink de/d12/d15/d1d/d8f/deb/l106 0 2024-09-17T04:21:01.404 INFO:tasks.workunit.client.1.smithi134.stdout:2/667: write d19/d27/d31/f6e [196282,68306] 0 2024-09-17T04:21:01.406 INFO:tasks.workunit.client.1.smithi134.stdout:3/799: chown de/d12/d15/d1d/d2d/l86 4333486 1 2024-09-17T04:21:01.408 INFO:tasks.workunit.client.1.smithi134.stdout:6/789: symlink de/d19/d62/d34/l101 0 2024-09-17T04:21:01.410 INFO:tasks.workunit.client.1.smithi134.stdout:8/610: getdents d4/db/dd/d43/d8b/d8e 0 2024-09-17T04:21:01.411 INFO:tasks.workunit.client.0.smithi088.stdout:3/260: dwrite d0/d13/f24 [0,4194304] 0 2024-09-17T04:21:01.413 INFO:tasks.workunit.client.0.smithi088.stdout:0/191: dwrite db/d1a/d20/d28/d37/f26 [0,4194304] 0 2024-09-17T04:21:01.415 INFO:tasks.workunit.client.1.smithi134.stdout:2/668: dwrite d19/d27/d31/d49/d6f/d84/f9e [0,4194304] 0 2024-09-17T04:21:01.416 INFO:tasks.workunit.client.1.smithi134.stdout:3/800: dread de/d12/d15/f4b [0,4194304] 0 2024-09-17T04:21:01.417 INFO:tasks.workunit.client.1.smithi134.stdout:7/560: write d0/d16/d35/d4b/d65/f89 [3992782,129339] 0 2024-09-17T04:21:01.419 INFO:tasks.workunit.client.1.smithi134.stdout:4/734: fsync d0/d13/d40/d42/d92/dc3/fbf 0 2024-09-17T04:21:01.419 INFO:tasks.workunit.client.1.smithi134.stdout:7/561: chown d0/dd/d3a/l9f 1159472 1 2024-09-17T04:21:01.420 INFO:tasks.workunit.client.0.smithi088.stdout:1/254: creat d0/d1/d16/d35/f50 x:0 0 0 2024-09-17T04:21:01.423 INFO:tasks.workunit.client.0.smithi088.stdout:6/284: link d14/d44/d45/d6b/d29/f3d d14/d44/d45/d6b/d16/f6e 0 2024-09-17T04:21:01.425 INFO:tasks.workunit.client.1.smithi134.stdout:1/744: creat d12/d36/ffb x:0 0 0 2024-09-17T04:21:01.427 INFO:tasks.workunit.client.1.smithi134.stdout:2/669: read d19/d1c/f2d [1080699,5299] 0 2024-09-17T04:21:01.428 INFO:tasks.workunit.client.0.smithi088.stdout:2/313: link d0/l8 d0/d1/d2d/d33/d4b/d24/d3b/d26/l62 0 2024-09-17T04:21:01.430 INFO:tasks.workunit.client.1.smithi134.stdout:4/735: dwrite d0/df/d1e/d73/dc7/fde [0,4194304] 0 2024-09-17T04:21:01.430 INFO:tasks.workunit.client.1.smithi134.stdout:6/790: rmdir de/d19/d62/d34 39 2024-09-17T04:21:01.434 INFO:tasks.workunit.client.1.smithi134.stdout:8/611: rename d4/db/dd/d43/cb1 to d4/d1f/d86/d9f/cbc 0 2024-09-17T04:21:01.435 INFO:tasks.workunit.client.0.smithi088.stdout:1/255: symlink d0/d1/l51 0 2024-09-17T04:21:01.436 INFO:tasks.workunit.client.1.smithi134.stdout:0/674: creat d11/d19/ddc/de1/fe6 x:0 0 0 2024-09-17T04:21:01.437 INFO:tasks.workunit.client.0.smithi088.stdout:1/256: dread d0/d1/fe [0,4194304] 0 2024-09-17T04:21:01.437 INFO:tasks.workunit.client.0.smithi088.stdout:6/285: rmdir d14/d3a/d41 39 2024-09-17T04:21:01.438 INFO:tasks.workunit.client.0.smithi088.stdout:6/286: stat d14/d44/d45/d6b/c46 0 2024-09-17T04:21:01.440 INFO:tasks.workunit.client.0.smithi088.stdout:2/314: mknod d0/d1/d2d/d33/c63 0 2024-09-17T04:21:01.443 INFO:tasks.workunit.client.1.smithi134.stdout:1/745: creat d12/d19/d5d/d91/dac/dd5/ffc x:0 0 0 2024-09-17T04:21:01.444 INFO:tasks.workunit.client.0.smithi088.stdout:0/192: getdents db/d1b/d39 0 2024-09-17T04:21:01.444 INFO:tasks.workunit.client.1.smithi134.stdout:1/746: write d12/d1c/d2e/d7d/fce [526364,63734] 0 2024-09-17T04:21:01.445 INFO:tasks.workunit.client.1.smithi134.stdout:6/791: stat de/d19/d62/d34/cb7 0 2024-09-17T04:21:01.446 INFO:tasks.workunit.client.0.smithi088.stdout:1/257: dwrite d0/f4f [0,4194304] 0 2024-09-17T04:21:01.449 INFO:tasks.workunit.client.0.smithi088.stdout:6/287: rename d14/d44/d45/d6b/d16/f26 to d14/d44/d45/d6b/d29/d3e/f6f 0 2024-09-17T04:21:01.450 INFO:tasks.workunit.client.1.smithi134.stdout:6/792: dwrite de/d19/d1f/d55/d77/f95 [0,4194304] 0 2024-09-17T04:21:01.451 INFO:tasks.workunit.client.1.smithi134.stdout:4/736: creat d0/d13/d40/d42/d92/d65/dc2/ff1 x:0 0 0 2024-09-17T04:21:01.452 INFO:tasks.workunit.client.1.smithi134.stdout:6/793: readlink de/d19/d1f/d55/lea 0 2024-09-17T04:21:01.452 INFO:tasks.workunit.client.0.smithi088.stdout:2/315: creat d0/d1/d2d/d33/d4b/d24/d3b/d22/f64 x:0 0 0 2024-09-17T04:21:01.453 INFO:tasks.workunit.client.0.smithi088.stdout:2/316: dread - d0/d1/d2d/d33/f38 zero size 2024-09-17T04:21:01.455 INFO:tasks.workunit.client.1.smithi134.stdout:7/562: rename d0/dd/d3a/d3d/d38/d74/d98 to d0/d16/d8b/d6a/d70/db3 0 2024-09-17T04:21:01.456 INFO:tasks.workunit.client.0.smithi088.stdout:0/193: symlink db/d1a/d20/d28/l42 0 2024-09-17T04:21:01.458 INFO:tasks.workunit.client.0.smithi088.stdout:0/194: read db/f1d [68402,29435] 0 2024-09-17T04:21:01.459 INFO:tasks.workunit.client.1.smithi134.stdout:6/794: dread de/d19/d62/d7c/f7d [0,4194304] 0 2024-09-17T04:21:01.459 INFO:tasks.workunit.client.0.smithi088.stdout:1/258: readlink d0/d1/d16/l46 0 2024-09-17T04:21:01.460 INFO:tasks.workunit.client.1.smithi134.stdout:6/795: chown de/d19/d62/db0/fd8 146935 1 2024-09-17T04:21:01.460 INFO:tasks.workunit.client.0.smithi088.stdout:1/259: chown d0/d1/fd 79243945 1 2024-09-17T04:21:01.461 INFO:tasks.workunit.client.1.smithi134.stdout:6/796: fdatasync de/d19/d74/fcc 0 2024-09-17T04:21:01.461 INFO:tasks.workunit.client.1.smithi134.stdout:0/675: creat d11/d4c/dd3/d2f/d43/d5d/fe7 x:0 0 0 2024-09-17T04:21:01.463 INFO:tasks.workunit.client.1.smithi134.stdout:0/676: dread d11/d24/d49/f68 [0,4194304] 0 2024-09-17T04:21:01.463 INFO:tasks.workunit.client.0.smithi088.stdout:6/288: chown d14/d2f/f36 1190613 1 2024-09-17T04:21:01.466 INFO:tasks.workunit.client.1.smithi134.stdout:2/670: mkdir d19/d1c/d92/ddc/dcf/de1 0 2024-09-17T04:21:01.468 INFO:tasks.workunit.client.1.smithi134.stdout:1/747: mknod d12/d1c/d2e/dea/cfd 0 2024-09-17T04:21:01.470 INFO:tasks.workunit.client.0.smithi088.stdout:1/260: mkdir d0/d1/d16/d35/d52 0 2024-09-17T04:21:01.475 INFO:tasks.workunit.client.1.smithi134.stdout:4/737: dread d0/f43 [4194304,4194304] 0 2024-09-17T04:21:01.476 INFO:tasks.workunit.client.1.smithi134.stdout:8/612: truncate d4/f36 2798160 0 2024-09-17T04:21:01.477 INFO:tasks.workunit.client.1.smithi134.stdout:4/738: dread d0/d13/d40/d42/d92/f21 [0,4194304] 0 2024-09-17T04:21:01.478 INFO:tasks.workunit.client.0.smithi088.stdout:6/289: dwrite d14/f56 [0,4194304] 0 2024-09-17T04:21:01.478 INFO:tasks.workunit.client.0.smithi088.stdout:1/261: creat d0/d1/d16/d2a/f53 x:0 0 0 2024-09-17T04:21:01.481 INFO:tasks.workunit.client.0.smithi088.stdout:2/317: unlink d0/d18/f34 0 2024-09-17T04:21:01.482 INFO:tasks.workunit.client.1.smithi134.stdout:6/797: chown de/d19/da3/de6/ff6 63 1 2024-09-17T04:21:01.483 INFO:tasks.workunit.client.1.smithi134.stdout:6/798: readlink de/d19/d62/d34/l35 0 2024-09-17T04:21:01.485 INFO:tasks.workunit.client.0.smithi088.stdout:6/290: stat d14/f24 0 2024-09-17T04:21:01.487 INFO:tasks.workunit.client.0.smithi088.stdout:1/262: write d0/d1/df/d20/f49 [804809,34904] 0 2024-09-17T04:21:01.489 INFO:tasks.workunit.client.0.smithi088.stdout:2/318: fdatasync d0/f12 0 2024-09-17T04:21:01.491 INFO:tasks.workunit.client.0.smithi088.stdout:6/291: mkdir d14/d44/d45/d6b/d2a/d70 0 2024-09-17T04:21:01.497 INFO:tasks.workunit.client.0.smithi088.stdout:1/263: unlink d0/d1/d16/d2a/c39 0 2024-09-17T04:21:01.502 INFO:tasks.workunit.client.0.smithi088.stdout:1/264: rename d0/d1/f1c to d0/d13/f54 0 2024-09-17T04:21:01.504 INFO:tasks.workunit.client.0.smithi088.stdout:2/319: mkdir d0/d1/d2d/d33/d65 0 2024-09-17T04:21:01.505 INFO:tasks.workunit.client.1.smithi134.stdout:4/739: dread d0/df/d1e/d73/f95 [0,4194304] 0 2024-09-17T04:21:01.505 INFO:tasks.workunit.client.1.smithi134.stdout:8/613: symlink d4/d1e/daf/d60/lbd 0 2024-09-17T04:21:01.506 INFO:tasks.workunit.client.1.smithi134.stdout:7/563: write d0/f20 [951096,84962] 0 2024-09-17T04:21:01.506 INFO:tasks.workunit.client.1.smithi134.stdout:4/740: chown d0/d3b/f52 9 1 2024-09-17T04:21:01.507 INFO:tasks.workunit.client.1.smithi134.stdout:4/741: write d0/d13/f8d [7220160,20638] 0 2024-09-17T04:21:01.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.510+0000 7f582909b640 1 -- 172.21.15.88:0/901306404 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5824104d20 msgr2=0x7f5824107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:01.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.510+0000 7f582909b640 1 --2- 172.21.15.88:0/901306404 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5824104d20 0x7f5824107110 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5818009880 tx=0x7f581802a4b0 comp rx=0 tx=0).stop 2024-09-17T04:21:01.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.510+0000 7f582909b640 1 -- 172.21.15.88:0/901306404 shutdown_connections 2024-09-17T04:21:01.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.510+0000 7f582909b640 1 --2- 172.21.15.88:0/901306404 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5824104d20 0x7f5824107110 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:01.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.510+0000 7f582909b640 1 --2- 172.21.15.88:0/901306404 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58241023f0 0x7f58241047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:01.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.510+0000 7f582909b640 1 -- 172.21.15.88:0/901306404 >> 172.21.15.88:0/901306404 conn(0x7f58240fc010 msgr2=0x7f58240fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:21:01.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.510+0000 7f582909b640 1 -- 172.21.15.88:0/901306404 shutdown_connections 2024-09-17T04:21:01.510 INFO:tasks.workunit.client.0.smithi088.stdout:2/320: dwrite d0/f9 [0,4194304] 0 2024-09-17T04:21:01.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.511+0000 7f582909b640 1 -- 172.21.15.88:0/901306404 wait complete. 2024-09-17T04:21:01.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.512+0000 7f582909b640 1 Processor -- start 2024-09-17T04:21:01.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.512+0000 7f582909b640 1 -- start start 2024-09-17T04:21:01.512 INFO:tasks.workunit.client.1.smithi134.stdout:6/799: write de/d5d/d67/fbd [4902084,120503] 0 2024-09-17T04:21:01.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.512+0000 7f582909b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58241023f0 0x7f5824073270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:21:01.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.513+0000 7f582909b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5824104d20 0x7f58240737b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:21:01.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.513+0000 7f582909b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f5824108580 con 0x7f58241023f0 2024-09-17T04:21:01.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.513+0000 7f582909b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5824108400 con 0x7f5824104d20 2024-09-17T04:21:01.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.513+0000 7f5822d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58241023f0 0x7f5824073270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:21:01.513 INFO:tasks.workunit.client.0.smithi088.stdout:1/265: truncate d0/d1/fe 514041 0 2024-09-17T04:21:01.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.513+0000 7f5822d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58241023f0 0x7f5824073270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46382/0 (socket says 172.21.15.88:46382) 2024-09-17T04:21:01.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.513+0000 7f5822d9d640 1 -- 172.21.15.88:0/2078759023 learned_addr learned my addr 172.21.15.88:0/2078759023 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:21:01.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.513+0000 7f582259c640 1 --2- 172.21.15.88:0/2078759023 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5824104d20 0x7f58240737b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:21:01.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.513+0000 7f5822d9d640 1 -- 172.21.15.88:0/2078759023 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5824104d20 msgr2=0x7f58240737b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:01.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.513+0000 7f5822d9d640 1 --2- 172.21.15.88:0/2078759023 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5824104d20 0x7f58240737b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:01.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.513+0000 7f5822d9d640 1 -- 172.21.15.88:0/2078759023 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5824073e30 con 0x7f58241023f0 2024-09-17T04:21:01.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.514+0000 7f5822d9d640 1 --2- 172.21.15.88:0/2078759023 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58241023f0 0x7f5824073270 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f581400e970 tx=0x7f581400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:21:01.515 INFO:tasks.workunit.client.0.smithi088.stdout:1/266: stat d0/d1/df/d20/f2e 0 2024-09-17T04:21:01.515 INFO:tasks.workunit.client.0.smithi088.stdout:6/292: write d14/d44/d45/d6b/d16/f2e [2999838,82499] 0 2024-09-17T04:21:01.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.515+0000 7f580bfff640 1 -- 172.21.15.88:0/2078759023 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f581400cac0 con 0x7f58241023f0 2024-09-17T04:21:01.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.515+0000 7f580bfff640 1 -- 172.21.15.88:0/2078759023 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f581400cc60 con 0x7f58241023f0 2024-09-17T04:21:01.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.515+0000 7f580bfff640 1 -- 172.21.15.88:0/2078759023 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f581400cac0 con 0x7f58241023f0 2024-09-17T04:21:01.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.515+0000 7f582909b640 1 -- 172.21.15.88:0/2078759023 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f582410d3c0 con 0x7f58241023f0 2024-09-17T04:21:01.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.515+0000 7f582909b640 1 -- 172.21.15.88:0/2078759023 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f582410d920 con 0x7f58241023f0 2024-09-17T04:21:01.516 INFO:tasks.workunit.client.1.smithi134.stdout:3/801: link de/d10/c19 de/d12/d15/d1d/c107 0 2024-09-17T04:21:01.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.516+0000 7f582909b640 1 -- 172.21.15.88:0/2078759023 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58241027d0 con 0x7f58241023f0 2024-09-17T04:21:01.517 INFO:tasks.workunit.client.1.smithi134.stdout:2/671: symlink d19/d27/d31/d49/d6f/da9/db0/le2 0 2024-09-17T04:21:01.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.517+0000 7f580bfff640 1 -- 172.21.15.88:0/2078759023 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f5814010430 con 0x7f58241023f0 2024-09-17T04:21:01.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.518+0000 7f580bfff640 1 --2- 172.21.15.88:0/2078759023 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f580c074e10 0x7f580c0772d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:21:01.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.518+0000 7f580bfff640 1 -- 172.21.15.88:0/2078759023 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f58140963e0 con 0x7f58241023f0 2024-09-17T04:21:01.518 INFO:tasks.workunit.client.0.smithi088.stdout:1/267: creat d0/d13/f55 x:0 0 0 2024-09-17T04:21:01.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.518+0000 7f582259c640 1 --2- 172.21.15.88:0/2078759023 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f580c074e10 0x7f580c0772d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:21:01.518 INFO:tasks.workunit.client.0.smithi088.stdout:6/293: rmdir d14/d44/d45/d6b 39 2024-09-17T04:21:01.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.519+0000 7f582259c640 1 --2- 172.21.15.88:0/2078759023 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f580c074e10 0x7f580c0772d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5818009230 tx=0x7f5818004f30 comp rx=0 tx=0).ready entity=mgr.24431 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:21:01.519 INFO:tasks.workunit.client.1.smithi134.stdout:5/677: sync 2024-09-17T04:21:01.519 INFO:tasks.workunit.client.1.smithi134.stdout:2/672: write d19/d1c/f1f [913429,75812] 0 2024-09-17T04:21:01.520 INFO:tasks.workunit.client.1.smithi134.stdout:1/748: dread d12/d19/d1d/f44 [0,4194304] 0 2024-09-17T04:21:01.520 INFO:tasks.workunit.client.1.smithi134.stdout:2/673: dread - d19/da1/fd1 zero size 2024-09-17T04:21:01.521 INFO:tasks.workunit.client.1.smithi134.stdout:1/749: chown d12/d36/da1/dd1 1679364 1 2024-09-17T04:21:01.521 INFO:tasks.workunit.client.1.smithi134.stdout:2/674: fsync d19/d27/f32 0 2024-09-17T04:21:01.522 INFO:tasks.workunit.client.0.smithi088.stdout:6/294: read d14/d44/d45/d6b/d29/f2d [52556,65784] 0 2024-09-17T04:21:01.524 INFO:tasks.workunit.client.0.smithi088.stdout:6/295: chown d14/d44/d45/d6b/f66 68973 1 2024-09-17T04:21:01.524 INFO:tasks.workunit.client.0.smithi088.stdout:6/296: fsync d14/d44/d45/d6b/d16/f62 0 2024-09-17T04:21:01.525 INFO:tasks.workunit.client.0.smithi088.stdout:6/297: fsync d14/d44/d45/d6b/d16/f51 0 2024-09-17T04:21:01.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.526+0000 7f580bfff640 1 -- 172.21.15.88:0/2078759023 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f5814061910 con 0x7f58241023f0 2024-09-17T04:21:01.528 INFO:tasks.workunit.client.0.smithi088.stdout:6/298: rename d14/d44/d45/d6b/d29/d3e/l58 to d14/d44/d45/d6b/d16/d42/l71 0 2024-09-17T04:21:01.530 INFO:tasks.workunit.client.0.smithi088.stdout:6/299: mkdir d14/d44/d45/d6b/d29/d72 0 2024-09-17T04:21:01.536 INFO:tasks.workunit.client.0.smithi088.stdout:6/300: dwrite f4 [8388608,4194304] 0 2024-09-17T04:21:01.543 INFO:tasks.workunit.client.0.smithi088.stdout:6/301: chown d14/l28 7 1 2024-09-17T04:21:01.552 INFO:tasks.workunit.client.1.smithi134.stdout:8/614: chown d4/d11/l7f 349009 1 2024-09-17T04:21:01.553 INFO:tasks.workunit.client.1.smithi134.stdout:8/615: dread d4/db/d6e/fae [0,4194304] 0 2024-09-17T04:21:01.553 INFO:tasks.workunit.client.1.smithi134.stdout:8/616: stat d4/d1f/d25/l55 0 2024-09-17T04:21:01.556 INFO:tasks.workunit.client.1.smithi134.stdout:3/802: truncate de/d10/f64 5240456 0 2024-09-17T04:21:01.557 INFO:tasks.workunit.client.1.smithi134.stdout:3/803: chown de/d10/d3d/dd9/f92 128923274 1 2024-09-17T04:21:01.558 INFO:tasks.workunit.client.1.smithi134.stdout:5/678: mkdir d0/da/d29/d7c/ddf 0 2024-09-17T04:21:01.558 INFO:tasks.workunit.client.1.smithi134.stdout:5/679: read - d0/da/fa0 zero size 2024-09-17T04:21:01.561 INFO:tasks.workunit.client.1.smithi134.stdout:0/677: getdents d11/d4c/dd3 0 2024-09-17T04:21:01.562 INFO:tasks.workunit.client.1.smithi134.stdout:0/678: fdatasync d11/fd5 0 2024-09-17T04:21:01.562 INFO:tasks.workunit.client.1.smithi134.stdout:0/679: chown d11/f13 1879 1 2024-09-17T04:21:01.566 INFO:tasks.workunit.client.1.smithi134.stdout:1/750: mkdir d12/d19/d5d/dfe 0 2024-09-17T04:21:01.566 INFO:tasks.workunit.client.0.smithi088.stdout:1/268: dwrite d0/d1/fe [0,4194304] 0 2024-09-17T04:21:01.567 INFO:tasks.workunit.client.0.smithi088.stdout:1/269: chown d0/d1/l51 81510 1 2024-09-17T04:21:01.567 INFO:tasks.workunit.client.1.smithi134.stdout:5/680: rename d0/da/fa0 to d0/da/d69/d41/d72/fe0 0 2024-09-17T04:21:01.572 INFO:tasks.workunit.client.1.smithi134.stdout:8/617: mknod d4/d1e/daf/d60/d6b/d13/cbe 0 2024-09-17T04:21:01.573 INFO:tasks.workunit.client.0.smithi088.stdout:1/270: mkdir d0/d1/d16/d56 0 2024-09-17T04:21:01.574 INFO:tasks.workunit.client.1.smithi134.stdout:0/680: creat d11/d24/d49/d9b/fe8 x:0 0 0 2024-09-17T04:21:01.575 INFO:tasks.workunit.client.1.smithi134.stdout:7/564: write d0/d16/f26 [2380311,112485] 0 2024-09-17T04:21:01.577 INFO:tasks.workunit.client.1.smithi134.stdout:3/804: dread de/d10/d3d/f7d [0,4194304] 0 2024-09-17T04:21:01.578 INFO:tasks.workunit.client.1.smithi134.stdout:3/805: readlink de/d12/d15/d1d/d2d/d31/d6a/la0 0 2024-09-17T04:21:01.592 INFO:tasks.workunit.client.1.smithi134.stdout:7/565: dread d0/d16/d35/d4b/f48 [4194304,4194304] 0 2024-09-17T04:21:01.593 INFO:tasks.workunit.client.1.smithi134.stdout:7/566: dread - d0/d16/d8b/fad zero size 2024-09-17T04:21:01.597 INFO:tasks.workunit.client.1.smithi134.stdout:7/567: dwrite d0/fa6 [0,4194304] 0 2024-09-17T04:21:01.598 INFO:tasks.workunit.client.1.smithi134.stdout:7/568: chown d0/d16/d8b 254408143 1 2024-09-17T04:21:01.599 INFO:tasks.workunit.client.1.smithi134.stdout:7/569: truncate d0/dd/d3a/d3d/d38/f3c 814340 0 2024-09-17T04:21:01.611 INFO:tasks.workunit.client.1.smithi134.stdout:4/742: sync 2024-09-17T04:21:01.617 INFO:tasks.workunit.client.0.smithi088.stdout:5/280: sync 2024-09-17T04:21:01.617 INFO:tasks.workunit.client.0.smithi088.stdout:8/228: sync 2024-09-17T04:21:01.624 INFO:tasks.workunit.client.1.smithi134.stdout:6/800: getdents de/d19/d1f/d55/d77/d89 0 2024-09-17T04:21:01.625 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:01 smithi088 ceph-mon[27811]: from='client.24493 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:21:01.626 INFO:tasks.workunit.client.1.smithi134.stdout:0/681: dread d11/d18/f1f [0,4194304] 0 2024-09-17T04:21:01.627 INFO:tasks.workunit.client.0.smithi088.stdout:8/229: creat d7/d29/d2a/d38/f48 x:0 0 0 2024-09-17T04:21:01.628 INFO:tasks.workunit.client.1.smithi134.stdout:8/618: mkdir d4/d1f/d2b/dbf 0 2024-09-17T04:21:01.628 INFO:tasks.workunit.client.1.smithi134.stdout:5/681: dwrite d0/d48/f80 [0,4194304] 0 2024-09-17T04:21:01.630 INFO:tasks.workunit.client.0.smithi088.stdout:5/281: mknod d2/d31/d33/d20/d25/d2c/c5c 0 2024-09-17T04:21:01.633 INFO:tasks.workunit.client.1.smithi134.stdout:2/675: dwrite f2 [0,4194304] 0 2024-09-17T04:21:01.634 INFO:tasks.workunit.client.1.smithi134.stdout:2/676: dread - d19/d1c/d92/ddc/dc6/dbc/fb5 zero size 2024-09-17T04:21:01.637 INFO:tasks.workunit.client.0.smithi088.stdout:5/282: symlink d2/d31/l5d 0 2024-09-17T04:21:01.637 INFO:tasks.workunit.client.1.smithi134.stdout:1/751: write d12/d19/d1d/d5f/f87 [3317117,111307] 0 2024-09-17T04:21:01.637 INFO:tasks.workunit.client.0.smithi088.stdout:5/283: stat d2/f40 0 2024-09-17T04:21:01.639 INFO:tasks.workunit.client.0.smithi088.stdout:1/271: link d0/d1/d16/d35/c4b d0/d1/df/d20/c57 0 2024-09-17T04:21:01.640 INFO:tasks.workunit.client.1.smithi134.stdout:3/806: mkdir de/d108 0 2024-09-17T04:21:01.640 INFO:tasks.workunit.client.1.smithi134.stdout:3/807: fdatasync de/d12/d22/d5a/f9e 0 2024-09-17T04:21:01.643 INFO:tasks.workunit.client.1.smithi134.stdout:4/743: creat d0/d13/d40/d42/ff2 x:0 0 0 2024-09-17T04:21:01.645 INFO:tasks.workunit.client.0.smithi088.stdout:5/284: mkdir d2/d31/d33/d20/d30/d51/d5e 0 2024-09-17T04:21:01.646 INFO:tasks.workunit.client.0.smithi088.stdout:1/272: mkdir d0/d1/d58 0 2024-09-17T04:21:01.647 INFO:tasks.workunit.client.0.smithi088.stdout:5/285: dread - d2/d31/d33/d20/d25/d2c/f52 zero size 2024-09-17T04:21:01.647 INFO:tasks.workunit.client.0.smithi088.stdout:1/273: stat d0/d1/df/d20/d4e 0 2024-09-17T04:21:01.648 INFO:tasks.workunit.client.1.smithi134.stdout:5/682: creat d0/da/d29/d7c/d9e/fe1 x:0 0 0 2024-09-17T04:21:01.648 INFO:tasks.workunit.client.0.smithi088.stdout:5/286: fdatasync d2/f40 0 2024-09-17T04:21:01.649 INFO:tasks.workunit.client.0.smithi088.stdout:5/287: fdatasync d2/d31/d33/f12 0 2024-09-17T04:21:01.650 INFO:tasks.workunit.client.1.smithi134.stdout:1/752: creat d12/d19/d5d/d88/fff x:0 0 0 2024-09-17T04:21:01.653 INFO:tasks.workunit.client.0.smithi088.stdout:5/288: creat d2/d31/d33/d20/d25/d49/f5f x:0 0 0 2024-09-17T04:21:01.654 INFO:tasks.workunit.client.0.smithi088.stdout:1/274: creat d0/d1/df/d20/d4e/f59 x:0 0 0 2024-09-17T04:21:01.659 INFO:tasks.workunit.client.0.smithi088.stdout:1/275: mknod d0/d1/d27/c5a 0 2024-09-17T04:21:01.661 INFO:tasks.workunit.client.0.smithi088.stdout:8/230: truncate d7/d29/d2a/f33 520325 0 2024-09-17T04:21:01.665 INFO:tasks.workunit.client.0.smithi088.stdout:8/231: creat d7/d29/d2a/d38/d3d/f49 x:0 0 0 2024-09-17T04:21:01.665 INFO:tasks.workunit.client.0.smithi088.stdout:1/276: dwrite d0/f3b [0,4194304] 0 2024-09-17T04:21:01.669 INFO:tasks.workunit.client.0.smithi088.stdout:8/232: unlink d7/d29/d2a/d38/l41 0 2024-09-17T04:21:01.670 INFO:tasks.workunit.client.0.smithi088.stdout:8/233: stat d7/dd/f16 0 2024-09-17T04:21:01.671 INFO:tasks.workunit.client.0.smithi088.stdout:1/277: mkdir d0/d1/d16/d56/d5b 0 2024-09-17T04:21:01.672 INFO:tasks.workunit.client.0.smithi088.stdout:5/289: write d2/f10 [3333472,56610] 0 2024-09-17T04:21:01.673 INFO:tasks.workunit.client.0.smithi088.stdout:1/278: write d0/d13/f3f [187161,39125] 0 2024-09-17T04:21:01.676 INFO:tasks.workunit.client.0.smithi088.stdout:5/290: creat d2/d31/d33/d20/d25/d49/f60 x:0 0 0 2024-09-17T04:21:01.680 INFO:tasks.workunit.client.0.smithi088.stdout:5/291: mkdir d2/d31/d33/d20/d25/d61 0 2024-09-17T04:21:01.683 INFO:tasks.workunit.client.0.smithi088.stdout:1/279: dwrite d0/d1/fd [0,4194304] 0 2024-09-17T04:21:01.686 INFO:tasks.workunit.client.0.smithi088.stdout:1/280: readlink d0/d1/d16/l46 0 2024-09-17T04:21:01.689 INFO:tasks.workunit.client.0.smithi088.stdout:8/234: dread d7/f9 [0,4194304] 0 2024-09-17T04:21:01.690 INFO:tasks.workunit.client.0.smithi088.stdout:5/292: rmdir d2/d31/d33/d20/d25/d61 0 2024-09-17T04:21:01.692 INFO:tasks.workunit.client.0.smithi088.stdout:5/293: truncate d2/d31/d33/f58 883420 0 2024-09-17T04:21:01.698 INFO:tasks.workunit.client.0.smithi088.stdout:1/281: dwrite d0/d1/f1a [0,4194304] 0 2024-09-17T04:21:01.701 INFO:tasks.workunit.client.0.smithi088.stdout:1/282: mknod d0/d1/d16/d56/d5b/c5c 0 2024-09-17T04:21:01.703 INFO:tasks.workunit.client.0.smithi088.stdout:1/283: mkdir d0/d1/df/d20/d4e/d5d 0 2024-09-17T04:21:01.707 INFO:tasks.workunit.client.0.smithi088.stdout:1/284: creat d0/d1/df/d20/f5e x:0 0 0 2024-09-17T04:21:01.708 INFO:tasks.workunit.client.0.smithi088.stdout:5/294: truncate d2/d31/d33/d20/f2e 2017671 0 2024-09-17T04:21:01.709 INFO:tasks.workunit.client.0.smithi088.stdout:8/235: truncate d7/d29/d2a/f33 751771 0 2024-09-17T04:21:01.709 INFO:tasks.workunit.client.0.smithi088.stdout:1/285: write d0/d13/f47 [314936,113849] 0 2024-09-17T04:21:01.709 INFO:tasks.workunit.client.0.smithi088.stdout:1/286: chown d0/f41 1059130044 1 2024-09-17T04:21:01.710 INFO:tasks.workunit.client.0.smithi088.stdout:1/287: write d0/f4f [2599104,290] 0 2024-09-17T04:21:01.711 INFO:tasks.workunit.client.0.smithi088.stdout:8/236: write f6 [5079260,55878] 0 2024-09-17T04:21:01.712 INFO:tasks.workunit.client.0.smithi088.stdout:8/237: read d7/f8 [3571331,106264] 0 2024-09-17T04:21:01.713 INFO:tasks.workunit.client.0.smithi088.stdout:5/295: creat d2/d31/d33/d20/f62 x:0 0 0 2024-09-17T04:21:01.714 INFO:tasks.workunit.client.0.smithi088.stdout:8/238: chown d7/cb 49620871 1 2024-09-17T04:21:01.714 INFO:tasks.workunit.client.0.smithi088.stdout:5/296: stat d2/d31/d33/d20/f55 0 2024-09-17T04:21:01.715 INFO:tasks.workunit.client.0.smithi088.stdout:1/288: creat d0/d1/d16/d35/f5f x:0 0 0 2024-09-17T04:21:01.715 INFO:tasks.workunit.client.0.smithi088.stdout:8/239: write f6 [3855773,106032] 0 2024-09-17T04:21:01.716 INFO:tasks.workunit.client.0.smithi088.stdout:5/297: chown d2/d31/d33/d20/d25/f28 977106 1 2024-09-17T04:21:01.720 INFO:tasks.workunit.client.1.smithi134.stdout:3/808: creat de/d12/d9d/dd4/f109 x:0 0 0 2024-09-17T04:21:01.721 INFO:tasks.workunit.client.1.smithi134.stdout:3/809: chown de/d10/d3d 1835 1 2024-09-17T04:21:01.721 INFO:tasks.workunit.client.1.smithi134.stdout:1/753: write d12/f86 [195406,88194] 0 2024-09-17T04:21:01.722 INFO:tasks.workunit.client.1.smithi134.stdout:8/619: dread d4/d1e/daf/d60/d6b/d13/f78 [0,4194304] 0 2024-09-17T04:21:01.723 INFO:tasks.workunit.client.0.smithi088.stdout:1/289: dwrite d0/f4a [0,4194304] 0 2024-09-17T04:21:01.723 INFO:tasks.workunit.client.1.smithi134.stdout:7/570: link d0/d16/d8b/d6a/d70/d85/f9e d0/dd/fb4 0 2024-09-17T04:21:01.723 INFO:tasks.workunit.client.1.smithi134.stdout:7/571: readlink d0/dd/d3a/d3d/d38/l3f 0 2024-09-17T04:21:01.728 INFO:tasks.workunit.client.0.smithi088.stdout:8/240: rename d7/dd/f16 to d7/d29/d2a/f4a 0 2024-09-17T04:21:01.729 INFO:tasks.workunit.client.1.smithi134.stdout:7/572: dwrite d0/dd/f58 [0,4194304] 0 2024-09-17T04:21:01.730 INFO:tasks.workunit.client.1.smithi134.stdout:0/682: rename d11/d4c/dd3/d2f to d11/d19/d21/de9 0 2024-09-17T04:21:01.730 INFO:tasks.workunit.client.0.smithi088.stdout:1/290: unlink d0/f4a 0 2024-09-17T04:21:01.736 INFO:tasks.workunit.client.1.smithi134.stdout:5/683: fsync d0/da/d69/d41/d6d/d89/fc8 0 2024-09-17T04:21:01.739 INFO:tasks.workunit.client.1.smithi134.stdout:3/810: rmdir de 39 2024-09-17T04:21:01.741 INFO:tasks.workunit.client.0.smithi088.stdout:1/291: rename d0/d1/fd to d0/d13/f60 0 2024-09-17T04:21:01.745 INFO:tasks.workunit.client.0.smithi088.stdout:8/241: unlink d7/dd/c30 0 2024-09-17T04:21:01.746 INFO:tasks.workunit.client.1.smithi134.stdout:4/744: link d0/c69 d0/df/d1e/d73/ddb/cf3 0 2024-09-17T04:21:01.746 INFO:tasks.workunit.client.1.smithi134.stdout:4/745: stat d0/df/d35/fd3 0 2024-09-17T04:21:01.748 INFO:tasks.workunit.client.1.smithi134.stdout:0/683: mkdir d11/d19/d21/de9/d9a/dea 0 2024-09-17T04:21:01.751 INFO:tasks.workunit.client.1.smithi134.stdout:7/573: creat d0/d16/d8b/d6a/d70/db3/fb5 x:0 0 0 2024-09-17T04:21:01.752 INFO:tasks.workunit.client.1.smithi134.stdout:6/801: sync 2024-09-17T04:21:01.755 INFO:tasks.workunit.client.1.smithi134.stdout:5/684: fsync d0/da/d29/d78/da5/fb1 0 2024-09-17T04:21:01.756 INFO:tasks.workunit.client.1.smithi134.stdout:8/620: write d4/db/d6e/fae [749049,30940] 0 2024-09-17T04:21:01.759 INFO:tasks.workunit.client.0.smithi088.stdout:1/292: link d0/d1/df/f3e d0/d1/f61 0 2024-09-17T04:21:01.760 INFO:tasks.workunit.client.1.smithi134.stdout:3/811: read - de/d12/d15/d1d/d8f/deb/f100 zero size 2024-09-17T04:21:01.761 INFO:tasks.workunit.client.1.smithi134.stdout:4/746: creat d0/df/d35/ff4 x:0 0 0 2024-09-17T04:21:01.762 INFO:tasks.workunit.client.1.smithi134.stdout:5/685: dwrite d0/d3a/d2b/d61/f65 [0,4194304] 0 2024-09-17T04:21:01.763 INFO:tasks.workunit.client.0.smithi088.stdout:8/242: write d7/d29/d2a/f33 [840870,130571] 0 2024-09-17T04:21:01.764 INFO:tasks.workunit.client.1.smithi134.stdout:0/684: write d11/f13 [2865117,73347] 0 2024-09-17T04:21:01.764 INFO:tasks.workunit.client.1.smithi134.stdout:3/812: chown de/d12/d15/d1d/la4 47424 1 2024-09-17T04:21:01.765 INFO:tasks.workunit.client.1.smithi134.stdout:1/754: dwrite d12/d19/d1d/d61/dd3/dda/f6f [0,4194304] 0 2024-09-17T04:21:01.766 INFO:tasks.workunit.client.0.smithi088.stdout:8/243: write d7/d29/d2a/f2b [1503204,122496] 0 2024-09-17T04:21:01.767 INFO:tasks.workunit.client.1.smithi134.stdout:4/747: write d0/df/d35/d5c/d8b/fc0 [5118945,40659] 0 2024-09-17T04:21:01.768 INFO:tasks.workunit.client.0.smithi088.stdout:1/293: dwrite d0/d1/fe [0,4194304] 0 2024-09-17T04:21:01.770 INFO:tasks.workunit.client.1.smithi134.stdout:6/802: symlink de/d19/d1f/d85/dde/l102 0 2024-09-17T04:21:01.771 INFO:tasks.workunit.client.0.smithi088.stdout:8/244: read d7/d29/f2e [335090,29317] 0 2024-09-17T04:21:01.773 INFO:tasks.workunit.client.1.smithi134.stdout:8/621: mknod d4/db/dd/d43/da5/cc0 0 2024-09-17T04:21:01.773 INFO:tasks.workunit.client.1.smithi134.stdout:3/813: mkdir de/d10/d3d/dd9/dbd/d10a 0 2024-09-17T04:21:01.775 INFO:tasks.workunit.client.1.smithi134.stdout:0/685: dread d11/d19/d21/de9/d43/d5d/f78 [0,4194304] 0 2024-09-17T04:21:01.777 INFO:tasks.workunit.client.1.smithi134.stdout:6/803: fdatasync de/d19/d1f/f26 0 2024-09-17T04:21:01.779 INFO:tasks.workunit.client.1.smithi134.stdout:6/804: stat de/d19/d21/d2d/d4c/c69 0 2024-09-17T04:21:01.780 INFO:tasks.workunit.client.1.smithi134.stdout:8/622: dwrite d4/db/dd/f2e [0,4194304] 0 2024-09-17T04:21:01.781 INFO:tasks.workunit.client.0.smithi088.stdout:8/245: symlink d7/d29/d2a/d38/l4b 0 2024-09-17T04:21:01.781 INFO:tasks.workunit.client.1.smithi134.stdout:6/805: truncate de/d19/d62/d34/d3b/fc0 506072 0 2024-09-17T04:21:01.783 INFO:tasks.workunit.client.1.smithi134.stdout:1/755: mkdir d12/d1c/d100 0 2024-09-17T04:21:01.784 INFO:tasks.workunit.client.0.smithi088.stdout:8/246: creat d7/dd/d31/f4c x:0 0 0 2024-09-17T04:21:01.786 INFO:tasks.workunit.client.1.smithi134.stdout:2/677: sync 2024-09-17T04:21:01.786 INFO:tasks.workunit.client.0.smithi088.stdout:1/294: dread d0/d1/df/d20/f49 [0,4194304] 0 2024-09-17T04:21:01.787 INFO:tasks.workunit.client.1.smithi134.stdout:2/678: stat d19/d1c/d47/d50/fcb 0 2024-09-17T04:21:01.787 INFO:tasks.workunit.client.1.smithi134.stdout:5/686: link d0/da/d2c/fa7 d0/da/fe2 0 2024-09-17T04:21:01.788 INFO:tasks.workunit.client.1.smithi134.stdout:5/687: chown d0/da/d29/d78/f99 0 1 2024-09-17T04:21:01.793 INFO:tasks.workunit.client.1.smithi134.stdout:5/688: dwrite d0/d3a/fa9 [0,4194304] 0 2024-09-17T04:21:01.794 INFO:tasks.workunit.client.1.smithi134.stdout:8/623: rename d4/d1e/d8a/fa8 to d4/db/dd/d43/da5/fc1 0 2024-09-17T04:21:01.794 INFO:tasks.workunit.client.1.smithi134.stdout:5/689: fsync d0/d3a/d2b/f9f 0 2024-09-17T04:21:01.795 INFO:tasks.workunit.client.0.smithi088.stdout:1/295: dwrite d0/d1/df/d20/f5e [0,4194304] 0 2024-09-17T04:21:01.796 INFO:tasks.workunit.client.1.smithi134.stdout:4/748: creat d0/ff5 x:0 0 0 2024-09-17T04:21:01.796 INFO:tasks.workunit.client.1.smithi134.stdout:5/690: write d0/da/d2c/d73/fa3 [4532265,87781] 0 2024-09-17T04:21:01.799 INFO:tasks.workunit.client.1.smithi134.stdout:2/679: mkdir d19/d1c/d92/ddc/dc6/dbc/de3 0 2024-09-17T04:21:01.799 INFO:tasks.workunit.client.1.smithi134.stdout:5/691: chown d0/da/d2c/d73/d8a/fbd 42567738 1 2024-09-17T04:21:01.801 INFO:tasks.workunit.client.1.smithi134.stdout:6/806: dwrite de/d19/d62/fa8 [0,4194304] 0 2024-09-17T04:21:01.804 INFO:tasks.workunit.client.1.smithi134.stdout:8/624: mknod d4/d1e/daf/d60/d6b/cc2 0 2024-09-17T04:21:01.805 INFO:tasks.workunit.client.0.smithi088.stdout:1/296: creat d0/d1/df/d20/f62 x:0 0 0 2024-09-17T04:21:01.806 INFO:tasks.workunit.client.1.smithi134.stdout:8/625: chown d4/db/f20 0 1 2024-09-17T04:21:01.807 INFO:tasks.workunit.client.1.smithi134.stdout:8/626: fdatasync d4/d1f/d25/d6a/f85 0 2024-09-17T04:21:01.807 INFO:tasks.workunit.client.1.smithi134.stdout:2/680: dwrite d19/da1/fd1 [0,4194304] 0 2024-09-17T04:21:01.808 INFO:tasks.workunit.client.1.smithi134.stdout:0/686: creat d11/d24/d49/feb x:0 0 0 2024-09-17T04:21:01.809 INFO:tasks.workunit.client.1.smithi134.stdout:2/681: readlink d19/d27/d31/l5d 0 2024-09-17T04:21:01.809 INFO:tasks.workunit.client.0.smithi088.stdout:1/297: mkdir d0/d1/df/d63 0 2024-09-17T04:21:01.810 INFO:tasks.workunit.client.1.smithi134.stdout:5/692: symlink d0/da/d29/d7c/le3 0 2024-09-17T04:21:01.811 INFO:tasks.workunit.client.1.smithi134.stdout:6/807: rmdir de/d19/d74/d98 39 2024-09-17T04:21:01.814 INFO:tasks.workunit.client.1.smithi134.stdout:1/756: getdents d12/d1c/dc0/dde 0 2024-09-17T04:21:01.814 INFO:tasks.workunit.client.1.smithi134.stdout:4/749: creat d0/d13/d40/d42/dc5/dcb/ff6 x:0 0 0 2024-09-17T04:21:01.815 INFO:tasks.workunit.client.1.smithi134.stdout:8/627: mknod d4/d1f/d25/d6a/cc3 0 2024-09-17T04:21:01.816 INFO:tasks.workunit.client.1.smithi134.stdout:8/628: chown d4/db/dd/d43/d8b/d8e 13385112 1 2024-09-17T04:21:01.817 INFO:tasks.workunit.client.0.smithi088.stdout:1/298: creat d0/d1/d16/d2a/f64 x:0 0 0 2024-09-17T04:21:01.817 INFO:tasks.workunit.client.1.smithi134.stdout:1/757: read d12/d19/d1d/d61/dd3/dda/d85/fbb [240189,128507] 0 2024-09-17T04:21:01.817 INFO:tasks.workunit.client.1.smithi134.stdout:4/750: dread d0/df/d1e/d73/f8f [0,4194304] 0 2024-09-17T04:21:01.818 INFO:tasks.workunit.client.1.smithi134.stdout:8/629: write d4/d1f/f3a [1749725,119290] 0 2024-09-17T04:21:01.819 INFO:tasks.workunit.client.1.smithi134.stdout:8/630: stat d4/db/dd/d43/da5/fc1 0 2024-09-17T04:21:01.820 INFO:tasks.workunit.client.1.smithi134.stdout:8/631: write d4/d1e/f9b [39133,51962] 0 2024-09-17T04:21:01.821 INFO:tasks.workunit.client.1.smithi134.stdout:8/632: chown f3 102424847 1 2024-09-17T04:21:01.823 INFO:tasks.workunit.client.1.smithi134.stdout:0/687: rename d11/d19/f6c to d11/d4c/d76/fec 0 2024-09-17T04:21:01.824 INFO:tasks.workunit.client.1.smithi134.stdout:6/808: symlink de/l103 0 2024-09-17T04:21:01.824 INFO:tasks.workunit.client.1.smithi134.stdout:0/688: stat d11/d4c/d76/c83 0 2024-09-17T04:21:01.825 INFO:tasks.workunit.client.0.smithi088.stdout:1/299: dwrite d0/d13/f47 [0,4194304] 0 2024-09-17T04:21:01.825 INFO:tasks.workunit.client.1.smithi134.stdout:0/689: stat d11/d24/d49 0 2024-09-17T04:21:01.827 INFO:tasks.workunit.client.1.smithi134.stdout:1/758: mkdir d12/d19/d4f/d101 0 2024-09-17T04:21:01.828 INFO:tasks.workunit.client.1.smithi134.stdout:7/574: truncate d0/d16/d35/d4b/d65/f89 3753641 0 2024-09-17T04:21:01.829 INFO:tasks.workunit.client.1.smithi134.stdout:4/751: dread - d0/d13/d40/d42/f9b zero size 2024-09-17T04:21:01.832 INFO:tasks.workunit.client.0.smithi088.stdout:1/300: creat d0/d1/df/d20/d4e/d5d/f65 x:0 0 0 2024-09-17T04:21:01.833 INFO:tasks.workunit.client.1.smithi134.stdout:6/809: symlink de/d5d/l104 0 2024-09-17T04:21:01.834 INFO:tasks.workunit.client.1.smithi134.stdout:0/690: rmdir d11/d6f 39 2024-09-17T04:21:01.835 INFO:tasks.workunit.client.1.smithi134.stdout:8/633: dread f3 [0,4194304] 0 2024-09-17T04:21:01.836 INFO:tasks.workunit.client.1.smithi134.stdout:1/759: unlink d12/d1c/d2e/d7d/fce 0 2024-09-17T04:21:01.838 INFO:tasks.workunit.client.0.smithi088.stdout:1/301: mknod d0/d1/df/d20/d4e/c66 0 2024-09-17T04:21:01.839 INFO:tasks.workunit.client.0.smithi088.stdout:1/302: write d0/d1/f1a [1582874,94573] 0 2024-09-17T04:21:01.839 INFO:tasks.workunit.client.1.smithi134.stdout:7/575: mkdir d0/d16/d8b/d6a/d70/d85/db6 0 2024-09-17T04:21:01.839 INFO:tasks.workunit.client.1.smithi134.stdout:3/814: write de/d12/d15/f4b [1711474,78721] 0 2024-09-17T04:21:01.843 INFO:tasks.workunit.client.1.smithi134.stdout:6/810: symlink de/d19/d1f/d55/d77/d89/l105 0 2024-09-17T04:21:01.845 INFO:tasks.workunit.client.0.smithi088.stdout:1/303: dwrite d0/f4 [0,4194304] 0 2024-09-17T04:21:01.846 INFO:tasks.workunit.client.0.smithi088.stdout:8/247: write d7/f8 [5079590,69550] 0 2024-09-17T04:21:01.848 INFO:tasks.workunit.client.1.smithi134.stdout:0/691: mkdir d11/d24/d49/d62/daf/ded 0 2024-09-17T04:21:01.855 INFO:tasks.workunit.client.0.smithi088.stdout:1/304: symlink d0/d1/df/d63/l67 0 2024-09-17T04:21:01.855 INFO:tasks.workunit.client.0.smithi088.stdout:1/305: truncate d0/f4f 4230610 0 2024-09-17T04:21:01.857 INFO:tasks.workunit.client.1.smithi134.stdout:3/815: rename de/d12/d9d/dd4 to de/d12/d15/d9f/dba/dc4/dca/d10b 0 2024-09-17T04:21:01.858 INFO:tasks.workunit.client.1.smithi134.stdout:6/811: dread de/d19/d1f/d55/f68 [0,4194304] 0 2024-09-17T04:21:01.859 INFO:tasks.workunit.client.1.smithi134.stdout:6/812: write de/d2b/f80 [1019257,120306] 0 2024-09-17T04:21:01.869 INFO:tasks.workunit.client.0.smithi088.stdout:4/314: sync 2024-09-17T04:21:01.870 INFO:tasks.workunit.client.0.smithi088.stdout:9/375: sync 2024-09-17T04:21:01.870 INFO:tasks.workunit.client.0.smithi088.stdout:7/325: sync 2024-09-17T04:21:01.871 INFO:tasks.workunit.client.0.smithi088.stdout:9/376: stat d2/dd/d11/d4f/d72/l81 0 2024-09-17T04:21:01.873 INFO:tasks.workunit.client.0.smithi088.stdout:1/306: creat d0/d13/f68 x:0 0 0 2024-09-17T04:21:01.874 INFO:tasks.workunit.client.0.smithi088.stdout:8/248: getdents d7/d29/d2a/d38/d3d 0 2024-09-17T04:21:01.875 INFO:tasks.workunit.client.1.smithi134.stdout:1/760: mknod d12/d19/d5d/dfe/c102 0 2024-09-17T04:21:01.875 INFO:tasks.workunit.client.1.smithi134.stdout:0/692: dwrite d11/d48/fd1 [0,4194304] 0 2024-09-17T04:21:01.877 INFO:tasks.workunit.client.1.smithi134.stdout:7/576: mkdir d0/dd/db7 0 2024-09-17T04:21:01.877 INFO:tasks.workunit.client.1.smithi134.stdout:0/693: chown d11/d19/d21/de9/l5a 8790948 1 2024-09-17T04:21:01.878 INFO:tasks.workunit.client.1.smithi134.stdout:0/694: write d11/d19/d21/d37/f42 [3382087,8922] 0 2024-09-17T04:21:01.878 INFO:tasks.workunit.client.1.smithi134.stdout:4/752: symlink d0/d13/d40/d72/lf7 0 2024-09-17T04:21:01.879 INFO:tasks.workunit.client.1.smithi134.stdout:0/695: read d11/d19/d21/de9/d43/d5d/f78 [466422,18387] 0 2024-09-17T04:21:01.880 INFO:tasks.workunit.client.0.smithi088.stdout:9/377: unlink d2/dd/d11/d4f/d72/l81 0 2024-09-17T04:21:01.881 INFO:tasks.workunit.client.0.smithi088.stdout:1/307: creat d0/d1/d16/d35/f69 x:0 0 0 2024-09-17T04:21:01.883 INFO:tasks.workunit.client.1.smithi134.stdout:3/816: mknod de/d12/d15/d1d/d2d/c10c 0 2024-09-17T04:21:01.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:01 smithi088 ceph-mon[27811]: from='client.14806 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:21:01.893 INFO:tasks.workunit.client.1.smithi134.stdout:1/761: rename d12/d1c/c28 to d12/dcc/c103 0 2024-09-17T04:21:01.894 INFO:tasks.workunit.client.0.smithi088.stdout:9/378: fsync d2/fb 0 2024-09-17T04:21:01.894 INFO:tasks.workunit.client.1.smithi134.stdout:6/813: dwrite de/d19/d62/d34/f3c [0,4194304] 0 2024-09-17T04:21:01.895 INFO:tasks.workunit.client.1.smithi134.stdout:1/762: write d12/d19/d1d/d61/da0/da4/fd9 [270539,20535] 0 2024-09-17T04:21:01.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:01 smithi134 ceph-mon[35201]: from='client.24493 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:21:01.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:01 smithi134 ceph-mon[35201]: from='client.14806 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:21:01.897 INFO:tasks.workunit.client.0.smithi088.stdout:8/249: rename d7/dd/l45 to d7/d29/d2a/d3a/l4d 0 2024-09-17T04:21:01.898 INFO:tasks.workunit.client.1.smithi134.stdout:8/634: write d4/db/dd/f30 [159580,57714] 0 2024-09-17T04:21:01.899 INFO:tasks.workunit.client.1.smithi134.stdout:4/753: mknod d0/d13/d40/d42/dc5/cf8 0 2024-09-17T04:21:01.901 INFO:tasks.workunit.client.1.smithi134.stdout:0/696: dread d11/d24/d49/f68 [0,4194304] 0 2024-09-17T04:21:01.901 INFO:tasks.workunit.client.1.smithi134.stdout:1/763: dread d12/d19/d1d/d61/da0/feb [0,4194304] 0 2024-09-17T04:21:01.901 INFO:tasks.workunit.client.0.smithi088.stdout:9/379: fsync d2/f9 0 2024-09-17T04:21:01.902 INFO:tasks.workunit.client.1.smithi134.stdout:3/817: fdatasync de/d12/d15/d1d/d2d/d31/d6a/d83/f89 0 2024-09-17T04:21:01.906 INFO:tasks.workunit.client.1.smithi134.stdout:4/754: dwrite d0/d13/d40/d42/d92/d7b/fc8 [0,4194304] 0 2024-09-17T04:21:01.907 INFO:tasks.workunit.client.1.smithi134.stdout:6/814: rename de/d19/d21/c78 to de/d19/d1f/d55/d77/db8/dc7/ddc/db3/c106 0 2024-09-17T04:21:01.909 INFO:tasks.workunit.client.0.smithi088.stdout:7/326: dwrite d2/d4/d7/f36 [4194304,4194304] 0 2024-09-17T04:21:01.914 INFO:tasks.workunit.client.1.smithi134.stdout:1/764: fsync d12/d19/d1d/d61/da0/feb 0 2024-09-17T04:21:01.914 INFO:tasks.workunit.client.0.smithi088.stdout:1/308: creat d0/f6a x:0 0 0 2024-09-17T04:21:01.916 INFO:tasks.workunit.client.0.smithi088.stdout:4/315: truncate d5/f2d 3118008 0 2024-09-17T04:21:01.916 INFO:tasks.workunit.client.0.smithi088.stdout:1/309: write d0/d1/df/d20/f5e [2651114,17044] 0 2024-09-17T04:21:01.918 INFO:tasks.workunit.client.0.smithi088.stdout:8/250: link d7/d29/d2a/f35 d7/d29/d2a/d38/d42/f4e 0 2024-09-17T04:21:01.920 INFO:tasks.workunit.client.1.smithi134.stdout:7/577: creat d0/dd/d3a/d3d/d38/d60/fb8 x:0 0 0 2024-09-17T04:21:01.920 INFO:tasks.workunit.client.1.smithi134.stdout:2/682: sync 2024-09-17T04:21:01.920 INFO:tasks.workunit.client.1.smithi134.stdout:5/693: sync 2024-09-17T04:21:01.921 INFO:tasks.workunit.client.1.smithi134.stdout:5/694: readlink d0/da/l28 0 2024-09-17T04:21:01.922 INFO:tasks.workunit.client.1.smithi134.stdout:7/578: write d0/dd/d3a/d3d/f61 [1932111,90722] 0 2024-09-17T04:21:01.922 INFO:tasks.workunit.client.0.smithi088.stdout:7/327: symlink d2/d4/d7/d46/d67/l73 0 2024-09-17T04:21:01.923 INFO:tasks.workunit.client.1.smithi134.stdout:3/818: symlink de/d12/d15/dd0/dfe/l10d 0 2024-09-17T04:21:01.923 INFO:tasks.workunit.client.1.smithi134.stdout:3/819: readlink de/d10/d3d/da2/la9 0 2024-09-17T04:21:01.925 INFO:tasks.workunit.client.0.smithi088.stdout:8/251: dwrite d7/f8 [0,4194304] 0 2024-09-17T04:21:01.926 INFO:tasks.workunit.client.0.smithi088.stdout:8/252: chown d7/c19 930802 1 2024-09-17T04:21:01.926 INFO:tasks.workunit.client.1.smithi134.stdout:4/755: mknod d0/df/d35/d5c/d8b/cf9 0 2024-09-17T04:21:01.928 INFO:tasks.workunit.client.0.smithi088.stdout:8/253: stat d7/d29/f12 0 2024-09-17T04:21:01.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.929+0000 7f582909b640 1 -- 172.21.15.88:0/2078759023 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f582410de70 con 0x7f58241023f0 2024-09-17T04:21:01.929 INFO:tasks.workunit.client.1.smithi134.stdout:8/635: rename d4/d1e/daf/d60/ca0 to d4/db/dd/d43/d8b/cc4 0 2024-09-17T04:21:01.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.930+0000 7f580bfff640 1 -- 172.21.15.88:0/2078759023 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+841 (secure 0 0 0) 0x7f58140667c0 con 0x7f58241023f0 2024-09-17T04:21:01.931 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-17T04:21:01.931 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-09-17T04:21:01.931 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T04:21:01.931 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:21:01.931 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-09-17T04:21:01.931 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 1, 2024-09-17T04:21:01.931 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 1 2024-09-17T04:21:01.931 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:21:01.932 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-09-17T04:21:01.932 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-17T04:21:01.932 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:21:01.932 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2024-09-17T04:21:01.932 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T04:21:01.932 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:21:01.932 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-09-17T04:21:01.932 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 13, 2024-09-17T04:21:01.933 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 1 2024-09-17T04:21:01.933 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-17T04:21:01.933 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-17T04:21:01.933 INFO:tasks.workunit.client.0.smithi088.stdout:7/328: dwrite d2/d1d/f3d [0,4194304] 0 2024-09-17T04:21:01.933 INFO:tasks.workunit.client.0.smithi088.stdout:7/329: chown d2/d1e/f5a 758328994 1 2024-09-17T04:21:01.934 INFO:tasks.workunit.client.0.smithi088.stdout:7/330: write d2/d4/f52 [846722,40274] 0 2024-09-17T04:21:01.935 INFO:tasks.workunit.client.1.smithi134.stdout:8/636: truncate d4/db/dd/f2e 9155625 0 2024-09-17T04:21:01.935 INFO:tasks.workunit.client.1.smithi134.stdout:6/815: creat de/d19/d62/db0/f107 x:0 0 0 2024-09-17T04:21:01.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.935+0000 7f582909b640 1 -- 172.21.15.88:0/2078759023 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f580c074e10 msgr2=0x7f580c0772d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:01.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.935+0000 7f582909b640 1 --2- 172.21.15.88:0/2078759023 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f580c074e10 0x7f580c0772d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5818009230 tx=0x7f5818004f30 comp rx=0 tx=0).stop 2024-09-17T04:21:01.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.935+0000 7f582909b640 1 -- 172.21.15.88:0/2078759023 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58241023f0 msgr2=0x7f5824073270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:01.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.935+0000 7f582909b640 1 --2- 172.21.15.88:0/2078759023 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58241023f0 0x7f5824073270 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f581400e970 tx=0x7f581400ee30 comp rx=0 tx=0).stop 2024-09-17T04:21:01.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.935+0000 7f582909b640 1 -- 172.21.15.88:0/2078759023 shutdown_connections 2024-09-17T04:21:01.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.935+0000 7f582909b640 1 --2- 172.21.15.88:0/2078759023 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f580c074e10 0x7f580c0772d0 secure :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5818009230 tx=0x7f5818004f30 comp rx=0 tx=0).stop 2024-09-17T04:21:01.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.935+0000 7f582909b640 1 --2- 172.21.15.88:0/2078759023 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5824104d20 0x7f58240737b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:01.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.935+0000 7f582909b640 1 --2- 172.21.15.88:0/2078759023 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58241023f0 0x7f5824073270 secure :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f581400e970 tx=0x7f581400ee30 comp rx=0 tx=0).stop 2024-09-17T04:21:01.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.935+0000 7f582909b640 1 -- 172.21.15.88:0/2078759023 >> 172.21.15.88:0/2078759023 conn(0x7f58240fc010 msgr2=0x7f58240fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:21:01.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.935+0000 7f582909b640 1 -- 172.21.15.88:0/2078759023 shutdown_connections 2024-09-17T04:21:01.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:01.935+0000 7f582909b640 1 -- 172.21.15.88:0/2078759023 wait complete. 2024-09-17T04:21:01.938 INFO:tasks.workunit.client.0.smithi088.stdout:1/310: mknod d0/d1/d16/d56/c6b 0 2024-09-17T04:21:01.938 INFO:tasks.workunit.client.0.smithi088.stdout:1/311: read - d0/d1/df/d20/f29 zero size 2024-09-17T04:21:01.938 INFO:tasks.workunit.client.1.smithi134.stdout:6/816: write de/d19/d1f/d55/f87 [7507371,90303] 0 2024-09-17T04:21:01.939 INFO:tasks.workunit.client.1.smithi134.stdout:1/765: dread d12/d19/d1d/d3e/f48 [0,4194304] 0 2024-09-17T04:21:01.940 INFO:tasks.workunit.client.1.smithi134.stdout:0/697: creat d11/d24/d49/d62/daf/ded/fee x:0 0 0 2024-09-17T04:21:01.945 INFO:tasks.workunit.client.0.smithi088.stdout:8/254: unlink d7/f43 0 2024-09-17T04:21:01.947 INFO:tasks.workunit.client.1.smithi134.stdout:2/683: mkdir d19/d1c/d92/ddc/dc6/dbc/de4 0 2024-09-17T04:21:01.949 INFO:tasks.workunit.client.0.smithi088.stdout:4/316: mknod d5/d3d/d49/d5e/c64 0 2024-09-17T04:21:01.950 INFO:tasks.workunit.client.0.smithi088.stdout:4/317: readlink d5/d32/l59 0 2024-09-17T04:21:01.950 INFO:tasks.workunit.client.1.smithi134.stdout:5/695: chown d0/da/d29/d78/da5/dce 23405285 1 2024-09-17T04:21:01.951 INFO:tasks.workunit.client.1.smithi134.stdout:5/696: truncate d0/da/d2c/fa7 677376 0 2024-09-17T04:21:01.951 INFO:tasks.workunit.client.0.smithi088.stdout:7/331: mknod d2/d1d/c74 0 2024-09-17T04:21:01.952 INFO:tasks.workunit.client.1.smithi134.stdout:5/697: truncate d0/da/d29/d7c/d9e/fe1 338071 0 2024-09-17T04:21:01.953 INFO:tasks.workunit.client.1.smithi134.stdout:7/579: unlink d0/d16/d8b/d6a/d70/db3/fb5 0 2024-09-17T04:21:01.953 INFO:tasks.workunit.client.1.smithi134.stdout:7/580: chown d0/d16/d35/d4b/f7c 114378 1 2024-09-17T04:21:01.954 INFO:tasks.workunit.client.0.smithi088.stdout:1/312: mknod d0/d13/c6c 0 2024-09-17T04:21:01.954 INFO:tasks.workunit.client.1.smithi134.stdout:7/581: fdatasync d0/dd/d3a/d3d/d38/f18 0 2024-09-17T04:21:01.955 INFO:tasks.workunit.client.0.smithi088.stdout:9/380: getdents d2/dd/d11/d4f/d5c 0 2024-09-17T04:21:01.957 INFO:tasks.workunit.client.1.smithi134.stdout:4/756: mknod d0/d3b/d9f/cfa 0 2024-09-17T04:21:01.957 INFO:tasks.workunit.client.0.smithi088.stdout:9/381: read d2/dd/f4c [120784,22624] 0 2024-09-17T04:21:01.958 INFO:tasks.workunit.client.1.smithi134.stdout:8/637: fsync d4/d1e/f81 0 2024-09-17T04:21:01.958 INFO:tasks.workunit.client.1.smithi134.stdout:8/638: stat d4/d1f/d25/d6a/cc3 0 2024-09-17T04:21:01.960 INFO:tasks.workunit.client.1.smithi134.stdout:8/639: dread d4/db/dd/d95/f96 [0,4194304] 0 2024-09-17T04:21:01.961 INFO:tasks.workunit.client.1.smithi134.stdout:8/640: truncate d4/db/d6e/fae 1640143 0 2024-09-17T04:21:01.962 INFO:tasks.workunit.client.1.smithi134.stdout:6/817: mkdir de/d19/d62/d7c/d108 0 2024-09-17T04:21:01.963 INFO:tasks.workunit.client.1.smithi134.stdout:6/818: dread - de/d19/d62/db0/f107 zero size 2024-09-17T04:21:01.963 INFO:tasks.workunit.client.0.smithi088.stdout:7/332: creat d2/d4/d7/d46/d67/f75 x:0 0 0 2024-09-17T04:21:01.969 INFO:tasks.workunit.client.0.smithi088.stdout:1/313: dread d0/d1/d16/f3c [0,4194304] 0 2024-09-17T04:21:01.969 INFO:tasks.workunit.client.0.smithi088.stdout:1/314: chown d0/d1/d27 22136920 1 2024-09-17T04:21:01.971 INFO:tasks.workunit.client.0.smithi088.stdout:9/382: unlink d2/dd/d11/d4f/d5c/f77 0 2024-09-17T04:21:01.972 INFO:tasks.workunit.client.0.smithi088.stdout:9/383: dread - d2/dd/d11/d1d/d35/f5f zero size 2024-09-17T04:21:01.975 INFO:tasks.workunit.client.0.smithi088.stdout:4/318: mkdir d5/d65 0 2024-09-17T04:21:01.978 INFO:tasks.workunit.client.0.smithi088.stdout:7/333: dread d2/d4/f69 [0,4194304] 0 2024-09-17T04:21:01.979 INFO:tasks.workunit.client.0.smithi088.stdout:7/334: dread - d2/d4/d7/d46/d67/f75 zero size 2024-09-17T04:21:01.980 INFO:tasks.workunit.client.0.smithi088.stdout:7/335: stat d2/d1e/l41 0 2024-09-17T04:21:01.981 INFO:tasks.workunit.client.0.smithi088.stdout:7/336: write d2/d1e/d23/d45/f65 [210925,120196] 0 2024-09-17T04:21:01.986 INFO:tasks.workunit.client.1.smithi134.stdout:4/757: creat d0/d13/d40/d42/d92/d65/dc2/ffb x:0 0 0 2024-09-17T04:21:01.987 INFO:tasks.workunit.client.1.smithi134.stdout:2/684: dwrite d19/d1c/d47/d50/f95 [0,4194304] 0 2024-09-17T04:21:01.990 INFO:tasks.workunit.client.1.smithi134.stdout:8/641: symlink d4/db/d6e/d9d/lc5 0 2024-09-17T04:21:01.991 INFO:tasks.workunit.client.1.smithi134.stdout:7/582: write d0/d16/d35/d4b/f48 [1249335,106423] 0 2024-09-17T04:21:01.993 INFO:tasks.workunit.client.1.smithi134.stdout:1/766: creat d12/d19/d4f/d101/f104 x:0 0 0 2024-09-17T04:21:01.993 INFO:tasks.workunit.client.1.smithi134.stdout:7/583: write d0/d16/d8b/d6a/d70/d85/f93 [2794262,42370] 0 2024-09-17T04:21:01.994 INFO:tasks.workunit.client.1.smithi134.stdout:1/767: write d12/f90 [7837431,50874] 0 2024-09-17T04:21:01.996 INFO:tasks.workunit.client.0.smithi088.stdout:1/315: link d0/d13/f3f d0/d1/df/d20/d4e/d5d/f6d 0 2024-09-17T04:21:02.000 INFO:tasks.workunit.client.0.smithi088.stdout:8/255: rename d7/dd/l21 to d7/l4f 0 2024-09-17T04:21:02.001 INFO:tasks.workunit.client.0.smithi088.stdout:4/319: mknod d5/d65/c66 0 2024-09-17T04:21:02.004 INFO:tasks.workunit.client.0.smithi088.stdout:1/316: dwrite d0/d1/df/d20/f62 [0,4194304] 0 2024-09-17T04:21:02.005 INFO:tasks.workunit.client.1.smithi134.stdout:4/758: rmdir d0/df 39 2024-09-17T04:21:02.007 INFO:tasks.workunit.client.1.smithi134.stdout:4/759: write d0/d13/d40/d42/dc5/dcb/ff6 [1008888,97845] 0 2024-09-17T04:21:02.008 INFO:tasks.workunit.client.0.smithi088.stdout:8/256: symlink d7/d29/l50 0 2024-09-17T04:21:02.009 INFO:tasks.workunit.client.1.smithi134.stdout:2/685: readlink d19/d1c/l24 0 2024-09-17T04:21:02.010 INFO:tasks.workunit.client.0.smithi088.stdout:4/320: creat d5/d32/f67 x:0 0 0 2024-09-17T04:21:02.013 INFO:tasks.workunit.client.1.smithi134.stdout:8/642: creat d4/d1e/daf/d60/d6b/fc6 x:0 0 0 2024-09-17T04:21:02.014 INFO:tasks.workunit.client.0.smithi088.stdout:9/384: link d2/dd/d11/d1d/d43/d51/f71 d2/dd/f87 0 2024-09-17T04:21:02.014 INFO:tasks.workunit.client.0.smithi088.stdout:9/385: stat d2/c59 0 2024-09-17T04:21:02.016 INFO:tasks.workunit.client.0.smithi088.stdout:7/337: write d2/f1b [6625,108601] 0 2024-09-17T04:21:02.017 INFO:tasks.workunit.client.1.smithi134.stdout:8/643: dwrite d4/d1e/daf/f4b [0,4194304] 0 2024-09-17T04:21:02.018 INFO:tasks.workunit.client.0.smithi088.stdout:7/338: write d2/d4/d7/f34 [5152628,103204] 0 2024-09-17T04:21:02.018 INFO:tasks.workunit.client.0.smithi088.stdout:4/321: unlink d5/f20 0 2024-09-17T04:21:02.019 INFO:tasks.workunit.client.1.smithi134.stdout:8/644: write d4/d1e/daf/fb9 [677425,76226] 0 2024-09-17T04:21:02.019 INFO:tasks.workunit.client.0.smithi088.stdout:4/322: chown d5/d32/f44 1 1 2024-09-17T04:21:02.022 INFO:tasks.workunit.client.0.smithi088.stdout:9/386: creat d2/dd/d11/d1d/d35/f88 x:0 0 0 2024-09-17T04:21:02.024 INFO:tasks.workunit.client.1.smithi134.stdout:0/698: creat d11/d19/d21/de9/fef x:0 0 0 2024-09-17T04:21:02.025 INFO:tasks.workunit.client.0.smithi088.stdout:8/257: getdents d7/d29/d2a/d38/d3d 0 2024-09-17T04:21:02.030 INFO:tasks.workunit.client.1.smithi134.stdout:5/698: creat d0/fe4 x:0 0 0 2024-09-17T04:21:02.032 INFO:tasks.workunit.client.0.smithi088.stdout:7/339: unlink d2/d4/c2c 0 2024-09-17T04:21:02.033 INFO:tasks.workunit.client.1.smithi134.stdout:1/768: read d12/f42 [83590,89404] 0 2024-09-17T04:21:02.033 INFO:tasks.workunit.client.1.smithi134.stdout:3/820: getdents de/d12/d15/d9f/df7 0 2024-09-17T04:21:02.034 INFO:tasks.workunit.client.0.smithi088.stdout:1/317: fsync d0/d1/df/d20/f62 0 2024-09-17T04:21:02.035 INFO:tasks.workunit.client.0.smithi088.stdout:4/323: mkdir d5/d65/d68 0 2024-09-17T04:21:02.038 INFO:tasks.workunit.client.0.smithi088.stdout:7/340: readlink d2/d1e/d23/l59 0 2024-09-17T04:21:02.040 INFO:tasks.workunit.client.0.smithi088.stdout:1/318: dwrite d0/f3b [0,4194304] 0 2024-09-17T04:21:02.045 INFO:tasks.workunit.client.0.smithi088.stdout:4/324: creat d5/d3d/d49/d5e/f69 x:0 0 0 2024-09-17T04:21:02.047 INFO:tasks.workunit.client.0.smithi088.stdout:7/341: rmdir d2/d1e 39 2024-09-17T04:21:02.049 INFO:tasks.workunit.client.1.smithi134.stdout:7/584: dwrite d0/dd/d3a/d3d/d38/f23 [0,4194304] 0 2024-09-17T04:21:02.051 INFO:tasks.workunit.client.1.smithi134.stdout:5/699: write d0/da/d69/d41/d6d/f7f [407134,6754] 0 2024-09-17T04:21:02.053 INFO:tasks.workunit.client.1.smithi134.stdout:2/686: rename d19/l21 to d19/d1c/d47/d50/d85/le5 0 2024-09-17T04:21:02.054 INFO:tasks.workunit.client.0.smithi088.stdout:4/325: unlink d5/d32/c31 0 2024-09-17T04:21:02.054 INFO:tasks.workunit.client.1.smithi134.stdout:6/819: getdents de/d19/d62/d7c/ddb 0 2024-09-17T04:21:02.057 INFO:tasks.workunit.client.0.smithi088.stdout:1/319: symlink d0/d1/d58/l6e 0 2024-09-17T04:21:02.058 INFO:tasks.workunit.client.0.smithi088.stdout:8/258: getdents d7/dd 0 2024-09-17T04:21:02.058 INFO:tasks.workunit.client.0.smithi088.stdout:8/259: chown d7 107100906 1 2024-09-17T04:21:02.060 INFO:tasks.workunit.client.0.smithi088.stdout:4/326: creat d5/d3d/d49/d5e/f6a x:0 0 0 2024-09-17T04:21:02.061 INFO:tasks.workunit.client.1.smithi134.stdout:4/760: symlink d0/df/dd5/de9/lfc 0 2024-09-17T04:21:02.062 INFO:tasks.workunit.client.0.smithi088.stdout:7/342: creat d2/d1e/d23/d45/d62/f76 x:0 0 0 2024-09-17T04:21:02.062 INFO:tasks.workunit.client.1.smithi134.stdout:4/761: write d0/df/d17/d9c/fb3 [2412183,122889] 0 2024-09-17T04:21:02.063 INFO:tasks.workunit.client.0.smithi088.stdout:7/343: fsync d2/d1e/d23/d45/f63 0 2024-09-17T04:21:02.064 INFO:tasks.workunit.client.0.smithi088.stdout:1/320: creat d0/d1/df/d63/f6f x:0 0 0 2024-09-17T04:21:02.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.064+0000 7fa6598fd640 1 -- 172.21.15.88:0/1074473784 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa654101a80 msgr2=0x7fa654101f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:02.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.064+0000 7fa6598fd640 1 --2- 172.21.15.88:0/1074473784 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa654101a80 0x7fa654101f00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa63c009880 tx=0x7fa63c02a4a0 comp rx=0 tx=0).stop 2024-09-17T04:21:02.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.064+0000 7fa6598fd640 1 -- 172.21.15.88:0/1074473784 shutdown_connections 2024-09-17T04:21:02.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.064+0000 7fa6598fd640 1 --2- 172.21.15.88:0/1074473784 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa654101a80 0x7fa654101f00 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:02.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.064+0000 7fa6598fd640 1 --2- 172.21.15.88:0/1074473784 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa654100880 0x7fa654100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:02.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.064+0000 7fa6598fd640 1 -- 172.21.15.88:0/1074473784 >> 172.21.15.88:0/1074473784 conn(0x7fa6540fc010 msgr2=0x7fa6540fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:21:02.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.065+0000 7fa6598fd640 1 -- 172.21.15.88:0/1074473784 shutdown_connections 2024-09-17T04:21:02.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.065+0000 7fa6598fd640 1 -- 172.21.15.88:0/1074473784 wait complete. 2024-09-17T04:21:02.065 INFO:tasks.workunit.client.0.smithi088.stdout:1/321: fsync d0/f3b 0 2024-09-17T04:21:02.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.065+0000 7fa6598fd640 1 Processor -- start 2024-09-17T04:21:02.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.065+0000 7fa6598fd640 1 -- start start 2024-09-17T04:21:02.066 INFO:tasks.workunit.client.0.smithi088.stdout:8/260: rmdir d7 39 2024-09-17T04:21:02.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.066+0000 7fa6598fd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa654100880 0x7fa65406e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:21:02.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.066+0000 7fa6598fd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa654101a80 0x7fa65406e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:21:02.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.066+0000 7fa6598fd640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa654108590 con 0x7fa654101a80 2024-09-17T04:21:02.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.066+0000 7fa6598fd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa654108410 con 0x7fa654100880 2024-09-17T04:21:02.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.066+0000 7fa652ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa654100880 0x7fa65406e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:21:02.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.066+0000 7fa64bfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa654101a80 0x7fa65406e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:21:02.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.066+0000 7fa652ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa654100880 0x7fa65406e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.88:55634/0 (socket says 172.21.15.88:55634) 2024-09-17T04:21:02.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.066+0000 7fa652ffd640 1 -- 172.21.15.88:0/367138171 learned_addr learned my addr 172.21.15.88:0/367138171 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:21:02.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.066+0000 7fa64bfff640 1 -- 172.21.15.88:0/367138171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa654100880 msgr2=0x7fa65406e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:02.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.066+0000 7fa64bfff640 1 --2- 172.21.15.88:0/367138171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa654100880 0x7fa65406e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:02.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.067+0000 7fa64bfff640 1 -- 172.21.15.88:0/367138171 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa65406ef20 con 0x7fa654101a80 2024-09-17T04:21:02.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.067+0000 7fa64bfff640 1 --2- 172.21.15.88:0/367138171 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa654101a80 0x7fa65406e8a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa63c02aa90 tx=0x7fa63c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:21:02.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.067+0000 7fa6588fb640 1 -- 172.21.15.88:0/367138171 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa63c03f070 con 0x7fa654101a80 2024-09-17T04:21:02.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.067+0000 7fa6598fd640 1 -- 172.21.15.88:0/367138171 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa654073900 con 0x7fa654101a80 2024-09-17T04:21:02.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.067+0000 7fa6598fd640 1 -- 172.21.15.88:0/367138171 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa654073e60 con 0x7fa654101a80 2024-09-17T04:21:02.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.068+0000 7fa6588fb640 1 -- 172.21.15.88:0/367138171 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa63c0054a0 con 0x7fa654101a80 2024-09-17T04:21:02.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.068+0000 7fa6588fb640 1 -- 172.21.15.88:0/367138171 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa63c049060 con 0x7fa654101a80 2024-09-17T04:21:02.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.069+0000 7fa6598fd640 1 -- 172.21.15.88:0/367138171 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6340052c0 con 0x7fa654101a80 2024-09-17T04:21:02.070 INFO:tasks.workunit.client.0.smithi088.stdout:7/344: rename d2/d1d/f37 to d2/d1e/d23/d45/d62/f77 0 2024-09-17T04:21:02.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.071+0000 7fa6588fb640 1 -- 172.21.15.88:0/367138171 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7fa63c042070 con 0x7fa654101a80 2024-09-17T04:21:02.071 INFO:tasks.workunit.client.0.smithi088.stdout:7/345: chown d2/d1d/d2e/l4c 108385 1 2024-09-17T04:21:02.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.071+0000 7fa6588fb640 1 --2- 172.21.15.88:0/367138171 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7fa640074e60 0x7fa640077320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:21:02.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.072+0000 7fa6588fb640 1 -- 172.21.15.88:0/367138171 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7fa63c0b6cd0 con 0x7fa654101a80 2024-09-17T04:21:02.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.072+0000 7fa652ffd640 1 --2- 172.21.15.88:0/367138171 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7fa640074e60 0x7fa640077320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:21:02.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.073+0000 7fa652ffd640 1 --2- 172.21.15.88:0/367138171 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7fa640074e60 0x7fa640077320 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa644005fd0 tx=0x7fa64400b4a0 comp rx=0 tx=0).ready entity=mgr.24431 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:21:02.072 INFO:tasks.workunit.client.0.smithi088.stdout:8/261: chown d7/dd/d31/f4c 575 1 2024-09-17T04:21:02.073 INFO:tasks.workunit.client.0.smithi088.stdout:1/322: mknod d0/d1/d16/d35/c70 0 2024-09-17T04:21:02.075 INFO:tasks.workunit.client.0.smithi088.stdout:7/346: creat d2/d1d/d2e/f78 x:0 0 0 2024-09-17T04:21:02.078 INFO:tasks.workunit.client.1.smithi134.stdout:6/820: dread de/d19/d1f/d55/f87 [4194304,4194304] 0 2024-09-17T04:21:02.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.079+0000 7fa6588fb640 1 -- 172.21.15.88:0/367138171 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7fa63c082280 con 0x7fa654101a80 2024-09-17T04:21:02.081 INFO:tasks.workunit.client.1.smithi134.stdout:0/699: truncate d11/d4c/d76/f9e 940860 0 2024-09-17T04:21:02.082 INFO:tasks.workunit.client.1.smithi134.stdout:1/769: write d12/d19/d5d/d91/dac/fba [3919452,61413] 0 2024-09-17T04:21:02.085 INFO:tasks.workunit.client.1.smithi134.stdout:5/700: mkdir d0/d3a/d2b/de5 0 2024-09-17T04:21:02.087 INFO:tasks.workunit.client.1.smithi134.stdout:8/645: rename d4/d1e/daf/d60/d6b to d4/d11/da1/dc7 0 2024-09-17T04:21:02.088 INFO:tasks.workunit.client.1.smithi134.stdout:4/762: mkdir d0/d13/d40/d42/d92/d7b/dc9/dfd 0 2024-09-17T04:21:02.088 INFO:tasks.workunit.client.1.smithi134.stdout:4/763: fdatasync d0/df/d35/fd3 0 2024-09-17T04:21:02.089 INFO:tasks.workunit.client.0.smithi088.stdout:7/347: mkdir d2/d79 0 2024-09-17T04:21:02.090 INFO:tasks.workunit.client.0.smithi088.stdout:7/348: truncate d2/d4/f52 1494947 0 2024-09-17T04:21:02.091 INFO:tasks.workunit.client.1.smithi134.stdout:0/700: creat d11/d4c/ff0 x:0 0 0 2024-09-17T04:21:02.092 INFO:tasks.workunit.client.0.smithi088.stdout:7/349: write d2/d1e/d23/d45/f57 [213467,95609] 0 2024-09-17T04:21:02.092 INFO:tasks.workunit.client.0.smithi088.stdout:4/327: unlink d5/d3f/l2e 0 2024-09-17T04:21:02.095 INFO:tasks.workunit.client.0.smithi088.stdout:1/323: write d0/f28 [3057437,120318] 0 2024-09-17T04:21:02.097 INFO:tasks.workunit.client.1.smithi134.stdout:7/585: dwrite d0/dd/fe [8388608,4194304] 0 2024-09-17T04:21:02.099 INFO:tasks.workunit.client.1.smithi134.stdout:2/687: truncate d19/d27/d31/d49/d6f/fa6 3865770 0 2024-09-17T04:21:02.099 INFO:tasks.workunit.client.0.smithi088.stdout:7/350: dwrite d2/d1e/d23/d45/f5d [0,4194304] 0 2024-09-17T04:21:02.100 INFO:tasks.workunit.client.1.smithi134.stdout:8/646: symlink d4/d11/da1/dc7/lc8 0 2024-09-17T04:21:02.101 INFO:tasks.workunit.client.0.smithi088.stdout:7/351: chown d2/d4/d7/f10 4081340 1 2024-09-17T04:21:02.101 INFO:tasks.workunit.client.1.smithi134.stdout:8/647: readlink d4/d1e/daf/lb6 0 2024-09-17T04:21:02.102 INFO:tasks.workunit.client.0.smithi088.stdout:4/328: mkdir d5/d32/d6b 0 2024-09-17T04:21:02.103 INFO:tasks.workunit.client.0.smithi088.stdout:7/352: write d2/d1d/d2e/f78 [995636,43428] 0 2024-09-17T04:21:02.104 INFO:tasks.workunit.client.0.smithi088.stdout:8/262: getdents d7/d29/d2a/d3a 0 2024-09-17T04:21:02.105 INFO:tasks.workunit.client.1.smithi134.stdout:7/586: dwrite d0/d16/d8b/fad [0,4194304] 0 2024-09-17T04:21:02.106 INFO:tasks.workunit.client.0.smithi088.stdout:1/324: rmdir d0/d1/df 39 2024-09-17T04:21:02.107 INFO:tasks.workunit.client.1.smithi134.stdout:0/701: symlink d11/d19/ddc/lf1 0 2024-09-17T04:21:02.114 INFO:tasks.workunit.client.1.smithi134.stdout:8/648: mknod d4/d11/da1/dc7/cc9 0 2024-09-17T04:21:02.115 INFO:tasks.workunit.client.0.smithi088.stdout:4/329: symlink d5/d32/d6b/l6c 0 2024-09-17T04:21:02.116 INFO:tasks.workunit.client.0.smithi088.stdout:7/353: creat d2/d79/f7a x:0 0 0 2024-09-17T04:21:02.117 INFO:tasks.workunit.client.1.smithi134.stdout:1/770: creat d12/f105 x:0 0 0 2024-09-17T04:21:02.117 INFO:tasks.workunit.client.0.smithi088.stdout:4/330: chown d5/d3d/d49/d5e/f6a 1 1 2024-09-17T04:21:02.119 INFO:tasks.workunit.client.0.smithi088.stdout:7/354: fsync d2/d4/f14 0 2024-09-17T04:21:02.120 INFO:tasks.workunit.client.0.smithi088.stdout:8/263: rename d7/d29/d2a/d38/f48 to d7/f51 0 2024-09-17T04:21:02.121 INFO:tasks.workunit.client.0.smithi088.stdout:1/325: dwrite d0/d1/df/d20/f29 [0,4194304] 0 2024-09-17T04:21:02.125 INFO:tasks.workunit.client.1.smithi134.stdout:5/701: getdents d0/da/d29 0 2024-09-17T04:21:02.126 INFO:tasks.workunit.client.0.smithi088.stdout:8/264: dread d7/d29/f12 [4194304,4194304] 0 2024-09-17T04:21:02.126 INFO:tasks.workunit.client.0.smithi088.stdout:1/326: write d0/d1/df/d20/f49 [433380,45484] 0 2024-09-17T04:21:02.127 INFO:tasks.workunit.client.1.smithi134.stdout:2/688: creat d19/fe6 x:0 0 0 2024-09-17T04:21:02.128 INFO:tasks.workunit.client.1.smithi134.stdout:4/764: getdents d0/d13/d40/d42/dc5/dcb 0 2024-09-17T04:21:02.130 INFO:tasks.workunit.client.1.smithi134.stdout:4/765: write d0/df/d35/d5c/fcc [43523,81699] 0 2024-09-17T04:21:02.130 INFO:tasks.workunit.client.1.smithi134.stdout:7/587: rename d0/d16/d8b/d6a/d70/db3 to d0/dd/db9 0 2024-09-17T04:21:02.131 INFO:tasks.workunit.client.1.smithi134.stdout:1/771: mknod d12/d19/d5d/c106 0 2024-09-17T04:21:02.133 INFO:tasks.workunit.client.0.smithi088.stdout:4/331: creat d5/d3d/f6d x:0 0 0 2024-09-17T04:21:02.133 INFO:tasks.workunit.client.1.smithi134.stdout:5/702: chown d0/f4 6649850 1 2024-09-17T04:21:02.133 INFO:tasks.workunit.client.1.smithi134.stdout:1/772: read d12/d19/d4f/fb3 [2551278,86529] 0 2024-09-17T04:21:02.134 INFO:tasks.workunit.client.0.smithi088.stdout:4/332: write d5/f23 [362650,41037] 0 2024-09-17T04:21:02.134 INFO:tasks.workunit.client.0.smithi088.stdout:1/327: creat d0/d1/df/d20/d4e/f71 x:0 0 0 2024-09-17T04:21:02.135 INFO:tasks.workunit.client.0.smithi088.stdout:4/333: truncate d5/f4b 975421 0 2024-09-17T04:21:02.138 INFO:tasks.workunit.client.1.smithi134.stdout:0/702: rename d11/d19/d21/d37/l6e to d11/d4c/d76/dba/lf2 0 2024-09-17T04:21:02.139 INFO:tasks.workunit.client.0.smithi088.stdout:1/328: dread d0/d1/df/d20/f62 [0,4194304] 0 2024-09-17T04:21:02.139 INFO:tasks.workunit.client.0.smithi088.stdout:8/265: link d7/c19 d7/d29/c52 0 2024-09-17T04:21:02.141 INFO:tasks.workunit.client.0.smithi088.stdout:4/334: mknod d5/d3f/c6e 0 2024-09-17T04:21:02.143 INFO:tasks.workunit.client.0.smithi088.stdout:1/329: creat d0/d1/df/d20/d4e/d5d/f72 x:0 0 0 2024-09-17T04:21:02.145 INFO:tasks.workunit.client.1.smithi134.stdout:0/703: rename d11/d19/d21/de9 to d11/d18/d97/df3 0 2024-09-17T04:21:02.146 INFO:tasks.workunit.client.0.smithi088.stdout:8/266: mkdir d7/d29/d2a/d53 0 2024-09-17T04:21:02.147 INFO:tasks.workunit.client.0.smithi088.stdout:1/330: dread d0/d13/f60 [0,4194304] 0 2024-09-17T04:21:02.148 INFO:tasks.workunit.client.0.smithi088.stdout:8/267: write d7/f51 [907554,14602] 0 2024-09-17T04:21:02.151 INFO:tasks.workunit.client.1.smithi134.stdout:1/773: rmdir d12/d1c/dc0/dde 0 2024-09-17T04:21:02.151 INFO:tasks.workunit.client.1.smithi134.stdout:1/774: readlink d12/d19/d1d/d3e/l9b 0 2024-09-17T04:21:02.152 INFO:tasks.workunit.client.1.smithi134.stdout:5/703: rmdir d0/da/d69/d41/db6/dc5 0 2024-09-17T04:21:02.153 INFO:tasks.workunit.client.0.smithi088.stdout:4/335: dwrite d5/d3d/d49/f52 [0,4194304] 0 2024-09-17T04:21:02.153 INFO:tasks.workunit.client.1.smithi134.stdout:0/704: dwrite d11/d18/f1f [0,4194304] 0 2024-09-17T04:21:02.154 INFO:tasks.workunit.client.0.smithi088.stdout:4/336: stat d5/d65 0 2024-09-17T04:21:02.155 INFO:tasks.workunit.client.0.smithi088.stdout:8/268: rename d7/ca to d7/d29/d2a/d38/c54 0 2024-09-17T04:21:02.155 INFO:tasks.workunit.client.0.smithi088.stdout:1/331: truncate d0/d1/f61 1184483 0 2024-09-17T04:21:02.156 INFO:tasks.workunit.client.1.smithi134.stdout:5/704: symlink d0/da/d29/db5/le6 0 2024-09-17T04:21:02.158 INFO:tasks.workunit.client.1.smithi134.stdout:5/705: read d0/d3a/d2b/f62 [3838133,103659] 0 2024-09-17T04:21:02.159 INFO:tasks.workunit.client.0.smithi088.stdout:4/337: mknod d5/d3f/c6f 0 2024-09-17T04:21:02.159 INFO:tasks.workunit.client.1.smithi134.stdout:3/821: sync 2024-09-17T04:21:02.160 INFO:tasks.workunit.client.1.smithi134.stdout:3/822: fsync de/d12/d22/f46 0 2024-09-17T04:21:02.161 INFO:tasks.workunit.client.0.smithi088.stdout:1/332: rename d0/d13/f1e to d0/d1/d58/f73 0 2024-09-17T04:21:02.162 INFO:tasks.workunit.client.0.smithi088.stdout:8/269: dwrite d7/f8 [0,4194304] 0 2024-09-17T04:21:02.162 INFO:tasks.workunit.client.0.smithi088.stdout:4/338: fsync d5/d3d/f42 0 2024-09-17T04:21:02.164 INFO:tasks.workunit.client.1.smithi134.stdout:3/823: readlink de/d10/d3d/l7b 0 2024-09-17T04:21:02.165 INFO:tasks.workunit.client.1.smithi134.stdout:3/824: read - de/d12/d15/d1d/d8f/d90/fa8 zero size 2024-09-17T04:21:02.165 INFO:tasks.workunit.client.0.smithi088.stdout:3/261: sync 2024-09-17T04:21:02.165 INFO:tasks.workunit.client.0.smithi088.stdout:0/195: sync 2024-09-17T04:21:02.165 INFO:tasks.workunit.client.0.smithi088.stdout:1/333: chown d0/d1/df/c17 1533 1 2024-09-17T04:21:02.166 INFO:tasks.workunit.client.1.smithi134.stdout:3/825: chown de/d12/f47 36 1 2024-09-17T04:21:02.166 INFO:tasks.workunit.client.1.smithi134.stdout:3/826: chown de/d12/d15/l6d 1 1 2024-09-17T04:21:02.167 INFO:tasks.workunit.client.1.smithi134.stdout:3/827: chown de/d12/d22/f81 135467 1 2024-09-17T04:21:02.179 INFO:tasks.workunit.client.0.smithi088.stdout:3/262: dread d0/f4 [0,4194304] 0 2024-09-17T04:21:02.179 INFO:tasks.workunit.client.0.smithi088.stdout:0/196: dwrite db/f10 [0,4194304] 0 2024-09-17T04:21:02.180 INFO:tasks.workunit.client.0.smithi088.stdout:3/263: write d0/d13/d1b/d29/f2d [5185729,12180] 0 2024-09-17T04:21:02.180 INFO:tasks.workunit.client.0.smithi088.stdout:1/334: mknod d0/d1/d16/d2a/c74 0 2024-09-17T04:21:02.181 INFO:tasks.workunit.client.0.smithi088.stdout:8/270: truncate d7/d29/d2a/f35 337707 0 2024-09-17T04:21:02.185 INFO:tasks.workunit.client.1.smithi134.stdout:5/706: getdents d0/da 0 2024-09-17T04:21:02.186 INFO:tasks.workunit.client.0.smithi088.stdout:1/335: symlink d0/d1/df/d20/d4e/d5d/l75 0 2024-09-17T04:21:02.187 INFO:tasks.workunit.client.0.smithi088.stdout:1/336: chown d0/d1/d16/d35/c48 7548 1 2024-09-17T04:21:02.189 INFO:tasks.workunit.client.1.smithi134.stdout:3/828: rmdir de/d108 0 2024-09-17T04:21:02.190 INFO:tasks.workunit.client.1.smithi134.stdout:3/829: truncate de/d10/ffb 609817 0 2024-09-17T04:21:02.191 INFO:tasks.workunit.client.0.smithi088.stdout:3/264: creat d0/d13/f53 x:0 0 0 2024-09-17T04:21:02.192 INFO:tasks.workunit.client.1.smithi134.stdout:3/830: dread de/d12/d15/d1d/d2d/fb4 [0,4194304] 0 2024-09-17T04:21:02.193 INFO:tasks.workunit.client.0.smithi088.stdout:8/271: truncate d7/d29/f2e 2476297 0 2024-09-17T04:21:02.196 INFO:tasks.workunit.client.0.smithi088.stdout:1/337: dwrite d0/d1/d16/d35/f69 [0,4194304] 0 2024-09-17T04:21:02.198 INFO:tasks.workunit.client.0.smithi088.stdout:8/272: mkdir d7/dd/d31/d47/d55 0 2024-09-17T04:21:02.198 INFO:tasks.workunit.client.0.smithi088.stdout:3/265: truncate d0/d13/d1b/d29/d30/f48 1323842 0 2024-09-17T04:21:02.199 INFO:tasks.workunit.client.0.smithi088.stdout:1/338: creat d0/d1/df/d63/f76 x:0 0 0 2024-09-17T04:21:02.207 INFO:tasks.workunit.client.0.smithi088.stdout:1/339: dwrite d0/d1/df/d20/f49 [0,4194304] 0 2024-09-17T04:21:02.208 INFO:tasks.workunit.client.1.smithi134.stdout:3/831: dread de/d10/f8c [4194304,4194304] 0 2024-09-17T04:21:02.209 INFO:tasks.workunit.client.0.smithi088.stdout:1/340: chown d0/d13/l4c 385 1 2024-09-17T04:21:02.209 INFO:tasks.workunit.client.1.smithi134.stdout:3/832: chown de/d12/d15/d9f/dba 1 1 2024-09-17T04:21:02.210 INFO:tasks.workunit.client.1.smithi134.stdout:3/833: write de/d10/f5f [967392,52298] 0 2024-09-17T04:21:02.212 INFO:tasks.workunit.client.1.smithi134.stdout:2/689: dread d19/d1c/f30 [0,4194304] 0 2024-09-17T04:21:02.212 INFO:tasks.workunit.client.1.smithi134.stdout:2/690: chown d19/d27/la8 1536797 1 2024-09-17T04:21:02.213 INFO:tasks.workunit.client.1.smithi134.stdout:2/691: chown d19/d1c/d47/fd2 1058 1 2024-09-17T04:21:02.214 INFO:tasks.workunit.client.1.smithi134.stdout:3/834: read - de/d12/d15/d1d/d2d/fa5 zero size 2024-09-17T04:21:02.218 INFO:tasks.workunit.client.1.smithi134.stdout:8/649: write d4/d1f/d2b/fac [25820,21633] 0 2024-09-17T04:21:02.218 INFO:tasks.workunit.client.1.smithi134.stdout:3/835: read de/d12/d15/d1d/f62 [3254102,127599] 0 2024-09-17T04:21:02.224 INFO:tasks.workunit.client.1.smithi134.stdout:3/836: creat de/d12/d15/d1d/d2d/d31/d6a/f10e x:0 0 0 2024-09-17T04:21:02.226 INFO:tasks.workunit.client.1.smithi134.stdout:8/650: link d4/d1f/l7c d4/d11/da1/db3/lca 0 2024-09-17T04:21:02.229 INFO:tasks.workunit.client.1.smithi134.stdout:7/588: dwrite d0/d16/d35/d4b/f44 [0,4194304] 0 2024-09-17T04:21:02.230 INFO:tasks.workunit.client.1.smithi134.stdout:8/651: unlink d4/d1e/daf/l8c 0 2024-09-17T04:21:02.232 INFO:tasks.workunit.client.1.smithi134.stdout:8/652: chown d4/d1f/c4c 343991104 1 2024-09-17T04:21:02.235 INFO:tasks.workunit.client.1.smithi134.stdout:7/589: dread d0/dd/d3a/d3d/f78 [0,4194304] 0 2024-09-17T04:21:02.236 INFO:tasks.workunit.client.1.smithi134.stdout:8/653: creat d4/db/dd/da2/fcb x:0 0 0 2024-09-17T04:21:02.238 INFO:tasks.workunit.client.1.smithi134.stdout:1/775: truncate d12/d19/d66/fc6 875734 0 2024-09-17T04:21:02.239 INFO:tasks.workunit.client.1.smithi134.stdout:7/590: dread d0/dd/f58 [0,4194304] 0 2024-09-17T04:21:02.239 INFO:tasks.workunit.client.1.smithi134.stdout:1/776: fdatasync d12/d19/d4f/d101/f104 0 2024-09-17T04:21:02.240 INFO:tasks.workunit.client.1.smithi134.stdout:8/654: write d4/d1f/f33 [872212,67151] 0 2024-09-17T04:21:02.240 INFO:tasks.workunit.client.1.smithi134.stdout:7/591: chown d0/d16/la 0 1 2024-09-17T04:21:02.240 INFO:tasks.workunit.client.1.smithi134.stdout:1/777: stat d12/d19/d5d 0 2024-09-17T04:21:02.241 INFO:tasks.workunit.client.1.smithi134.stdout:8/655: fsync d4/d11/da1/dc7/d13/f73 0 2024-09-17T04:21:02.241 INFO:tasks.workunit.client.1.smithi134.stdout:0/705: truncate d11/d22/f3a 3239140 0 2024-09-17T04:21:02.243 INFO:tasks.workunit.client.1.smithi134.stdout:8/656: write d4/d1f/d25/f75 [936007,97449] 0 2024-09-17T04:21:02.244 INFO:tasks.workunit.client.1.smithi134.stdout:8/657: truncate d4/d1f/f97 4888331 0 2024-09-17T04:21:02.245 INFO:tasks.workunit.client.1.smithi134.stdout:8/658: stat d4/d1f/d2b/fac 0 2024-09-17T04:21:02.245 INFO:tasks.workunit.client.1.smithi134.stdout:0/706: mkdir d11/d48/dd2/df4 0 2024-09-17T04:21:02.246 INFO:tasks.workunit.client.1.smithi134.stdout:8/659: chown d4/d11/da1/dc7/d5e/f9e 11170039 1 2024-09-17T04:21:02.247 INFO:tasks.workunit.client.1.smithi134.stdout:8/660: write d4/db/dd/f2e [6056016,89031] 0 2024-09-17T04:21:02.247 INFO:tasks.workunit.client.0.smithi088.stdout:8/273: read d7/d29/d2a/f35 [129319,34278] 0 2024-09-17T04:21:02.249 INFO:tasks.workunit.client.0.smithi088.stdout:8/274: chown d7/d29 209517453 1 2024-09-17T04:21:02.250 INFO:tasks.workunit.client.1.smithi134.stdout:0/707: rmdir d11/d4c/d76 39 2024-09-17T04:21:02.250 INFO:tasks.workunit.client.1.smithi134.stdout:6/821: sync 2024-09-17T04:21:02.250 INFO:tasks.workunit.client.0.smithi088.stdout:4/339: truncate d5/d3f/f41 6016 0 2024-09-17T04:21:02.253 INFO:tasks.workunit.client.0.smithi088.stdout:0/197: dwrite db/d1a/f40 [0,4194304] 0 2024-09-17T04:21:02.255 INFO:tasks.workunit.client.1.smithi134.stdout:7/592: rmdir d0/d16/d8b/d6a/d70/d85/db6 0 2024-09-17T04:21:02.258 INFO:tasks.workunit.client.0.smithi088.stdout:8/275: creat d7/dd/f56 x:0 0 0 2024-09-17T04:21:02.259 INFO:tasks.workunit.client.0.smithi088.stdout:8/276: chown d7/f24 128560534 1 2024-09-17T04:21:02.260 INFO:tasks.workunit.client.1.smithi134.stdout:8/661: rename d4/db/d6e to d4/d1f/d2b/dbf/dcc 0 2024-09-17T04:21:02.262 INFO:tasks.workunit.client.0.smithi088.stdout:0/198: dwrite db/d1a/f35 [0,4194304] 0 2024-09-17T04:21:02.263 INFO:tasks.workunit.client.1.smithi134.stdout:7/593: fsync d0/dd/d3a/d3d/d4c/f7a 0 2024-09-17T04:21:02.264 INFO:tasks.workunit.client.1.smithi134.stdout:7/594: stat d0/d16/d35/d4b/d65/l66 0 2024-09-17T04:21:02.267 INFO:tasks.workunit.client.1.smithi134.stdout:6/822: rename de/d19/d1f/d55/d77/db8 to de/d19/d1f/d55/d77/d89/d109 0 2024-09-17T04:21:02.268 INFO:tasks.workunit.client.1.smithi134.stdout:6/823: write de/d19/d62/d34/f3c [2676631,94076] 0 2024-09-17T04:21:02.270 INFO:tasks.workunit.client.1.smithi134.stdout:8/662: creat d4/d1f/d25/d6a/fcd x:0 0 0 2024-09-17T04:21:02.271 INFO:tasks.workunit.client.0.smithi088.stdout:3/266: truncate d0/d13/d1b/d29/d2b/f47 171058 0 2024-09-17T04:21:02.272 INFO:tasks.workunit.client.0.smithi088.stdout:1/341: write d0/d13/f44 [4306000,47948] 0 2024-09-17T04:21:02.272 INFO:tasks.workunit.client.1.smithi134.stdout:0/708: read - d11/d4c/dd3/d81/fe0 zero size 2024-09-17T04:21:02.277 INFO:tasks.workunit.client.0.smithi088.stdout:8/277: getdents d7/d29/d2a/d3a 0 2024-09-17T04:21:02.279 INFO:tasks.workunit.client.0.smithi088.stdout:4/340: rename d5/f21 to d5/f70 0 2024-09-17T04:21:02.280 INFO:tasks.workunit.client.1.smithi134.stdout:8/663: creat d4/d11/da1/db3/fce x:0 0 0 2024-09-17T04:21:02.281 INFO:tasks.workunit.client.1.smithi134.stdout:3/837: dwrite f6 [4194304,4194304] 0 2024-09-17T04:21:02.282 INFO:tasks.workunit.client.1.smithi134.stdout:1/778: fsync d12/d19/d5d/d88/fbf 0 2024-09-17T04:21:02.283 INFO:tasks.workunit.client.0.smithi088.stdout:0/199: creat db/d1b/d36/f43 x:0 0 0 2024-09-17T04:21:02.285 INFO:tasks.workunit.client.1.smithi134.stdout:0/709: symlink d11/d18/d97/df3/d9a/lf5 0 2024-09-17T04:21:02.286 INFO:tasks.workunit.client.0.smithi088.stdout:1/342: rmdir d0/d1/df/d20/d4e 39 2024-09-17T04:21:02.287 INFO:tasks.workunit.client.0.smithi088.stdout:1/343: truncate d0/d1/fa 5777347 0 2024-09-17T04:21:02.287 INFO:tasks.workunit.client.1.smithi134.stdout:7/595: truncate d0/d16/d35/d4b/d65/f89 2627362 0 2024-09-17T04:21:02.289 INFO:tasks.workunit.client.0.smithi088.stdout:8/278: fsync f2 0 2024-09-17T04:21:02.294 INFO:tasks.workunit.client.1.smithi134.stdout:3/838: fsync de/d12/f47 0 2024-09-17T04:21:02.296 INFO:tasks.workunit.client.1.smithi134.stdout:4/766: sync 2024-09-17T04:21:02.296 INFO:tasks.workunit.client.0.smithi088.stdout:3/267: mkdir d0/d54 0 2024-09-17T04:21:02.297 INFO:tasks.workunit.client.1.smithi134.stdout:4/767: truncate d0/df/fd7 545861 0 2024-09-17T04:21:02.300 INFO:tasks.workunit.client.1.smithi134.stdout:1/779: symlink d12/d1c/d56/l107 0 2024-09-17T04:21:02.300 INFO:tasks.workunit.client.1.smithi134.stdout:1/780: stat d12/d1c/d4a 0 2024-09-17T04:21:02.301 INFO:tasks.workunit.client.0.smithi088.stdout:1/344: dread - d0/d1/df/d20/d4e/d5d/f72 zero size 2024-09-17T04:21:02.301 INFO:tasks.workunit.client.1.smithi134.stdout:1/781: fsync d12/d19/d5d/d91/dac/fba 0 2024-09-17T04:21:02.302 INFO:tasks.workunit.client.0.smithi088.stdout:0/200: dread db/f1d [0,4194304] 0 2024-09-17T04:21:02.304 INFO:tasks.workunit.client.1.smithi134.stdout:7/596: creat d0/d16/d8b/d6a/fba x:0 0 0 2024-09-17T04:21:02.305 INFO:tasks.workunit.client.1.smithi134.stdout:1/782: dwrite d12/d19/d4f/fb3 [0,4194304] 0 2024-09-17T04:21:02.306 INFO:tasks.workunit.client.0.smithi088.stdout:4/341: mkdir d5/d3f/d71 0 2024-09-17T04:21:02.312 INFO:tasks.workunit.client.1.smithi134.stdout:1/783: dwrite d12/d36/fae [0,4194304] 0 2024-09-17T04:21:02.313 INFO:tasks.workunit.client.1.smithi134.stdout:1/784: write d12/db2/fc1 [1805019,89397] 0 2024-09-17T04:21:02.321 INFO:tasks.workunit.client.0.smithi088.stdout:3/268: mkdir d0/d54/d55 0 2024-09-17T04:21:02.321 INFO:tasks.workunit.client.0.smithi088.stdout:3/269: readlink d0/d13/d1b/d29/l44 0 2024-09-17T04:21:02.323 INFO:tasks.workunit.client.0.smithi088.stdout:1/345: mkdir d0/d1/d16/d77 0 2024-09-17T04:21:02.323 INFO:tasks.workunit.client.1.smithi134.stdout:6/824: getdents de/d19/d21/d2d/d92 0 2024-09-17T04:21:02.324 INFO:tasks.workunit.client.0.smithi088.stdout:1/346: write d0/d1/fa [4873379,95045] 0 2024-09-17T04:21:02.327 INFO:tasks.workunit.client.1.smithi134.stdout:8/664: creat d4/fcf x:0 0 0 2024-09-17T04:21:02.328 INFO:tasks.workunit.client.0.smithi088.stdout:2/321: sync 2024-09-17T04:21:02.329 INFO:tasks.workunit.client.1.smithi134.stdout:6/825: dwrite de/d19/f22 [0,4194304] 0 2024-09-17T04:21:02.330 INFO:tasks.workunit.client.0.smithi088.stdout:0/201: mknod db/d3c/c44 0 2024-09-17T04:21:02.330 INFO:tasks.workunit.client.1.smithi134.stdout:6/826: fdatasync de/d19/d21/f64 0 2024-09-17T04:21:02.330 INFO:tasks.workunit.client.0.smithi088.stdout:3/270: dwrite d0/d13/d1b/d29/d2b/f3f [0,4194304] 0 2024-09-17T04:21:02.332 INFO:tasks.workunit.client.1.smithi134.stdout:6/827: fsync de/d19/d21/d2d/d4c/f83 0 2024-09-17T04:21:02.333 INFO:tasks.workunit.client.0.smithi088.stdout:1/347: dread d0/d1/df/d20/d4e/d5d/f6d [0,4194304] 0 2024-09-17T04:21:02.333 INFO:tasks.workunit.client.1.smithi134.stdout:6/828: stat de/d19/f22 0 2024-09-17T04:21:02.336 INFO:tasks.workunit.client.1.smithi134.stdout:1/785: mknod d12/d19/d5d/d91/dac/dd5/c108 0 2024-09-17T04:21:02.336 INFO:tasks.workunit.client.1.smithi134.stdout:8/665: dwrite d4/d1e/daf/f4b [0,4194304] 0 2024-09-17T04:21:02.337 INFO:tasks.workunit.client.1.smithi134.stdout:6/829: write de/d19/d21/d2d/f3e [1687375,63138] 0 2024-09-17T04:21:02.337 INFO:tasks.workunit.client.0.smithi088.stdout:8/279: mkdir d7/dd/d31/d47/d55/d57 0 2024-09-17T04:21:02.340 INFO:tasks.workunit.client.1.smithi134.stdout:8/666: dread - d4/d11/da1/dc7/fc6 zero size 2024-09-17T04:21:02.340 INFO:tasks.workunit.client.1.smithi134.stdout:8/667: chown d4/d11/da1/dc7/d5e 6406 1 2024-09-17T04:21:02.343 INFO:tasks.workunit.client.1.smithi134.stdout:0/710: rename d11/d19/d21/d37/f42 to d11/d18/d97/df3/ff6 0 2024-09-17T04:21:02.343 INFO:tasks.workunit.client.0.smithi088.stdout:1/348: dwrite d0/d1/d16/d35/f69 [4194304,4194304] 0 2024-09-17T04:21:02.348 INFO:tasks.workunit.client.1.smithi134.stdout:7/597: mkdir d0/dd/dbb 0 2024-09-17T04:21:02.351 INFO:tasks.workunit.client.0.smithi088.stdout:8/280: dwrite d7/f8 [4194304,4194304] 0 2024-09-17T04:21:02.351 INFO:tasks.workunit.client.0.smithi088.stdout:4/342: dwrite f1 [0,4194304] 0 2024-09-17T04:21:02.355 INFO:tasks.workunit.client.0.smithi088.stdout:1/349: dread d0/f4 [0,4194304] 0 2024-09-17T04:21:02.359 INFO:tasks.workunit.client.1.smithi134.stdout:4/768: creat d0/d13/d40/ffe x:0 0 0 2024-09-17T04:21:02.362 INFO:tasks.workunit.client.1.smithi134.stdout:6/830: truncate fd 2865899 0 2024-09-17T04:21:02.362 INFO:tasks.workunit.client.0.smithi088.stdout:3/271: mkdir d0/d13/d1b/d29/d56 0 2024-09-17T04:21:02.363 INFO:tasks.workunit.client.0.smithi088.stdout:0/202: truncate db/f11 1751993 0 2024-09-17T04:21:02.364 INFO:tasks.workunit.client.1.smithi134.stdout:1/786: mkdir d12/d19/d1d/d61/dd3/dda/d109 0 2024-09-17T04:21:02.365 INFO:tasks.workunit.client.0.smithi088.stdout:8/281: creat d7/dd/d31/f58 x:0 0 0 2024-09-17T04:21:02.369 INFO:tasks.workunit.client.1.smithi134.stdout:8/668: symlink d4/db/dd/d43/ld0 0 2024-09-17T04:21:02.370 INFO:tasks.workunit.client.1.smithi134.stdout:0/711: stat d11/d4c/dd3/c7c 0 2024-09-17T04:21:02.373 INFO:tasks.workunit.client.1.smithi134.stdout:4/769: rename d0/d13/d40/d42/d92/d7b/dc9/dfd to d0/d13/d40/d42/d92/d65/dff 0 2024-09-17T04:21:02.374 INFO:tasks.workunit.client.0.smithi088.stdout:8/282: dwrite d7/dd/d31/f36 [0,4194304] 0 2024-09-17T04:21:02.376 INFO:tasks.workunit.client.1.smithi134.stdout:0/712: dwrite d11/d24/d49/d9b/fcd [0,4194304] 0 2024-09-17T04:21:02.377 INFO:tasks.workunit.client.1.smithi134.stdout:5/707: sync 2024-09-17T04:21:02.377 INFO:tasks.workunit.client.1.smithi134.stdout:2/692: sync 2024-09-17T04:21:02.386 INFO:tasks.workunit.client.1.smithi134.stdout:5/708: dread d0/da/d2c/f4c [0,4194304] 0 2024-09-17T04:21:02.396 INFO:tasks.workunit.client.1.smithi134.stdout:1/787: dread d12/d1c/f34 [0,4194304] 0 2024-09-17T04:21:02.396 INFO:tasks.workunit.client.0.smithi088.stdout:1/350: link d0/d13/f68 d0/d1/df/d20/d4e/d5d/f78 0 2024-09-17T04:21:02.398 INFO:tasks.workunit.client.1.smithi134.stdout:0/713: truncate d11/d19/d21/f5f 1753942 0 2024-09-17T04:21:02.398 INFO:tasks.workunit.client.1.smithi134.stdout:0/714: read d11/d18/f1f [83606,15675] 0 2024-09-17T04:21:02.401 INFO:tasks.workunit.client.0.smithi088.stdout:0/203: dread db/f19 [0,4194304] 0 2024-09-17T04:21:02.402 INFO:tasks.workunit.client.1.smithi134.stdout:7/598: creat d0/d16/fbc x:0 0 0 2024-09-17T04:21:02.402 INFO:tasks.workunit.client.1.smithi134.stdout:6/831: dread de/d19/d1f/dae/fbf [0,4194304] 0 2024-09-17T04:21:02.406 INFO:tasks.workunit.client.0.smithi088.stdout:4/343: mkdir d5/d72 0 2024-09-17T04:21:02.407 INFO:tasks.workunit.client.1.smithi134.stdout:1/788: fdatasync d12/d19/d1d/d3e/f48 0 2024-09-17T04:21:02.411 INFO:tasks.workunit.client.0.smithi088.stdout:1/351: chown d0/d1/df/d20/c57 10234 1 2024-09-17T04:21:02.411 INFO:tasks.workunit.client.1.smithi134.stdout:0/715: chown d11/d6f/ce3 2182 1 2024-09-17T04:21:02.414 INFO:tasks.workunit.client.1.smithi134.stdout:7/599: symlink d0/dd/d3a/d3d/lbd 0 2024-09-17T04:21:02.415 INFO:tasks.workunit.client.1.smithi134.stdout:4/770: dread d0/df/fd8 [0,4194304] 0 2024-09-17T04:21:02.416 INFO:tasks.workunit.client.1.smithi134.stdout:6/832: mknod de/d19/d74/d94/d9e/c10a 0 2024-09-17T04:21:02.416 INFO:tasks.workunit.client.1.smithi134.stdout:4/771: write d0/df/d1e/fef [337147,69687] 0 2024-09-17T04:21:02.417 INFO:tasks.workunit.client.0.smithi088.stdout:8/283: symlink d7/d29/d2a/l59 0 2024-09-17T04:21:02.423 INFO:tasks.workunit.client.1.smithi134.stdout:8/669: truncate d4/db/f20 4974171 0 2024-09-17T04:21:02.425 INFO:tasks.workunit.client.1.smithi134.stdout:7/600: dread d0/f6 [0,4194304] 0 2024-09-17T04:21:02.425 INFO:tasks.workunit.client.1.smithi134.stdout:0/716: rename d11/d24/d49/d9b to d11/d24/d49/d62/df7 0 2024-09-17T04:21:02.427 INFO:tasks.workunit.client.1.smithi134.stdout:5/709: creat d0/da/d29/d78/da5/fe7 x:0 0 0 2024-09-17T04:21:02.428 INFO:tasks.workunit.client.0.smithi088.stdout:1/352: link d0/d1/df/f10 d0/d1/d16/d2a/f79 0 2024-09-17T04:21:02.429 INFO:tasks.workunit.client.1.smithi134.stdout:8/670: dwrite d4/d1e/f9b [0,4194304] 0 2024-09-17T04:21:02.429 INFO:tasks.workunit.client.1.smithi134.stdout:5/710: truncate d0/da/d29/d78/fd4 35924 0 2024-09-17T04:21:02.429 INFO:tasks.workunit.client.1.smithi134.stdout:8/671: stat d4/c3e 0 2024-09-17T04:21:02.431 INFO:tasks.workunit.client.1.smithi134.stdout:4/772: truncate d0/d13/d40/d42/d92/d86/faf 326425 0 2024-09-17T04:21:02.433 INFO:tasks.workunit.client.1.smithi134.stdout:1/789: link d12/fa3 d12/d19/d1d/d61/dd3/dda/f10a 0 2024-09-17T04:21:02.433 INFO:tasks.workunit.client.0.smithi088.stdout:8/284: mknod d7/dd/c5a 0 2024-09-17T04:21:02.435 INFO:tasks.workunit.client.0.smithi088.stdout:8/285: truncate d7/dd/d31/f58 918892 0 2024-09-17T04:21:02.435 INFO:tasks.workunit.client.0.smithi088.stdout:3/272: truncate d0/d13/d1b/d29/d30/f39 2069505 0 2024-09-17T04:21:02.437 INFO:tasks.workunit.client.1.smithi134.stdout:8/672: dwrite d4/db/f2d [0,4194304] 0 2024-09-17T04:21:02.437 INFO:tasks.workunit.client.1.smithi134.stdout:6/833: rename de/d19/d1f/d55/f82 to de/d2b/f10b 0 2024-09-17T04:21:02.438 INFO:tasks.workunit.client.1.smithi134.stdout:8/673: fdatasync d4/d11/d5f/fb5 0 2024-09-17T04:21:02.438 INFO:tasks.workunit.client.0.smithi088.stdout:4/344: getdents d5/d32 0 2024-09-17T04:21:02.439 INFO:tasks.workunit.client.1.smithi134.stdout:1/790: read d12/db2/fb6 [590869,125170] 0 2024-09-17T04:21:02.439 INFO:tasks.workunit.client.0.smithi088.stdout:4/345: truncate d5/d3d/d49/d5e/f61 116113 0 2024-09-17T04:21:02.443 INFO:tasks.workunit.client.0.smithi088.stdout:1/353: mknod d0/d1/d16/c7a 0 2024-09-17T04:21:02.444 INFO:tasks.workunit.client.1.smithi134.stdout:3/839: sync 2024-09-17T04:21:02.445 INFO:tasks.workunit.client.0.smithi088.stdout:3/273: fsync d0/d13/f28 0 2024-09-17T04:21:02.449 INFO:tasks.workunit.client.0.smithi088.stdout:0/204: truncate db/d1b/f2b 382449 0 2024-09-17T04:21:02.451 INFO:tasks.workunit.client.0.smithi088.stdout:0/205: read db/f19 [3248720,98930] 0 2024-09-17T04:21:02.453 INFO:tasks.workunit.client.1.smithi134.stdout:4/773: truncate d0/df/d1e/f5e 3045747 0 2024-09-17T04:21:02.454 INFO:tasks.workunit.client.0.smithi088.stdout:8/286: dwrite d7/d29/f12 [8388608,4194304] 0 2024-09-17T04:21:02.454 INFO:tasks.workunit.client.1.smithi134.stdout:4/774: chown d0/d13/d40/d42/l55 367501 1 2024-09-17T04:21:02.456 INFO:tasks.workunit.client.1.smithi134.stdout:6/834: mkdir de/d19/d74/d94/d9b/d10c 0 2024-09-17T04:21:02.457 INFO:tasks.workunit.client.1.smithi134.stdout:6/835: fdatasync f9 0 2024-09-17T04:21:02.459 INFO:tasks.workunit.client.0.smithi088.stdout:4/346: mkdir d5/d3d/d73 0 2024-09-17T04:21:02.459 INFO:tasks.workunit.client.0.smithi088.stdout:0/206: dread db/d1a/f35 [0,4194304] 0 2024-09-17T04:21:02.461 INFO:tasks.workunit.client.1.smithi134.stdout:6/836: dread de/d19/d62/d34/f3c [0,4194304] 0 2024-09-17T04:21:02.462 INFO:tasks.workunit.client.0.smithi088.stdout:1/354: mknod d0/d1/c7b 0 2024-09-17T04:21:02.462 INFO:tasks.workunit.client.1.smithi134.stdout:6/837: read de/d2b/fa0 [128464,47887] 0 2024-09-17T04:21:02.462 INFO:tasks.workunit.client.0.smithi088.stdout:4/347: write d5/d3d/f42 [274739,31346] 0 2024-09-17T04:21:02.463 INFO:tasks.workunit.client.0.smithi088.stdout:3/274: dwrite d0/f12 [0,4194304] 0 2024-09-17T04:21:02.465 INFO:tasks.workunit.client.1.smithi134.stdout:8/674: write d4/db/dd/d43/da5/fc1 [575449,20715] 0 2024-09-17T04:21:02.466 INFO:tasks.workunit.client.0.smithi088.stdout:8/287: truncate d7/d29/d2a/d38/d42/f4e 1204766 0 2024-09-17T04:21:02.469 INFO:tasks.workunit.client.1.smithi134.stdout:8/675: dread d4/db/dd/f30 [0,4194304] 0 2024-09-17T04:21:02.470 INFO:tasks.workunit.client.0.smithi088.stdout:0/207: symlink db/d1b/d39/l45 0 2024-09-17T04:21:02.472 INFO:tasks.workunit.client.1.smithi134.stdout:3/840: creat de/d12/d15/d1d/d8f/f10f x:0 0 0 2024-09-17T04:21:02.473 INFO:tasks.workunit.client.1.smithi134.stdout:0/717: write d11/d18/d97/df3/f55 [870327,65812] 0 2024-09-17T04:21:02.475 INFO:tasks.workunit.client.0.smithi088.stdout:8/288: dwrite d7/dd/d31/f58 [0,4194304] 0 2024-09-17T04:21:02.478 INFO:tasks.workunit.client.0.smithi088.stdout:3/275: truncate d0/d13/d1b/f27 331726 0 2024-09-17T04:21:02.478 INFO:tasks.workunit.client.1.smithi134.stdout:4/775: chown d0/d13/d40/d72 4025776 1 2024-09-17T04:21:02.482 INFO:tasks.workunit.client.0.smithi088.stdout:0/208: dwrite db/d1b/d39/f3a [4194304,4194304] 0 2024-09-17T04:21:02.485 INFO:tasks.workunit.client.1.smithi134.stdout:6/838: dread de/d19/d21/f64 [0,4194304] 0 2024-09-17T04:21:02.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.486+0000 7fa6598fd640 1 -- 172.21.15.88:0/367138171 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fa634005880 con 0x7fa654101a80 2024-09-17T04:21:02.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.487+0000 7fa6588fb640 1 -- 172.21.15.88:0/367138171 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) ==== 76+0+2045 (secure 0 0 0) 0x7fa63c087130 con 0x7fa654101a80 2024-09-17T04:21:02.487 INFO:tasks.workunit.client.1.smithi134.stdout:6/839: write de/d19/d1f/d55/d77/d89/d109/dc7/ddc/db3/db4/dd7/ffe [740033,47635] 0 2024-09-17T04:21:02.487 INFO:teuthology.orchestra.run.smithi088.stdout:e15 2024-09-17T04:21:02.487 INFO:teuthology.orchestra.run.smithi088.stdout:btime 2024-09-17T04:18:27:750910+0000 2024-09-17T04:21:02.488 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T04:21:02.488 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:21:02.488 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2024-09-17T04:21:02.488 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:21:02.488 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2024-09-17T04:21:02.488 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2024-09-17T04:21:02.488 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 15 2024-09-17T04:21:02.488 INFO:teuthology.orchestra.run.smithi088.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T04:21:02.488 INFO:teuthology.orchestra.run.smithi088.stdout:created 2024-09-17T04:18:10.480573+0000 2024-09-17T04:21:02.488 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2024-09-17T04:18:27.750896+0000 2024-09-17T04:21:02.488 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2024-09-17T04:21:02.488 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2024-09-17T04:21:02.488 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2024-09-17T04:21:02.489 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2024-09-17T04:21:02.489 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2024-09-17T04:21:02.489 INFO:teuthology.orchestra.run.smithi088.stdout:max_xattr_size 65536 2024-09-17T04:21:02.489 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2024-09-17T04:21:02.489 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2024-09-17T04:21:02.489 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 45 2024-09-17T04:21:02.489 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:21:02.489 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 1 2024-09-17T04:21:02.489 INFO:teuthology.orchestra.run.smithi088.stdout:in 0 2024-09-17T04:21:02.489 INFO:teuthology.orchestra.run.smithi088.stdout:up {0=14590} 2024-09-17T04:21:02.489 INFO:teuthology.orchestra.run.smithi088.stdout:failed 2024-09-17T04:21:02.489 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2024-09-17T04:21:02.489 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2024-09-17T04:21:02.489 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2024-09-17T04:21:02.490 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2024-09-17T04:21:02.490 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data enabled 2024-09-17T04:21:02.490 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2024-09-17T04:21:02.490 INFO:teuthology.orchestra.run.smithi088.stdout:bal_rank_mask -1 2024-09-17T04:21:02.490 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 1 2024-09-17T04:21:02.490 INFO:teuthology.orchestra.run.smithi088.stdout:qdb_cluster leader: 14590 members: 14590 2024-09-17T04:21:02.490 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.giqrgt{0:14590} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.88:6828/1714846518,v1:172.21.15.88:6829/1714846518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:21:02.490 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi134.psnynp{0:24321} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.134:6826/2137586894,v1:172.21.15.134:6827/2137586894] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:21:02.490 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:21:02.491 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:21:02.491 INFO:teuthology.orchestra.run.smithi088.stdout:Standby daemons: 2024-09-17T04:21:02.491 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:21:02.491 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi134.ktuhce{-1:24325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/967997022,v1:172.21.15.134:6825/967997022] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:21:02.491 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.lgavsv{-1:24329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/1425146180,v1:172.21.15.88:6827/1425146180] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:21:02.491 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 15 2024-09-17T04:21:02.491 INFO:tasks.workunit.client.0.smithi088.stdout:4/348: creat d5/d72/f74 x:0 0 0 2024-09-17T04:21:02.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.490+0000 7fa6598fd640 1 -- 172.21.15.88:0/367138171 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7fa640074e60 msgr2=0x7fa640077320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:02.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.490+0000 7fa6598fd640 1 --2- 172.21.15.88:0/367138171 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7fa640074e60 0x7fa640077320 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa644005fd0 tx=0x7fa64400b4a0 comp rx=0 tx=0).stop 2024-09-17T04:21:02.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.490+0000 7fa6598fd640 1 -- 172.21.15.88:0/367138171 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa654101a80 msgr2=0x7fa65406e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:02.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.490+0000 7fa6598fd640 1 --2- 172.21.15.88:0/367138171 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa654101a80 0x7fa65406e8a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa63c02aa90 tx=0x7fa63c0046c0 comp rx=0 tx=0).stop 2024-09-17T04:21:02.492 INFO:tasks.workunit.client.0.smithi088.stdout:4/349: read d5/d3d/f42 [72916,51595] 0 2024-09-17T04:21:02.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.491+0000 7fa6598fd640 1 -- 172.21.15.88:0/367138171 shutdown_connections 2024-09-17T04:21:02.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.491+0000 7fa6598fd640 1 --2- 172.21.15.88:0/367138171 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7fa640074e60 0x7fa640077320 secure :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa644005fd0 tx=0x7fa64400b4a0 comp rx=0 tx=0).stop 2024-09-17T04:21:02.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.491+0000 7fa6598fd640 1 --2- 172.21.15.88:0/367138171 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa654101a80 0x7fa65406e8a0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:02.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.491+0000 7fa6598fd640 1 --2- 172.21.15.88:0/367138171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa654100880 0x7fa65406e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:02.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.491+0000 7fa6598fd640 1 -- 172.21.15.88:0/367138171 >> 172.21.15.88:0/367138171 conn(0x7fa6540fc010 msgr2=0x7fa654104f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:21:02.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.491+0000 7fa6598fd640 1 -- 172.21.15.88:0/367138171 shutdown_connections 2024-09-17T04:21:02.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.491+0000 7fa6598fd640 1 -- 172.21.15.88:0/367138171 wait complete. 2024-09-17T04:21:02.494 INFO:tasks.workunit.client.0.smithi088.stdout:8/289: write d7/dd/f1a [4716574,9986] 0 2024-09-17T04:21:02.495 INFO:tasks.workunit.client.0.smithi088.stdout:3/276: rmdir d0/d13/d1b/d29/d2b/d40 39 2024-09-17T04:21:02.497 INFO:tasks.workunit.client.0.smithi088.stdout:3/277: chown d0/f33 0 1 2024-09-17T04:21:02.498 INFO:tasks.workunit.client.0.smithi088.stdout:0/209: symlink db/d1a/d20/d28/l46 0 2024-09-17T04:21:02.500 INFO:tasks.workunit.client.0.smithi088.stdout:3/278: write d0/d13/f17 [4683751,118794] 0 2024-09-17T04:21:02.501 INFO:tasks.workunit.client.1.smithi134.stdout:3/841: symlink de/d12/d15/d1d/d2d/d31/d6a/d78/l110 0 2024-09-17T04:21:02.503 INFO:tasks.workunit.client.0.smithi088.stdout:8/290: dwrite d7/f8 [8388608,4194304] 0 2024-09-17T04:21:02.503 INFO:tasks.workunit.client.0.smithi088.stdout:3/279: chown d0/d13/d1b/d29/d30/d3c/f51 142035785 1 2024-09-17T04:21:02.505 INFO:tasks.workunit.client.1.smithi134.stdout:2/693: sync 2024-09-17T04:21:02.510 INFO:tasks.workunit.client.1.smithi134.stdout:0/718: rename d11/d18/f5e to d11/d24/d49/d62/daf/ded/ff8 0 2024-09-17T04:21:02.511 INFO:tasks.workunit.client.1.smithi134.stdout:7/601: getdents d0/d16/d8b 0 2024-09-17T04:21:02.514 INFO:tasks.workunit.client.1.smithi134.stdout:6/840: creat de/d19/d1f/d55/d77/d89/d109/dc7/ddc/db3/db4/dd7/f10d x:0 0 0 2024-09-17T04:21:02.515 INFO:tasks.workunit.client.1.smithi134.stdout:6/841: chown de/f2c 243258 1 2024-09-17T04:21:02.516 INFO:tasks.workunit.client.1.smithi134.stdout:2/694: dwrite d19/f1a [4194304,4194304] 0 2024-09-17T04:21:02.517 INFO:tasks.workunit.client.1.smithi134.stdout:2/695: readlink d19/d27/d31/d34/l40 0 2024-09-17T04:21:02.518 INFO:tasks.workunit.client.1.smithi134.stdout:2/696: chown d19/d27/d31/d49/d6f/d84/d98/dc2 0 1 2024-09-17T04:21:02.520 INFO:tasks.workunit.client.0.smithi088.stdout:4/350: truncate d5/f1f 957971 0 2024-09-17T04:21:02.521 INFO:tasks.workunit.client.0.smithi088.stdout:0/210: rename db/d1a/d20/d28 to db/d1b/d36/d47 0 2024-09-17T04:21:02.522 INFO:tasks.workunit.client.0.smithi088.stdout:8/291: stat d7/l11 0 2024-09-17T04:21:02.522 INFO:tasks.workunit.client.0.smithi088.stdout:0/211: readlink db/d1a/l24 0 2024-09-17T04:21:02.523 INFO:tasks.workunit.client.1.smithi134.stdout:5/711: getdents d0/d3a/d2b/d61/d7b 0 2024-09-17T04:21:02.528 INFO:tasks.workunit.client.1.smithi134.stdout:7/602: dread d0/d16/d35/d4b/f48 [0,4194304] 0 2024-09-17T04:21:02.529 INFO:tasks.workunit.client.0.smithi088.stdout:0/212: dwrite db/f2a [0,4194304] 0 2024-09-17T04:21:02.529 INFO:tasks.workunit.client.1.smithi134.stdout:3/842: mknod de/d12/d15/d1d/d2d/d31/d6a/d78/d7c/c111 0 2024-09-17T04:21:02.532 INFO:tasks.workunit.client.0.smithi088.stdout:4/351: mkdir d5/d65/d75 0 2024-09-17T04:21:02.535 INFO:tasks.workunit.client.0.smithi088.stdout:3/280: rename d0/f10 to d0/d13/d1b/d29/d30/d35/f57 0 2024-09-17T04:21:02.536 INFO:tasks.workunit.client.1.smithi134.stdout:1/791: sync 2024-09-17T04:21:02.537 INFO:tasks.workunit.client.1.smithi134.stdout:1/792: write d12/f90 [7571594,16486] 0 2024-09-17T04:21:02.543 INFO:tasks.workunit.client.0.smithi088.stdout:0/213: truncate db/f1c 276913 0 2024-09-17T04:21:02.546 INFO:tasks.workunit.client.0.smithi088.stdout:8/292: creat d7/d29/d2a/d38/d42/f5b x:0 0 0 2024-09-17T04:21:02.548 INFO:tasks.workunit.client.0.smithi088.stdout:4/352: mknod d5/d65/d75/c76 0 2024-09-17T04:21:02.549 INFO:tasks.workunit.client.0.smithi088.stdout:4/353: write d5/d3d/d49/f52 [1376858,18943] 0 2024-09-17T04:21:02.550 INFO:tasks.workunit.client.0.smithi088.stdout:3/281: mkdir d0/d13/d58 0 2024-09-17T04:21:02.551 INFO:tasks.workunit.client.0.smithi088.stdout:3/282: fdatasync d0/fb 0 2024-09-17T04:21:02.552 INFO:tasks.workunit.client.0.smithi088.stdout:3/283: stat d0/d13/d4d 0 2024-09-17T04:21:02.554 INFO:tasks.workunit.client.0.smithi088.stdout:8/293: dwrite d7/d29/d2a/f33 [0,4194304] 0 2024-09-17T04:21:02.554 INFO:tasks.workunit.client.0.smithi088.stdout:3/284: stat d0/d13/d1b/d29/d2b/f3f 0 2024-09-17T04:21:02.557 INFO:tasks.workunit.client.0.smithi088.stdout:4/354: stat d5/f2d 0 2024-09-17T04:21:02.557 INFO:tasks.workunit.client.0.smithi088.stdout:0/214: creat db/d1a/f48 x:0 0 0 2024-09-17T04:21:02.558 INFO:tasks.workunit.client.0.smithi088.stdout:4/355: chown f1 0 1 2024-09-17T04:21:02.563 INFO:tasks.workunit.client.0.smithi088.stdout:3/285: rmdir d0/d13/d1b/d29/d30 39 2024-09-17T04:21:02.569 INFO:tasks.workunit.client.0.smithi088.stdout:0/215: creat db/d1b/d36/d47/d37/f49 x:0 0 0 2024-09-17T04:21:02.588 INFO:tasks.workunit.client.0.smithi088.stdout:3/286: getdents d0 0 2024-09-17T04:21:02.590 INFO:tasks.workunit.client.0.smithi088.stdout:8/294: write d7/f9 [1442541,82709] 0 2024-09-17T04:21:02.591 INFO:tasks.workunit.client.0.smithi088.stdout:8/295: dread - d7/d29/d2a/d38/d3d/f49 zero size 2024-09-17T04:21:02.593 INFO:tasks.workunit.client.0.smithi088.stdout:3/287: chown d0/d13/d1b/d29/d30/c37 1786710 1 2024-09-17T04:21:02.593 INFO:tasks.workunit.client.0.smithi088.stdout:3/288: chown d0/fb 6133 1 2024-09-17T04:21:02.594 INFO:tasks.workunit.client.0.smithi088.stdout:3/289: fsync d0/f12 0 2024-09-17T04:21:02.595 INFO:tasks.workunit.client.0.smithi088.stdout:3/290: chown d0/d13/d4d 28395971 1 2024-09-17T04:21:02.595 INFO:tasks.workunit.client.0.smithi088.stdout:0/216: getdents db/d1b/d36/d47/d37 0 2024-09-17T04:21:02.595 INFO:tasks.workunit.client.0.smithi088.stdout:3/291: stat d0/lf 0 2024-09-17T04:21:02.601 INFO:tasks.workunit.client.1.smithi134.stdout:0/719: fdatasync d11/d48/fa1 0 2024-09-17T04:21:02.605 INFO:tasks.workunit.client.0.smithi088.stdout:4/356: dwrite d5/fb [0,4194304] 0 2024-09-17T04:21:02.610 INFO:tasks.workunit.client.0.smithi088.stdout:3/292: mknod d0/d54/d55/c59 0 2024-09-17T04:21:02.612 INFO:tasks.workunit.client.0.smithi088.stdout:8/296: dread d7/dd/f28 [0,4194304] 0 2024-09-17T04:21:02.613 INFO:tasks.workunit.client.0.smithi088.stdout:4/357: rename d5/d3d/d49/d5e/c5f to d5/d65/d68/c77 0 2024-09-17T04:21:02.615 INFO:tasks.workunit.client.1.smithi134.stdout:3/843: write de/d12/d15/d1d/f8b [2495327,103684] 0 2024-09-17T04:21:02.618 INFO:tasks.workunit.client.1.smithi134.stdout:1/793: symlink d12/d19/d1d/d61/dd3/dda/d85/l10b 0 2024-09-17T04:21:02.622 INFO:tasks.workunit.client.0.smithi088.stdout:4/358: unlink d5/d3d/d49/d5e/f69 0 2024-09-17T04:21:02.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.623+0000 7f40b5f89640 1 -- 172.21.15.88:0/3112966407 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40b01024d0 msgr2=0x7f40b01048c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:02.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.623+0000 7f40b5f89640 1 --2- 172.21.15.88:0/3112966407 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40b01024d0 0x7f40b01048c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f40a0009880 tx=0x7f40a002e8c0 comp rx=0 tx=0).stop 2024-09-17T04:21:02.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.623+0000 7f40b5f89640 1 -- 172.21.15.88:0/3112966407 shutdown_connections 2024-09-17T04:21:02.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.623+0000 7f40b5f89640 1 --2- 172.21.15.88:0/3112966407 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40b0104e00 0x7f40b01071f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:02.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.623+0000 7f40b5f89640 1 --2- 172.21.15.88:0/3112966407 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40b01024d0 0x7f40b01048c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:02.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.623+0000 7f40b5f89640 1 -- 172.21.15.88:0/3112966407 >> 172.21.15.88:0/3112966407 conn(0x7f40b00fc010 msgr2=0x7f40b00fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:21:02.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.623+0000 7f40b5f89640 1 -- 172.21.15.88:0/3112966407 shutdown_connections 2024-09-17T04:21:02.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.623+0000 7f40b5f89640 1 -- 172.21.15.88:0/3112966407 wait complete. 2024-09-17T04:21:02.624 INFO:tasks.workunit.client.0.smithi088.stdout:0/217: getdents db/d1b/d39 0 2024-09-17T04:21:02.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.624+0000 7f40b5f89640 1 Processor -- start 2024-09-17T04:21:02.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.624+0000 7f40b5f89640 1 -- start start 2024-09-17T04:21:02.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.624+0000 7f40b5f89640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40b01024d0 0x7f40b0195350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:21:02.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.624+0000 7f40b5f89640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40b0104e00 0x7f40b0195890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:21:02.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.624+0000 7f40b5f89640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f40b01085b0 con 0x7f40b01024d0 2024-09-17T04:21:02.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.624+0000 7f40b5f89640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f40b0108430 con 0x7f40b0104e00 2024-09-17T04:21:02.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.624+0000 7f40af7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40b01024d0 0x7f40b0195350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:21:02.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.625+0000 7f40af7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40b01024d0 0x7f40b0195350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50660/0 (socket says 172.21.15.88:50660) 2024-09-17T04:21:02.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.625+0000 7f40af7fe640 1 -- 172.21.15.88:0/2979626512 learned_addr learned my addr 172.21.15.88:0/2979626512 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:21:02.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.625+0000 7f40aeffd640 1 --2- 172.21.15.88:0/2979626512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40b0104e00 0x7f40b0195890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:21:02.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.625+0000 7f40af7fe640 1 -- 172.21.15.88:0/2979626512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40b0104e00 msgr2=0x7f40b0195890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:02.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.625+0000 7f40af7fe640 1 --2- 172.21.15.88:0/2979626512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40b0104e00 0x7f40b0195890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:02.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.625+0000 7f40af7fe640 1 -- 172.21.15.88:0/2979626512 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40b0195f10 con 0x7f40b01024d0 2024-09-17T04:21:02.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.625+0000 7f40af7fe640 1 --2- 172.21.15.88:0/2979626512 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40b01024d0 0x7f40b0195350 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f40a00099a0 tx=0x7f40a0035ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:21:02.627 INFO:tasks.workunit.client.1.smithi134.stdout:0/720: mknod d11/d18/d97/df3/d43/d5d/cf9 0 2024-09-17T04:21:02.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.626+0000 7f40acff9640 1 -- 172.21.15.88:0/2979626512 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f40a0044070 con 0x7f40b01024d0 2024-09-17T04:21:02.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.626+0000 7f40acff9640 1 -- 172.21.15.88:0/2979626512 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f40a0005000 con 0x7f40b01024d0 2024-09-17T04:21:02.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.626+0000 7f40acff9640 1 -- 172.21.15.88:0/2979626512 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f40a0003940 con 0x7f40b01024d0 2024-09-17T04:21:02.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.626+0000 7f40b5f89640 1 -- 172.21.15.88:0/2979626512 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40b019a950 con 0x7f40b01024d0 2024-09-17T04:21:02.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.626+0000 7f40b5f89640 1 -- 172.21.15.88:0/2979626512 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40b019ae20 con 0x7f40b01024d0 2024-09-17T04:21:02.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.628+0000 7f40b5f89640 1 -- 172.21.15.88:0/2979626512 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40b01028b0 con 0x7f40b01024d0 2024-09-17T04:21:02.628 INFO:tasks.workunit.client.1.smithi134.stdout:6/842: dwrite de/d19/d21/d2d/f6a [0,4194304] 0 2024-09-17T04:21:02.628 INFO:tasks.workunit.client.1.smithi134.stdout:7/603: write d0/dd/d3a/d3d/f56 [3447992,84886] 0 2024-09-17T04:21:02.629 INFO:tasks.workunit.client.1.smithi134.stdout:6/843: stat de/d19/d1f/l27 0 2024-09-17T04:21:02.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.629+0000 7f40acff9640 1 -- 172.21.15.88:0/2979626512 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f40a003c070 con 0x7f40b01024d0 2024-09-17T04:21:02.629 INFO:tasks.workunit.client.0.smithi088.stdout:8/297: fsync d7/d29/d2a/f35 0 2024-09-17T04:21:02.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.629+0000 7f40acff9640 1 --2- 172.21.15.88:0/2979626512 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f4098074a80 0x7f4098076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:21:02.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.630+0000 7f40acff9640 1 -- 172.21.15.88:0/2979626512 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f40a003a020 con 0x7f40b01024d0 2024-09-17T04:21:02.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.630+0000 7f40aeffd640 1 --2- 172.21.15.88:0/2979626512 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f4098074a80 0x7f4098076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:21:02.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.633+0000 7f40aeffd640 1 --2- 172.21.15.88:0/2979626512 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f4098074a80 0x7f4098076f40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f40b0196800 tx=0x7f40a4005f90 comp rx=0 tx=0).ready entity=mgr.24431 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:21:02.633 INFO:tasks.workunit.client.1.smithi134.stdout:8/676: getdents d4/d11/da1/dc7/d13 0 2024-09-17T04:21:02.634 INFO:tasks.workunit.client.0.smithi088.stdout:4/359: symlink d5/d3d/d49/l78 0 2024-09-17T04:21:02.634 INFO:tasks.workunit.client.1.smithi134.stdout:6/844: dread de/d2b/f50 [0,4194304] 0 2024-09-17T04:21:02.635 INFO:tasks.workunit.client.1.smithi134.stdout:4/776: getdents d0/d13/d40/d72 0 2024-09-17T04:21:02.635 INFO:tasks.workunit.client.0.smithi088.stdout:4/360: write d5/d3d/d49/d5e/f61 [743540,74497] 0 2024-09-17T04:21:02.636 INFO:tasks.workunit.client.1.smithi134.stdout:5/712: dread d0/f3c [0,4194304] 0 2024-09-17T04:21:02.637 INFO:tasks.workunit.client.1.smithi134.stdout:7/604: readlink d0/dd/d3a/d3d/l5e 0 2024-09-17T04:21:02.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.638+0000 7f40acff9640 1 -- 172.21.15.88:0/2979626512 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f40a0086d90 con 0x7f40b01024d0 2024-09-17T04:21:02.640 INFO:tasks.workunit.client.0.smithi088.stdout:3/293: write d0/d13/d1b/d29/d30/f39 [963120,122694] 0 2024-09-17T04:21:02.641 INFO:tasks.workunit.client.1.smithi134.stdout:0/721: dwrite d11/d18/d97/df3/ff6 [4194304,4194304] 0 2024-09-17T04:21:02.642 INFO:tasks.workunit.client.0.smithi088.stdout:8/298: getdents d7/dd/d31 0 2024-09-17T04:21:02.643 INFO:tasks.workunit.client.1.smithi134.stdout:2/697: write d19/d27/f5b [2470376,89067] 0 2024-09-17T04:21:02.645 INFO:tasks.workunit.client.0.smithi088.stdout:8/299: creat d7/d29/f5c x:0 0 0 2024-09-17T04:21:02.646 INFO:tasks.workunit.client.1.smithi134.stdout:1/794: dread d12/d19/f54 [0,4194304] 0 2024-09-17T04:21:02.647 INFO:tasks.workunit.client.0.smithi088.stdout:3/294: mkdir d0/d13/d58/d5a 0 2024-09-17T04:21:02.648 INFO:tasks.workunit.client.1.smithi134.stdout:1/795: dread d12/d19/d1d/d61/dd3/dda/f10a [0,4194304] 0 2024-09-17T04:21:02.652 INFO:tasks.workunit.client.0.smithi088.stdout:8/300: symlink d7/dd/l5d 0 2024-09-17T04:21:02.653 INFO:tasks.workunit.client.0.smithi088.stdout:3/295: dwrite d0/fb [0,4194304] 0 2024-09-17T04:21:02.654 INFO:tasks.workunit.client.1.smithi134.stdout:8/677: mkdir d4/d11/da1/dd1 0 2024-09-17T04:21:02.654 INFO:tasks.workunit.client.1.smithi134.stdout:8/678: readlink d4/d1f/d25/d6a/l91 0 2024-09-17T04:21:02.655 INFO:tasks.workunit.client.1.smithi134.stdout:2/698: truncate f11 9354969 0 2024-09-17T04:21:02.655 INFO:tasks.workunit.client.1.smithi134.stdout:2/699: dread - d19/fe6 zero size 2024-09-17T04:21:02.656 INFO:tasks.workunit.client.0.smithi088.stdout:8/301: mknod d7/d29/d2a/d38/c5e 0 2024-09-17T04:21:02.660 INFO:tasks.workunit.client.0.smithi088.stdout:8/302: mknod d7/dd/c5f 0 2024-09-17T04:21:02.663 INFO:tasks.workunit.client.1.smithi134.stdout:1/796: write d12/d19/d1d/d3e/fa6 [715157,123338] 0 2024-09-17T04:21:02.664 INFO:tasks.workunit.client.1.smithi134.stdout:1/797: chown d12/d19/d1d/d61/f77 134330413 1 2024-09-17T04:21:02.664 INFO:tasks.workunit.client.1.smithi134.stdout:8/679: mknod d4/d11/da1/dc7/d5e/cd2 0 2024-09-17T04:21:02.664 INFO:tasks.workunit.client.1.smithi134.stdout:8/680: chown d4/d1f/f97 53086 1 2024-09-17T04:21:02.666 INFO:tasks.workunit.client.1.smithi134.stdout:2/700: creat d19/d27/d31/d49/d6f/da9/db0/daa/fe7 x:0 0 0 2024-09-17T04:21:02.670 INFO:tasks.workunit.client.1.smithi134.stdout:8/681: dwrite d4/d11/da1/dc7/d13/f73 [8388608,4194304] 0 2024-09-17T04:21:02.670 INFO:tasks.workunit.client.0.smithi088.stdout:8/303: fsync d7/d29/f2e 0 2024-09-17T04:21:02.671 INFO:tasks.workunit.client.1.smithi134.stdout:8/682: stat d4/db/dd/d43/d8b/d8e/fba 0 2024-09-17T04:21:02.676 INFO:tasks.workunit.client.1.smithi134.stdout:4/777: write d0/f22 [69511,129592] 0 2024-09-17T04:21:02.678 INFO:tasks.workunit.client.1.smithi134.stdout:2/701: unlink d19/d1c/f52 0 2024-09-17T04:21:02.678 INFO:tasks.workunit.client.1.smithi134.stdout:0/722: dwrite d11/d24/f58 [0,4194304] 0 2024-09-17T04:21:02.679 INFO:tasks.workunit.client.0.smithi088.stdout:6/302: sync 2024-09-17T04:21:02.679 INFO:tasks.workunit.client.0.smithi088.stdout:8/304: creat d7/dd/d31/d47/d55/d57/f60 x:0 0 0 2024-09-17T04:21:02.681 INFO:tasks.workunit.client.1.smithi134.stdout:6/845: getdents de/d19/d1f/dae 0 2024-09-17T04:21:02.681 INFO:tasks.workunit.client.1.smithi134.stdout:5/713: link d0/d48/f4f d0/da/d29/d7c/fe8 0 2024-09-17T04:21:02.683 INFO:tasks.workunit.client.0.smithi088.stdout:3/296: dwrite d0/d13/d1b/f27 [0,4194304] 0 2024-09-17T04:21:02.683 INFO:tasks.workunit.client.0.smithi088.stdout:6/303: dread d14/d44/d45/d6b/d29/f5f [0,4194304] 0 2024-09-17T04:21:02.683 INFO:tasks.workunit.client.1.smithi134.stdout:6/846: write de/d19/d21/d2d/f6a [3578017,130428] 0 2024-09-17T04:21:02.686 INFO:tasks.workunit.client.1.smithi134.stdout:1/798: mknod d12/c10c 0 2024-09-17T04:21:02.687 INFO:tasks.workunit.client.1.smithi134.stdout:1/799: chown d12/d19/d1d/d61/da0/da4/fd9 3793637 1 2024-09-17T04:21:02.693 INFO:tasks.workunit.client.1.smithi134.stdout:1/800: dwrite d12/d1c/d2e/f5a [0,4194304] 0 2024-09-17T04:21:02.694 INFO:tasks.workunit.client.0.smithi088.stdout:6/304: creat d14/d44/d45/d6b/d29/d3e/f73 x:0 0 0 2024-09-17T04:21:02.696 INFO:tasks.workunit.client.0.smithi088.stdout:6/305: write d14/d2f/f36 [252576,94899] 0 2024-09-17T04:21:02.699 INFO:tasks.workunit.client.1.smithi134.stdout:5/714: mknod d0/d3a/d2b/d61/ce9 0 2024-09-17T04:21:02.703 INFO:tasks.workunit.client.0.smithi088.stdout:3/297: rename d0/fb to d0/d13/d1b/d29/f5b 0 2024-09-17T04:21:02.704 INFO:tasks.workunit.client.0.smithi088.stdout:6/306: dwrite d14/d44/f5d [0,4194304] 0 2024-09-17T04:21:02.711 INFO:tasks.workunit.client.1.smithi134.stdout:6/847: dread fb [0,4194304] 0 2024-09-17T04:21:02.713 INFO:tasks.workunit.client.1.smithi134.stdout:3/844: sync 2024-09-17T04:21:02.718 INFO:tasks.workunit.client.1.smithi134.stdout:3/845: dwrite de/d12/d15/d9f/dba/dc4/dca/d10b/f109 [0,4194304] 0 2024-09-17T04:21:02.719 INFO:tasks.workunit.client.1.smithi134.stdout:3/846: stat de/d10/d70 0 2024-09-17T04:21:02.736 INFO:tasks.workunit.client.1.smithi134.stdout:1/801: creat d12/d19/d1d/d61/f10d x:0 0 0 2024-09-17T04:21:02.736 INFO:tasks.workunit.client.0.smithi088.stdout:8/305: write d7/d29/d2a/f35 [1522595,57507] 0 2024-09-17T04:21:02.739 INFO:tasks.workunit.client.0.smithi088.stdout:6/307: fsync d14/d44/d45/d6b/d29/d3e/f6f 0 2024-09-17T04:21:02.740 INFO:tasks.workunit.client.1.smithi134.stdout:4/778: write d0/df/fd8 [4133040,62966] 0 2024-09-17T04:21:02.780 INFO:tasks.workunit.client.1.smithi134.stdout:7/605: sync 2024-09-17T04:21:02.781 INFO:tasks.workunit.client.1.smithi134.stdout:7/606: dread - d0/d16/d8b/d6a/d70/d85/fa4 zero size 2024-09-17T04:21:02.847 INFO:tasks.workunit.client.1.smithi134.stdout:6/848: sync 2024-09-17T04:21:02.848 INFO:tasks.workunit.client.1.smithi134.stdout:6/849: chown de/d19/d1f/f28 40264 1 2024-09-17T04:21:02.870 INFO:tasks.workunit.client.0.smithi088.stdout:8/306: creat d7/dd/d31/d47/d55/f61 x:0 0 0 2024-09-17T04:21:02.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.871+0000 7f40b5f89640 1 -- 172.21.15.88:0/2979626512 --> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f40b019b0e0 con 0x7f4098074a80 2024-09-17T04:21:02.871 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:02 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/2078759023' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T04:21:02.871 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:02 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/367138171' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T04:21:02.872 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:02 smithi088 ceph-mon[27811]: pgmap v22: 65 pgs: 65 active+clean; 2.2 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 78 MiB/s rd, 323 MiB/s wr, 552 op/s 2024-09-17T04:21:02.872 INFO:tasks.workunit.client.1.smithi134.stdout:8/683: rename d4/db/dd/f5b to d4/d11/da1/fd3 0 2024-09-17T04:21:02.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.873+0000 7f40acff9640 1 -- 172.21.15.88:0/2979626512 <== mgr.24431 v2:172.21.15.134:6828/1122341233 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+318 (secure 0 0 0) 0x7f40b019b0e0 con 0x7f4098074a80 2024-09-17T04:21:02.873 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-17T04:21:02.873 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f", 2024-09-17T04:21:02.873 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-09-17T04:21:02.873 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T04:21:02.873 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [], 2024-09-17T04:21:02.873 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "1/23 daemons upgraded", 2024-09-17T04:21:02.873 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "", 2024-09-17T04:21:02.873 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-09-17T04:21:02.873 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-17T04:21:02.874 INFO:tasks.workunit.client.0.smithi088.stdout:8/307: fsync d7/dd/f28 0 2024-09-17T04:21:02.874 INFO:tasks.workunit.client.1.smithi134.stdout:5/715: rmdir d0/d3a/d6b 39 2024-09-17T04:21:02.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.876+0000 7f40b5f89640 1 -- 172.21.15.88:0/2979626512 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f4098074a80 msgr2=0x7f4098076f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:02.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.876+0000 7f40b5f89640 1 --2- 172.21.15.88:0/2979626512 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f4098074a80 0x7f4098076f40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f40b0196800 tx=0x7f40a4005f90 comp rx=0 tx=0).stop 2024-09-17T04:21:02.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.876+0000 7f40b5f89640 1 -- 172.21.15.88:0/2979626512 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40b01024d0 msgr2=0x7f40b0195350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:02.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.876+0000 7f40b5f89640 1 --2- 172.21.15.88:0/2979626512 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40b01024d0 0x7f40b0195350 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f40a00099a0 tx=0x7f40a0035ae0 comp rx=0 tx=0).stop 2024-09-17T04:21:02.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.876+0000 7f40b5f89640 1 -- 172.21.15.88:0/2979626512 shutdown_connections 2024-09-17T04:21:02.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.876+0000 7f40b5f89640 1 --2- 172.21.15.88:0/2979626512 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f4098074a80 0x7f4098076f40 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:02.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.876+0000 7f40b5f89640 1 --2- 172.21.15.88:0/2979626512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40b0104e00 0x7f40b0195890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:02.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.876+0000 7f40b5f89640 1 --2- 172.21.15.88:0/2979626512 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40b01024d0 0x7f40b0195350 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:02.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.876+0000 7f40b5f89640 1 -- 172.21.15.88:0/2979626512 >> 172.21.15.88:0/2979626512 conn(0x7f40b00fc010 msgr2=0x7f40b00fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:21:02.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.876+0000 7f40b5f89640 1 -- 172.21.15.88:0/2979626512 shutdown_connections 2024-09-17T04:21:02.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:02.876+0000 7f40b5f89640 1 -- 172.21.15.88:0/2979626512 wait complete. 2024-09-17T04:21:02.881 INFO:tasks.workunit.client.1.smithi134.stdout:3/847: truncate de/d12/d15/d1d/d2d/f53 702202 0 2024-09-17T04:21:02.882 INFO:tasks.workunit.client.0.smithi088.stdout:8/308: mkdir d7/dd/d62 0 2024-09-17T04:21:02.884 INFO:tasks.workunit.client.1.smithi134.stdout:1/802: creat d12/d19/d1d/d3e/f10e x:0 0 0 2024-09-17T04:21:02.885 INFO:tasks.workunit.client.0.smithi088.stdout:3/298: dwrite d0/f1a [0,4194304] 0 2024-09-17T04:21:02.887 INFO:tasks.workunit.client.1.smithi134.stdout:0/723: link d11/d22/l95 d11/d19/d21/d37/lfa 0 2024-09-17T04:21:02.887 INFO:tasks.workunit.client.0.smithi088.stdout:6/308: write d14/d44/d45/d6b/d2a/f49 [298724,115863] 0 2024-09-17T04:21:02.888 INFO:tasks.workunit.client.0.smithi088.stdout:8/309: mkdir d7/d29/d2a/d38/d3d/d63 0 2024-09-17T04:21:02.889 INFO:tasks.workunit.client.0.smithi088.stdout:8/310: chown d7/d29/d2a 2 1 2024-09-17T04:21:02.889 INFO:tasks.workunit.client.1.smithi134.stdout:4/779: fdatasync d0/df/d1e/d73/f8f 0 2024-09-17T04:21:02.893 INFO:tasks.workunit.client.0.smithi088.stdout:6/309: dread d14/d44/f5d [0,4194304] 0 2024-09-17T04:21:02.894 INFO:tasks.workunit.client.1.smithi134.stdout:6/850: rmdir de/d19/d62/d34/d8e 39 2024-09-17T04:21:02.894 INFO:tasks.workunit.client.1.smithi134.stdout:2/702: link d19/d27/d31/d34/ld6 d19/d27/d31/d49/d6f/d84/d98/dc2/le8 0 2024-09-17T04:21:02.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:02 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/2078759023' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T04:21:02.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:02 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/367138171' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T04:21:02.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:02 smithi134 ceph-mon[35201]: pgmap v22: 65 pgs: 65 active+clean; 2.2 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 78 MiB/s rd, 323 MiB/s wr, 552 op/s 2024-09-17T04:21:02.897 INFO:tasks.workunit.client.1.smithi134.stdout:8/684: creat d4/db/dd/da2/fd4 x:0 0 0 2024-09-17T04:21:02.899 INFO:tasks.workunit.client.1.smithi134.stdout:7/607: dwrite d0/dd/d3a/d3d/d38/d60/f84 [0,4194304] 0 2024-09-17T04:21:02.899 INFO:tasks.workunit.client.1.smithi134.stdout:8/685: write d4/db/f2d [4392868,108650] 0 2024-09-17T04:21:02.899 INFO:tasks.workunit.client.0.smithi088.stdout:8/311: symlink d7/d29/d2a/l64 0 2024-09-17T04:21:02.901 INFO:tasks.workunit.client.1.smithi134.stdout:8/686: fdatasync d4/d11/da1/dc7/d13/f73 0 2024-09-17T04:21:02.902 INFO:tasks.workunit.client.1.smithi134.stdout:3/848: creat de/d12/d15/d9f/df7/f112 x:0 0 0 2024-09-17T04:21:02.902 INFO:tasks.workunit.client.0.smithi088.stdout:6/310: creat d14/d44/d45/d6b/d16/f74 x:0 0 0 2024-09-17T04:21:02.902 INFO:tasks.workunit.client.1.smithi134.stdout:2/703: dread d19/d1c/f30 [0,4194304] 0 2024-09-17T04:21:02.904 INFO:tasks.workunit.client.1.smithi134.stdout:1/803: creat d12/d19/d5d/d91/dac/dd5/f10f x:0 0 0 2024-09-17T04:21:02.905 INFO:tasks.workunit.client.0.smithi088.stdout:6/311: truncate d14/d44/d45/d6b/d2a/f50 22861 0 2024-09-17T04:21:02.905 INFO:tasks.workunit.client.1.smithi134.stdout:1/804: chown d12/d19/d1d/d3e/f10e 16 1 2024-09-17T04:21:02.909 INFO:tasks.workunit.client.1.smithi134.stdout:1/805: dwrite d12/d1c/d2e/d7d/f97 [0,4194304] 0 2024-09-17T04:21:02.910 INFO:tasks.workunit.client.1.smithi134.stdout:6/851: creat de/d19/d1f/dae/f10e x:0 0 0 2024-09-17T04:21:02.911 INFO:tasks.workunit.client.1.smithi134.stdout:6/852: stat de/d19/d62/d34 0 2024-09-17T04:21:02.912 INFO:tasks.workunit.client.0.smithi088.stdout:6/312: dwrite d14/d44/d45/d6b/d16/f2e [0,4194304] 0 2024-09-17T04:21:02.916 INFO:tasks.workunit.client.1.smithi134.stdout:2/704: mkdir d19/d27/de9 0 2024-09-17T04:21:02.916 INFO:tasks.workunit.client.1.smithi134.stdout:8/687: creat d4/db/dd/d72/fd5 x:0 0 0 2024-09-17T04:21:02.918 INFO:tasks.workunit.client.1.smithi134.stdout:8/688: write d4/d11/da1/dc7/d13/f61 [2090695,87367] 0 2024-09-17T04:21:02.921 INFO:tasks.workunit.client.1.smithi134.stdout:0/724: mknod d11/d18/d97/df3/cfb 0 2024-09-17T04:21:02.924 INFO:tasks.workunit.client.1.smithi134.stdout:0/725: write d11/d24/d49/d62/df7/fcd [2521212,18664] 0 2024-09-17T04:21:02.924 INFO:tasks.workunit.client.0.smithi088.stdout:6/313: creat d14/d44/d45/d6b/d29/d72/f75 x:0 0 0 2024-09-17T04:21:02.926 INFO:tasks.workunit.client.1.smithi134.stdout:8/689: dwrite d4/d1f/d25/d6a/f85 [0,4194304] 0 2024-09-17T04:21:02.928 INFO:tasks.workunit.client.0.smithi088.stdout:3/299: truncate d0/d13/d1b/f27 3930221 0 2024-09-17T04:21:02.929 INFO:tasks.workunit.client.1.smithi134.stdout:6/853: unlink de/d19/d62/d34/d3b/fd5 0 2024-09-17T04:21:02.931 INFO:tasks.workunit.client.0.smithi088.stdout:8/312: dread f2 [4194304,4194304] 0 2024-09-17T04:21:02.932 INFO:tasks.workunit.client.0.smithi088.stdout:6/314: dwrite d14/d44/d45/d6b/d29/d3e/f37 [0,4194304] 0 2024-09-17T04:21:02.935 INFO:tasks.workunit.client.0.smithi088.stdout:3/300: mkdir d0/d13/d1b/d29/d30/d3c/d5c 0 2024-09-17T04:21:02.935 INFO:tasks.workunit.client.1.smithi134.stdout:5/716: write d0/f2a [1350511,52111] 0 2024-09-17T04:21:02.938 INFO:tasks.workunit.client.0.smithi088.stdout:6/315: creat d14/d44/f76 x:0 0 0 2024-09-17T04:21:02.940 INFO:tasks.workunit.client.1.smithi134.stdout:3/849: write de/d12/d15/f4d [893676,114082] 0 2024-09-17T04:21:02.941 INFO:tasks.workunit.client.0.smithi088.stdout:3/301: symlink d0/d13/d1b/l5d 0 2024-09-17T04:21:02.946 INFO:tasks.workunit.client.0.smithi088.stdout:8/313: rename d7/d29/d2a/d3a/l4d to d7/d29/d2a/l65 0 2024-09-17T04:21:02.947 INFO:tasks.workunit.client.1.smithi134.stdout:8/690: rmdir d4/d1e/daf 39 2024-09-17T04:21:02.950 INFO:tasks.workunit.client.0.smithi088.stdout:6/316: rename d14/d44/d45/d6b/c46 to d14/d44/d45/d6b/d29/d72/c77 0 2024-09-17T04:21:02.953 INFO:tasks.workunit.client.0.smithi088.stdout:6/317: write d14/d44/d45/d6b/d16/f62 [43450,53106] 0 2024-09-17T04:21:02.954 INFO:tasks.workunit.client.1.smithi134.stdout:2/705: creat d19/d1c/d92/ddc/dc6/dbc/de3/fea x:0 0 0 2024-09-17T04:21:02.955 INFO:tasks.workunit.client.0.smithi088.stdout:3/302: truncate d0/f16 2339498 0 2024-09-17T04:21:02.956 INFO:tasks.workunit.client.1.smithi134.stdout:5/717: unlink d0/da/l14 0 2024-09-17T04:21:02.959 INFO:tasks.workunit.client.0.smithi088.stdout:8/314: dread f6 [0,4194304] 0 2024-09-17T04:21:02.960 INFO:tasks.workunit.client.1.smithi134.stdout:3/850: creat de/d10/d70/f113 x:0 0 0 2024-09-17T04:21:02.961 INFO:tasks.workunit.client.1.smithi134.stdout:3/851: write de/d12/d15/d1d/d8f/f10f [459986,94920] 0 2024-09-17T04:21:02.961 INFO:tasks.workunit.client.1.smithi134.stdout:7/608: truncate d0/f1b 3309298 0 2024-09-17T04:21:02.961 INFO:tasks.workunit.client.1.smithi134.stdout:3/852: write f6 [5657374,125426] 0 2024-09-17T04:21:02.964 INFO:tasks.workunit.client.1.smithi134.stdout:4/780: getdents d0/d13/d40/d42/d92 0 2024-09-17T04:21:02.965 INFO:tasks.workunit.client.1.smithi134.stdout:7/609: dread d0/f6 [0,4194304] 0 2024-09-17T04:21:02.965 INFO:tasks.workunit.client.0.smithi088.stdout:3/303: unlink d0/d13/d1b/d29/d2b/f34 0 2024-09-17T04:21:02.967 INFO:tasks.workunit.client.0.smithi088.stdout:8/315: symlink d7/dd/d31/d47/d55/l66 0 2024-09-17T04:21:02.970 INFO:tasks.workunit.client.1.smithi134.stdout:2/706: truncate d19/d1c/f87 1255812 0 2024-09-17T04:21:02.972 INFO:tasks.workunit.client.1.smithi134.stdout:1/806: truncate d12/d1c/d2e/f3b 1646014 0 2024-09-17T04:21:02.975 INFO:tasks.workunit.client.1.smithi134.stdout:4/781: symlink d0/df/d35/d5c/l100 0 2024-09-17T04:21:02.976 INFO:tasks.workunit.client.1.smithi134.stdout:7/610: rmdir d0/dd/d3a/d3d 39 2024-09-17T04:21:02.976 INFO:tasks.workunit.client.1.smithi134.stdout:7/611: chown d0/d16/d8b/l7d 6327 1 2024-09-17T04:21:02.980 INFO:tasks.workunit.client.1.smithi134.stdout:4/782: dwrite d0/d3b/f52 [0,4194304] 0 2024-09-17T04:21:02.980 INFO:tasks.workunit.client.1.smithi134.stdout:6/854: creat de/d19/d62/f10f x:0 0 0 2024-09-17T04:21:02.983 INFO:tasks.workunit.client.1.smithi134.stdout:4/783: fsync d0/d13/d40/d42/d92/d65/dc2/ffb 0 2024-09-17T04:21:02.983 INFO:tasks.workunit.client.1.smithi134.stdout:1/807: mkdir d12/d19/d5d/d88/d110 0 2024-09-17T04:21:02.984 INFO:tasks.workunit.client.1.smithi134.stdout:4/784: write d0/d13/d40/d42/d92/fcf [918643,38729] 0 2024-09-17T04:21:02.984 INFO:tasks.workunit.client.1.smithi134.stdout:1/808: chown d12/d1c/d2e 2 1 2024-09-17T04:21:02.987 INFO:tasks.workunit.client.1.smithi134.stdout:0/726: getdents d11/d24/d49 0 2024-09-17T04:21:02.987 INFO:tasks.workunit.client.0.smithi088.stdout:8/316: write d7/dd/d31/f4c [540423,120355] 0 2024-09-17T04:21:02.988 INFO:tasks.workunit.client.0.smithi088.stdout:8/317: chown d7 5 1 2024-09-17T04:21:02.990 INFO:tasks.workunit.client.0.smithi088.stdout:3/304: readlink d0/l32 0 2024-09-17T04:21:02.990 INFO:tasks.workunit.client.1.smithi134.stdout:7/612: write d0/dd/d3a/d3d/d38/f18 [4134445,118755] 0 2024-09-17T04:21:02.990 INFO:tasks.workunit.client.0.smithi088.stdout:6/318: write d14/d44/d45/d6b/d16/f30 [349948,20903] 0 2024-09-17T04:21:02.991 INFO:tasks.workunit.client.1.smithi134.stdout:7/613: chown d0/d16/l31 44314 1 2024-09-17T04:21:02.993 INFO:tasks.workunit.client.1.smithi134.stdout:8/691: rmdir d4/d11/da1/dd1 0 2024-09-17T04:21:02.994 INFO:tasks.workunit.client.0.smithi088.stdout:8/318: dread d7/dd/f1a [0,4194304] 0 2024-09-17T04:21:02.994 INFO:tasks.workunit.client.0.smithi088.stdout:8/319: fdatasync d7/dd/f56 0 2024-09-17T04:21:03.002 INFO:tasks.workunit.client.0.smithi088.stdout:3/305: mkdir d0/d13/d58/d5e 0 2024-09-17T04:21:03.004 INFO:tasks.workunit.client.0.smithi088.stdout:6/319: dread d14/d44/d45/d6b/d16/f6e [0,4194304] 0 2024-09-17T04:21:03.004 INFO:tasks.workunit.client.1.smithi134.stdout:4/785: symlink d0/d13/d40/d42/d92/d65/dc2/l101 0 2024-09-17T04:21:03.005 INFO:tasks.workunit.client.0.smithi088.stdout:8/320: fsync d7/f24 0 2024-09-17T04:21:03.006 INFO:tasks.workunit.client.0.smithi088.stdout:6/320: chown d14/d44/d45/d6b/d2a/f5a 29 1 2024-09-17T04:21:03.007 INFO:tasks.workunit.client.1.smithi134.stdout:0/727: rmdir d11/d18/d97/df3/d9a 39 2024-09-17T04:21:03.007 INFO:tasks.workunit.client.1.smithi134.stdout:0/728: chown d11/d19/cb5 208668 1 2024-09-17T04:21:03.010 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:03.010+0000 7f926ec0c640 1 -- 172.21.15.88:0/1162030586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f926810c5a0 msgr2=0x7f926810c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:03.010 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:03.010+0000 7f926ec0c640 1 --2- 172.21.15.88:0/1162030586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f926810c5a0 0x7f926810c9a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9258009880 tx=0x7f925802a4a0 comp rx=0 tx=0).stop 2024-09-17T04:21:03.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:03.010+0000 7f926ec0c640 1 -- 172.21.15.88:0/1162030586 shutdown_connections 2024-09-17T04:21:03.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:03.010+0000 7f926ec0c640 1 --2- 172.21.15.88:0/1162030586 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f926810d510 0x7f926810d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:03.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:03.011+0000 7f926ec0c640 1 --2- 172.21.15.88:0/1162030586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f926810c5a0 0x7f926810c9a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:03.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:03.011+0000 7f926ec0c640 1 -- 172.21.15.88:0/1162030586 >> 172.21.15.88:0/1162030586 conn(0x7f926806bdd0 msgr2=0x7f926806c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:21:03.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:03.011+0000 7f926ec0c640 1 -- 172.21.15.88:0/1162030586 shutdown_connections 2024-09-17T04:21:03.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:03.011+0000 7f926ec0c640 1 -- 172.21.15.88:0/1162030586 wait complete. 2024-09-17T04:21:03.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:03.012+0000 7f926ec0c640 1 Processor -- start 2024-09-17T04:21:03.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:03.012+0000 7f926ec0c640 1 -- start start 2024-09-17T04:21:03.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:03.012+0000 7f926ec0c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f926810c5a0 0x7f92681a1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:21:03.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:03.012+0000 7f926ec0c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f926810d510 0x7f92681a2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:21:03.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:03.013+0000 7f926c9a8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f926810c5a0 0x7f92681a1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:21:03.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:03.013+0000 7f926c9a8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f926810c5a0 0x7f92681a1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.88:36246/0 (socket says 172.21.15.88:36246) 2024-09-17T04:21:03.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:03.013+0000 7f926c9a8640 1 -- 172.21.15.88:0/3772138258 learned_addr learned my addr 172.21.15.88:0/3772138258 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:21:03.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:03.013+0000 7f926ec0c640 1 -- 172.21.15.88:0/3772138258 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f92681150f0 con 0x7f926810d510 2024-09-17T04:21:03.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:03.013+0000 7f926ec0c640 1 -- 172.21.15.88:0/3772138258 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9268114f70 con 0x7f926810c5a0 2024-09-17T04:21:03.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:03.013+0000 7f9267fff640 1 --2- 172.21.15.88:0/3772138258 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f926810d510 0x7f92681a2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:21:03.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:03.013+0000 7f926c9a8640 1 -- 172.21.15.88:0/3772138258 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f926810d510 msgr2=0x7f92681a2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:03.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:03.013+0000 7f926c9a8640 1 --2- 172.21.15.88:0/3772138258 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f926810d510 0x7f92681a2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:03.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:03.013+0000 7f926c9a8640 1 -- 172.21.15.88:0/3772138258 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92681a28c0 con 0x7f926810c5a0 2024-09-17T04:21:03.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:03.013+0000 7f926c9a8640 1 --2- 172.21.15.88:0/3772138258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f926810c5a0 0x7f92681a1cd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f925802aa90 tx=0x7f92580048f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:21:03.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:03.014+0000 7f9265ffb640 1 -- 172.21.15.88:0/3772138258 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f925803f070 con 0x7f926810c5a0 2024-09-17T04:21:03.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:03.014+0000 7f9265ffb640 1 -- 172.21.15.88:0/3772138258 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9258004ce0 con 0x7f926810c5a0 2024-09-17T04:21:03.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:03.014+0000 7f926ec0c640 1 -- 172.21.15.88:0/3772138258 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92681a72c0 con 0x7f926810c5a0 2024-09-17T04:21:03.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:03.014+0000 7f9265ffb640 1 -- 172.21.15.88:0/3772138258 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9258035030 con 0x7f926810c5a0 2024-09-17T04:21:03.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:03.016+0000 7f926ec0c640 1 -- 172.21.15.88:0/3772138258 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92681a77c0 con 0x7f926810c5a0 2024-09-17T04:21:03.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:03.016+0000 7f9265ffb640 1 -- 172.21.15.88:0/3772138258 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f9258042070 con 0x7f926810c5a0 2024-09-17T04:21:03.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:03.016+0000 7f9265ffb640 1 --2- 172.21.15.88:0/3772138258 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f9250074b00 0x7f9250076fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:21:03.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:03.017+0000 7f9267fff640 1 --2- 172.21.15.88:0/3772138258 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f9250074b00 0x7f9250076fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:21:03.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:03.017+0000 7f9265ffb640 1 -- 172.21.15.88:0/3772138258 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f92580b4d00 con 0x7f926810c5a0 2024-09-17T04:21:03.017 INFO:tasks.workunit.client.1.smithi134.stdout:2/707: write d19/d27/d31/d49/d6f/da9/db0/daa/fd0 [3346111,101301] 0 2024-09-17T04:21:03.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:03.017+0000 7f9267fff640 1 --2- 172.21.15.88:0/3772138258 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f9250074b00 0x7f9250076fc0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f92681a3170 tx=0x7f925c005f90 comp rx=0 tx=0).ready entity=mgr.24431 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:21:03.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:03.017+0000 7f926ec0c640 1 -- 172.21.15.88:0/3772138258 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92681a79f0 con 0x7f926810c5a0 2024-09-17T04:21:03.018 INFO:tasks.workunit.client.0.smithi088.stdout:3/306: truncate d0/d13/f17 3252327 0 2024-09-17T04:21:03.020 INFO:tasks.workunit.client.0.smithi088.stdout:8/321: mknod d7/d29/d2a/c67 0 2024-09-17T04:21:03.021 INFO:tasks.workunit.client.1.smithi134.stdout:1/809: creat d12/d19/d1d/d61/dd3/dda/d85/df9/f111 x:0 0 0 2024-09-17T04:21:03.022 INFO:tasks.workunit.client.0.smithi088.stdout:6/321: creat d14/d44/d61/f78 x:0 0 0 2024-09-17T04:21:03.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:03.023+0000 7f9265ffb640 1 -- 172.21.15.88:0/3772138258 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f92580b9030 con 0x7f926810c5a0 2024-09-17T04:21:03.024 INFO:tasks.workunit.client.1.smithi134.stdout:6/855: dwrite de/d19/d62/f20 [0,4194304] 0 2024-09-17T04:21:03.024 INFO:tasks.workunit.client.0.smithi088.stdout:6/322: truncate d14/d44/d45/d6b/d16/f74 219670 0 2024-09-17T04:21:03.025 INFO:tasks.workunit.client.1.smithi134.stdout:7/614: mkdir d0/d16/d35/dbe 0 2024-09-17T04:21:03.025 INFO:tasks.workunit.client.0.smithi088.stdout:6/323: write d14/d44/d45/d6b/d16/f51 [1405704,4558] 0 2024-09-17T04:21:03.027 INFO:tasks.workunit.client.0.smithi088.stdout:6/324: write d14/d44/d45/d6b/d16/f2e [2748627,109642] 0 2024-09-17T04:21:03.031 INFO:tasks.workunit.client.1.smithi134.stdout:6/856: dwrite de/d19/d21/d2d/f39 [0,4194304] 0 2024-09-17T04:21:03.032 INFO:tasks.workunit.client.0.smithi088.stdout:3/307: link d0/l32 d0/d13/d1b/d29/d30/d35/l5f 0 2024-09-17T04:21:03.034 INFO:tasks.workunit.client.0.smithi088.stdout:6/325: symlink d14/d44/d45/d6b/d2a/l79 0 2024-09-17T04:21:03.036 INFO:tasks.workunit.client.1.smithi134.stdout:2/708: unlink d19/d27/d31/f89 0 2024-09-17T04:21:03.036 INFO:tasks.workunit.client.0.smithi088.stdout:8/322: dread d7/d29/d2a/f2b [0,4194304] 0 2024-09-17T04:21:03.037 INFO:tasks.workunit.client.1.smithi134.stdout:2/709: write d19/d27/f32 [3194549,92330] 0 2024-09-17T04:21:03.037 INFO:tasks.workunit.client.0.smithi088.stdout:8/323: fsync f2 0 2024-09-17T04:21:03.038 INFO:tasks.workunit.client.0.smithi088.stdout:3/308: mknod d0/c60 0 2024-09-17T04:21:03.039 INFO:tasks.workunit.client.0.smithi088.stdout:8/324: write d7/d29/d2a/d3a/f3e [737189,68974] 0 2024-09-17T04:21:03.040 INFO:tasks.workunit.client.1.smithi134.stdout:7/615: creat d0/dd/d3a/d3d/d38/fbf x:0 0 0 2024-09-17T04:21:03.041 INFO:tasks.workunit.client.1.smithi134.stdout:5/718: link d0/da/d69/d41/d6d/l98 d0/d48/lea 0 2024-09-17T04:21:03.044 INFO:tasks.workunit.client.1.smithi134.stdout:4/786: creat d0/d13/d40/f102 x:0 0 0 2024-09-17T04:21:03.048 INFO:tasks.workunit.client.1.smithi134.stdout:3/853: sync 2024-09-17T04:21:03.049 INFO:tasks.workunit.client.1.smithi134.stdout:0/729: rename d11/d19/d21/l50 to d11/d18/d97/df3/lfc 0 2024-09-17T04:21:03.049 INFO:tasks.workunit.client.1.smithi134.stdout:2/710: creat d19/d27/d31/d49/d6f/d84/d98/feb x:0 0 0 2024-09-17T04:21:03.049 INFO:tasks.workunit.client.1.smithi134.stdout:8/692: getdents d4/db/dd/d43 0 2024-09-17T04:21:03.050 INFO:tasks.workunit.client.1.smithi134.stdout:2/711: readlink d19/d27/l46 0 2024-09-17T04:21:03.050 INFO:tasks.workunit.client.0.smithi088.stdout:3/309: dwrite d0/d13/f53 [0,4194304] 0 2024-09-17T04:21:03.050 INFO:tasks.workunit.client.1.smithi134.stdout:8/693: read - d4/d1f/d25/d6a/fcd zero size 2024-09-17T04:21:03.051 INFO:tasks.workunit.client.1.smithi134.stdout:7/616: fsync d0/dd/fb4 0 2024-09-17T04:21:03.052 INFO:tasks.workunit.client.1.smithi134.stdout:5/719: fsync d0/da/d2c/d73/fa3 0 2024-09-17T04:21:03.053 INFO:tasks.workunit.client.0.smithi088.stdout:3/310: write d0/d13/d1b/f21 [629532,24628] 0 2024-09-17T04:21:03.057 INFO:tasks.workunit.client.1.smithi134.stdout:8/694: creat d4/d11/da1/dc7/d5e/fd6 x:0 0 0 2024-09-17T04:21:03.058 INFO:tasks.workunit.client.1.smithi134.stdout:5/720: mkdir d0/da/d2c/deb 0 2024-09-17T04:21:03.059 INFO:tasks.workunit.client.0.smithi088.stdout:3/311: creat d0/d13/d1b/d29/d30/d3c/f61 x:0 0 0 2024-09-17T04:21:03.060 INFO:tasks.workunit.client.1.smithi134.stdout:8/695: write d4/d11/da1/db3/fce [865707,123687] 0 2024-09-17T04:21:03.061 INFO:tasks.workunit.client.1.smithi134.stdout:2/712: mknod d19/d27/de9/cec 0 2024-09-17T04:21:03.062 INFO:tasks.workunit.client.1.smithi134.stdout:4/787: dwrite d0/f43 [4194304,4194304] 0 2024-09-17T04:21:03.062 INFO:tasks.workunit.client.1.smithi134.stdout:8/696: chown d4/l21 84 1 2024-09-17T04:21:03.062 INFO:tasks.workunit.client.0.smithi088.stdout:3/312: symlink d0/d13/d4d/l62 0 2024-09-17T04:21:03.063 INFO:tasks.workunit.client.0.smithi088.stdout:8/325: dread d7/d29/f2e [0,4194304] 0 2024-09-17T04:21:03.063 INFO:tasks.workunit.client.1.smithi134.stdout:8/697: readlink d4/db/dd/d43/ld0 0 2024-09-17T04:21:03.063 INFO:tasks.workunit.client.1.smithi134.stdout:4/788: read - d0/d13/d40/d42/d92/d65/fcd zero size 2024-09-17T04:21:03.064 INFO:tasks.workunit.client.1.smithi134.stdout:0/730: rmdir d11/d4c/d76/dba 39 2024-09-17T04:21:03.066 INFO:tasks.workunit.client.1.smithi134.stdout:3/854: link de/d12/d22/f81 de/d12/d15/d1d/f114 0 2024-09-17T04:21:03.066 INFO:tasks.workunit.client.0.smithi088.stdout:3/313: chown d0/c15 64883 1 2024-09-17T04:21:03.067 INFO:tasks.workunit.client.0.smithi088.stdout:3/314: chown d0/d13/d1b/d29/d30/d35 1952239732 1 2024-09-17T04:21:03.069 INFO:tasks.workunit.client.1.smithi134.stdout:7/617: link d0/d16/d8b/d6a/fba d0/d16/d35/d4b/fc0 0 2024-09-17T04:21:03.073 INFO:tasks.workunit.client.0.smithi088.stdout:8/326: getdents d7/dd/d62 0 2024-09-17T04:21:03.074 INFO:tasks.workunit.client.1.smithi134.stdout:8/698: symlink d4/d1f/d86/d9f/ld7 0 2024-09-17T04:21:03.077 INFO:tasks.workunit.client.0.smithi088.stdout:8/327: write d7/d29/d2a/f2b [5576585,99085] 0 2024-09-17T04:21:03.079 INFO:tasks.workunit.client.0.smithi088.stdout:6/326: getdents d14/d44/d45/d6b/d2a 0 2024-09-17T04:21:03.081 INFO:tasks.workunit.client.0.smithi088.stdout:8/328: creat d7/d29/f68 x:0 0 0 2024-09-17T04:21:03.082 INFO:tasks.workunit.client.0.smithi088.stdout:8/329: dread - d7/d29/d2a/d38/d3d/f49 zero size 2024-09-17T04:21:03.083 INFO:tasks.workunit.client.0.smithi088.stdout:8/330: stat d7/d29/d2a/f33 0 2024-09-17T04:21:03.084 INFO:tasks.workunit.client.1.smithi134.stdout:4/789: dread d0/d13/d40/d42/d92/d86/faf [0,4194304] 0 2024-09-17T04:21:03.084 INFO:tasks.workunit.client.0.smithi088.stdout:3/315: getdents d0/d13/d1b/d29/d2b 0 2024-09-17T04:21:03.084 INFO:tasks.workunit.client.0.smithi088.stdout:8/331: stat d7/c14 0 2024-09-17T04:21:03.086 INFO:tasks.workunit.client.0.smithi088.stdout:6/327: chown d14/d3a/d41/f60 21 1 2024-09-17T04:21:03.087 INFO:tasks.workunit.client.0.smithi088.stdout:6/328: read d14/d44/d45/d6b/d16/f2e [548024,44633] 0 2024-09-17T04:21:03.091 INFO:tasks.workunit.client.1.smithi134.stdout:6/857: truncate de/d19/d62/f20 1565852 0 2024-09-17T04:21:03.093 INFO:tasks.workunit.client.1.smithi134.stdout:7/618: dread d0/dd/d3a/d3d/d38/d60/d75/f80 [0,4194304] 0 2024-09-17T04:21:03.093 INFO:tasks.workunit.client.1.smithi134.stdout:8/699: write d4/d1e/daf/fb9 [1344114,17956] 0 2024-09-17T04:21:03.094 INFO:tasks.workunit.client.1.smithi134.stdout:0/731: fdatasync d11/d18/f57 0 2024-09-17T04:21:03.095 INFO:tasks.workunit.client.1.smithi134.stdout:7/619: truncate d0/dd/d3a/d3d/d38/d74/faf 732304 0 2024-09-17T04:21:03.096 INFO:tasks.workunit.client.0.smithi088.stdout:6/329: truncate d14/d44/d45/d6b/d29/f3d 653009 0 2024-09-17T04:21:03.098 INFO:tasks.workunit.client.0.smithi088.stdout:3/316: mkdir d0/d13/d58/d5a/d63 0 2024-09-17T04:21:03.100 INFO:tasks.workunit.client.1.smithi134.stdout:7/620: dwrite d0/dd/d3a/d3d/d38/d60/f84 [0,4194304] 0 2024-09-17T04:21:03.103 INFO:tasks.workunit.client.1.smithi134.stdout:4/790: rmdir d0/df/d1e 39 2024-09-17T04:21:03.106 INFO:tasks.workunit.client.0.smithi088.stdout:6/330: rename d14/d44/d45/d6b/d29/d72 to d14/d44/d45/d6b/d2a/d52/d7a 0 2024-09-17T04:21:03.107 INFO:tasks.workunit.client.1.smithi134.stdout:5/721: rename d0/da/d69/d41/l74 to d0/lec 0 2024-09-17T04:21:03.109 INFO:tasks.workunit.client.0.smithi088.stdout:3/317: fdatasync d0/d13/d1b/d29/d30/d35/f57 0 2024-09-17T04:21:03.109 INFO:tasks.workunit.client.1.smithi134.stdout:7/621: dwrite d0/dd/d3a/d3d/d38/d60/fb8 [0,4194304] 0 2024-09-17T04:21:03.113 INFO:tasks.workunit.client.1.smithi134.stdout:2/713: truncate d19/d7e/f86 2379212 0 2024-09-17T04:21:03.115 INFO:tasks.workunit.client.0.smithi088.stdout:6/331: rename d14/d44/d45/d6b/d2a/d70 to d14/d44/d45/d6b/d2a/d52/d7a/d7b 0 2024-09-17T04:21:03.118 INFO:tasks.workunit.client.1.smithi134.stdout:8/700: creat d4/db/dd/d43/fd8 x:0 0 0 2024-09-17T04:21:03.118 INFO:tasks.workunit.client.0.smithi088.stdout:6/332: chown d14/d44/d45/d6b/d2a/f5a 983331066 1 2024-09-17T04:21:03.122 INFO:tasks.workunit.client.0.smithi088.stdout:8/332: dwrite d7/f24 [0,4194304] 0 2024-09-17T04:21:03.122 INFO:tasks.workunit.client.1.smithi134.stdout:6/858: dwrite de/d19/d62/db0/fbe [0,4194304] 0 2024-09-17T04:21:03.123 INFO:tasks.workunit.client.1.smithi134.stdout:2/714: dwrite f2 [0,4194304] 0 2024-09-17T04:21:03.126 INFO:tasks.workunit.client.0.smithi088.stdout:3/318: creat d0/d13/d1b/d29/d56/f64 x:0 0 0 2024-09-17T04:21:03.129 INFO:tasks.workunit.client.0.smithi088.stdout:6/333: creat d14/d44/d45/d6b/d2a/d52/d7a/d7b/f7c x:0 0 0 2024-09-17T04:21:03.129 INFO:tasks.workunit.client.1.smithi134.stdout:1/810: write d12/d1c/d2e/f3b [1775249,25562] 0 2024-09-17T04:21:03.131 INFO:tasks.workunit.client.0.smithi088.stdout:8/333: dread d7/d29/d2a/d3a/f3e [0,4194304] 0 2024-09-17T04:21:03.132 INFO:tasks.workunit.client.0.smithi088.stdout:3/319: mkdir d0/d13/d1b/d29/d30/d35/d65 0 2024-09-17T04:21:03.133 INFO:tasks.workunit.client.0.smithi088.stdout:8/334: write d7/d29/d2a/d38/f44 [869241,117595] 0 2024-09-17T04:21:03.137 INFO:tasks.workunit.client.1.smithi134.stdout:3/855: dwrite de/d10/f64 [0,4194304] 0 2024-09-17T04:21:03.138 INFO:tasks.workunit.client.0.smithi088.stdout:3/320: write d0/f12 [2117866,28623] 0 2024-09-17T04:21:03.139 INFO:tasks.workunit.client.0.smithi088.stdout:6/334: symlink d14/d44/d45/d6b/l7d 0 2024-09-17T04:21:03.141 INFO:tasks.workunit.client.0.smithi088.stdout:6/335: readlink d14/d44/d45/d6b/d2a/l79 0 2024-09-17T04:21:03.143 INFO:tasks.workunit.client.1.smithi134.stdout:3/856: read de/d12/d15/d1d/f114 [3414043,35699] 0 2024-09-17T04:21:03.144 INFO:tasks.workunit.client.0.smithi088.stdout:8/335: symlink d7/dd/d31/d47/d55/d57/l69 0 2024-09-17T04:21:03.145 INFO:tasks.workunit.client.1.smithi134.stdout:7/622: dread d0/d16/f13 [0,4194304] 0 2024-09-17T04:21:03.148 INFO:tasks.workunit.client.0.smithi088.stdout:6/336: dwrite d14/f56 [4194304,4194304] 0 2024-09-17T04:21:03.153 INFO:tasks.workunit.client.1.smithi134.stdout:2/715: write d19/d27/d31/f5c [3624176,111381] 0 2024-09-17T04:21:03.153 INFO:tasks.workunit.client.1.smithi134.stdout:2/716: fdatasync d19/d1c/d47/d50/f7c 0 2024-09-17T04:21:03.157 INFO:tasks.workunit.client.0.smithi088.stdout:8/336: rename d7/dd/l5d to d7/dd/d31/l6a 0 2024-09-17T04:21:03.158 INFO:tasks.workunit.client.0.smithi088.stdout:6/337: chown d14/l28 32895 1 2024-09-17T04:21:03.160 INFO:tasks.workunit.client.1.smithi134.stdout:1/811: creat d12/d19/d1d/d3e/dcb/f112 x:0 0 0 2024-09-17T04:21:03.163 INFO:tasks.workunit.client.0.smithi088.stdout:6/338: read d14/d44/d45/d6b/d29/d3e/f6f [2820730,27929] 0 2024-09-17T04:21:03.166 INFO:tasks.workunit.client.0.smithi088.stdout:8/337: mkdir d7/dd/d31/d47/d55/d57/d6b 0 2024-09-17T04:21:03.170 INFO:tasks.workunit.client.1.smithi134.stdout:4/791: rename d0/df/d35/d5c/lb1 to d0/d13/d40/d42/d92/l103 0 2024-09-17T04:21:03.173 INFO:tasks.workunit.client.1.smithi134.stdout:8/701: write d4/d11/da1/dc7/d13/f40 [1366043,67545] 0 2024-09-17T04:21:03.174 INFO:tasks.workunit.client.0.smithi088.stdout:8/338: dwrite f2 [0,4194304] 0 2024-09-17T04:21:03.174 INFO:tasks.workunit.client.1.smithi134.stdout:8/702: fdatasync d4/d1f/f97 0 2024-09-17T04:21:03.174 INFO:tasks.workunit.client.0.smithi088.stdout:3/321: link d0/d13/f17 d0/d13/d1b/d29/d30/d35/f66 0 2024-09-17T04:21:03.175 INFO:tasks.workunit.client.0.smithi088.stdout:8/339: chown d7/dd/d31/c37 934 1 2024-09-17T04:21:03.176 INFO:tasks.workunit.client.1.smithi134.stdout:3/857: creat de/d12/d15/d9f/dba/f115 x:0 0 0 2024-09-17T04:21:03.184 INFO:tasks.workunit.client.0.smithi088.stdout:3/322: dwrite d0/f33 [0,4194304] 0 2024-09-17T04:21:03.186 INFO:tasks.workunit.client.1.smithi134.stdout:5/722: truncate d0/da/d69/d41/fb2 18109 0 2024-09-17T04:21:03.187 INFO:tasks.workunit.client.1.smithi134.stdout:5/723: chown d0/d3a/d2b/f51 15 1 2024-09-17T04:21:03.190 INFO:tasks.workunit.client.1.smithi134.stdout:0/732: creat d11/d4c/ffd x:0 0 0 2024-09-17T04:21:03.191 INFO:tasks.workunit.client.0.smithi088.stdout:6/339: dread d14/d2f/f36 [0,4194304] 0 2024-09-17T04:21:03.195 INFO:tasks.workunit.client.1.smithi134.stdout:1/812: mknod d12/d19/d1d/d61/dd3/dda/d85/c113 0 2024-09-17T04:21:03.196 INFO:tasks.workunit.client.0.smithi088.stdout:3/323: creat d0/d13/d1b/d29/d2b/d50/f67 x:0 0 0 2024-09-17T04:21:03.199 INFO:tasks.workunit.client.1.smithi134.stdout:2/717: rename d19/da1 to d19/d1c/d92/ddc/dc6/ded 0 2024-09-17T04:21:03.200 INFO:tasks.workunit.client.0.smithi088.stdout:3/324: creat d0/d13/d1b/d29/d30/f68 x:0 0 0 2024-09-17T04:21:03.200 INFO:tasks.workunit.client.0.smithi088.stdout:6/340: dread d14/d44/d45/d6b/d29/f2d [0,4194304] 0 2024-09-17T04:21:03.202 INFO:tasks.workunit.client.0.smithi088.stdout:6/341: read - d14/d44/d45/d6b/d2a/d52/d7a/f75 zero size 2024-09-17T04:21:03.202 INFO:tasks.workunit.client.0.smithi088.stdout:8/340: link d7/d29/d2a/d38/c46 d7/c6c 0 2024-09-17T04:21:03.203 INFO:tasks.workunit.client.0.smithi088.stdout:6/342: fdatasync d14/d44/d45/d6b/d16/f74 0 2024-09-17T04:21:03.204 INFO:tasks.workunit.client.1.smithi134.stdout:8/703: mknod d4/d1e/daf/d60/cd9 0 2024-09-17T04:21:03.206 INFO:tasks.workunit.client.1.smithi134.stdout:7/623: creat d0/dd/d3a/d3d/d38/da9/fc1 x:0 0 0 2024-09-17T04:21:03.210 INFO:tasks.workunit.client.0.smithi088.stdout:8/341: dwrite d7/dd/d31/f36 [8388608,4194304] 0 2024-09-17T04:21:03.215 INFO:tasks.workunit.client.0.smithi088.stdout:8/342: dread d7/d29/f2e [0,4194304] 0 2024-09-17T04:21:03.215 INFO:tasks.workunit.client.1.smithi134.stdout:5/724: dread d0/d3a/f3b [0,4194304] 0 2024-09-17T04:21:03.217 INFO:tasks.workunit.client.0.smithi088.stdout:6/343: symlink d14/d44/d45/d6b/d16/d42/l7e 0 2024-09-17T04:21:03.219 INFO:tasks.workunit.client.0.smithi088.stdout:3/325: creat d0/d54/d55/f69 x:0 0 0 2024-09-17T04:21:03.220 INFO:tasks.workunit.client.1.smithi134.stdout:1/813: write d12/d19/d5d/d88/fbf [1344527,51495] 0 2024-09-17T04:21:03.220 INFO:tasks.workunit.client.0.smithi088.stdout:8/343: creat d7/dd/d31/f6d x:0 0 0 2024-09-17T04:21:03.221 INFO:tasks.workunit.client.1.smithi134.stdout:4/792: creat d0/df/d1e/d73/f104 x:0 0 0 2024-09-17T04:21:03.222 INFO:tasks.workunit.client.0.smithi088.stdout:6/344: symlink d14/d44/d45/d4d/l7f 0 2024-09-17T04:21:03.223 INFO:tasks.workunit.client.1.smithi134.stdout:2/718: mknod d19/d27/d31/cee 0 2024-09-17T04:21:03.224 INFO:tasks.workunit.client.1.smithi134.stdout:6/859: dwrite de/d19/d1f/d85/d88/fcb [0,4194304] 0 2024-09-17T04:21:03.224 INFO:tasks.workunit.client.1.smithi134.stdout:8/704: dread d4/d1f/d25/f50 [0,4194304] 0 2024-09-17T04:21:03.225 INFO:tasks.workunit.client.0.smithi088.stdout:6/345: unlink f11 0 2024-09-17T04:21:03.225 INFO:tasks.workunit.client.1.smithi134.stdout:7/624: truncate d0/f19 3498802 0 2024-09-17T04:21:03.226 INFO:tasks.workunit.client.1.smithi134.stdout:6/860: write de/d19/d62/d7c/fca [479760,116185] 0 2024-09-17T04:21:03.226 INFO:tasks.workunit.client.0.smithi088.stdout:3/326: dread d0/f4 [0,4194304] 0 2024-09-17T04:21:03.227 INFO:tasks.workunit.client.1.smithi134.stdout:3/858: creat de/d12/d15/d1d/d2d/d31/d6a/d83/da7/f116 x:0 0 0 2024-09-17T04:21:03.231 INFO:tasks.workunit.client.1.smithi134.stdout:5/725: truncate d0/da/d29/d7c/d9e/fc1 857769 0 2024-09-17T04:21:03.233 INFO:tasks.workunit.client.0.smithi088.stdout:6/346: fdatasync d14/f32 0 2024-09-17T04:21:03.236 INFO:tasks.workunit.client.0.smithi088.stdout:3/327: dwrite d0/d13/d1b/d29/d2b/f42 [0,4194304] 0 2024-09-17T04:21:03.238 INFO:tasks.workunit.client.1.smithi134.stdout:6/861: mknod de/d19/d1f/d5c/c110 0 2024-09-17T04:21:03.238 INFO:tasks.workunit.client.0.smithi088.stdout:6/347: rmdir d14/d3a/d41 39 2024-09-17T04:21:03.239 INFO:tasks.workunit.client.0.smithi088.stdout:6/348: readlink d14/d44/d45/d6b/l7d 0 2024-09-17T04:21:03.239 INFO:tasks.workunit.client.1.smithi134.stdout:3/859: symlink de/d10/d3d/dd9/l117 0 2024-09-17T04:21:03.242 INFO:tasks.workunit.client.1.smithi134.stdout:7/625: dread d0/dd/d3a/d3d/d38/f3c [0,4194304] 0 2024-09-17T04:21:03.243 INFO:tasks.workunit.client.1.smithi134.stdout:7/626: readlink d0/d16/la 0 2024-09-17T04:21:03.247 INFO:tasks.workunit.client.0.smithi088.stdout:3/328: truncate d0/d13/d1b/f27 2704562 0 2024-09-17T04:21:03.247 INFO:tasks.workunit.client.0.smithi088.stdout:6/349: dread d14/d44/d45/d6b/d16/f2e [0,4194304] 0 2024-09-17T04:21:03.249 INFO:tasks.workunit.client.1.smithi134.stdout:7/627: dwrite d0/d16/f5a [4194304,4194304] 0 2024-09-17T04:21:03.253 INFO:tasks.workunit.client.0.smithi088.stdout:6/350: readlink d14/d44/d45/d6b/l20 0 2024-09-17T04:21:03.254 INFO:tasks.workunit.client.0.smithi088.stdout:6/351: stat d14/d44/d45/d6b/l20 0 2024-09-17T04:21:03.255 INFO:tasks.workunit.client.0.smithi088.stdout:6/352: read - d14/d44/d45/d6b/d2a/d52/f64 zero size 2024-09-17T04:21:03.258 INFO:tasks.workunit.client.1.smithi134.stdout:6/862: creat de/d19/d1f/d55/d77/f111 x:0 0 0 2024-09-17T04:21:03.258 INFO:tasks.workunit.client.1.smithi134.stdout:0/733: write d11/d24/d49/d62/daf/ded/ff8 [252647,52904] 0 2024-09-17T04:21:03.258 INFO:tasks.workunit.client.1.smithi134.stdout:6/863: readlink de/d5d/d67/laf 0 2024-09-17T04:21:03.259 INFO:tasks.workunit.client.1.smithi134.stdout:6/864: chown de/d19/d1f/f57 1 1 2024-09-17T04:21:03.261 INFO:tasks.workunit.client.1.smithi134.stdout:6/865: chown de/d19/d1f/d5c/c79 6905 1 2024-09-17T04:21:03.264 INFO:tasks.workunit.client.1.smithi134.stdout:2/719: creat d19/d1c/fef x:0 0 0 2024-09-17T04:21:03.265 INFO:tasks.workunit.client.1.smithi134.stdout:1/814: dwrite d12/d19/d1d/d61/dd3/dda/f10a [0,4194304] 0 2024-09-17T04:21:03.265 INFO:tasks.workunit.client.1.smithi134.stdout:2/720: dread - d19/d1c/d47/fbe zero size 2024-09-17T04:21:03.267 INFO:tasks.workunit.client.1.smithi134.stdout:1/815: write d12/d19/d1d/d3e/dcb/f112 [708669,30883] 0 2024-09-17T04:21:03.268 INFO:tasks.workunit.client.1.smithi134.stdout:7/628: rename d0/f15 to d0/d16/d8b/fc2 0 2024-09-17T04:21:03.269 INFO:tasks.workunit.client.1.smithi134.stdout:5/726: write d0/da/d69/f91 [446180,11762] 0 2024-09-17T04:21:03.271 INFO:tasks.workunit.client.1.smithi134.stdout:0/734: unlink d11/d18/d97/df3/d45/c51 0 2024-09-17T04:21:03.274 INFO:tasks.workunit.client.1.smithi134.stdout:3/860: truncate de/d12/d15/d1d/d2d/d31/d6a/d83/fb7 441868 0 2024-09-17T04:21:03.277 INFO:tasks.workunit.client.1.smithi134.stdout:0/735: dwrite d11/d18/d97/df3/d43/d5d/fc5 [0,4194304] 0 2024-09-17T04:21:03.279 INFO:tasks.workunit.client.1.smithi134.stdout:4/793: getdents d0/d13/d40/d42/d92/d65/dc2 0 2024-09-17T04:21:03.279 INFO:tasks.workunit.client.0.smithi088.stdout:6/353: truncate f4 5811277 0 2024-09-17T04:21:03.281 INFO:tasks.workunit.client.0.smithi088.stdout:3/329: dwrite d0/f1a [4194304,4194304] 0 2024-09-17T04:21:03.282 INFO:tasks.workunit.client.1.smithi134.stdout:2/721: mkdir d19/d1c/d92/ddc/dc6/df0 0 2024-09-17T04:21:03.283 INFO:tasks.workunit.client.0.smithi088.stdout:6/354: read - d14/d44/d45/d6b/d16/f6a zero size 2024-09-17T04:21:03.283 INFO:tasks.workunit.client.1.smithi134.stdout:2/722: chown d19/d1c/d47/dae/dc8/fd9 443 1 2024-09-17T04:21:03.284 INFO:tasks.workunit.client.0.smithi088.stdout:6/355: chown d14/d44/l4c 2915 1 2024-09-17T04:21:03.284 INFO:tasks.workunit.client.1.smithi134.stdout:2/723: readlink d19/d1c/d92/ddc/dc6/ded/ld8 0 2024-09-17T04:21:03.290 INFO:tasks.workunit.client.1.smithi134.stdout:1/816: dwrite d12/d19/d1d/d61/fe9 [0,4194304] 0 2024-09-17T04:21:03.292 INFO:tasks.workunit.client.1.smithi134.stdout:8/705: getdents d4/d11/da1/db3 0 2024-09-17T04:21:03.297 INFO:tasks.workunit.client.0.smithi088.stdout:3/330: creat d0/d13/d58/d5e/f6a x:0 0 0 2024-09-17T04:21:03.302 INFO:tasks.workunit.client.0.smithi088.stdout:6/356: symlink d14/d3a/d41/l80 0 2024-09-17T04:21:03.304 INFO:tasks.workunit.client.0.smithi088.stdout:3/331: dwrite d0/d13/d1b/d29/f36 [0,4194304] 0 2024-09-17T04:21:03.304 INFO:tasks.workunit.client.1.smithi134.stdout:6/866: creat de/d19/d62/d7c/d108/f112 x:0 0 0 2024-09-17T04:21:03.309 INFO:tasks.workunit.client.0.smithi088.stdout:6/357: creat d14/d44/d45/d6b/d2a/d52/d7a/d7b/f81 x:0 0 0 2024-09-17T04:21:03.311 INFO:tasks.workunit.client.1.smithi134.stdout:4/794: write d0/d13/d40/d42/d92/f7e [1554550,92534] 0 2024-09-17T04:21:03.312 INFO:tasks.workunit.client.1.smithi134.stdout:2/724: symlink d19/d1c/d47/lf1 0 2024-09-17T04:21:03.313 INFO:tasks.workunit.client.0.smithi088.stdout:3/332: dwrite d0/f2 [0,4194304] 0 2024-09-17T04:21:03.314 INFO:tasks.workunit.client.1.smithi134.stdout:7/629: symlink d0/dd/d3a/lc3 0 2024-09-17T04:21:03.316 INFO:tasks.workunit.client.0.smithi088.stdout:3/333: fsync d0/d13/d1b/d29/d2b/f41 0 2024-09-17T04:21:03.317 INFO:tasks.workunit.client.1.smithi134.stdout:1/817: mknod d12/d19/d5d/d91/dac/dd5/def/c114 0 2024-09-17T04:21:03.317 INFO:tasks.workunit.client.0.smithi088.stdout:6/358: creat d14/d63/f82 x:0 0 0 2024-09-17T04:21:03.322 INFO:tasks.workunit.client.0.smithi088.stdout:3/334: unlink d0/d13/d1b/c2f 0 2024-09-17T04:21:03.324 INFO:tasks.workunit.client.1.smithi134.stdout:6/867: rename la to de/d19/d21/d2d/d92/l113 0 2024-09-17T04:21:03.326 INFO:tasks.workunit.client.1.smithi134.stdout:3/861: mknod de/d12/d15/d1d/d2d/d31/d6a/d78/d7c/dad/c118 0 2024-09-17T04:21:03.327 INFO:tasks.workunit.client.1.smithi134.stdout:3/862: chown de/d10/d3d/de2 1224495 1 2024-09-17T04:21:03.333 INFO:tasks.workunit.client.1.smithi134.stdout:7/630: rmdir d0/dd/d3a/d3d/d38 39 2024-09-17T04:21:03.336 INFO:tasks.workunit.client.1.smithi134.stdout:4/795: dread d0/df/d1e/d73/dc7/fde [0,4194304] 0 2024-09-17T04:21:03.338 INFO:tasks.workunit.client.0.smithi088.stdout:3/335: rename d0/d13/d1b/d29/d30/d35/f3e to d0/d13/f6b 0 2024-09-17T04:21:03.338 INFO:tasks.workunit.client.1.smithi134.stdout:8/706: write d4/fe [489981,11549] 0 2024-09-17T04:21:03.339 INFO:tasks.workunit.client.0.smithi088.stdout:3/336: chown d0/d13/d1b/d29/f3b 1459653 1 2024-09-17T04:21:03.340 INFO:tasks.workunit.client.1.smithi134.stdout:8/707: read d4/d1f/d25/fa4 [53597,23370] 0 2024-09-17T04:21:03.340 INFO:tasks.workunit.client.0.smithi088.stdout:6/359: getdents d14/d44 0 2024-09-17T04:21:03.341 INFO:tasks.workunit.client.1.smithi134.stdout:5/727: link d0/da/d29/d8e/c90 d0/da/d2c/deb/ced 0 2024-09-17T04:21:03.343 INFO:tasks.workunit.client.0.smithi088.stdout:3/337: dread d0/d13/f53 [0,4194304] 0 2024-09-17T04:21:03.344 INFO:tasks.workunit.client.0.smithi088.stdout:3/338: chown d0/d13/d1b/d29/d2b/d40 1986432 1 2024-09-17T04:21:03.345 INFO:tasks.workunit.client.0.smithi088.stdout:3/339: write d0/d13/d1b/d29/d30/d3c/f51 [328501,84660] 0 2024-09-17T04:21:03.347 INFO:tasks.workunit.client.1.smithi134.stdout:6/868: mkdir de/d19/d1f/d55/d77/d89/d109/dc7/ddc/db3/d114 0 2024-09-17T04:21:03.347 INFO:tasks.workunit.client.1.smithi134.stdout:6/869: read de/d19/d1f/dae/fbf [1533961,84774] 0 2024-09-17T04:21:03.349 INFO:tasks.workunit.client.0.smithi088.stdout:6/360: creat d14/d44/d45/d6b/d2a/d52/d7a/f83 x:0 0 0 2024-09-17T04:21:03.352 INFO:tasks.workunit.client.1.smithi134.stdout:0/736: creat d11/d19/ffe x:0 0 0 2024-09-17T04:21:03.353 INFO:tasks.workunit.client.1.smithi134.stdout:1/818: dwrite d12/d19/d1d/d61/fe5 [0,4194304] 0 2024-09-17T04:21:03.353 INFO:tasks.workunit.client.0.smithi088.stdout:6/361: creat d14/d3a/d41/f84 x:0 0 0 2024-09-17T04:21:03.357 INFO:tasks.workunit.client.1.smithi134.stdout:4/796: unlink d0/df/d17/f6d 0 2024-09-17T04:21:03.361 INFO:tasks.workunit.client.0.smithi088.stdout:6/362: unlink d14/d44/d45/d6b/d29/f3d 0 2024-09-17T04:21:03.363 INFO:tasks.workunit.client.0.smithi088.stdout:6/363: write d14/d44/d61/f78 [371369,63146] 0 2024-09-17T04:21:03.365 INFO:tasks.workunit.client.1.smithi134.stdout:5/728: creat d0/da/d29/d78/da5/dce/fee x:0 0 0 2024-09-17T04:21:03.366 INFO:tasks.workunit.client.0.smithi088.stdout:6/364: truncate f10 1761735 0 2024-09-17T04:21:03.367 INFO:tasks.workunit.client.1.smithi134.stdout:7/631: write d0/d16/d35/d4b/fc0 [558778,120584] 0 2024-09-17T04:21:03.368 INFO:tasks.workunit.client.1.smithi134.stdout:6/870: creat de/d19/d1f/d5c/f115 x:0 0 0 2024-09-17T04:21:03.370 INFO:tasks.workunit.client.1.smithi134.stdout:0/737: mkdir d11/d48/dff 0 2024-09-17T04:21:03.372 INFO:tasks.workunit.client.1.smithi134.stdout:0/738: dread d11/d24/d49/f68 [0,4194304] 0 2024-09-17T04:21:03.372 INFO:tasks.workunit.client.1.smithi134.stdout:6/871: dread de/d19/d62/d7c/fca [0,4194304] 0 2024-09-17T04:21:03.377 INFO:tasks.workunit.client.1.smithi134.stdout:3/863: truncate de/d12/fb1 3701650 0 2024-09-17T04:21:03.380 INFO:tasks.workunit.client.1.smithi134.stdout:2/725: rename d19/d27/d31/d49 to d19/d27/d31/d34/df2 0 2024-09-17T04:21:03.381 INFO:tasks.workunit.client.1.smithi134.stdout:8/708: truncate d4/d1f/f3a 733216 0 2024-09-17T04:21:03.383 INFO:tasks.workunit.client.0.smithi088.stdout:6/365: rename d14/d44/d45/d6b/d2a/d52/d7a/c77 to d14/d44/d45/d6b/d2a/d52/c85 0 2024-09-17T04:21:03.384 INFO:tasks.workunit.client.1.smithi134.stdout:5/729: dread d0/f79 [0,4194304] 0 2024-09-17T04:21:03.387 INFO:tasks.workunit.client.1.smithi134.stdout:6/872: write de/d19/d1f/d55/f63 [2941511,54226] 0 2024-09-17T04:21:03.388 INFO:tasks.workunit.client.1.smithi134.stdout:6/873: dread - de/d19/d1f/dae/fcf zero size 2024-09-17T04:21:03.389 INFO:tasks.workunit.client.1.smithi134.stdout:3/864: symlink de/d12/d15/d1d/d2d/d31/d6a/d78/d7c/l119 0 2024-09-17T04:21:03.392 INFO:tasks.workunit.client.1.smithi134.stdout:1/819: rename d12/c10c to d12/d19/d5d/d91/dac/dd5/def/c115 0 2024-09-17T04:21:03.392 INFO:tasks.workunit.client.1.smithi134.stdout:1/820: truncate d12/d36/fcd 2478368 0 2024-09-17T04:21:03.393 INFO:tasks.workunit.client.1.smithi134.stdout:1/821: write d12/d19/d5d/d91/fe7 [23398,97595] 0 2024-09-17T04:21:03.393 INFO:tasks.workunit.client.1.smithi134.stdout:8/709: symlink d4/d1e/daf/d60/lda 0 2024-09-17T04:21:03.395 INFO:tasks.workunit.client.1.smithi134.stdout:8/710: chown d4/d1e/daf/d60/lbd 0 1 2024-09-17T04:21:03.398 INFO:tasks.workunit.client.1.smithi134.stdout:0/739: unlink d11/d22/f3a 0 2024-09-17T04:21:03.399 INFO:tasks.workunit.client.1.smithi134.stdout:0/740: write d11/d6f/fb4 [3103315,37310] 0 2024-09-17T04:21:03.400 INFO:tasks.workunit.client.1.smithi134.stdout:4/797: truncate d0/df/d1e/dbc/fc6 199819 0 2024-09-17T04:21:03.402 INFO:tasks.workunit.client.1.smithi134.stdout:8/711: dwrite d4/db/dd/d43/fd8 [0,4194304] 0 2024-09-17T04:21:03.408 INFO:tasks.workunit.client.1.smithi134.stdout:1/822: stat c6 0 2024-09-17T04:21:03.409 INFO:tasks.workunit.client.1.smithi134.stdout:0/741: dwrite d11/d19/f87 [0,4194304] 0 2024-09-17T04:21:03.409 INFO:tasks.workunit.client.1.smithi134.stdout:3/865: dwrite de/d67/f95 [0,4194304] 0 2024-09-17T04:21:03.410 INFO:tasks.workunit.client.1.smithi134.stdout:5/730: mknod d0/da/d29/d7c/ddf/cef 0 2024-09-17T04:21:03.412 INFO:tasks.workunit.client.1.smithi134.stdout:1/823: chown d12/d19/d5d/d88/fd6 2072683 1 2024-09-17T04:21:03.412 INFO:tasks.workunit.client.1.smithi134.stdout:5/731: dread - d0/da/d69/fd2 zero size 2024-09-17T04:21:03.418 INFO:tasks.workunit.client.1.smithi134.stdout:8/712: symlink d4/d1f/d86/ldb 0 2024-09-17T04:21:03.418 INFO:tasks.workunit.client.0.smithi088.stdout:6/366: link d14/d44/d45/d6b/d16/d42/l7e d14/d44/d45/d6b/d2a/d52/d7a/l86 0 2024-09-17T04:21:03.419 INFO:tasks.workunit.client.1.smithi134.stdout:2/726: write d19/d27/d31/d34/f82 [1022188,116674] 0 2024-09-17T04:21:03.420 INFO:tasks.workunit.client.1.smithi134.stdout:2/727: chown d19/d27/d31/d34/df2/d63/f68 15 1 2024-09-17T04:21:03.423 INFO:tasks.workunit.client.0.smithi088.stdout:6/367: chown d14/l1b 46641329 1 2024-09-17T04:21:03.425 INFO:tasks.workunit.client.1.smithi134.stdout:7/632: link d0/dd/d3a/d3d/d38/f1d d0/dd/fc4 0 2024-09-17T04:21:03.426 INFO:tasks.workunit.client.1.smithi134.stdout:0/742: chown d11/d4c/d76/dba 866 1 2024-09-17T04:21:03.430 INFO:tasks.workunit.client.1.smithi134.stdout:3/866: symlink de/d10/d3d/dd9/dbd/l11a 0 2024-09-17T04:21:03.431 INFO:tasks.workunit.client.1.smithi134.stdout:1/824: symlink d12/d19/d5d/dfe/l116 0 2024-09-17T04:21:03.431 INFO:tasks.workunit.client.1.smithi134.stdout:4/798: getdents d0/df/dd6 0 2024-09-17T04:21:03.433 INFO:tasks.workunit.client.1.smithi134.stdout:6/874: link de/d19/d62/db0/ce8 de/d19/d1f/d55/d77/d89/d109/dc7/ddc/db3/c116 0 2024-09-17T04:21:03.434 INFO:tasks.workunit.client.1.smithi134.stdout:7/633: mknod d0/dd/d3a/d3d/d38/d60/d75/cc5 0 2024-09-17T04:21:03.435 INFO:tasks.workunit.client.1.smithi134.stdout:5/732: mkdir d0/da/d29/d78/da5/df0 0 2024-09-17T04:21:03.438 INFO:tasks.workunit.client.1.smithi134.stdout:4/799: dwrite d0/df/d1e/d63/f9a [0,4194304] 0 2024-09-17T04:21:03.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:03.453+0000 7f926ec0c640 1 -- 172.21.15.88:0/3772138258 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f92681a7ca0 con 0x7f926810c5a0 2024-09-17T04:21:03.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:03.454+0000 7f9265ffb640 1 -- 172.21.15.88:0/3772138258 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f9258081e00 con 0x7f926810c5a0 2024-09-17T04:21:03.454 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T04:21:03.454 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T04:21:03.454 INFO:teuthology.orchestra.run.smithi088.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T04:21:03.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:03.456+0000 7f926ec0c640 1 -- 172.21.15.88:0/3772138258 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f9250074b00 msgr2=0x7f9250076fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:03.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:03.456+0000 7f926ec0c640 1 --2- 172.21.15.88:0/3772138258 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f9250074b00 0x7f9250076fc0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f92681a3170 tx=0x7f925c005f90 comp rx=0 tx=0).stop 2024-09-17T04:21:03.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:03.456+0000 7f926ec0c640 1 -- 172.21.15.88:0/3772138258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f926810c5a0 msgr2=0x7f92681a1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:03.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:03.456+0000 7f926ec0c640 1 --2- 172.21.15.88:0/3772138258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f926810c5a0 0x7f92681a1cd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f925802aa90 tx=0x7f92580048f0 comp rx=0 tx=0).stop 2024-09-17T04:21:03.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:03.456+0000 7f926ec0c640 1 -- 172.21.15.88:0/3772138258 shutdown_connections 2024-09-17T04:21:03.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:03.456+0000 7f926ec0c640 1 --2- 172.21.15.88:0/3772138258 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f9250074b00 0x7f9250076fc0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:03.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:03.456+0000 7f926ec0c640 1 --2- 172.21.15.88:0/3772138258 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f926810d510 0x7f92681a2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:03.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:03.456+0000 7f926ec0c640 1 --2- 172.21.15.88:0/3772138258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f926810c5a0 0x7f92681a1cd0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:03.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:03.456+0000 7f926ec0c640 1 -- 172.21.15.88:0/3772138258 >> 172.21.15.88:0/3772138258 conn(0x7f926806bdd0 msgr2=0x7f92681108a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:21:03.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:03.456+0000 7f926ec0c640 1 -- 172.21.15.88:0/3772138258 shutdown_connections 2024-09-17T04:21:03.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:03.456+0000 7f926ec0c640 1 -- 172.21.15.88:0/3772138258 wait complete. 2024-09-17T04:21:03.524 INFO:tasks.workunit.client.0.smithi088.stdout:9/387: sync 2024-09-17T04:21:03.525 INFO:tasks.workunit.client.0.smithi088.stdout:5/298: sync 2024-09-17T04:21:03.525 INFO:tasks.workunit.client.0.smithi088.stdout:9/388: read - d2/d2b/d2e/f84 zero size 2024-09-17T04:21:03.525 INFO:tasks.workunit.client.1.smithi134.stdout:0/743: symlink d11/d4c/dd3/l100 0 2024-09-17T04:21:03.526 INFO:tasks.workunit.client.0.smithi088.stdout:6/368: write d14/d44/d45/d6b/d29/d3e/f33 [4143047,10259] 0 2024-09-17T04:21:03.526 INFO:tasks.workunit.client.0.smithi088.stdout:5/299: readlink d2/l5b 0 2024-09-17T04:21:03.529 INFO:tasks.workunit.client.0.smithi088.stdout:9/389: creat d2/dd/d11/d30/f89 x:0 0 0 2024-09-17T04:21:03.530 INFO:tasks.workunit.client.1.smithi134.stdout:8/713: write d4/d1f/d25/fa4 [1321971,70760] 0 2024-09-17T04:21:03.530 INFO:tasks.workunit.client.0.smithi088.stdout:6/369: mkdir d14/d2f/d87 0 2024-09-17T04:21:03.531 INFO:tasks.workunit.client.0.smithi088.stdout:9/390: stat d2/dd/d11/d1d/d43/d51/f71 0 2024-09-17T04:21:03.532 INFO:tasks.workunit.client.1.smithi134.stdout:5/733: mknod d0/da/d69/d41/db6/cf1 0 2024-09-17T04:21:03.533 INFO:tasks.workunit.client.1.smithi134.stdout:5/734: dread - d0/da/d29/d7c/fd7 zero size 2024-09-17T04:21:03.534 INFO:tasks.workunit.client.0.smithi088.stdout:5/300: dwrite d2/d31/d33/f58 [0,4194304] 0 2024-09-17T04:21:03.534 INFO:tasks.workunit.client.1.smithi134.stdout:1/825: truncate d12/d19/d1d/f6b 5113243 0 2024-09-17T04:21:03.535 INFO:tasks.workunit.client.1.smithi134.stdout:2/728: dwrite d19/d27/d31/d34/df2/d63/f8f [0,4194304] 0 2024-09-17T04:21:03.538 INFO:tasks.workunit.client.1.smithi134.stdout:4/800: readlink d0/df/l3d 0 2024-09-17T04:21:03.538 INFO:tasks.workunit.client.0.smithi088.stdout:9/391: dread d2/fb [0,4194304] 0 2024-09-17T04:21:03.540 INFO:tasks.workunit.client.0.smithi088.stdout:6/370: dread d14/d44/d45/d6b/d16/f62 [0,4194304] 0 2024-09-17T04:21:03.541 INFO:tasks.workunit.client.1.smithi134.stdout:3/867: dwrite de/d12/d15/d1d/d2d/d63/fae [4194304,4194304] 0 2024-09-17T04:21:03.542 INFO:tasks.workunit.client.1.smithi134.stdout:3/868: dread - de/d10/d3d/de2/ff8 zero size 2024-09-17T04:21:03.544 INFO:tasks.workunit.client.0.smithi088.stdout:9/392: creat d2/d2b/d2e/f8a x:0 0 0 2024-09-17T04:21:03.547 INFO:tasks.workunit.client.0.smithi088.stdout:5/301: fdatasync d2/d31/d33/f58 0 2024-09-17T04:21:03.548 INFO:tasks.workunit.client.0.smithi088.stdout:6/371: rmdir d14/d44/d45/d6b/d2a/d52/d7a/d7b 39 2024-09-17T04:21:03.548 INFO:tasks.workunit.client.0.smithi088.stdout:5/302: stat d2 0 2024-09-17T04:21:03.549 INFO:tasks.workunit.client.0.smithi088.stdout:6/372: chown d14/d3a/d41/f84 1715 1 2024-09-17T04:21:03.550 INFO:tasks.workunit.client.0.smithi088.stdout:5/303: write d2/d31/d33/d20/d25/d2c/f52 [881475,71554] 0 2024-09-17T04:21:03.550 INFO:tasks.workunit.client.0.smithi088.stdout:6/373: chown d14/d44/d45/d6b/c1d 990119 1 2024-09-17T04:21:03.551 INFO:tasks.workunit.client.0.smithi088.stdout:9/393: chown d2/d16 234 1 2024-09-17T04:21:03.557 INFO:tasks.workunit.client.0.smithi088.stdout:9/394: rmdir d2/d2b 39 2024-09-17T04:21:03.559 INFO:tasks.workunit.client.0.smithi088.stdout:5/304: symlink d2/d31/d33/d20/d30/l63 0 2024-09-17T04:21:03.560 INFO:tasks.workunit.client.0.smithi088.stdout:6/374: unlink f10 0 2024-09-17T04:21:03.560 INFO:tasks.workunit.client.0.smithi088.stdout:5/305: write d2/d31/d33/d20/d25/d49/f60 [671565,2979] 0 2024-09-17T04:21:03.563 INFO:tasks.workunit.client.0.smithi088.stdout:6/375: truncate d14/d3a/d41/f84 766335 0 2024-09-17T04:21:03.566 INFO:tasks.workunit.client.0.smithi088.stdout:5/306: rename d2/d31/d33/f12 to d2/d31/d33/d20/d25/d49/f64 0 2024-09-17T04:21:03.568 INFO:tasks.workunit.client.0.smithi088.stdout:6/376: mknod d14/d44/d45/d6b/d29/c88 0 2024-09-17T04:21:03.569 INFO:tasks.workunit.client.0.smithi088.stdout:9/395: dwrite d2/d2b/f38 [0,4194304] 0 2024-09-17T04:21:03.569 INFO:tasks.workunit.client.0.smithi088.stdout:5/307: fsync d2/d31/d33/d20/d25/f57 0 2024-09-17T04:21:03.571 INFO:tasks.workunit.client.0.smithi088.stdout:9/396: truncate d2/dd/d11/d30/d49/f42 706653 0 2024-09-17T04:21:03.573 INFO:tasks.workunit.client.0.smithi088.stdout:6/377: stat d14/d44/d45/d6b/d16/c5b 0 2024-09-17T04:21:03.576 INFO:tasks.workunit.client.0.smithi088.stdout:5/308: rename d2/d31/d33/d20/d47/c53 to d2/d31/d33/d20/d30/d51/d5e/c65 0 2024-09-17T04:21:03.579 INFO:tasks.workunit.client.0.smithi088.stdout:9/397: rename d2/dd/d11/d1d to d2/dd/d14/d8b 0 2024-09-17T04:21:03.580 INFO:tasks.workunit.client.0.smithi088.stdout:9/398: dread - d2/dd/f87 zero size 2024-09-17T04:21:03.582 INFO:tasks.workunit.client.0.smithi088.stdout:6/378: rename d14/d44/d45/d6b/d29/d3e/f6f to d14/d44/d45/d6b/d16/d42/f89 0 2024-09-17T04:21:03.585 INFO:tasks.workunit.client.0.smithi088.stdout:9/399: creat d2/d2b/f8c x:0 0 0 2024-09-17T04:21:03.586 INFO:tasks.workunit.client.0.smithi088.stdout:9/400: chown d2/dd/d14/d8b/f24 5336246 1 2024-09-17T04:21:03.586 INFO:tasks.workunit.client.0.smithi088.stdout:6/379: creat d14/d44/f8a x:0 0 0 2024-09-17T04:21:03.588 INFO:tasks.workunit.client.0.smithi088.stdout:9/401: symlink d2/dd/d14/d2a/l8d 0 2024-09-17T04:21:03.589 INFO:tasks.workunit.client.0.smithi088.stdout:9/402: write d2/d2b/f80 [706223,119783] 0 2024-09-17T04:21:03.591 INFO:tasks.workunit.client.0.smithi088.stdout:9/403: chown d2/l39 0 1 2024-09-17T04:21:03.596 INFO:tasks.workunit.client.0.smithi088.stdout:9/404: rename d2/d2b/c67 to d2/d2b/d2e/c8e 0 2024-09-17T04:21:03.607 INFO:tasks.workunit.client.1.smithi134.stdout:0/744: rmdir d11/d24/d49/d62/df7 39 2024-09-17T04:21:03.609 INFO:tasks.workunit.client.1.smithi134.stdout:7/634: link d0/d16/fbc d0/dd/d3a/d3d/d4c/fc6 0 2024-09-17T04:21:03.610 INFO:tasks.workunit.client.1.smithi134.stdout:7/635: fsync d0/dd/d3a/d3d/d38/d60/fa8 0 2024-09-17T04:21:03.611 INFO:tasks.workunit.client.1.smithi134.stdout:8/714: unlink d4/d11/da1/dc7/d5e/f9e 0 2024-09-17T04:21:03.612 INFO:tasks.workunit.client.1.smithi134.stdout:8/715: readlink d4/d11/da1/dc7/l1a 0 2024-09-17T04:21:03.613 INFO:tasks.workunit.client.1.smithi134.stdout:5/735: chown d0/d3a/d6b/d9c/ca2 2248 1 2024-09-17T04:21:03.613 INFO:tasks.workunit.client.1.smithi134.stdout:5/736: chown d0/da/d29/d78/da5/fe7 95509 1 2024-09-17T04:21:03.614 INFO:tasks.workunit.client.1.smithi134.stdout:1/826: creat d12/d19/d1d/d5f/dd7/f117 x:0 0 0 2024-09-17T04:21:03.614 INFO:tasks.workunit.client.1.smithi134.stdout:1/827: chown d12/d19/d5d 375263601 1 2024-09-17T04:21:03.614 INFO:tasks.workunit.client.1.smithi134.stdout:1/828: chown d12/d1c/d2e 0 1 2024-09-17T04:21:03.615 INFO:tasks.workunit.client.1.smithi134.stdout:2/729: creat d19/d1c/d47/dae/ff3 x:0 0 0 2024-09-17T04:21:03.616 INFO:tasks.workunit.client.1.smithi134.stdout:4/801: write d0/d3b/d9f/ff0 [173099,97726] 0 2024-09-17T04:21:03.617 INFO:tasks.workunit.client.1.smithi134.stdout:4/802: stat d0/d13/d40/d42/f4f 0 2024-09-17T04:21:03.618 INFO:tasks.workunit.client.1.smithi134.stdout:0/745: rename l7 to d11/d6f/da8/l101 0 2024-09-17T04:21:03.620 INFO:tasks.workunit.client.1.smithi134.stdout:0/746: write d11/d6f/fb4 [2596024,76283] 0 2024-09-17T04:21:03.620 INFO:tasks.workunit.client.1.smithi134.stdout:7/636: mkdir d0/d16/d8b/dc7 0 2024-09-17T04:21:03.621 INFO:tasks.workunit.client.1.smithi134.stdout:8/716: chown d4/d11/da1/fd3 0 1 2024-09-17T04:21:03.622 INFO:tasks.workunit.client.1.smithi134.stdout:0/747: chown d11/d19/d21/d37 136418478 1 2024-09-17T04:21:03.622 INFO:tasks.workunit.client.1.smithi134.stdout:2/730: dwrite d19/d1c/d47/dae/ff3 [0,4194304] 0 2024-09-17T04:21:03.623 INFO:tasks.workunit.client.1.smithi134.stdout:7/637: fdatasync d0/d16/d8b/d6a/d70/d85/fa4 0 2024-09-17T04:21:03.624 INFO:tasks.workunit.client.1.smithi134.stdout:2/731: readlink d19/d27/d31/d34/df2/d6f/da9/db0/le2 0 2024-09-17T04:21:03.625 INFO:tasks.workunit.client.1.smithi134.stdout:2/732: chown d19/d27/d31/d34 142519455 1 2024-09-17T04:21:03.625 INFO:tasks.workunit.client.1.smithi134.stdout:4/803: creat d0/d13/f105 x:0 0 0 2024-09-17T04:21:03.626 INFO:tasks.workunit.client.1.smithi134.stdout:6/875: getdents de/d19/d1f/d55/d77/d89/d109/dc7/ddc/db3/db4 0 2024-09-17T04:21:03.627 INFO:tasks.workunit.client.1.smithi134.stdout:2/733: write d19/d27/d31/d34/df2/d6f/d84/d98/fe0 [930117,92375] 0 2024-09-17T04:21:03.629 INFO:tasks.workunit.client.1.smithi134.stdout:2/734: chown d19/d27/d31/d34/l6a 163993088 1 2024-09-17T04:21:03.630 INFO:tasks.workunit.client.1.smithi134.stdout:5/737: mkdir d0/d3a/d2b/df2 0 2024-09-17T04:21:03.631 INFO:tasks.workunit.client.1.smithi134.stdout:8/717: mknod d4/d1f/d86/cdc 0 2024-09-17T04:21:03.632 INFO:tasks.workunit.client.0.smithi088.stdout:6/380: write f4 [5504393,31480] 0 2024-09-17T04:21:03.632 INFO:tasks.workunit.client.1.smithi134.stdout:4/804: dwrite d0/d13/f33 [4194304,4194304] 0 2024-09-17T04:21:03.634 INFO:tasks.workunit.client.1.smithi134.stdout:6/876: fsync de/d19/d21/d4d/fa4 0 2024-09-17T04:21:03.691 INFO:tasks.workunit.client.0.smithi088.stdout:2/322: sync 2024-09-17T04:21:03.691 INFO:tasks.workunit.client.0.smithi088.stdout:7/355: sync 2024-09-17T04:21:03.692 INFO:tasks.workunit.client.0.smithi088.stdout:7/356: chown d2/d4/d7/d20/f3c 247411794 1 2024-09-17T04:21:03.693 INFO:tasks.workunit.client.0.smithi088.stdout:7/357: write d2/d1e/f3b [8763514,26406] 0 2024-09-17T04:21:03.723 INFO:tasks.workunit.client.1.smithi134.stdout:5/738: mkdir d0/d3a/d2b/d61/d7b/df3 0 2024-09-17T04:21:03.724 INFO:tasks.workunit.client.1.smithi134.stdout:7/638: creat d0/d16/d8b/dc7/fc8 x:0 0 0 2024-09-17T04:21:03.727 INFO:tasks.workunit.client.1.smithi134.stdout:5/739: dwrite d0/f2a [0,4194304] 0 2024-09-17T04:21:03.728 INFO:tasks.workunit.client.1.smithi134.stdout:8/718: mkdir d4/d1f/d2b/dbf/ddd 0 2024-09-17T04:21:03.728 INFO:tasks.workunit.client.0.smithi088.stdout:9/405: dwrite d2/dd/d11/f1e [4194304,4194304] 0 2024-09-17T04:21:03.729 INFO:tasks.workunit.client.0.smithi088.stdout:9/406: chown d2/dd/d14/d8b 13887711 1 2024-09-17T04:21:03.730 INFO:tasks.workunit.client.1.smithi134.stdout:5/740: read d0/da/d69/d41/d6d/f7f [398278,73136] 0 2024-09-17T04:21:03.735 INFO:tasks.workunit.client.1.smithi134.stdout:8/719: dwrite d4/d1f/d2b/dbf/dcc/fae [0,4194304] 0 2024-09-17T04:21:03.735 INFO:tasks.workunit.client.0.smithi088.stdout:6/381: link d14/d44/f5d d14/d44/d45/d6b/d16/f8b 0 2024-09-17T04:21:03.738 INFO:tasks.workunit.client.1.smithi134.stdout:2/735: unlink d19/d27/d31/d34/lad 0 2024-09-17T04:21:03.739 INFO:tasks.workunit.client.0.smithi088.stdout:9/407: mkdir d2/dd/d14/d2a/d8f 0 2024-09-17T04:21:03.740 INFO:tasks.workunit.client.0.smithi088.stdout:6/382: dread d14/d44/f5d [0,4194304] 0 2024-09-17T04:21:03.743 INFO:tasks.workunit.client.0.smithi088.stdout:7/358: creat d2/d4/d7/f7b x:0 0 0 2024-09-17T04:21:03.744 INFO:tasks.workunit.client.1.smithi134.stdout:0/748: mknod d11/d24/d49/d62/df7/dd8/de2/c102 0 2024-09-17T04:21:03.744 INFO:tasks.workunit.client.0.smithi088.stdout:7/359: fdatasync d2/d1d/f3d 0 2024-09-17T04:21:03.751 INFO:tasks.workunit.client.0.smithi088.stdout:6/383: chown d14/d44/d45/d6b/d16/f6e 37 1 2024-09-17T04:21:03.751 INFO:tasks.workunit.client.1.smithi134.stdout:3/869: write de/d12/d15/d1d/d2d/d31/f55 [877936,3593] 0 2024-09-17T04:21:03.754 INFO:tasks.workunit.client.0.smithi088.stdout:7/360: mknod d2/d1e/d23/d45/d62/c7c 0 2024-09-17T04:21:03.755 INFO:tasks.workunit.client.0.smithi088.stdout:7/361: chown d2/d1e/f5a 26185887 1 2024-09-17T04:21:03.755 INFO:tasks.workunit.client.1.smithi134.stdout:1/829: dwrite d12/d19/f8e [0,4194304] 0 2024-09-17T04:21:03.755 INFO:tasks.workunit.client.1.smithi134.stdout:5/741: rmdir d0/da/d29/d7c 39 2024-09-17T04:21:03.756 INFO:tasks.workunit.client.0.smithi088.stdout:7/362: write d2/d1d/f58 [769334,122645] 0 2024-09-17T04:21:03.757 INFO:tasks.workunit.client.0.smithi088.stdout:7/363: write d2/f1b [810230,104101] 0 2024-09-17T04:21:03.758 INFO:tasks.workunit.client.0.smithi088.stdout:6/384: dread - d14/d44/d45/d6b/d2a/d52/d7a/d7b/f7c zero size 2024-09-17T04:21:03.759 INFO:tasks.workunit.client.0.smithi088.stdout:7/364: dread - d2/d4/d7/d46/d67/f75 zero size 2024-09-17T04:21:03.762 INFO:tasks.workunit.client.1.smithi134.stdout:2/736: symlink d19/d1c/d92/ddc/dc6/ded/lf4 0 2024-09-17T04:21:03.763 INFO:tasks.workunit.client.0.smithi088.stdout:2/323: truncate d0/d1/f2 1769756 0 2024-09-17T04:21:03.764 INFO:tasks.workunit.client.0.smithi088.stdout:2/324: chown d0/c6 48959485 1 2024-09-17T04:21:03.765 INFO:tasks.workunit.client.1.smithi134.stdout:1/830: dread d12/d36/fcd [0,4194304] 0 2024-09-17T04:21:03.766 INFO:tasks.workunit.client.0.smithi088.stdout:2/325: write d0/d1/d2d/d33/d4b/d24/f51 [984373,103560] 0 2024-09-17T04:21:03.766 INFO:tasks.workunit.client.1.smithi134.stdout:6/877: write de/d19/d62/fb9 [1219011,46024] 0 2024-09-17T04:21:03.767 INFO:tasks.workunit.client.0.smithi088.stdout:7/365: rmdir d2/d4/d7 39 2024-09-17T04:21:03.768 INFO:tasks.workunit.client.1.smithi134.stdout:2/737: dread d19/d1c/d47/dae/ff3 [0,4194304] 0 2024-09-17T04:21:03.769 INFO:tasks.workunit.client.0.smithi088.stdout:7/366: truncate d2/d1e/d23/d45/f65 1020467 0 2024-09-17T04:21:03.770 INFO:tasks.workunit.client.1.smithi134.stdout:3/870: chown de/d10/d70/f87 3 1 2024-09-17T04:21:03.773 INFO:tasks.workunit.client.0.smithi088.stdout:2/326: rename d0/d13/c5f to d0/d1/d2d/d33/d4b/d24/c66 0 2024-09-17T04:21:03.774 INFO:tasks.workunit.client.1.smithi134.stdout:7/639: dread d0/d16/d35/d4b/f7c [0,4194304] 0 2024-09-17T04:21:03.775 INFO:tasks.workunit.client.0.smithi088.stdout:7/367: rmdir d2/d1e/d23 39 2024-09-17T04:21:03.775 INFO:tasks.workunit.client.1.smithi134.stdout:7/640: write d0/d16/d35/d4b/fc0 [849092,43421] 0 2024-09-17T04:21:03.777 INFO:tasks.workunit.client.1.smithi134.stdout:7/641: write d0/d16/d8b/d6a/f88 [768329,43640] 0 2024-09-17T04:21:03.780 INFO:tasks.workunit.client.0.smithi088.stdout:7/368: unlink d2/d1d/f6c 0 2024-09-17T04:21:03.780 INFO:tasks.workunit.client.1.smithi134.stdout:7/642: dread d0/d16/f13 [0,4194304] 0 2024-09-17T04:21:03.783 INFO:tasks.workunit.client.1.smithi134.stdout:4/805: truncate d0/d13/d40/d42/d92/f7e 233809 0 2024-09-17T04:21:03.784 INFO:tasks.workunit.client.0.smithi088.stdout:9/408: dwrite d2/dd/f87 [0,4194304] 0 2024-09-17T04:21:03.785 INFO:tasks.workunit.client.1.smithi134.stdout:1/831: symlink d12/db2/l118 0 2024-09-17T04:21:03.789 INFO:tasks.workunit.client.1.smithi134.stdout:6/878: symlink de/d19/d62/db0/l117 0 2024-09-17T04:21:03.791 INFO:tasks.workunit.client.0.smithi088.stdout:9/409: dwrite d2/dd/d14/d8b/d43/d51/f6b [0,4194304] 0 2024-09-17T04:21:03.791 INFO:tasks.workunit.client.0.smithi088.stdout:7/369: rename d2/d1e to d2/d1d/d2e/d7d 0 2024-09-17T04:21:03.794 INFO:tasks.workunit.client.1.smithi134.stdout:2/738: mknod d19/d27/d31/d34/df2/d63/cf5 0 2024-09-17T04:21:03.794 INFO:tasks.workunit.client.0.smithi088.stdout:6/385: dwrite d14/d44/d45/d6b/d16/f8b [0,4194304] 0 2024-09-17T04:21:03.795 INFO:tasks.workunit.client.1.smithi134.stdout:0/749: write d11/d4c/f84 [714433,63069] 0 2024-09-17T04:21:03.795 INFO:tasks.workunit.client.0.smithi088.stdout:2/327: dread d0/d18/f3e [0,4194304] 0 2024-09-17T04:21:03.797 INFO:tasks.workunit.client.1.smithi134.stdout:3/871: creat de/d12/d15/d1d/d2d/d31/d6a/d83/da7/f11b x:0 0 0 2024-09-17T04:21:03.799 INFO:tasks.workunit.client.1.smithi134.stdout:3/872: write de/d10/d3d/ff5 [608700,18611] 0 2024-09-17T04:21:03.802 INFO:tasks.workunit.client.0.smithi088.stdout:7/370: write d2/d1d/d2e/d7d/d23/d45/f63 [786070,78458] 0 2024-09-17T04:21:03.803 INFO:tasks.workunit.client.1.smithi134.stdout:2/739: dwrite d19/d27/d31/d34/df2/d6f/d84/d98/feb [0,4194304] 0 2024-09-17T04:21:03.804 INFO:tasks.workunit.client.1.smithi134.stdout:2/740: readlink d19/d27/la8 0 2024-09-17T04:21:03.804 INFO:tasks.workunit.client.0.smithi088.stdout:7/371: truncate d2/d1d/d2e/d7d/f4a 844743 0 2024-09-17T04:21:03.809 INFO:tasks.workunit.client.0.smithi088.stdout:9/410: rename d2/dd/d14/c2c to d2/dd/d11/c90 0 2024-09-17T04:21:03.819 INFO:tasks.workunit.client.0.smithi088.stdout:6/386: rename d14/d44/d45/d6b/d2a/d52/d7a/l86 to d14/d44/d45/d6b/d2a/l8c 0 2024-09-17T04:21:03.820 INFO:tasks.workunit.client.1.smithi134.stdout:1/832: symlink d12/db2/l119 0 2024-09-17T04:21:03.821 INFO:tasks.workunit.client.0.smithi088.stdout:9/411: getdents d2/dd/d14/d2a/d76 0 2024-09-17T04:21:03.824 INFO:tasks.workunit.client.0.smithi088.stdout:6/387: creat d14/d44/d45/d6b/d2a/f8d x:0 0 0 2024-09-17T04:21:03.825 INFO:tasks.workunit.client.1.smithi134.stdout:0/750: fdatasync d11/d18/d97/df3/d43/f94 0 2024-09-17T04:21:03.825 INFO:tasks.workunit.client.0.smithi088.stdout:6/388: readlink d14/d3a/d41/l80 0 2024-09-17T04:21:03.826 INFO:tasks.workunit.client.1.smithi134.stdout:0/751: truncate d11/d18/d97/df3/fef 208506 0 2024-09-17T04:21:03.826 INFO:tasks.workunit.client.0.smithi088.stdout:6/389: dread - d14/d44/d45/d6b/d2a/d52/d7a/f75 zero size 2024-09-17T04:21:03.827 INFO:tasks.workunit.client.0.smithi088.stdout:2/328: dread d0/d1/d2d/d33/d4b/d24/f2c [0,4194304] 0 2024-09-17T04:21:03.828 INFO:tasks.workunit.client.0.smithi088.stdout:9/412: mknod d2/d16/c91 0 2024-09-17T04:21:03.830 INFO:tasks.workunit.client.1.smithi134.stdout:3/873: creat de/d12/d15/dd0/dfe/f11c x:0 0 0 2024-09-17T04:21:03.832 INFO:tasks.workunit.client.0.smithi088.stdout:6/390: creat d14/d44/f8e x:0 0 0 2024-09-17T04:21:03.833 INFO:tasks.workunit.client.1.smithi134.stdout:2/741: fsync d19/f73 0 2024-09-17T04:21:03.833 INFO:tasks.workunit.client.0.smithi088.stdout:7/372: dread d2/d4/f18 [0,4194304] 0 2024-09-17T04:21:03.834 INFO:tasks.workunit.client.0.smithi088.stdout:2/329: dread - d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/f5b zero size 2024-09-17T04:21:03.835 INFO:tasks.workunit.client.1.smithi134.stdout:7/643: write d0/d16/d35/f40 [2755189,109922] 0 2024-09-17T04:21:03.835 INFO:tasks.workunit.client.0.smithi088.stdout:7/373: readlink d2/d1d/d2e/d7d/l41 0 2024-09-17T04:21:03.836 INFO:tasks.workunit.client.0.smithi088.stdout:7/374: readlink d2/d1d/d2e/l4c 0 2024-09-17T04:21:03.837 INFO:tasks.workunit.client.1.smithi134.stdout:8/720: getdents d4/d1f/d86/d9f 0 2024-09-17T04:21:03.838 INFO:tasks.workunit.client.1.smithi134.stdout:8/721: chown d4/d1e/l3c 58605 1 2024-09-17T04:21:03.839 INFO:tasks.workunit.client.0.smithi088.stdout:6/391: mknod d14/d44/d45/d6b/d29/d3e/c8f 0 2024-09-17T04:21:03.840 INFO:tasks.workunit.client.0.smithi088.stdout:1/355: sync 2024-09-17T04:21:03.840 INFO:tasks.workunit.client.0.smithi088.stdout:9/413: unlink d2/d2b/d2e/c3e 0 2024-09-17T04:21:03.842 INFO:tasks.workunit.client.0.smithi088.stdout:9/414: dread - d2/dd/d14/d8b/d35/f5f zero size 2024-09-17T04:21:03.842 INFO:tasks.workunit.client.1.smithi134.stdout:6/879: dwrite de/d19/d62/fc8 [0,4194304] 0 2024-09-17T04:21:03.843 INFO:tasks.workunit.client.1.smithi134.stdout:0/752: dread d11/d24/f28 [0,4194304] 0 2024-09-17T04:21:03.843 INFO:tasks.workunit.client.0.smithi088.stdout:7/375: symlink d2/d1d/d2e/d7d/d23/d45/d62/l7e 0 2024-09-17T04:21:03.844 INFO:tasks.workunit.client.0.smithi088.stdout:9/415: truncate d2/dd/d14/d8b/d35/f5f 381385 0 2024-09-17T04:21:03.845 INFO:tasks.workunit.client.0.smithi088.stdout:7/376: write d2/d1d/d2e/d7d/f3b [5233072,48179] 0 2024-09-17T04:21:03.846 INFO:tasks.workunit.client.0.smithi088.stdout:6/392: readlink d14/d44/d45/d6b/d16/l18 0 2024-09-17T04:21:03.848 INFO:tasks.workunit.client.0.smithi088.stdout:1/356: write d0/d13/f60 [3305457,99381] 0 2024-09-17T04:21:03.850 INFO:tasks.workunit.client.1.smithi134.stdout:4/806: write d0/df/d1e/f5e [710928,11830] 0 2024-09-17T04:21:03.853 INFO:tasks.workunit.client.0.smithi088.stdout:9/416: read d2/f8 [23292,95273] 0 2024-09-17T04:21:03.854 INFO:tasks.workunit.client.1.smithi134.stdout:2/742: unlink d19/d1c/d47/d50/l58 0 2024-09-17T04:21:03.854 INFO:tasks.workunit.client.1.smithi134.stdout:2/743: chown d19/d27 4 1 2024-09-17T04:21:03.855 INFO:tasks.workunit.client.0.smithi088.stdout:2/330: dread d0/f12 [0,4194304] 0 2024-09-17T04:21:03.855 INFO:tasks.workunit.client.0.smithi088.stdout:6/393: mkdir d14/d44/d45/d6b/d2a/d52/d90 0 2024-09-17T04:21:03.856 INFO:tasks.workunit.client.0.smithi088.stdout:1/357: creat d0/d1/d16/d35/f7c x:0 0 0 2024-09-17T04:21:03.857 INFO:tasks.workunit.client.1.smithi134.stdout:1/833: dwrite d12/d1c/d2e/d7d/f98 [0,4194304] 0 2024-09-17T04:21:03.857 INFO:tasks.workunit.client.1.smithi134.stdout:5/742: getdents d0/da/d69/d41/d6d/d89 0 2024-09-17T04:21:03.858 INFO:tasks.workunit.client.1.smithi134.stdout:8/722: mknod d4/db/dd/d43/cde 0 2024-09-17T04:21:03.859 INFO:tasks.workunit.client.0.smithi088.stdout:1/358: truncate d0/d1/df/d20/d4e/d5d/f65 53119 0 2024-09-17T04:21:03.859 INFO:tasks.workunit.client.0.smithi088.stdout:9/417: symlink d2/dd/d11/d30/d49/l92 0 2024-09-17T04:21:03.861 INFO:tasks.workunit.client.0.smithi088.stdout:7/377: rename d2/d4/d7/d46/d67/l73 to d2/d1d/d2e/d7d/d23/l7f 0 2024-09-17T04:21:03.862 INFO:tasks.workunit.client.0.smithi088.stdout:6/394: symlink d14/d44/d61/l91 0 2024-09-17T04:21:03.865 INFO:tasks.workunit.client.0.smithi088.stdout:2/331: creat d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/f67 x:0 0 0 2024-09-17T04:21:03.867 INFO:tasks.workunit.client.1.smithi134.stdout:8/723: dwrite d4/db/dd/da2/fcb [0,4194304] 0 2024-09-17T04:21:03.869 INFO:tasks.workunit.client.0.smithi088.stdout:7/378: dwrite d2/d1d/d2e/d7d/f5e [0,4194304] 0 2024-09-17T04:21:03.870 INFO:tasks.workunit.client.0.smithi088.stdout:9/418: mkdir d2/dd/d14/d8b/d43/d51/d93 0 2024-09-17T04:21:03.873 INFO:tasks.workunit.client.0.smithi088.stdout:2/332: dread d0/d1/d2d/d33/d4b/d24/f51 [0,4194304] 0 2024-09-17T04:21:03.875 INFO:tasks.workunit.client.1.smithi134.stdout:4/807: creat d0/d13/d40/d42/d92/d65/dff/f106 x:0 0 0 2024-09-17T04:21:03.876 INFO:tasks.workunit.client.1.smithi134.stdout:4/808: write d0/df/d35/d5c/d8b/fc4 [1827511,117736] 0 2024-09-17T04:21:03.876 INFO:tasks.workunit.client.1.smithi134.stdout:7/644: mknod d0/cc9 0 2024-09-17T04:21:03.877 INFO:tasks.workunit.client.1.smithi134.stdout:7/645: stat d0/dd/fb4 0 2024-09-17T04:21:03.878 INFO:tasks.workunit.client.1.smithi134.stdout:2/744: creat d19/d1c/d92/ff6 x:0 0 0 2024-09-17T04:21:03.880 INFO:tasks.workunit.client.0.smithi088.stdout:6/395: mkdir d14/d44/d45/d6b/d16/d42/d92 0 2024-09-17T04:21:03.880 INFO:tasks.workunit.client.1.smithi134.stdout:1/834: dread d12/d19/d1d/d5f/f87 [0,4194304] 0 2024-09-17T04:21:03.881 INFO:tasks.workunit.client.1.smithi134.stdout:1/835: readlink d12/lbe 0 2024-09-17T04:21:03.882 INFO:tasks.workunit.client.0.smithi088.stdout:9/419: rename d2/dd/d14/d8b/d43/d51/d93 to d2/dd/d14/d8b/d35/d94 0 2024-09-17T04:21:03.883 INFO:tasks.workunit.client.1.smithi134.stdout:8/724: rmdir d4/d11 39 2024-09-17T04:21:03.888 INFO:tasks.workunit.client.0.smithi088.stdout:6/396: mknod d14/d44/d45/d6b/d2a/d52/c93 0 2024-09-17T04:21:03.889 INFO:tasks.workunit.client.1.smithi134.stdout:6/880: dread de/d19/d1f/d55/f68 [0,4194304] 0 2024-09-17T04:21:03.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:03 smithi088 ceph-mon[27811]: from='client.14818 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:21:03.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:03 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/3772138258' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T04:21:03.889 INFO:tasks.workunit.client.0.smithi088.stdout:9/420: dwrite d2/dd/d14/d8b/f7e [0,4194304] 0 2024-09-17T04:21:03.891 INFO:tasks.workunit.client.0.smithi088.stdout:9/421: write d2/d2b/d2e/f84 [686684,50800] 0 2024-09-17T04:21:03.891 INFO:tasks.workunit.client.0.smithi088.stdout:2/333: symlink d0/l68 0 2024-09-17T04:21:03.892 INFO:tasks.workunit.client.0.smithi088.stdout:9/422: chown d2/dd/d14/d8b/f4d 1637 1 2024-09-17T04:21:03.895 INFO:tasks.workunit.client.0.smithi088.stdout:1/359: getdents d0/d1/d27 0 2024-09-17T04:21:03.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:03 smithi134 ceph-mon[35201]: from='client.14818 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:21:03.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:03 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/3772138258' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T04:21:03.896 INFO:tasks.workunit.client.1.smithi134.stdout:3/874: write de/d10/d3d/f43 [547741,118528] 0 2024-09-17T04:21:03.899 INFO:tasks.workunit.client.1.smithi134.stdout:5/743: truncate d0/f47 1782068 0 2024-09-17T04:21:03.900 INFO:tasks.workunit.client.1.smithi134.stdout:1/836: creat d12/d19/d4f/f11a x:0 0 0 2024-09-17T04:21:03.901 INFO:tasks.workunit.client.0.smithi088.stdout:6/397: rename d14/d44/d61 to d14/d44/d94 0 2024-09-17T04:21:03.904 INFO:tasks.workunit.client.0.smithi088.stdout:1/360: fsync d0/d1/df/d20/d4e/d5d/f78 0 2024-09-17T04:21:03.905 INFO:tasks.workunit.client.0.smithi088.stdout:1/361: readlink d0/d1/df/d20/d4e/d5d/l75 0 2024-09-17T04:21:03.906 INFO:tasks.workunit.client.0.smithi088.stdout:1/362: dread d0/d1/df/d20/d4e/d5d/f65 [0,4194304] 0 2024-09-17T04:21:03.906 INFO:tasks.workunit.client.0.smithi088.stdout:6/398: unlink d14/d44/d45/d6b/c1d 0 2024-09-17T04:21:03.909 INFO:tasks.workunit.client.1.smithi134.stdout:6/881: mkdir de/d2b/df3/d118 0 2024-09-17T04:21:03.910 INFO:tasks.workunit.client.1.smithi134.stdout:4/809: write d0/df/d17/f90 [997788,121364] 0 2024-09-17T04:21:03.913 INFO:tasks.workunit.client.0.smithi088.stdout:7/379: dwrite d2/d4/d7/d20/f22 [0,4194304] 0 2024-09-17T04:21:03.916 INFO:tasks.workunit.client.0.smithi088.stdout:9/423: dread d2/dd/d14/f20 [0,4194304] 0 2024-09-17T04:21:03.918 INFO:tasks.workunit.client.0.smithi088.stdout:9/424: truncate d2/dd/d14/d8b/d35/f88 977336 0 2024-09-17T04:21:03.918 INFO:tasks.workunit.client.1.smithi134.stdout:2/745: dwrite d19/d27/d31/d34/f70 [0,4194304] 0 2024-09-17T04:21:03.918 INFO:tasks.workunit.client.0.smithi088.stdout:5/309: sync 2024-09-17T04:21:03.919 INFO:tasks.workunit.client.0.smithi088.stdout:3/340: sync 2024-09-17T04:21:03.919 INFO:tasks.workunit.client.0.smithi088.stdout:4/361: sync 2024-09-17T04:21:03.919 INFO:tasks.workunit.client.0.smithi088.stdout:0/218: sync 2024-09-17T04:21:03.919 INFO:tasks.workunit.client.0.smithi088.stdout:8/344: sync 2024-09-17T04:21:03.919 INFO:tasks.workunit.client.0.smithi088.stdout:8/345: readlink d7/l17 0 2024-09-17T04:21:03.919 INFO:tasks.workunit.client.1.smithi134.stdout:2/746: chown d19/d27/d31/d34/df2/d63/l75 78 1 2024-09-17T04:21:03.920 INFO:tasks.workunit.client.0.smithi088.stdout:2/334: link d0/d1/d2d/d33/d4b/c15 d0/d1/d2d/d33/d65/c69 0 2024-09-17T04:21:03.923 INFO:tasks.workunit.client.1.smithi134.stdout:5/744: symlink d0/da/d69/d41/d72/lf4 0 2024-09-17T04:21:03.927 INFO:tasks.workunit.client.0.smithi088.stdout:9/425: dwrite d2/d2b/d58/d82/f83 [0,4194304] 0 2024-09-17T04:21:03.930 INFO:tasks.workunit.client.1.smithi134.stdout:0/753: getdents d11/d24/d49/d62 0 2024-09-17T04:21:03.933 INFO:tasks.workunit.client.0.smithi088.stdout:1/363: mknod d0/d1/df/d20/c7d 0 2024-09-17T04:21:03.935 INFO:tasks.workunit.client.1.smithi134.stdout:8/725: unlink d4/d11/d5f/fb5 0 2024-09-17T04:21:03.936 INFO:tasks.workunit.client.1.smithi134.stdout:1/837: dread d12/d19/d1d/f9f [0,4194304] 0 2024-09-17T04:21:03.938 INFO:tasks.workunit.client.0.smithi088.stdout:6/399: mkdir d14/d44/d45/d6b/d16/d42/d92/d95 0 2024-09-17T04:21:03.938 INFO:tasks.workunit.client.1.smithi134.stdout:4/810: readlink d0/d13/d40/d42/d92/l103 0 2024-09-17T04:21:03.940 INFO:tasks.workunit.client.1.smithi134.stdout:7/646: rmdir d0/d16/d35/dbe 0 2024-09-17T04:21:03.942 INFO:tasks.workunit.client.0.smithi088.stdout:0/219: rename db/d1a to db/d1b/d36/d4a 0 2024-09-17T04:21:03.944 INFO:tasks.workunit.client.1.smithi134.stdout:3/875: mkdir de/d12/d22/dfd/d11d 0 2024-09-17T04:21:03.944 INFO:tasks.workunit.client.0.smithi088.stdout:6/400: dwrite d14/d44/d45/d6b/d29/d3e/f37 [0,4194304] 0 2024-09-17T04:21:03.945 INFO:tasks.workunit.client.1.smithi134.stdout:3/876: dread - de/d12/d15/d1d/d2d/d31/d6a/f10e zero size 2024-09-17T04:21:03.947 INFO:tasks.workunit.client.0.smithi088.stdout:6/401: chown d14/d44/d45/d6b/d16/d42/f89 443 1 2024-09-17T04:21:03.947 INFO:tasks.workunit.client.0.smithi088.stdout:2/335: unlink d0/d1/d2d/c2f 0 2024-09-17T04:21:03.949 INFO:tasks.workunit.client.0.smithi088.stdout:6/402: chown d14/d44/d45/d6b/d29/d3e/c8f 200324 1 2024-09-17T04:21:03.950 INFO:tasks.workunit.client.0.smithi088.stdout:8/346: creat d7/d29/f6e x:0 0 0 2024-09-17T04:21:03.956 INFO:tasks.workunit.client.1.smithi134.stdout:8/726: rename d4/d1f/d25/c27 to d4/d11/d5f/cdf 0 2024-09-17T04:21:03.958 INFO:tasks.workunit.client.0.smithi088.stdout:9/426: dread d2/dd/f4c [0,4194304] 0 2024-09-17T04:21:03.959 INFO:tasks.workunit.client.0.smithi088.stdout:1/364: unlink d0/d1/d16/d2a/l4d 0 2024-09-17T04:21:03.960 INFO:tasks.workunit.client.1.smithi134.stdout:6/882: write de/d2b/fa0 [519277,63504] 0 2024-09-17T04:21:03.963 INFO:tasks.workunit.client.1.smithi134.stdout:4/811: mknod d0/d13/d40/d42/d92/d65/c107 0 2024-09-17T04:21:03.965 INFO:tasks.workunit.client.1.smithi134.stdout:7/647: fsync d0/dd/fb4 0 2024-09-17T04:21:03.966 INFO:tasks.workunit.client.1.smithi134.stdout:7/648: dread - d0/dd/d3a/d3d/d4c/fb1 zero size 2024-09-17T04:21:03.967 INFO:tasks.workunit.client.1.smithi134.stdout:7/649: chown d0/d16/d8b/d6a/f88 412 1 2024-09-17T04:21:03.968 INFO:tasks.workunit.client.0.smithi088.stdout:5/310: mknod d2/d31/d33/d20/d25/d2c/d3d/c66 0 2024-09-17T04:21:03.968 INFO:tasks.workunit.client.0.smithi088.stdout:4/362: dwrite d5/d3d/f42 [0,4194304] 0 2024-09-17T04:21:03.975 INFO:tasks.workunit.client.0.smithi088.stdout:3/341: link d0/d13/f28 d0/d13/d4d/f6c 0 2024-09-17T04:21:03.977 INFO:tasks.workunit.client.1.smithi134.stdout:0/754: link d11/d4c/ffd d11/d24/d49/d62/f103 0 2024-09-17T04:21:03.978 INFO:tasks.workunit.client.0.smithi088.stdout:2/336: creat d0/d1/d2d/f6a x:0 0 0 2024-09-17T04:21:03.979 INFO:tasks.workunit.client.1.smithi134.stdout:3/877: rename de/d12/d15/d1d/d2d/c10c to de/d12/d15/c11e 0 2024-09-17T04:21:03.980 INFO:tasks.workunit.client.1.smithi134.stdout:5/745: dwrite d0/d3a/f3f [0,4194304] 0 2024-09-17T04:21:03.980 INFO:tasks.workunit.client.1.smithi134.stdout:7/650: dread d0/dd/d3a/d3d/d38/d74/f7f [0,4194304] 0 2024-09-17T04:21:03.984 INFO:tasks.workunit.client.1.smithi134.stdout:6/883: mkdir de/d19/d1f/d85/dde/d119 0 2024-09-17T04:21:03.986 INFO:tasks.workunit.client.1.smithi134.stdout:3/878: dwrite de/d10/d3d/dd9/ff1 [0,4194304] 0 2024-09-17T04:21:03.988 INFO:tasks.workunit.client.0.smithi088.stdout:7/380: creat d2/d1d/d2e/d7d/f80 x:0 0 0 2024-09-17T04:21:03.990 INFO:tasks.workunit.client.0.smithi088.stdout:8/347: dwrite d7/dd/fe [0,4194304] 0 2024-09-17T04:21:03.991 INFO:tasks.workunit.client.1.smithi134.stdout:4/812: creat d0/d13/d40/d42/d92/d7b/dc9/f108 x:0 0 0 2024-09-17T04:21:03.992 INFO:tasks.workunit.client.0.smithi088.stdout:9/427: creat d2/d2b/d58/d82/f95 x:0 0 0 2024-09-17T04:21:03.995 INFO:tasks.workunit.client.1.smithi134.stdout:1/838: dwrite d12/d19/d1d/d61/dd3/dda/d85/fbb [0,4194304] 0 2024-09-17T04:21:03.995 INFO:tasks.workunit.client.1.smithi134.stdout:2/747: link d19/d27/d31/l4f d19/d27/d31/d34/df2/d63/d94/d80/lf7 0 2024-09-17T04:21:03.996 INFO:tasks.workunit.client.1.smithi134.stdout:2/748: chown d19/d1c/fef 23327612 1 2024-09-17T04:21:03.998 INFO:tasks.workunit.client.1.smithi134.stdout:2/749: fdatasync d19/d1c/d92/fd4 0 2024-09-17T04:21:04.001 INFO:tasks.workunit.client.1.smithi134.stdout:7/651: unlink d0/d16/l43 0 2024-09-17T04:21:04.001 INFO:tasks.workunit.client.0.smithi088.stdout:0/220: dwrite db/f13 [0,4194304] 0 2024-09-17T04:21:04.004 INFO:tasks.workunit.client.0.smithi088.stdout:0/221: write db/f10 [3686326,30849] 0 2024-09-17T04:21:04.005 INFO:tasks.workunit.client.0.smithi088.stdout:3/342: rename d0/d54/d55/c59 to d0/d13/d58/d5a/d63/c6d 0 2024-09-17T04:21:04.007 INFO:tasks.workunit.client.0.smithi088.stdout:0/222: write f0 [3526751,78926] 0 2024-09-17T04:21:04.008 INFO:tasks.workunit.client.0.smithi088.stdout:5/311: dwrite d2/d31/d33/d20/d25/d49/f64 [0,4194304] 0 2024-09-17T04:21:04.010 INFO:tasks.workunit.client.0.smithi088.stdout:0/223: fsync db/d1b/d36/d4a/d20/f2c 0 2024-09-17T04:21:04.012 INFO:tasks.workunit.client.0.smithi088.stdout:0/224: write db/f13 [521595,30549] 0 2024-09-17T04:21:04.015 INFO:tasks.workunit.client.1.smithi134.stdout:4/813: symlink d0/df/d35/l109 0 2024-09-17T04:21:04.017 INFO:tasks.workunit.client.1.smithi134.stdout:4/814: write d0/d13/d40/d42/d92/d65/dc2/ff1 [125560,48007] 0 2024-09-17T04:21:04.019 INFO:tasks.workunit.client.0.smithi088.stdout:8/348: rmdir d7 39 2024-09-17T04:21:04.020 INFO:tasks.workunit.client.0.smithi088.stdout:5/312: dwrite d2/d31/d33/d20/d25/d49/f5f [0,4194304] 0 2024-09-17T04:21:04.029 INFO:tasks.workunit.client.0.smithi088.stdout:5/313: dwrite d2/d31/d33/d20/f23 [4194304,4194304] 0 2024-09-17T04:21:04.034 INFO:tasks.workunit.client.1.smithi134.stdout:0/755: write d11/d18/f1e [4038639,79323] 0 2024-09-17T04:21:04.035 INFO:tasks.workunit.client.1.smithi134.stdout:5/746: creat d0/da/d29/d7c/ddf/ff5 x:0 0 0 2024-09-17T04:21:04.037 INFO:tasks.workunit.client.1.smithi134.stdout:6/884: write de/d19/d21/d4d/fa4 [581947,106561] 0 2024-09-17T04:21:04.042 INFO:tasks.workunit.client.1.smithi134.stdout:7/652: fdatasync d0/d16/d35/d4b/f48 0 2024-09-17T04:21:04.046 INFO:tasks.workunit.client.0.smithi088.stdout:6/403: creat d14/d44/d45/d6b/f96 x:0 0 0 2024-09-17T04:21:04.048 INFO:tasks.workunit.client.1.smithi134.stdout:3/879: truncate de/d12/d15/d1d/d8f/f10f 1523047 0 2024-09-17T04:21:04.049 INFO:tasks.workunit.client.1.smithi134.stdout:2/750: mkdir d19/df8 0 2024-09-17T04:21:04.049 INFO:tasks.workunit.client.1.smithi134.stdout:2/751: chown d19/d27/d31/d34/d42/fb8 339556673 1 2024-09-17T04:21:04.050 INFO:tasks.workunit.client.1.smithi134.stdout:2/752: chown d19/d1c/d47/dae/dc8 0 1 2024-09-17T04:21:04.053 INFO:tasks.workunit.client.1.smithi134.stdout:6/885: rmdir de/d2b 39 2024-09-17T04:21:04.061 INFO:tasks.workunit.client.1.smithi134.stdout:1/839: dwrite d12/d19/f54 [0,4194304] 0 2024-09-17T04:21:04.061 INFO:tasks.workunit.client.0.smithi088.stdout:4/363: link d5/f2d d5/d32/f79 0 2024-09-17T04:21:04.063 INFO:tasks.workunit.client.1.smithi134.stdout:0/756: mknod d11/d4c/c104 0 2024-09-17T04:21:04.063 INFO:tasks.workunit.client.0.smithi088.stdout:5/314: readlink d2/d31/d33/l24 0 2024-09-17T04:21:04.065 INFO:tasks.workunit.client.0.smithi088.stdout:3/343: mknod d0/d13/d1b/d29/d30/d35/d65/c6e 0 2024-09-17T04:21:04.067 INFO:tasks.workunit.client.1.smithi134.stdout:5/747: mkdir d0/d3a/d2b/d5a/df6 0 2024-09-17T04:21:04.068 INFO:tasks.workunit.client.1.smithi134.stdout:6/886: mknod de/d19/d62/d7c/d108/c11a 0 2024-09-17T04:21:04.069 INFO:tasks.workunit.client.1.smithi134.stdout:6/887: chown de/d19/d1f/d5c/c110 2 1 2024-09-17T04:21:04.073 INFO:tasks.workunit.client.0.smithi088.stdout:6/404: read d14/d44/d45/d6b/f39 [3842697,48451] 0 2024-09-17T04:21:04.073 INFO:tasks.workunit.client.0.smithi088.stdout:0/225: symlink db/d1b/d36/d4a/l4b 0 2024-09-17T04:21:04.074 INFO:tasks.workunit.client.0.smithi088.stdout:7/381: creat d2/d4/f81 x:0 0 0 2024-09-17T04:21:04.075 INFO:tasks.workunit.client.1.smithi134.stdout:4/815: write d0/df/d1e/dbc/fc6 [504983,49080] 0 2024-09-17T04:21:04.076 INFO:tasks.workunit.client.1.smithi134.stdout:4/816: write d0/df/d1e/d73/fda [3014223,72703] 0 2024-09-17T04:21:04.077 INFO:tasks.workunit.client.0.smithi088.stdout:7/382: chown d2/d1d/d2e/d7d/f5a 7 1 2024-09-17T04:21:04.078 INFO:tasks.workunit.client.0.smithi088.stdout:9/428: creat d2/dd/d11/f96 x:0 0 0 2024-09-17T04:21:04.079 INFO:tasks.workunit.client.0.smithi088.stdout:1/365: link d0/d13/l4c d0/l7e 0 2024-09-17T04:21:04.082 INFO:tasks.workunit.client.0.smithi088.stdout:0/226: dwrite db/f2a [4194304,4194304] 0 2024-09-17T04:21:04.082 INFO:tasks.workunit.client.0.smithi088.stdout:5/315: chown d2/l29 33452 1 2024-09-17T04:21:04.083 INFO:tasks.workunit.client.0.smithi088.stdout:7/383: write d2/d4/d7/d20/f3c [468428,125352] 0 2024-09-17T04:21:04.084 INFO:tasks.workunit.client.1.smithi134.stdout:3/880: dread de/d10/d3d/f94 [0,4194304] 0 2024-09-17T04:21:04.085 INFO:tasks.workunit.client.0.smithi088.stdout:3/344: symlink d0/d13/d58/d5e/l6f 0 2024-09-17T04:21:04.088 INFO:tasks.workunit.client.0.smithi088.stdout:2/337: link d0/d1/cf d0/d18/c6b 0 2024-09-17T04:21:04.090 INFO:tasks.workunit.client.1.smithi134.stdout:7/653: rename d0/d16/f13 to d0/dd/d3a/d3d/d38/d60/fca 0 2024-09-17T04:21:04.094 INFO:tasks.workunit.client.0.smithi088.stdout:0/227: dwrite db/d1b/d36/d47/f32 [0,4194304] 0 2024-09-17T04:21:04.097 INFO:tasks.workunit.client.0.smithi088.stdout:8/349: mkdir d7/dd/d6f 0 2024-09-17T04:21:04.098 INFO:tasks.workunit.client.0.smithi088.stdout:2/338: dwrite d0/d1/d2d/d33/f38 [0,4194304] 0 2024-09-17T04:21:04.100 INFO:tasks.workunit.client.1.smithi134.stdout:4/817: creat d0/d13/d40/d42/f10a x:0 0 0 2024-09-17T04:21:04.101 INFO:tasks.workunit.client.0.smithi088.stdout:8/350: truncate d7/d29/d2a/d38/d42/f5b 847515 0 2024-09-17T04:21:04.102 INFO:tasks.workunit.client.1.smithi134.stdout:1/840: mkdir d12/d1c/d100/d11b 0 2024-09-17T04:21:04.103 INFO:tasks.workunit.client.1.smithi134.stdout:1/841: readlink d12/d19/d1d/d5f/l9a 0 2024-09-17T04:21:04.105 INFO:tasks.workunit.client.1.smithi134.stdout:5/748: symlink d0/da/d29/d78/da5/lf7 0 2024-09-17T04:21:04.106 INFO:tasks.workunit.client.0.smithi088.stdout:3/345: mknod d0/d54/d55/c70 0 2024-09-17T04:21:04.109 INFO:tasks.workunit.client.0.smithi088.stdout:7/384: mkdir d2/d1d/d2e/d7d/d23/d45/d62/d82 0 2024-09-17T04:21:04.109 INFO:tasks.workunit.client.1.smithi134.stdout:4/818: dwrite d0/d3b/f52 [4194304,4194304] 0 2024-09-17T04:21:04.109 INFO:tasks.workunit.client.1.smithi134.stdout:5/749: read d0/da/d2c/f63 [1720538,70688] 0 2024-09-17T04:21:04.111 INFO:tasks.workunit.client.0.smithi088.stdout:8/351: dwrite d7/d29/d2a/f2b [4194304,4194304] 0 2024-09-17T04:21:04.114 INFO:tasks.workunit.client.1.smithi134.stdout:0/757: mkdir d11/d24/d49/d62/df7/dd8/de2/d105 0 2024-09-17T04:21:04.116 INFO:tasks.workunit.client.1.smithi134.stdout:2/753: getdents d19/d1c/d47 0 2024-09-17T04:21:04.117 INFO:tasks.workunit.client.0.smithi088.stdout:2/339: fsync d0/d1/f1e 0 2024-09-17T04:21:04.117 INFO:tasks.workunit.client.1.smithi134.stdout:1/842: mkdir d12/db2/d11c 0 2024-09-17T04:21:04.118 INFO:tasks.workunit.client.0.smithi088.stdout:4/364: creat d5/d3d/f7a x:0 0 0 2024-09-17T04:21:04.119 INFO:tasks.workunit.client.0.smithi088.stdout:4/365: readlink d5/l45 0 2024-09-17T04:21:04.119 INFO:tasks.workunit.client.1.smithi134.stdout:3/881: mknod de/d12/d15/d1d/d2d/d63/c11f 0 2024-09-17T04:21:04.120 INFO:tasks.workunit.client.1.smithi134.stdout:3/882: dread - de/d12/d15/d1d/d8f/deb/f100 zero size 2024-09-17T04:21:04.124 INFO:tasks.workunit.client.0.smithi088.stdout:6/405: dwrite d14/d44/d45/d6b/d2a/d52/d7a/f83 [0,4194304] 0 2024-09-17T04:21:04.125 INFO:tasks.workunit.client.1.smithi134.stdout:0/758: creat d11/d18/d97/df3/d43/f106 x:0 0 0 2024-09-17T04:21:04.125 INFO:tasks.workunit.client.0.smithi088.stdout:5/316: dread d2/f1d [0,4194304] 0 2024-09-17T04:21:04.126 INFO:tasks.workunit.client.0.smithi088.stdout:5/317: chown d2/d31/d33/l1a 300 1 2024-09-17T04:21:04.126 INFO:tasks.workunit.client.0.smithi088.stdout:3/346: fdatasync d0/d13/f53 0 2024-09-17T04:21:04.128 INFO:tasks.workunit.client.1.smithi134.stdout:2/754: creat d19/d27/d31/d34/df2/dc3/ff9 x:0 0 0 2024-09-17T04:21:04.130 INFO:tasks.workunit.client.0.smithi088.stdout:3/347: stat d0/d13/d4d 0 2024-09-17T04:21:04.130 INFO:tasks.workunit.client.0.smithi088.stdout:8/352: creat d7/dd/d31/f70 x:0 0 0 2024-09-17T04:21:04.130 INFO:tasks.workunit.client.0.smithi088.stdout:3/348: stat d0/d13/d4d/c4f 0 2024-09-17T04:21:04.130 INFO:tasks.workunit.client.1.smithi134.stdout:1/843: symlink d12/d1c/d2e/dea/l11d 0 2024-09-17T04:21:04.131 INFO:tasks.workunit.client.0.smithi088.stdout:7/385: fdatasync d2/d1d/d2e/d7d/d23/f35 0 2024-09-17T04:21:04.132 INFO:tasks.workunit.client.1.smithi134.stdout:3/883: symlink de/d12/d15/d1d/d2d/d31/d6a/d78/l120 0 2024-09-17T04:21:04.133 INFO:tasks.workunit.client.1.smithi134.stdout:3/884: fdatasync de/d12/d15/d1d/d2d/d31/d6a/d83/da7/f11b 0 2024-09-17T04:21:04.138 INFO:tasks.workunit.client.0.smithi088.stdout:7/386: readlink d2/d1d/d2e/d7d/d23/l59 0 2024-09-17T04:21:04.138 INFO:tasks.workunit.client.1.smithi134.stdout:3/885: dwrite de/d10/d3d/ff5 [0,4194304] 0 2024-09-17T04:21:04.140 INFO:tasks.workunit.client.0.smithi088.stdout:3/349: dwrite d0/d13/d1b/d29/d2b/f3f [0,4194304] 0 2024-09-17T04:21:04.143 INFO:tasks.workunit.client.0.smithi088.stdout:6/406: dwrite d14/d2f/f67 [0,4194304] 0 2024-09-17T04:21:04.144 INFO:tasks.workunit.client.0.smithi088.stdout:6/407: stat cd 0 2024-09-17T04:21:04.147 INFO:tasks.workunit.client.1.smithi134.stdout:2/755: dwrite d19/d1c/d47/dae/ff3 [0,4194304] 0 2024-09-17T04:21:04.147 INFO:tasks.workunit.client.0.smithi088.stdout:4/366: read d5/d3f/f33 [4743109,23131] 0 2024-09-17T04:21:04.148 INFO:tasks.workunit.client.1.smithi134.stdout:6/888: truncate de/d19/f22 4126614 0 2024-09-17T04:21:04.154 INFO:tasks.workunit.client.0.smithi088.stdout:1/366: write d0/d1/f61 [1255629,65430] 0 2024-09-17T04:21:04.156 INFO:tasks.workunit.client.0.smithi088.stdout:1/367: dread - d0/d1/d16/d35/f7c zero size 2024-09-17T04:21:04.157 INFO:tasks.workunit.client.0.smithi088.stdout:8/353: readlink d7/dd/l26 0 2024-09-17T04:21:04.160 INFO:tasks.workunit.client.1.smithi134.stdout:4/819: getdents d0/d3b 0 2024-09-17T04:21:04.162 INFO:tasks.workunit.client.1.smithi134.stdout:4/820: chown d0/df/dd5 62295 1 2024-09-17T04:21:04.162 INFO:tasks.workunit.client.0.smithi088.stdout:2/340: symlink d0/d1/d2d/d33/d65/l6c 0 2024-09-17T04:21:04.163 INFO:tasks.workunit.client.1.smithi134.stdout:6/889: creat de/d19/d62/d7c/ddb/f11b x:0 0 0 2024-09-17T04:21:04.163 INFO:tasks.workunit.client.1.smithi134.stdout:7/654: dwrite d0/f33 [0,4194304] 0 2024-09-17T04:21:04.164 INFO:tasks.workunit.client.0.smithi088.stdout:0/228: truncate db/f10 3925531 0 2024-09-17T04:21:04.164 INFO:tasks.workunit.client.0.smithi088.stdout:2/341: write d0/d1/d2d/d33/d4b/d24/d3b/d22/f64 [670105,12579] 0 2024-09-17T04:21:04.166 INFO:tasks.workunit.client.0.smithi088.stdout:2/342: chown d0/l42 8266272 1 2024-09-17T04:21:04.166 INFO:tasks.workunit.client.0.smithi088.stdout:9/429: link d2/dd/d14/d8b/d43/l46 d2/dd/d14/d8b/d43/d51/l97 0 2024-09-17T04:21:04.166 INFO:tasks.workunit.client.1.smithi134.stdout:6/890: read de/d19/d1f/f57 [73800,76289] 0 2024-09-17T04:21:04.168 INFO:tasks.workunit.client.0.smithi088.stdout:9/430: write d2/dd/d11/f1e [352406,74085] 0 2024-09-17T04:21:04.168 INFO:tasks.workunit.client.1.smithi134.stdout:5/750: truncate d0/da/d2c/fbe 1926879 0 2024-09-17T04:21:04.169 INFO:tasks.workunit.client.0.smithi088.stdout:3/350: creat d0/d13/d1b/d29/d56/f71 x:0 0 0 2024-09-17T04:21:04.171 INFO:tasks.workunit.client.1.smithi134.stdout:1/844: rmdir d12/d1c/dc0 0 2024-09-17T04:21:04.171 INFO:tasks.workunit.client.0.smithi088.stdout:4/367: fdatasync d5/d3f/f33 0 2024-09-17T04:21:04.172 INFO:tasks.workunit.client.1.smithi134.stdout:3/886: dread de/d12/d15/d1d/f62 [0,4194304] 0 2024-09-17T04:21:04.175 INFO:tasks.workunit.client.0.smithi088.stdout:5/318: link d2/d31/d33/d20/f23 d2/d31/f67 0 2024-09-17T04:21:04.177 INFO:tasks.workunit.client.0.smithi088.stdout:1/368: symlink d0/d1/df/d20/d4e/l7f 0 2024-09-17T04:21:04.178 INFO:tasks.workunit.client.0.smithi088.stdout:6/408: dwrite d14/d3a/d41/f60 [0,4194304] 0 2024-09-17T04:21:04.181 INFO:tasks.workunit.client.0.smithi088.stdout:2/343: mkdir d0/d1/d2d/d33/d4b/d6d 0 2024-09-17T04:21:04.184 INFO:tasks.workunit.client.1.smithi134.stdout:5/751: symlink d0/d3a/d6b/lf8 0 2024-09-17T04:21:04.188 INFO:tasks.workunit.client.1.smithi134.stdout:1/845: truncate d12/d19/d5d/f95 1530486 0 2024-09-17T04:21:04.188 INFO:tasks.workunit.client.0.smithi088.stdout:4/368: creat d5/d32/d6b/f7b x:0 0 0 2024-09-17T04:21:04.188 INFO:tasks.workunit.client.0.smithi088.stdout:8/354: dwrite d7/dd/f1a [0,4194304] 0 2024-09-17T04:21:04.189 INFO:tasks.workunit.client.0.smithi088.stdout:5/319: unlink d2/d31/d33/d20/d25/d2c/l39 0 2024-09-17T04:21:04.190 INFO:tasks.workunit.client.0.smithi088.stdout:5/320: write d2/d31/d33/d20/f62 [1020924,11587] 0 2024-09-17T04:21:04.193 INFO:tasks.workunit.client.1.smithi134.stdout:6/891: creat de/d2b/d8a/f11c x:0 0 0 2024-09-17T04:21:04.195 INFO:tasks.workunit.client.1.smithi134.stdout:0/759: write d11/d4c/dd3/fae [273673,11975] 0 2024-09-17T04:21:04.196 INFO:tasks.workunit.client.0.smithi088.stdout:3/351: mkdir d0/d13/d1b/d29/d72 0 2024-09-17T04:21:04.197 INFO:tasks.workunit.client.0.smithi088.stdout:3/352: write d0/f2 [669589,32278] 0 2024-09-17T04:21:04.197 INFO:tasks.workunit.client.1.smithi134.stdout:5/752: read d0/d3a/f5b [434281,37177] 0 2024-09-17T04:21:04.197 INFO:tasks.workunit.client.1.smithi134.stdout:0/760: truncate d11/d18/d97/fcf 4243443 0 2024-09-17T04:21:04.199 INFO:tasks.workunit.client.1.smithi134.stdout:8/727: sync 2024-09-17T04:21:04.200 INFO:tasks.workunit.client.1.smithi134.stdout:0/761: write d11/d18/f30 [2204827,27860] 0 2024-09-17T04:21:04.200 INFO:tasks.workunit.client.0.smithi088.stdout:4/369: creat d5/d72/f7c x:0 0 0 2024-09-17T04:21:04.201 INFO:tasks.workunit.client.0.smithi088.stdout:8/355: readlink d7/dd/d31/l6a 0 2024-09-17T04:21:04.202 INFO:tasks.workunit.client.1.smithi134.stdout:4/821: getdents d0/d13/d40/d42/d92/d7b/dc9 0 2024-09-17T04:21:04.202 INFO:tasks.workunit.client.0.smithi088.stdout:8/356: chown d7/dd/d31/d47 73 1 2024-09-17T04:21:04.203 INFO:tasks.workunit.client.1.smithi134.stdout:4/822: fsync d0/d13/d40/ffe 0 2024-09-17T04:21:04.203 INFO:tasks.workunit.client.0.smithi088.stdout:0/229: creat db/f4c x:0 0 0 2024-09-17T04:21:04.203 INFO:tasks.workunit.client.1.smithi134.stdout:4/823: fsync d0/d13/f33 0 2024-09-17T04:21:04.204 INFO:tasks.workunit.client.0.smithi088.stdout:0/230: chown db/d1b/d36/d4a/d20/c27 947 1 2024-09-17T04:21:04.204 INFO:tasks.workunit.client.1.smithi134.stdout:4/824: fdatasync d0/df/d35/fd3 0 2024-09-17T04:21:04.205 INFO:tasks.workunit.client.1.smithi134.stdout:3/887: rename de/d12/d15/d9f/df7/ce0 to de/d12/d15/d9f/dba/dc4/dca/c121 0 2024-09-17T04:21:04.208 INFO:tasks.workunit.client.1.smithi134.stdout:8/728: mkdir d4/d1f/d86/de0 0 2024-09-17T04:21:04.209 INFO:tasks.workunit.client.0.smithi088.stdout:3/353: mknod d0/d13/d58/d5e/c73 0 2024-09-17T04:21:04.210 INFO:tasks.workunit.client.0.smithi088.stdout:3/354: chown d0/d13/d1b/d29/f2d 58429 1 2024-09-17T04:21:04.211 INFO:tasks.workunit.client.0.smithi088.stdout:4/370: write d5/f2a [4196280,75665] 0 2024-09-17T04:21:04.212 INFO:tasks.workunit.client.0.smithi088.stdout:8/357: chown d7/d29/c2f 1496911220 1 2024-09-17T04:21:04.214 INFO:tasks.workunit.client.0.smithi088.stdout:0/231: rmdir db/d1b 39 2024-09-17T04:21:04.216 INFO:tasks.workunit.client.0.smithi088.stdout:7/387: dread d2/d4/d7/d46/f4e [0,4194304] 0 2024-09-17T04:21:04.220 INFO:tasks.workunit.client.1.smithi134.stdout:3/888: mkdir de/d12/d15/d1d/d8f/d122 0 2024-09-17T04:21:04.222 INFO:tasks.workunit.client.0.smithi088.stdout:1/369: creat d0/d1/df/d20/f80 x:0 0 0 2024-09-17T04:21:04.223 INFO:tasks.workunit.client.0.smithi088.stdout:5/321: dread d2/f15 [0,4194304] 0 2024-09-17T04:21:04.224 INFO:tasks.workunit.client.1.smithi134.stdout:6/892: creat de/d19/d74/f11d x:0 0 0 2024-09-17T04:21:04.224 INFO:tasks.workunit.client.0.smithi088.stdout:5/322: stat d2/d31/d33/f37 0 2024-09-17T04:21:04.225 INFO:tasks.workunit.client.0.smithi088.stdout:3/355: creat d0/d13/d1b/d29/d2b/d50/f74 x:0 0 0 2024-09-17T04:21:04.226 INFO:tasks.workunit.client.1.smithi134.stdout:6/893: read de/f13 [3805680,50026] 0 2024-09-17T04:21:04.226 INFO:tasks.workunit.client.1.smithi134.stdout:6/894: fsync de/d19/f61 0 2024-09-17T04:21:04.226 INFO:tasks.workunit.client.0.smithi088.stdout:3/356: fdatasync d0/d13/d1b/d29/d2b/f41 0 2024-09-17T04:21:04.227 INFO:tasks.workunit.client.0.smithi088.stdout:5/323: dread d2/d31/d33/f37 [0,4194304] 0 2024-09-17T04:21:04.228 INFO:tasks.workunit.client.0.smithi088.stdout:3/357: write d0/d13/d1b/d29/d2b/f42 [2347497,41701] 0 2024-09-17T04:21:04.229 INFO:tasks.workunit.client.1.smithi134.stdout:5/753: rename d0/l23 to d0/da/d2c/d73/d8a/lf9 0 2024-09-17T04:21:04.231 INFO:tasks.workunit.client.1.smithi134.stdout:4/825: creat d0/df/d1e/d73/ddb/f10b x:0 0 0 2024-09-17T04:21:04.233 INFO:tasks.workunit.client.0.smithi088.stdout:8/358: creat d7/dd/d31/d47/d55/d57/f71 x:0 0 0 2024-09-17T04:21:04.234 INFO:tasks.workunit.client.1.smithi134.stdout:3/889: fsync de/d12/d22/fcd 0 2024-09-17T04:21:04.235 INFO:tasks.workunit.client.1.smithi134.stdout:2/756: truncate d19/d1c/d92/ddc/dc6/ded/fd1 884487 0 2024-09-17T04:21:04.235 INFO:tasks.workunit.client.0.smithi088.stdout:7/388: dread d2/f31 [0,4194304] 0 2024-09-17T04:21:04.236 INFO:tasks.workunit.client.1.smithi134.stdout:0/762: creat d11/d22/f107 x:0 0 0 2024-09-17T04:21:04.237 INFO:tasks.workunit.client.0.smithi088.stdout:9/431: write d2/dd/d11/d30/f7f [129148,44124] 0 2024-09-17T04:21:04.239 INFO:tasks.workunit.client.0.smithi088.stdout:4/371: mknod d5/d3d/d73/c7d 0 2024-09-17T04:21:04.241 INFO:tasks.workunit.client.0.smithi088.stdout:4/372: dread d5/f4b [0,4194304] 0 2024-09-17T04:21:04.243 INFO:tasks.workunit.client.1.smithi134.stdout:8/729: rename d4/d11/da1/dc7/f35 to d4/d11/da1/dc7/d5e/fe1 0 2024-09-17T04:21:04.245 INFO:tasks.workunit.client.1.smithi134.stdout:5/754: creat d0/da/d69/d41/d72/ffa x:0 0 0 2024-09-17T04:21:04.247 INFO:tasks.workunit.client.1.smithi134.stdout:5/755: write d0/da/d2c/d73/fa3 [5616025,118204] 0 2024-09-17T04:21:04.247 INFO:tasks.workunit.client.0.smithi088.stdout:3/358: dread d0/d13/f24 [0,4194304] 0 2024-09-17T04:21:04.248 INFO:tasks.workunit.client.1.smithi134.stdout:4/826: symlink d0/df/d35/d5c/l10c 0 2024-09-17T04:21:04.248 INFO:tasks.workunit.client.1.smithi134.stdout:7/655: dwrite d0/d16/d35/d4b/d65/f89 [0,4194304] 0 2024-09-17T04:21:04.248 INFO:tasks.workunit.client.0.smithi088.stdout:6/409: write d14/d44/d45/d6b/d29/f2d [1346769,40314] 0 2024-09-17T04:21:04.250 INFO:tasks.workunit.client.1.smithi134.stdout:7/656: chown d0/d16/d8b/d6a/c99 23541 1 2024-09-17T04:21:04.251 INFO:tasks.workunit.client.0.smithi088.stdout:8/359: unlink d7/d29/f68 0 2024-09-17T04:21:04.252 INFO:tasks.workunit.client.0.smithi088.stdout:2/344: write d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/f5b [244526,123785] 0 2024-09-17T04:21:04.253 INFO:tasks.workunit.client.0.smithi088.stdout:2/345: write d0/d1/f3 [7750512,38469] 0 2024-09-17T04:21:04.255 INFO:tasks.workunit.client.1.smithi134.stdout:2/757: fdatasync d19/d27/d31/d34/fa4 0 2024-09-17T04:21:04.255 INFO:tasks.workunit.client.1.smithi134.stdout:1/846: dwrite d12/d1c/d2e/f67 [0,4194304] 0 2024-09-17T04:21:04.256 INFO:tasks.workunit.client.1.smithi134.stdout:1/847: chown d12/d1c/d2e/d7d/fed 2132341122 1 2024-09-17T04:21:04.257 INFO:tasks.workunit.client.0.smithi088.stdout:2/346: read d0/f9 [3234846,28374] 0 2024-09-17T04:21:04.258 INFO:tasks.workunit.client.1.smithi134.stdout:1/848: write d12/d19/f8e [3107794,95135] 0 2024-09-17T04:21:04.258 INFO:tasks.workunit.client.1.smithi134.stdout:0/763: fsync d11/d18/d97/df3/d43/f44 0 2024-09-17T04:21:04.260 INFO:tasks.workunit.client.1.smithi134.stdout:1/849: readlink d12/d19/d1d/d61/dd3/dda/d85/l10b 0 2024-09-17T04:21:04.263 INFO:tasks.workunit.client.0.smithi088.stdout:4/373: rename d5/d3d/d49 to d5/d3d/d73/d7e 0 2024-09-17T04:21:04.265 INFO:tasks.workunit.client.1.smithi134.stdout:8/730: rename d4/d1f/f33 to d4/d11/da1/dc7/fe2 0 2024-09-17T04:21:04.265 INFO:tasks.workunit.client.0.smithi088.stdout:5/324: mknod d2/d31/d33/c68 0 2024-09-17T04:21:04.266 INFO:tasks.workunit.client.0.smithi088.stdout:5/325: stat d2/d31/d33 0 2024-09-17T04:21:04.266 INFO:tasks.workunit.client.1.smithi134.stdout:8/731: truncate d4/d11/da1/dc7/d5e/fd6 576281 0 2024-09-17T04:21:04.269 INFO:tasks.workunit.client.0.smithi088.stdout:5/326: dread d2/d31/d33/d20/d25/d2c/f52 [0,4194304] 0 2024-09-17T04:21:04.397 INFO:tasks.workunit.client.1.smithi134.stdout:5/756: readlink d0/da/d69/d41/d6d/l98 0 2024-09-17T04:21:04.398 INFO:tasks.workunit.client.0.smithi088.stdout:3/359: creat d0/d13/d58/d5a/d63/f75 x:0 0 0 2024-09-17T04:21:04.400 INFO:tasks.workunit.client.1.smithi134.stdout:4/827: symlink d0/d13/d40/d42/dc5/dcb/l10d 0 2024-09-17T04:21:04.401 INFO:tasks.workunit.client.0.smithi088.stdout:0/232: creat db/f4d x:0 0 0 2024-09-17T04:21:04.405 INFO:tasks.workunit.client.0.smithi088.stdout:6/410: unlink d14/d44/d45/d6b/l20 0 2024-09-17T04:21:04.409 INFO:tasks.workunit.client.0.smithi088.stdout:7/389: symlink d2/d4/d7/l83 0 2024-09-17T04:21:04.410 INFO:tasks.workunit.client.1.smithi134.stdout:2/758: chown d19/d1c/f87 188424636 1 2024-09-17T04:21:04.413 INFO:tasks.workunit.client.0.smithi088.stdout:2/347: mknod d0/d1/d2d/d33/d4b/d24/c6e 0 2024-09-17T04:21:04.415 INFO:tasks.workunit.client.0.smithi088.stdout:9/432: mkdir d2/dd/d14/d2a/d76/d98 0 2024-09-17T04:21:04.424 INFO:tasks.workunit.client.0.smithi088.stdout:5/327: symlink d2/d31/d33/d20/d25/d2c/d3d/l69 0 2024-09-17T04:21:04.426 INFO:tasks.workunit.client.1.smithi134.stdout:7/657: rename d0/dd/d3a/d3d/d38/d60/d75/l81 to d0/d16/d8b/d6a/lcb 0 2024-09-17T04:21:04.428 INFO:tasks.workunit.client.1.smithi134.stdout:8/732: creat d4/d1f/d2b/dbf/dcc/d9d/fe3 x:0 0 0 2024-09-17T04:21:04.429 INFO:tasks.workunit.client.1.smithi134.stdout:8/733: chown d4/d11/da1/dc7/d13/f73 73553136 1 2024-09-17T04:21:04.430 INFO:tasks.workunit.client.1.smithi134.stdout:3/890: truncate de/d10/d3d/ff5 1012878 0 2024-09-17T04:21:04.431 INFO:tasks.workunit.client.1.smithi134.stdout:6/895: getdents de/d19/d1f/d85/dde 0 2024-09-17T04:21:04.435 INFO:tasks.workunit.client.1.smithi134.stdout:7/658: creat d0/dd/d3a/d3d/d4c/fcc x:0 0 0 2024-09-17T04:21:04.435 INFO:tasks.workunit.client.1.smithi134.stdout:7/659: fdatasync d0/dd/d3a/d3d/f61 0 2024-09-17T04:21:04.439 INFO:tasks.workunit.client.1.smithi134.stdout:0/764: write d11/f8c [574401,16370] 0 2024-09-17T04:21:04.444 INFO:tasks.workunit.client.1.smithi134.stdout:6/896: mknod de/d19/d21/df2/c11e 0 2024-09-17T04:21:04.445 INFO:tasks.workunit.client.1.smithi134.stdout:1/850: dwrite d12/d19/d1d/d3e/f48 [0,4194304] 0 2024-09-17T04:21:04.446 INFO:tasks.workunit.client.1.smithi134.stdout:7/660: symlink d0/dd/d3a/lcd 0 2024-09-17T04:21:04.449 INFO:tasks.workunit.client.1.smithi134.stdout:3/891: rename de/d10/d3d/f94 to de/d10/f123 0 2024-09-17T04:21:04.450 INFO:tasks.workunit.client.1.smithi134.stdout:0/765: mknod d11/d24/d49/d62/c108 0 2024-09-17T04:21:04.452 INFO:tasks.workunit.client.1.smithi134.stdout:6/897: unlink de/d2b/d8a/fad 0 2024-09-17T04:21:04.456 INFO:tasks.workunit.client.1.smithi134.stdout:3/892: mknod de/d67/dc5/c124 0 2024-09-17T04:21:04.458 INFO:tasks.workunit.client.1.smithi134.stdout:0/766: symlink d11/d24/d49/d62/df7/l109 0 2024-09-17T04:21:04.458 INFO:tasks.workunit.client.1.smithi134.stdout:0/767: read - d11/d24/d49/d62/df7/fe8 zero size 2024-09-17T04:21:04.459 INFO:tasks.workunit.client.1.smithi134.stdout:1/851: symlink d12/db2/d11c/l11e 0 2024-09-17T04:21:04.459 INFO:tasks.workunit.client.1.smithi134.stdout:0/768: readlink d11/d18/d97/df3/d43/l73 0 2024-09-17T04:21:04.460 INFO:tasks.workunit.client.1.smithi134.stdout:6/898: truncate de/d19/d21/d2d/f2f 1024281 0 2024-09-17T04:21:04.460 INFO:tasks.workunit.client.1.smithi134.stdout:0/769: write d11/d48/fc8 [821519,118469] 0 2024-09-17T04:21:04.461 INFO:tasks.workunit.client.0.smithi088.stdout:3/360: symlink d0/d54/d55/l76 0 2024-09-17T04:21:04.463 INFO:tasks.workunit.client.0.smithi088.stdout:6/411: mkdir d14/d44/d45/d4d/d97 0 2024-09-17T04:21:04.465 INFO:tasks.workunit.client.1.smithi134.stdout:1/852: dwrite d12/d1c/d2e/f3b [0,4194304] 0 2024-09-17T04:21:04.468 INFO:tasks.workunit.client.1.smithi134.stdout:1/853: truncate d12/d19/d1d/d61/fe5 4930208 0 2024-09-17T04:21:04.468 INFO:tasks.workunit.client.1.smithi134.stdout:0/770: dwrite d11/d24/d49/feb [0,4194304] 0 2024-09-17T04:21:04.470 INFO:tasks.workunit.client.1.smithi134.stdout:1/854: chown d12/d1c/d2e 472 1 2024-09-17T04:21:04.471 INFO:tasks.workunit.client.0.smithi088.stdout:2/348: fsync d0/d1/d2d/d33/d4b/d24/f51 0 2024-09-17T04:21:04.473 INFO:tasks.workunit.client.1.smithi134.stdout:3/893: mkdir de/d12/d15/d125 0 2024-09-17T04:21:04.474 INFO:tasks.workunit.client.1.smithi134.stdout:0/771: mkdir d11/d4c/d76/dba/d10a 0 2024-09-17T04:21:04.475 INFO:tasks.workunit.client.0.smithi088.stdout:4/374: symlink d5/d3f/d71/l7f 0 2024-09-17T04:21:04.475 INFO:tasks.workunit.client.1.smithi134.stdout:1/855: fsync d12/d19/d1d/d61/dd3/dda/d85/df9/f111 0 2024-09-17T04:21:04.475 INFO:tasks.workunit.client.0.smithi088.stdout:4/375: fdatasync d5/d3d/d73/d7e/f52 0 2024-09-17T04:21:04.477 INFO:tasks.workunit.client.1.smithi134.stdout:3/894: dread - de/d12/d15/d9f/df7/f112 zero size 2024-09-17T04:21:04.478 INFO:tasks.workunit.client.1.smithi134.stdout:6/899: dwrite de/d19/d62/db0/fd8 [0,4194304] 0 2024-09-17T04:21:04.480 INFO:tasks.workunit.client.0.smithi088.stdout:3/361: symlink d0/d13/d58/d5e/l77 0 2024-09-17T04:21:04.482 INFO:tasks.workunit.client.0.smithi088.stdout:0/233: mkdir db/d1b/d36/d4a/d20/d4e 0 2024-09-17T04:21:04.483 INFO:tasks.workunit.client.0.smithi088.stdout:4/376: dwrite f1 [0,4194304] 0 2024-09-17T04:21:04.484 INFO:tasks.workunit.client.1.smithi134.stdout:1/856: dread d12/d19/d1d/d61/dd3/dda/d85/fbb [0,4194304] 0 2024-09-17T04:21:04.485 INFO:tasks.workunit.client.0.smithi088.stdout:6/412: fdatasync d14/d44/d45/d6b/f22 0 2024-09-17T04:21:04.491 INFO:tasks.workunit.client.0.smithi088.stdout:0/234: dwrite db/f4d [0,4194304] 0 2024-09-17T04:21:04.492 INFO:tasks.workunit.client.1.smithi134.stdout:0/772: symlink d11/d22/l10b 0 2024-09-17T04:21:04.493 INFO:tasks.workunit.client.1.smithi134.stdout:0/773: dread - d11/d18/d97/df3/d43/d5d/fe7 zero size 2024-09-17T04:21:04.494 INFO:tasks.workunit.client.0.smithi088.stdout:6/413: dread d14/f24 [0,4194304] 0 2024-09-17T04:21:04.494 INFO:tasks.workunit.client.1.smithi134.stdout:0/774: write d11/d24/d49/f5b [1126182,48834] 0 2024-09-17T04:21:04.497 INFO:tasks.workunit.client.1.smithi134.stdout:1/857: creat d12/d19/d4f/f11f x:0 0 0 2024-09-17T04:21:04.498 INFO:tasks.workunit.client.0.smithi088.stdout:9/433: mkdir d2/dd/d14/d2a/d8f/d99 0 2024-09-17T04:21:04.500 INFO:tasks.workunit.client.1.smithi134.stdout:3/895: mkdir de/d12/d15/d1d/d2d/d31/d6a/d83/d126 0 2024-09-17T04:21:04.500 INFO:tasks.workunit.client.0.smithi088.stdout:0/235: dwrite db/d1b/d36/d4a/f40 [0,4194304] 0 2024-09-17T04:21:04.502 INFO:tasks.workunit.client.1.smithi134.stdout:6/900: symlink de/d19/d62/l11f 0 2024-09-17T04:21:04.504 INFO:tasks.workunit.client.1.smithi134.stdout:0/775: fdatasync d11/d24/d49/d62/f103 0 2024-09-17T04:21:04.505 INFO:tasks.workunit.client.1.smithi134.stdout:7/661: dwrite d0/d16/d35/d4b/f48 [0,4194304] 0 2024-09-17T04:21:04.506 INFO:tasks.workunit.client.0.smithi088.stdout:3/362: rmdir d0/d13/d1b/d29/d30 39 2024-09-17T04:21:04.506 INFO:tasks.workunit.client.1.smithi134.stdout:7/662: chown d0/dd/d3a/fae 102594 1 2024-09-17T04:21:04.508 INFO:tasks.workunit.client.1.smithi134.stdout:7/663: write d0/dd/d3a/d3d/d38/f23 [5279569,71860] 0 2024-09-17T04:21:04.512 INFO:tasks.workunit.client.1.smithi134.stdout:6/901: read de/d2b/f71 [1619151,16926] 0 2024-09-17T04:21:04.513 INFO:tasks.workunit.client.0.smithi088.stdout:8/360: getdents d7/d29/d2a/d3a 0 2024-09-17T04:21:04.514 INFO:tasks.workunit.client.1.smithi134.stdout:3/896: mkdir de/d12/d15/d1d/d127 0 2024-09-17T04:21:04.521 INFO:tasks.workunit.client.1.smithi134.stdout:7/664: creat d0/dd/db9/fce x:0 0 0 2024-09-17T04:21:04.522 INFO:tasks.workunit.client.0.smithi088.stdout:5/328: dwrite d2/d31/d33/f1f [0,4194304] 0 2024-09-17T04:21:04.523 INFO:tasks.workunit.client.0.smithi088.stdout:9/434: symlink d2/dd/d11/d4f/d5c/l9a 0 2024-09-17T04:21:04.523 INFO:tasks.workunit.client.1.smithi134.stdout:6/902: readlink de/d19/d62/d34/d8e/lc3 0 2024-09-17T04:21:04.530 INFO:tasks.workunit.client.0.smithi088.stdout:7/390: dwrite d2/d1d/d2e/d7d/d23/d45/d62/f70 [0,4194304] 0 2024-09-17T04:21:04.531 INFO:tasks.workunit.client.0.smithi088.stdout:8/361: symlink d7/dd/d31/d47/d55/d57/l72 0 2024-09-17T04:21:04.534 INFO:tasks.workunit.client.0.smithi088.stdout:2/349: creat d0/d1/d2d/d33/f6f x:0 0 0 2024-09-17T04:21:04.536 INFO:tasks.workunit.client.0.smithi088.stdout:5/329: dwrite d2/d31/d33/f58 [0,4194304] 0 2024-09-17T04:21:04.538 INFO:tasks.workunit.client.1.smithi134.stdout:1/858: dread d12/d19/d1d/d61/fe2 [0,4194304] 0 2024-09-17T04:21:04.540 INFO:tasks.workunit.client.0.smithi088.stdout:6/414: mknod d14/d44/d45/d6b/d2a/d52/d7a/c98 0 2024-09-17T04:21:04.542 INFO:tasks.workunit.client.0.smithi088.stdout:8/362: dwrite d7/dd/f1a [0,4194304] 0 2024-09-17T04:21:04.546 INFO:tasks.workunit.client.0.smithi088.stdout:6/415: fdatasync d14/d44/d45/d6b/d2a/d52/d7a/d7b/f81 0 2024-09-17T04:21:04.546 INFO:tasks.workunit.client.0.smithi088.stdout:5/330: dread d2/d31/d33/d20/d25/d49/f5f [0,4194304] 0 2024-09-17T04:21:04.547 INFO:tasks.workunit.client.0.smithi088.stdout:9/435: rename d2/dd/d14/d8b/d35/f78 to d2/d2b/d58/f9b 0 2024-09-17T04:21:04.549 INFO:tasks.workunit.client.0.smithi088.stdout:4/377: creat d5/d3d/f80 x:0 0 0 2024-09-17T04:21:04.552 INFO:tasks.workunit.client.0.smithi088.stdout:5/331: dread d2/d31/d33/d20/d25/d2c/f4b [0,4194304] 0 2024-09-17T04:21:04.556 INFO:tasks.workunit.client.1.smithi134.stdout:6/903: dread de/d2b/f9f [0,4194304] 0 2024-09-17T04:21:04.558 INFO:tasks.workunit.client.0.smithi088.stdout:8/363: rename c3 to d7/dd/d62/c73 0 2024-09-17T04:21:04.559 INFO:tasks.workunit.client.0.smithi088.stdout:6/416: dread d14/d44/d45/d6b/f22 [0,4194304] 0 2024-09-17T04:21:04.561 INFO:tasks.workunit.client.0.smithi088.stdout:3/363: mknod d0/d13/d1b/d29/d30/d3c/d5c/c78 0 2024-09-17T04:21:04.562 INFO:tasks.workunit.client.1.smithi134.stdout:6/904: dwrite de/d19/d21/d4d/fa4 [0,4194304] 0 2024-09-17T04:21:04.563 INFO:tasks.workunit.client.0.smithi088.stdout:7/391: dread d2/d4/f14 [0,4194304] 0 2024-09-17T04:21:04.566 INFO:tasks.workunit.client.0.smithi088.stdout:0/236: truncate db/d1b/d36/d47/f32 121469 0 2024-09-17T04:21:04.573 INFO:tasks.workunit.client.0.smithi088.stdout:0/237: dwrite db/d1b/d36/d4a/d20/f2c [4194304,4194304] 0 2024-09-17T04:21:04.573 INFO:tasks.workunit.client.0.smithi088.stdout:8/364: creat d7/dd/d31/d47/d55/f74 x:0 0 0 2024-09-17T04:21:04.580 INFO:tasks.workunit.client.0.smithi088.stdout:4/378: mknod d5/d3d/c81 0 2024-09-17T04:21:04.580 INFO:tasks.workunit.client.0.smithi088.stdout:4/379: dread - d5/d72/f7c zero size 2024-09-17T04:21:04.581 INFO:tasks.workunit.client.0.smithi088.stdout:4/380: write d5/d3d/f6d [395605,78259] 0 2024-09-17T04:21:04.597 INFO:tasks.workunit.client.1.smithi134.stdout:2/759: sync 2024-09-17T04:21:04.597 INFO:tasks.workunit.client.1.smithi134.stdout:4/828: sync 2024-09-17T04:21:04.598 INFO:tasks.workunit.client.1.smithi134.stdout:5/757: sync 2024-09-17T04:21:04.598 INFO:tasks.workunit.client.1.smithi134.stdout:8/734: sync 2024-09-17T04:21:04.601 INFO:tasks.workunit.client.1.smithi134.stdout:2/760: dread d19/d27/d31/d34/df2/d6f/d84/d98/feb [0,4194304] 0 2024-09-17T04:21:04.649 INFO:tasks.workunit.client.0.smithi088.stdout:3/364: dread d0/f16 [0,4194304] 0 2024-09-17T04:21:04.650 INFO:tasks.workunit.client.0.smithi088.stdout:9/436: truncate d2/dd/d11/f79 201963 0 2024-09-17T04:21:04.655 INFO:tasks.workunit.client.0.smithi088.stdout:5/332: truncate d2/d31/d33/d20/d25/d49/f5f 4686870 0 2024-09-17T04:21:04.656 INFO:tasks.workunit.client.0.smithi088.stdout:0/238: mkdir db/d3c/d4f 0 2024-09-17T04:21:04.659 INFO:tasks.workunit.client.0.smithi088.stdout:6/417: fsync d14/d44/d45/d6b/d16/f6a 0 2024-09-17T04:21:04.663 INFO:tasks.workunit.client.0.smithi088.stdout:7/392: write d2/d4/f33 [399482,51680] 0 2024-09-17T04:21:04.664 INFO:tasks.workunit.client.0.smithi088.stdout:7/393: write d2/d1d/d2e/d7d/f29 [2318985,78490] 0 2024-09-17T04:21:04.665 INFO:tasks.workunit.client.1.smithi134.stdout:0/776: link d11/d18/f30 d11/d18/f10c 0 2024-09-17T04:21:04.667 INFO:tasks.workunit.client.0.smithi088.stdout:2/350: link d0/d1/l47 d0/d18/l70 0 2024-09-17T04:21:04.668 INFO:tasks.workunit.client.0.smithi088.stdout:2/351: fdatasync d0/d1/f11 0 2024-09-17T04:21:04.670 INFO:tasks.workunit.client.0.smithi088.stdout:5/333: fdatasync d2/f10 0 2024-09-17T04:21:04.670 INFO:tasks.workunit.client.0.smithi088.stdout:5/334: chown d2/d31/f45 14740218 1 2024-09-17T04:21:04.671 INFO:tasks.workunit.client.1.smithi134.stdout:3/897: mknod de/d12/d15/d1d/d2d/d31/d6a/c128 0 2024-09-17T04:21:04.673 INFO:tasks.workunit.client.1.smithi134.stdout:1/859: mkdir d12/d1c/d2e/d120 0 2024-09-17T04:21:04.674 INFO:tasks.workunit.client.0.smithi088.stdout:8/365: mkdir d7/d29/d2a/d75 0 2024-09-17T04:21:04.677 INFO:tasks.workunit.client.0.smithi088.stdout:0/239: dwrite db/f19 [4194304,4194304] 0 2024-09-17T04:21:04.678 INFO:tasks.workunit.client.0.smithi088.stdout:0/240: chown db/d1b/d36/d47/l46 435494283 1 2024-09-17T04:21:04.678 INFO:tasks.workunit.client.0.smithi088.stdout:0/241: fsync db/d1b/d39/f3a 0 2024-09-17T04:21:04.680 INFO:tasks.workunit.client.0.smithi088.stdout:0/242: stat db/d1b/d36/d47 0 2024-09-17T04:21:04.681 INFO:tasks.workunit.client.1.smithi134.stdout:8/735: creat d4/d1f/d25/fe4 x:0 0 0 2024-09-17T04:21:04.681 INFO:tasks.workunit.client.0.smithi088.stdout:0/243: fsync db/d1b/d36/d4a/f40 0 2024-09-17T04:21:04.683 INFO:tasks.workunit.client.0.smithi088.stdout:9/437: creat d2/dd/d14/d2a/d76/d98/f9c x:0 0 0 2024-09-17T04:21:04.684 INFO:tasks.workunit.client.1.smithi134.stdout:4/829: rename d0/df/d35/d39/l4b to d0/d13/d40/d42/d92/d65/l10e 0 2024-09-17T04:21:04.686 INFO:tasks.workunit.client.1.smithi134.stdout:7/665: write d0/dd/d3a/d3d/d38/f3c [196700,103663] 0 2024-09-17T04:21:04.686 INFO:tasks.workunit.client.1.smithi134.stdout:0/777: chown d11/d6f/da8/la9 449 1 2024-09-17T04:21:04.697 INFO:tasks.workunit.client.0.smithi088.stdout:1/370: sync 2024-09-17T04:21:04.704 INFO:tasks.workunit.client.0.smithi088.stdout:4/381: dwrite d5/d3f/f41 [0,4194304] 0 2024-09-17T04:21:04.714 INFO:tasks.workunit.client.1.smithi134.stdout:1/860: mkdir d12/d19/d1d/d3e/d121 0 2024-09-17T04:21:04.715 INFO:tasks.workunit.client.1.smithi134.stdout:1/861: dread - d12/d19/d5d/d88/fff zero size 2024-09-17T04:21:04.716 INFO:tasks.workunit.client.0.smithi088.stdout:8/366: creat d7/dd/d31/f76 x:0 0 0 2024-09-17T04:21:04.717 INFO:tasks.workunit.client.0.smithi088.stdout:8/367: write d7/f24 [2258144,71274] 0 2024-09-17T04:21:04.718 INFO:tasks.workunit.client.1.smithi134.stdout:5/758: mknod d0/da/d69/cfb 0 2024-09-17T04:21:04.718 INFO:tasks.workunit.client.0.smithi088.stdout:7/394: write d2/d4/d7/f10 [4520807,44666] 0 2024-09-17T04:21:04.719 INFO:tasks.workunit.client.1.smithi134.stdout:8/736: symlink d4/d11/da1/db3/le5 0 2024-09-17T04:21:04.720 INFO:tasks.workunit.client.0.smithi088.stdout:6/418: symlink d14/d3a/l99 0 2024-09-17T04:21:04.721 INFO:tasks.workunit.client.1.smithi134.stdout:4/830: creat d0/df/d17/d9c/f10f x:0 0 0 2024-09-17T04:21:04.722 INFO:tasks.workunit.client.1.smithi134.stdout:7/666: rmdir d0/dd/d3a 39 2024-09-17T04:21:04.723 INFO:tasks.workunit.client.1.smithi134.stdout:0/778: dread - d11/d6f/fc1 zero size 2024-09-17T04:21:04.723 INFO:tasks.workunit.client.1.smithi134.stdout:7/667: write d0/d16/d35/d4b/f44 [3449071,71514] 0 2024-09-17T04:21:04.725 INFO:tasks.workunit.client.1.smithi134.stdout:5/759: chown d0/lec 10 1 2024-09-17T04:21:04.725 INFO:tasks.workunit.client.1.smithi134.stdout:8/737: symlink d4/d11/da1/dc7/d13/le6 0 2024-09-17T04:21:04.726 INFO:tasks.workunit.client.1.smithi134.stdout:8/738: stat d4/c6c 0 2024-09-17T04:21:04.726 INFO:tasks.workunit.client.0.smithi088.stdout:1/371: unlink d0/l32 0 2024-09-17T04:21:04.728 INFO:tasks.workunit.client.1.smithi134.stdout:2/761: creat d19/d27/d31/d34/df2/d6f/ffa x:0 0 0 2024-09-17T04:21:04.729 INFO:tasks.workunit.client.0.smithi088.stdout:1/372: read d0/d1/df/d20/f2e [3707183,69918] 0 2024-09-17T04:21:04.730 INFO:tasks.workunit.client.0.smithi088.stdout:1/373: dread - d0/d1/df/d20/d4e/f71 zero size 2024-09-17T04:21:04.731 INFO:tasks.workunit.client.1.smithi134.stdout:2/762: write d19/d1c/f1f [1823590,111998] 0 2024-09-17T04:21:04.737 INFO:tasks.workunit.client.1.smithi134.stdout:5/760: dwrite d0/da/d29/d7c/db3/fd8 [0,4194304] 0 2024-09-17T04:21:04.737 INFO:tasks.workunit.client.1.smithi134.stdout:3/898: dwrite de/d10/d70/f87 [0,4194304] 0 2024-09-17T04:21:04.737 INFO:tasks.workunit.client.1.smithi134.stdout:2/763: fsync d19/d27/f2f 0 2024-09-17T04:21:04.738 INFO:tasks.workunit.client.0.smithi088.stdout:7/395: fdatasync d2/d4/f69 0 2024-09-17T04:21:04.739 INFO:tasks.workunit.client.0.smithi088.stdout:7/396: chown d2/d4/f14 32279090 1 2024-09-17T04:21:04.741 INFO:tasks.workunit.client.0.smithi088.stdout:7/397: dread d2/d1d/d2e/d7d/f4a [0,4194304] 0 2024-09-17T04:21:04.742 INFO:tasks.workunit.client.1.smithi134.stdout:4/831: fsync d0/df/d17/d9c/f10f 0 2024-09-17T04:21:04.743 INFO:tasks.workunit.client.0.smithi088.stdout:3/365: getdents d0/d13/d1b 0 2024-09-17T04:21:04.743 INFO:tasks.workunit.client.0.smithi088.stdout:2/352: write d0/d18/f4c [569460,41406] 0 2024-09-17T04:21:04.743 INFO:tasks.workunit.client.1.smithi134.stdout:5/761: chown d0/da/d69/d41/d72/fe0 484 1 2024-09-17T04:21:04.745 INFO:tasks.workunit.client.1.smithi134.stdout:6/905: dwrite de/d19/f22 [0,4194304] 0 2024-09-17T04:21:04.746 INFO:tasks.workunit.client.1.smithi134.stdout:7/668: readlink d0/dd/d3a/la1 0 2024-09-17T04:21:04.746 INFO:tasks.workunit.client.1.smithi134.stdout:0/779: truncate d11/d18/f30 4093785 0 2024-09-17T04:21:04.747 INFO:tasks.workunit.client.0.smithi088.stdout:4/382: write d5/f4b [1647603,36075] 0 2024-09-17T04:21:04.747 INFO:tasks.workunit.client.0.smithi088.stdout:1/374: rmdir d0/d1/d16/d35 39 2024-09-17T04:21:04.749 INFO:tasks.workunit.client.0.smithi088.stdout:3/366: dread d0/d13/d1b/d29/d30/d3c/f51 [0,4194304] 0 2024-09-17T04:21:04.750 INFO:tasks.workunit.client.1.smithi134.stdout:1/862: dread d12/d19/d5d/d91/dac/fba [0,4194304] 0 2024-09-17T04:21:04.750 INFO:tasks.workunit.client.1.smithi134.stdout:7/669: stat d0/dd/d3a/d3d/d38/da9 0 2024-09-17T04:21:04.751 INFO:tasks.workunit.client.1.smithi134.stdout:1/863: fsync d12/d19/d4f/fb3 0 2024-09-17T04:21:04.751 INFO:tasks.workunit.client.1.smithi134.stdout:8/739: creat d4/db/dd/fe7 x:0 0 0 2024-09-17T04:21:04.752 INFO:tasks.workunit.client.0.smithi088.stdout:1/375: dread - d0/d1/df/d63/f76 zero size 2024-09-17T04:21:04.753 INFO:tasks.workunit.client.0.smithi088.stdout:5/335: dwrite d2/d31/d33/d20/d25/d2c/f50 [0,4194304] 0 2024-09-17T04:21:04.753 INFO:tasks.workunit.client.0.smithi088.stdout:8/368: link d7/dd/f56 d7/d29/d2a/d38/d3d/d63/f77 0 2024-09-17T04:21:04.755 INFO:tasks.workunit.client.1.smithi134.stdout:2/764: mknod d19/d1c/d47/d50/d85/d93/dc1/cfb 0 2024-09-17T04:21:04.757 INFO:tasks.workunit.client.1.smithi134.stdout:6/906: creat de/d19/da3/de6/f120 x:0 0 0 2024-09-17T04:21:04.758 INFO:tasks.workunit.client.1.smithi134.stdout:7/670: dread - d0/d16/d8b/f9b zero size 2024-09-17T04:21:04.761 INFO:tasks.workunit.client.1.smithi134.stdout:6/907: read de/d19/d1f/d55/da9/fbc [758545,103684] 0 2024-09-17T04:21:04.764 INFO:tasks.workunit.client.0.smithi088.stdout:8/369: dwrite d7/dd/f28 [0,4194304] 0 2024-09-17T04:21:04.764 INFO:tasks.workunit.client.1.smithi134.stdout:8/740: mknod d4/db/dd/d72/ce8 0 2024-09-17T04:21:04.765 INFO:tasks.workunit.client.1.smithi134.stdout:8/741: stat d4/d1f/d86/de0 0 2024-09-17T04:21:04.766 INFO:tasks.workunit.client.0.smithi088.stdout:7/398: dwrite d2/f31 [4194304,4194304] 0 2024-09-17T04:21:04.767 INFO:tasks.workunit.client.1.smithi134.stdout:1/864: truncate d12/d19/f25 2934746 0 2024-09-17T04:21:04.774 INFO:tasks.workunit.client.1.smithi134.stdout:7/671: creat d0/d16/d8b/d6a/d70/fcf x:0 0 0 2024-09-17T04:21:04.776 INFO:tasks.workunit.client.1.smithi134.stdout:8/742: unlink d4/d1f/d25/lb2 0 2024-09-17T04:21:04.777 INFO:tasks.workunit.client.1.smithi134.stdout:1/865: dwrite d12/d19/d1d/d61/fd8 [0,4194304] 0 2024-09-17T04:21:04.778 INFO:tasks.workunit.client.1.smithi134.stdout:0/780: creat d11/d22/f10d x:0 0 0 2024-09-17T04:21:04.779 INFO:tasks.workunit.client.0.smithi088.stdout:0/244: link db/d1b/d36/d47/c2e db/d3c/d4f/c50 0 2024-09-17T04:21:04.780 INFO:tasks.workunit.client.0.smithi088.stdout:8/370: chown d7/dd/c1e 463225855 1 2024-09-17T04:21:04.783 INFO:tasks.workunit.client.1.smithi134.stdout:3/899: dread de/d12/d15/d1d/d2d/d31/d6a/d83/f89 [0,4194304] 0 2024-09-17T04:21:04.785 INFO:tasks.workunit.client.1.smithi134.stdout:5/762: getdents d0/da/d29/d7c/ddf 0 2024-09-17T04:21:04.787 INFO:tasks.workunit.client.0.smithi088.stdout:6/419: getdents d14/d3a/d41 0 2024-09-17T04:21:04.788 INFO:tasks.workunit.client.0.smithi088.stdout:6/420: dread - d14/d44/d45/d6b/d2a/d52/d7a/f75 zero size 2024-09-17T04:21:04.789 INFO:tasks.workunit.client.1.smithi134.stdout:7/672: mkdir d0/d16/d35/d8d/dd0 0 2024-09-17T04:21:04.790 INFO:tasks.workunit.client.1.smithi134.stdout:7/673: write d0/d16/d8b/fad [3939623,744] 0 2024-09-17T04:21:04.793 INFO:tasks.workunit.client.1.smithi134.stdout:7/674: truncate d0/d16/d8b/d6a/d70/d85/fa4 979732 0 2024-09-17T04:21:04.794 INFO:tasks.workunit.client.0.smithi088.stdout:7/399: mknod d2/d1d/d2e/d7d/d23/d45/d62/d82/c84 0 2024-09-17T04:21:04.794 INFO:tasks.workunit.client.1.smithi134.stdout:7/675: chown d0/d16/la 6159 1 2024-09-17T04:21:04.795 INFO:tasks.workunit.client.0.smithi088.stdout:7/400: readlink d2/d1d/d2e/d7d/d23/d45/l5c 0 2024-09-17T04:21:04.796 INFO:tasks.workunit.client.0.smithi088.stdout:5/336: creat d2/d31/d33/d20/f6a x:0 0 0 2024-09-17T04:21:04.799 INFO:tasks.workunit.client.0.smithi088.stdout:5/337: read - d2/d31/d33/d20/d25/d49/f4a zero size 2024-09-17T04:21:04.800 INFO:tasks.workunit.client.0.smithi088.stdout:3/367: write d0/d13/d1b/f27 [739159,18019] 0 2024-09-17T04:21:04.801 INFO:tasks.workunit.client.1.smithi134.stdout:2/765: getdents d19/d1c/d47 0 2024-09-17T04:21:04.804 INFO:tasks.workunit.client.0.smithi088.stdout:6/421: unlink d14/d44/d45/d6b/d2a/d52/d7a/f75 0 2024-09-17T04:21:04.804 INFO:tasks.workunit.client.0.smithi088.stdout:3/368: fdatasync d0/d13/d1b/d29/d30/f39 0 2024-09-17T04:21:04.804 INFO:tasks.workunit.client.0.smithi088.stdout:2/353: dwrite d0/d1/d2d/d33/d4b/d24/f51 [0,4194304] 0 2024-09-17T04:21:04.805 INFO:tasks.workunit.client.1.smithi134.stdout:0/781: dread d11/d19/f8d [0,4194304] 0 2024-09-17T04:21:04.805 INFO:tasks.workunit.client.1.smithi134.stdout:0/782: chown d11/d24/d49 0 1 2024-09-17T04:21:04.806 INFO:tasks.workunit.client.0.smithi088.stdout:8/371: unlink d7/cc 0 2024-09-17T04:21:04.807 INFO:tasks.workunit.client.1.smithi134.stdout:6/908: link de/d19/d1f/d55/d77/d89/d109/dc7/fe2 de/d19/d21/d2d/d92/f121 0 2024-09-17T04:21:04.808 INFO:tasks.workunit.client.0.smithi088.stdout:2/354: chown d0/d1/d2d/d33/d4b/d24/d3b/c37 399560354 1 2024-09-17T04:21:04.809 INFO:tasks.workunit.client.0.smithi088.stdout:8/372: fsync d7/dd/d31/d47/d55/f74 0 2024-09-17T04:21:04.809 INFO:tasks.workunit.client.0.smithi088.stdout:5/338: dread d2/d31/d33/d20/d25/d2c/f50 [0,4194304] 0 2024-09-17T04:21:04.809 INFO:tasks.workunit.client.0.smithi088.stdout:4/383: getdents d5/d3d/d73 0 2024-09-17T04:21:04.811 INFO:tasks.workunit.client.1.smithi134.stdout:8/743: dread d4/d1e/daf/d60/f7d [0,4194304] 0 2024-09-17T04:21:04.813 INFO:tasks.workunit.client.0.smithi088.stdout:1/376: getdents d0/d1/df/d20/d4e/d5d 0 2024-09-17T04:21:04.813 INFO:tasks.workunit.client.0.smithi088.stdout:0/245: dread db/d1b/d36/d4a/d20/f2c [0,4194304] 0 2024-09-17T04:21:04.814 INFO:tasks.workunit.client.1.smithi134.stdout:3/900: getdents de/d12/d15/d9f/dba/dc0 0 2024-09-17T04:21:04.821 INFO:tasks.workunit.client.1.smithi134.stdout:7/676: dread d0/d16/d8b/fc2 [0,4194304] 0 2024-09-17T04:21:04.821 INFO:tasks.workunit.client.1.smithi134.stdout:5/763: dread d0/f6f [0,4194304] 0 2024-09-17T04:21:04.821 INFO:tasks.workunit.client.1.smithi134.stdout:0/783: fdatasync d11/d24/d49/d62/f103 0 2024-09-17T04:21:04.821 INFO:tasks.workunit.client.1.smithi134.stdout:1/866: write d12/d19/d1d/d5f/fb0 [1886327,32621] 0 2024-09-17T04:21:04.821 INFO:tasks.workunit.client.1.smithi134.stdout:0/784: chown d11/d22/l95 47865 1 2024-09-17T04:21:04.822 INFO:tasks.workunit.client.1.smithi134.stdout:1/867: write d12/d36/fc2 [3518738,28257] 0 2024-09-17T04:21:04.824 INFO:tasks.workunit.client.1.smithi134.stdout:0/785: chown d11/d18/d97/df3/d43/d5d/c8f 172 1 2024-09-17T04:21:04.825 INFO:tasks.workunit.client.1.smithi134.stdout:1/868: write d12/d19/d5d/d91/fe7 [591730,30312] 0 2024-09-17T04:21:04.825 INFO:tasks.workunit.client.1.smithi134.stdout:7/677: dread d0/f33 [0,4194304] 0 2024-09-17T04:21:04.827 INFO:tasks.workunit.client.1.smithi134.stdout:0/786: write d11/d22/f10d [422592,89661] 0 2024-09-17T04:21:04.835 INFO:tasks.workunit.client.1.smithi134.stdout:1/869: dwrite d12/d19/f8e [0,4194304] 0 2024-09-17T04:21:04.835 INFO:tasks.workunit.client.0.smithi088.stdout:1/377: symlink d0/d1/d16/d77/l81 0 2024-09-17T04:21:04.837 INFO:tasks.workunit.client.0.smithi088.stdout:1/378: write d0/d1/df/d20/f49 [2414051,110245] 0 2024-09-17T04:21:04.837 INFO:tasks.workunit.client.0.smithi088.stdout:3/369: creat d0/f79 x:0 0 0 2024-09-17T04:21:04.838 INFO:tasks.workunit.client.1.smithi134.stdout:3/901: dwrite de/d12/d15/d1d/d2d/fb4 [0,4194304] 0 2024-09-17T04:21:04.839 INFO:tasks.workunit.client.0.smithi088.stdout:1/379: chown d0/d1/df/d20/d4e/d5d 4063874 1 2024-09-17T04:21:04.839 INFO:tasks.workunit.client.1.smithi134.stdout:4/832: sync 2024-09-17T04:21:04.840 INFO:tasks.workunit.client.0.smithi088.stdout:7/401: getdents d2/d1d/d2e/d7d/d23 0 2024-09-17T04:21:04.840 INFO:tasks.workunit.client.0.smithi088.stdout:1/380: stat d0/f6a 0 2024-09-17T04:21:04.844 INFO:tasks.workunit.client.0.smithi088.stdout:0/246: write db/f11 [902755,25678] 0 2024-09-17T04:21:04.844 INFO:tasks.workunit.client.1.smithi134.stdout:2/766: rmdir d19/d1c/d92/ddc/dc6/dbc/de4 0 2024-09-17T04:21:04.845 INFO:tasks.workunit.client.0.smithi088.stdout:3/370: symlink d0/d13/d1b/d29/d2b/d40/l7a 0 2024-09-17T04:21:04.850 INFO:tasks.workunit.client.0.smithi088.stdout:7/402: mkdir d2/d1d/d2e/d7d/d23/d45/d85 0 2024-09-17T04:21:04.852 INFO:tasks.workunit.client.1.smithi134.stdout:5/764: dread d0/d3a/d2b/f51 [0,4194304] 0 2024-09-17T04:21:04.854 INFO:tasks.workunit.client.1.smithi134.stdout:3/902: dwrite de/d12/d15/d1d/d8f/deb/f100 [0,4194304] 0 2024-09-17T04:21:04.854 INFO:tasks.workunit.client.1.smithi134.stdout:6/909: dwrite de/f53 [0,4194304] 0 2024-09-17T04:21:04.856 INFO:tasks.workunit.client.0.smithi088.stdout:8/373: dread d7/f9 [4194304,4194304] 0 2024-09-17T04:21:04.856 INFO:tasks.workunit.client.1.smithi134.stdout:4/833: dwrite d0/df/d35/d5c/d8b/fc0 [4194304,4194304] 0 2024-09-17T04:21:04.859 INFO:tasks.workunit.client.0.smithi088.stdout:7/403: fsync d2/d4/f33 0 2024-09-17T04:21:04.859 INFO:tasks.workunit.client.0.smithi088.stdout:0/247: dwrite db/d1b/d36/d47/f30 [0,4194304] 0 2024-09-17T04:21:04.861 INFO:tasks.workunit.client.1.smithi134.stdout:7/678: mknod d0/d16/d35/cd1 0 2024-09-17T04:21:04.861 INFO:tasks.workunit.client.1.smithi134.stdout:5/765: write d0/da/d29/d78/fd4 [1000007,50464] 0 2024-09-17T04:21:04.862 INFO:tasks.workunit.client.1.smithi134.stdout:3/903: readlink de/d67/lbc 0 2024-09-17T04:21:04.862 INFO:tasks.workunit.client.1.smithi134.stdout:4/834: write d0/d13/d40/d42/f10a [961801,64981] 0 2024-09-17T04:21:04.864 INFO:tasks.workunit.client.0.smithi088.stdout:6/422: dread d14/d44/d45/d6b/d16/f2e [0,4194304] 0 2024-09-17T04:21:04.864 INFO:tasks.workunit.client.0.smithi088.stdout:1/381: dwrite d0/d13/f3f [4194304,4194304] 0 2024-09-17T04:21:04.867 INFO:tasks.workunit.client.1.smithi134.stdout:2/767: creat d19/d7e/ffc x:0 0 0 2024-09-17T04:21:04.869 INFO:tasks.workunit.client.1.smithi134.stdout:8/744: getdents d4/d11/da1/dc7/d5e 0 2024-09-17T04:21:04.870 INFO:tasks.workunit.client.1.smithi134.stdout:1/870: mkdir d12/d1c/d100/d11b/d122 0 2024-09-17T04:21:04.870 INFO:tasks.workunit.client.1.smithi134.stdout:4/835: rmdir d0/d13/d40/d42/d92/dc3 39 2024-09-17T04:21:04.871 INFO:tasks.workunit.client.0.smithi088.stdout:1/382: chown d0/d1/d16/d35/f50 2 1 2024-09-17T04:21:04.873 INFO:tasks.workunit.client.0.smithi088.stdout:6/423: mknod d14/d3a/c9a 0 2024-09-17T04:21:04.874 INFO:tasks.workunit.client.0.smithi088.stdout:1/383: write d0/d1/df/d20/f62 [4033415,69704] 0 2024-09-17T04:21:04.875 INFO:tasks.workunit.client.1.smithi134.stdout:5/766: fsync d0/d3a/d2b/d61/d7b/f97 0 2024-09-17T04:21:04.876 INFO:tasks.workunit.client.0.smithi088.stdout:1/384: write d0/d13/f3f [6752408,76948] 0 2024-09-17T04:21:04.877 INFO:tasks.workunit.client.0.smithi088.stdout:7/404: creat d2/d4/f86 x:0 0 0 2024-09-17T04:21:04.878 INFO:tasks.workunit.client.0.smithi088.stdout:8/374: dread d7/d29/d2a/d38/d42/f4e [0,4194304] 0 2024-09-17T04:21:04.878 INFO:tasks.workunit.client.1.smithi134.stdout:6/910: readlink de/d19/d21/d2d/d92/l113 0 2024-09-17T04:21:04.880 INFO:tasks.workunit.client.0.smithi088.stdout:6/424: dread d14/d2f/f67 [0,4194304] 0 2024-09-17T04:21:04.882 INFO:tasks.workunit.client.0.smithi088.stdout:6/425: chown d14/d44/f8a 0 1 2024-09-17T04:21:04.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:04 smithi088 ceph-mon[27811]: pgmap v23: 65 pgs: 65 active+clean; 2.2 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 66 MiB/s rd, 234 MiB/s wr, 412 op/s 2024-09-17T04:21:04.888 INFO:tasks.workunit.client.0.smithi088.stdout:1/385: dread d0/d13/f1b [0,4194304] 0 2024-09-17T04:21:04.890 INFO:tasks.workunit.client.0.smithi088.stdout:8/375: link d7/d29/d2a/d38/d42/f5b d7/d29/d2a/d38/d3d/f78 0 2024-09-17T04:21:04.890 INFO:tasks.workunit.client.1.smithi134.stdout:1/871: creat d12/d19/d5d/d91/dac/dd5/def/df1/f123 x:0 0 0 2024-09-17T04:21:04.892 INFO:tasks.workunit.client.0.smithi088.stdout:3/371: dread d0/f4 [0,4194304] 0 2024-09-17T04:21:04.892 INFO:tasks.workunit.client.1.smithi134.stdout:5/767: mknod d0/d3a/cfc 0 2024-09-17T04:21:04.893 INFO:tasks.workunit.client.1.smithi134.stdout:7/679: getdents d0/dd/d3a/d3d/d38/d74 0 2024-09-17T04:21:04.895 INFO:tasks.workunit.client.1.smithi134.stdout:1/872: creat d12/d1c/d4a/f124 x:0 0 0 2024-09-17T04:21:04.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:04 smithi134 ceph-mon[35201]: pgmap v23: 65 pgs: 65 active+clean; 2.2 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 66 MiB/s rd, 234 MiB/s wr, 412 op/s 2024-09-17T04:21:04.897 INFO:tasks.workunit.client.0.smithi088.stdout:1/386: rename d0/d1/d16/d35/f7c to d0/d1/d16/d56/d5b/f82 0 2024-09-17T04:21:04.899 INFO:tasks.workunit.client.0.smithi088.stdout:6/426: getdents d14/d44 0 2024-09-17T04:21:04.901 INFO:tasks.workunit.client.1.smithi134.stdout:7/680: rename d0/d16/d8b/d6a/d70/d85/fa4 to d0/d16/d8b/d6a/fd2 0 2024-09-17T04:21:04.902 INFO:tasks.workunit.client.0.smithi088.stdout:8/376: dwrite d7/d29/f3c [0,4194304] 0 2024-09-17T04:21:04.904 INFO:tasks.workunit.client.0.smithi088.stdout:3/372: dwrite d0/d13/d1b/d29/d30/f68 [0,4194304] 0 2024-09-17T04:21:04.904 INFO:tasks.workunit.client.1.smithi134.stdout:2/768: dread d19/f1a [0,4194304] 0 2024-09-17T04:21:04.906 INFO:tasks.workunit.client.1.smithi134.stdout:3/904: dread de/d10/f64 [0,4194304] 0 2024-09-17T04:21:04.907 INFO:tasks.workunit.client.1.smithi134.stdout:3/905: write de/d12/d15/d1d/d8f/deb/f100 [3409536,13680] 0 2024-09-17T04:21:04.912 INFO:tasks.workunit.client.0.smithi088.stdout:0/248: write db/fc [916068,43300] 0 2024-09-17T04:21:04.912 INFO:tasks.workunit.client.1.smithi134.stdout:1/873: getdents d12/d19/d5d/d88/d110 0 2024-09-17T04:21:04.913 INFO:tasks.workunit.client.1.smithi134.stdout:1/874: chown d12/d19/d1d/d3e 7647 1 2024-09-17T04:21:04.917 INFO:tasks.workunit.client.0.smithi088.stdout:3/373: readlink d0/l18 0 2024-09-17T04:21:04.917 INFO:tasks.workunit.client.1.smithi134.stdout:0/787: truncate d11/d24/d49/d62/daf/fb0 381528 0 2024-09-17T04:21:04.918 INFO:tasks.workunit.client.0.smithi088.stdout:3/374: chown d0/d13/f22 58238 1 2024-09-17T04:21:04.918 INFO:tasks.workunit.client.1.smithi134.stdout:6/911: dread de/f2c [0,4194304] 0 2024-09-17T04:21:04.919 INFO:tasks.workunit.client.0.smithi088.stdout:8/377: fsync d7/dd/d31/f3b 0 2024-09-17T04:21:04.921 INFO:tasks.workunit.client.1.smithi134.stdout:6/912: write de/d19/d1f/d55/d77/d89/d109/dc7/ddc/db3/ff1 [292085,61514] 0 2024-09-17T04:21:04.922 INFO:tasks.workunit.client.1.smithi134.stdout:6/913: chown de/l103 1073 1 2024-09-17T04:21:04.922 INFO:tasks.workunit.client.0.smithi088.stdout:6/427: dwrite d14/d44/d45/d6b/d16/f74 [0,4194304] 0 2024-09-17T04:21:04.923 INFO:tasks.workunit.client.1.smithi134.stdout:6/914: dread - de/d19/d1f/d55/d77/d89/d109/fef zero size 2024-09-17T04:21:04.927 INFO:tasks.workunit.client.0.smithi088.stdout:7/405: truncate d2/d1d/d2e/d7d/d23/d45/f63 82973 0 2024-09-17T04:21:04.934 INFO:tasks.workunit.client.0.smithi088.stdout:1/387: dread d0/d1/d27/f40 [0,4194304] 0 2024-09-17T04:21:04.935 INFO:tasks.workunit.client.1.smithi134.stdout:6/915: creat de/d19/d1f/d5c/f122 x:0 0 0 2024-09-17T04:21:04.936 INFO:tasks.workunit.client.0.smithi088.stdout:0/249: symlink db/d1b/d36/d4a/l51 0 2024-09-17T04:21:04.936 INFO:tasks.workunit.client.1.smithi134.stdout:5/768: dwrite d0/da/d2c/f63 [0,4194304] 0 2024-09-17T04:21:04.937 INFO:tasks.workunit.client.1.smithi134.stdout:5/769: chown d0/da/d69/d41/d72 13 1 2024-09-17T04:21:04.938 INFO:tasks.workunit.client.1.smithi134.stdout:6/916: dread de/d19/da3/de6/ff6 [0,4194304] 0 2024-09-17T04:21:04.938 INFO:tasks.workunit.client.1.smithi134.stdout:1/875: truncate d12/d19/d5d/f95 847539 0 2024-09-17T04:21:04.940 INFO:tasks.workunit.client.1.smithi134.stdout:7/681: rename d0/d16/d8b/d6a/f88 to d0/dd/d3a/d3d/fd3 0 2024-09-17T04:21:04.943 INFO:tasks.workunit.client.1.smithi134.stdout:7/682: read d0/dd/d3a/d3d/d38/d60/fb8 [756590,9327] 0 2024-09-17T04:21:04.943 INFO:tasks.workunit.client.1.smithi134.stdout:2/769: dread d19/d1c/f1d [4194304,4194304] 0 2024-09-17T04:21:04.945 INFO:tasks.workunit.client.0.smithi088.stdout:7/406: chown d2/d4/c1f 672676648 1 2024-09-17T04:21:04.951 INFO:tasks.workunit.client.1.smithi134.stdout:6/917: rename de/d19/d1f/d55/d77/lab to de/d19/d1f/d85/l123 0 2024-09-17T04:21:04.953 INFO:tasks.workunit.client.0.smithi088.stdout:3/375: dwrite d0/d13/f53 [0,4194304] 0 2024-09-17T04:21:04.955 INFO:tasks.workunit.client.1.smithi134.stdout:0/788: link d11/d19/d21/c69 d11/d48/c10e 0 2024-09-17T04:21:04.957 INFO:tasks.workunit.client.0.smithi088.stdout:1/388: unlink d0/d1/df/l3a 0 2024-09-17T04:21:04.958 INFO:tasks.workunit.client.1.smithi134.stdout:2/770: stat d19/d1c/d92/ddc/dc6/c7f 0 2024-09-17T04:21:04.959 INFO:tasks.workunit.client.0.smithi088.stdout:1/389: write d0/d1/fa [2788956,112266] 0 2024-09-17T04:21:04.959 INFO:tasks.workunit.client.0.smithi088.stdout:3/376: creat d0/d54/d55/f7b x:0 0 0 2024-09-17T04:21:04.961 INFO:tasks.workunit.client.1.smithi134.stdout:2/771: write d19/d27/f5b [4221934,19811] 0 2024-09-17T04:21:04.962 INFO:tasks.workunit.client.1.smithi134.stdout:3/906: getdents de/d12/d15/d9f/dba/dc4/dca/d10b 0 2024-09-17T04:21:04.963 INFO:tasks.workunit.client.0.smithi088.stdout:6/428: link d14/d44/d45/d6b/d2a/f49 d14/d44/d45/d6b/d2a/d52/f9b 0 2024-09-17T04:21:04.965 INFO:tasks.workunit.client.1.smithi134.stdout:5/770: symlink d0/da/d2c/deb/lfd 0 2024-09-17T04:21:04.966 INFO:tasks.workunit.client.1.smithi134.stdout:0/789: dwrite d11/d24/d49/d62/daf/fd4 [0,4194304] 0 2024-09-17T04:21:04.971 INFO:tasks.workunit.client.0.smithi088.stdout:8/378: truncate d7/d29/f3c 3837911 0 2024-09-17T04:21:04.973 INFO:tasks.workunit.client.0.smithi088.stdout:8/379: write d7/dd/d31/f76 [801571,90868] 0 2024-09-17T04:21:04.974 INFO:tasks.workunit.client.0.smithi088.stdout:1/390: write d0/d1/df/d20/d4e/d5d/f6d [2442635,60655] 0 2024-09-17T04:21:04.975 INFO:tasks.workunit.client.0.smithi088.stdout:8/380: chown f2 3448727 1 2024-09-17T04:21:04.976 INFO:tasks.workunit.client.0.smithi088.stdout:6/429: readlink d14/d44/d45/d6b/d2a/l79 0 2024-09-17T04:21:04.977 INFO:tasks.workunit.client.0.smithi088.stdout:6/430: chown d14/d44 14653 1 2024-09-17T04:21:04.977 INFO:tasks.workunit.client.0.smithi088.stdout:7/407: dread d2/d4/d7/f34 [0,4194304] 0 2024-09-17T04:21:04.979 INFO:tasks.workunit.client.0.smithi088.stdout:3/377: link d0/d13/d1b/d29/f2d d0/d13/d4d/f7c 0 2024-09-17T04:21:04.980 INFO:tasks.workunit.client.1.smithi134.stdout:7/683: write d0/dd/d3a/fae [837558,87698] 0 2024-09-17T04:21:04.981 INFO:tasks.workunit.client.1.smithi134.stdout:3/907: creat de/d12/d15/d9f/dba/f129 x:0 0 0 2024-09-17T04:21:04.982 INFO:tasks.workunit.client.1.smithi134.stdout:8/745: sync 2024-09-17T04:21:04.982 INFO:tasks.workunit.client.1.smithi134.stdout:4/836: sync 2024-09-17T04:21:04.983 INFO:tasks.workunit.client.0.smithi088.stdout:1/391: mknod d0/d1/df/d20/d4e/c83 0 2024-09-17T04:21:04.983 INFO:tasks.workunit.client.1.smithi134.stdout:4/837: chown d0/fe1 114146165 1 2024-09-17T04:21:04.986 INFO:tasks.workunit.client.0.smithi088.stdout:8/381: dwrite d7/dd/d31/d47/d55/f74 [0,4194304] 0 2024-09-17T04:21:04.986 INFO:tasks.workunit.client.0.smithi088.stdout:6/431: read - d14/d44/d45/d6b/d2a/f8d zero size 2024-09-17T04:21:04.987 INFO:tasks.workunit.client.0.smithi088.stdout:0/250: dread db/d1b/d36/d4a/f35 [0,4194304] 0 2024-09-17T04:21:04.991 INFO:tasks.workunit.client.1.smithi134.stdout:6/918: write de/d19/f33 [4651802,52864] 0 2024-09-17T04:21:04.994 INFO:tasks.workunit.client.0.smithi088.stdout:8/382: dwrite f2 [4194304,4194304] 0 2024-09-17T04:21:04.995 INFO:tasks.workunit.client.1.smithi134.stdout:1/876: truncate d12/d19/d1d/d61/dd3/dda/f10a 3010257 0 2024-09-17T04:21:04.995 INFO:tasks.workunit.client.1.smithi134.stdout:6/919: read de/d5d/d67/fbd [2764105,48287] 0 2024-09-17T04:21:04.996 INFO:tasks.workunit.client.1.smithi134.stdout:1/877: write d12/d19/d4f/f11f [310530,39159] 0 2024-09-17T04:21:04.997 INFO:tasks.workunit.client.0.smithi088.stdout:6/432: read f4 [2651528,109950] 0 2024-09-17T04:21:04.997 INFO:tasks.workunit.client.1.smithi134.stdout:6/920: write de/d19/d21/d2d/f6a [1745422,3509] 0 2024-09-17T04:21:04.998 INFO:tasks.workunit.client.1.smithi134.stdout:1/878: write d12/d1c/d2e/f5a [2960619,18698] 0 2024-09-17T04:21:04.998 INFO:tasks.workunit.client.1.smithi134.stdout:6/921: dread - de/d19/d62/db0/f107 zero size 2024-09-17T04:21:04.999 INFO:tasks.workunit.client.1.smithi134.stdout:1/879: readlink d12/d36/l89 0 2024-09-17T04:21:04.999 INFO:tasks.workunit.client.0.smithi088.stdout:3/378: dwrite d0/d13/d4d/f7c [0,4194304] 0 2024-09-17T04:21:05.006 INFO:tasks.workunit.client.1.smithi134.stdout:4/838: dread d0/f22 [0,4194304] 0 2024-09-17T04:21:05.008 INFO:tasks.workunit.client.1.smithi134.stdout:3/908: mkdir de/d12/d15/d1d/d2d/d31/d6a/d78/d7c/d12a 0 2024-09-17T04:21:05.010 INFO:tasks.workunit.client.1.smithi134.stdout:8/746: creat d4/d11/da1/dc7/fe9 x:0 0 0 2024-09-17T04:21:05.015 INFO:tasks.workunit.client.0.smithi088.stdout:1/392: rename d0/d1/df/d20/d4e to d0/d13/d84 0 2024-09-17T04:21:05.015 INFO:tasks.workunit.client.0.smithi088.stdout:8/383: rmdir d7/d29 39 2024-09-17T04:21:05.016 INFO:tasks.workunit.client.1.smithi134.stdout:8/747: dwrite d4/db/dd/d43/da5/fc1 [0,4194304] 0 2024-09-17T04:21:05.018 INFO:tasks.workunit.client.1.smithi134.stdout:2/772: creat d19/d27/d31/d34/df2/d6f/da9/db0/dca/ffd x:0 0 0 2024-09-17T04:21:05.020 INFO:tasks.workunit.client.1.smithi134.stdout:5/771: symlink d0/da/d69/d41/d6d/d89/dd5/lfe 0 2024-09-17T04:21:05.021 INFO:tasks.workunit.client.0.smithi088.stdout:7/408: fdatasync d2/d1d/d2e/d7d/d23/d45/f63 0 2024-09-17T04:21:05.022 INFO:tasks.workunit.client.0.smithi088.stdout:3/379: fdatasync d0/f4 0 2024-09-17T04:21:05.023 INFO:tasks.workunit.client.0.smithi088.stdout:7/409: write d2/d1d/d2e/d7d/f5e [1382638,33302] 0 2024-09-17T04:21:05.024 INFO:tasks.workunit.client.0.smithi088.stdout:3/380: fsync d0/d13/d1b/f21 0 2024-09-17T04:21:05.026 INFO:tasks.workunit.client.0.smithi088.stdout:0/251: creat db/d3c/d4f/f52 x:0 0 0 2024-09-17T04:21:05.027 INFO:tasks.workunit.client.0.smithi088.stdout:3/381: truncate d0/d13/d4d/f6c 329477 0 2024-09-17T04:21:05.029 INFO:tasks.workunit.client.0.smithi088.stdout:1/393: mkdir d0/d1/df/d85 0 2024-09-17T04:21:05.031 INFO:tasks.workunit.client.1.smithi134.stdout:1/880: unlink d12/d1c/d56/c99 0 2024-09-17T04:21:05.033 INFO:tasks.workunit.client.1.smithi134.stdout:7/684: creat d0/dd/dbb/fd4 x:0 0 0 2024-09-17T04:21:05.034 INFO:tasks.workunit.client.0.smithi088.stdout:7/410: dwrite d2/d1d/f58 [0,4194304] 0 2024-09-17T04:21:05.035 INFO:tasks.workunit.client.1.smithi134.stdout:7/685: write d0/d16/d8b/fad [2804345,35309] 0 2024-09-17T04:21:05.036 INFO:tasks.workunit.client.0.smithi088.stdout:0/252: dwrite db/f19 [8388608,4194304] 0 2024-09-17T04:21:05.036 INFO:tasks.workunit.client.1.smithi134.stdout:4/839: mknod d0/d13/d40/d42/c110 0 2024-09-17T04:21:05.039 INFO:tasks.workunit.client.1.smithi134.stdout:1/881: dwrite d12/d19/d5d/d91/dac/fba [4194304,4194304] 0 2024-09-17T04:21:05.039 INFO:tasks.workunit.client.1.smithi134.stdout:3/909: creat de/d12/d9d/f12b x:0 0 0 2024-09-17T04:21:05.041 INFO:tasks.workunit.client.1.smithi134.stdout:1/882: write d12/d19/d4f/d101/f104 [578113,115440] 0 2024-09-17T04:21:05.042 INFO:tasks.workunit.client.1.smithi134.stdout:1/883: readlink d12/d19/d4f/lb8 0 2024-09-17T04:21:05.045 INFO:tasks.workunit.client.0.smithi088.stdout:3/382: creat d0/d13/d4d/f7d x:0 0 0 2024-09-17T04:21:05.045 INFO:tasks.workunit.client.0.smithi088.stdout:0/253: dwrite db/f4c [0,4194304] 0 2024-09-17T04:21:05.045 INFO:tasks.workunit.client.0.smithi088.stdout:0/254: stat db/f11 0 2024-09-17T04:21:05.047 INFO:tasks.workunit.client.1.smithi134.stdout:8/748: creat d4/d1f/d2b/dbf/dcc/fea x:0 0 0 2024-09-17T04:21:05.050 INFO:tasks.workunit.client.0.smithi088.stdout:6/433: link d14/d44/d45/d6b/f66 d14/d44/d45/d6b/d16/f9c 0 2024-09-17T04:21:05.052 INFO:tasks.workunit.client.0.smithi088.stdout:1/394: creat d0/d1/d16/d77/f86 x:0 0 0 2024-09-17T04:21:05.053 INFO:tasks.workunit.client.0.smithi088.stdout:1/395: fsync d0/d1/d27/f40 0 2024-09-17T04:21:05.054 INFO:tasks.workunit.client.0.smithi088.stdout:7/411: dread d2/d1d/d2e/d7d/d23/d45/f65 [0,4194304] 0 2024-09-17T04:21:05.057 INFO:tasks.workunit.client.1.smithi134.stdout:0/790: creat d11/d24/d49/d62/f10f x:0 0 0 2024-09-17T04:21:05.060 INFO:tasks.workunit.client.1.smithi134.stdout:6/922: write de/d19/d1f/f73 [1642614,119263] 0 2024-09-17T04:21:05.060 INFO:tasks.workunit.client.0.smithi088.stdout:1/396: mkdir d0/d1/d16/d56/d5b/d87 0 2024-09-17T04:21:05.062 INFO:tasks.workunit.client.1.smithi134.stdout:4/840: creat d0/df/d35/d5c/f111 x:0 0 0 2024-09-17T04:21:05.062 INFO:tasks.workunit.client.0.smithi088.stdout:7/412: truncate d2/d1d/d2e/d7d/f4a 526158 0 2024-09-17T04:21:05.062 INFO:tasks.workunit.client.1.smithi134.stdout:4/841: readlink d0/df/d1e/lad 0 2024-09-17T04:21:05.063 INFO:tasks.workunit.client.0.smithi088.stdout:6/434: mkdir d14/d2f/d87/d9d 0 2024-09-17T04:21:05.063 INFO:tasks.workunit.client.1.smithi134.stdout:6/923: dread de/d19/d1f/d55/f68 [0,4194304] 0 2024-09-17T04:21:05.064 INFO:tasks.workunit.client.1.smithi134.stdout:3/910: creat de/d10/d3d/da2/f12c x:0 0 0 2024-09-17T04:21:05.065 INFO:tasks.workunit.client.1.smithi134.stdout:8/749: rmdir d4/d1f/d2b 39 2024-09-17T04:21:05.066 INFO:tasks.workunit.client.1.smithi134.stdout:8/750: chown d4/d1f/d25/l70 0 1 2024-09-17T04:21:05.066 INFO:tasks.workunit.client.1.smithi134.stdout:3/911: write de/d12/d15/d1d/d2d/d31/d6a/d78/d7c/fcf [4513265,73915] 0 2024-09-17T04:21:05.069 INFO:tasks.workunit.client.0.smithi088.stdout:1/397: creat d0/d1/f88 x:0 0 0 2024-09-17T04:21:05.071 INFO:tasks.workunit.client.1.smithi134.stdout:7/686: link d0/dd/d3a/d3d/d38/d60/f84 d0/d16/d8b/dc7/fd5 0 2024-09-17T04:21:05.072 INFO:tasks.workunit.client.0.smithi088.stdout:7/413: dwrite d2/f60 [0,4194304] 0 2024-09-17T04:21:05.072 INFO:tasks.workunit.client.1.smithi134.stdout:7/687: fdatasync d0/f20 0 2024-09-17T04:21:05.073 INFO:tasks.workunit.client.0.smithi088.stdout:7/414: chown d2/d1d/d2e/d7d/l26 21115915 1 2024-09-17T04:21:05.074 INFO:tasks.workunit.client.0.smithi088.stdout:7/415: chown d2/d79 108249639 1 2024-09-17T04:21:05.074 INFO:tasks.workunit.client.0.smithi088.stdout:1/398: symlink d0/d1/d16/d2a/l89 0 2024-09-17T04:21:05.077 INFO:tasks.workunit.client.1.smithi134.stdout:8/751: chown d4/l17 18865 1 2024-09-17T04:21:05.078 INFO:tasks.workunit.client.0.smithi088.stdout:7/416: mknod d2/d4/d7/d46/d67/c87 0 2024-09-17T04:21:05.080 INFO:tasks.workunit.client.0.smithi088.stdout:1/399: mkdir d0/d1/d16/d56/d8a 0 2024-09-17T04:21:05.082 INFO:tasks.workunit.client.0.smithi088.stdout:7/417: dread d2/d1d/f58 [0,4194304] 0 2024-09-17T04:21:05.083 INFO:tasks.workunit.client.1.smithi134.stdout:0/791: symlink d11/d48/dd2/df4/l110 0 2024-09-17T04:21:05.085 INFO:tasks.workunit.client.0.smithi088.stdout:1/400: creat d0/d1/d16/d35/f8b x:0 0 0 2024-09-17T04:21:05.086 INFO:tasks.workunit.client.0.smithi088.stdout:1/401: chown d0/d13/d84/d5d/f78 126 1 2024-09-17T04:21:05.087 INFO:tasks.workunit.client.1.smithi134.stdout:6/924: dread de/d19/d1f/d55/f87 [4194304,4194304] 0 2024-09-17T04:21:05.087 INFO:tasks.workunit.client.1.smithi134.stdout:6/925: fdatasync de/d19/f33 0 2024-09-17T04:21:05.088 INFO:tasks.workunit.client.0.smithi088.stdout:7/418: unlink d2/d1d/f3d 0 2024-09-17T04:21:05.089 INFO:tasks.workunit.client.1.smithi134.stdout:7/688: unlink d0/dd/d3a/d3d/d38/c21 0 2024-09-17T04:21:05.093 INFO:tasks.workunit.client.0.smithi088.stdout:7/419: dwrite d2/f21 [0,4194304] 0 2024-09-17T04:21:05.093 INFO:tasks.workunit.client.1.smithi134.stdout:2/773: getdents d19/d27/d31/d34/df2/d6f/d84 0 2024-09-17T04:21:05.094 INFO:tasks.workunit.client.1.smithi134.stdout:2/774: dread - d19/d27/d31/d34/df2/d6f/d84/d98/fce zero size 2024-09-17T04:21:05.095 INFO:tasks.workunit.client.0.smithi088.stdout:7/420: fdatasync d2/d4/d7/d20/f6b 0 2024-09-17T04:21:05.095 INFO:tasks.workunit.client.1.smithi134.stdout:2/775: chown d19/l56 3 1 2024-09-17T04:21:05.095 INFO:tasks.workunit.client.1.smithi134.stdout:8/752: truncate d4/db/dd/f30 46843 0 2024-09-17T04:21:05.099 INFO:tasks.workunit.client.0.smithi088.stdout:1/402: creat d0/d1/f8c x:0 0 0 2024-09-17T04:21:05.100 INFO:tasks.workunit.client.0.smithi088.stdout:1/403: chown d0/d1/df/f3e 319188 1 2024-09-17T04:21:05.101 INFO:tasks.workunit.client.0.smithi088.stdout:7/421: creat d2/d1d/d2e/d7d/d23/d45/f88 x:0 0 0 2024-09-17T04:21:05.102 INFO:tasks.workunit.client.1.smithi134.stdout:2/776: dwrite d19/d27/d31/f5c [4194304,4194304] 0 2024-09-17T04:21:05.103 INFO:tasks.workunit.client.0.smithi088.stdout:7/422: truncate d2/d4/d7/d46/d67/f72 873220 0 2024-09-17T04:21:05.105 INFO:tasks.workunit.client.1.smithi134.stdout:6/926: symlink de/d19/d21/d2d/l124 0 2024-09-17T04:21:05.105 INFO:tasks.workunit.client.0.smithi088.stdout:1/404: dread d0/d13/d84/d5d/f6d [0,4194304] 0 2024-09-17T04:21:05.106 INFO:tasks.workunit.client.1.smithi134.stdout:6/927: fsync de/d19/d21/d4d/fa4 0 2024-09-17T04:21:05.108 INFO:tasks.workunit.client.0.smithi088.stdout:7/423: mknod d2/d1d/c89 0 2024-09-17T04:21:05.108 INFO:tasks.workunit.client.1.smithi134.stdout:5/772: write d0/da/d69/d41/d6d/d89/fc8 [2055746,85120] 0 2024-09-17T04:21:05.109 INFO:tasks.workunit.client.1.smithi134.stdout:5/773: read d0/f6f [2808608,98335] 0 2024-09-17T04:21:05.109 INFO:tasks.workunit.client.0.smithi088.stdout:7/424: chown d2/d1d/d2e/d7d/d23/d45/d6d 1680 1 2024-09-17T04:21:05.110 INFO:tasks.workunit.client.1.smithi134.stdout:8/753: symlink d4/db/dd/da2/leb 0 2024-09-17T04:21:05.110 INFO:tasks.workunit.client.0.smithi088.stdout:7/425: chown d2/d4/d7/d46 25256 1 2024-09-17T04:21:05.110 INFO:tasks.workunit.client.1.smithi134.stdout:5/774: chown d0/da/d69/d41/f49 14228428 1 2024-09-17T04:21:05.111 INFO:tasks.workunit.client.0.smithi088.stdout:7/426: stat d2/d4/f52 0 2024-09-17T04:21:05.112 INFO:tasks.workunit.client.1.smithi134.stdout:0/792: symlink d11/d19/l111 0 2024-09-17T04:21:05.113 INFO:tasks.workunit.client.1.smithi134.stdout:4/842: getdents d0/d13/d40/d42/d92/d65 0 2024-09-17T04:21:05.115 INFO:tasks.workunit.client.1.smithi134.stdout:4/843: stat d0/df/d1e/f2e 0 2024-09-17T04:21:05.117 INFO:tasks.workunit.client.0.smithi088.stdout:1/405: creat d0/f8d x:0 0 0 2024-09-17T04:21:05.118 INFO:tasks.workunit.client.1.smithi134.stdout:3/912: write de/d12/d22/d5a/fb5 [679504,105823] 0 2024-09-17T04:21:05.119 INFO:tasks.workunit.client.1.smithi134.stdout:5/775: dwrite d0/da/d29/d8e/faa [0,4194304] 0 2024-09-17T04:21:05.120 INFO:tasks.workunit.client.1.smithi134.stdout:3/913: fdatasync de/d12/d22/d5a/ff3 0 2024-09-17T04:21:05.123 INFO:tasks.workunit.client.0.smithi088.stdout:7/427: creat d2/f8a x:0 0 0 2024-09-17T04:21:05.124 INFO:tasks.workunit.client.1.smithi134.stdout:8/754: mkdir d4/d11/da1/db3/dec 0 2024-09-17T04:21:05.125 INFO:tasks.workunit.client.1.smithi134.stdout:2/777: dread d19/d27/f32 [4194304,4194304] 0 2024-09-17T04:21:05.125 INFO:tasks.workunit.client.1.smithi134.stdout:8/755: readlink d4/d11/da1/dc7/lc8 0 2024-09-17T04:21:05.126 INFO:tasks.workunit.client.0.smithi088.stdout:1/406: dwrite d0/d1/df/d20/f80 [0,4194304] 0 2024-09-17T04:21:05.126 INFO:tasks.workunit.client.0.smithi088.stdout:7/428: readlink d2/d1d/d2e/d7d/d23/d45/l48 0 2024-09-17T04:21:05.126 INFO:tasks.workunit.client.1.smithi134.stdout:2/778: chown d19/d1c/d47/d50/f95 23 1 2024-09-17T04:21:05.132 INFO:tasks.workunit.client.1.smithi134.stdout:4/844: mknod d0/df/d1e/d73/c112 0 2024-09-17T04:21:05.134 INFO:tasks.workunit.client.0.smithi088.stdout:7/429: rename d2/d1d/d2e/d7d/d23/d45/f88 to d2/d1d/d2e/d7d/d23/f8b 0 2024-09-17T04:21:05.135 INFO:tasks.workunit.client.1.smithi134.stdout:4/845: truncate d0/df/d1e/d63/f9a 4320509 0 2024-09-17T04:21:05.136 INFO:tasks.workunit.client.1.smithi134.stdout:4/846: fsync d0/d13/d40/d42/dc5/fed 0 2024-09-17T04:21:05.137 INFO:tasks.workunit.client.1.smithi134.stdout:6/928: mknod de/d99/c125 0 2024-09-17T04:21:05.140 INFO:tasks.workunit.client.1.smithi134.stdout:5/776: dread d0/da/d29/f9b [0,4194304] 0 2024-09-17T04:21:05.141 INFO:tasks.workunit.client.1.smithi134.stdout:5/777: readlink d0/lec 0 2024-09-17T04:21:05.143 INFO:tasks.workunit.client.1.smithi134.stdout:3/914: mkdir de/d12/d12d 0 2024-09-17T04:21:05.144 INFO:tasks.workunit.client.1.smithi134.stdout:4/847: mknod d0/df/d1e/d63/c113 0 2024-09-17T04:21:05.144 INFO:tasks.workunit.client.1.smithi134.stdout:7/689: truncate d0/d16/d35/d4b/f48 6123408 0 2024-09-17T04:21:05.146 INFO:tasks.workunit.client.1.smithi134.stdout:7/690: write d0/dd/d3a/d3d/d38/f3c [785518,81817] 0 2024-09-17T04:21:05.147 INFO:tasks.workunit.client.1.smithi134.stdout:0/793: link d11/d19/d21/d37/f8b d11/d6f/da8/f112 0 2024-09-17T04:21:05.149 INFO:tasks.workunit.client.1.smithi134.stdout:3/915: creat de/d12/d15/d1d/d8f/f12e x:0 0 0 2024-09-17T04:21:05.149 INFO:tasks.workunit.client.1.smithi134.stdout:4/848: dread d0/d13/d40/d42/d92/fe3 [0,4194304] 0 2024-09-17T04:21:05.150 INFO:tasks.workunit.client.1.smithi134.stdout:2/779: dread d19/d1c/d47/d50/f95 [0,4194304] 0 2024-09-17T04:21:05.151 INFO:tasks.workunit.client.1.smithi134.stdout:5/778: symlink d0/d3a/lff 0 2024-09-17T04:21:05.152 INFO:tasks.workunit.client.1.smithi134.stdout:4/849: write d0/df/d1e/f2e [3269565,87160] 0 2024-09-17T04:21:05.153 INFO:tasks.workunit.client.1.smithi134.stdout:5/779: write d0/da/d29/d7c/db3/fdd [527265,102911] 0 2024-09-17T04:21:05.153 INFO:tasks.workunit.client.1.smithi134.stdout:7/691: creat d0/d16/d8b/d6a/d70/d85/fd6 x:0 0 0 2024-09-17T04:21:05.154 INFO:tasks.workunit.client.1.smithi134.stdout:4/850: write d0/d13/d40/d42/d92/d7b/fc8 [2549805,107397] 0 2024-09-17T04:21:05.155 INFO:tasks.workunit.client.1.smithi134.stdout:3/916: creat de/d12/d15/d9f/dba/dc4/f12f x:0 0 0 2024-09-17T04:21:05.156 INFO:tasks.workunit.client.1.smithi134.stdout:5/780: fsync d0/da/d29/d7c/d9e/fc1 0 2024-09-17T04:21:05.157 INFO:tasks.workunit.client.0.smithi088.stdout:1/407: dwrite d0/d1/d16/d35/f43 [0,4194304] 0 2024-09-17T04:21:05.157 INFO:tasks.workunit.client.1.smithi134.stdout:4/851: write d0/d13/d40/d42/ff2 [765878,66806] 0 2024-09-17T04:21:05.159 INFO:tasks.workunit.client.0.smithi088.stdout:7/430: write d2/d1d/d2e/d7d/f30 [2146736,47071] 0 2024-09-17T04:21:05.159 INFO:tasks.workunit.client.1.smithi134.stdout:7/692: symlink d0/dd/d3a/d3d/d38/d74/ld7 0 2024-09-17T04:21:05.161 INFO:tasks.workunit.client.1.smithi134.stdout:7/693: chown d0/dd/d3a/d3d/d4c/fcc 3 1 2024-09-17T04:21:05.162 INFO:tasks.workunit.client.0.smithi088.stdout:1/408: rename d0/d1/f88 to d0/d1/d16/d77/f8e 0 2024-09-17T04:21:05.164 INFO:tasks.workunit.client.0.smithi088.stdout:7/431: mknod d2/d1d/d2e/c8c 0 2024-09-17T04:21:05.165 INFO:tasks.workunit.client.0.smithi088.stdout:7/432: chown d2/d1d/d2e/d7d/d23/f2f 178 1 2024-09-17T04:21:05.166 INFO:tasks.workunit.client.1.smithi134.stdout:6/929: write de/d19/f24 [2076940,19859] 0 2024-09-17T04:21:05.167 INFO:tasks.workunit.client.1.smithi134.stdout:6/930: dread - de/d19/d1f/dae/f10e zero size 2024-09-17T04:21:05.169 INFO:tasks.workunit.client.0.smithi088.stdout:1/409: unlink d0/d1/df/d20/f29 0 2024-09-17T04:21:05.170 INFO:tasks.workunit.client.1.smithi134.stdout:4/852: mkdir d0/df/d1e/dbc/d114 0 2024-09-17T04:21:05.172 INFO:tasks.workunit.client.1.smithi134.stdout:7/694: fdatasync d0/dd/f58 0 2024-09-17T04:21:05.175 INFO:tasks.workunit.client.1.smithi134.stdout:0/794: dwrite d11/d19/d21/f27 [0,4194304] 0 2024-09-17T04:21:05.175 INFO:tasks.workunit.client.1.smithi134.stdout:5/781: mkdir d0/d3a/d2b/d100 0 2024-09-17T04:21:05.176 INFO:tasks.workunit.client.1.smithi134.stdout:3/917: dread de/d12/d22/f46 [0,4194304] 0 2024-09-17T04:21:05.178 INFO:tasks.workunit.client.0.smithi088.stdout:1/410: creat d0/d1/df/f8f x:0 0 0 2024-09-17T04:21:05.179 INFO:tasks.workunit.client.1.smithi134.stdout:1/884: sync 2024-09-17T04:21:05.180 INFO:tasks.workunit.client.1.smithi134.stdout:1/885: write d12/d19/d4f/fb3 [3964149,93369] 0 2024-09-17T04:21:05.180 INFO:tasks.workunit.client.0.smithi088.stdout:7/433: mkdir d2/d8d 0 2024-09-17T04:21:05.183 INFO:tasks.workunit.client.1.smithi134.stdout:6/931: unlink de/d19/d62/db0/fd8 0 2024-09-17T04:21:05.186 INFO:tasks.workunit.client.1.smithi134.stdout:7/695: rmdir d0/dd/dbb 39 2024-09-17T04:21:05.188 INFO:tasks.workunit.client.0.smithi088.stdout:7/434: symlink d2/d1d/d2e/d7d/l8e 0 2024-09-17T04:21:05.190 INFO:tasks.workunit.client.1.smithi134.stdout:6/932: dwrite de/d19/d62/d34/d8e/ffd [0,4194304] 0 2024-09-17T04:21:05.190 INFO:tasks.workunit.client.1.smithi134.stdout:7/696: truncate d0/d16/d8b/d6a/d70/fcf 216793 0 2024-09-17T04:21:05.190 INFO:tasks.workunit.client.1.smithi134.stdout:0/795: rename d11/d4c/dd3/d81/ca0 to d11/d6f/c113 0 2024-09-17T04:21:05.191 INFO:tasks.workunit.client.1.smithi134.stdout:3/918: symlink de/d12/d15/d1d/d8f/l130 0 2024-09-17T04:21:05.191 INFO:tasks.workunit.client.0.smithi088.stdout:7/435: mknod d2/d4/d7/d46/c8f 0 2024-09-17T04:21:05.192 INFO:tasks.workunit.client.1.smithi134.stdout:2/780: link d19/d1c/ld5 d19/d27/lfe 0 2024-09-17T04:21:05.195 INFO:tasks.workunit.client.0.smithi088.stdout:7/436: read d2/d1d/f6a [1766297,128714] 0 2024-09-17T04:21:05.201 INFO:tasks.workunit.client.1.smithi134.stdout:3/919: dwrite de/d12/d15/d1d/d2d/d31/d6a/d83/f89 [0,4194304] 0 2024-09-17T04:21:05.201 INFO:tasks.workunit.client.1.smithi134.stdout:3/920: stat de/d10/d70/l76 0 2024-09-17T04:21:05.202 INFO:tasks.workunit.client.0.smithi088.stdout:1/411: getdents d0/d1/df 0 2024-09-17T04:21:05.202 INFO:tasks.workunit.client.0.smithi088.stdout:7/437: dread d2/d1d/d2e/d7d/d23/d45/f4d [0,4194304] 0 2024-09-17T04:21:05.203 INFO:tasks.workunit.client.0.smithi088.stdout:7/438: readlink d2/d1d/d2e/d7d/d23/d45/l51 0 2024-09-17T04:21:05.204 INFO:tasks.workunit.client.1.smithi134.stdout:4/853: link d0/df/fd8 d0/d13/d40/f115 0 2024-09-17T04:21:05.206 INFO:tasks.workunit.client.1.smithi134.stdout:8/756: sync 2024-09-17T04:21:05.206 INFO:tasks.workunit.client.1.smithi134.stdout:6/933: mkdir de/d19/d74/d126 0 2024-09-17T04:21:05.209 INFO:tasks.workunit.client.1.smithi134.stdout:5/782: dread d0/d3a/ff [0,4194304] 0 2024-09-17T04:21:05.209 INFO:tasks.workunit.client.1.smithi134.stdout:6/934: write de/d19/d74/f11d [555477,124783] 0 2024-09-17T04:21:05.210 INFO:tasks.workunit.client.1.smithi134.stdout:8/757: chown d4/l21 6306853 1 2024-09-17T04:21:05.211 INFO:tasks.workunit.client.1.smithi134.stdout:1/886: creat d12/d19/d1d/f125 x:0 0 0 2024-09-17T04:21:05.212 INFO:tasks.workunit.client.1.smithi134.stdout:7/697: creat d0/dd/d3a/d3d/fd8 x:0 0 0 2024-09-17T04:21:05.212 INFO:tasks.workunit.client.1.smithi134.stdout:0/796: mkdir d11/d18/d97/df3/d9a/dea/d114 0 2024-09-17T04:21:05.213 INFO:tasks.workunit.client.1.smithi134.stdout:6/935: rmdir de/d19/d1f/d5c 39 2024-09-17T04:21:05.214 INFO:tasks.workunit.client.1.smithi134.stdout:7/698: write d0/d16/f5a [7505106,47543] 0 2024-09-17T04:21:05.214 INFO:tasks.workunit.client.1.smithi134.stdout:4/854: fsync d0/d13/d40/d42/d92/f7e 0 2024-09-17T04:21:05.215 INFO:tasks.workunit.client.1.smithi134.stdout:3/921: link de/d10/d70/le9 de/d12/d15/d1d/d2d/d31/d6a/d83/d126/l131 0 2024-09-17T04:21:05.215 INFO:tasks.workunit.client.1.smithi134.stdout:0/797: rmdir d11/d48 39 2024-09-17T04:21:05.216 INFO:tasks.workunit.client.1.smithi134.stdout:4/855: fsync d0/df/d1e/f2e 0 2024-09-17T04:21:05.216 INFO:tasks.workunit.client.1.smithi134.stdout:1/887: mknod d12/d19/d5d/d91/dac/dd5/c126 0 2024-09-17T04:21:05.218 INFO:tasks.workunit.client.1.smithi134.stdout:6/936: symlink de/d19/d1f/d55/l127 0 2024-09-17T04:21:05.220 INFO:tasks.workunit.client.1.smithi134.stdout:8/758: rename d4/d11/da1/dc7/d13/l89 to d4/d11/da1/dc7/led 0 2024-09-17T04:21:05.222 INFO:tasks.workunit.client.1.smithi134.stdout:1/888: mkdir d12/d1c/d2e/d120/d127 0 2024-09-17T04:21:05.223 INFO:tasks.workunit.client.1.smithi134.stdout:0/798: link d11/d19/c4a d11/d24/d49/d62/daf/c115 0 2024-09-17T04:21:05.223 INFO:tasks.workunit.client.1.smithi134.stdout:8/759: chown d4/d11/da1/dc7/d13/c74 1275653 1 2024-09-17T04:21:05.224 INFO:tasks.workunit.client.1.smithi134.stdout:3/922: getdents de 0 2024-09-17T04:21:05.224 INFO:tasks.workunit.client.1.smithi134.stdout:1/889: mkdir d12/d1c/d2e/d128 0 2024-09-17T04:21:05.227 INFO:tasks.workunit.client.1.smithi134.stdout:3/923: chown de/d12/d15/d1d/d2d/d31/d6a/d78 68749 1 2024-09-17T04:21:05.227 INFO:tasks.workunit.client.1.smithi134.stdout:0/799: truncate d11/d24/d49/d62/f10f 237533 0 2024-09-17T04:21:05.228 INFO:tasks.workunit.client.1.smithi134.stdout:1/890: rename d12/d1c/d4a/ca8 to d12/db2/c129 0 2024-09-17T04:21:05.230 INFO:tasks.workunit.client.1.smithi134.stdout:3/924: chown de/d12/d15/c21 15222 1 2024-09-17T04:21:05.232 INFO:tasks.workunit.client.1.smithi134.stdout:7/699: write d0/dd/f54 [4371930,17903] 0 2024-09-17T04:21:05.234 INFO:tasks.workunit.client.1.smithi134.stdout:2/781: dwrite d19/d1c/d92/ddc/dc6/ded/fd1 [0,4194304] 0 2024-09-17T04:21:05.236 INFO:tasks.workunit.client.1.smithi134.stdout:3/925: write de/d12/d15/d1d/d2d/d63/fff [248153,109190] 0 2024-09-17T04:21:05.237 INFO:tasks.workunit.client.1.smithi134.stdout:1/891: creat d12/d19/d5d/d91/dac/dd5/def/df1/f12a x:0 0 0 2024-09-17T04:21:05.239 INFO:tasks.workunit.client.1.smithi134.stdout:0/800: truncate d11/d18/d97/df3/d43/d5d/f78 1268128 0 2024-09-17T04:21:05.244 INFO:tasks.workunit.client.1.smithi134.stdout:6/937: dread de/d19/d62/db0/fbe [0,4194304] 0 2024-09-17T04:21:05.244 INFO:tasks.workunit.client.1.smithi134.stdout:0/801: truncate d11/d24/d49/d62/df7/fe8 23342 0 2024-09-17T04:21:05.245 INFO:tasks.workunit.client.1.smithi134.stdout:4/856: dread d0/d13/f14 [0,4194304] 0 2024-09-17T04:21:05.245 INFO:tasks.workunit.client.1.smithi134.stdout:3/926: truncate de/d12/d15/d1d/d2d/f36 1618040 0 2024-09-17T04:21:05.245 INFO:tasks.workunit.client.1.smithi134.stdout:6/938: read f9 [3420190,113452] 0 2024-09-17T04:21:05.248 INFO:tasks.workunit.client.1.smithi134.stdout:2/782: dread d19/d27/d31/d34/df2/d6f/d84/d98/feb [0,4194304] 0 2024-09-17T04:21:05.250 INFO:tasks.workunit.client.1.smithi134.stdout:3/927: mkdir de/d12/d15/d1d/d8f/deb/d132 0 2024-09-17T04:21:05.251 INFO:tasks.workunit.client.1.smithi134.stdout:2/783: chown d19/d27/d31/d34/df2/d6f/da9/lc9 35479 1 2024-09-17T04:21:05.252 INFO:tasks.workunit.client.1.smithi134.stdout:0/802: rename d11/f3b to d11/d24/d49/d62/df7/dd8/f116 0 2024-09-17T04:21:05.252 INFO:tasks.workunit.client.1.smithi134.stdout:7/700: dread d0/f6 [0,4194304] 0 2024-09-17T04:21:05.256 INFO:tasks.workunit.client.1.smithi134.stdout:7/701: dread - d0/d16/fbc zero size 2024-09-17T04:21:05.256 INFO:tasks.workunit.client.1.smithi134.stdout:2/784: chown d19/d1c/d47/d50/fcb 57897007 1 2024-09-17T04:21:05.257 INFO:tasks.workunit.client.1.smithi134.stdout:4/857: dwrite d0/d13/d40/d42/d92/fcf [0,4194304] 0 2024-09-17T04:21:05.264 INFO:tasks.workunit.client.1.smithi134.stdout:2/785: rename d19/d27/d31/d34/df2/d6f/d84/fb6 to d19/d1c/d92/ddc/dc6/dbc/de3/fff 0 2024-09-17T04:21:05.266 INFO:tasks.workunit.client.1.smithi134.stdout:6/939: write de/d19/d21/d2d/d92/f121 [1913430,56549] 0 2024-09-17T04:21:05.266 INFO:tasks.workunit.client.1.smithi134.stdout:1/892: dread d12/d19/d5d/f7a [4194304,4194304] 0 2024-09-17T04:21:05.267 INFO:tasks.workunit.client.1.smithi134.stdout:3/928: write de/d12/f48 [1964180,83081] 0 2024-09-17T04:21:05.267 INFO:tasks.workunit.client.1.smithi134.stdout:0/803: write d11/d4c/dd3/f54 [3052432,44616] 0 2024-09-17T04:21:05.268 INFO:tasks.workunit.client.1.smithi134.stdout:4/858: write d0/d13/d40/d42/d92/d86/faf [1226106,28739] 0 2024-09-17T04:21:05.272 INFO:tasks.workunit.client.1.smithi134.stdout:2/786: rename d19/d27/f5b to d19/d1c/d92/ddc/dc6/df0/f100 0 2024-09-17T04:21:05.275 INFO:tasks.workunit.client.1.smithi134.stdout:7/702: dwrite d0/dd/d3a/d3d/fd3 [0,4194304] 0 2024-09-17T04:21:05.275 INFO:tasks.workunit.client.1.smithi134.stdout:3/929: creat de/d12/d15/dd0/dfe/f133 x:0 0 0 2024-09-17T04:21:05.277 INFO:tasks.workunit.client.1.smithi134.stdout:0/804: creat d11/d18/d97/df3/d9a/dea/d114/f117 x:0 0 0 2024-09-17T04:21:05.278 INFO:tasks.workunit.client.1.smithi134.stdout:1/893: rename d12/f90 to d12/d36/f12b 0 2024-09-17T04:21:05.281 INFO:tasks.workunit.client.1.smithi134.stdout:3/930: rmdir de/d10 39 2024-09-17T04:21:05.281 INFO:tasks.workunit.client.1.smithi134.stdout:4/859: truncate d0/d13/d40/d42/f66 1496413 0 2024-09-17T04:21:05.283 INFO:tasks.workunit.client.1.smithi134.stdout:6/940: getdents de/d2b/d8a 0 2024-09-17T04:21:05.283 INFO:tasks.workunit.client.1.smithi134.stdout:7/703: mkdir d0/d16/dd9 0 2024-09-17T04:21:05.285 INFO:tasks.workunit.client.1.smithi134.stdout:3/931: creat de/d12/d15/d125/f134 x:0 0 0 2024-09-17T04:21:05.287 INFO:tasks.workunit.client.1.smithi134.stdout:4/860: creat d0/df/d35/d5c/f116 x:0 0 0 2024-09-17T04:21:05.287 INFO:tasks.workunit.client.1.smithi134.stdout:2/787: write d19/f73 [2247929,32182] 0 2024-09-17T04:21:05.288 INFO:tasks.workunit.client.1.smithi134.stdout:6/941: chown de/d19/d1f/d55/d77/d89/d109/dc7/lf5 0 1 2024-09-17T04:21:05.291 INFO:tasks.workunit.client.1.smithi134.stdout:3/932: mknod de/d12/d15/d9f/df7/c135 0 2024-09-17T04:21:05.291 INFO:tasks.workunit.client.1.smithi134.stdout:2/788: stat d19/d1c/l24 0 2024-09-17T04:21:05.291 INFO:tasks.workunit.client.1.smithi134.stdout:1/894: dwrite d12/d19/f54 [0,4194304] 0 2024-09-17T04:21:05.294 INFO:tasks.workunit.client.1.smithi134.stdout:0/805: truncate d11/d24/d49/d62/df7/fcd 3331325 0 2024-09-17T04:21:05.295 INFO:tasks.workunit.client.1.smithi134.stdout:4/861: symlink d0/d13/d40/d42/d92/d86/l117 0 2024-09-17T04:21:05.296 INFO:tasks.workunit.client.1.smithi134.stdout:2/789: creat d19/d1c/d47/d50/d85/d93/dc1/f101 x:0 0 0 2024-09-17T04:21:05.296 INFO:tasks.workunit.client.1.smithi134.stdout:7/704: link d0/dd/db9/f94 d0/dd/d3a/d3d/fda 0 2024-09-17T04:21:05.297 INFO:tasks.workunit.client.1.smithi134.stdout:4/862: write d0/df/d1e/d73/fda [5033823,120168] 0 2024-09-17T04:21:05.330 INFO:tasks.workunit.client.1.smithi134.stdout:7/705: read d0/d16/d8b/d6a/fd2 [278088,82063] 0 2024-09-17T04:21:05.330 INFO:tasks.workunit.client.1.smithi134.stdout:6/942: link de/d19/d1f/d55/d77/d89/d109/dc7/ddc/db3/db4/dd7/f10d de/d19/d1f/d85/dde/f128 0 2024-09-17T04:21:05.330 INFO:tasks.workunit.client.1.smithi134.stdout:0/806: dread - d11/d6f/da8/f112 zero size 2024-09-17T04:21:05.332 INFO:tasks.workunit.client.1.smithi134.stdout:4/863: chown d0/df/dd5/le2 1 1 2024-09-17T04:21:05.333 INFO:tasks.workunit.client.1.smithi134.stdout:6/943: chown de/d19/d1f/f28 31518852 1 2024-09-17T04:21:05.336 INFO:tasks.workunit.client.1.smithi134.stdout:7/706: rename d0/d16/d35/d4b/f48 to d0/d16/d8b/fdb 0 2024-09-17T04:21:05.338 INFO:tasks.workunit.client.1.smithi134.stdout:3/933: dwrite de/d10/f123 [0,4194304] 0 2024-09-17T04:21:05.341 INFO:tasks.workunit.client.1.smithi134.stdout:2/790: dwrite d19/d27/d31/d34/df2/d6f/d84/d98/feb [0,4194304] 0 2024-09-17T04:21:05.344 INFO:tasks.workunit.client.1.smithi134.stdout:2/791: fsync d19/d1c/f1f 0 2024-09-17T04:21:05.344 INFO:tasks.workunit.client.1.smithi134.stdout:3/934: mkdir de/d12/d9d/d136 0 2024-09-17T04:21:05.344 INFO:tasks.workunit.client.1.smithi134.stdout:7/707: rename d0/d16/d8b/d6a/c7e to d0/d16/d35/d4b/cdc 0 2024-09-17T04:21:05.346 INFO:tasks.workunit.client.1.smithi134.stdout:6/944: truncate de/f12 983422 0 2024-09-17T04:21:05.348 INFO:tasks.workunit.client.1.smithi134.stdout:7/708: readlink d0/dd/d3a/lc3 0 2024-09-17T04:21:05.351 INFO:tasks.workunit.client.1.smithi134.stdout:2/792: write d19/d1c/d92/ddc/dc6/dbc/fb5 [227191,94561] 0 2024-09-17T04:21:05.351 INFO:tasks.workunit.client.1.smithi134.stdout:4/864: dwrite d0/d13/d40/d42/d92/dc3/fbf [0,4194304] 0 2024-09-17T04:21:05.353 INFO:tasks.workunit.client.1.smithi134.stdout:3/935: mkdir de/d12/d22/d5a/d137 0 2024-09-17T04:21:05.354 INFO:tasks.workunit.client.1.smithi134.stdout:0/807: dwrite d11/d19/f91 [0,4194304] 0 2024-09-17T04:21:05.357 INFO:tasks.workunit.client.1.smithi134.stdout:0/808: stat d11/d24/d49/f68 0 2024-09-17T04:21:05.358 INFO:tasks.workunit.client.1.smithi134.stdout:3/936: creat de/d12/d15/d9f/dba/f138 x:0 0 0 2024-09-17T04:21:05.363 INFO:tasks.workunit.client.1.smithi134.stdout:2/793: dwrite d19/d1c/d92/ddc/dc6/df0/f100 [0,4194304] 0 2024-09-17T04:21:05.364 INFO:tasks.workunit.client.1.smithi134.stdout:3/937: mkdir de/d12/d15/d1d/d2d/d31/d6a/d78/d7c/d12a/d139 0 2024-09-17T04:21:05.366 INFO:tasks.workunit.client.1.smithi134.stdout:2/794: chown d19/d1c/d92/ddc/dc6/dbc/l8b 4 1 2024-09-17T04:21:05.367 INFO:tasks.workunit.client.1.smithi134.stdout:2/795: dread - d19/d1c/d92/ff6 zero size 2024-09-17T04:21:05.371 INFO:tasks.workunit.client.1.smithi134.stdout:8/760: sync 2024-09-17T04:21:05.371 INFO:tasks.workunit.client.1.smithi134.stdout:5/783: sync 2024-09-17T04:21:05.373 INFO:tasks.workunit.client.1.smithi134.stdout:8/761: stat d4/d11/da1/dc7/d5e 0 2024-09-17T04:21:05.376 INFO:tasks.workunit.client.1.smithi134.stdout:5/784: fdatasync d0/f6f 0 2024-09-17T04:21:05.376 INFO:tasks.workunit.client.1.smithi134.stdout:2/796: dwrite d19/d1c/d47/fcd [0,4194304] 0 2024-09-17T04:21:05.377 INFO:tasks.workunit.client.1.smithi134.stdout:6/945: write de/d19/d1f/d55/f68 [4018696,41680] 0 2024-09-17T04:21:05.377 INFO:tasks.workunit.client.1.smithi134.stdout:5/785: unlink d0/d3a/cfc 0 2024-09-17T04:21:05.382 INFO:tasks.workunit.client.1.smithi134.stdout:6/946: write de/d2b/f9f [4151295,96011] 0 2024-09-17T04:21:05.384 INFO:tasks.workunit.client.1.smithi134.stdout:2/797: rename d19/d1c/d92/ddc/dcf to d19/d27/d31/d34/df2/d63/d94/d102 0 2024-09-17T04:21:05.388 INFO:tasks.workunit.client.1.smithi134.stdout:6/947: read de/d19/d74/d98/ff7 [517245,124917] 0 2024-09-17T04:21:05.389 INFO:tasks.workunit.client.1.smithi134.stdout:7/709: dwrite d0/dd/d3a/d3d/d38/d74/f7f [0,4194304] 0 2024-09-17T04:21:05.390 INFO:tasks.workunit.client.1.smithi134.stdout:7/710: stat d0/d16/d8b/d6a/d70/d85/fd6 0 2024-09-17T04:21:05.436 INFO:tasks.workunit.client.1.smithi134.stdout:2/798: symlink d19/d1c/d92/ddc/dc6/l103 0 2024-09-17T04:21:05.438 INFO:tasks.workunit.client.1.smithi134.stdout:3/938: write de/d67/fd7 [217850,60629] 0 2024-09-17T04:21:05.440 INFO:tasks.workunit.client.1.smithi134.stdout:3/939: write de/d12/d15/dd0/dfe/f11c [968185,12500] 0 2024-09-17T04:21:05.441 INFO:tasks.workunit.client.1.smithi134.stdout:1/895: sync 2024-09-17T04:21:05.441 INFO:tasks.workunit.client.1.smithi134.stdout:2/799: chown d19/d1c/d47/d50/d85/fb2 12548671 1 2024-09-17T04:21:05.446 INFO:tasks.workunit.client.1.smithi134.stdout:0/809: dwrite d11/d6f/fc1 [0,4194304] 0 2024-09-17T04:21:05.453 INFO:tasks.workunit.client.1.smithi134.stdout:8/762: dwrite d4/db/dd/f16 [4194304,4194304] 0 2024-09-17T04:21:05.458 INFO:tasks.workunit.client.1.smithi134.stdout:2/800: dwrite d19/fe6 [0,4194304] 0 2024-09-17T04:21:05.461 INFO:tasks.workunit.client.1.smithi134.stdout:6/948: dread de/d19/d21/d2d/f2f [0,4194304] 0 2024-09-17T04:21:05.463 INFO:tasks.workunit.client.1.smithi134.stdout:6/949: chown de/d19/d21/d4d/f6f 2 1 2024-09-17T04:21:05.473 INFO:tasks.workunit.client.1.smithi134.stdout:0/810: mkdir d11/d4c/d76/d118 0 2024-09-17T04:21:05.474 INFO:tasks.workunit.client.1.smithi134.stdout:8/763: read d4/db/f20 [4115904,121756] 0 2024-09-17T04:21:05.479 INFO:tasks.workunit.client.1.smithi134.stdout:6/950: truncate de/d19/d21/d2d/f5b 363259 0 2024-09-17T04:21:05.484 INFO:tasks.workunit.client.1.smithi134.stdout:0/811: getdents d11/d24/d49/d62/df7/dd8/de2 0 2024-09-17T04:21:05.487 INFO:tasks.workunit.client.1.smithi134.stdout:6/951: dwrite de/d19/d74/d98/ff7 [0,4194304] 0 2024-09-17T04:21:05.489 INFO:tasks.workunit.client.1.smithi134.stdout:4/865: sync 2024-09-17T04:21:05.490 INFO:tasks.workunit.client.1.smithi134.stdout:0/812: getdents d11/d18/d97/df3 0 2024-09-17T04:21:05.495 INFO:tasks.workunit.client.1.smithi134.stdout:4/866: write d0/df/d1e/d73/dc7/fde [1997862,79743] 0 2024-09-17T04:21:05.496 INFO:tasks.workunit.client.1.smithi134.stdout:7/711: creat d0/dd/d3a/d3d/d38/d60/fdd x:0 0 0 2024-09-17T04:21:05.498 INFO:tasks.workunit.client.1.smithi134.stdout:0/813: creat d11/d48/dff/f119 x:0 0 0 2024-09-17T04:21:05.499 INFO:tasks.workunit.client.1.smithi134.stdout:6/952: dwrite de/d19/d62/d7c/ddb/f11b [0,4194304] 0 2024-09-17T04:21:05.501 INFO:tasks.workunit.client.1.smithi134.stdout:8/764: dread d4/db/dd/f1b [0,4194304] 0 2024-09-17T04:21:05.509 INFO:tasks.workunit.client.1.smithi134.stdout:0/814: getdents d11 0 2024-09-17T04:21:05.510 INFO:tasks.workunit.client.1.smithi134.stdout:6/953: link de/d19/d21/ld1 de/d19/d74/d94/l129 0 2024-09-17T04:21:05.519 INFO:tasks.workunit.client.1.smithi134.stdout:7/712: mkdir d0/d16/d8b/d6a/d70/dde 0 2024-09-17T04:21:05.520 INFO:tasks.workunit.client.1.smithi134.stdout:2/801: rmdir d19/d27/d31/d34/df2/d6f/da9/db0/dca 39 2024-09-17T04:21:05.521 INFO:tasks.workunit.client.1.smithi134.stdout:2/802: chown d19/l56 1264012 1 2024-09-17T04:21:05.536 INFO:tasks.workunit.client.1.smithi134.stdout:2/803: creat d19/d1c/d47/d50/d85/d93/dc1/f104 x:0 0 0 2024-09-17T04:21:05.597 INFO:tasks.workunit.client.0.smithi088.stdout:9/438: sync 2024-09-17T04:21:05.600 INFO:tasks.workunit.client.0.smithi088.stdout:9/439: link d2/dd/d14/d8b/d35/f6c d2/dd/d14/d8b/d43/d51/f9d 0 2024-09-17T04:21:05.603 INFO:tasks.workunit.client.0.smithi088.stdout:9/440: fdatasync d2/f7 0 2024-09-17T04:21:05.610 INFO:tasks.workunit.client.0.smithi088.stdout:9/441: getdents d2/dd 0 2024-09-17T04:21:05.614 INFO:tasks.workunit.client.1.smithi134.stdout:5/786: truncate d0/da/d29/d7c/db3/fd8 1956698 0 2024-09-17T04:21:05.617 INFO:tasks.workunit.client.0.smithi088.stdout:9/442: dwrite d2/dd/d14/d8b/d35/f88 [0,4194304] 0 2024-09-17T04:21:05.622 INFO:tasks.workunit.client.0.smithi088.stdout:9/443: unlink d2/d2b/d2e/c8e 0 2024-09-17T04:21:05.636 INFO:tasks.workunit.client.1.smithi134.stdout:6/954: symlink de/d19/l12a 0 2024-09-17T04:21:05.636 INFO:tasks.workunit.client.1.smithi134.stdout:3/940: dwrite de/d12/d22/d5a/f5d [0,4194304] 0 2024-09-17T04:21:05.637 INFO:tasks.workunit.client.1.smithi134.stdout:6/955: chown de/d19/d21/d2d/f3e 1488903 1 2024-09-17T04:21:05.640 INFO:tasks.workunit.client.1.smithi134.stdout:3/941: readlink de/d12/d15/d1d/d8f/deb/lce 0 2024-09-17T04:21:05.641 INFO:tasks.workunit.client.1.smithi134.stdout:3/942: stat de/d12/d9d/lb8 0 2024-09-17T04:21:05.642 INFO:tasks.workunit.client.1.smithi134.stdout:6/956: unlink de/d19/d62/d7c/ddb/f11b 0 2024-09-17T04:21:05.649 INFO:tasks.workunit.client.1.smithi134.stdout:6/957: dread - de/d19/d1f/d5c/fa2 zero size 2024-09-17T04:21:05.650 INFO:tasks.workunit.client.1.smithi134.stdout:2/804: sync 2024-09-17T04:21:05.652 INFO:tasks.workunit.client.1.smithi134.stdout:3/943: link de/d12/d15/dd0/dfe/lf6 de/d12/d15/d125/l13a 0 2024-09-17T04:21:05.654 INFO:tasks.workunit.client.1.smithi134.stdout:2/805: symlink d19/d1c/d92/ddc/dc6/dbc/de3/l105 0 2024-09-17T04:21:05.654 INFO:tasks.workunit.client.1.smithi134.stdout:2/806: readlink d19/d1c/d47/l4e 0 2024-09-17T04:21:05.655 INFO:tasks.workunit.client.1.smithi134.stdout:6/958: mkdir de/d19/d12b 0 2024-09-17T04:21:05.656 INFO:tasks.workunit.client.1.smithi134.stdout:3/944: symlink de/d12/d15/d1d/d2d/d31/d6a/d78/d7c/d12a/l13b 0 2024-09-17T04:21:05.657 INFO:tasks.workunit.client.1.smithi134.stdout:3/945: write de/d10/d70/f113 [892163,40788] 0 2024-09-17T04:21:05.658 INFO:tasks.workunit.client.1.smithi134.stdout:2/807: creat d19/d1c/d47/dae/f106 x:0 0 0 2024-09-17T04:21:05.658 INFO:tasks.workunit.client.1.smithi134.stdout:6/959: rmdir de/d19/d21/d2d/d92 39 2024-09-17T04:21:05.660 INFO:tasks.workunit.client.1.smithi134.stdout:2/808: dread - d19/d1c/d92/ddc/dc6/dbc/de3/fea zero size 2024-09-17T04:21:05.660 INFO:tasks.workunit.client.1.smithi134.stdout:2/809: chown d19/d1c/d92/ddc 699262 1 2024-09-17T04:21:05.662 INFO:tasks.workunit.client.1.smithi134.stdout:3/946: symlink de/d12/d22/dfd/d11d/l13c 0 2024-09-17T04:21:05.663 INFO:tasks.workunit.client.1.smithi134.stdout:2/810: mkdir d19/d1c/d92/ddc/dc6/dbc/d107 0 2024-09-17T04:21:05.669 INFO:tasks.workunit.client.1.smithi134.stdout:8/765: write d4/db/dd/f30 [86124,9319] 0 2024-09-17T04:21:05.670 INFO:tasks.workunit.client.1.smithi134.stdout:8/766: symlink d4/db/dd/d43/lee 0 2024-09-17T04:21:05.671 INFO:tasks.workunit.client.1.smithi134.stdout:0/815: write d11/d18/d97/fc3 [771659,79505] 0 2024-09-17T04:21:05.672 INFO:tasks.workunit.client.1.smithi134.stdout:0/816: chown d11/d18/d97/df3/f55 38019530 1 2024-09-17T04:21:05.673 INFO:tasks.workunit.client.1.smithi134.stdout:1/896: unlink d12/d19/d1d/d61/da0/feb 0 2024-09-17T04:21:05.674 INFO:tasks.workunit.client.1.smithi134.stdout:8/767: mkdir d4/d1f/d25/def 0 2024-09-17T04:21:05.674 INFO:tasks.workunit.client.1.smithi134.stdout:8/768: chown d4/db 438049 1 2024-09-17T04:21:05.678 INFO:tasks.workunit.client.1.smithi134.stdout:1/897: link d12/d1c/d2e/d7d/f98 d12/d1c/d100/d11b/d122/f12c 0 2024-09-17T04:21:05.679 INFO:tasks.workunit.client.1.smithi134.stdout:8/769: symlink d4/d1f/d86/de0/lf0 0 2024-09-17T04:21:05.679 INFO:tasks.workunit.client.1.smithi134.stdout:0/817: dwrite d11/d19/f87 [0,4194304] 0 2024-09-17T04:21:05.681 INFO:tasks.workunit.client.1.smithi134.stdout:8/770: readlink d4/d1f/d86/l93 0 2024-09-17T04:21:05.682 INFO:tasks.workunit.client.1.smithi134.stdout:6/960: dread de/d19/f24 [0,4194304] 0 2024-09-17T04:21:05.685 INFO:tasks.workunit.client.1.smithi134.stdout:7/713: dwrite d0/dd/d3a/d3d/d38/d60/f84 [0,4194304] 0 2024-09-17T04:21:05.685 INFO:tasks.workunit.client.1.smithi134.stdout:1/898: symlink d12/d19/d5d/d91/dac/dd5/def/l12d 0 2024-09-17T04:21:05.688 INFO:tasks.workunit.client.1.smithi134.stdout:2/811: dread f16 [0,4194304] 0 2024-09-17T04:21:05.696 INFO:tasks.workunit.client.1.smithi134.stdout:6/961: rename de/d19/d62/d7c/f7d to de/d19/d1f/d5c/df4/f12c 0 2024-09-17T04:21:05.697 INFO:tasks.workunit.client.1.smithi134.stdout:6/962: chown de/d5d/d67/fbd 14670344 1 2024-09-17T04:21:05.697 INFO:tasks.workunit.client.1.smithi134.stdout:1/899: creat d12/d19/d1d/d3e/d121/f12e x:0 0 0 2024-09-17T04:21:05.698 INFO:tasks.workunit.client.1.smithi134.stdout:1/900: write d12/d19/d4f/d101/f104 [1235987,30853] 0 2024-09-17T04:21:05.699 INFO:tasks.workunit.client.1.smithi134.stdout:2/812: rename d19/d27/d31/d34/df2/d6f/da9/lc9 to d19/d27/d31/d34/df2/d6f/d84/d98/dc2/l108 0 2024-09-17T04:21:05.699 INFO:tasks.workunit.client.1.smithi134.stdout:1/901: chown d12/d1c/d2e/f67 1252 1 2024-09-17T04:21:05.700 INFO:tasks.workunit.client.1.smithi134.stdout:6/963: mkdir de/d19/d62/d34/d8e/d12d 0 2024-09-17T04:21:05.701 INFO:tasks.workunit.client.1.smithi134.stdout:6/964: chown de/d19/d62/d7c/fca 31 1 2024-09-17T04:21:05.703 INFO:tasks.workunit.client.1.smithi134.stdout:6/965: creat de/d19/d62/d34/d3b/f12e x:0 0 0 2024-09-17T04:21:05.704 INFO:tasks.workunit.client.1.smithi134.stdout:6/966: readlink de/d19/d1f/d55/d77/d89/d109/dc7/lf5 0 2024-09-17T04:21:05.705 INFO:tasks.workunit.client.1.smithi134.stdout:6/967: stat de/d19/d62/l4a 0 2024-09-17T04:21:05.706 INFO:tasks.workunit.client.1.smithi134.stdout:3/947: symlink de/l13d 0 2024-09-17T04:21:05.707 INFO:tasks.workunit.client.1.smithi134.stdout:2/813: link d19/d1c/d47/d50/d85/d93/dc1/cfb d19/d1c/d47/dae/c109 0 2024-09-17T04:21:05.708 INFO:tasks.workunit.client.1.smithi134.stdout:3/948: rmdir de/d12 39 2024-09-17T04:21:05.709 INFO:tasks.workunit.client.1.smithi134.stdout:1/902: link d12/d1c/d2e/d7d/c94 d12/d19/d1d/d3e/dcb/c12f 0 2024-09-17T04:21:05.711 INFO:tasks.workunit.client.1.smithi134.stdout:5/787: dwrite d0/d48/f52 [0,4194304] 0 2024-09-17T04:21:05.712 INFO:tasks.workunit.client.1.smithi134.stdout:1/903: truncate d12/d19/d1d/d61/f77 2178872 0 2024-09-17T04:21:05.713 INFO:tasks.workunit.client.1.smithi134.stdout:4/867: mknod d0/d13/c118 0 2024-09-17T04:21:05.714 INFO:tasks.workunit.client.1.smithi134.stdout:2/814: mkdir d19/d27/d31/d34/df2/d6f/da9/db0/dca/d10a 0 2024-09-17T04:21:05.718 INFO:tasks.workunit.client.1.smithi134.stdout:1/904: creat d12/d19/d1d/d5f/ddc/f130 x:0 0 0 2024-09-17T04:21:05.718 INFO:tasks.workunit.client.0.smithi088.stdout:9/444: dwrite d2/fc [0,4194304] 0 2024-09-17T04:21:05.719 INFO:tasks.workunit.client.1.smithi134.stdout:1/905: fsync d12/d19/d1d/d5f/fb0 0 2024-09-17T04:21:05.721 INFO:tasks.workunit.client.1.smithi134.stdout:4/868: creat d0/d13/d40/d42/d92/dc3/f119 x:0 0 0 2024-09-17T04:21:05.723 INFO:tasks.workunit.client.0.smithi088.stdout:9/445: rename d2/dd/d11/d4f/c65 to d2/dd/d14/d2a/d76/c9e 0 2024-09-17T04:21:05.727 INFO:tasks.workunit.client.1.smithi134.stdout:1/906: rmdir d12 39 2024-09-17T04:21:05.737 INFO:tasks.workunit.client.0.smithi088.stdout:9/446: fdatasync d2/fc 0 2024-09-17T04:21:05.791 INFO:tasks.workunit.client.1.smithi134.stdout:0/818: sync 2024-09-17T04:21:05.811 INFO:tasks.workunit.client.0.smithi088.stdout:2/355: sync 2024-09-17T04:21:05.825 INFO:tasks.workunit.client.0.smithi088.stdout:2/356: dread d0/d1/d2d/d33/f38 [0,4194304] 0 2024-09-17T04:21:05.840 INFO:tasks.workunit.client.1.smithi134.stdout:7/714: sync 2024-09-17T04:21:05.856 INFO:tasks.workunit.client.1.smithi134.stdout:4/869: mknod d0/d13/d40/d42/d92/d7b/c11a 0 2024-09-17T04:21:05.857 INFO:tasks.workunit.client.1.smithi134.stdout:3/949: creat de/d12/f13e x:0 0 0 2024-09-17T04:21:05.857 INFO:tasks.workunit.client.1.smithi134.stdout:5/788: link d0/d3a/d2b/l33 d0/da/d29/db5/l101 0 2024-09-17T04:21:05.861 INFO:tasks.workunit.client.1.smithi134.stdout:2/815: creat d19/d27/d31/d34/df2/d6f/f10b x:0 0 0 2024-09-17T04:21:05.864 INFO:tasks.workunit.client.1.smithi134.stdout:3/950: rmdir de/d12/d9d 39 2024-09-17T04:21:05.866 INFO:tasks.workunit.client.1.smithi134.stdout:4/870: truncate d0/d13/d40/d72/fa6 2041593 0 2024-09-17T04:21:05.867 INFO:tasks.workunit.client.0.smithi088.stdout:2/357: creat d0/d1/d2d/d33/f71 x:0 0 0 2024-09-17T04:21:05.868 INFO:tasks.workunit.client.1.smithi134.stdout:5/789: creat d0/da/d29/d78/f102 x:0 0 0 2024-09-17T04:21:05.868 INFO:tasks.workunit.client.0.smithi088.stdout:2/358: readlink d0/d1/d2d/d33/d4b/d24/d3b/d22/l44 0 2024-09-17T04:21:05.870 INFO:tasks.workunit.client.1.smithi134.stdout:2/816: fsync d19/d1c/d92/fc5 0 2024-09-17T04:21:05.871 INFO:tasks.workunit.client.1.smithi134.stdout:8/771: write d4/db/dd/d95/f99 [965677,37282] 0 2024-09-17T04:21:05.872 INFO:tasks.workunit.client.0.smithi088.stdout:2/359: creat d0/d1/d2d/d33/d65/f72 x:0 0 0 2024-09-17T04:21:05.873 INFO:tasks.workunit.client.0.smithi088.stdout:2/360: write d0/d1/d2d/d33/f52 [424939,46287] 0 2024-09-17T04:21:05.874 INFO:tasks.workunit.client.1.smithi134.stdout:7/715: mknod d0/d16/d8b/d6a/d70/dde/cdf 0 2024-09-17T04:21:05.879 INFO:tasks.workunit.client.0.smithi088.stdout:2/361: dwrite d0/d18/f4c [0,4194304] 0 2024-09-17T04:21:05.880 INFO:tasks.workunit.client.0.smithi088.stdout:2/362: dread - d0/d1/d2d/f6a zero size 2024-09-17T04:21:05.881 INFO:tasks.workunit.client.1.smithi134.stdout:3/951: dwrite de/d12/d15/d1d/f62 [0,4194304] 0 2024-09-17T04:21:05.883 INFO:tasks.workunit.client.1.smithi134.stdout:6/968: truncate de/d19/d62/db0/fbe 3260600 0 2024-09-17T04:21:05.884 INFO:tasks.workunit.client.1.smithi134.stdout:2/817: rename d19/d1c/f1f to d19/d1c/d92/f10c 0 2024-09-17T04:21:05.886 INFO:tasks.workunit.client.1.smithi134.stdout:5/790: creat d0/d3a/d2b/de5/f103 x:0 0 0 2024-09-17T04:21:05.888 INFO:tasks.workunit.client.0.smithi088.stdout:9/447: getdents d2/dd/d11/d4f 0 2024-09-17T04:21:05.890 INFO:tasks.workunit.client.1.smithi134.stdout:6/969: mknod de/d5d/d67/c12f 0 2024-09-17T04:21:05.891 INFO:tasks.workunit.client.1.smithi134.stdout:6/970: fdatasync de/d19/d1f/dae/fcf 0 2024-09-17T04:21:05.891 INFO:tasks.workunit.client.1.smithi134.stdout:2/818: dread d19/d1c/d92/ddc/dc6/ded/fd1 [0,4194304] 0 2024-09-17T04:21:05.892 INFO:tasks.workunit.client.0.smithi088.stdout:9/448: write d2/d2b/d58/d82/f85 [663864,97654] 0 2024-09-17T04:21:05.893 INFO:tasks.workunit.client.1.smithi134.stdout:6/971: dread - de/d19/d1f/d85/d88/ffb zero size 2024-09-17T04:21:05.893 INFO:tasks.workunit.client.1.smithi134.stdout:3/952: creat de/d12/d15/d1d/d8f/d122/f13f x:0 0 0 2024-09-17T04:21:05.893 INFO:tasks.workunit.client.1.smithi134.stdout:6/972: chown de/d19/d1f/d55/da9 6786 1 2024-09-17T04:21:05.894 INFO:tasks.workunit.client.1.smithi134.stdout:5/791: creat d0/d3a/d2b/d61/f104 x:0 0 0 2024-09-17T04:21:05.896 INFO:tasks.workunit.client.1.smithi134.stdout:5/792: write d0/da/d29/d78/da5/fe7 [513813,129074] 0 2024-09-17T04:21:05.896 INFO:tasks.workunit.client.0.smithi088.stdout:9/449: creat d2/dd/d11/d30/d49/f9f x:0 0 0 2024-09-17T04:21:05.897 INFO:tasks.workunit.client.0.smithi088.stdout:9/450: chown d2/dd/d11/d30/d49/f42 520385993 1 2024-09-17T04:21:05.898 INFO:tasks.workunit.client.0.smithi088.stdout:9/451: write d2/dd/d14/d8b/d43/d51/f6b [1402723,90797] 0 2024-09-17T04:21:05.899 INFO:tasks.workunit.client.1.smithi134.stdout:3/953: mkdir de/d67/d140 0 2024-09-17T04:21:05.902 INFO:tasks.workunit.client.1.smithi134.stdout:0/819: dwrite d11/d24/f7e [0,4194304] 0 2024-09-17T04:21:05.903 INFO:tasks.workunit.client.0.smithi088.stdout:9/452: creat d2/dd/d11/d4f/d72/d74/fa0 x:0 0 0 2024-09-17T04:21:05.904 INFO:tasks.workunit.client.0.smithi088.stdout:9/453: truncate d2/dd/d14/d8b/d35/f6c 417335 0 2024-09-17T04:21:05.908 INFO:tasks.workunit.client.1.smithi134.stdout:0/820: mknod d11/d24/d49/d62/daf/ded/c11a 0 2024-09-17T04:21:05.908 INFO:tasks.workunit.client.1.smithi134.stdout:6/973: read de/d5d/d67/fbd [1703899,43244] 0 2024-09-17T04:21:05.909 INFO:tasks.workunit.client.1.smithi134.stdout:4/871: write d0/d13/d40/f115 [951630,35110] 0 2024-09-17T04:21:05.910 INFO:tasks.workunit.client.1.smithi134.stdout:0/821: dread - d11/fd5 zero size 2024-09-17T04:21:05.910 INFO:tasks.workunit.client.1.smithi134.stdout:1/907: truncate d12/f86 897854 0 2024-09-17T04:21:05.911 INFO:tasks.workunit.client.1.smithi134.stdout:8/772: write d4/db/dd/f1b [470676,31009] 0 2024-09-17T04:21:05.912 INFO:tasks.workunit.client.1.smithi134.stdout:7/716: dread d0/d16/d35/d4b/f7c [0,4194304] 0 2024-09-17T04:21:05.913 INFO:tasks.workunit.client.1.smithi134.stdout:6/974: creat de/d19/d1f/d85/f130 x:0 0 0 2024-09-17T04:21:05.914 INFO:tasks.workunit.client.1.smithi134.stdout:8/773: chown d4/db/dd/da2/fcb 119634 1 2024-09-17T04:21:05.915 INFO:tasks.workunit.client.1.smithi134.stdout:0/822: mkdir d11/d48/dff/d11b 0 2024-09-17T04:21:05.917 INFO:tasks.workunit.client.1.smithi134.stdout:4/872: symlink d0/d13/d40/d42/d92/d65/dc2/l11b 0 2024-09-17T04:21:05.919 INFO:tasks.workunit.client.1.smithi134.stdout:7/717: truncate d0/dd/db9/f9c 886533 0 2024-09-17T04:21:05.921 INFO:tasks.workunit.client.1.smithi134.stdout:1/908: rename d12/d19/d1d/d3e/dcb/c12f to d12/d19/d4f/c131 0 2024-09-17T04:21:05.921 INFO:tasks.workunit.client.1.smithi134.stdout:8/774: dwrite d4/d1f/f97 [0,4194304] 0 2024-09-17T04:21:05.922 INFO:tasks.workunit.client.1.smithi134.stdout:6/975: dwrite de/d19/d74/d94/d9e/fac [0,4194304] 0 2024-09-17T04:21:05.930 INFO:tasks.workunit.client.0.smithi088.stdout:9/454: write d2/d2b/f38 [4673349,92991] 0 2024-09-17T04:21:05.931 INFO:tasks.workunit.client.1.smithi134.stdout:2/819: dwrite d19/f22 [4194304,4194304] 0 2024-09-17T04:21:05.933 INFO:tasks.workunit.client.0.smithi088.stdout:4/384: sync 2024-09-17T04:21:05.933 INFO:tasks.workunit.client.0.smithi088.stdout:5/339: sync 2024-09-17T04:21:05.934 INFO:tasks.workunit.client.0.smithi088.stdout:9/455: symlink d2/dd/d11/d4f/d72/d74/la1 0 2024-09-17T04:21:05.937 INFO:tasks.workunit.client.1.smithi134.stdout:3/954: dwrite de/d12/d22/d5a/f71 [0,4194304] 0 2024-09-17T04:21:05.938 INFO:tasks.workunit.client.1.smithi134.stdout:5/793: dwrite d0/d3a/d2b/d61/d7b/fae [4194304,4194304] 0 2024-09-17T04:21:05.941 INFO:tasks.workunit.client.1.smithi134.stdout:0/823: truncate d11/d24/f58 690066 0 2024-09-17T04:21:05.941 INFO:tasks.workunit.client.1.smithi134.stdout:2/820: chown d19/d27/d31/d34/df2/c60 40458 1 2024-09-17T04:21:05.943 INFO:tasks.workunit.client.0.smithi088.stdout:9/456: creat d2/dd/d14/d2a/fa2 x:0 0 0 2024-09-17T04:21:05.944 INFO:tasks.workunit.client.1.smithi134.stdout:1/909: getdents d12/d19/d1d/d61/dd3/dda/d85 0 2024-09-17T04:21:05.944 INFO:tasks.workunit.client.0.smithi088.stdout:4/385: dwrite d5/d3d/f7a [0,4194304] 0 2024-09-17T04:21:05.947 INFO:tasks.workunit.client.1.smithi134.stdout:7/718: write d0/d16/fbc [466159,11066] 0 2024-09-17T04:21:05.947 INFO:tasks.workunit.client.1.smithi134.stdout:8/775: write d4/db/dd/d72/f88 [4432674,26177] 0 2024-09-17T04:21:05.948 INFO:tasks.workunit.client.0.smithi088.stdout:5/340: fsync d2/d31/d33/d20/d25/d49/f5f 0 2024-09-17T04:21:05.951 INFO:tasks.workunit.client.1.smithi134.stdout:8/776: dread - d4/d1f/d25/d6a/fcd zero size 2024-09-17T04:21:05.952 INFO:tasks.workunit.client.0.smithi088.stdout:9/457: symlink d2/dd/d11/d4f/d72/d74/la3 0 2024-09-17T04:21:05.955 INFO:tasks.workunit.client.1.smithi134.stdout:4/873: dwrite d0/df/d35/fd1 [0,4194304] 0 2024-09-17T04:21:05.957 INFO:tasks.workunit.client.0.smithi088.stdout:9/458: symlink d2/dd/d14/d8b/d35/d94/la4 0 2024-09-17T04:21:05.957 INFO:tasks.workunit.client.1.smithi134.stdout:5/794: rename d0/da/d69/d41/d6d/d89/fc8 to d0/da/d2c/f105 0 2024-09-17T04:21:05.957 INFO:tasks.workunit.client.1.smithi134.stdout:4/874: dread - d0/d13/d40/f102 zero size 2024-09-17T04:21:05.959 INFO:tasks.workunit.client.1.smithi134.stdout:2/821: creat d19/d1c/d47/f10d x:0 0 0 2024-09-17T04:21:05.960 INFO:tasks.workunit.client.1.smithi134.stdout:3/955: symlink de/d12/d15/d1d/l141 0 2024-09-17T04:21:05.961 INFO:tasks.workunit.client.1.smithi134.stdout:6/976: dread de/d19/d21/d2d/f39 [0,4194304] 0 2024-09-17T04:21:05.962 INFO:tasks.workunit.client.1.smithi134.stdout:4/875: read d0/df/d17/f90 [686075,129549] 0 2024-09-17T04:21:05.963 INFO:tasks.workunit.client.1.smithi134.stdout:0/824: rmdir d11/d4c/d76/dba/d10a 0 2024-09-17T04:21:05.964 INFO:tasks.workunit.client.1.smithi134.stdout:6/977: readlink de/d19/d1f/d55/d77/d89/lba 0 2024-09-17T04:21:05.964 INFO:tasks.workunit.client.1.smithi134.stdout:2/822: write d19/d27/d31/f6e [875496,29555] 0 2024-09-17T04:21:05.965 INFO:tasks.workunit.client.0.smithi088.stdout:4/386: dread d5/f23 [0,4194304] 0 2024-09-17T04:21:05.965 INFO:tasks.workunit.client.1.smithi134.stdout:7/719: rename d0/dd/d3a/d3d/d38/d60/c97 to d0/dd/dbb/ce0 0 2024-09-17T04:21:05.967 INFO:tasks.workunit.client.1.smithi134.stdout:4/876: stat d0/d13/d40/d42/d92/d86/l117 0 2024-09-17T04:21:05.967 INFO:tasks.workunit.client.1.smithi134.stdout:8/777: creat d4/d1f/d2b/dbf/ddd/ff1 x:0 0 0 2024-09-17T04:21:05.968 INFO:tasks.workunit.client.1.smithi134.stdout:2/823: stat d19/d27/d31/d34/df2/d63/f68 0 2024-09-17T04:21:05.968 INFO:tasks.workunit.client.1.smithi134.stdout:5/795: mkdir d0/da/d29/d78/da5/d106 0 2024-09-17T04:21:05.968 INFO:tasks.workunit.client.1.smithi134.stdout:4/877: dread - d0/df/d35/fd3 zero size 2024-09-17T04:21:05.969 INFO:tasks.workunit.client.1.smithi134.stdout:2/824: chown d19/d27/d31/l5d 1164028 1 2024-09-17T04:21:05.970 INFO:tasks.workunit.client.1.smithi134.stdout:6/978: unlink de/d19/d62/d7c/d108/c11a 0 2024-09-17T04:21:05.970 INFO:tasks.workunit.client.1.smithi134.stdout:4/878: truncate d0/df/d35/ff4 99503 0 2024-09-17T04:21:05.971 INFO:tasks.workunit.client.0.smithi088.stdout:4/387: rename d5/d3d/d73/d7e/l4f to d5/l82 0 2024-09-17T04:21:05.972 INFO:tasks.workunit.client.1.smithi134.stdout:3/956: creat de/d12/d15/d1d/d2d/d31/f142 x:0 0 0 2024-09-17T04:21:05.973 INFO:tasks.workunit.client.1.smithi134.stdout:3/957: dread - de/d12/fea zero size 2024-09-17T04:21:05.973 INFO:tasks.workunit.client.0.smithi088.stdout:4/388: rmdir d5/d65/d75 39 2024-09-17T04:21:05.974 INFO:tasks.workunit.client.1.smithi134.stdout:3/958: chown de/d12/d22/d5a/f102 0 1 2024-09-17T04:21:05.975 INFO:tasks.workunit.client.0.smithi088.stdout:4/389: dread - d5/d32/f57 zero size 2024-09-17T04:21:05.992 INFO:tasks.workunit.client.1.smithi134.stdout:5/796: unlink d0/da/d29/d7c/db3/fdd 0 2024-09-17T04:21:05.993 INFO:tasks.workunit.client.1.smithi134.stdout:7/720: symlink d0/dd/d3a/d3d/le1 0 2024-09-17T04:21:05.994 INFO:tasks.workunit.client.1.smithi134.stdout:3/959: symlink de/d10/d3d/de2/l143 0 2024-09-17T04:21:05.994 INFO:tasks.workunit.client.1.smithi134.stdout:7/721: chown d0/f1c 155320308 1 2024-09-17T04:21:05.994 INFO:tasks.workunit.client.1.smithi134.stdout:4/879: mknod d0/df/d1e/c11c 0 2024-09-17T04:21:05.995 INFO:tasks.workunit.client.1.smithi134.stdout:5/797: unlink d0/da/d69/d41/l6a 0 2024-09-17T04:21:05.997 INFO:tasks.workunit.client.1.smithi134.stdout:4/880: chown d0/d13/d40/d72/fe6 39297 1 2024-09-17T04:21:05.998 INFO:tasks.workunit.client.1.smithi134.stdout:3/960: write de/d12/d15/dd0/dfe/f11c [1051541,33691] 0 2024-09-17T04:21:06.000 INFO:tasks.workunit.client.1.smithi134.stdout:5/798: fdatasync d0/da/d29/d7c/d9e/fc1 0 2024-09-17T04:21:06.001 INFO:tasks.workunit.client.1.smithi134.stdout:6/979: dread de/d19/d1f/d55/da9/fbc [0,4194304] 0 2024-09-17T04:21:06.002 INFO:tasks.workunit.client.1.smithi134.stdout:4/881: chown d0/df/d1e/dbc/fc6 66433 1 2024-09-17T04:21:06.005 INFO:tasks.workunit.client.1.smithi134.stdout:1/910: dread d12/d19/d1d/d3e/f48 [0,4194304] 0 2024-09-17T04:21:06.006 INFO:tasks.workunit.client.1.smithi134.stdout:6/980: write de/d2b/f10b [2194982,21149] 0 2024-09-17T04:21:06.008 INFO:tasks.workunit.client.1.smithi134.stdout:7/722: dwrite d0/fa6 [0,4194304] 0 2024-09-17T04:21:06.011 INFO:tasks.workunit.client.1.smithi134.stdout:4/882: mkdir d0/d13/d40/d42/dc5/d11d 0 2024-09-17T04:21:06.011 INFO:tasks.workunit.client.1.smithi134.stdout:5/799: mknod d0/da/d29/d78/da5/df0/c107 0 2024-09-17T04:21:06.014 INFO:tasks.workunit.client.1.smithi134.stdout:3/961: creat de/d12/d15/dd0/dfe/df2/f144 x:0 0 0 2024-09-17T04:21:06.015 INFO:tasks.workunit.client.1.smithi134.stdout:7/723: chown d0/f19 25 1 2024-09-17T04:21:06.016 INFO:tasks.workunit.client.1.smithi134.stdout:2/825: dread d19/d7e/f81 [0,4194304] 0 2024-09-17T04:21:06.017 INFO:tasks.workunit.client.1.smithi134.stdout:3/962: unlink de/d67/lbc 0 2024-09-17T04:21:06.018 INFO:tasks.workunit.client.1.smithi134.stdout:3/963: fsync de/d10/f79 0 2024-09-17T04:21:06.018 INFO:tasks.workunit.client.1.smithi134.stdout:4/883: read d0/d3b/f5b [2493649,111148] 0 2024-09-17T04:21:06.019 INFO:tasks.workunit.client.1.smithi134.stdout:1/911: rename d12/d19/c26 to d12/d19/d1d/d5f/dd7/c132 0 2024-09-17T04:21:06.024 INFO:tasks.workunit.client.1.smithi134.stdout:3/964: dwrite de/d10/d3d/f43 [0,4194304] 0 2024-09-17T04:21:06.024 INFO:tasks.workunit.client.1.smithi134.stdout:3/965: stat de/l13d 0 2024-09-17T04:21:06.028 INFO:tasks.workunit.client.1.smithi134.stdout:4/884: mkdir d0/df/dd5/d11e 0 2024-09-17T04:21:06.028 INFO:tasks.workunit.client.1.smithi134.stdout:6/981: rename de/d19/d1f/d55/d77/d89/d109/dc7/ddc/db3/db4 to de/d19/d74/d94/d9b/d131 0 2024-09-17T04:21:06.028 INFO:tasks.workunit.client.1.smithi134.stdout:0/825: truncate d11/d18/f9f 1483763 0 2024-09-17T04:21:06.028 INFO:tasks.workunit.client.1.smithi134.stdout:1/912: mkdir d12/d19/d1d/d5f/d133 0 2024-09-17T04:21:06.030 INFO:tasks.workunit.client.1.smithi134.stdout:2/826: mkdir d19/d27/d31/d34/df2/d6f/d10e 0 2024-09-17T04:21:06.033 INFO:tasks.workunit.client.1.smithi134.stdout:6/982: creat de/d19/da3/de6/f132 x:0 0 0 2024-09-17T04:21:06.034 INFO:tasks.workunit.client.1.smithi134.stdout:3/966: read de/d10/d3d/dd9/f8a [54399,129226] 0 2024-09-17T04:21:06.035 INFO:tasks.workunit.client.1.smithi134.stdout:1/913: symlink d12/d1c/d2e/d120/l134 0 2024-09-17T04:21:06.036 INFO:tasks.workunit.client.1.smithi134.stdout:2/827: rename d19/d1c/d47/d50/d85/d93 to d19/d1c/d47/d50/d10f 0 2024-09-17T04:21:06.036 INFO:tasks.workunit.client.1.smithi134.stdout:1/914: chown d12/d19/d1d/d61/dd3/dda/f6f 1734642 1 2024-09-17T04:21:06.037 INFO:tasks.workunit.client.1.smithi134.stdout:0/826: creat d11/d4c/d76/d118/f11c x:0 0 0 2024-09-17T04:21:06.038 INFO:tasks.workunit.client.1.smithi134.stdout:2/828: truncate d19/d1c/d47/fbe 690786 0 2024-09-17T04:21:06.039 INFO:tasks.workunit.client.1.smithi134.stdout:6/983: mkdir de/d19/d1f/d55/d77/d89/d109/dc7/dff/d133 0 2024-09-17T04:21:06.040 INFO:tasks.workunit.client.1.smithi134.stdout:1/915: truncate d12/d1c/d2e/d7d/fed 2381 0 2024-09-17T04:21:06.042 INFO:tasks.workunit.client.1.smithi134.stdout:3/967: rename de/d10/d3d/l5e to de/d12/d9d/l145 0 2024-09-17T04:21:06.043 INFO:tasks.workunit.client.1.smithi134.stdout:2/829: symlink d19/d27/d31/d34/df2/d63/d94/d102/l110 0 2024-09-17T04:21:06.044 INFO:tasks.workunit.client.1.smithi134.stdout:6/984: mkdir de/d19/d62/d7c/d108/d134 0 2024-09-17T04:21:06.048 INFO:tasks.workunit.client.1.smithi134.stdout:5/800: write d0/da/d29/d78/da5/fb1 [188004,96883] 0 2024-09-17T04:21:06.049 INFO:tasks.workunit.client.1.smithi134.stdout:3/968: link de/d12/d15/d1d/d2d/d31/d6a/f10e de/d12/d15/d1d/f146 0 2024-09-17T04:21:06.055 INFO:tasks.workunit.client.1.smithi134.stdout:6/985: dwrite de/d19/d1f/d55/d77/d89/d109/dc7/ddc/db3/ff1 [0,4194304] 0 2024-09-17T04:21:06.055 INFO:tasks.workunit.client.1.smithi134.stdout:3/969: read de/d12/d22/d5a/fb5 [676863,98656] 0 2024-09-17T04:21:06.059 INFO:tasks.workunit.client.1.smithi134.stdout:3/970: write de/d12/d15/d9f/dba/f138 [519491,7257] 0 2024-09-17T04:21:06.059 INFO:tasks.workunit.client.1.smithi134.stdout:0/827: truncate d11/d24/f28 3379767 0 2024-09-17T04:21:06.059 INFO:tasks.workunit.client.1.smithi134.stdout:7/724: dwrite d0/f6 [0,4194304] 0 2024-09-17T04:21:06.061 INFO:tasks.workunit.client.1.smithi134.stdout:6/986: mknod de/d19/d1f/d55/d77/d89/d109/dc7/ddc/c135 0 2024-09-17T04:21:06.062 INFO:tasks.workunit.client.1.smithi134.stdout:1/916: truncate d12/d1c/f34 2368952 0 2024-09-17T04:21:06.066 INFO:tasks.workunit.client.1.smithi134.stdout:3/971: chown de/d12/d9d/l145 0 1 2024-09-17T04:21:06.067 INFO:tasks.workunit.client.1.smithi134.stdout:7/725: symlink d0/d16/d8b/le2 0 2024-09-17T04:21:06.068 INFO:tasks.workunit.client.1.smithi134.stdout:0/828: write d11/d19/f8d [105170,116958] 0 2024-09-17T04:21:06.072 INFO:tasks.workunit.client.1.smithi134.stdout:1/917: link c6 d12/d19/d1d/d5f/dd7/c135 0 2024-09-17T04:21:06.072 INFO:tasks.workunit.client.1.smithi134.stdout:7/726: stat d0/dd/d3a/d3d/d4c/c67 0 2024-09-17T04:21:06.072 INFO:tasks.workunit.client.1.smithi134.stdout:2/830: dwrite d19/d1c/f2d [0,4194304] 0 2024-09-17T04:21:06.073 INFO:tasks.workunit.client.1.smithi134.stdout:1/918: stat d12/d36/c7e 0 2024-09-17T04:21:06.074 INFO:tasks.workunit.client.1.smithi134.stdout:2/831: dread - d19/d1c/d47/dae/f106 zero size 2024-09-17T04:21:06.075 INFO:tasks.workunit.client.1.smithi134.stdout:2/832: read - d19/d1c/d92/fdb zero size 2024-09-17T04:21:06.076 INFO:tasks.workunit.client.1.smithi134.stdout:0/829: link d11/d4c/fca d11/d19/d21/d37/f11d 0 2024-09-17T04:21:06.077 INFO:tasks.workunit.client.1.smithi134.stdout:2/833: stat d19/d1c/d47/d50/c5a 0 2024-09-17T04:21:06.078 INFO:tasks.workunit.client.1.smithi134.stdout:1/919: mkdir d12/d1c/d100/d11b/d122/d136 0 2024-09-17T04:21:06.080 INFO:tasks.workunit.client.1.smithi134.stdout:2/834: read f2 [3651012,84325] 0 2024-09-17T04:21:06.081 INFO:tasks.workunit.client.1.smithi134.stdout:1/920: creat d12/d1c/d100/f137 x:0 0 0 2024-09-17T04:21:06.082 INFO:tasks.workunit.client.1.smithi134.stdout:2/835: fsync d19/d27/d31/d34/f82 0 2024-09-17T04:21:06.083 INFO:tasks.workunit.client.1.smithi134.stdout:0/830: dread d11/d24/f7e [0,4194304] 0 2024-09-17T04:21:06.084 INFO:tasks.workunit.client.1.smithi134.stdout:3/972: dread de/d12/d15/d1d/d2d/d31/d6a/d83/fb7 [0,4194304] 0 2024-09-17T04:21:06.084 INFO:tasks.workunit.client.1.smithi134.stdout:5/801: dread d0/d3a/f50 [0,4194304] 0 2024-09-17T04:21:06.085 INFO:tasks.workunit.client.1.smithi134.stdout:1/921: write d12/d19/d4f/d101/f104 [814704,20910] 0 2024-09-17T04:21:06.085 INFO:tasks.workunit.client.1.smithi134.stdout:2/836: symlink d19/d1c/d92/l111 0 2024-09-17T04:21:06.086 INFO:tasks.workunit.client.1.smithi134.stdout:0/831: read - d11/d18/d97/df3/d43/d5d/fe7 zero size 2024-09-17T04:21:06.087 INFO:tasks.workunit.client.1.smithi134.stdout:1/922: chown d12/d19/c8a 129532831 1 2024-09-17T04:21:06.087 INFO:tasks.workunit.client.0.smithi088.stdout:3/383: sync 2024-09-17T04:21:06.087 INFO:tasks.workunit.client.0.smithi088.stdout:8/384: sync 2024-09-17T04:21:06.088 INFO:tasks.workunit.client.1.smithi134.stdout:2/837: fsync d19/d27/d31/d34/f82 0 2024-09-17T04:21:06.090 INFO:tasks.workunit.client.0.smithi088.stdout:3/384: rename d0/d13/d4d/c4f to d0/d13/d1b/d29/d56/c7e 0 2024-09-17T04:21:06.091 INFO:tasks.workunit.client.0.smithi088.stdout:3/385: chown d0/d13/d1b/d29/d30/d35/f57 803 1 2024-09-17T04:21:06.092 INFO:tasks.workunit.client.0.smithi088.stdout:8/385: mkdir d7/d29/d2a/d3a/d79 0 2024-09-17T04:21:06.092 INFO:tasks.workunit.client.1.smithi134.stdout:3/973: dwrite f6 [0,4194304] 0 2024-09-17T04:21:06.093 INFO:tasks.workunit.client.1.smithi134.stdout:0/832: symlink d11/d4c/l11e 0 2024-09-17T04:21:06.093 INFO:tasks.workunit.client.0.smithi088.stdout:3/386: write d0/d13/d58/d5a/d63/f75 [1001417,79549] 0 2024-09-17T04:21:06.094 INFO:tasks.workunit.client.1.smithi134.stdout:1/923: mknod d12/d19/d4f/d101/c138 0 2024-09-17T04:21:06.096 INFO:tasks.workunit.client.1.smithi134.stdout:2/838: symlink d19/d27/d31/d34/df2/l112 0 2024-09-17T04:21:06.097 INFO:tasks.workunit.client.1.smithi134.stdout:2/839: stat d19/d1c/d47/fd2 0 2024-09-17T04:21:06.098 INFO:tasks.workunit.client.0.smithi088.stdout:3/387: creat d0/d54/f7f x:0 0 0 2024-09-17T04:21:06.099 INFO:tasks.workunit.client.1.smithi134.stdout:7/727: dread d0/dd/d3a/fae [0,4194304] 0 2024-09-17T04:21:06.099 INFO:tasks.workunit.client.0.smithi088.stdout:3/388: write d0/f79 [390507,76843] 0 2024-09-17T04:21:06.100 INFO:tasks.workunit.client.0.smithi088.stdout:3/389: write d0/d54/f7f [27155,2376] 0 2024-09-17T04:21:06.101 INFO:tasks.workunit.client.1.smithi134.stdout:6/987: dread de/d19/d62/fb9 [0,4194304] 0 2024-09-17T04:21:06.103 INFO:tasks.workunit.client.1.smithi134.stdout:2/840: creat d19/d1c/d92/ddc/dc6/dbc/f113 x:0 0 0 2024-09-17T04:21:06.106 INFO:tasks.workunit.client.0.smithi088.stdout:3/390: mkdir d0/d13/d58/d5a/d63/d80 0 2024-09-17T04:21:06.108 INFO:tasks.workunit.client.1.smithi134.stdout:3/974: creat de/d12/d15/d9f/dba/dc0/f147 x:0 0 0 2024-09-17T04:21:06.110 INFO:tasks.workunit.client.1.smithi134.stdout:1/924: fsync d12/d1c/d100/f137 0 2024-09-17T04:21:06.111 INFO:tasks.workunit.client.1.smithi134.stdout:0/833: getdents d11/d24/d49/d62/df7/dd8/de2 0 2024-09-17T04:21:06.112 INFO:tasks.workunit.client.1.smithi134.stdout:8/778: sync 2024-09-17T04:21:06.112 INFO:tasks.workunit.client.1.smithi134.stdout:7/728: mkdir d0/d16/de3 0 2024-09-17T04:21:06.113 INFO:tasks.workunit.client.1.smithi134.stdout:5/802: write d0/d48/f82 [4532510,68918] 0 2024-09-17T04:21:06.114 INFO:tasks.workunit.client.1.smithi134.stdout:3/975: rename de/d12/d15/d1d/d8f/d122 to de/d10/d3d/dd9/d148 0 2024-09-17T04:21:06.116 INFO:tasks.workunit.client.1.smithi134.stdout:1/925: creat d12/d19/d5d/d91/f139 x:0 0 0 2024-09-17T04:21:06.119 INFO:tasks.workunit.client.1.smithi134.stdout:2/841: creat d19/d27/d31/d34/f114 x:0 0 0 2024-09-17T04:21:06.120 INFO:tasks.workunit.client.1.smithi134.stdout:0/834: rename d11/d19/f8d to d11/d24/d49/f11f 0 2024-09-17T04:21:06.122 INFO:tasks.workunit.client.0.smithi088.stdout:8/386: write d7/d29/d2a/d38/d3d/d63/f77 [807186,96082] 0 2024-09-17T04:21:06.125 INFO:tasks.workunit.client.1.smithi134.stdout:2/842: mknod d19/d1c/d47/c115 0 2024-09-17T04:21:06.127 INFO:tasks.workunit.client.1.smithi134.stdout:6/988: write de/d2b/f70 [2675163,42115] 0 2024-09-17T04:21:06.128 INFO:tasks.workunit.client.0.smithi088.stdout:8/387: creat d7/d29/d2a/d75/f7a x:0 0 0 2024-09-17T04:21:06.128 INFO:tasks.workunit.client.0.smithi088.stdout:3/391: write d0/d13/f28 [1140710,81059] 0 2024-09-17T04:21:06.129 INFO:tasks.workunit.client.0.smithi088.stdout:3/392: stat d0/d13/d4d/f6c 0 2024-09-17T04:21:06.131 INFO:tasks.workunit.client.1.smithi134.stdout:1/926: mkdir d12/d1c/d13a 0 2024-09-17T04:21:06.131 INFO:tasks.workunit.client.1.smithi134.stdout:6/989: dread de/d19/d62/fb9 [0,4194304] 0 2024-09-17T04:21:06.131 INFO:tasks.workunit.client.1.smithi134.stdout:1/927: chown d12/d19/d4f/d101/f104 1577410392 1 2024-09-17T04:21:06.132 INFO:tasks.workunit.client.1.smithi134.stdout:1/928: readlink d12/d19/d1d/d3e/l9b 0 2024-09-17T04:21:06.132 INFO:tasks.workunit.client.1.smithi134.stdout:1/929: stat d12/d19/d66/f82 0 2024-09-17T04:21:06.132 INFO:tasks.workunit.client.0.smithi088.stdout:8/388: creat d7/d29/d2a/d3a/f7b x:0 0 0 2024-09-17T04:21:06.133 INFO:tasks.workunit.client.1.smithi134.stdout:1/930: write d12/d19/d5d/d91/f139 [152223,58096] 0 2024-09-17T04:21:06.133 INFO:tasks.workunit.client.1.smithi134.stdout:7/729: creat d0/d16/d35/fe4 x:0 0 0 2024-09-17T04:21:06.134 INFO:tasks.workunit.client.0.smithi088.stdout:3/393: mkdir d0/d13/d1b/d29/d30/d81 0 2024-09-17T04:21:06.135 INFO:tasks.workunit.client.1.smithi134.stdout:7/730: fdatasync d0/dd/d3a/d3d/d4c/fc6 0 2024-09-17T04:21:06.136 INFO:tasks.workunit.client.1.smithi134.stdout:7/731: chown d0/d16/d8b/fad 855267 1 2024-09-17T04:21:06.136 INFO:tasks.workunit.client.1.smithi134.stdout:8/779: write d4/d11/da1/fd3 [2156051,46491] 0 2024-09-17T04:21:06.138 INFO:tasks.workunit.client.1.smithi134.stdout:5/803: dread d0/f5c [0,4194304] 0 2024-09-17T04:21:06.138 INFO:tasks.workunit.client.1.smithi134.stdout:8/780: dread - d4/d11/da1/dc7/fe9 zero size 2024-09-17T04:21:06.138 INFO:tasks.workunit.client.0.smithi088.stdout:3/394: symlink d0/d54/d55/l82 0 2024-09-17T04:21:06.140 INFO:tasks.workunit.client.1.smithi134.stdout:6/990: fsync de/d2b/f50 0 2024-09-17T04:21:06.141 INFO:tasks.workunit.client.1.smithi134.stdout:4/885: sync 2024-09-17T04:21:06.142 INFO:tasks.workunit.client.1.smithi134.stdout:1/931: fdatasync d12/d19/d1d/d61/dd3/dda/d85/fbb 0 2024-09-17T04:21:06.143 INFO:tasks.workunit.client.0.smithi088.stdout:3/395: symlink d0/d13/l83 0 2024-09-17T04:21:06.145 INFO:tasks.workunit.client.1.smithi134.stdout:3/976: dwrite de/d12/d15/dd0/fe8 [0,4194304] 0 2024-09-17T04:21:06.145 INFO:tasks.workunit.client.1.smithi134.stdout:1/932: chown d12/db2/lb4 2342 1 2024-09-17T04:21:06.145 INFO:tasks.workunit.client.1.smithi134.stdout:2/843: unlink d19/d27/lfe 0 2024-09-17T04:21:06.146 INFO:tasks.workunit.client.1.smithi134.stdout:5/804: mknod d0/da/d2c/deb/c108 0 2024-09-17T04:21:06.150 INFO:tasks.workunit.client.1.smithi134.stdout:1/933: write d12/d19/d1d/d61/fd8 [932020,96974] 0 2024-09-17T04:21:06.150 INFO:tasks.workunit.client.1.smithi134.stdout:8/781: rename d4/d1f/d25/d6a/fcd to d4/d11/ff2 0 2024-09-17T04:21:06.153 INFO:tasks.workunit.client.0.smithi088.stdout:3/396: getdents d0/d13/d58/d5e 0 2024-09-17T04:21:06.153 INFO:tasks.workunit.client.1.smithi134.stdout:6/991: creat de/d19/da3/de6/f136 x:0 0 0 2024-09-17T04:21:06.153 INFO:tasks.workunit.client.1.smithi134.stdout:7/732: mknod d0/dd/ce5 0 2024-09-17T04:21:06.154 INFO:tasks.workunit.client.1.smithi134.stdout:4/886: chown d0/df/c11 977404 1 2024-09-17T04:21:06.154 INFO:tasks.workunit.client.1.smithi134.stdout:3/977: mkdir de/d67/d149 0 2024-09-17T04:21:06.154 INFO:tasks.workunit.client.1.smithi134.stdout:0/835: dwrite d11/d18/f40 [4194304,4194304] 0 2024-09-17T04:21:06.155 INFO:tasks.workunit.client.0.smithi088.stdout:3/397: truncate d0/d13/d1b/f21 876474 0 2024-09-17T04:21:06.155 INFO:tasks.workunit.client.0.smithi088.stdout:8/389: dread d7/dd/fe [0,4194304] 0 2024-09-17T04:21:06.157 INFO:tasks.workunit.client.1.smithi134.stdout:5/805: unlink d0/da/d29/d7c/le3 0 2024-09-17T04:21:06.158 INFO:tasks.workunit.client.0.smithi088.stdout:3/398: rmdir d0/d13/d1b/d29/d2b/d50 39 2024-09-17T04:21:06.159 INFO:tasks.workunit.client.1.smithi134.stdout:0/836: write d11/d6f/fc1 [5171976,29736] 0 2024-09-17T04:21:06.159 INFO:tasks.workunit.client.1.smithi134.stdout:8/782: chown d4/c5a 1876599 1 2024-09-17T04:21:06.159 INFO:tasks.workunit.client.1.smithi134.stdout:2/844: dwrite d19/d27/d31/d34/f70 [0,4194304] 0 2024-09-17T04:21:06.162 INFO:tasks.workunit.client.0.smithi088.stdout:3/399: readlink d0/d13/l19 0 2024-09-17T04:21:06.163 INFO:tasks.workunit.client.0.smithi088.stdout:3/400: stat d0/c15 0 2024-09-17T04:21:06.166 INFO:tasks.workunit.client.0.smithi088.stdout:8/390: dwrite d7/d29/d2a/f4a [8388608,4194304] 0 2024-09-17T04:21:06.168 INFO:tasks.workunit.client.0.smithi088.stdout:3/401: chown d0/fa 43 1 2024-09-17T04:21:06.171 INFO:tasks.workunit.client.1.smithi134.stdout:6/992: symlink de/d19/d1f/d55/d77/d89/d109/dc7/ddc/db3/l137 0 2024-09-17T04:21:06.175 INFO:tasks.workunit.client.0.smithi088.stdout:3/402: creat d0/d54/f84 x:0 0 0 2024-09-17T04:21:06.177 INFO:tasks.workunit.client.1.smithi134.stdout:0/837: mknod d11/d48/c120 0 2024-09-17T04:21:06.178 INFO:tasks.workunit.client.1.smithi134.stdout:7/733: dread d0/d16/d8b/d6a/f6d [4194304,4194304] 0 2024-09-17T04:21:06.179 INFO:tasks.workunit.client.0.smithi088.stdout:3/403: mkdir d0/d13/d1b/d29/d56/d85 0 2024-09-17T04:21:06.180 INFO:tasks.workunit.client.1.smithi134.stdout:7/734: write d0/dd/d3a/d3d/f61 [4119053,56214] 0 2024-09-17T04:21:06.181 INFO:tasks.workunit.client.0.smithi088.stdout:8/391: getdents d7/dd 0 2024-09-17T04:21:06.182 INFO:tasks.workunit.client.1.smithi134.stdout:1/934: rename d12/d19/d1d/d61/f10d to d12/d19/d1d/d61/da0/f13b 0 2024-09-17T04:21:06.183 INFO:tasks.workunit.client.1.smithi134.stdout:2/845: mknod d19/d27/d31/d34/df2/d6f/da9/db0/c116 0 2024-09-17T04:21:06.184 INFO:tasks.workunit.client.0.smithi088.stdout:8/392: symlink d7/d29/d2a/d38/d42/l7c 0 2024-09-17T04:21:06.185 INFO:tasks.workunit.client.1.smithi134.stdout:0/838: chown d11/d24/d49/d62/daf/c115 8092 1 2024-09-17T04:21:06.186 INFO:tasks.workunit.client.0.smithi088.stdout:3/404: mknod d0/d13/c86 0 2024-09-17T04:21:06.186 INFO:tasks.workunit.client.1.smithi134.stdout:0/839: write d11/d19/d21/f27 [3338929,52482] 0 2024-09-17T04:21:06.187 INFO:tasks.workunit.client.0.smithi088.stdout:3/405: write d0/f2 [2982546,61664] 0 2024-09-17T04:21:06.188 INFO:tasks.workunit.client.0.smithi088.stdout:3/406: readlink d0/d54/d55/l76 0 2024-09-17T04:21:06.188 INFO:tasks.workunit.client.1.smithi134.stdout:3/978: creat de/d12/d15/f14a x:0 0 0 2024-09-17T04:21:06.189 INFO:tasks.workunit.client.0.smithi088.stdout:3/407: truncate d0/d13/d4d/f7d 715188 0 2024-09-17T04:21:06.190 INFO:tasks.workunit.client.1.smithi134.stdout:4/887: getdents d0/d78 0 2024-09-17T04:21:06.190 INFO:tasks.workunit.client.0.smithi088.stdout:3/408: write d0/f1a [5727850,58169] 0 2024-09-17T04:21:06.192 INFO:tasks.workunit.client.0.smithi088.stdout:3/409: write d0/d13/d4d/f7c [1499846,68987] 0 2024-09-17T04:21:06.193 INFO:tasks.workunit.client.1.smithi134.stdout:7/735: mkdir d0/d16/d8b/d6a/de6 0 2024-09-17T04:21:06.194 INFO:tasks.workunit.client.1.smithi134.stdout:7/736: write d0/dd/d3a/d3d/d38/d60/fa8 [702769,100380] 0 2024-09-17T04:21:06.194 INFO:tasks.workunit.client.1.smithi134.stdout:8/783: rename d4/d1f/d25/fa4 to d4/db/dd/d43/ff3 0 2024-09-17T04:21:06.197 INFO:tasks.workunit.client.1.smithi134.stdout:2/846: mknod d19/d27/d31/d34/df2/d6f/da9/db0/dca/c117 0 2024-09-17T04:21:06.200 INFO:tasks.workunit.client.1.smithi134.stdout:3/979: mkdir de/d12/d15/d9f/dba/d14b 0 2024-09-17T04:21:06.201 INFO:tasks.workunit.client.1.smithi134.stdout:8/784: dwrite d4/d1f/f97 [0,4194304] 0 2024-09-17T04:21:06.203 INFO:tasks.workunit.client.1.smithi134.stdout:6/993: dread de/f2c [0,4194304] 0 2024-09-17T04:21:06.203 INFO:tasks.workunit.client.0.smithi088.stdout:8/393: dread d7/f24 [0,4194304] 0 2024-09-17T04:21:06.203 INFO:tasks.workunit.client.1.smithi134.stdout:3/980: write de/d12/d15/d1d/d2d/f36 [2303761,35142] 0 2024-09-17T04:21:06.203 INFO:tasks.workunit.client.0.smithi088.stdout:8/394: readlink d7/d29/d2a/l59 0 2024-09-17T04:21:06.205 INFO:tasks.workunit.client.1.smithi134.stdout:4/888: symlink d0/df/dd5/d11e/l11f 0 2024-09-17T04:21:06.206 INFO:tasks.workunit.client.1.smithi134.stdout:7/737: symlink d0/d16/d35/d8d/dd0/le7 0 2024-09-17T04:21:06.209 INFO:tasks.workunit.client.1.smithi134.stdout:7/738: dread d0/dd/d3a/d3d/d4c/fc6 [0,4194304] 0 2024-09-17T04:21:06.209 INFO:tasks.workunit.client.0.smithi088.stdout:8/395: rename d7/dd/d31/f4c to d7/d29/d2a/d38/f7d 0 2024-09-17T04:21:06.216 INFO:tasks.workunit.client.1.smithi134.stdout:6/994: fdatasync de/d19/d1f/d85/fa7 0 2024-09-17T04:21:06.218 INFO:tasks.workunit.client.0.smithi088.stdout:8/396: rmdir d7/d29/d2a/d53 0 2024-09-17T04:21:06.218 INFO:tasks.workunit.client.1.smithi134.stdout:1/935: getdents d12/d1c/d100/d11b/d122 0 2024-09-17T04:21:06.219 INFO:tasks.workunit.client.1.smithi134.stdout:1/936: chown d12/d19/d1d/d61/dd3 586608967 1 2024-09-17T04:21:06.220 INFO:tasks.workunit.client.1.smithi134.stdout:4/889: creat d0/d13/d40/d42/d92/d65/dc2/f120 x:0 0 0 2024-09-17T04:21:06.220 INFO:tasks.workunit.client.1.smithi134.stdout:2/847: write d19/d27/d31/d34/df2/d6f/d84/f97 [1062892,59507] 0 2024-09-17T04:21:06.222 INFO:tasks.workunit.client.0.smithi088.stdout:0/255: sync 2024-09-17T04:21:06.223 INFO:tasks.workunit.client.1.smithi134.stdout:0/840: getdents d11/d22 0 2024-09-17T04:21:06.225 INFO:tasks.workunit.client.1.smithi134.stdout:8/785: symlink d4/db/dd/lf4 0 2024-09-17T04:21:06.225 INFO:tasks.workunit.client.1.smithi134.stdout:7/739: dwrite d0/dd/d3a/d3d/d38/d60/fca [0,4194304] 0 2024-09-17T04:21:06.226 INFO:tasks.workunit.client.1.smithi134.stdout:3/981: fsync de/d12/d15/d1d/d2d/f53 0 2024-09-17T04:21:06.228 INFO:tasks.workunit.client.1.smithi134.stdout:6/995: fdatasync de/d19/d62/d7c/fca 0 2024-09-17T04:21:06.229 INFO:tasks.workunit.client.1.smithi134.stdout:1/937: symlink d12/d19/d1d/d61/dd3/dda/d85/l13c 0 2024-09-17T04:21:06.232 INFO:tasks.workunit.client.1.smithi134.stdout:2/848: read - d19/d27/d31/d34/f91 zero size 2024-09-17T04:21:06.232 INFO:tasks.workunit.client.1.smithi134.stdout:1/938: write d12/d1c/d2e/f3b [866010,1687] 0 2024-09-17T04:21:06.233 INFO:tasks.workunit.client.1.smithi134.stdout:2/849: fdatasync d19/d1c/d47/d50/d85/fb2 0 2024-09-17T04:21:06.233 INFO:tasks.workunit.client.1.smithi134.stdout:1/939: stat d12/d1c/d100/d11b/d122 0 2024-09-17T04:21:06.233 INFO:tasks.workunit.client.1.smithi134.stdout:0/841: mknod d11/d24/d49/d62/daf/c121 0 2024-09-17T04:21:06.234 INFO:tasks.workunit.client.1.smithi134.stdout:8/786: rmdir d4/d1f/d25 39 2024-09-17T04:21:06.237 INFO:tasks.workunit.client.1.smithi134.stdout:7/740: unlink d0/dd/d3a/d3d/fd3 0 2024-09-17T04:21:06.238 INFO:tasks.workunit.client.1.smithi134.stdout:3/982: rmdir de/d12/d15/d1d/d2d 39 2024-09-17T04:21:06.239 INFO:tasks.workunit.client.1.smithi134.stdout:6/996: mkdir de/d19/d74/d94/d9b/d131/d138 0 2024-09-17T04:21:06.240 INFO:tasks.workunit.client.1.smithi134.stdout:4/890: truncate d0/df/f18 8564731 0 2024-09-17T04:21:06.242 INFO:tasks.workunit.client.1.smithi134.stdout:4/891: write d0/df/d1e/d73/f104 [99633,10000] 0 2024-09-17T04:21:06.242 INFO:tasks.workunit.client.1.smithi134.stdout:1/940: unlink d12/d19/d1d/lb5 0 2024-09-17T04:21:06.242 INFO:tasks.workunit.client.1.smithi134.stdout:0/842: dread - d11/d4c/dd3/fcc zero size 2024-09-17T04:21:06.243 INFO:tasks.workunit.client.1.smithi134.stdout:1/941: chown d12/d36/f12b 400535052 1 2024-09-17T04:21:06.243 INFO:tasks.workunit.client.1.smithi134.stdout:8/787: chown d4/d11/da1/dc7/d13/f78 26585 1 2024-09-17T04:21:06.247 INFO:tasks.workunit.client.1.smithi134.stdout:3/983: rename de/d10/c56 to de/d12/d15/d1d/d8f/deb/d132/c14c 0 2024-09-17T04:21:06.247 INFO:tasks.workunit.client.1.smithi134.stdout:6/997: creat de/d5d/f139 x:0 0 0 2024-09-17T04:21:06.248 INFO:tasks.workunit.client.1.smithi134.stdout:3/984: chown de/d12/d15/d9f/dba/dc4/dca 129011 1 2024-09-17T04:21:06.248 INFO:tasks.workunit.client.1.smithi134.stdout:6/998: dread - de/d19/d1f/d85/d88/ffb zero size 2024-09-17T04:21:06.251 INFO:tasks.workunit.client.1.smithi134.stdout:7/741: getdents d0/d16/de3 0 2024-09-17T04:21:06.252 INFO:tasks.workunit.client.1.smithi134.stdout:2/850: link d19/d1c/d92/ddc/dc6/dbc/fcc d19/d27/d31/d34/df2/d63/d94/d102/de1/f118 0 2024-09-17T04:21:06.253 INFO:tasks.workunit.client.1.smithi134.stdout:0/843: mknod d11/d24/d49/d62/df7/dd8/de2/d105/c122 0 2024-09-17T04:21:06.254 INFO:tasks.workunit.client.1.smithi134.stdout:6/999: dread de/d19/f24 [0,4194304] 0 2024-09-17T04:21:06.254 INFO:tasks.workunit.client.1.smithi134.stdout:1/942: mknod d12/d19/d1d/d5f/d133/c13d 0 2024-09-17T04:21:06.255 INFO:tasks.workunit.client.1.smithi134.stdout:0/844: stat d11/d18/d97/df3/d9a/dea/d114 0 2024-09-17T04:21:06.257 INFO:tasks.workunit.client.1.smithi134.stdout:3/985: creat de/d12/d15/d1d/d2d/d31/d6a/d83/f14d x:0 0 0 2024-09-17T04:21:06.258 INFO:tasks.workunit.client.1.smithi134.stdout:7/742: symlink d0/dd/d3a/le8 0 2024-09-17T04:21:06.258 INFO:tasks.workunit.client.1.smithi134.stdout:5/806: sync 2024-09-17T04:21:06.259 INFO:tasks.workunit.client.1.smithi134.stdout:2/851: dread d19/d27/d31/d34/df2/d6f/d84/f97 [0,4194304] 0 2024-09-17T04:21:06.262 INFO:tasks.workunit.client.1.smithi134.stdout:0/845: rename d11/d19/d21/c3c to d11/d48/dff/c123 0 2024-09-17T04:21:06.262 INFO:tasks.workunit.client.1.smithi134.stdout:3/986: rmdir de/d12/d15/d1d/d2d 39 2024-09-17T04:21:06.263 INFO:tasks.workunit.client.1.smithi134.stdout:7/743: read - d0/dd/d3a/d3d/d38/da9/fc1 zero size 2024-09-17T04:21:06.265 INFO:tasks.workunit.client.1.smithi134.stdout:0/846: stat d11/d19/d21/f27 0 2024-09-17T04:21:06.266 INFO:tasks.workunit.client.1.smithi134.stdout:8/788: dwrite d4/f82 [0,4194304] 0 2024-09-17T04:21:06.267 INFO:tasks.workunit.client.0.smithi088.stdout:8/397: mkdir d7/d29/d7e 0 2024-09-17T04:21:06.267 INFO:tasks.workunit.client.1.smithi134.stdout:4/892: dread d0/df/f4e [0,4194304] 0 2024-09-17T04:21:06.268 INFO:tasks.workunit.client.0.smithi088.stdout:3/410: dwrite d0/d13/d1b/d29/d30/d35/f66 [0,4194304] 0 2024-09-17T04:21:06.270 INFO:tasks.workunit.client.1.smithi134.stdout:1/943: dwrite d12/d19/d1d/d61/da0/da4/fd9 [0,4194304] 0 2024-09-17T04:21:06.270 INFO:tasks.workunit.client.1.smithi134.stdout:5/807: link d0/d3a/c22 d0/d3a/d6b/c109 0 2024-09-17T04:21:06.271 INFO:tasks.workunit.client.0.smithi088.stdout:0/256: unlink db/f3f 0 2024-09-17T04:21:06.274 INFO:tasks.workunit.client.1.smithi134.stdout:5/808: chown d0/da/d2c 498 1 2024-09-17T04:21:06.274 INFO:tasks.workunit.client.0.smithi088.stdout:8/398: mkdir d7/d7f 0 2024-09-17T04:21:06.275 INFO:tasks.workunit.client.1.smithi134.stdout:8/789: symlink d4/db/dd/d43/da5/lf5 0 2024-09-17T04:21:06.275 INFO:tasks.workunit.client.1.smithi134.stdout:4/893: dread - d0/df/d35/d5c/f116 zero size 2024-09-17T04:21:06.276 INFO:tasks.workunit.client.0.smithi088.stdout:3/411: fdatasync d0/d13/d1b/d29/d2b/f42 0 2024-09-17T04:21:06.278 INFO:tasks.workunit.client.1.smithi134.stdout:0/847: rename d11/d18/d97/df3/d43/c72 to d11/d4c/d76/dba/c124 0 2024-09-17T04:21:06.279 INFO:tasks.workunit.client.1.smithi134.stdout:2/852: creat d19/d27/d31/d34/df2/d6f/da9/db0/dca/d10a/f119 x:0 0 0 2024-09-17T04:21:06.280 INFO:tasks.workunit.client.0.smithi088.stdout:0/257: dwrite db/d1b/d36/d47/d37/f49 [0,4194304] 0 2024-09-17T04:21:06.280 INFO:tasks.workunit.client.0.smithi088.stdout:8/399: rmdir d7/d29/d2a/d3a 39 2024-09-17T04:21:06.281 INFO:tasks.workunit.client.1.smithi134.stdout:3/987: dwrite de/d12/d15/d1d/f62 [0,4194304] 0 2024-09-17T04:21:06.282 INFO:tasks.workunit.client.0.smithi088.stdout:0/258: fsync f0 0 2024-09-17T04:21:06.282 INFO:tasks.workunit.client.0.smithi088.stdout:3/412: read d0/f12 [3582573,103777] 0 2024-09-17T04:21:06.283 INFO:tasks.workunit.client.1.smithi134.stdout:1/944: mkdir d12/d19/d5d/d88/d13e 0 2024-09-17T04:21:06.283 INFO:tasks.workunit.client.1.smithi134.stdout:7/744: dread d0/d16/d8b/dc7/fd5 [0,4194304] 0 2024-09-17T04:21:06.284 INFO:tasks.workunit.client.1.smithi134.stdout:0/848: read d11/d6f/fc1 [4133336,45773] 0 2024-09-17T04:21:06.285 INFO:tasks.workunit.client.1.smithi134.stdout:7/745: readlink d0/dd/d3a/l9f 0 2024-09-17T04:21:06.286 INFO:tasks.workunit.client.1.smithi134.stdout:3/988: stat de/d12/d22/d5a/l88 0 2024-09-17T04:21:06.289 INFO:tasks.workunit.client.0.smithi088.stdout:3/413: creat d0/d13/d1b/d29/d30/d3c/f87 x:0 0 0 2024-09-17T04:21:06.290 INFO:tasks.workunit.client.1.smithi134.stdout:1/945: mknod d12/d1c/d100/d11b/c13f 0 2024-09-17T04:21:06.292 INFO:tasks.workunit.client.0.smithi088.stdout:8/400: link d7/d29/d2a/f2b d7/d29/d2a/d38/d3d/f80 0 2024-09-17T04:21:06.294 INFO:tasks.workunit.client.1.smithi134.stdout:2/853: symlink d19/d27/d31/d34/df2/d63/l11a 0 2024-09-17T04:21:06.294 INFO:tasks.workunit.client.1.smithi134.stdout:4/894: creat d0/df/d1e/dbc/d114/f121 x:0 0 0 2024-09-17T04:21:06.295 INFO:tasks.workunit.client.1.smithi134.stdout:0/849: mknod d11/d22/c125 0 2024-09-17T04:21:06.295 INFO:tasks.workunit.client.1.smithi134.stdout:7/746: stat d0/d16/d8b/fdb 0 2024-09-17T04:21:06.296 INFO:tasks.workunit.client.0.smithi088.stdout:3/414: unlink d0/d13/d1b/d29/f2d 0 2024-09-17T04:21:06.296 INFO:tasks.workunit.client.0.smithi088.stdout:3/415: chown d0/d13/d1b/l1d 483507 1 2024-09-17T04:21:06.297 INFO:tasks.workunit.client.0.smithi088.stdout:0/259: rename db/f1c to db/f53 0 2024-09-17T04:21:06.298 INFO:tasks.workunit.client.1.smithi134.stdout:5/809: dread d0/f79 [0,4194304] 0 2024-09-17T04:21:06.299 INFO:tasks.workunit.client.1.smithi134.stdout:5/810: fdatasync d0/da/d2c/f63 0 2024-09-17T04:21:06.299 INFO:tasks.workunit.client.1.smithi134.stdout:5/811: dread - d0/d3a/d2b/d61/d7b/f97 zero size 2024-09-17T04:21:06.301 INFO:tasks.workunit.client.1.smithi134.stdout:1/946: unlink d12/d19/d5d/d88/cf6 0 2024-09-17T04:21:06.301 INFO:tasks.workunit.client.0.smithi088.stdout:8/401: truncate d7/d29/d2a/d3a/f3e 1015628 0 2024-09-17T04:21:06.301 INFO:tasks.workunit.client.1.smithi134.stdout:1/947: readlink d12/d36/l57 0 2024-09-17T04:21:06.302 INFO:tasks.workunit.client.1.smithi134.stdout:2/854: creat d19/d27/d31/d34/df2/d63/d94/f11b x:0 0 0 2024-09-17T04:21:06.303 INFO:tasks.workunit.client.0.smithi088.stdout:3/416: creat d0/d13/d1b/f88 x:0 0 0 2024-09-17T04:21:06.304 INFO:tasks.workunit.client.1.smithi134.stdout:8/790: link d4/db/dd/d72/fd5 d4/d1f/d2b/dbf/dcc/ff6 0 2024-09-17T04:21:06.304 INFO:tasks.workunit.client.0.smithi088.stdout:0/260: dwrite db/f2a [4194304,4194304] 0 2024-09-17T04:21:06.304 INFO:tasks.workunit.client.1.smithi134.stdout:8/791: dread - d4/db/dd/d72/fd5 zero size 2024-09-17T04:21:06.305 INFO:tasks.workunit.client.0.smithi088.stdout:0/261: readlink db/d1b/d36/d47/l42 0 2024-09-17T04:21:06.307 INFO:tasks.workunit.client.0.smithi088.stdout:8/402: rmdir d7/d29/d2a/d75 39 2024-09-17T04:21:06.308 INFO:tasks.workunit.client.0.smithi088.stdout:8/403: stat d7/dd/d31/d47/d55/f74 0 2024-09-17T04:21:06.309 INFO:tasks.workunit.client.0.smithi088.stdout:3/417: rmdir d0 39 2024-09-17T04:21:06.315 INFO:tasks.workunit.client.1.smithi134.stdout:3/989: fsync de/d10/d3d/ff5 0 2024-09-17T04:21:06.317 INFO:tasks.workunit.client.0.smithi088.stdout:3/418: read - d0/d13/d1b/d29/d56/f64 zero size 2024-09-17T04:21:06.318 INFO:tasks.workunit.client.0.smithi088.stdout:0/262: fsync db/d1b/d36/d47/f32 0 2024-09-17T04:21:06.320 INFO:tasks.workunit.client.0.smithi088.stdout:8/404: creat d7/d29/d2a/d3a/d79/f81 x:0 0 0 2024-09-17T04:21:06.321 INFO:tasks.workunit.client.1.smithi134.stdout:5/812: dread d0/da/d69/d41/d6d/f76 [0,4194304] 0 2024-09-17T04:21:06.323 INFO:tasks.workunit.client.0.smithi088.stdout:0/263: dwrite db/d1b/d36/d47/d37/f49 [0,4194304] 0 2024-09-17T04:21:06.325 INFO:tasks.workunit.client.0.smithi088.stdout:8/405: creat d7/dd/f82 x:0 0 0 2024-09-17T04:21:06.327 INFO:tasks.workunit.client.1.smithi134.stdout:7/747: creat d0/d16/de3/fe9 x:0 0 0 2024-09-17T04:21:06.327 INFO:tasks.workunit.client.0.smithi088.stdout:0/264: mknod db/d1b/c54 0 2024-09-17T04:21:06.330 INFO:tasks.workunit.client.1.smithi134.stdout:3/990: write de/d12/d15/d1d/d2d/d63/fae [5045656,110302] 0 2024-09-17T04:21:06.331 INFO:tasks.workunit.client.1.smithi134.stdout:8/792: mknod d4/d1f/d25/d6a/cf7 0 2024-09-17T04:21:06.334 INFO:tasks.workunit.client.0.smithi088.stdout:6/435: sync 2024-09-17T04:21:06.334 INFO:tasks.workunit.client.0.smithi088.stdout:1/412: sync 2024-09-17T04:21:06.335 INFO:tasks.workunit.client.0.smithi088.stdout:6/436: dread - d14/d44/f8e zero size 2024-09-17T04:21:06.335 INFO:tasks.workunit.client.1.smithi134.stdout:5/813: mknod d0/c10a 0 2024-09-17T04:21:06.338 INFO:tasks.workunit.client.1.smithi134.stdout:4/895: getdents d0/d13/d40/d42 0 2024-09-17T04:21:06.339 INFO:tasks.workunit.client.1.smithi134.stdout:4/896: write d0/df/d1e/d73/f88 [5769074,106920] 0 2024-09-17T04:21:06.340 INFO:tasks.workunit.client.0.smithi088.stdout:1/413: creat d0/d13/d84/f90 x:0 0 0 2024-09-17T04:21:06.342 INFO:tasks.workunit.client.1.smithi134.stdout:8/793: mkdir d4/db/dd/d95/df8 0 2024-09-17T04:21:06.345 INFO:tasks.workunit.client.0.smithi088.stdout:6/437: symlink d14/d44/d45/d6b/d16/d42/d92/l9e 0 2024-09-17T04:21:06.347 INFO:tasks.workunit.client.0.smithi088.stdout:1/414: mkdir d0/d1/df/d63/d91 0 2024-09-17T04:21:06.348 INFO:tasks.workunit.client.0.smithi088.stdout:1/415: fsync d0/d1/df/d20/f62 0 2024-09-17T04:21:06.349 INFO:tasks.workunit.client.1.smithi134.stdout:3/991: rename de/d12/d15/d1d/d2d/d31/d6a/cc2 to de/d12/d15/d9f/dba/d14b/c14e 0 2024-09-17T04:21:06.350 INFO:tasks.workunit.client.1.smithi134.stdout:3/992: write de/d12/d15/dd0/dfe/df2/f144 [153286,128475] 0 2024-09-17T04:21:06.351 INFO:tasks.workunit.client.1.smithi134.stdout:5/814: mknod d0/da/d29/d78/da5/df0/c10b 0 2024-09-17T04:21:06.352 INFO:tasks.workunit.client.1.smithi134.stdout:1/948: link d12/d19/d4f/c131 d12/d19/d5d/d88/d13e/c140 0 2024-09-17T04:21:06.354 INFO:tasks.workunit.client.1.smithi134.stdout:4/897: mkdir d0/d13/d40/d42/d92/d65/d122 0 2024-09-17T04:21:06.355 INFO:tasks.workunit.client.1.smithi134.stdout:2/855: write d19/d1c/f1d [4705944,91924] 0 2024-09-17T04:21:06.356 INFO:tasks.workunit.client.1.smithi134.stdout:4/898: chown d0/d13/d40/d42/d92 0 1 2024-09-17T04:21:06.357 INFO:tasks.workunit.client.1.smithi134.stdout:0/850: dwrite d11/d19/d21/d37/f8b [0,4194304] 0 2024-09-17T04:21:06.358 INFO:tasks.workunit.client.1.smithi134.stdout:7/748: link d0/dd/d3a/d3d/l45 d0/d16/d35/d4b/lea 0 2024-09-17T04:21:06.359 INFO:tasks.workunit.client.0.smithi088.stdout:6/438: symlink d14/l9f 0 2024-09-17T04:21:06.359 INFO:tasks.workunit.client.1.smithi134.stdout:7/749: chown d0/dd/d3a/l9f 0 1 2024-09-17T04:21:06.362 INFO:tasks.workunit.client.0.smithi088.stdout:1/416: symlink d0/l92 0 2024-09-17T04:21:06.364 INFO:tasks.workunit.client.1.smithi134.stdout:5/815: mknod d0/da/d2c/d73/c10c 0 2024-09-17T04:21:06.365 INFO:tasks.workunit.client.1.smithi134.stdout:5/816: stat d0/d3a/d2b/d100 0 2024-09-17T04:21:06.366 INFO:tasks.workunit.client.1.smithi134.stdout:5/817: dread - d0/da/d29/f85 zero size 2024-09-17T04:21:06.367 INFO:tasks.workunit.client.0.smithi088.stdout:6/439: write d14/d44/d45/d6b/d16/f6a [349644,74120] 0 2024-09-17T04:21:06.370 INFO:tasks.workunit.client.0.smithi088.stdout:1/417: write d0/d1/d16/d77/f8e [693550,1745] 0 2024-09-17T04:21:06.371 INFO:tasks.workunit.client.0.smithi088.stdout:1/418: readlink d0/d1/l51 0 2024-09-17T04:21:06.375 INFO:tasks.workunit.client.0.smithi088.stdout:8/406: dwrite d7/dd/d31/d47/d55/f74 [0,4194304] 0 2024-09-17T04:21:06.378 INFO:tasks.workunit.client.1.smithi134.stdout:4/899: mkdir d0/d13/d123 0 2024-09-17T04:21:06.379 INFO:tasks.workunit.client.1.smithi134.stdout:4/900: write d0/df/d35/d5c/fcc [43706,22103] 0 2024-09-17T04:21:06.379 INFO:tasks.workunit.client.0.smithi088.stdout:6/440: creat d14/d2f/fa0 x:0 0 0 2024-09-17T04:21:06.380 INFO:tasks.workunit.client.1.smithi134.stdout:8/794: write d4/d1e/daf/f6d [2638153,11357] 0 2024-09-17T04:21:06.380 INFO:tasks.workunit.client.0.smithi088.stdout:6/441: readlink d14/d2f/l4e 0 2024-09-17T04:21:06.381 INFO:tasks.workunit.client.1.smithi134.stdout:8/795: write d4/db/dd/d95/f99 [869841,47412] 0 2024-09-17T04:21:06.385 INFO:tasks.workunit.client.0.smithi088.stdout:3/419: write d0/d13/d4d/f7c [4486895,118167] 0 2024-09-17T04:21:06.385 INFO:tasks.workunit.client.1.smithi134.stdout:8/796: chown d4/d1e 49029389 1 2024-09-17T04:21:06.385 INFO:tasks.workunit.client.1.smithi134.stdout:3/993: creat de/d12/d15/d1d/d2d/d31/d6a/d78/de1/f14f x:0 0 0 2024-09-17T04:21:06.389 INFO:tasks.workunit.client.0.smithi088.stdout:8/407: creat d7/d29/d7e/f83 x:0 0 0 2024-09-17T04:21:06.390 INFO:tasks.workunit.client.1.smithi134.stdout:5/818: dread d0/f2a [0,4194304] 0 2024-09-17T04:21:06.390 INFO:tasks.workunit.client.1.smithi134.stdout:2/856: fdatasync f11 0 2024-09-17T04:21:06.390 INFO:tasks.workunit.client.1.smithi134.stdout:2/857: readlink l18 0 2024-09-17T04:21:06.392 INFO:tasks.workunit.client.0.smithi088.stdout:6/442: creat d14/d44/d45/d4d/d97/fa1 x:0 0 0 2024-09-17T04:21:06.392 INFO:tasks.workunit.client.1.smithi134.stdout:2/858: chown d19/d1c/f30 645422 1 2024-09-17T04:21:06.393 INFO:tasks.workunit.client.0.smithi088.stdout:8/408: fdatasync d7/d29/d2a/f2b 0 2024-09-17T04:21:06.394 INFO:tasks.workunit.client.0.smithi088.stdout:6/443: readlink d14/d3a/l99 0 2024-09-17T04:21:06.395 INFO:tasks.workunit.client.1.smithi134.stdout:7/750: link d0/d16/d8b/d6a/f6d d0/d16/d8b/d6a/feb 0 2024-09-17T04:21:06.401 INFO:tasks.workunit.client.1.smithi134.stdout:3/994: dread de/faf [0,4194304] 0 2024-09-17T04:21:06.402 INFO:tasks.workunit.client.0.smithi088.stdout:6/444: creat d14/d44/d45/d4d/d97/fa2 x:0 0 0 2024-09-17T04:21:06.406 INFO:tasks.workunit.client.0.smithi088.stdout:8/409: dwrite d7/dd/d31/d47/d55/d57/f71 [0,4194304] 0 2024-09-17T04:21:06.407 INFO:tasks.workunit.client.1.smithi134.stdout:2/859: creat d19/d27/d31/f11c x:0 0 0 2024-09-17T04:21:06.408 INFO:tasks.workunit.client.1.smithi134.stdout:4/901: mknod d0/df/c124 0 2024-09-17T04:21:06.409 INFO:tasks.workunit.client.0.smithi088.stdout:3/420: dwrite d0/d13/d1b/f88 [0,4194304] 0 2024-09-17T04:21:06.412 INFO:tasks.workunit.client.0.smithi088.stdout:1/419: dread d0/d1/df/f10 [0,4194304] 0 2024-09-17T04:21:06.412 INFO:tasks.workunit.client.1.smithi134.stdout:1/949: getdents d12/d1c/d4a 0 2024-09-17T04:21:06.413 INFO:tasks.workunit.client.1.smithi134.stdout:1/950: dread - d12/d36/ffb zero size 2024-09-17T04:21:06.417 INFO:tasks.workunit.client.1.smithi134.stdout:0/851: getdents d11/d19/d21/d37 0 2024-09-17T04:21:06.418 INFO:tasks.workunit.client.1.smithi134.stdout:0/852: read d11/d19/d21/d37/f8b [2306383,42395] 0 2024-09-17T04:21:06.419 INFO:tasks.workunit.client.1.smithi134.stdout:4/902: rmdir d0/d3b/d9f 39 2024-09-17T04:21:06.425 INFO:tasks.workunit.client.1.smithi134.stdout:2/860: dwrite d19/f1a [4194304,4194304] 0 2024-09-17T04:21:06.426 INFO:tasks.workunit.client.1.smithi134.stdout:8/797: getdents d4/db/dd/d95 0 2024-09-17T04:21:06.428 INFO:tasks.workunit.client.0.smithi088.stdout:6/445: mknod d14/d44/d45/d6b/d16/d42/ca3 0 2024-09-17T04:21:06.429 INFO:tasks.workunit.client.1.smithi134.stdout:1/951: dwrite d12/d1c/d4a/f4c [0,4194304] 0 2024-09-17T04:21:06.430 INFO:tasks.workunit.client.1.smithi134.stdout:4/903: read d0/df/f31 [2760189,75527] 0 2024-09-17T04:21:06.430 INFO:tasks.workunit.client.1.smithi134.stdout:0/853: rmdir d11/d24/d49/d62/df7/dd8/de2/d105 39 2024-09-17T04:21:06.431 INFO:tasks.workunit.client.0.smithi088.stdout:8/410: creat d7/dd/d31/d47/d55/d57/f84 x:0 0 0 2024-09-17T04:21:06.433 INFO:tasks.workunit.client.0.smithi088.stdout:8/411: stat d7/dd/d31/d47/d55/d57/f84 0 2024-09-17T04:21:06.433 INFO:tasks.workunit.client.1.smithi134.stdout:5/819: getdents d0/da/d29/d7c 0 2024-09-17T04:21:06.434 INFO:tasks.workunit.client.1.smithi134.stdout:1/952: dread d12/d19/d1d/d3e/f48 [0,4194304] 0 2024-09-17T04:21:06.434 INFO:tasks.workunit.client.0.smithi088.stdout:3/421: creat d0/d13/d1b/d29/d30/d3c/d5c/f89 x:0 0 0 2024-09-17T04:21:06.435 INFO:tasks.workunit.client.1.smithi134.stdout:0/854: dread d11/d19/f87 [0,4194304] 0 2024-09-17T04:21:06.440 INFO:tasks.workunit.client.1.smithi134.stdout:8/798: mkdir d4/db/dd/d43/d8b/df9 0 2024-09-17T04:21:06.440 INFO:tasks.workunit.client.1.smithi134.stdout:8/799: chown d4/d1e/daf/d60/cd9 1189884 1 2024-09-17T04:21:06.442 INFO:tasks.workunit.client.0.smithi088.stdout:1/420: creat d0/d1/d16/d56/d5b/d87/f93 x:0 0 0 2024-09-17T04:21:06.443 INFO:tasks.workunit.client.0.smithi088.stdout:1/421: chown d0/d1/df/d63/f76 1651 1 2024-09-17T04:21:06.444 INFO:tasks.workunit.client.1.smithi134.stdout:5/820: mkdir d0/da/d29/d8e/d10d 0 2024-09-17T04:21:06.445 INFO:tasks.workunit.client.1.smithi134.stdout:5/821: chown d0/d3a/d6b 1 1 2024-09-17T04:21:06.446 INFO:tasks.workunit.client.0.smithi088.stdout:2/363: sync 2024-09-17T04:21:06.446 INFO:tasks.workunit.client.0.smithi088.stdout:7/439: sync 2024-09-17T04:21:06.446 INFO:tasks.workunit.client.0.smithi088.stdout:4/390: sync 2024-09-17T04:21:06.446 INFO:tasks.workunit.client.0.smithi088.stdout:9/459: sync 2024-09-17T04:21:06.447 INFO:tasks.workunit.client.0.smithi088.stdout:1/422: dread d0/d13/f1b [0,4194304] 0 2024-09-17T04:21:06.447 INFO:tasks.workunit.client.0.smithi088.stdout:3/422: fdatasync d0/d13/d1b/d29/d2b/f47 0 2024-09-17T04:21:06.448 INFO:tasks.workunit.client.1.smithi134.stdout:1/953: creat d12/d19/d1d/d5f/d133/f141 x:0 0 0 2024-09-17T04:21:06.448 INFO:tasks.workunit.client.0.smithi088.stdout:5/341: sync 2024-09-17T04:21:06.449 INFO:tasks.workunit.client.0.smithi088.stdout:6/446: rename d14/d44/d45/d6b/f22 to d14/d44/d45/d6b/d2a/fa4 0 2024-09-17T04:21:06.450 INFO:tasks.workunit.client.0.smithi088.stdout:6/447: dread - d14/d2f/fa0 zero size 2024-09-17T04:21:06.451 INFO:tasks.workunit.client.1.smithi134.stdout:3/995: truncate de/d10/d3d/dd9/ff1 79816 0 2024-09-17T04:21:06.451 INFO:tasks.workunit.client.0.smithi088.stdout:3/423: read d0/d13/d1b/d29/d2b/f42 [4099688,112372] 0 2024-09-17T04:21:06.452 INFO:tasks.workunit.client.0.smithi088.stdout:6/448: write d14/d44/d45/d6b/d2a/d52/d7a/d7b/f81 [932787,99415] 0 2024-09-17T04:21:06.456 INFO:tasks.workunit.client.1.smithi134.stdout:0/855: dwrite d11/d6f/da8/f112 [0,4194304] 0 2024-09-17T04:21:06.458 INFO:tasks.workunit.client.1.smithi134.stdout:0/856: readlink d11/d48/dd2/df4/l110 0 2024-09-17T04:21:06.459 INFO:tasks.workunit.client.0.smithi088.stdout:7/440: unlink d2/d1d/d2e/d7d/l41 0 2024-09-17T04:21:06.459 INFO:tasks.workunit.client.0.smithi088.stdout:6/449: dwrite d14/d44/d45/d6b/d2a/d52/f64 [0,4194304] 0 2024-09-17T04:21:06.460 INFO:tasks.workunit.client.1.smithi134.stdout:4/904: dread d0/d13/d40/d72/fa6 [0,4194304] 0 2024-09-17T04:21:06.460 INFO:tasks.workunit.client.1.smithi134.stdout:5/822: read - d0/d3a/fca zero size 2024-09-17T04:21:06.461 INFO:tasks.workunit.client.0.smithi088.stdout:4/391: mkdir d5/d3d/d73/d7e/d5e/d83 0 2024-09-17T04:21:06.465 INFO:tasks.workunit.client.0.smithi088.stdout:5/342: mkdir d2/d31/d33/d20/d30/d51/d5e/d6b 0 2024-09-17T04:21:06.467 INFO:tasks.workunit.client.1.smithi134.stdout:2/861: creat d19/d1c/f11d x:0 0 0 2024-09-17T04:21:06.468 INFO:tasks.workunit.client.1.smithi134.stdout:8/800: symlink d4/lfa 0 2024-09-17T04:21:06.475 INFO:tasks.workunit.client.1.smithi134.stdout:4/905: creat d0/df/d1e/dbc/f125 x:0 0 0 2024-09-17T04:21:06.475 INFO:tasks.workunit.client.0.smithi088.stdout:9/460: write d2/f7 [1204526,2218] 0 2024-09-17T04:21:06.476 INFO:tasks.workunit.client.0.smithi088.stdout:9/461: chown d2/dd/d14/d8b 824626832 1 2024-09-17T04:21:06.478 INFO:tasks.workunit.client.0.smithi088.stdout:7/441: creat d2/d4/d7/d20/f90 x:0 0 0 2024-09-17T04:21:06.479 INFO:tasks.workunit.client.0.smithi088.stdout:6/450: creat d14/d44/d94/fa5 x:0 0 0 2024-09-17T04:21:06.480 INFO:tasks.workunit.client.1.smithi134.stdout:0/857: truncate d11/d24/d49/d62/daf/fb0 94194 0 2024-09-17T04:21:06.482 INFO:tasks.workunit.client.1.smithi134.stdout:4/906: symlink d0/df/d35/d39/l126 0 2024-09-17T04:21:06.483 INFO:tasks.workunit.client.1.smithi134.stdout:3/996: link la de/d12/d15/d1d/d2d/d31/d6a/d78/d7c/l150 0 2024-09-17T04:21:06.483 INFO:tasks.workunit.client.1.smithi134.stdout:3/997: write de/d10/f5f [4588023,80540] 0 2024-09-17T04:21:06.484 INFO:tasks.workunit.client.1.smithi134.stdout:2/862: mknod d19/d27/d31/d34/df2/d63/d94/d102/de1/c11e 0 2024-09-17T04:21:06.486 INFO:tasks.workunit.client.1.smithi134.stdout:8/801: rename d4/d11/da1/dc7/led to d4/d1f/d86/lfb 0 2024-09-17T04:21:06.487 INFO:tasks.workunit.client.0.smithi088.stdout:1/423: creat d0/f94 x:0 0 0 2024-09-17T04:21:06.488 INFO:tasks.workunit.client.0.smithi088.stdout:1/424: chown d0/d1/c7b 465 1 2024-09-17T04:21:06.490 INFO:tasks.workunit.client.0.smithi088.stdout:9/462: mkdir d2/dd/d14/d8b/d35/da5 0 2024-09-17T04:21:06.491 INFO:tasks.workunit.client.1.smithi134.stdout:0/858: read d11/d24/d49/d62/df7/dd8/fdb [3855201,52799] 0 2024-09-17T04:21:06.491 INFO:tasks.workunit.client.1.smithi134.stdout:0/859: dread - d11/fd5 zero size 2024-09-17T04:21:06.493 INFO:tasks.workunit.client.0.smithi088.stdout:5/343: dread d2/d31/d33/d20/f23 [0,4194304] 0 2024-09-17T04:21:06.494 INFO:tasks.workunit.client.1.smithi134.stdout:4/907: creat d0/df/d1e/d73/f127 x:0 0 0 2024-09-17T04:21:06.494 INFO:tasks.workunit.client.0.smithi088.stdout:0/265: sync 2024-09-17T04:21:06.503 INFO:tasks.workunit.client.1.smithi134.stdout:8/802: dread - d4/d11/da1/db3/fb7 zero size 2024-09-17T04:21:06.504 INFO:tasks.workunit.client.1.smithi134.stdout:5/823: link d0/da/d2c/d73/fd0 d0/da/d29/d7c/f10e 0 2024-09-17T04:21:06.504 INFO:tasks.workunit.client.1.smithi134.stdout:3/998: dread de/d12/f3a [0,4194304] 0 2024-09-17T04:21:06.505 INFO:tasks.workunit.client.0.smithi088.stdout:1/425: unlink d0/d1/c7b 0 2024-09-17T04:21:06.506 INFO:tasks.workunit.client.0.smithi088.stdout:3/424: write d0/d13/f25 [733504,171] 0 2024-09-17T04:21:06.507 INFO:tasks.workunit.client.1.smithi134.stdout:5/824: dread d0/da/d2c/fa7 [0,4194304] 0 2024-09-17T04:21:06.508 INFO:tasks.workunit.client.0.smithi088.stdout:3/425: fsync d0/d13/d1b/d29/f36 0 2024-09-17T04:21:06.508 INFO:tasks.workunit.client.0.smithi088.stdout:4/392: dwrite d5/d32/f57 [0,4194304] 0 2024-09-17T04:21:06.509 INFO:tasks.workunit.client.0.smithi088.stdout:4/393: chown d5/d3d/f6d 2989610 1 2024-09-17T04:21:06.515 INFO:tasks.workunit.client.0.smithi088.stdout:5/344: unlink d2/d31/d33/d20/d25/d2c/f4b 0 2024-09-17T04:21:06.515 INFO:tasks.workunit.client.1.smithi134.stdout:8/803: rmdir d4/db/dd 39 2024-09-17T04:21:06.516 INFO:tasks.workunit.client.0.smithi088.stdout:5/345: write d2/f40 [346314,106993] 0 2024-09-17T04:21:06.520 INFO:tasks.workunit.client.1.smithi134.stdout:3/999: chown de/d10/d3d/dd9/ff1 192 1 2024-09-17T04:21:06.520 INFO:tasks.workunit.client.0.smithi088.stdout:2/364: link d0/d1/d2d/d33/d4b/d24/d3b/c37 d0/c73 0 2024-09-17T04:21:06.521 INFO:tasks.workunit.client.0.smithi088.stdout:7/442: truncate d2/d4/d7/d20/f22 1547188 0 2024-09-17T04:21:06.523 INFO:tasks.workunit.client.0.smithi088.stdout:7/443: fdatasync d2/d4/d7/d46/d67/f72 0 2024-09-17T04:21:06.523 INFO:tasks.workunit.client.0.smithi088.stdout:8/412: rename d7/d29/d2a/d3a/l3f to d7/l85 0 2024-09-17T04:21:06.524 INFO:tasks.workunit.client.0.smithi088.stdout:8/413: chown d7/dd/d31/d47/d55/d57 694 1 2024-09-17T04:21:06.526 INFO:tasks.workunit.client.1.smithi134.stdout:5/825: mkdir d0/d3a/d6b/d10f 0 2024-09-17T04:21:06.532 INFO:tasks.workunit.client.1.smithi134.stdout:2/863: creat d19/d27/d31/d34/df2/d6f/da9/db0/f11f x:0 0 0 2024-09-17T04:21:06.534 INFO:tasks.workunit.client.0.smithi088.stdout:5/346: rmdir d2/d31 39 2024-09-17T04:21:06.535 INFO:tasks.workunit.client.1.smithi134.stdout:5/826: symlink d0/da/d2c/l110 0 2024-09-17T04:21:06.537 INFO:tasks.workunit.client.0.smithi088.stdout:6/451: creat d14/d44/d45/d6b/d2a/fa6 x:0 0 0 2024-09-17T04:21:06.537 INFO:tasks.workunit.client.1.smithi134.stdout:4/908: link d0/d13/d40/d42/d92/cdd d0/d13/d40/d42/dc5/c128 0 2024-09-17T04:21:06.539 INFO:tasks.workunit.client.1.smithi134.stdout:4/909: write d0/df/d35/fd3 [429833,26173] 0 2024-09-17T04:21:06.540 INFO:tasks.workunit.client.1.smithi134.stdout:2/864: dwrite d19/d27/d31/f11c [0,4194304] 0 2024-09-17T04:21:06.540 INFO:tasks.workunit.client.0.smithi088.stdout:7/444: creat d2/d1d/d2e/f91 x:0 0 0 2024-09-17T04:21:06.541 INFO:tasks.workunit.client.0.smithi088.stdout:7/445: write d2/f1b [428410,82652] 0 2024-09-17T04:21:06.542 INFO:tasks.workunit.client.1.smithi134.stdout:5/827: dread d0/da/d29/d78/fd4 [0,4194304] 0 2024-09-17T04:21:06.543 INFO:tasks.workunit.client.0.smithi088.stdout:1/426: getdents d0/d1/d16/d56/d8a 0 2024-09-17T04:21:06.544 INFO:tasks.workunit.client.0.smithi088.stdout:7/446: write d2/d1d/d2e/d7d/d23/d45/d62/f70 [3473228,5110] 0 2024-09-17T04:21:06.545 INFO:tasks.workunit.client.0.smithi088.stdout:7/447: dread - d2/d4/f86 zero size 2024-09-17T04:21:06.546 INFO:tasks.workunit.client.0.smithi088.stdout:4/394: symlink d5/d3d/l84 0 2024-09-17T04:21:06.547 INFO:tasks.workunit.client.1.smithi134.stdout:8/804: dread d4/db/dd/f16 [0,4194304] 0 2024-09-17T04:21:06.548 INFO:tasks.workunit.client.1.smithi134.stdout:4/910: dwrite d0/df/d1e/d73/f95 [4194304,4194304] 0 2024-09-17T04:21:06.548 INFO:tasks.workunit.client.1.smithi134.stdout:8/805: readlink d4/db/dd/da2/leb 0 2024-09-17T04:21:06.550 INFO:tasks.workunit.client.1.smithi134.stdout:7/751: sync 2024-09-17T04:21:06.551 INFO:tasks.workunit.client.0.smithi088.stdout:0/266: link db/d1b/d36/d4a/l51 db/d1b/d36/d47/d37/l55 0 2024-09-17T04:21:06.556 INFO:tasks.workunit.client.0.smithi088.stdout:9/463: getdents d2/dd/d11/d30 0 2024-09-17T04:21:06.560 INFO:tasks.workunit.client.0.smithi088.stdout:1/427: symlink d0/d1/d27/l95 0 2024-09-17T04:21:06.562 INFO:tasks.workunit.client.0.smithi088.stdout:7/448: rename d2/d4/f81 to d2/d1d/d2e/d7d/d23/d45/d85/f92 0 2024-09-17T04:21:06.565 INFO:tasks.workunit.client.0.smithi088.stdout:2/365: link d0/d1/d2d/d33/d4b/d24/d3b/c23 d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/c74 0 2024-09-17T04:21:06.565 INFO:tasks.workunit.client.0.smithi088.stdout:2/366: fsync d0/d1/f3 0 2024-09-17T04:21:06.568 INFO:tasks.workunit.client.0.smithi088.stdout:9/464: unlink d2/l86 0 2024-09-17T04:21:06.569 INFO:tasks.workunit.client.0.smithi088.stdout:3/426: getdents d0/d13/d1b/d29/d30/d35 0 2024-09-17T04:21:06.575 INFO:tasks.workunit.client.0.smithi088.stdout:9/465: dwrite d2/dd/d11/d4f/d72/d74/fa0 [0,4194304] 0 2024-09-17T04:21:06.576 INFO:tasks.workunit.client.0.smithi088.stdout:9/466: fdatasync d2/dd/d11/d30/f89 0 2024-09-17T04:21:06.577 INFO:tasks.workunit.client.0.smithi088.stdout:4/395: mknod d5/c85 0 2024-09-17T04:21:06.579 INFO:tasks.workunit.client.0.smithi088.stdout:4/396: fsync d5/d72/f74 0 2024-09-17T04:21:06.583 INFO:tasks.workunit.client.0.smithi088.stdout:6/452: rmdir d14/d44/d45/d6b/d16/d42/d92/d95 0 2024-09-17T04:21:06.585 INFO:tasks.workunit.client.0.smithi088.stdout:7/449: dread d2/d1d/d2e/d7d/f29 [0,4194304] 0 2024-09-17T04:21:06.587 INFO:tasks.workunit.client.0.smithi088.stdout:7/450: write d2/d4/d7/d20/f6b [1030795,58163] 0 2024-09-17T04:21:06.595 INFO:tasks.workunit.client.1.smithi134.stdout:0/860: link d11/f70 d11/d48/f126 0 2024-09-17T04:21:06.595 INFO:tasks.workunit.client.1.smithi134.stdout:0/861: readlink d11/d4c/dd3/d81/lbc 0 2024-09-17T04:21:06.598 INFO:tasks.workunit.client.0.smithi088.stdout:4/397: dread d5/d3d/d73/d7e/f52 [0,4194304] 0 2024-09-17T04:21:06.600 INFO:tasks.workunit.client.1.smithi134.stdout:5/828: stat d0/da/fe2 0 2024-09-17T04:21:06.602 INFO:tasks.workunit.client.0.smithi088.stdout:7/451: unlink d2/d1d/d2e/d7d/l8e 0 2024-09-17T04:21:06.604 INFO:tasks.workunit.client.0.smithi088.stdout:8/414: link d7/d29/d2a/d38/c54 d7/d29/d2a/c86 0 2024-09-17T04:21:06.607 INFO:tasks.workunit.client.0.smithi088.stdout:3/427: mkdir d0/d13/d8a 0 2024-09-17T04:21:06.608 INFO:tasks.workunit.client.0.smithi088.stdout:7/452: dwrite d2/d1d/d2e/f78 [0,4194304] 0 2024-09-17T04:21:06.608 INFO:tasks.workunit.client.0.smithi088.stdout:1/428: creat d0/d1/f96 x:0 0 0 2024-09-17T04:21:06.612 INFO:tasks.workunit.client.0.smithi088.stdout:4/398: creat d5/d32/d6b/f86 x:0 0 0 2024-09-17T04:21:06.613 INFO:tasks.workunit.client.0.smithi088.stdout:6/453: mkdir d14/d44/d45/d6b/da7 0 2024-09-17T04:21:06.616 INFO:tasks.workunit.client.1.smithi134.stdout:1/954: sync 2024-09-17T04:21:06.619 INFO:tasks.workunit.client.0.smithi088.stdout:7/453: rmdir d2/d79 39 2024-09-17T04:21:06.621 INFO:tasks.workunit.client.1.smithi134.stdout:1/955: dwrite d12/d19/d1d/d3e/fa6 [0,4194304] 0 2024-09-17T04:21:06.622 INFO:tasks.workunit.client.0.smithi088.stdout:1/429: rename d0/d1/f96 to d0/d1/df/d63/d91/f97 0 2024-09-17T04:21:06.622 INFO:tasks.workunit.client.1.smithi134.stdout:1/956: stat d12/d36/fc2 0 2024-09-17T04:21:06.628 INFO:tasks.workunit.client.0.smithi088.stdout:8/415: getdents d7/dd/d31/d47/d55/d57/d6b 0 2024-09-17T04:21:06.629 INFO:tasks.workunit.client.0.smithi088.stdout:2/367: dwrite d0/f61 [0,4194304] 0 2024-09-17T04:21:06.633 INFO:tasks.workunit.client.0.smithi088.stdout:3/428: mkdir d0/d13/d1b/d29/d2b/d8b 0 2024-09-17T04:21:06.635 INFO:tasks.workunit.client.1.smithi134.stdout:8/806: creat d4/d1f/ffc x:0 0 0 2024-09-17T04:21:06.636 INFO:tasks.workunit.client.0.smithi088.stdout:9/467: write d2/dd/f4c [723214,24949] 0 2024-09-17T04:21:06.636 INFO:tasks.workunit.client.1.smithi134.stdout:8/807: fsync d4/db/dd/d43/fd8 0 2024-09-17T04:21:06.638 INFO:tasks.workunit.client.0.smithi088.stdout:9/468: read d2/dd/fe [964634,65811] 0 2024-09-17T04:21:06.640 INFO:tasks.workunit.client.1.smithi134.stdout:7/752: creat d0/dd/d3a/fec x:0 0 0 2024-09-17T04:21:06.641 INFO:tasks.workunit.client.1.smithi134.stdout:1/957: unlink d12/dcc/fe1 0 2024-09-17T04:21:06.644 INFO:tasks.workunit.client.1.smithi134.stdout:0/862: unlink d11/d22/f3e 0 2024-09-17T04:21:06.647 INFO:tasks.workunit.client.0.smithi088.stdout:4/399: write d5/d32/f79 [1270037,90960] 0 2024-09-17T04:21:06.648 INFO:tasks.workunit.client.1.smithi134.stdout:5/829: write d0/da/d29/d7c/f10e [843925,121570] 0 2024-09-17T04:21:06.648 INFO:tasks.workunit.client.0.smithi088.stdout:4/400: write d5/d3d/f42 [3681146,27933] 0 2024-09-17T04:21:06.649 INFO:tasks.workunit.client.1.smithi134.stdout:4/911: getdents d0/d13/d40/d42/dc5 0 2024-09-17T04:21:06.649 INFO:tasks.workunit.client.1.smithi134.stdout:2/865: dwrite d19/d7e/f86 [0,4194304] 0 2024-09-17T04:21:06.650 INFO:tasks.workunit.client.0.smithi088.stdout:4/401: write d5/d32/d6b/f86 [392742,86796] 0 2024-09-17T04:21:06.650 INFO:tasks.workunit.client.1.smithi134.stdout:5/830: write d0/d48/f80 [4287750,120206] 0 2024-09-17T04:21:06.651 INFO:tasks.workunit.client.0.smithi088.stdout:4/402: write d5/d32/d6b/f7b [670232,105199] 0 2024-09-17T04:21:06.652 INFO:tasks.workunit.client.1.smithi134.stdout:4/912: write d0/df/d17/d9c/fb3 [840422,43657] 0 2024-09-17T04:21:06.652 INFO:tasks.workunit.client.0.smithi088.stdout:2/368: creat d0/d1/d2d/f75 x:0 0 0 2024-09-17T04:21:06.653 INFO:tasks.workunit.client.0.smithi088.stdout:4/403: write d5/d3d/f7a [1325288,46859] 0 2024-09-17T04:21:06.656 INFO:tasks.workunit.client.1.smithi134.stdout:1/958: rename d12/d19/d5d/d91/dac/dd5/ffc to d12/d36/da1/f142 0 2024-09-17T04:21:06.657 INFO:tasks.workunit.client.1.smithi134.stdout:1/959: fsync d12/d1c/d2e/f5a 0 2024-09-17T04:21:06.658 INFO:tasks.workunit.client.0.smithi088.stdout:3/429: dread - d0/d13/d1b/d29/d2b/d50/f67 zero size 2024-09-17T04:21:06.658 INFO:tasks.workunit.client.0.smithi088.stdout:2/369: dread d0/d18/f4c [0,4194304] 0 2024-09-17T04:21:06.661 INFO:tasks.workunit.client.0.smithi088.stdout:7/454: symlink d2/d1d/d2e/d7d/l93 0 2024-09-17T04:21:06.664 INFO:tasks.workunit.client.1.smithi134.stdout:2/866: fdatasync d19/d7e/f81 0 2024-09-17T04:21:06.665 INFO:tasks.workunit.client.0.smithi088.stdout:9/469: symlink d2/dd/d14/d2a/la6 0 2024-09-17T04:21:06.670 INFO:tasks.workunit.client.1.smithi134.stdout:5/831: creat d0/da/d2c/d73/f111 x:0 0 0 2024-09-17T04:21:06.671 INFO:tasks.workunit.client.1.smithi134.stdout:5/832: chown d0/d3a/d2b/d61/d7b 60351 1 2024-09-17T04:21:06.671 INFO:tasks.workunit.client.0.smithi088.stdout:9/470: dwrite d2/fb [0,4194304] 0 2024-09-17T04:21:06.672 INFO:tasks.workunit.client.0.smithi088.stdout:6/454: creat d14/d3a/fa8 x:0 0 0 2024-09-17T04:21:06.673 INFO:tasks.workunit.client.1.smithi134.stdout:4/913: mkdir d0/df/dd5/d129 0 2024-09-17T04:21:06.676 INFO:tasks.workunit.client.1.smithi134.stdout:0/863: symlink d11/d24/l127 0 2024-09-17T04:21:06.677 INFO:tasks.workunit.client.1.smithi134.stdout:0/864: chown d11/d24/d49/d62/daf/ded/ff8 77 1 2024-09-17T04:21:06.679 INFO:tasks.workunit.client.0.smithi088.stdout:3/430: dread d0/d13/d1b/d29/f5b [0,4194304] 0 2024-09-17T04:21:06.681 INFO:tasks.workunit.client.1.smithi134.stdout:7/753: rmdir d0/dd/db7 0 2024-09-17T04:21:06.682 INFO:tasks.workunit.client.0.smithi088.stdout:3/431: read d0/d13/d1b/f27 [2466347,91990] 0 2024-09-17T04:21:06.684 INFO:tasks.workunit.client.0.smithi088.stdout:1/430: rmdir d0/d1/d16/d56/d8a 0 2024-09-17T04:21:06.686 INFO:tasks.workunit.client.1.smithi134.stdout:1/960: mknod d12/d19/d1d/d61/dd3/dda/d109/c143 0 2024-09-17T04:21:06.688 INFO:tasks.workunit.client.1.smithi134.stdout:0/865: symlink d11/d48/dd2/df4/l128 0 2024-09-17T04:21:06.690 INFO:tasks.workunit.client.0.smithi088.stdout:8/416: creat d7/f87 x:0 0 0 2024-09-17T04:21:06.693 INFO:tasks.workunit.client.0.smithi088.stdout:4/404: creat d5/d3d/d73/d7e/d5e/d83/f87 x:0 0 0 2024-09-17T04:21:06.695 INFO:tasks.workunit.client.1.smithi134.stdout:2/867: creat d19/d27/d31/d34/df2/d6f/f120 x:0 0 0 2024-09-17T04:21:06.698 INFO:tasks.workunit.client.0.smithi088.stdout:7/455: symlink d2/d1d/d2e/d7d/l94 0 2024-09-17T04:21:06.698 INFO:tasks.workunit.client.1.smithi134.stdout:7/754: write d0/dd/d3a/d3d/d4c/f76 [58722,22214] 0 2024-09-17T04:21:06.699 INFO:tasks.workunit.client.1.smithi134.stdout:7/755: chown d0/d16/d35/fe4 0 1 2024-09-17T04:21:06.700 INFO:tasks.workunit.client.0.smithi088.stdout:3/432: creat d0/d13/d58/d5a/f8c x:0 0 0 2024-09-17T04:21:06.701 INFO:tasks.workunit.client.0.smithi088.stdout:6/455: dwrite d14/d44/d45/d6b/d29/f5f [0,4194304] 0 2024-09-17T04:21:06.702 INFO:tasks.workunit.client.1.smithi134.stdout:2/868: rename d19/f76 to d19/d27/d31/d34/df2/d6f/d10e/f121 0 2024-09-17T04:21:06.702 INFO:tasks.workunit.client.1.smithi134.stdout:4/914: dread d0/fa [0,4194304] 0 2024-09-17T04:21:06.703 INFO:tasks.workunit.client.1.smithi134.stdout:2/869: chown d19/d27/d31/d34/ld3 0 1 2024-09-17T04:21:06.703 INFO:tasks.workunit.client.0.smithi088.stdout:6/456: write d14/d44/d45/d6b/d2a/f8d [828845,76950] 0 2024-09-17T04:21:06.703 INFO:tasks.workunit.client.1.smithi134.stdout:2/870: chown d19/d1c/d92/ddc/dc6/dbc/de3 207783 1 2024-09-17T04:21:06.715 INFO:tasks.workunit.client.0.smithi088.stdout:7/456: dread d2/d4/d7/f61 [0,4194304] 0 2024-09-17T04:21:06.766 INFO:tasks.workunit.client.1.smithi134.stdout:8/808: sync 2024-09-17T04:21:06.767 INFO:tasks.workunit.client.1.smithi134.stdout:8/809: fsync d4/d1f/d2b/dbf/ddd/ff1 0 2024-09-17T04:21:06.807 INFO:tasks.workunit.client.1.smithi134.stdout:7/756: readlink d0/dd/d3a/d3d/d38/d60/l6c 0 2024-09-17T04:21:06.807 INFO:tasks.workunit.client.1.smithi134.stdout:1/961: truncate d12/d36/fae 339538 0 2024-09-17T04:21:06.809 INFO:tasks.workunit.client.0.smithi088.stdout:2/370: rename d0/d1/d2d/d33/d4b/l57 to d0/l76 0 2024-09-17T04:21:06.810 INFO:tasks.workunit.client.1.smithi134.stdout:2/871: creat d19/d27/d31/d34/df2/d63/d94/f122 x:0 0 0 2024-09-17T04:21:06.810 INFO:tasks.workunit.client.1.smithi134.stdout:0/866: sync 2024-09-17T04:21:06.810 INFO:tasks.workunit.client.1.smithi134.stdout:5/833: sync 2024-09-17T04:21:06.811 INFO:tasks.workunit.client.1.smithi134.stdout:0/867: truncate d11/d4c/d76/d118/f11c 739009 0 2024-09-17T04:21:06.811 INFO:tasks.workunit.client.1.smithi134.stdout:8/810: mknod d4/d11/da1/dc7/cfd 0 2024-09-17T04:21:06.812 INFO:tasks.workunit.client.1.smithi134.stdout:0/868: dread - d11/d18/d97/df3/d43/f106 zero size 2024-09-17T04:21:06.813 INFO:tasks.workunit.client.1.smithi134.stdout:4/915: write d0/df/f31 [1623877,50216] 0 2024-09-17T04:21:06.815 INFO:tasks.workunit.client.1.smithi134.stdout:1/962: creat d12/d19/d1d/d3e/d121/f144 x:0 0 0 2024-09-17T04:21:06.816 INFO:tasks.workunit.client.0.smithi088.stdout:6/457: fdatasync d14/d44/d45/d6b/d29/f38 0 2024-09-17T04:21:06.818 INFO:tasks.workunit.client.1.smithi134.stdout:2/872: creat d19/d1c/d92/f123 x:0 0 0 2024-09-17T04:21:06.819 INFO:tasks.workunit.client.0.smithi088.stdout:3/433: dread d0/d13/d1b/d29/d30/d3c/f51 [0,4194304] 0 2024-09-17T04:21:06.819 INFO:tasks.workunit.client.1.smithi134.stdout:1/963: write d12/d19/d5d/d91/dac/fba [4705429,22037] 0 2024-09-17T04:21:06.819 INFO:tasks.workunit.client.0.smithi088.stdout:3/434: chown d0/d13/d58/d5e 0 1 2024-09-17T04:21:06.820 INFO:tasks.workunit.client.1.smithi134.stdout:5/834: fsync d0/da/d29/d78/f8d 0 2024-09-17T04:21:06.820 INFO:tasks.workunit.client.0.smithi088.stdout:3/435: read d0/d13/d1b/f88 [1747988,31300] 0 2024-09-17T04:21:06.821 INFO:tasks.workunit.client.0.smithi088.stdout:3/436: chown d0/d13/d58/d5e/c73 189 1 2024-09-17T04:21:06.822 INFO:tasks.workunit.client.1.smithi134.stdout:7/757: dwrite d0/dd/d3a/fae [0,4194304] 0 2024-09-17T04:21:06.823 INFO:tasks.workunit.client.1.smithi134.stdout:4/916: dwrite d0/f43 [0,4194304] 0 2024-09-17T04:21:06.823 INFO:tasks.workunit.client.1.smithi134.stdout:7/758: chown d0/dd 25947 1 2024-09-17T04:21:06.826 INFO:tasks.workunit.client.0.smithi088.stdout:1/431: link d0/d1/d16/d2a/c38 d0/d1/d16/d56/d5b/d87/c98 0 2024-09-17T04:21:06.826 INFO:tasks.workunit.client.1.smithi134.stdout:0/869: mknod d11/d4c/d76/d118/c129 0 2024-09-17T04:21:06.826 INFO:tasks.workunit.client.1.smithi134.stdout:0/870: fdatasync d11/d18/d97/df3/f55 0 2024-09-17T04:21:06.827 INFO:tasks.workunit.client.0.smithi088.stdout:1/432: write d0/d1/d27/f40 [4721312,28003] 0 2024-09-17T04:21:06.829 INFO:tasks.workunit.client.0.smithi088.stdout:1/433: read - d0/d1/d16/d2a/f53 zero size 2024-09-17T04:21:06.829 INFO:tasks.workunit.client.0.smithi088.stdout:5/347: sync 2024-09-17T04:21:06.833 INFO:tasks.workunit.client.0.smithi088.stdout:6/458: stat d14/d44/d45/d6b/d16/d42/l7e 0 2024-09-17T04:21:06.835 INFO:tasks.workunit.client.1.smithi134.stdout:0/871: dwrite d11/d4c/f84 [0,4194304] 0 2024-09-17T04:21:06.835 INFO:tasks.workunit.client.0.smithi088.stdout:2/371: write d0/f5d [768752,6570] 0 2024-09-17T04:21:06.837 INFO:tasks.workunit.client.1.smithi134.stdout:8/811: dwrite d4/d1e/daf/f84 [0,4194304] 0 2024-09-17T04:21:06.838 INFO:tasks.workunit.client.1.smithi134.stdout:5/835: truncate d0/da/d2c/f4c 1413495 0 2024-09-17T04:21:06.838 INFO:tasks.workunit.client.1.smithi134.stdout:7/759: unlink d0/dd/d3a/d3d/d4c/c67 0 2024-09-17T04:21:06.839 INFO:tasks.workunit.client.0.smithi088.stdout:3/437: fdatasync d0/d54/f84 0 2024-09-17T04:21:06.839 INFO:tasks.workunit.client.0.smithi088.stdout:3/438: stat d0/d13/d1b/f88 0 2024-09-17T04:21:06.841 INFO:tasks.workunit.client.1.smithi134.stdout:7/760: write d0/dd/dbb/fd4 [947468,49781] 0 2024-09-17T04:21:06.844 INFO:tasks.workunit.client.0.smithi088.stdout:7/457: truncate d2/d1d/d2e/d7d/d23/d45/d62/f70 3628930 0 2024-09-17T04:21:06.846 INFO:tasks.workunit.client.0.smithi088.stdout:3/439: dread d0/d13/d1b/d29/f5b [0,4194304] 0 2024-09-17T04:21:06.847 INFO:tasks.workunit.client.1.smithi134.stdout:1/964: rename c1 to d12/d1c/d2e/c145 0 2024-09-17T04:21:06.848 INFO:tasks.workunit.client.0.smithi088.stdout:3/440: write d0/d13/d1b/d29/d56/f64 [952834,90822] 0 2024-09-17T04:21:06.852 INFO:tasks.workunit.client.0.smithi088.stdout:1/434: creat d0/d1/d16/d77/f99 x:0 0 0 2024-09-17T04:21:06.853 INFO:tasks.workunit.client.0.smithi088.stdout:1/435: write d0/d13/d84/d5d/f72 [91778,59828] 0 2024-09-17T04:21:06.856 INFO:tasks.workunit.client.1.smithi134.stdout:5/836: creat d0/d3a/d6b/f112 x:0 0 0 2024-09-17T04:21:06.857 INFO:tasks.workunit.client.0.smithi088.stdout:4/405: getdents d5/d65 0 2024-09-17T04:21:06.857 INFO:tasks.workunit.client.1.smithi134.stdout:7/761: mkdir d0/dd/db9/ded 0 2024-09-17T04:21:06.858 INFO:tasks.workunit.client.0.smithi088.stdout:7/458: fdatasync d2/d1d/d2e/d7d/d23/d45/f65 0 2024-09-17T04:21:06.859 INFO:tasks.workunit.client.1.smithi134.stdout:1/965: creat d12/d1c/d2e/f146 x:0 0 0 2024-09-17T04:21:06.860 INFO:tasks.workunit.client.0.smithi088.stdout:3/441: unlink d0/d13/f17 0 2024-09-17T04:21:06.861 INFO:tasks.workunit.client.1.smithi134.stdout:1/966: truncate d12/d19/d1d/d3e/f48 5703267 0 2024-09-17T04:21:06.863 INFO:tasks.workunit.client.0.smithi088.stdout:6/459: truncate d14/d44/d45/d6b/d2a/f49 63676 0 2024-09-17T04:21:06.865 INFO:tasks.workunit.client.0.smithi088.stdout:1/436: unlink d0/d13/l34 0 2024-09-17T04:21:06.865 INFO:tasks.workunit.client.0.smithi088.stdout:1/437: stat d0/d1/d16/d35/c70 0 2024-09-17T04:21:06.866 INFO:tasks.workunit.client.0.smithi088.stdout:8/417: getdents d7/dd/d62 0 2024-09-17T04:21:06.867 INFO:tasks.workunit.client.0.smithi088.stdout:1/438: stat d0/d1/df/d63/l67 0 2024-09-17T04:21:06.867 INFO:tasks.workunit.client.0.smithi088.stdout:8/418: dread - d7/dd/d31/d47/d55/d57/f60 zero size 2024-09-17T04:21:06.868 INFO:tasks.workunit.client.0.smithi088.stdout:1/439: write d0/f6a [946757,12234] 0 2024-09-17T04:21:06.869 INFO:tasks.workunit.client.0.smithi088.stdout:1/440: chown d0/d1/df/d20/f80 2444 1 2024-09-17T04:21:06.870 INFO:tasks.workunit.client.0.smithi088.stdout:4/406: creat d5/d65/f88 x:0 0 0 2024-09-17T04:21:06.872 INFO:tasks.workunit.client.1.smithi134.stdout:1/967: chown d12/f86 46297135 1 2024-09-17T04:21:06.874 INFO:tasks.workunit.client.1.smithi134.stdout:2/873: getdents d19/d1c/d92/ddc 0 2024-09-17T04:21:06.874 INFO:tasks.workunit.client.1.smithi134.stdout:2/874: write d19/d1c/d47/d50/f7c [1148872,118552] 0 2024-09-17T04:21:06.875 INFO:tasks.workunit.client.0.smithi088.stdout:7/459: fsync d2/d4/d7/d20/f3a 0 2024-09-17T04:21:06.876 INFO:tasks.workunit.client.1.smithi134.stdout:2/875: rename d19 to d19/d27/d31/d34/df2/d63/d94/d124 22 2024-09-17T04:21:06.877 INFO:tasks.workunit.client.1.smithi134.stdout:8/812: rmdir d4/db/dd/d95/df8 0 2024-09-17T04:21:06.877 INFO:tasks.workunit.client.1.smithi134.stdout:2/876: dread - d19/d27/d31/d34/df2/d6f/da9/db0/dca/d10a/f119 zero size 2024-09-17T04:21:06.878 INFO:tasks.workunit.client.0.smithi088.stdout:4/407: dwrite d5/d32/d6b/f7b [0,4194304] 0 2024-09-17T04:21:06.878 INFO:tasks.workunit.client.0.smithi088.stdout:2/372: dread d0/d1/d2d/d33/d4b/d24/f51 [0,4194304] 0 2024-09-17T04:21:06.878 INFO:tasks.workunit.client.1.smithi134.stdout:0/872: write d11/d48/fab [840615,111144] 0 2024-09-17T04:21:06.879 INFO:tasks.workunit.client.1.smithi134.stdout:4/917: truncate d0/d13/d40/d42/d92/fe3 96119 0 2024-09-17T04:21:06.882 INFO:tasks.workunit.client.1.smithi134.stdout:5/837: getdents d0/d3a/d6b/d10f 0 2024-09-17T04:21:06.883 INFO:tasks.workunit.client.1.smithi134.stdout:7/762: symlink d0/dd/d3a/d3d/lee 0 2024-09-17T04:21:06.885 INFO:tasks.workunit.client.1.smithi134.stdout:1/968: dread - d12/d19/d1d/d61/dd3/dda/fec zero size 2024-09-17T04:21:06.886 INFO:tasks.workunit.client.0.smithi088.stdout:5/348: write d2/d31/d33/f1b [2867929,114164] 0 2024-09-17T04:21:06.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:06 smithi088 ceph-mon[27811]: pgmap v24: 65 pgs: 65 active+clean; 2.8 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 102 MiB/s rd, 327 MiB/s wr, 614 op/s 2024-09-17T04:21:06.890 INFO:tasks.workunit.client.0.smithi088.stdout:1/441: mkdir d0/d1/d27/d9a 0 2024-09-17T04:21:06.890 INFO:tasks.workunit.client.0.smithi088.stdout:6/460: dread d14/d44/d45/d6b/d29/f38 [0,4194304] 0 2024-09-17T04:21:06.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:06 smithi134 ceph-mon[35201]: pgmap v24: 65 pgs: 65 active+clean; 2.8 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 102 MiB/s rd, 327 MiB/s wr, 614 op/s 2024-09-17T04:21:06.897 INFO:tasks.workunit.client.1.smithi134.stdout:4/918: unlink d0/d13/d40/d42/l5a 0 2024-09-17T04:21:06.900 INFO:tasks.workunit.client.1.smithi134.stdout:5/838: mkdir d0/da/d2c/deb/d113 0 2024-09-17T04:21:06.902 INFO:tasks.workunit.client.0.smithi088.stdout:2/373: mkdir d0/d1/d2d/d77 0 2024-09-17T04:21:06.903 INFO:tasks.workunit.client.1.smithi134.stdout:7/763: write d0/d16/f26 [3258109,43123] 0 2024-09-17T04:21:06.903 INFO:tasks.workunit.client.0.smithi088.stdout:7/460: dread d2/d4/d7/f2a [0,4194304] 0 2024-09-17T04:21:06.904 INFO:tasks.workunit.client.1.smithi134.stdout:7/764: dread - d0/dd/db9/fce zero size 2024-09-17T04:21:06.904 INFO:tasks.workunit.client.0.smithi088.stdout:2/374: fsync d0/f5d 0 2024-09-17T04:21:06.904 INFO:tasks.workunit.client.0.smithi088.stdout:0/267: sync 2024-09-17T04:21:06.905 INFO:tasks.workunit.client.0.smithi088.stdout:3/442: dwrite d0/d13/d1b/d29/d30/d35/f3d [0,4194304] 0 2024-09-17T04:21:06.905 INFO:tasks.workunit.client.0.smithi088.stdout:8/419: mknod d7/dd/d31/d47/d55/d57/d6b/c88 0 2024-09-17T04:21:06.906 INFO:tasks.workunit.client.1.smithi134.stdout:2/877: mkdir d19/d1c/d92/ddc/dc6/dbc/d107/d125 0 2024-09-17T04:21:06.907 INFO:tasks.workunit.client.1.smithi134.stdout:2/878: write d19/d1c/d47/dae/f106 [857332,86959] 0 2024-09-17T04:21:06.908 INFO:tasks.workunit.client.0.smithi088.stdout:5/349: rmdir d2/d31/d33/d20/d25 39 2024-09-17T04:21:06.909 INFO:tasks.workunit.client.1.smithi134.stdout:0/873: mknod d11/d19/c12a 0 2024-09-17T04:21:06.909 INFO:tasks.workunit.client.0.smithi088.stdout:3/443: truncate d0/d54/f84 454098 0 2024-09-17T04:21:06.915 INFO:tasks.workunit.client.1.smithi134.stdout:5/839: rmdir d0/da/d69/d41/db6 39 2024-09-17T04:21:06.916 INFO:tasks.workunit.client.0.smithi088.stdout:1/442: dread d0/d13/f47 [0,4194304] 0 2024-09-17T04:21:06.917 INFO:tasks.workunit.client.0.smithi088.stdout:7/461: dread d2/d4/d7/d20/f3c [0,4194304] 0 2024-09-17T04:21:06.918 INFO:tasks.workunit.client.0.smithi088.stdout:6/461: creat d14/d44/d45/d6b/d2a/d52/d7a/d7b/fa9 x:0 0 0 2024-09-17T04:21:06.920 INFO:tasks.workunit.client.0.smithi088.stdout:7/462: readlink d2/d1d/d2e/d7d/d23/d45/l48 0 2024-09-17T04:21:06.920 INFO:tasks.workunit.client.1.smithi134.stdout:2/879: mknod d19/d1c/d47/dae/dc8/c126 0 2024-09-17T04:21:06.921 INFO:tasks.workunit.client.1.smithi134.stdout:2/880: chown d19/d1c/fef 1600 1 2024-09-17T04:21:06.921 INFO:tasks.workunit.client.0.smithi088.stdout:1/443: dread d0/d13/d84/d5d/f6d [4194304,4194304] 0 2024-09-17T04:21:06.923 INFO:tasks.workunit.client.0.smithi088.stdout:1/444: write d0/d1/fa [4265931,26738] 0 2024-09-17T04:21:06.926 INFO:tasks.workunit.client.1.smithi134.stdout:8/813: rename d4/d11/da1/dc7/d13/l18 to d4/lfe 0 2024-09-17T04:21:06.932 INFO:tasks.workunit.client.1.smithi134.stdout:2/881: rmdir d19/d1c/d47/d50/d10f 39 2024-09-17T04:21:06.933 INFO:tasks.workunit.client.0.smithi088.stdout:8/420: dread d7/dd/d31/f36 [8388608,4194304] 0 2024-09-17T04:21:06.933 INFO:tasks.workunit.client.1.smithi134.stdout:4/919: truncate d0/df/d17/f90 927548 0 2024-09-17T04:21:06.934 INFO:tasks.workunit.client.1.smithi134.stdout:7/765: dwrite d0/dd/fb4 [0,4194304] 0 2024-09-17T04:21:06.935 INFO:tasks.workunit.client.1.smithi134.stdout:1/969: rename d12/d1c/d2e/f5a to d12/d19/d5d/d91/dac/dd5/def/f147 0 2024-09-17T04:21:06.936 INFO:tasks.workunit.client.1.smithi134.stdout:8/814: unlink d4/d11/da1/dc7/l1a 0 2024-09-17T04:21:06.936 INFO:tasks.workunit.client.1.smithi134.stdout:7/766: write d0/dd/d3a/d3d/fd8 [314025,121881] 0 2024-09-17T04:21:06.938 INFO:tasks.workunit.client.1.smithi134.stdout:5/840: symlink d0/d3a/d2b/d5a/df6/l114 0 2024-09-17T04:21:06.939 INFO:tasks.workunit.client.0.smithi088.stdout:3/444: mknod d0/d54/c8d 0 2024-09-17T04:21:06.944 INFO:tasks.workunit.client.1.smithi134.stdout:2/882: truncate d19/d7e/f81 930376 0 2024-09-17T04:21:06.944 INFO:tasks.workunit.client.1.smithi134.stdout:2/883: dread - d19/d1c/fef zero size 2024-09-17T04:21:06.945 INFO:tasks.workunit.client.0.smithi088.stdout:6/462: mknod d14/d44/caa 0 2024-09-17T04:21:06.945 INFO:tasks.workunit.client.1.smithi134.stdout:2/884: fsync d19/d27/d31/f6e 0 2024-09-17T04:21:06.946 INFO:tasks.workunit.client.1.smithi134.stdout:4/920: mknod d0/df/d35/d5c/c12a 0 2024-09-17T04:21:06.949 INFO:tasks.workunit.client.0.smithi088.stdout:4/408: symlink d5/d65/d68/l89 0 2024-09-17T04:21:06.954 INFO:tasks.workunit.client.0.smithi088.stdout:9/471: sync 2024-09-17T04:21:06.955 INFO:tasks.workunit.client.1.smithi134.stdout:7/767: unlink d0/dd/d3a/la1 0 2024-09-17T04:21:06.955 INFO:tasks.workunit.client.0.smithi088.stdout:2/375: dwrite d0/d1/d2d/d33/d4b/d24/d3b/f54 [0,4194304] 0 2024-09-17T04:21:06.958 INFO:tasks.workunit.client.1.smithi134.stdout:8/815: creat d4/d1f/d25/fff x:0 0 0 2024-09-17T04:21:06.960 INFO:tasks.workunit.client.1.smithi134.stdout:5/841: write d0/d3a/ff [2744117,44906] 0 2024-09-17T04:21:06.962 INFO:tasks.workunit.client.1.smithi134.stdout:8/816: write d4/d1f/ffc [377848,90889] 0 2024-09-17T04:21:06.964 INFO:tasks.workunit.client.1.smithi134.stdout:2/885: fdatasync d19/d1c/d92/ddc/dc6/ded/fd1 0 2024-09-17T04:21:06.965 INFO:tasks.workunit.client.1.smithi134.stdout:7/768: dwrite d0/dd/d3a/d3d/d38/fbf [0,4194304] 0 2024-09-17T04:21:06.965 INFO:tasks.workunit.client.0.smithi088.stdout:8/421: symlink d7/d29/d2a/d38/d3d/l89 0 2024-09-17T04:21:06.965 INFO:tasks.workunit.client.1.smithi134.stdout:2/886: chown cd 0 1 2024-09-17T04:21:06.966 INFO:tasks.workunit.client.1.smithi134.stdout:1/970: write d12/d1c/d56/f76 [775032,97334] 0 2024-09-17T04:21:06.967 INFO:tasks.workunit.client.1.smithi134.stdout:2/887: write d19/d1c/f1d [7004363,26745] 0 2024-09-17T04:21:06.969 INFO:tasks.workunit.client.0.smithi088.stdout:1/445: write d0/d13/d84/d5d/f78 [537721,67659] 0 2024-09-17T04:21:06.969 INFO:tasks.workunit.client.1.smithi134.stdout:1/971: chown d12/d19/d5d/d91/dac/dd5/def/df1 36677 1 2024-09-17T04:21:06.970 INFO:tasks.workunit.client.0.smithi088.stdout:3/445: unlink d0/d13/d1b/d29/f36 0 2024-09-17T04:21:06.971 INFO:tasks.workunit.client.1.smithi134.stdout:4/921: dread d0/d13/d40/d42/d92/d7b/fc8 [0,4194304] 0 2024-09-17T04:21:06.971 INFO:tasks.workunit.client.1.smithi134.stdout:2/888: write d19/d1c/d92/ddc/dc6/dbc/de3/fea [845130,25743] 0 2024-09-17T04:21:06.972 INFO:tasks.workunit.client.1.smithi134.stdout:1/972: write d12/d19/d5d/d91/dac/dd5/def/df1/f123 [915872,97823] 0 2024-09-17T04:21:06.972 INFO:tasks.workunit.client.1.smithi134.stdout:7/769: dread d0/d16/d35/d4b/fc0 [0,4194304] 0 2024-09-17T04:21:06.976 INFO:tasks.workunit.client.0.smithi088.stdout:6/463: creat d14/d44/d45/d6b/d29/fab x:0 0 0 2024-09-17T04:21:06.978 INFO:tasks.workunit.client.0.smithi088.stdout:7/463: mknod d2/d79/c95 0 2024-09-17T04:21:06.979 INFO:tasks.workunit.client.0.smithi088.stdout:4/409: stat d5/d3d/c40 0 2024-09-17T04:21:06.979 INFO:tasks.workunit.client.0.smithi088.stdout:7/464: chown d2/d4/d7/d20/f90 50 1 2024-09-17T04:21:06.984 INFO:tasks.workunit.client.1.smithi134.stdout:4/922: unlink d0/d13/d40/d42/d92/dc3/lbd 0 2024-09-17T04:21:06.985 INFO:tasks.workunit.client.0.smithi088.stdout:2/376: creat d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/f78 x:0 0 0 2024-09-17T04:21:06.986 INFO:tasks.workunit.client.1.smithi134.stdout:2/889: fsync d19/d27/d31/d34/fbd 0 2024-09-17T04:21:06.992 INFO:tasks.workunit.client.1.smithi134.stdout:7/770: dread d0/dd/d3a/d3d/d38/f23 [0,4194304] 0 2024-09-17T04:21:06.992 INFO:tasks.workunit.client.1.smithi134.stdout:7/771: chown d0/dd/c8e 2103241161 1 2024-09-17T04:21:06.994 INFO:tasks.workunit.client.0.smithi088.stdout:1/446: rmdir d0/d1/d16/d56/d5b/d87 39 2024-09-17T04:21:06.994 INFO:tasks.workunit.client.0.smithi088.stdout:8/422: dwrite d7/dd/f1a [0,4194304] 0 2024-09-17T04:21:06.997 INFO:tasks.workunit.client.1.smithi134.stdout:0/874: rename d11/d22/l38 to d11/d24/d49/d62/l12b 0 2024-09-17T04:21:06.998 INFO:tasks.workunit.client.1.smithi134.stdout:0/875: chown d11/fd5 0 1 2024-09-17T04:21:06.998 INFO:tasks.workunit.client.1.smithi134.stdout:7/772: dwrite d0/dd/d3a/d3d/d4c/f76 [0,4194304] 0 2024-09-17T04:21:07.002 INFO:tasks.workunit.client.0.smithi088.stdout:6/464: dread d14/d44/d45/d6b/d2a/d52/f9b [0,4194304] 0 2024-09-17T04:21:07.006 INFO:tasks.workunit.client.0.smithi088.stdout:4/410: chown d5/d3d/c55 386 1 2024-09-17T04:21:07.011 INFO:tasks.workunit.client.0.smithi088.stdout:2/377: fdatasync d0/d13/f16 0 2024-09-17T04:21:07.014 INFO:tasks.workunit.client.0.smithi088.stdout:6/465: dwrite d14/d44/d45/d6b/d29/f5f [0,4194304] 0 2024-09-17T04:21:07.016 INFO:tasks.workunit.client.1.smithi134.stdout:1/973: rename d12/d19/d1d/d3e/d121 to d12/d19/d66/d148 0 2024-09-17T04:21:07.018 INFO:tasks.workunit.client.0.smithi088.stdout:0/268: getdents db/d3c/d4f 0 2024-09-17T04:21:07.018 INFO:tasks.workunit.client.0.smithi088.stdout:9/472: dwrite d2/f8 [0,4194304] 0 2024-09-17T04:21:07.019 INFO:tasks.workunit.client.0.smithi088.stdout:5/350: getdents d2/d31 0 2024-09-17T04:21:07.022 INFO:tasks.workunit.client.0.smithi088.stdout:4/411: dwrite d5/f2d [0,4194304] 0 2024-09-17T04:21:07.024 INFO:tasks.workunit.client.1.smithi134.stdout:5/842: getdents d0/da/d69/d41/d6d 0 2024-09-17T04:21:07.025 INFO:tasks.workunit.client.1.smithi134.stdout:1/974: dwrite d12/d19/d1d/d5f/d133/f141 [0,4194304] 0 2024-09-17T04:21:07.025 INFO:tasks.workunit.client.0.smithi088.stdout:8/423: fsync f6 0 2024-09-17T04:21:07.027 INFO:tasks.workunit.client.0.smithi088.stdout:1/447: creat d0/d1/d16/d2a/f9b x:0 0 0 2024-09-17T04:21:07.029 INFO:tasks.workunit.client.1.smithi134.stdout:4/923: rename d0/d13/d40/d42/f66 to d0/d13/d123/f12b 0 2024-09-17T04:21:07.030 INFO:tasks.workunit.client.1.smithi134.stdout:2/890: write d19/d1c/f87 [1546994,100612] 0 2024-09-17T04:21:07.032 INFO:tasks.workunit.client.1.smithi134.stdout:1/975: dread d12/d19/d1d/d61/da0/da4/fd9 [0,4194304] 0 2024-09-17T04:21:07.032 INFO:tasks.workunit.client.0.smithi088.stdout:6/466: dread d14/d44/d94/f78 [0,4194304] 0 2024-09-17T04:21:07.036 INFO:tasks.workunit.client.1.smithi134.stdout:7/773: mknod d0/dd/d3a/d3d/cef 0 2024-09-17T04:21:07.037 INFO:tasks.workunit.client.0.smithi088.stdout:3/446: dread d0/fa [0,4194304] 0 2024-09-17T04:21:07.039 INFO:tasks.workunit.client.1.smithi134.stdout:0/876: write d11/d19/d21/fb8 [590304,118919] 0 2024-09-17T04:21:07.041 INFO:tasks.workunit.client.0.smithi088.stdout:1/448: dwrite d0/f94 [0,4194304] 0 2024-09-17T04:21:07.041 INFO:tasks.workunit.client.0.smithi088.stdout:7/465: mkdir d2/d96 0 2024-09-17T04:21:07.045 INFO:tasks.workunit.client.0.smithi088.stdout:2/378: readlink d0/l76 0 2024-09-17T04:21:07.046 INFO:tasks.workunit.client.1.smithi134.stdout:2/891: creat d19/d27/d31/d34/df2/d63/f127 x:0 0 0 2024-09-17T04:21:07.053 INFO:tasks.workunit.client.0.smithi088.stdout:1/449: dwrite d0/d1/d16/d35/f5f [0,4194304] 0 2024-09-17T04:21:07.054 INFO:tasks.workunit.client.0.smithi088.stdout:5/351: creat d2/d31/d33/d20/d30/d51/d5e/f6c x:0 0 0 2024-09-17T04:21:07.055 INFO:tasks.workunit.client.1.smithi134.stdout:5/843: rename d0/da/d2c/fbe to d0/da/d29/db5/f115 0 2024-09-17T04:21:07.058 INFO:tasks.workunit.client.1.smithi134.stdout:1/976: unlink d12/fa3 0 2024-09-17T04:21:07.059 INFO:tasks.workunit.client.1.smithi134.stdout:2/892: unlink d19/d27/d31/d34/fa4 0 2024-09-17T04:21:07.060 INFO:tasks.workunit.client.0.smithi088.stdout:2/379: dwrite d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/f67 [0,4194304] 0 2024-09-17T04:21:07.064 INFO:tasks.workunit.client.0.smithi088.stdout:6/467: mkdir d14/d44/d45/d6b/d29/dac 0 2024-09-17T04:21:07.065 INFO:tasks.workunit.client.1.smithi134.stdout:1/977: creat d12/d19/d1d/d3e/f149 x:0 0 0 2024-09-17T04:21:07.067 INFO:tasks.workunit.client.1.smithi134.stdout:7/774: creat d0/dd/d3a/ff0 x:0 0 0 2024-09-17T04:21:07.069 INFO:tasks.workunit.client.0.smithi088.stdout:2/380: dwrite d0/d1/d2d/f75 [0,4194304] 0 2024-09-17T04:21:07.071 INFO:tasks.workunit.client.1.smithi134.stdout:0/877: creat d11/d24/d49/d62/df7/dd8/de2/f12c x:0 0 0 2024-09-17T04:21:07.071 INFO:tasks.workunit.client.0.smithi088.stdout:2/381: stat d0/d1/d2d/d33/f38 0 2024-09-17T04:21:07.073 INFO:tasks.workunit.client.1.smithi134.stdout:1/978: dwrite d12/d1c/d2e/f3b [0,4194304] 0 2024-09-17T04:21:07.073 INFO:tasks.workunit.client.1.smithi134.stdout:0/878: write d11/d18/d97/df3/d43/d5d/fc5 [4215739,15095] 0 2024-09-17T04:21:07.073 INFO:tasks.workunit.client.0.smithi088.stdout:7/466: dwrite d2/d4/d7/f34 [4194304,4194304] 0 2024-09-17T04:21:07.075 INFO:tasks.workunit.client.0.smithi088.stdout:2/382: truncate d0/d1/d2d/d33/f6f 387219 0 2024-09-17T04:21:07.078 INFO:tasks.workunit.client.0.smithi088.stdout:1/450: mkdir d0/d1/d16/d2a/d9c 0 2024-09-17T04:21:07.079 INFO:tasks.workunit.client.1.smithi134.stdout:2/893: rename d19/d1c/d92/ddc/dc6/dbc/fcc to d19/d1c/d92/ddc/dc6/df0/f128 0 2024-09-17T04:21:07.079 INFO:tasks.workunit.client.1.smithi134.stdout:7/775: write d0/f33 [1591936,39045] 0 2024-09-17T04:21:07.080 INFO:tasks.workunit.client.1.smithi134.stdout:8/817: sync 2024-09-17T04:21:07.082 INFO:tasks.workunit.client.1.smithi134.stdout:5/844: link d0/da/d69/d41/d6d/f76 d0/da/d29/f116 0 2024-09-17T04:21:07.082 INFO:tasks.workunit.client.0.smithi088.stdout:8/424: mknod d7/d29/d2a/d75/c8a 0 2024-09-17T04:21:07.083 INFO:tasks.workunit.client.1.smithi134.stdout:1/979: creat d12/dcc/f14a x:0 0 0 2024-09-17T04:21:07.083 INFO:tasks.workunit.client.1.smithi134.stdout:8/818: write d4/db/dd/d72/f88 [349746,20406] 0 2024-09-17T04:21:07.083 INFO:tasks.workunit.client.1.smithi134.stdout:5/845: stat d0/da/d29/l6e 0 2024-09-17T04:21:07.084 INFO:tasks.workunit.client.0.smithi088.stdout:8/425: chown d7/d29/d2a/l64 458812960 1 2024-09-17T04:21:07.085 INFO:tasks.workunit.client.1.smithi134.stdout:1/980: chown d12/d19/d5d/d91/dac/dd5/def/df1/f123 2788 1 2024-09-17T04:21:07.085 INFO:tasks.workunit.client.1.smithi134.stdout:2/894: mknod d19/d27/d31/d34/df2/d6f/d84/d98/dc2/c129 0 2024-09-17T04:21:07.093 INFO:tasks.workunit.client.1.smithi134.stdout:8/819: truncate d4/f57 644670 0 2024-09-17T04:21:07.094 INFO:tasks.workunit.client.1.smithi134.stdout:4/924: write d0/f5 [5198351,59526] 0 2024-09-17T04:21:07.094 INFO:tasks.workunit.client.0.smithi088.stdout:6/468: fdatasync d14/f24 0 2024-09-17T04:21:07.095 INFO:tasks.workunit.client.1.smithi134.stdout:8/820: chown d4/db/dd/d72/fd5 2134022471 1 2024-09-17T04:21:07.095 INFO:tasks.workunit.client.1.smithi134.stdout:8/821: fdatasync d4/db/dd/d43/da5/fc1 0 2024-09-17T04:21:07.098 INFO:tasks.workunit.client.0.smithi088.stdout:4/412: write d5/f28 [694716,81458] 0 2024-09-17T04:21:07.099 INFO:tasks.workunit.client.0.smithi088.stdout:2/383: mknod d0/d1/d2d/d77/c79 0 2024-09-17T04:21:07.103 INFO:tasks.workunit.client.0.smithi088.stdout:6/469: dwrite d14/d3a/d41/f60 [0,4194304] 0 2024-09-17T04:21:07.105 INFO:tasks.workunit.client.0.smithi088.stdout:8/426: creat d7/d7f/f8b x:0 0 0 2024-09-17T04:21:07.106 INFO:tasks.workunit.client.0.smithi088.stdout:2/384: chown d0/d1/d2d/d33/d4b/d24/d3b/d26/c5a 61981634 1 2024-09-17T04:21:07.107 INFO:tasks.workunit.client.0.smithi088.stdout:4/413: truncate d5/d3d/d73/d7e/d5e/f6a 686149 0 2024-09-17T04:21:07.108 INFO:tasks.workunit.client.0.smithi088.stdout:2/385: chown d0/d18 0 1 2024-09-17T04:21:07.109 INFO:tasks.workunit.client.0.smithi088.stdout:4/414: write d5/f2d [2847167,90151] 0 2024-09-17T04:21:07.112 INFO:tasks.workunit.client.0.smithi088.stdout:6/470: write d14/d2f/f36 [1275754,54908] 0 2024-09-17T04:21:07.112 INFO:tasks.workunit.client.1.smithi134.stdout:7/776: link d0/dd/ce5 d0/dd/db9/ded/cf1 0 2024-09-17T04:21:07.114 INFO:tasks.workunit.client.0.smithi088.stdout:1/451: link d0/d13/d84/d5d/l75 d0/d1/df/d20/l9d 0 2024-09-17T04:21:07.117 INFO:tasks.workunit.client.0.smithi088.stdout:3/447: dread d0/d13/d1b/d29/f3b [0,4194304] 0 2024-09-17T04:21:07.118 INFO:tasks.workunit.client.1.smithi134.stdout:1/981: dread d12/d19/d1d/f44 [0,4194304] 0 2024-09-17T04:21:07.119 INFO:tasks.workunit.client.0.smithi088.stdout:2/386: fdatasync d0/d1/d2d/d33/d4b/d24/f51 0 2024-09-17T04:21:07.119 INFO:tasks.workunit.client.0.smithi088.stdout:8/427: dread d7/dd/d31/f76 [0,4194304] 0 2024-09-17T04:21:07.121 INFO:tasks.workunit.client.0.smithi088.stdout:8/428: readlink d7/d29/l50 0 2024-09-17T04:21:07.122 INFO:tasks.workunit.client.0.smithi088.stdout:7/467: dread d2/d4/d7/d46/f4e [0,4194304] 0 2024-09-17T04:21:07.122 INFO:tasks.workunit.client.0.smithi088.stdout:4/415: stat d5/d3f/l54 0 2024-09-17T04:21:07.124 INFO:tasks.workunit.client.1.smithi134.stdout:4/925: rename d0/df/d17/d9c to d0/d13/d40/d12c 0 2024-09-17T04:21:07.125 INFO:tasks.workunit.client.1.smithi134.stdout:4/926: write d0/df/d35/d5c/d8b/fc4 [930409,115704] 0 2024-09-17T04:21:07.125 INFO:tasks.workunit.client.0.smithi088.stdout:9/473: dwrite d2/dd/d11/d30/f62 [0,4194304] 0 2024-09-17T04:21:07.127 INFO:tasks.workunit.client.0.smithi088.stdout:9/474: chown d2/dd/d14/d8b/d43/d51/f71 94 1 2024-09-17T04:21:07.129 INFO:tasks.workunit.client.0.smithi088.stdout:1/452: unlink d0/d1/f8c 0 2024-09-17T04:21:07.129 INFO:tasks.workunit.client.0.smithi088.stdout:3/448: creat d0/d13/d1b/d29/d30/d3c/d5c/f8e x:0 0 0 2024-09-17T04:21:07.130 INFO:tasks.workunit.client.0.smithi088.stdout:0/269: truncate db/f25 1428987 0 2024-09-17T04:21:07.131 INFO:tasks.workunit.client.0.smithi088.stdout:3/449: dread - d0/d54/d55/f69 zero size 2024-09-17T04:21:07.131 INFO:tasks.workunit.client.0.smithi088.stdout:1/453: truncate d0/d1/d16/d77/f99 199032 0 2024-09-17T04:21:07.133 INFO:tasks.workunit.client.0.smithi088.stdout:5/352: write d2/d31/d33/f54 [608172,54007] 0 2024-09-17T04:21:07.134 INFO:tasks.workunit.client.0.smithi088.stdout:0/270: write db/d1b/d36/d47/f30 [3147659,31813] 0 2024-09-17T04:21:07.135 INFO:tasks.workunit.client.1.smithi134.stdout:1/982: mkdir d12/d19/d14b 0 2024-09-17T04:21:07.137 INFO:tasks.workunit.client.0.smithi088.stdout:2/387: creat d0/d1/d2d/d33/d4b/d24/f7a x:0 0 0 2024-09-17T04:21:07.138 INFO:tasks.workunit.client.1.smithi134.stdout:4/927: creat d0/d13/d40/d42/d92/d65/dff/f12d x:0 0 0 2024-09-17T04:21:07.138 INFO:tasks.workunit.client.1.smithi134.stdout:5/846: fsync d0/da/d69/d41/d6d/f76 0 2024-09-17T04:21:07.140 INFO:tasks.workunit.client.1.smithi134.stdout:1/983: dread d12/d19/d1d/d5f/d133/f141 [0,4194304] 0 2024-09-17T04:21:07.141 INFO:tasks.workunit.client.1.smithi134.stdout:1/984: fsync d12/d1c/d2e/f3b 0 2024-09-17T04:21:07.141 INFO:tasks.workunit.client.0.smithi088.stdout:4/416: rmdir d5/d3d/d73/d7e/d5e/d83 39 2024-09-17T04:21:07.142 INFO:tasks.workunit.client.0.smithi088.stdout:2/388: dread d0/d1/d2d/f3a [0,4194304] 0 2024-09-17T04:21:07.145 INFO:tasks.workunit.client.1.smithi134.stdout:0/879: dwrite d11/d18/f9f [0,4194304] 0 2024-09-17T04:21:07.146 INFO:tasks.workunit.client.1.smithi134.stdout:7/777: getdents d0/d16/d8b/d6a/d70/d85 0 2024-09-17T04:21:07.148 INFO:tasks.workunit.client.1.smithi134.stdout:0/880: write d11/d24/d49/d62/daf/ded/fee [563518,129430] 0 2024-09-17T04:21:07.148 INFO:tasks.workunit.client.0.smithi088.stdout:8/429: mknod d7/d29/d2a/c8c 0 2024-09-17T04:21:07.149 INFO:tasks.workunit.client.0.smithi088.stdout:2/389: dwrite d0/d1/d2d/d33/f6f [0,4194304] 0 2024-09-17T04:21:07.149 INFO:tasks.workunit.client.1.smithi134.stdout:2/895: write d19/d27/d31/d34/d42/f54 [5221211,105195] 0 2024-09-17T04:21:07.151 INFO:tasks.workunit.client.0.smithi088.stdout:1/454: mkdir d0/d1/d16/d77/d9e 0 2024-09-17T04:21:07.153 INFO:tasks.workunit.client.1.smithi134.stdout:5/847: rename d0/f79 to d0/da/d2c/d73/d8a/f117 0 2024-09-17T04:21:07.155 INFO:tasks.workunit.client.0.smithi088.stdout:5/353: dread - d2/d31/d33/d20/d47/f48 zero size 2024-09-17T04:21:07.159 INFO:tasks.workunit.client.0.smithi088.stdout:3/450: truncate d0/d13/f22 2163880 0 2024-09-17T04:21:07.160 INFO:tasks.workunit.client.0.smithi088.stdout:5/354: dread d2/d31/d33/d20/f23 [4194304,4194304] 0 2024-09-17T04:21:07.163 INFO:tasks.workunit.client.1.smithi134.stdout:8/822: dwrite d4/d11/f90 [0,4194304] 0 2024-09-17T04:21:07.163 INFO:tasks.workunit.client.1.smithi134.stdout:8/823: write d4/fcf [925863,43128] 0 2024-09-17T04:21:07.168 INFO:tasks.workunit.client.1.smithi134.stdout:8/824: dread d4/d1f/f97 [0,4194304] 0 2024-09-17T04:21:07.173 INFO:tasks.workunit.client.1.smithi134.stdout:8/825: dwrite d4/d11/da1/dc7/fe9 [0,4194304] 0 2024-09-17T04:21:07.174 INFO:tasks.workunit.client.1.smithi134.stdout:8/826: dread - d4/d1f/d2b/dbf/ddd/ff1 zero size 2024-09-17T04:21:07.175 INFO:tasks.workunit.client.1.smithi134.stdout:8/827: chown d4/d1f/d25/d6a/cf7 515532988 1 2024-09-17T04:21:07.183 INFO:tasks.workunit.client.0.smithi088.stdout:2/390: rename d0/d1/d2d/d33/d4b/d24/d3b/c37 to d0/d1/d2d/d33/d4b/c7b 0 2024-09-17T04:21:07.184 INFO:tasks.workunit.client.0.smithi088.stdout:6/471: dwrite d14/f32 [4194304,4194304] 0 2024-09-17T04:21:07.185 INFO:tasks.workunit.client.1.smithi134.stdout:2/896: mkdir d19/d27/d31/d34/df2/d6f/da9/db0/dca/d12a 0 2024-09-17T04:21:07.186 INFO:tasks.workunit.client.0.smithi088.stdout:1/455: creat d0/d1/df/d63/f9f x:0 0 0 2024-09-17T04:21:07.187 INFO:tasks.workunit.client.0.smithi088.stdout:1/456: dread - d0/d1/d16/d2a/f9b zero size 2024-09-17T04:21:07.187 INFO:tasks.workunit.client.1.smithi134.stdout:5/848: mkdir d0/d3a/d2b/d61/d7b/d118 0 2024-09-17T04:21:07.188 INFO:tasks.workunit.client.0.smithi088.stdout:1/457: write d0/d1/fe [1413978,126283] 0 2024-09-17T04:21:07.190 INFO:tasks.workunit.client.1.smithi134.stdout:1/985: mkdir d12/d1c/d100/d11b/d122/d136/d14c 0 2024-09-17T04:21:07.192 INFO:tasks.workunit.client.0.smithi088.stdout:3/451: fsync d0/d13/d1b/f27 0 2024-09-17T04:21:07.194 INFO:tasks.workunit.client.0.smithi088.stdout:5/355: symlink d2/d31/d33/d20/d30/d51/l6d 0 2024-09-17T04:21:07.195 INFO:tasks.workunit.client.1.smithi134.stdout:1/986: dread d12/d1c/d2e/f3b [0,4194304] 0 2024-09-17T04:21:07.199 INFO:tasks.workunit.client.1.smithi134.stdout:4/928: truncate d0/df/fd8 3880366 0 2024-09-17T04:21:07.201 INFO:tasks.workunit.client.0.smithi088.stdout:6/472: mkdir d14/d44/dad 0 2024-09-17T04:21:07.202 INFO:tasks.workunit.client.0.smithi088.stdout:6/473: stat d14/d44/d45/d6b/d2a/d52/d7a/f83 0 2024-09-17T04:21:07.203 INFO:tasks.workunit.client.0.smithi088.stdout:6/474: stat d14/d44/d45/d6b/d16/d42 0 2024-09-17T04:21:07.203 INFO:tasks.workunit.client.0.smithi088.stdout:2/391: mkdir d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/d7c 0 2024-09-17T04:21:07.205 INFO:tasks.workunit.client.1.smithi134.stdout:8/828: dwrite d4/d11/da1/dc7/d13/f61 [0,4194304] 0 2024-09-17T04:21:07.210 INFO:tasks.workunit.client.1.smithi134.stdout:2/897: unlink d19/d27/d31/d34/df2/d63/f8f 0 2024-09-17T04:21:07.210 INFO:tasks.workunit.client.0.smithi088.stdout:6/475: dwrite d14/d3a/fa8 [0,4194304] 0 2024-09-17T04:21:07.211 INFO:tasks.workunit.client.1.smithi134.stdout:2/898: write d19/d27/d31/d34/df2/d63/d94/f11b [175537,13999] 0 2024-09-17T04:21:07.212 INFO:tasks.workunit.client.0.smithi088.stdout:1/458: creat d0/d1/df/d63/fa0 x:0 0 0 2024-09-17T04:21:07.215 INFO:tasks.workunit.client.0.smithi088.stdout:6/476: chown d14/d44/d45/d4d/d97/fa1 68 1 2024-09-17T04:21:07.217 INFO:tasks.workunit.client.0.smithi088.stdout:3/452: symlink d0/d13/d1b/d29/d2b/d50/l8f 0 2024-09-17T04:21:07.218 INFO:tasks.workunit.client.0.smithi088.stdout:6/477: dread d14/d44/d45/d6b/d2a/f49 [0,4194304] 0 2024-09-17T04:21:07.219 INFO:tasks.workunit.client.0.smithi088.stdout:3/453: readlink d0/d13/d1b/d29/l2e 0 2024-09-17T04:21:07.221 INFO:tasks.workunit.client.0.smithi088.stdout:5/356: stat d2/l2b 0 2024-09-17T04:21:07.222 INFO:tasks.workunit.client.1.smithi134.stdout:4/929: symlink d0/df/d1e/dbc/l12e 0 2024-09-17T04:21:07.223 INFO:tasks.workunit.client.1.smithi134.stdout:4/930: chown d0/l7 6800 1 2024-09-17T04:21:07.223 INFO:tasks.workunit.client.0.smithi088.stdout:1/459: dwrite d0/d13/d84/d5d/f78 [0,4194304] 0 2024-09-17T04:21:07.224 INFO:tasks.workunit.client.1.smithi134.stdout:0/881: truncate d11/f70 3118572 0 2024-09-17T04:21:07.225 INFO:tasks.workunit.client.1.smithi134.stdout:0/882: write d11/d18/f36 [3846148,61453] 0 2024-09-17T04:21:07.226 INFO:tasks.workunit.client.0.smithi088.stdout:4/417: creat d5/d3d/d73/d7e/f8a x:0 0 0 2024-09-17T04:21:07.229 INFO:tasks.workunit.client.0.smithi088.stdout:8/430: creat d7/dd/d6f/f8d x:0 0 0 2024-09-17T04:21:07.231 INFO:tasks.workunit.client.1.smithi134.stdout:8/829: rename d4/d11/l7f to d4/db/dd/d43/l100 0 2024-09-17T04:21:07.231 INFO:tasks.workunit.client.0.smithi088.stdout:2/392: stat d0/d18/c5c 0 2024-09-17T04:21:07.306 INFO:tasks.workunit.client.0.smithi088.stdout:0/271: getdents db/d1b/d36 0 2024-09-17T04:21:07.307 INFO:tasks.workunit.client.1.smithi134.stdout:2/899: rmdir d19/d27/d31/d34/df2/d6f/d84/d98/dc2 39 2024-09-17T04:21:07.308 INFO:tasks.workunit.client.0.smithi088.stdout:0/272: truncate db/d1b/d36/d47/d37/f49 4876571 0 2024-09-17T04:21:07.308 INFO:tasks.workunit.client.1.smithi134.stdout:5/849: write d0/da/d69/d41/d6d/f76 [3761488,7129] 0 2024-09-17T04:21:07.308 INFO:tasks.workunit.client.0.smithi088.stdout:0/273: chown db/lf 159754 1 2024-09-17T04:21:07.309 INFO:tasks.workunit.client.1.smithi134.stdout:2/900: chown d19/d1c/d47/d50/f95 19 1 2024-09-17T04:21:07.310 INFO:tasks.workunit.client.1.smithi134.stdout:1/987: fsync d12/d19/d1d/f9f 0 2024-09-17T04:21:07.312 INFO:tasks.workunit.client.1.smithi134.stdout:4/931: symlink d0/d13/d40/d42/d92/dc3/l12f 0 2024-09-17T04:21:07.313 INFO:tasks.workunit.client.1.smithi134.stdout:4/932: truncate d0/ff5 563984 0 2024-09-17T04:21:07.317 INFO:tasks.workunit.client.1.smithi134.stdout:7/778: link d0/d16/d35/d4b/d65/l66 d0/d16/d35/lf2 0 2024-09-17T04:21:07.318 INFO:tasks.workunit.client.0.smithi088.stdout:3/454: rmdir d0/d13/d58/d5e 39 2024-09-17T04:21:07.319 INFO:tasks.workunit.client.1.smithi134.stdout:8/830: creat d4/d1f/d2b/dbf/ddd/f101 x:0 0 0 2024-09-17T04:21:07.321 INFO:tasks.workunit.client.1.smithi134.stdout:5/850: unlink d0/da/d29/d78/c95 0 2024-09-17T04:21:07.322 INFO:tasks.workunit.client.1.smithi134.stdout:2/901: rename d19/d1c/d47/dae/lbb to d19/d27/d31/d34/df2/d6f/da9/l12b 0 2024-09-17T04:21:07.324 INFO:tasks.workunit.client.0.smithi088.stdout:4/418: rename d5/d65 to d5/d3f/d71/d8b 0 2024-09-17T04:21:07.326 INFO:tasks.workunit.client.0.smithi088.stdout:2/393: mknod d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/c7d 0 2024-09-17T04:21:07.329 INFO:tasks.workunit.client.1.smithi134.stdout:0/883: truncate d11/d18/d97/df3/d43/d5d/f78 1634057 0 2024-09-17T04:21:07.329 INFO:tasks.workunit.client.0.smithi088.stdout:6/478: symlink d14/d44/d45/d6b/da7/lae 0 2024-09-17T04:21:07.331 INFO:tasks.workunit.client.1.smithi134.stdout:8/831: dread d4/db/f2d [0,4194304] 0 2024-09-17T04:21:07.331 INFO:tasks.workunit.client.1.smithi134.stdout:7/779: fsync d0/dd/d3a/d3d/f78 0 2024-09-17T04:21:07.331 INFO:tasks.workunit.client.0.smithi088.stdout:6/479: chown d14/d3a/l99 773 1 2024-09-17T04:21:07.331 INFO:tasks.workunit.client.0.smithi088.stdout:6/480: readlink d14/d3a/l99 0 2024-09-17T04:21:07.332 INFO:tasks.workunit.client.1.smithi134.stdout:8/832: write d4/db/dd/d95/f99 [1901107,117204] 0 2024-09-17T04:21:07.332 INFO:tasks.workunit.client.0.smithi088.stdout:5/357: mknod d2/d31/d33/d20/d25/d2c/d3d/c6e 0 2024-09-17T04:21:07.336 INFO:tasks.workunit.client.0.smithi088.stdout:4/419: creat d5/d32/d6b/f8c x:0 0 0 2024-09-17T04:21:07.341 INFO:tasks.workunit.client.1.smithi134.stdout:1/988: link d12/d19/d5d/d88/fbf d12/d1c/d13a/f14d 0 2024-09-17T04:21:07.346 INFO:tasks.workunit.client.1.smithi134.stdout:0/884: truncate d11/d19/d21/d37/f4b 3757216 0 2024-09-17T04:21:07.347 INFO:tasks.workunit.client.1.smithi134.stdout:4/933: dwrite d0/d3b/f5b [0,4194304] 0 2024-09-17T04:21:07.347 INFO:tasks.workunit.client.1.smithi134.stdout:1/989: dwrite d12/d19/d66/d148/f12e [0,4194304] 0 2024-09-17T04:21:07.348 INFO:tasks.workunit.client.0.smithi088.stdout:4/420: dread d5/d3f/f41 [0,4194304] 0 2024-09-17T04:21:07.348 INFO:tasks.workunit.client.0.smithi088.stdout:4/421: readlink d5/l6 0 2024-09-17T04:21:07.349 INFO:tasks.workunit.client.0.smithi088.stdout:4/422: write d5/f2a [2767682,14631] 0 2024-09-17T04:21:07.349 INFO:tasks.workunit.client.1.smithi134.stdout:0/885: chown d11/d24/d49/d62/daf/ded/fee 1011 1 2024-09-17T04:21:07.349 INFO:tasks.workunit.client.0.smithi088.stdout:1/460: rmdir d0/d1/d16/d35/d52 0 2024-09-17T04:21:07.350 INFO:tasks.workunit.client.0.smithi088.stdout:1/461: stat d0/d1/d16/d56 0 2024-09-17T04:21:07.351 INFO:tasks.workunit.client.1.smithi134.stdout:8/833: rmdir d4/db/dd/da2 39 2024-09-17T04:21:07.351 INFO:tasks.workunit.client.0.smithi088.stdout:1/462: fdatasync d0/d1/d16/f3c 0 2024-09-17T04:21:07.355 INFO:tasks.workunit.client.0.smithi088.stdout:8/431: link d7/dd/d62/c73 d7/d29/c8e 0 2024-09-17T04:21:07.356 INFO:tasks.workunit.client.1.smithi134.stdout:8/834: dwrite d4/fcf [0,4194304] 0 2024-09-17T04:21:07.358 INFO:tasks.workunit.client.1.smithi134.stdout:5/851: symlink d0/da/l119 0 2024-09-17T04:21:07.360 INFO:tasks.workunit.client.0.smithi088.stdout:0/274: rmdir db/d1b/d36/d4a/d20/d4e 0 2024-09-17T04:21:07.363 INFO:tasks.workunit.client.1.smithi134.stdout:2/902: creat d19/d1c/d92/ddc/dc6/dbc/d107/d125/f12c x:0 0 0 2024-09-17T04:21:07.366 INFO:tasks.workunit.client.0.smithi088.stdout:3/455: dwrite d0/d13/f22 [0,4194304] 0 2024-09-17T04:21:07.366 INFO:tasks.workunit.client.0.smithi088.stdout:6/481: mknod d14/d44/d45/d6b/d2a/caf 0 2024-09-17T04:21:07.368 INFO:tasks.workunit.client.0.smithi088.stdout:6/482: write d14/d2f/fa0 [316367,46079] 0 2024-09-17T04:21:07.369 INFO:tasks.workunit.client.1.smithi134.stdout:1/990: write d12/d19/d1d/d61/da0/f13b [640413,113727] 0 2024-09-17T04:21:07.372 INFO:tasks.workunit.client.0.smithi088.stdout:8/432: mknod d7/dd/d31/c8f 0 2024-09-17T04:21:07.373 INFO:tasks.workunit.client.0.smithi088.stdout:8/433: dread - d7/d29/d2a/d75/f7a zero size 2024-09-17T04:21:07.373 INFO:tasks.workunit.client.0.smithi088.stdout:0/275: dread - db/d1b/d39/f3d zero size 2024-09-17T04:21:07.373 INFO:tasks.workunit.client.0.smithi088.stdout:8/434: dread - d7/f87 zero size 2024-09-17T04:21:07.374 INFO:tasks.workunit.client.1.smithi134.stdout:5/852: fsync d0/da/d29/d8e/faa 0 2024-09-17T04:21:07.374 INFO:tasks.workunit.client.0.smithi088.stdout:8/435: fdatasync d7/f87 0 2024-09-17T04:21:07.375 INFO:tasks.workunit.client.1.smithi134.stdout:7/780: creat d0/d16/d35/ff3 x:0 0 0 2024-09-17T04:21:07.376 INFO:tasks.workunit.client.0.smithi088.stdout:5/358: rename d2/d31/d33/d20/f62 to d2/d31/d33/f6f 0 2024-09-17T04:21:07.378 INFO:tasks.workunit.client.1.smithi134.stdout:1/991: rmdir d12 39 2024-09-17T04:21:07.379 INFO:tasks.workunit.client.0.smithi088.stdout:5/359: read d2/d31/d33/f1f [4046120,14691] 0 2024-09-17T04:21:07.379 INFO:tasks.workunit.client.0.smithi088.stdout:6/483: dread - d14/d63/f82 zero size 2024-09-17T04:21:07.381 INFO:tasks.workunit.client.0.smithi088.stdout:6/484: dread - d14/d44/d45/d6b/d2a/fa6 zero size 2024-09-17T04:21:07.382 INFO:tasks.workunit.client.0.smithi088.stdout:6/485: readlink d14/d44/d45/d6b/d16/d42/d92/l9e 0 2024-09-17T04:21:07.382 INFO:tasks.workunit.client.0.smithi088.stdout:6/486: readlink d14/d44/d45/d6b/d2a/l79 0 2024-09-17T04:21:07.383 INFO:tasks.workunit.client.0.smithi088.stdout:1/463: symlink d0/la1 0 2024-09-17T04:21:07.384 INFO:tasks.workunit.client.1.smithi134.stdout:5/853: read d0/da/d29/d78/fd4 [816076,117087] 0 2024-09-17T04:21:07.385 INFO:tasks.workunit.client.1.smithi134.stdout:2/903: dread d19/d27/d31/d34/f82 [0,4194304] 0 2024-09-17T04:21:07.385 INFO:tasks.workunit.client.0.smithi088.stdout:0/276: creat db/d1b/d36/d47/d37/f56 x:0 0 0 2024-09-17T04:21:07.386 INFO:tasks.workunit.client.0.smithi088.stdout:0/277: write db/d1b/d36/d47/f30 [4613121,67554] 0 2024-09-17T04:21:07.386 INFO:tasks.workunit.client.1.smithi134.stdout:7/781: unlink d0/fa6 0 2024-09-17T04:21:07.388 INFO:tasks.workunit.client.0.smithi088.stdout:8/436: rmdir d7/dd/d31/d47/d55 39 2024-09-17T04:21:07.390 INFO:tasks.workunit.client.0.smithi088.stdout:3/456: write d0/d13/d1b/d29/d30/d35/f3d [2085518,65816] 0 2024-09-17T04:21:07.390 INFO:tasks.workunit.client.0.smithi088.stdout:5/360: dread - d2/d31/d33/d20/f55 zero size 2024-09-17T04:21:07.392 INFO:tasks.workunit.client.1.smithi134.stdout:7/782: dwrite d0/dd/d3a/d3d/d38/d74/f7f [0,4194304] 0 2024-09-17T04:21:07.393 INFO:tasks.workunit.client.1.smithi134.stdout:2/904: creat d19/d27/d31/d34/df2/d6f/da9/db0/dca/f12d x:0 0 0 2024-09-17T04:21:07.393 INFO:tasks.workunit.client.1.smithi134.stdout:2/905: readlink l15 0 2024-09-17T04:21:07.396 INFO:tasks.workunit.client.1.smithi134.stdout:1/992: creat d12/db2/d11c/f14e x:0 0 0 2024-09-17T04:21:07.396 INFO:tasks.workunit.client.0.smithi088.stdout:8/437: mknod d7/d29/d2a/d38/d42/c90 0 2024-09-17T04:21:07.398 INFO:tasks.workunit.client.1.smithi134.stdout:5/854: creat d0/d3a/d2b/df2/f11a x:0 0 0 2024-09-17T04:21:07.398 INFO:tasks.workunit.client.1.smithi134.stdout:7/783: mkdir d0/dd/d3a/d3d/d4c/df4 0 2024-09-17T04:21:07.399 INFO:tasks.workunit.client.1.smithi134.stdout:2/906: rmdir d19/d7e 39 2024-09-17T04:21:07.399 INFO:tasks.workunit.client.0.smithi088.stdout:3/457: stat d0/d13/d1b/d29/d2b/d40/l7a 0 2024-09-17T04:21:07.400 INFO:tasks.workunit.client.0.smithi088.stdout:5/361: rmdir d2/d31/d33/d20/d25/d49 39 2024-09-17T04:21:07.401 INFO:tasks.workunit.client.1.smithi134.stdout:5/855: chown d0/d3a/d2b/c32 1092936 1 2024-09-17T04:21:07.402 INFO:tasks.workunit.client.1.smithi134.stdout:2/907: creat d19/d1c/d92/f12e x:0 0 0 2024-09-17T04:21:07.403 INFO:tasks.workunit.client.1.smithi134.stdout:2/908: fsync d19/d27/d31/f6e 0 2024-09-17T04:21:07.406 INFO:tasks.workunit.client.0.smithi088.stdout:8/438: fdatasync d7/d29/d2a/f35 0 2024-09-17T04:21:07.407 INFO:tasks.workunit.client.1.smithi134.stdout:7/784: link d0/dd/fe d0/d16/d8b/d6a/d70/d85/ff5 0 2024-09-17T04:21:07.408 INFO:tasks.workunit.client.1.smithi134.stdout:1/993: rename d12/d1c/d56/f70 to d12/d1c/d2e/d7d/f14f 0 2024-09-17T04:21:07.409 INFO:tasks.workunit.client.1.smithi134.stdout:2/909: dwrite d19/d1c/d47/fcd [4194304,4194304] 0 2024-09-17T04:21:07.410 INFO:tasks.workunit.client.1.smithi134.stdout:2/910: chown d19/d1c/d92/ddc/dc6 2299965 1 2024-09-17T04:21:07.422 INFO:tasks.workunit.client.1.smithi134.stdout:4/934: truncate d0/d13/d40/d42/dc5/dcb/ff6 408136 0 2024-09-17T04:21:07.422 INFO:tasks.workunit.client.1.smithi134.stdout:2/911: dwrite d19/d1c/d92/f10c [4194304,4194304] 0 2024-09-17T04:21:07.422 INFO:tasks.workunit.client.0.smithi088.stdout:4/423: truncate d5/f2d 2679348 0 2024-09-17T04:21:07.424 INFO:tasks.workunit.client.1.smithi134.stdout:0/886: dwrite d11/d19/f87 [0,4194304] 0 2024-09-17T04:21:07.426 INFO:tasks.workunit.client.0.smithi088.stdout:3/458: mknod d0/d13/c90 0 2024-09-17T04:21:07.427 INFO:tasks.workunit.client.0.smithi088.stdout:3/459: chown d0/d13/d1b/f27 48 1 2024-09-17T04:21:07.428 INFO:tasks.workunit.client.0.smithi088.stdout:4/424: dwrite d5/d3d/f42 [0,4194304] 0 2024-09-17T04:21:07.429 INFO:tasks.workunit.client.0.smithi088.stdout:5/362: mknod d2/d31/d33/c70 0 2024-09-17T04:21:07.431 INFO:tasks.workunit.client.1.smithi134.stdout:0/887: creat d11/d18/d97/df3/f12d x:0 0 0 2024-09-17T04:21:07.432 INFO:tasks.workunit.client.0.smithi088.stdout:8/439: mknod d7/d29/d2a/d38/c91 0 2024-09-17T04:21:07.433 INFO:tasks.workunit.client.1.smithi134.stdout:0/888: chown d11/d24/d49/d62/daf/ded/fee 0 1 2024-09-17T04:21:07.434 INFO:tasks.workunit.client.1.smithi134.stdout:0/889: dread - d11/d24/d49/d62/df7/dd8/de2/f12c zero size 2024-09-17T04:21:07.435 INFO:tasks.workunit.client.0.smithi088.stdout:3/460: creat d0/d13/d1b/d29/d2b/d50/f91 x:0 0 0 2024-09-17T04:21:07.437 INFO:tasks.workunit.client.0.smithi088.stdout:5/363: creat d2/d31/d33/d20/d47/f71 x:0 0 0 2024-09-17T04:21:07.441 INFO:tasks.workunit.client.0.smithi088.stdout:3/461: write d0/d13/f22 [4375734,96229] 0 2024-09-17T04:21:07.445 INFO:tasks.workunit.client.1.smithi134.stdout:7/785: dread d0/d16/d8b/fc2 [0,4194304] 0 2024-09-17T04:21:07.446 INFO:tasks.workunit.client.0.smithi088.stdout:6/487: dwrite d14/d44/d45/d6b/d2a/d52/f9b [0,4194304] 0 2024-09-17T04:21:07.447 INFO:tasks.workunit.client.0.smithi088.stdout:1/464: dwrite d0/d13/d84/d5d/f65 [0,4194304] 0 2024-09-17T04:21:07.449 INFO:tasks.workunit.client.1.smithi134.stdout:7/786: mknod d0/d16/de3/cf6 0 2024-09-17T04:21:07.453 INFO:tasks.workunit.client.1.smithi134.stdout:7/787: unlink d0/dd/d3a/l9f 0 2024-09-17T04:21:07.456 INFO:tasks.workunit.client.0.smithi088.stdout:3/462: rename d0/d13/d58/d5a/d63/c6d to d0/d13/d1b/d29/d56/c92 0 2024-09-17T04:21:07.456 INFO:tasks.workunit.client.0.smithi088.stdout:8/440: dread d7/dd/f56 [0,4194304] 0 2024-09-17T04:21:07.457 INFO:tasks.workunit.client.0.smithi088.stdout:1/465: dwrite d0/d1/df/d63/fa0 [0,4194304] 0 2024-09-17T04:21:07.459 INFO:tasks.workunit.client.1.smithi134.stdout:7/788: rename d0/d16/d8b/fdb to d0/dd/d3a/d3d/d38/da9/ff7 0 2024-09-17T04:21:07.459 INFO:tasks.workunit.client.0.smithi088.stdout:3/463: rmdir d0/d13/d1b/d29/d56 39 2024-09-17T04:21:07.461 INFO:tasks.workunit.client.1.smithi134.stdout:7/789: truncate d0/d16/d35/fe4 576942 0 2024-09-17T04:21:07.462 INFO:tasks.workunit.client.0.smithi088.stdout:8/441: symlink d7/l92 0 2024-09-17T04:21:07.463 INFO:tasks.workunit.client.0.smithi088.stdout:1/466: write d0/d1/df/d63/f6f [532878,90875] 0 2024-09-17T04:21:07.465 INFO:tasks.workunit.client.0.smithi088.stdout:3/464: mkdir d0/d93 0 2024-09-17T04:21:07.467 INFO:tasks.workunit.client.1.smithi134.stdout:7/790: symlink d0/dd/lf8 0 2024-09-17T04:21:07.468 INFO:tasks.workunit.client.1.smithi134.stdout:7/791: readlink d0/d16/d35/d4b/l92 0 2024-09-17T04:21:07.468 INFO:tasks.workunit.client.0.smithi088.stdout:1/467: creat d0/d13/fa2 x:0 0 0 2024-09-17T04:21:07.469 INFO:tasks.workunit.client.0.smithi088.stdout:3/465: fdatasync d0/d13/d1b/d29/d2b/f3f 0 2024-09-17T04:21:07.471 INFO:tasks.workunit.client.1.smithi134.stdout:7/792: rename d0/f6 to d0/d16/d8b/d6a/d70/ff9 0 2024-09-17T04:21:07.473 INFO:tasks.workunit.client.0.smithi088.stdout:3/466: write d0/d13/d1b/d29/d30/d3c/d5c/f8e [729193,73633] 0 2024-09-17T04:21:07.473 INFO:tasks.workunit.client.0.smithi088.stdout:8/442: dwrite d7/d29/d2a/d38/f7d [0,4194304] 0 2024-09-17T04:21:07.474 INFO:tasks.workunit.client.0.smithi088.stdout:8/443: readlink d7/d29/d2a/l64 0 2024-09-17T04:21:07.475 INFO:tasks.workunit.client.1.smithi134.stdout:7/793: symlink d0/d16/de3/lfa 0 2024-09-17T04:21:07.476 INFO:tasks.workunit.client.0.smithi088.stdout:8/444: write d7/d29/d2a/f4a [2507942,73604] 0 2024-09-17T04:21:07.477 INFO:tasks.workunit.client.0.smithi088.stdout:3/467: creat d0/d13/d1b/d29/d30/d3c/f94 x:0 0 0 2024-09-17T04:21:07.479 INFO:tasks.workunit.client.1.smithi134.stdout:7/794: read d0/dd/d3a/f4f [1058918,69578] 0 2024-09-17T04:21:07.480 INFO:tasks.workunit.client.0.smithi088.stdout:3/468: creat d0/d13/d1b/f95 x:0 0 0 2024-09-17T04:21:07.485 INFO:tasks.workunit.client.0.smithi088.stdout:3/469: creat d0/d13/d1b/d29/d30/d3c/d5c/f96 x:0 0 0 2024-09-17T04:21:07.487 INFO:tasks.workunit.client.1.smithi134.stdout:7/795: rename d0/d16/d8b/d6a/d70/c87 to d0/d16/d35/d8d/cfb 0 2024-09-17T04:21:07.487 INFO:tasks.workunit.client.1.smithi134.stdout:7/796: chown d0/dd/fc4 221257159 1 2024-09-17T04:21:07.490 INFO:tasks.workunit.client.0.smithi088.stdout:8/445: rename d7/dd/fe to d7/dd/d31/d47/f93 0 2024-09-17T04:21:07.491 INFO:tasks.workunit.client.1.smithi134.stdout:5/856: write d0/da/d29/db5/f115 [1875122,98213] 0 2024-09-17T04:21:07.491 INFO:tasks.workunit.client.0.smithi088.stdout:3/470: creat d0/d13/d58/d5e/f97 x:0 0 0 2024-09-17T04:21:07.492 INFO:tasks.workunit.client.1.smithi134.stdout:5/857: read - d0/da/d29/f85 zero size 2024-09-17T04:21:07.493 INFO:tasks.workunit.client.1.smithi134.stdout:7/797: truncate d0/dd/db9/f9c 1757338 0 2024-09-17T04:21:07.494 INFO:tasks.workunit.client.1.smithi134.stdout:5/858: rmdir d0/d3a/d6b 39 2024-09-17T04:21:07.494 INFO:tasks.workunit.client.1.smithi134.stdout:5/859: chown d0/da/d29/d78/da5/df0 132850472 1 2024-09-17T04:21:07.495 INFO:tasks.workunit.client.1.smithi134.stdout:5/860: chown d0/d3a/d2b/d5a/df6 7 1 2024-09-17T04:21:07.496 INFO:tasks.workunit.client.0.smithi088.stdout:3/471: creat d0/d13/d1b/d29/d30/d3c/d5c/f98 x:0 0 0 2024-09-17T04:21:07.497 INFO:tasks.workunit.client.1.smithi134.stdout:7/798: creat d0/d16/d8b/d6a/ffc x:0 0 0 2024-09-17T04:21:07.498 INFO:tasks.workunit.client.0.smithi088.stdout:3/472: read - d0/d13/d1b/d29/d2b/d40/f43 zero size 2024-09-17T04:21:07.499 INFO:tasks.workunit.client.0.smithi088.stdout:3/473: dread - d0/d13/f6b zero size 2024-09-17T04:21:07.500 INFO:tasks.workunit.client.1.smithi134.stdout:5/861: mkdir d0/da/d69/d41/d6d/d89/d11b 0 2024-09-17T04:21:07.502 INFO:tasks.workunit.client.0.smithi088.stdout:3/474: creat d0/d13/f99 x:0 0 0 2024-09-17T04:21:07.503 INFO:tasks.workunit.client.1.smithi134.stdout:7/799: dwrite d0/dd/d3a/d3d/d38/d60/fca [0,4194304] 0 2024-09-17T04:21:07.504 INFO:tasks.workunit.client.1.smithi134.stdout:7/800: readlink d0/d16/d8b/l7d 0 2024-09-17T04:21:07.511 INFO:tasks.workunit.client.0.smithi088.stdout:3/475: dwrite d0/d13/f24 [0,4194304] 0 2024-09-17T04:21:07.511 INFO:tasks.workunit.client.1.smithi134.stdout:7/801: mkdir d0/d16/d35/dfd 0 2024-09-17T04:21:07.512 INFO:tasks.workunit.client.1.smithi134.stdout:4/935: write d0/df/d35/d5c/f81 [1384995,83632] 0 2024-09-17T04:21:07.517 INFO:tasks.workunit.client.1.smithi134.stdout:7/802: rename d0/d16/d35/f49 to d0/d16/de3/ffe 0 2024-09-17T04:21:07.519 INFO:tasks.workunit.client.1.smithi134.stdout:4/936: mkdir d0/d3b/d9f/d130 0 2024-09-17T04:21:07.520 INFO:tasks.workunit.client.0.smithi088.stdout:3/476: creat d0/d13/f9a x:0 0 0 2024-09-17T04:21:07.521 INFO:tasks.workunit.client.1.smithi134.stdout:7/803: write d0/dd/d3a/d3d/d38/d60/fdd [610167,100623] 0 2024-09-17T04:21:07.522 INFO:tasks.workunit.client.0.smithi088.stdout:3/477: write d0/d13/f22 [2626555,89442] 0 2024-09-17T04:21:07.522 INFO:tasks.workunit.client.1.smithi134.stdout:0/890: dwrite d11/d18/d97/df3/f12d [0,4194304] 0 2024-09-17T04:21:07.524 INFO:tasks.workunit.client.1.smithi134.stdout:4/937: read d0/df/f18 [3488523,70812] 0 2024-09-17T04:21:07.525 INFO:tasks.workunit.client.0.smithi088.stdout:4/425: dwrite d5/d3f/f39 [0,4194304] 0 2024-09-17T04:21:07.525 INFO:tasks.workunit.client.1.smithi134.stdout:7/804: chown d0/dd/fb 445308735 1 2024-09-17T04:21:07.525 INFO:tasks.workunit.client.1.smithi134.stdout:4/938: stat d0/df/d1e/d73/f127 0 2024-09-17T04:21:07.529 INFO:tasks.workunit.client.1.smithi134.stdout:0/891: mkdir d11/d4c/d12e 0 2024-09-17T04:21:07.529 INFO:tasks.workunit.client.0.smithi088.stdout:5/364: truncate d2/d31/d33/d20/d25/d49/f64 1465209 0 2024-09-17T04:21:07.531 INFO:tasks.workunit.client.0.smithi088.stdout:6/488: write d14/d44/d45/d6b/d2a/f5a [459991,123797] 0 2024-09-17T04:21:07.532 INFO:tasks.workunit.client.1.smithi134.stdout:7/805: fsync d0/dd/fc4 0 2024-09-17T04:21:07.533 INFO:tasks.workunit.client.0.smithi088.stdout:1/468: dread d0/d1/df/d20/f80 [0,4194304] 0 2024-09-17T04:21:07.534 INFO:tasks.workunit.client.0.smithi088.stdout:3/478: link d0/d13/d1b/d29/d30/d3c/f87 d0/d13/d58/d5e/f9b 0 2024-09-17T04:21:07.539 INFO:tasks.workunit.client.1.smithi134.stdout:0/892: rename d11/d6f/fb4 to d11/d6f/da8/f12f 0 2024-09-17T04:21:07.541 INFO:tasks.workunit.client.0.smithi088.stdout:5/365: unlink d2/d31/d33/f1b 0 2024-09-17T04:21:07.547 INFO:tasks.workunit.client.0.smithi088.stdout:5/366: truncate d2/d31/f67 1002561 0 2024-09-17T04:21:07.549 INFO:tasks.workunit.client.0.smithi088.stdout:6/489: rename d14/d44/d45/d6b/d2a/f50 to d14/d44/d45/d6b/d2a/d52/d90/fb0 0 2024-09-17T04:21:07.550 INFO:tasks.workunit.client.0.smithi088.stdout:6/490: stat d14/d44/d45/d6b/d2a/caf 0 2024-09-17T04:21:07.550 INFO:tasks.workunit.client.0.smithi088.stdout:1/469: mkdir d0/d1/df/d85/da3 0 2024-09-17T04:21:07.551 INFO:tasks.workunit.client.0.smithi088.stdout:1/470: chown d0/d1/d16/l46 8346067 1 2024-09-17T04:21:07.554 INFO:tasks.workunit.client.0.smithi088.stdout:3/479: rename d0/d13/d1b/f95 to d0/d13/d58/d5a/d63/d80/f9c 0 2024-09-17T04:21:07.558 INFO:tasks.workunit.client.0.smithi088.stdout:6/491: creat d14/d44/d45/d6b/d29/dac/fb1 x:0 0 0 2024-09-17T04:21:07.559 INFO:tasks.workunit.client.0.smithi088.stdout:3/480: fsync d0/d13/d1b/d29/d2b/f41 0 2024-09-17T04:21:07.561 INFO:tasks.workunit.client.0.smithi088.stdout:6/492: fsync d14/d44/d45/d6b/d16/f2e 0 2024-09-17T04:21:07.561 INFO:tasks.workunit.client.0.smithi088.stdout:5/367: dread d2/d31/d33/d20/d25/d2c/f50 [0,4194304] 0 2024-09-17T04:21:07.561 INFO:tasks.workunit.client.0.smithi088.stdout:3/481: dread d0/d13/d1b/d29/d30/d3c/f51 [0,4194304] 0 2024-09-17T04:21:07.581 INFO:tasks.workunit.client.1.smithi134.stdout:8/835: sync 2024-09-17T04:21:07.583 INFO:tasks.workunit.client.1.smithi134.stdout:1/994: sync 2024-09-17T04:21:07.583 INFO:tasks.workunit.client.1.smithi134.stdout:2/912: sync 2024-09-17T04:21:07.599 INFO:tasks.workunit.client.1.smithi134.stdout:1/995: dread d12/d1c/d13a/f14d [0,4194304] 0 2024-09-17T04:21:07.614 INFO:tasks.workunit.client.0.smithi088.stdout:3/482: dread d0/d13/f28 [0,4194304] 0 2024-09-17T04:21:07.620 INFO:tasks.workunit.client.0.smithi088.stdout:5/368: link d2/d31/f44 d2/d31/d33/d20/d25/d2c/f72 0 2024-09-17T04:21:07.627 INFO:tasks.workunit.client.1.smithi134.stdout:7/806: mkdir d0/d16/d35/d4b/dff 0 2024-09-17T04:21:07.627 INFO:tasks.workunit.client.0.smithi088.stdout:3/483: rename d0/d13/d1b/d29/d30/d3c/d5c/f8e to d0/f9d 0 2024-09-17T04:21:07.630 INFO:tasks.workunit.client.1.smithi134.stdout:5/862: dwrite d0/d3a/d2b/faf [0,4194304] 0 2024-09-17T04:21:07.631 INFO:tasks.workunit.client.0.smithi088.stdout:5/369: chown d2/d31/d33/d20/d25/f41 1356 1 2024-09-17T04:21:07.634 INFO:tasks.workunit.client.0.smithi088.stdout:8/446: dwrite d7/dd/d31/d47/d55/d57/f71 [0,4194304] 0 2024-09-17T04:21:07.634 INFO:tasks.workunit.client.1.smithi134.stdout:7/807: dwrite d0/f20 [0,4194304] 0 2024-09-17T04:21:07.644 INFO:tasks.workunit.client.0.smithi088.stdout:4/426: truncate d5/fb 3744270 0 2024-09-17T04:21:07.647 INFO:tasks.workunit.client.0.smithi088.stdout:5/370: symlink d2/d31/d33/d20/d47/l73 0 2024-09-17T04:21:07.650 INFO:tasks.workunit.client.0.smithi088.stdout:8/447: fdatasync d7/d29/f2e 0 2024-09-17T04:21:07.651 INFO:tasks.workunit.client.0.smithi088.stdout:3/484: fsync d0/d13/d1b/d29/d30/d35/f66 0 2024-09-17T04:21:07.653 INFO:tasks.workunit.client.0.smithi088.stdout:3/485: fsync d0/d13/d1b/f21 0 2024-09-17T04:21:07.655 INFO:tasks.workunit.client.1.smithi134.stdout:2/913: mknod d19/d1c/d47/d50/d10f/dc1/c12f 0 2024-09-17T04:21:07.660 INFO:tasks.workunit.client.1.smithi134.stdout:7/808: symlink d0/d16/d8b/d6a/d70/l100 0 2024-09-17T04:21:07.665 INFO:tasks.workunit.client.1.smithi134.stdout:2/914: creat d19/d1c/d47/f130 x:0 0 0 2024-09-17T04:21:07.665 INFO:tasks.workunit.client.0.smithi088.stdout:3/486: creat d0/d13/d1b/d29/d30/f9e x:0 0 0 2024-09-17T04:21:07.666 INFO:tasks.workunit.client.1.smithi134.stdout:7/809: symlink d0/d16/de3/l101 0 2024-09-17T04:21:07.668 INFO:tasks.workunit.client.1.smithi134.stdout:0/893: link d11/d18/d97/df3/d43/f94 d11/d22/f130 0 2024-09-17T04:21:07.671 INFO:tasks.workunit.client.0.smithi088.stdout:4/427: creat d5/d3d/d73/d7e/d5e/f8d x:0 0 0 2024-09-17T04:21:07.672 INFO:tasks.workunit.client.1.smithi134.stdout:7/810: fdatasync d0/d16/d35/d4b/f7c 0 2024-09-17T04:21:07.674 INFO:tasks.workunit.client.0.smithi088.stdout:3/487: dread d0/d13/d1b/d29/d30/f39 [0,4194304] 0 2024-09-17T04:21:07.674 INFO:tasks.workunit.client.0.smithi088.stdout:3/488: chown d0/d93 42610 1 2024-09-17T04:21:07.674 INFO:tasks.workunit.client.0.smithi088.stdout:4/428: truncate d5/d32/f67 645528 0 2024-09-17T04:21:07.676 INFO:tasks.workunit.client.1.smithi134.stdout:7/811: unlink d0/d16/d35/lf2 0 2024-09-17T04:21:07.680 INFO:tasks.workunit.client.0.smithi088.stdout:3/489: dwrite d0/d13/d4d/f7d [0,4194304] 0 2024-09-17T04:21:07.681 INFO:tasks.workunit.client.1.smithi134.stdout:2/915: dread d19/d27/d31/d34/df2/d6f/d84/f9e [0,4194304] 0 2024-09-17T04:21:07.681 INFO:tasks.workunit.client.0.smithi088.stdout:3/490: fsync d0/d13/d1b/d29/d30/d3c/f94 0 2024-09-17T04:21:07.683 INFO:tasks.workunit.client.1.smithi134.stdout:2/916: dread - d19/d27/d31/d34/df2/d6f/da9/db0/dca/d10a/f119 zero size 2024-09-17T04:21:07.683 INFO:tasks.workunit.client.0.smithi088.stdout:4/429: creat d5/d3f/d71/d8b/d75/f8e x:0 0 0 2024-09-17T04:21:07.686 INFO:tasks.workunit.client.0.smithi088.stdout:4/430: symlink d5/d3f/d71/d8b/d68/l8f 0 2024-09-17T04:21:07.687 INFO:tasks.workunit.client.0.smithi088.stdout:4/431: readlink d5/d3f/l54 0 2024-09-17T04:21:07.688 INFO:tasks.workunit.client.0.smithi088.stdout:3/491: creat d0/f9f x:0 0 0 2024-09-17T04:21:07.691 INFO:tasks.workunit.client.1.smithi134.stdout:4/939: truncate d0/f5 5087749 0 2024-09-17T04:21:07.692 INFO:tasks.workunit.client.1.smithi134.stdout:7/812: dread d0/d16/d8b/d6a/d70/d85/fa5 [0,4194304] 0 2024-09-17T04:21:07.692 INFO:tasks.workunit.client.1.smithi134.stdout:4/940: chown d0/df/d1e/d73 174 1 2024-09-17T04:21:07.694 INFO:tasks.workunit.client.0.smithi088.stdout:3/492: dwrite d0/d13/f22 [4194304,4194304] 0 2024-09-17T04:21:07.695 INFO:tasks.workunit.client.1.smithi134.stdout:7/813: truncate d0/d16/d8b/d6a/d70/d85/f9e 5213788 0 2024-09-17T04:21:07.695 INFO:tasks.workunit.client.0.smithi088.stdout:4/432: dread d5/d32/f44 [0,4194304] 0 2024-09-17T04:21:07.697 INFO:tasks.workunit.client.0.smithi088.stdout:3/493: read - d0/d13/d1b/d29/d30/f9e zero size 2024-09-17T04:21:07.697 INFO:tasks.workunit.client.1.smithi134.stdout:8/836: write d4/f36 [1208685,130208] 0 2024-09-17T04:21:07.699 INFO:tasks.workunit.client.0.smithi088.stdout:4/433: rmdir d5/d32/d6b 39 2024-09-17T04:21:07.699 INFO:tasks.workunit.client.1.smithi134.stdout:1/996: dwrite d12/f86 [0,4194304] 0 2024-09-17T04:21:07.704 INFO:tasks.workunit.client.0.smithi088.stdout:3/494: unlink d0/d13/d1b/d29/d30/d35/d65/c6e 0 2024-09-17T04:21:07.708 INFO:tasks.workunit.client.1.smithi134.stdout:5/863: dwrite d0/da/d29/f84 [0,4194304] 0 2024-09-17T04:21:07.708 INFO:tasks.workunit.client.0.smithi088.stdout:8/448: write d7/f51 [1816234,40751] 0 2024-09-17T04:21:07.709 INFO:tasks.workunit.client.1.smithi134.stdout:7/814: link d0/d16/d35/ff3 d0/d16/d35/d4b/d65/f102 0 2024-09-17T04:21:07.709 INFO:tasks.workunit.client.0.smithi088.stdout:8/449: stat d7/d29/d7e/f83 0 2024-09-17T04:21:07.711 INFO:tasks.workunit.client.1.smithi134.stdout:4/941: dread d0/d13/d40/d42/d92/f45 [0,4194304] 0 2024-09-17T04:21:07.712 INFO:tasks.workunit.client.1.smithi134.stdout:7/815: write d0/dd/d3a/d3d/f61 [157408,114071] 0 2024-09-17T04:21:07.714 INFO:tasks.workunit.client.0.smithi088.stdout:4/434: creat d5/d32/f90 x:0 0 0 2024-09-17T04:21:07.715 INFO:tasks.workunit.client.0.smithi088.stdout:4/435: write d5/f28 [916010,115775] 0 2024-09-17T04:21:07.715 INFO:tasks.workunit.client.1.smithi134.stdout:5/864: mknod d0/da/d29/d78/c11c 0 2024-09-17T04:21:07.716 INFO:tasks.workunit.client.1.smithi134.stdout:8/837: dwrite d4/d11/da1/dc7/d13/f73 [12582912,4194304] 0 2024-09-17T04:21:07.720 INFO:tasks.workunit.client.0.smithi088.stdout:8/450: fsync d7/f24 0 2024-09-17T04:21:07.722 INFO:tasks.workunit.client.1.smithi134.stdout:4/942: mkdir d0/d13/d123/d131 0 2024-09-17T04:21:07.724 INFO:tasks.workunit.client.1.smithi134.stdout:7/816: creat d0/d16/d35/d8d/dd0/f103 x:0 0 0 2024-09-17T04:21:07.724 INFO:tasks.workunit.client.1.smithi134.stdout:7/817: stat d0/d16/d35/fe4 0 2024-09-17T04:21:07.725 INFO:tasks.workunit.client.1.smithi134.stdout:5/865: symlink d0/da/d29/db5/l11d 0 2024-09-17T04:21:07.726 INFO:tasks.workunit.client.0.smithi088.stdout:4/436: creat d5/d3f/d71/f91 x:0 0 0 2024-09-17T04:21:07.728 INFO:tasks.workunit.client.1.smithi134.stdout:8/838: mknod d4/d11/da1/db3/c102 0 2024-09-17T04:21:07.731 INFO:tasks.workunit.client.1.smithi134.stdout:4/943: mknod d0/df/d1e/daa/c132 0 2024-09-17T04:21:07.731 INFO:tasks.workunit.client.0.smithi088.stdout:8/451: creat d7/d29/f94 x:0 0 0 2024-09-17T04:21:07.733 INFO:tasks.workunit.client.1.smithi134.stdout:7/818: chown d0/dd/db9/ded/cf1 2005989803 1 2024-09-17T04:21:07.733 INFO:tasks.workunit.client.1.smithi134.stdout:0/894: dwrite d11/d18/f9f [0,4194304] 0 2024-09-17T04:21:07.734 INFO:tasks.workunit.client.0.smithi088.stdout:4/437: dwrite d5/d72/f74 [0,4194304] 0 2024-09-17T04:21:07.735 INFO:tasks.workunit.client.0.smithi088.stdout:4/438: write d5/d3d/f80 [999208,73221] 0 2024-09-17T04:21:07.739 INFO:tasks.workunit.client.1.smithi134.stdout:4/944: rmdir d0 39 2024-09-17T04:21:07.741 INFO:tasks.workunit.client.0.smithi088.stdout:8/452: chown d7/c6c 8555136 1 2024-09-17T04:21:07.743 INFO:tasks.workunit.client.1.smithi134.stdout:5/866: unlink d0/da/d2c/fa7 0 2024-09-17T04:21:07.743 INFO:tasks.workunit.client.0.smithi088.stdout:4/439: mknod d5/d3d/d73/c92 0 2024-09-17T04:21:07.745 INFO:tasks.workunit.client.0.smithi088.stdout:4/440: dread d5/d3d/d73/d7e/d5e/f6a [0,4194304] 0 2024-09-17T04:21:07.747 INFO:tasks.workunit.client.1.smithi134.stdout:7/819: unlink d0/dd/d3a/d3d/le1 0 2024-09-17T04:21:07.749 INFO:tasks.workunit.client.1.smithi134.stdout:5/867: dwrite d0/da/d29/d78/da5/fb1 [0,4194304] 0 2024-09-17T04:21:07.750 INFO:tasks.workunit.client.1.smithi134.stdout:0/895: rename d11/d19/f87 to d11/d48/dd2/f131 0 2024-09-17T04:21:07.750 INFO:tasks.workunit.client.0.smithi088.stdout:5/371: link d2/d31/d33/f18 d2/d31/d33/d20/d30/d51/d5e/f74 0 2024-09-17T04:21:07.754 INFO:tasks.workunit.client.1.smithi134.stdout:8/839: link d4/d1e/daf/f84 d4/d1f/d25/d6a/f103 0 2024-09-17T04:21:07.756 INFO:tasks.workunit.client.1.smithi134.stdout:4/945: rename d0/df/d1e/daa to d0/df/d1e/daa/d133 22 2024-09-17T04:21:07.759 INFO:tasks.workunit.client.0.smithi088.stdout:3/495: dwrite d0/d13/d1b/f27 [0,4194304] 0 2024-09-17T04:21:07.761 INFO:tasks.workunit.client.0.smithi088.stdout:3/496: write d0/d13/d58/d5a/d63/f75 [1271394,47647] 0 2024-09-17T04:21:07.767 INFO:tasks.workunit.client.0.smithi088.stdout:4/441: symlink d5/d3f/d71/d8b/l93 0 2024-09-17T04:21:07.770 INFO:tasks.workunit.client.1.smithi134.stdout:8/840: rmdir d4/db/dd/d43/d8b/d8e 39 2024-09-17T04:21:07.771 INFO:tasks.workunit.client.0.smithi088.stdout:4/442: dread d5/d3d/f42 [0,4194304] 0 2024-09-17T04:21:07.772 INFO:tasks.workunit.client.1.smithi134.stdout:4/946: creat d0/d13/d40/d42/d92/d86/f134 x:0 0 0 2024-09-17T04:21:07.774 INFO:tasks.workunit.client.1.smithi134.stdout:0/896: dwrite d11/d18/d97/df3/fef [0,4194304] 0 2024-09-17T04:21:07.775 INFO:tasks.workunit.client.1.smithi134.stdout:0/897: chown d11/d19/d21/d37/f8b 780499744 1 2024-09-17T04:21:07.777 INFO:tasks.workunit.client.0.smithi088.stdout:8/453: write d7/d29/f2e [1027091,76276] 0 2024-09-17T04:21:07.777 INFO:tasks.workunit.client.0.smithi088.stdout:4/443: rmdir d5/d3d/d73 39 2024-09-17T04:21:07.779 INFO:tasks.workunit.client.0.smithi088.stdout:3/497: dwrite d0/d13/d1b/d29/d56/f64 [0,4194304] 0 2024-09-17T04:21:07.781 INFO:tasks.workunit.client.0.smithi088.stdout:3/498: dread - d0/d13/d58/d5a/d63/d80/f9c zero size 2024-09-17T04:21:07.782 INFO:tasks.workunit.client.1.smithi134.stdout:0/898: dwrite d11/d18/f9f [0,4194304] 0 2024-09-17T04:21:07.785 INFO:tasks.workunit.client.1.smithi134.stdout:7/820: write d0/d16/f5a [832343,95935] 0 2024-09-17T04:21:07.785 INFO:tasks.workunit.client.0.smithi088.stdout:4/444: fdatasync d5/f1a 0 2024-09-17T04:21:07.789 INFO:tasks.workunit.client.0.smithi088.stdout:4/445: write d5/d3f/d71/d8b/d75/f8e [327643,123778] 0 2024-09-17T04:21:07.791 INFO:tasks.workunit.client.0.smithi088.stdout:5/372: dwrite d2/d31/d33/d20/d30/f4e [0,4194304] 0 2024-09-17T04:21:07.797 INFO:tasks.workunit.client.1.smithi134.stdout:4/947: mkdir d0/df/d1e/d135 0 2024-09-17T04:21:07.799 INFO:tasks.workunit.client.1.smithi134.stdout:5/868: link d0/d48/f87 d0/d3a/d6b/f11e 0 2024-09-17T04:21:07.799 INFO:tasks.workunit.client.0.smithi088.stdout:4/446: mknod d5/d3d/d73/c94 0 2024-09-17T04:21:07.800 INFO:tasks.workunit.client.1.smithi134.stdout:0/899: getdents d11/d48/dd2/dd7 0 2024-09-17T04:21:07.801 INFO:tasks.workunit.client.1.smithi134.stdout:0/900: readlink d11/d19/d21/d37/lc9 0 2024-09-17T04:21:07.806 INFO:tasks.workunit.client.0.smithi088.stdout:4/447: creat d5/d32/d6b/f95 x:0 0 0 2024-09-17T04:21:07.807 INFO:tasks.workunit.client.1.smithi134.stdout:8/841: write d4/d1f/d2b/f7b [4916223,99292] 0 2024-09-17T04:21:07.809 INFO:tasks.workunit.client.0.smithi088.stdout:4/448: creat d5/d3f/d71/d8b/d75/f96 x:0 0 0 2024-09-17T04:21:07.810 INFO:tasks.workunit.client.1.smithi134.stdout:0/901: creat d11/d4c/f132 x:0 0 0 2024-09-17T04:21:07.812 INFO:tasks.workunit.client.0.smithi088.stdout:4/449: fdatasync d5/d32/f79 0 2024-09-17T04:21:07.813 INFO:tasks.workunit.client.1.smithi134.stdout:0/902: mknod d11/d24/d49/d62/daf/ded/c133 0 2024-09-17T04:21:07.815 INFO:tasks.workunit.client.0.smithi088.stdout:4/450: fdatasync d5/d3f/d71/d8b/f88 0 2024-09-17T04:21:07.817 INFO:tasks.workunit.client.0.smithi088.stdout:8/454: dwrite d7/d29/d2a/d38/d3d/f80 [0,4194304] 0 2024-09-17T04:21:07.817 INFO:tasks.workunit.client.1.smithi134.stdout:8/842: dwrite d4/d11/ff2 [0,4194304] 0 2024-09-17T04:21:07.818 INFO:tasks.workunit.client.1.smithi134.stdout:8/843: chown d4/d11/da1/fa7 778847688 1 2024-09-17T04:21:07.820 INFO:tasks.workunit.client.0.smithi088.stdout:3/499: dwrite d0/d13/d1b/d29/d30/d3c/f87 [0,4194304] 0 2024-09-17T04:21:07.823 INFO:tasks.workunit.client.0.smithi088.stdout:3/500: write d0/d13/d1b/d29/d30/d3c/f61 [88869,60226] 0 2024-09-17T04:21:07.823 INFO:tasks.workunit.client.1.smithi134.stdout:0/903: dread d11/d22/f10d [0,4194304] 0 2024-09-17T04:21:07.824 INFO:tasks.workunit.client.1.smithi134.stdout:0/904: fsync d11/d18/f40 0 2024-09-17T04:21:07.824 INFO:tasks.workunit.client.0.smithi088.stdout:4/451: dread - d5/f4e zero size 2024-09-17T04:21:07.825 INFO:tasks.workunit.client.1.smithi134.stdout:8/844: fsync d4/d11/da1/db3/fb7 0 2024-09-17T04:21:07.827 INFO:tasks.workunit.client.0.smithi088.stdout:8/455: mkdir d7/d29/d2a/d75/d95 0 2024-09-17T04:21:07.828 INFO:tasks.workunit.client.0.smithi088.stdout:5/373: write d2/d31/d33/d20/d30/d51/d5e/f74 [872717,109967] 0 2024-09-17T04:21:07.831 INFO:tasks.workunit.client.0.smithi088.stdout:3/501: creat d0/d13/d58/d5a/d63/fa0 x:0 0 0 2024-09-17T04:21:07.831 INFO:tasks.workunit.client.1.smithi134.stdout:4/948: write d0/df/fd8 [4784796,41960] 0 2024-09-17T04:21:07.831 INFO:tasks.workunit.client.1.smithi134.stdout:5/869: dread - d0/da/d69/f66 zero size 2024-09-17T04:21:07.833 INFO:tasks.workunit.client.1.smithi134.stdout:4/949: write d0/d13/f105 [674135,72029] 0 2024-09-17T04:21:07.833 INFO:tasks.workunit.client.0.smithi088.stdout:4/452: symlink d5/d3f/d71/d8b/d68/l97 0 2024-09-17T04:21:07.833 INFO:tasks.workunit.client.0.smithi088.stdout:4/453: stat d5/f1a 0 2024-09-17T04:21:07.835 INFO:tasks.workunit.client.0.smithi088.stdout:4/454: fsync d5/d3f/d71/d8b/d75/f96 0 2024-09-17T04:21:07.836 INFO:tasks.workunit.client.0.smithi088.stdout:8/456: mknod d7/dd/d31/d47/d55/d57/c96 0 2024-09-17T04:21:07.838 INFO:tasks.workunit.client.0.smithi088.stdout:8/457: dread d7/d29/d2a/d38/d3d/f78 [0,4194304] 0 2024-09-17T04:21:07.840 INFO:tasks.workunit.client.0.smithi088.stdout:8/458: write d7/dd/d31/d47/d55/f74 [4344967,55341] 0 2024-09-17T04:21:07.841 INFO:tasks.workunit.client.0.smithi088.stdout:3/502: mknod d0/d13/d1b/d29/d2b/d40/ca1 0 2024-09-17T04:21:07.842 INFO:tasks.workunit.client.0.smithi088.stdout:4/455: read d5/d3d/f42 [1290488,15561] 0 2024-09-17T04:21:07.843 INFO:tasks.workunit.client.0.smithi088.stdout:4/456: fsync d5/d3d/f6d 0 2024-09-17T04:21:07.845 INFO:tasks.workunit.client.0.smithi088.stdout:5/374: rename d2/d31/d33/d20/d25/f28 to d2/d31/d33/d20/d30/d51/d5e/d6b/f75 0 2024-09-17T04:21:07.847 INFO:tasks.workunit.client.1.smithi134.stdout:4/950: dread d0/df/d1e/f5e [0,4194304] 0 2024-09-17T04:21:07.848 INFO:tasks.workunit.client.1.smithi134.stdout:0/905: mkdir d11/d18/d97/df3/d9a/dea/d134 0 2024-09-17T04:21:07.848 INFO:tasks.workunit.client.1.smithi134.stdout:4/951: dread - d0/d13/d40/ffe zero size 2024-09-17T04:21:07.849 INFO:tasks.workunit.client.1.smithi134.stdout:5/870: mkdir d0/da/d29/d7c/d9e/d11f 0 2024-09-17T04:21:07.849 INFO:tasks.workunit.client.0.smithi088.stdout:3/503: truncate d0/d13/d1b/d29/d2b/d40/f43 469653 0 2024-09-17T04:21:07.850 INFO:tasks.workunit.client.0.smithi088.stdout:4/457: fsync d5/f4e 0 2024-09-17T04:21:07.852 INFO:tasks.workunit.client.1.smithi134.stdout:8/845: creat d4/db/f104 x:0 0 0 2024-09-17T04:21:07.853 INFO:tasks.workunit.client.0.smithi088.stdout:5/375: mknod d2/d31/d33/d20/d47/c76 0 2024-09-17T04:21:07.860 INFO:tasks.workunit.client.1.smithi134.stdout:8/846: creat d4/d11/da1/db3/f105 x:0 0 0 2024-09-17T04:21:07.864 INFO:tasks.workunit.client.1.smithi134.stdout:5/871: creat d0/d3a/d2b/d61/d7b/df3/f120 x:0 0 0 2024-09-17T04:21:07.866 INFO:tasks.workunit.client.0.smithi088.stdout:5/376: creat d2/d31/f77 x:0 0 0 2024-09-17T04:21:07.867 INFO:tasks.workunit.client.0.smithi088.stdout:8/459: rmdir d7/d29/d2a/d75/d95 0 2024-09-17T04:21:07.868 INFO:tasks.workunit.client.1.smithi134.stdout:8/847: stat d4/d11/da1/dc7/d13/l46 0 2024-09-17T04:21:07.869 INFO:tasks.workunit.client.0.smithi088.stdout:4/458: mknod d5/d3d/d73/d7e/d5e/c98 0 2024-09-17T04:21:07.869 INFO:tasks.workunit.client.1.smithi134.stdout:2/917: sync 2024-09-17T04:21:07.869 INFO:tasks.workunit.client.0.smithi088.stdout:4/459: dread - d5/d72/f7c zero size 2024-09-17T04:21:07.870 INFO:tasks.workunit.client.1.smithi134.stdout:0/906: dwrite d11/d18/f10c [0,4194304] 0 2024-09-17T04:21:07.870 INFO:tasks.workunit.client.1.smithi134.stdout:0/907: readlink d11/l9c 0 2024-09-17T04:21:07.872 INFO:tasks.workunit.client.1.smithi134.stdout:5/872: unlink d0/d3a/f50 0 2024-09-17T04:21:07.874 INFO:tasks.workunit.client.0.smithi088.stdout:5/377: creat d2/d31/d33/d20/d30/d51/d5e/f78 x:0 0 0 2024-09-17T04:21:07.874 INFO:tasks.workunit.client.1.smithi134.stdout:8/848: rmdir d4/d1f/d86 39 2024-09-17T04:21:07.877 INFO:tasks.workunit.client.1.smithi134.stdout:4/952: rmdir d0/df/dc1 0 2024-09-17T04:21:07.878 INFO:tasks.workunit.client.0.smithi088.stdout:4/460: mkdir d5/d3f/d71/d99 0 2024-09-17T04:21:07.878 INFO:tasks.workunit.client.0.smithi088.stdout:3/504: link d0/d13/d1b/d29/d2b/d40/ca1 d0/d13/d1b/d29/d30/d3c/d5c/ca2 0 2024-09-17T04:21:07.879 INFO:tasks.workunit.client.0.smithi088.stdout:4/461: fdatasync d5/d32/d6b/f86 0 2024-09-17T04:21:07.880 INFO:tasks.workunit.client.0.smithi088.stdout:8/460: mkdir d7/d29/d2a/d38/d3d/d63/d97 0 2024-09-17T04:21:07.882 INFO:tasks.workunit.client.0.smithi088.stdout:5/378: symlink d2/d31/d33/d20/d30/d51/l79 0 2024-09-17T04:21:07.883 INFO:tasks.workunit.client.1.smithi134.stdout:8/849: unlink d4/d1e/l9a 0 2024-09-17T04:21:07.886 INFO:tasks.workunit.client.1.smithi134.stdout:4/953: rename d0/d13/d40/d42/d92/d65/la1 to d0/d13/d40/d42/l136 0 2024-09-17T04:21:07.886 INFO:tasks.workunit.client.0.smithi088.stdout:4/462: chown d5/d3f/c63 98103 1 2024-09-17T04:21:07.887 INFO:tasks.workunit.client.1.smithi134.stdout:2/918: mknod d19/d1c/d47/d50/c131 0 2024-09-17T04:21:07.888 INFO:tasks.workunit.client.1.smithi134.stdout:0/908: creat d11/d24/d49/d62/df7/dd8/de2/d105/f135 x:0 0 0 2024-09-17T04:21:07.888 INFO:tasks.workunit.client.0.smithi088.stdout:8/461: creat d7/dd/d31/d47/d55/d57/f98 x:0 0 0 2024-09-17T04:21:07.889 INFO:tasks.workunit.client.0.smithi088.stdout:8/462: chown d7/d29/d2a/c8c 0 1 2024-09-17T04:21:07.889 INFO:tasks.workunit.client.1.smithi134.stdout:5/873: mkdir d0/da/d29/d78/da5/d106/d121 0 2024-09-17T04:21:07.890 INFO:tasks.workunit.client.0.smithi088.stdout:3/505: symlink d0/d13/d8a/la3 0 2024-09-17T04:21:07.892 INFO:tasks.workunit.client.1.smithi134.stdout:4/954: creat d0/df/d1e/d63/f137 x:0 0 0 2024-09-17T04:21:07.894 INFO:tasks.workunit.client.1.smithi134.stdout:2/919: dwrite d19/d27/f2f [0,4194304] 0 2024-09-17T04:21:07.894 INFO:tasks.workunit.client.1.smithi134.stdout:0/909: unlink d11/d24/d49/d62/daf/ded/fee 0 2024-09-17T04:21:07.894 INFO:tasks.workunit.client.0.smithi088.stdout:8/463: dread d7/f51 [0,4194304] 0 2024-09-17T04:21:07.895 INFO:tasks.workunit.client.1.smithi134.stdout:2/920: stat d19/d27/d31/d34/df2/d6f/d84/ca5 0 2024-09-17T04:21:07.895 INFO:tasks.workunit.client.1.smithi134.stdout:8/850: mkdir d4/d11/da1/d106 0 2024-09-17T04:21:07.896 INFO:tasks.workunit.client.0.smithi088.stdout:3/506: creat d0/d13/d1b/d29/d30/d3c/fa4 x:0 0 0 2024-09-17T04:21:07.897 INFO:tasks.workunit.client.0.smithi088.stdout:3/507: fdatasync d0/d13/f99 0 2024-09-17T04:21:07.902 INFO:tasks.workunit.client.1.smithi134.stdout:5/874: truncate d0/da/d69/d41/fa1 389919 0 2024-09-17T04:21:07.902 INFO:tasks.workunit.client.1.smithi134.stdout:0/910: dwrite d11/d4c/dd3/f54 [0,4194304] 0 2024-09-17T04:21:07.904 INFO:tasks.workunit.client.1.smithi134.stdout:4/955: fdatasync d0/fe1 0 2024-09-17T04:21:07.906 INFO:tasks.workunit.client.1.smithi134.stdout:2/921: creat d19/d1c/d47/dae/f132 x:0 0 0 2024-09-17T04:21:07.908 INFO:tasks.workunit.client.1.smithi134.stdout:8/851: symlink d4/db/dd/d43/da5/l107 0 2024-09-17T04:21:07.908 INFO:tasks.workunit.client.1.smithi134.stdout:2/922: write d19/d1c/d47/d50/f7c [8452147,88679] 0 2024-09-17T04:21:07.912 INFO:tasks.workunit.client.1.smithi134.stdout:5/875: read d0/d3a/d2b/d61/f65 [2416502,122039] 0 2024-09-17T04:21:07.914 INFO:tasks.workunit.client.1.smithi134.stdout:5/876: chown d0/da/d69/d41/d6d/d89/dd5/lfe 0 1 2024-09-17T04:21:07.914 INFO:tasks.workunit.client.1.smithi134.stdout:2/923: dwrite d19/d27/d31/f11c [0,4194304] 0 2024-09-17T04:21:07.915 INFO:tasks.workunit.client.1.smithi134.stdout:4/956: creat d0/d13/d40/d42/d92/d7b/dc9/f138 x:0 0 0 2024-09-17T04:21:07.915 INFO:tasks.workunit.client.1.smithi134.stdout:2/924: chown d19/d1c/d47/d50/f7c 1103842 1 2024-09-17T04:21:07.917 INFO:tasks.workunit.client.1.smithi134.stdout:4/957: write d0/d13/f105 [988427,78295] 0 2024-09-17T04:21:07.918 INFO:tasks.workunit.client.1.smithi134.stdout:8/852: rmdir d4/d1e/d8a 39 2024-09-17T04:21:07.918 INFO:tasks.workunit.client.1.smithi134.stdout:4/958: fsync d0/d3b/f5b 0 2024-09-17T04:21:07.919 INFO:tasks.workunit.client.1.smithi134.stdout:1/997: sync 2024-09-17T04:21:07.919 INFO:tasks.workunit.client.1.smithi134.stdout:4/959: chown d0/df/d35/d5c/fcc 51566 1 2024-09-17T04:21:07.920 INFO:tasks.workunit.client.1.smithi134.stdout:0/911: mknod d11/d18/d97/df3/d9a/dea/d134/c136 0 2024-09-17T04:21:07.925 INFO:tasks.workunit.client.1.smithi134.stdout:2/925: creat d19/d27/d31/d34/df2/d63/d94/d102/de1/f133 x:0 0 0 2024-09-17T04:21:07.931 INFO:tasks.workunit.client.1.smithi134.stdout:1/998: read d12/d19/d5d/d88/fd6 [3956858,54459] 0 2024-09-17T04:21:07.932 INFO:tasks.workunit.client.1.smithi134.stdout:0/912: fdatasync d11/d4c/ff0 0 2024-09-17T04:21:07.932 INFO:tasks.workunit.client.1.smithi134.stdout:4/960: dwrite d0/df/d1e/dbc/fc6 [0,4194304] 0 2024-09-17T04:21:07.933 INFO:tasks.workunit.client.1.smithi134.stdout:0/913: dread - d11/d48/dff/f119 zero size 2024-09-17T04:21:07.934 INFO:tasks.workunit.client.1.smithi134.stdout:2/926: truncate d19/d27/d31/d34/df2/d6f/da9/db0/dca/ffd 29212 0 2024-09-17T04:21:07.936 INFO:tasks.workunit.client.1.smithi134.stdout:5/877: write d0/da/d69/d41/d6d/f7f [600266,88787] 0 2024-09-17T04:21:07.940 INFO:tasks.workunit.client.1.smithi134.stdout:8/853: dread d4/d1f/d2b/dbf/dcc/fae [0,4194304] 0 2024-09-17T04:21:07.940 INFO:tasks.workunit.client.1.smithi134.stdout:4/961: symlink d0/d13/d40/d42/dc5/d11d/l139 0 2024-09-17T04:21:07.942 INFO:tasks.workunit.client.1.smithi134.stdout:8/854: fsync d4/d1f/d2b/dbf/ddd/ff1 0 2024-09-17T04:21:07.942 INFO:tasks.workunit.client.1.smithi134.stdout:2/927: symlink d19/d27/d31/d34/df2/d6f/da9/db0/dca/l134 0 2024-09-17T04:21:07.942 INFO:tasks.workunit.client.1.smithi134.stdout:8/855: chown d4/d1e 6 1 2024-09-17T04:21:07.942 INFO:tasks.workunit.client.1.smithi134.stdout:0/914: write d11/d18/d97/df3/d45/f8a [1258039,19909] 0 2024-09-17T04:21:07.943 INFO:tasks.workunit.client.1.smithi134.stdout:5/878: creat d0/da/d69/d41/d6d/f122 x:0 0 0 2024-09-17T04:21:07.943 INFO:tasks.workunit.client.0.smithi088.stdout:9/475: sync 2024-09-17T04:21:07.943 INFO:tasks.workunit.client.0.smithi088.stdout:2/394: sync 2024-09-17T04:21:07.943 INFO:tasks.workunit.client.0.smithi088.stdout:7/468: sync 2024-09-17T04:21:07.945 INFO:tasks.workunit.client.0.smithi088.stdout:8/464: dread d7/dd/d31/d47/d55/d57/f71 [0,4194304] 0 2024-09-17T04:21:07.945 INFO:tasks.workunit.client.1.smithi134.stdout:4/962: rename d0/d3b/d9f/d130 to d0/d13a 0 2024-09-17T04:21:07.946 INFO:tasks.workunit.client.1.smithi134.stdout:8/856: fsync d4/db/dd/d43/ff3 0 2024-09-17T04:21:07.947 INFO:tasks.workunit.client.0.smithi088.stdout:3/508: fsync d0/d13/d58/d5e/f6a 0 2024-09-17T04:21:07.947 INFO:tasks.workunit.client.0.smithi088.stdout:9/476: chown d2/dd/d14/d8b/f4d 1017153066 1 2024-09-17T04:21:07.947 INFO:tasks.workunit.client.1.smithi134.stdout:4/963: chown d0/d13/d40/d42/d92/d86/faf 23 1 2024-09-17T04:21:07.948 INFO:tasks.workunit.client.1.smithi134.stdout:0/915: mknod d11/d18/d97/df3/d43/d5d/c137 0 2024-09-17T04:21:07.950 INFO:tasks.workunit.client.0.smithi088.stdout:2/395: creat d0/d1/d2d/d33/d4b/f7e x:0 0 0 2024-09-17T04:21:07.952 INFO:tasks.workunit.client.1.smithi134.stdout:2/928: rename d19/d27/d31/d34/df2/d63/d94/d102/de1/c11e to d19/d27/d31/d34/df2/d6f/d84/d98/d9f/c135 0 2024-09-17T04:21:07.953 INFO:tasks.workunit.client.1.smithi134.stdout:2/929: write d19/d1c/d47/f10d [78400,33754] 0 2024-09-17T04:21:07.956 INFO:tasks.workunit.client.1.smithi134.stdout:1/999: dread d12/f1a [0,4194304] 0 2024-09-17T04:21:07.959 INFO:tasks.workunit.client.1.smithi134.stdout:0/916: creat d11/d4c/d76/d118/f138 x:0 0 0 2024-09-17T04:21:07.962 INFO:tasks.workunit.client.0.smithi088.stdout:3/509: fsync d0/fa 0 2024-09-17T04:21:07.962 INFO:tasks.workunit.client.0.smithi088.stdout:5/379: dwrite d2/d31/d33/fa [0,4194304] 0 2024-09-17T04:21:07.963 INFO:tasks.workunit.client.1.smithi134.stdout:2/930: symlink d19/d27/d31/d34/df2/d6f/d10e/l136 0 2024-09-17T04:21:07.963 INFO:tasks.workunit.client.1.smithi134.stdout:2/931: chown d19/d1c/fef 102761093 1 2024-09-17T04:21:07.969 INFO:tasks.workunit.client.0.smithi088.stdout:3/510: rmdir d0/d13/d1b/d29/d2b/d50 39 2024-09-17T04:21:07.970 INFO:tasks.workunit.client.1.smithi134.stdout:0/917: mkdir d11/d18/d97/d139 0 2024-09-17T04:21:07.974 INFO:tasks.workunit.client.1.smithi134.stdout:4/964: rmdir d0/df/dd6 0 2024-09-17T04:21:07.974 INFO:tasks.workunit.client.0.smithi088.stdout:3/511: write d0/d13/d1b/f21 [121030,122183] 0 2024-09-17T04:21:07.974 INFO:tasks.workunit.client.0.smithi088.stdout:2/396: dwrite d0/d1/d2d/d33/f71 [0,4194304] 0 2024-09-17T04:21:07.976 INFO:tasks.workunit.client.0.smithi088.stdout:7/469: dwrite d2/d1d/d2e/d7d/d23/d45/f65 [0,4194304] 0 2024-09-17T04:21:07.976 INFO:tasks.workunit.client.1.smithi134.stdout:5/879: link d0/da/d29/f4e d0/d3a/d2b/d61/d7b/d118/f123 0 2024-09-17T04:21:07.977 INFO:tasks.workunit.client.1.smithi134.stdout:0/918: chown d11/d6f/da8/l101 802 1 2024-09-17T04:21:07.979 INFO:tasks.workunit.client.1.smithi134.stdout:8/857: getdents d4/d11/da1/dc7/d13 0 2024-09-17T04:21:07.979 INFO:tasks.workunit.client.1.smithi134.stdout:2/932: mknod d19/d1c/c137 0 2024-09-17T04:21:07.980 INFO:tasks.workunit.client.0.smithi088.stdout:9/477: dread d2/dd/d11/f25 [0,4194304] 0 2024-09-17T04:21:07.980 INFO:tasks.workunit.client.0.smithi088.stdout:7/470: rmdir d2/d4/d7/d46 39 2024-09-17T04:21:07.981 INFO:tasks.workunit.client.1.smithi134.stdout:2/933: dread - d19/d1c/f11d zero size 2024-09-17T04:21:07.982 INFO:tasks.workunit.client.1.smithi134.stdout:4/965: dread d0/df/fd7 [0,4194304] 0 2024-09-17T04:21:07.983 INFO:tasks.workunit.client.0.smithi088.stdout:3/512: truncate d0/f16 3256490 0 2024-09-17T04:21:07.986 INFO:tasks.workunit.client.1.smithi134.stdout:7/821: sync 2024-09-17T04:21:07.990 INFO:tasks.workunit.client.1.smithi134.stdout:8/858: rename d4/d1f/d2b/dbf/ddd/ff1 to d4/d1f/d2b/dbf/dcc/d9d/f108 0 2024-09-17T04:21:07.992 INFO:tasks.workunit.client.1.smithi134.stdout:5/880: write d0/d3a/d2b/d5a/f88 [2318179,29612] 0 2024-09-17T04:21:07.993 INFO:tasks.workunit.client.1.smithi134.stdout:2/934: mknod d19/d1c/d92/ddc/dc6/dbc/d107/d125/c138 0 2024-09-17T04:21:07.997 INFO:tasks.workunit.client.1.smithi134.stdout:0/919: symlink d11/d4c/dd3/l13a 0 2024-09-17T04:21:07.998 INFO:tasks.workunit.client.1.smithi134.stdout:0/920: fdatasync d11/d4c/dd3/f54 0 2024-09-17T04:21:07.999 INFO:tasks.workunit.client.0.smithi088.stdout:7/471: dwrite d2/d1d/d2e/d7d/d23/d45/d85/f92 [0,4194304] 0 2024-09-17T04:21:07.999 INFO:tasks.workunit.client.0.smithi088.stdout:2/397: getdents d0/d13 0 2024-09-17T04:21:08.000 INFO:tasks.workunit.client.1.smithi134.stdout:7/822: mkdir d0/d16/d8b/dc7/d104 0 2024-09-17T04:21:08.002 INFO:tasks.workunit.client.1.smithi134.stdout:8/859: creat d4/d1f/d2b/f109 x:0 0 0 2024-09-17T04:21:08.003 INFO:tasks.workunit.client.0.smithi088.stdout:2/398: write d0/d18/f3e [5113847,97613] 0 2024-09-17T04:21:08.003 INFO:tasks.workunit.client.0.smithi088.stdout:9/478: dwrite d2/f50 [0,4194304] 0 2024-09-17T04:21:08.003 INFO:tasks.workunit.client.0.smithi088.stdout:5/380: dread d2/d31/d33/d20/d25/d49/f64 [0,4194304] 0 2024-09-17T04:21:08.005 INFO:tasks.workunit.client.0.smithi088.stdout:2/399: stat d0/d1/d2d/d33/c63 0 2024-09-17T04:21:08.005 INFO:tasks.workunit.client.0.smithi088.stdout:5/381: read - d2/d31/f77 zero size 2024-09-17T04:21:08.007 INFO:tasks.workunit.client.0.smithi088.stdout:3/513: creat d0/d13/d1b/d29/d2b/d50/fa5 x:0 0 0 2024-09-17T04:21:08.008 INFO:tasks.workunit.client.0.smithi088.stdout:7/472: mkdir d2/d1d/d2e/d7d/d23/d97 0 2024-09-17T04:21:08.009 INFO:tasks.workunit.client.0.smithi088.stdout:7/473: chown d2/d4/l8 11628 1 2024-09-17T04:21:08.010 INFO:tasks.workunit.client.1.smithi134.stdout:8/860: dwrite d4/db/f104 [0,4194304] 0 2024-09-17T04:21:08.014 INFO:tasks.workunit.client.0.smithi088.stdout:3/514: write d0/d13/d1b/d29/f5b [3119749,76920] 0 2024-09-17T04:21:08.015 INFO:tasks.workunit.client.1.smithi134.stdout:2/935: unlink d19/d27/d31/d34/ld6 0 2024-09-17T04:21:08.017 INFO:tasks.workunit.client.1.smithi134.stdout:7/823: rmdir d0/d16/de3 39 2024-09-17T04:21:08.018 INFO:tasks.workunit.client.1.smithi134.stdout:5/881: dread d0/d3a/d6b/f11e [0,4194304] 0 2024-09-17T04:21:08.018 INFO:tasks.workunit.client.0.smithi088.stdout:5/382: dread d2/d31/d33/f37 [0,4194304] 0 2024-09-17T04:21:08.020 INFO:tasks.workunit.client.1.smithi134.stdout:4/966: rmdir d0/d13/d40/d42/d92/d65/d122 0 2024-09-17T04:21:08.021 INFO:tasks.workunit.client.0.smithi088.stdout:2/400: link d0/d1/d2d/d33/d4b/d24/d3b/f1f d0/d1/d2d/d33/d4b/d24/d3b/f7f 0 2024-09-17T04:21:08.026 INFO:tasks.workunit.client.1.smithi134.stdout:7/824: fsync d0/d16/d8b/d6a/fd2 0 2024-09-17T04:21:08.027 INFO:tasks.workunit.client.1.smithi134.stdout:4/967: creat d0/df/d17/f13b x:0 0 0 2024-09-17T04:21:08.029 INFO:tasks.workunit.client.0.smithi088.stdout:2/401: rename d0/d18 to d0/d1/d2d/d33/d80 0 2024-09-17T04:21:08.029 INFO:tasks.workunit.client.0.smithi088.stdout:2/402: readlink d0/l76 0 2024-09-17T04:21:08.030 INFO:tasks.workunit.client.1.smithi134.stdout:8/861: creat d4/db/dd/d43/d8b/d8e/f10a x:0 0 0 2024-09-17T04:21:08.031 INFO:tasks.workunit.client.1.smithi134.stdout:4/968: rmdir d0/df/d1e/d73 39 2024-09-17T04:21:08.034 INFO:tasks.workunit.client.0.smithi088.stdout:2/403: symlink d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/d7c/l81 0 2024-09-17T04:21:08.035 INFO:tasks.workunit.client.1.smithi134.stdout:2/936: getdents d19/d1c/d92/ddc/dc6/df0 0 2024-09-17T04:21:08.035 INFO:tasks.workunit.client.1.smithi134.stdout:4/969: dread d0/d13/f105 [0,4194304] 0 2024-09-17T04:21:08.037 INFO:tasks.workunit.client.1.smithi134.stdout:2/937: read d19/d1c/d47/d50/f95 [2963367,125077] 0 2024-09-17T04:21:08.039 INFO:tasks.workunit.client.1.smithi134.stdout:4/970: unlink d0/d13/d40/d42/d92/d7b/fc8 0 2024-09-17T04:21:08.039 INFO:tasks.workunit.client.0.smithi088.stdout:9/479: write d2/dd/f1b [2472866,24032] 0 2024-09-17T04:21:08.040 INFO:tasks.workunit.client.1.smithi134.stdout:4/971: chown d0/df/d35/d5c/l67 7666456 1 2024-09-17T04:21:08.040 INFO:tasks.workunit.client.1.smithi134.stdout:2/938: mknod d19/d27/d31/d34/df2/dc3/c139 0 2024-09-17T04:21:08.041 INFO:tasks.workunit.client.1.smithi134.stdout:2/939: fsync d19/d1c/d92/f10c 0 2024-09-17T04:21:08.041 INFO:tasks.workunit.client.0.smithi088.stdout:9/480: mknod d2/d16/ca7 0 2024-09-17T04:21:08.042 INFO:tasks.workunit.client.0.smithi088.stdout:9/481: write d2/dd/d11/f1e [9226926,78421] 0 2024-09-17T04:21:08.043 INFO:tasks.workunit.client.1.smithi134.stdout:4/972: rmdir d0/df/d1e/dbc/d114 39 2024-09-17T04:21:08.046 INFO:tasks.workunit.client.0.smithi088.stdout:5/383: write d2/d31/d33/d20/d47/f48 [685818,106998] 0 2024-09-17T04:21:08.047 INFO:tasks.workunit.client.1.smithi134.stdout:0/921: dwrite fe [4194304,4194304] 0 2024-09-17T04:21:08.049 INFO:tasks.workunit.client.1.smithi134.stdout:5/882: write d0/da/d29/f85 [245204,82437] 0 2024-09-17T04:21:08.050 INFO:tasks.workunit.client.1.smithi134.stdout:4/973: dread d0/df/d1e/dbc/fc6 [0,4194304] 0 2024-09-17T04:21:08.055 INFO:tasks.workunit.client.1.smithi134.stdout:4/974: mknod d0/df/dd5/c13c 0 2024-09-17T04:21:08.058 INFO:tasks.workunit.client.1.smithi134.stdout:2/940: getdents d19/d27/d31 0 2024-09-17T04:21:08.060 INFO:tasks.workunit.client.0.smithi088.stdout:2/404: dwrite d0/d1/d2d/d33/d4b/d24/f2c [4194304,4194304] 0 2024-09-17T04:21:08.060 INFO:tasks.workunit.client.1.smithi134.stdout:0/922: rename d11/d18/d97/df3/d9a/dea/d114/f117 to d11/d22/f13b 0 2024-09-17T04:21:08.064 INFO:tasks.workunit.client.1.smithi134.stdout:8/862: dwrite d4/db/dd/d72/fd5 [0,4194304] 0 2024-09-17T04:21:08.064 INFO:tasks.workunit.client.1.smithi134.stdout:5/883: dwrite d0/da/d29/d78/da5/fe7 [0,4194304] 0 2024-09-17T04:21:08.067 INFO:tasks.workunit.client.1.smithi134.stdout:8/863: dread - d4/d11/da1/db3/fb7 zero size 2024-09-17T04:21:08.069 INFO:tasks.workunit.client.0.smithi088.stdout:2/405: getdents d0/d1 0 2024-09-17T04:21:08.072 INFO:tasks.workunit.client.0.smithi088.stdout:9/482: dread d2/dd/f87 [0,4194304] 0 2024-09-17T04:21:08.073 INFO:tasks.workunit.client.1.smithi134.stdout:2/941: mkdir d19/d27/d31/d34/df2/d6f/d84/d98/d9f/d13a 0 2024-09-17T04:21:08.074 INFO:tasks.workunit.client.1.smithi134.stdout:5/884: chown d0/l56 202646793 1 2024-09-17T04:21:08.075 INFO:tasks.workunit.client.1.smithi134.stdout:0/923: creat d11/d24/d49/d62/daf/ded/f13c x:0 0 0 2024-09-17T04:21:08.075 INFO:tasks.workunit.client.0.smithi088.stdout:2/406: read d0/d1/d2d/f3c [2760993,97385] 0 2024-09-17T04:21:08.077 INFO:tasks.workunit.client.1.smithi134.stdout:5/885: mkdir d0/da/d29/d78/d124 0 2024-09-17T04:21:08.081 INFO:tasks.workunit.client.1.smithi134.stdout:8/864: getdents d4/db/dd/da2 0 2024-09-17T04:21:08.082 INFO:tasks.workunit.client.1.smithi134.stdout:8/865: write d4/db/dd/fe7 [70943,19504] 0 2024-09-17T04:21:08.088 INFO:tasks.workunit.client.1.smithi134.stdout:8/866: dread d4/d11/da1/dc7/d13/f40 [0,4194304] 0 2024-09-17T04:21:08.090 INFO:tasks.workunit.client.1.smithi134.stdout:4/975: truncate d0/d13/d40/d42/ff2 1247 0 2024-09-17T04:21:08.091 INFO:tasks.workunit.client.1.smithi134.stdout:8/867: creat d4/d1f/d2b/dbf/dcc/d9d/f10b x:0 0 0 2024-09-17T04:21:08.092 INFO:tasks.workunit.client.1.smithi134.stdout:4/976: mkdir d0/df/d13d 0 2024-09-17T04:21:08.093 INFO:tasks.workunit.client.0.smithi088.stdout:2/407: write d0/d1/d2d/d33/d4b/d24/d3b/f1f [3046719,25491] 0 2024-09-17T04:21:08.094 INFO:tasks.workunit.client.0.smithi088.stdout:9/483: dwrite d2/dd/fe [0,4194304] 0 2024-09-17T04:21:08.095 INFO:tasks.workunit.client.1.smithi134.stdout:5/886: truncate d0/f2a 3562204 0 2024-09-17T04:21:08.096 INFO:tasks.workunit.client.1.smithi134.stdout:8/868: getdents d4/d11/da1/dc7/d13 0 2024-09-17T04:21:08.101 INFO:tasks.workunit.client.1.smithi134.stdout:0/924: dwrite d11/d6f/da8/fb2 [4194304,4194304] 0 2024-09-17T04:21:08.101 INFO:tasks.workunit.client.1.smithi134.stdout:8/869: chown d4/d1e/c63 1 1 2024-09-17T04:21:08.101 INFO:tasks.workunit.client.0.smithi088.stdout:9/484: dwrite d2/f9 [0,4194304] 0 2024-09-17T04:21:08.102 INFO:tasks.workunit.client.1.smithi134.stdout:4/977: mknod d0/df/d1e/dbc/c13e 0 2024-09-17T04:21:08.103 INFO:tasks.workunit.client.0.smithi088.stdout:2/408: creat d0/d1/d2d/d33/f82 x:0 0 0 2024-09-17T04:21:08.105 INFO:tasks.workunit.client.1.smithi134.stdout:2/942: dwrite d19/d1c/d92/ddc/dc6/dbc/de3/fff [0,4194304] 0 2024-09-17T04:21:08.107 INFO:tasks.workunit.client.1.smithi134.stdout:5/887: unlink d0/da/d29/d78/f8d 0 2024-09-17T04:21:08.107 INFO:tasks.workunit.client.1.smithi134.stdout:2/943: chown d19/d27/d31/d34/f114 225830008 1 2024-09-17T04:21:08.110 INFO:tasks.workunit.client.1.smithi134.stdout:2/944: chown d19/d1c/d92/ddc/dc6/ded 80 1 2024-09-17T04:21:08.115 INFO:tasks.workunit.client.1.smithi134.stdout:4/978: symlink d0/l13f 0 2024-09-17T04:21:08.116 INFO:tasks.workunit.client.1.smithi134.stdout:2/945: truncate d19/d7e/ffc 608662 0 2024-09-17T04:21:08.117 INFO:tasks.workunit.client.1.smithi134.stdout:0/925: dwrite d11/d18/d97/df3/fef [0,4194304] 0 2024-09-17T04:21:08.119 INFO:tasks.workunit.client.1.smithi134.stdout:4/979: write d0/d13/d40/d42/d92/d65/dff/f12d [405496,82293] 0 2024-09-17T04:21:08.121 INFO:tasks.workunit.client.1.smithi134.stdout:2/946: dread - d19/d27/d31/d34/df2/d6f/da9/db0/fa7 zero size 2024-09-17T04:21:08.122 INFO:tasks.workunit.client.1.smithi134.stdout:4/980: dread d0/df/fd7 [0,4194304] 0 2024-09-17T04:21:08.122 INFO:tasks.workunit.client.1.smithi134.stdout:0/926: creat d11/d18/d97/df3/d45/f13d x:0 0 0 2024-09-17T04:21:08.125 INFO:tasks.workunit.client.1.smithi134.stdout:2/947: creat d19/d27/d31/d34/df2/dc3/f13b x:0 0 0 2024-09-17T04:21:08.126 INFO:tasks.workunit.client.1.smithi134.stdout:4/981: mkdir d0/df/d140 0 2024-09-17T04:21:08.130 INFO:tasks.workunit.client.1.smithi134.stdout:0/927: rename d11/d6f/da8/lb9 to d11/d19/l13e 0 2024-09-17T04:21:08.131 INFO:tasks.workunit.client.1.smithi134.stdout:2/948: chown d19/d27/d31/d34/df2/d6f/d84/c90 882 1 2024-09-17T04:21:08.131 INFO:tasks.workunit.client.1.smithi134.stdout:0/928: chown d11/d18/d97/df3 1567 1 2024-09-17T04:21:08.132 INFO:tasks.workunit.client.0.smithi088.stdout:9/485: write d2/d2b/d2e/f57 [746059,17125] 0 2024-09-17T04:21:08.133 INFO:tasks.workunit.client.0.smithi088.stdout:9/486: chown d2/dd/d14/d8b/d43/d51/f6b 32390 1 2024-09-17T04:21:08.134 INFO:tasks.workunit.client.0.smithi088.stdout:9/487: chown d2/dd/d11/d4f/d72/d74/la1 10 1 2024-09-17T04:21:08.138 INFO:tasks.workunit.client.0.smithi088.stdout:9/488: link d2/dd/f1b d2/d16/fa8 0 2024-09-17T04:21:08.139 INFO:tasks.workunit.client.1.smithi134.stdout:8/870: dwrite d4/d1e/daf/d60/f7d [0,4194304] 0 2024-09-17T04:21:08.139 INFO:tasks.workunit.client.0.smithi088.stdout:9/489: symlink d2/dd/la9 0 2024-09-17T04:21:08.140 INFO:tasks.workunit.client.0.smithi088.stdout:2/409: dread d0/d1/f2 [0,4194304] 0 2024-09-17T04:21:08.141 INFO:tasks.workunit.client.1.smithi134.stdout:0/929: write d11/d24/d49/fe4 [555060,114235] 0 2024-09-17T04:21:08.141 INFO:tasks.workunit.client.0.smithi088.stdout:2/410: chown d0/d1/d2d/d33/d4b/d24/d3b/d26/c30 35354409 1 2024-09-17T04:21:08.143 INFO:tasks.workunit.client.1.smithi134.stdout:2/949: dwrite d19/d27/d31/d34/f70 [0,4194304] 0 2024-09-17T04:21:08.144 INFO:tasks.workunit.client.1.smithi134.stdout:0/930: fdatasync d11/d18/f10c 0 2024-09-17T04:21:08.145 INFO:tasks.workunit.client.0.smithi088.stdout:2/411: dread d0/d1/d2d/d33/f71 [0,4194304] 0 2024-09-17T04:21:08.147 INFO:tasks.workunit.client.1.smithi134.stdout:8/871: mkdir d4/d1f/d2b/dbf/ddd/d10c 0 2024-09-17T04:21:08.148 INFO:tasks.workunit.client.1.smithi134.stdout:4/982: dwrite d0/d13/f105 [0,4194304] 0 2024-09-17T04:21:08.149 INFO:tasks.workunit.client.0.smithi088.stdout:2/412: write d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/f5b [1348749,70832] 0 2024-09-17T04:21:08.150 INFO:tasks.workunit.client.0.smithi088.stdout:0/278: sync 2024-09-17T04:21:08.150 INFO:tasks.workunit.client.0.smithi088.stdout:6/493: sync 2024-09-17T04:21:08.150 INFO:tasks.workunit.client.0.smithi088.stdout:1/471: sync 2024-09-17T04:21:08.151 INFO:tasks.workunit.client.1.smithi134.stdout:8/872: dread d4/d1f/d25/f50 [0,4194304] 0 2024-09-17T04:21:08.151 INFO:tasks.workunit.client.0.smithi088.stdout:2/413: mknod d0/d13/c83 0 2024-09-17T04:21:08.154 INFO:tasks.workunit.client.1.smithi134.stdout:8/873: dread d4/db/dd/fe7 [0,4194304] 0 2024-09-17T04:21:08.156 INFO:tasks.workunit.client.1.smithi134.stdout:2/950: mkdir d19/d27/d31/d34/df2/d6f/da9/d13c 0 2024-09-17T04:21:08.157 INFO:tasks.workunit.client.0.smithi088.stdout:0/279: mknod db/d1b/d36/c57 0 2024-09-17T04:21:08.160 INFO:tasks.workunit.client.0.smithi088.stdout:1/472: dwrite d0/f8d [0,4194304] 0 2024-09-17T04:21:08.161 INFO:tasks.workunit.client.1.smithi134.stdout:0/931: dread d11/d4c/dd3/f80 [0,4194304] 0 2024-09-17T04:21:08.161 INFO:tasks.workunit.client.1.smithi134.stdout:4/983: dread - d0/d13/d40/d42/d92/d86/fbb zero size 2024-09-17T04:21:08.162 INFO:tasks.workunit.client.0.smithi088.stdout:1/473: write d0/d1/d16/d35/f8b [914944,26797] 0 2024-09-17T04:21:08.163 INFO:tasks.workunit.client.1.smithi134.stdout:4/984: fsync d0/df/d35/d5c/f81 0 2024-09-17T04:21:08.165 INFO:tasks.workunit.client.0.smithi088.stdout:9/490: truncate d2/dd/d11/d30/f89 538601 0 2024-09-17T04:21:08.168 INFO:tasks.workunit.client.0.smithi088.stdout:0/280: unlink db/f11 0 2024-09-17T04:21:08.170 INFO:tasks.workunit.client.0.smithi088.stdout:1/474: mkdir d0/d1/d16/d2a/da4 0 2024-09-17T04:21:08.171 INFO:tasks.workunit.client.1.smithi134.stdout:4/985: mknod d0/d13/c141 0 2024-09-17T04:21:08.174 INFO:tasks.workunit.client.0.smithi088.stdout:2/414: getdents d0/d1 0 2024-09-17T04:21:08.175 INFO:tasks.workunit.client.0.smithi088.stdout:0/281: mknod db/d1b/d39/c58 0 2024-09-17T04:21:08.177 INFO:tasks.workunit.client.1.smithi134.stdout:4/986: mknod d0/df/d1e/d135/c142 0 2024-09-17T04:21:08.177 INFO:tasks.workunit.client.0.smithi088.stdout:9/491: rmdir d2/dd/d14 39 2024-09-17T04:21:08.179 INFO:tasks.workunit.client.0.smithi088.stdout:2/415: dread d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/f67 [0,4194304] 0 2024-09-17T04:21:08.180 INFO:tasks.workunit.client.1.smithi134.stdout:8/874: dread d4/db/dd/d43/da5/fc1 [0,4194304] 0 2024-09-17T04:21:08.181 INFO:tasks.workunit.client.1.smithi134.stdout:8/875: read - d4/d1f/d25/fff zero size 2024-09-17T04:21:08.182 INFO:tasks.workunit.client.0.smithi088.stdout:0/282: mkdir db/d3c/d4f/d59 0 2024-09-17T04:21:08.184 INFO:tasks.workunit.client.1.smithi134.stdout:8/876: rmdir d4/d1f/d2b 39 2024-09-17T04:21:08.184 INFO:tasks.workunit.client.0.smithi088.stdout:6/494: dread d14/d44/d45/d6b/d29/d3e/f33 [0,4194304] 0 2024-09-17T04:21:08.185 INFO:tasks.workunit.client.0.smithi088.stdout:2/416: creat d0/d1/d2d/f84 x:0 0 0 2024-09-17T04:21:08.186 INFO:tasks.workunit.client.0.smithi088.stdout:1/475: link d0/f28 d0/d1/d16/d77/d9e/fa5 0 2024-09-17T04:21:08.189 INFO:tasks.workunit.client.1.smithi134.stdout:7/825: sync 2024-09-17T04:21:08.189 INFO:tasks.workunit.client.1.smithi134.stdout:5/888: sync 2024-09-17T04:21:08.189 INFO:tasks.workunit.client.0.smithi088.stdout:9/492: readlink d2/dd/l29 0 2024-09-17T04:21:08.190 INFO:tasks.workunit.client.0.smithi088.stdout:0/283: read db/f25 [1132416,5810] 0 2024-09-17T04:21:08.190 INFO:tasks.workunit.client.1.smithi134.stdout:2/951: dwrite d19/d27/d31/d34/fbd [0,4194304] 0 2024-09-17T04:21:08.191 INFO:tasks.workunit.client.1.smithi134.stdout:0/932: write d11/d18/d97/df3/d45/f74 [2435225,18389] 0 2024-09-17T04:21:08.195 INFO:tasks.workunit.client.1.smithi134.stdout:8/877: unlink d4/d1f/d2b/dbf/dcc/d9d/f10b 0 2024-09-17T04:21:08.196 INFO:tasks.workunit.client.0.smithi088.stdout:0/284: symlink db/d1b/d39/l5a 0 2024-09-17T04:21:08.197 INFO:tasks.workunit.client.0.smithi088.stdout:0/285: dread - db/d1b/d36/d4a/f48 zero size 2024-09-17T04:21:08.197 INFO:tasks.workunit.client.0.smithi088.stdout:2/417: mkdir d0/d1/d2d/d33/d85 0 2024-09-17T04:21:08.197 INFO:tasks.workunit.client.0.smithi088.stdout:0/286: fdatasync db/f12 0 2024-09-17T04:21:08.201 INFO:tasks.workunit.client.1.smithi134.stdout:7/826: symlink d0/dd/db9/ded/l105 0 2024-09-17T04:21:08.203 INFO:tasks.workunit.client.0.smithi088.stdout:9/493: creat d2/dd/d11/d4f/d5c/faa x:0 0 0 2024-09-17T04:21:08.204 INFO:tasks.workunit.client.1.smithi134.stdout:5/889: symlink d0/da/d29/d78/da5/l125 0 2024-09-17T04:21:08.205 INFO:tasks.workunit.client.1.smithi134.stdout:5/890: chown d0/da/d29/d7c/db3 219 1 2024-09-17T04:21:08.206 INFO:tasks.workunit.client.0.smithi088.stdout:2/418: dwrite d0/d1/f11 [8388608,4194304] 0 2024-09-17T04:21:08.206 INFO:tasks.workunit.client.0.smithi088.stdout:6/495: link d14/d44/d45/d6b/d29/c4a d14/d44/d45/d6b/d16/d42/cb2 0 2024-09-17T04:21:08.207 INFO:tasks.workunit.client.1.smithi134.stdout:0/933: mkdir d11/d48/dd2/dd7/d13f 0 2024-09-17T04:21:08.208 INFO:tasks.workunit.client.0.smithi088.stdout:9/494: mkdir d2/d2b/d2e/dab 0 2024-09-17T04:21:08.209 INFO:tasks.workunit.client.0.smithi088.stdout:1/476: dwrite d0/d13/f3f [0,4194304] 0 2024-09-17T04:21:08.210 INFO:tasks.workunit.client.1.smithi134.stdout:7/827: creat d0/dd/db9/ded/f106 x:0 0 0 2024-09-17T04:21:08.211 INFO:tasks.workunit.client.0.smithi088.stdout:1/477: chown d0/d1/d16/d2a 8 1 2024-09-17T04:21:08.214 INFO:tasks.workunit.client.1.smithi134.stdout:0/934: dwrite d11/d4c/dd3/f54 [4194304,4194304] 0 2024-09-17T04:21:08.216 INFO:tasks.workunit.client.1.smithi134.stdout:7/828: chown d0/d16/de3/fe9 91554 1 2024-09-17T04:21:08.216 INFO:tasks.workunit.client.1.smithi134.stdout:8/878: dread d4/d1f/d25/d6a/f103 [0,4194304] 0 2024-09-17T04:21:08.217 INFO:tasks.workunit.client.1.smithi134.stdout:8/879: readlink d4/d1e/daf/d60/lda 0 2024-09-17T04:21:08.220 INFO:tasks.workunit.client.0.smithi088.stdout:9/495: dwrite d2/d2b/d2e/f8a [0,4194304] 0 2024-09-17T04:21:08.221 INFO:tasks.workunit.client.0.smithi088.stdout:1/478: dread - d0/d13/d84/f59 zero size 2024-09-17T04:21:08.225 INFO:tasks.workunit.client.1.smithi134.stdout:7/829: rmdir d0/dd/db9/ded 39 2024-09-17T04:21:08.228 INFO:tasks.workunit.client.0.smithi088.stdout:2/419: link d0/d1/f3 d0/d1/d2d/d33/d4b/d24/f86 0 2024-09-17T04:21:08.228 INFO:tasks.workunit.client.1.smithi134.stdout:0/935: mknod d11/d18/d97/d139/c140 0 2024-09-17T04:21:08.230 INFO:tasks.workunit.client.0.smithi088.stdout:0/287: rename db/c18 to db/d1b/d36/d4a/c5b 0 2024-09-17T04:21:08.232 INFO:tasks.workunit.client.0.smithi088.stdout:9/496: chown d2/dd/fe 648831 1 2024-09-17T04:21:08.233 INFO:tasks.workunit.client.0.smithi088.stdout:6/496: creat d14/d44/d45/d6b/d2a/fb3 x:0 0 0 2024-09-17T04:21:08.234 INFO:tasks.workunit.client.0.smithi088.stdout:2/420: fsync d0/d1/fe 0 2024-09-17T04:21:08.236 INFO:tasks.workunit.client.0.smithi088.stdout:0/288: creat db/d1b/d39/f5c x:0 0 0 2024-09-17T04:21:08.237 INFO:tasks.workunit.client.0.smithi088.stdout:2/421: write d0/d1/d2d/d33/d4b/d24/d3b/f1f [2038663,46443] 0 2024-09-17T04:21:08.238 INFO:tasks.workunit.client.0.smithi088.stdout:9/497: write d2/dd/d14/d8b/d43/d51/f6b [3516952,104824] 0 2024-09-17T04:21:08.238 INFO:tasks.workunit.client.0.smithi088.stdout:6/497: symlink d14/d63/lb4 0 2024-09-17T04:21:08.240 INFO:tasks.workunit.client.0.smithi088.stdout:6/498: write d14/d44/d94/fa5 [965959,26748] 0 2024-09-17T04:21:08.241 INFO:tasks.workunit.client.0.smithi088.stdout:6/499: chown d14/d44/d45/d6b/d16 2 1 2024-09-17T04:21:08.242 INFO:tasks.workunit.client.0.smithi088.stdout:6/500: write d14/d44/d94/fa5 [1566942,109464] 0 2024-09-17T04:21:08.242 INFO:tasks.workunit.client.0.smithi088.stdout:2/422: chown d0/l8 956156441 1 2024-09-17T04:21:08.243 INFO:tasks.workunit.client.1.smithi134.stdout:5/891: write d0/da/d69/d41/d6d/fb8 [983248,37564] 0 2024-09-17T04:21:08.243 INFO:tasks.workunit.client.1.smithi134.stdout:0/936: link d11/d24/d49/d62/fda d11/d4c/d76/dba/f141 0 2024-09-17T04:21:08.244 INFO:tasks.workunit.client.1.smithi134.stdout:0/937: chown d11/d4c/d76/l88 60928605 1 2024-09-17T04:21:08.245 INFO:tasks.workunit.client.0.smithi088.stdout:0/289: unlink db/d1b/d36/d4a/f48 0 2024-09-17T04:21:08.249 INFO:tasks.workunit.client.1.smithi134.stdout:0/938: mknod d11/d18/d97/d139/c142 0 2024-09-17T04:21:08.250 INFO:tasks.workunit.client.0.smithi088.stdout:6/501: mknod d14/d44/d45/d6b/d16/d42/cb5 0 2024-09-17T04:21:08.250 INFO:tasks.workunit.client.1.smithi134.stdout:0/939: dread - d11/d18/d97/df3/d43/d5d/fe7 zero size 2024-09-17T04:21:08.251 INFO:tasks.workunit.client.1.smithi134.stdout:5/892: mknod d0/da/d29/d7c/d9e/d11f/c126 0 2024-09-17T04:21:08.252 INFO:tasks.workunit.client.1.smithi134.stdout:8/880: truncate d4/db/dd/d95/f99 938425 0 2024-09-17T04:21:08.253 INFO:tasks.workunit.client.1.smithi134.stdout:0/940: creat d11/d19/ddc/f143 x:0 0 0 2024-09-17T04:21:08.254 INFO:tasks.workunit.client.0.smithi088.stdout:1/479: dread d0/d1/df/d20/f62 [0,4194304] 0 2024-09-17T04:21:08.255 INFO:tasks.workunit.client.0.smithi088.stdout:1/480: chown d0/d1/d16/d2a/c74 126 1 2024-09-17T04:21:08.256 INFO:tasks.workunit.client.1.smithi134.stdout:5/893: creat d0/d3a/d6b/d9c/dad/f127 x:0 0 0 2024-09-17T04:21:08.256 INFO:tasks.workunit.client.0.smithi088.stdout:9/498: mknod d2/dd/d14/d8b/cac 0 2024-09-17T04:21:08.256 INFO:tasks.workunit.client.0.smithi088.stdout:6/502: dwrite d14/d44/d45/d6b/d29/fab [0,4194304] 0 2024-09-17T04:21:08.257 INFO:tasks.workunit.client.1.smithi134.stdout:7/830: dwrite d0/d16/d8b/f9b [0,4194304] 0 2024-09-17T04:21:08.258 INFO:tasks.workunit.client.1.smithi134.stdout:7/831: fdatasync d0/d16/d8b/d6a/feb 0 2024-09-17T04:21:08.260 INFO:tasks.workunit.client.1.smithi134.stdout:0/941: mkdir d11/d48/dd2/d144 0 2024-09-17T04:21:08.265 INFO:tasks.workunit.client.0.smithi088.stdout:6/503: symlink d14/d2f/d87/lb6 0 2024-09-17T04:21:08.266 INFO:tasks.workunit.client.1.smithi134.stdout:8/881: truncate d4/d1f/f3a 1544060 0 2024-09-17T04:21:08.266 INFO:tasks.workunit.client.0.smithi088.stdout:2/423: link d0/d1/d2d/d33/d4b/d24/d3b/d26/c60 d0/d1/d2d/d33/d4b/d6d/c87 0 2024-09-17T04:21:08.267 INFO:tasks.workunit.client.1.smithi134.stdout:0/942: dread - d11/d24/d49/d62/f103 zero size 2024-09-17T04:21:08.268 INFO:tasks.workunit.client.1.smithi134.stdout:0/943: stat d11/d19/ddc/de1 0 2024-09-17T04:21:08.269 INFO:tasks.workunit.client.1.smithi134.stdout:4/987: sync 2024-09-17T04:21:08.269 INFO:tasks.workunit.client.1.smithi134.stdout:2/952: sync 2024-09-17T04:21:08.276 INFO:tasks.workunit.client.0.smithi088.stdout:6/504: creat d14/d44/d45/d6b/d16/fb7 x:0 0 0 2024-09-17T04:21:08.277 INFO:tasks.workunit.client.0.smithi088.stdout:6/505: chown d14/d44/d45/d6b/d29/dac 1368309 1 2024-09-17T04:21:08.278 INFO:tasks.workunit.client.1.smithi134.stdout:2/953: symlink d19/d1c/d47/dae/dc8/l13d 0 2024-09-17T04:21:08.278 INFO:tasks.workunit.client.1.smithi134.stdout:2/954: readlink d19/d27/d31/l3b 0 2024-09-17T04:21:08.279 INFO:tasks.workunit.client.1.smithi134.stdout:2/955: write d19/d1c/f2d [3471745,27117] 0 2024-09-17T04:21:08.282 INFO:tasks.workunit.client.0.smithi088.stdout:6/506: mknod d14/d44/d45/d6b/d2a/d52/d90/cb8 0 2024-09-17T04:21:08.283 INFO:tasks.workunit.client.0.smithi088.stdout:6/507: chown d14/d44/d45/d4d/d97 25094266 1 2024-09-17T04:21:08.283 INFO:tasks.workunit.client.1.smithi134.stdout:7/832: creat d0/f107 x:0 0 0 2024-09-17T04:21:08.285 INFO:tasks.workunit.client.0.smithi088.stdout:2/424: getdents d0/d1/d2d/d77 0 2024-09-17T04:21:08.286 INFO:tasks.workunit.client.1.smithi134.stdout:8/882: symlink d4/d1f/d86/de0/l10d 0 2024-09-17T04:21:08.287 INFO:tasks.workunit.client.0.smithi088.stdout:0/290: dwrite db/d1b/d36/f43 [0,4194304] 0 2024-09-17T04:21:08.289 INFO:tasks.workunit.client.0.smithi088.stdout:9/499: write d2/d2b/d58/f5b [720881,122621] 0 2024-09-17T04:21:08.292 INFO:tasks.workunit.client.0.smithi088.stdout:6/508: dwrite d14/d44/d94/fa5 [0,4194304] 0 2024-09-17T04:21:08.292 INFO:tasks.workunit.client.1.smithi134.stdout:4/988: link d0/d13/d40/d42/d92/dc3/f119 d0/d13/d40/d42/d92/d7b/dc9/f143 0 2024-09-17T04:21:08.296 INFO:tasks.workunit.client.1.smithi134.stdout:5/894: truncate d0/d48/f52 2382676 0 2024-09-17T04:21:08.299 INFO:tasks.workunit.client.1.smithi134.stdout:7/833: creat d0/dd/d3a/d3d/d38/f108 x:0 0 0 2024-09-17T04:21:08.300 INFO:tasks.workunit.client.1.smithi134.stdout:7/834: chown d0/dd/d3a/d3d/d4c/df4 3 1 2024-09-17T04:21:08.301 INFO:tasks.workunit.client.0.smithi088.stdout:9/500: rename d2/dd/d11/d30/d49/l3d to d2/d2b/lad 0 2024-09-17T04:21:08.301 INFO:tasks.workunit.client.1.smithi134.stdout:7/835: write d0/dd/dbb/fd4 [64504,51338] 0 2024-09-17T04:21:08.303 INFO:tasks.workunit.client.0.smithi088.stdout:6/509: mkdir d14/d44/d94/db9 0 2024-09-17T04:21:08.304 INFO:tasks.workunit.client.0.smithi088.stdout:6/510: fdatasync d14/d3a/d41/f84 0 2024-09-17T04:21:08.305 INFO:tasks.workunit.client.0.smithi088.stdout:2/425: creat d0/d1/d2d/d33/d4b/d6d/f88 x:0 0 0 2024-09-17T04:21:08.307 INFO:tasks.workunit.client.0.smithi088.stdout:0/291: mknod db/d1b/c5d 0 2024-09-17T04:21:08.307 INFO:tasks.workunit.client.0.smithi088.stdout:2/426: stat d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f 0 2024-09-17T04:21:08.307 INFO:tasks.workunit.client.1.smithi134.stdout:4/989: mkdir d0/df/d35/d39/d144 0 2024-09-17T04:21:08.309 INFO:tasks.workunit.client.0.smithi088.stdout:9/501: creat d2/dd/d11/d4f/d72/d74/fae x:0 0 0 2024-09-17T04:21:08.314 INFO:tasks.workunit.client.1.smithi134.stdout:7/836: truncate d0/dd/d3a/d3d/d38/f24 1254697 0 2024-09-17T04:21:08.316 INFO:tasks.workunit.client.0.smithi088.stdout:9/502: dwrite d2/dd/fe [0,4194304] 0 2024-09-17T04:21:08.316 INFO:tasks.workunit.client.1.smithi134.stdout:4/990: mknod d0/d13/d123/c145 0 2024-09-17T04:21:08.317 INFO:tasks.workunit.client.1.smithi134.stdout:4/991: chown d0/d13/d40/d42/d92/c8e 634711871 1 2024-09-17T04:21:08.319 INFO:tasks.workunit.client.1.smithi134.stdout:2/956: link d19/d1c/d92/ddc/dc6/dbc/l79 d19/d27/d31/d34/df2/d63/d94/d102/de1/l13e 0 2024-09-17T04:21:08.321 INFO:tasks.workunit.client.1.smithi134.stdout:0/944: link d11/d4c/d76/fec d11/d24/d49/d62/f145 0 2024-09-17T04:21:08.321 INFO:tasks.workunit.client.1.smithi134.stdout:2/957: dread - d19/d1c/d92/ddc/dc6/dbc/f113 zero size 2024-09-17T04:21:08.322 INFO:tasks.workunit.client.0.smithi088.stdout:0/292: rename db/c2f to db/d1b/c5e 0 2024-09-17T04:21:08.323 INFO:tasks.workunit.client.1.smithi134.stdout:0/945: chown d11/d4c/d76/l77 9019213 1 2024-09-17T04:21:08.323 INFO:tasks.workunit.client.0.smithi088.stdout:2/427: dread d0/d1/f1e [0,4194304] 0 2024-09-17T04:21:08.324 INFO:tasks.workunit.client.0.smithi088.stdout:2/428: fdatasync d0/d1/d2d/d33/d4b/d24/f2c 0 2024-09-17T04:21:08.324 INFO:tasks.workunit.client.1.smithi134.stdout:2/958: dread - d19/d1c/d47/f130 zero size 2024-09-17T04:21:08.325 INFO:tasks.workunit.client.1.smithi134.stdout:4/992: dwrite d0/d3b/f52 [4194304,4194304] 0 2024-09-17T04:21:08.325 INFO:tasks.workunit.client.1.smithi134.stdout:0/946: write d11/d4c/f132 [380663,182] 0 2024-09-17T04:21:08.325 INFO:tasks.workunit.client.0.smithi088.stdout:2/429: readlink d0/d1/d2d/d33/d4b/d24/d3b/d26/l56 0 2024-09-17T04:21:08.325 INFO:tasks.workunit.client.1.smithi134.stdout:8/883: rename d4/d1f/d2b/dbf/ddd to d4/db/d10e 0 2024-09-17T04:21:08.326 INFO:tasks.workunit.client.1.smithi134.stdout:2/959: chown d19/d27/d31 2 1 2024-09-17T04:21:08.327 INFO:tasks.workunit.client.1.smithi134.stdout:4/993: dread - d0/d13/d40/d12c/f10f zero size 2024-09-17T04:21:08.328 INFO:tasks.workunit.client.1.smithi134.stdout:7/837: rmdir d0/dd/d3a/d3d/d38/da9 39 2024-09-17T04:21:08.328 INFO:tasks.workunit.client.0.smithi088.stdout:2/430: chown d0/d1/d2d/d33/d4b/d24/d3b/l1a 101518 1 2024-09-17T04:21:08.330 INFO:tasks.workunit.client.1.smithi134.stdout:4/994: readlink d0/df/d35/d5c/l10c 0 2024-09-17T04:21:08.331 INFO:tasks.workunit.client.1.smithi134.stdout:7/838: chown d0/dd/d3a/d3d/d38/d60/fca 3 1 2024-09-17T04:21:08.335 INFO:tasks.workunit.client.0.smithi088.stdout:2/431: dread d0/f5d [0,4194304] 0 2024-09-17T04:21:08.336 INFO:tasks.workunit.client.1.smithi134.stdout:8/884: mkdir d4/d11/da1/db3/d10f 0 2024-09-17T04:21:08.336 INFO:tasks.workunit.client.0.smithi088.stdout:2/432: chown d0/d1/d2d/d33/d85 1 1 2024-09-17T04:21:08.337 INFO:tasks.workunit.client.0.smithi088.stdout:9/503: link d2/c59 d2/dd/d14/d2a/d8f/d99/caf 0 2024-09-17T04:21:08.337 INFO:tasks.workunit.client.1.smithi134.stdout:2/960: creat d19/d27/d31/d34/d42/f13f x:0 0 0 2024-09-17T04:21:08.338 INFO:tasks.workunit.client.0.smithi088.stdout:2/433: unlink d0/d1/d2d/d33/d65/f72 0 2024-09-17T04:21:08.339 INFO:tasks.workunit.client.1.smithi134.stdout:0/947: creat d11/d48/dd2/dd7/d13f/f146 x:0 0 0 2024-09-17T04:21:08.340 INFO:tasks.workunit.client.0.smithi088.stdout:9/504: creat d2/dd/d14/d8b/d43/d51/fb0 x:0 0 0 2024-09-17T04:21:08.341 INFO:tasks.workunit.client.1.smithi134.stdout:7/839: mkdir d0/dd/d3a/d3d/d109 0 2024-09-17T04:21:08.342 INFO:tasks.workunit.client.0.smithi088.stdout:2/434: mkdir d0/d1/d2d/d33/d4b/d24/d89 0 2024-09-17T04:21:08.342 INFO:tasks.workunit.client.1.smithi134.stdout:2/961: dread d19/d27/d31/d34/fbd [0,4194304] 0 2024-09-17T04:21:08.344 INFO:tasks.workunit.client.1.smithi134.stdout:7/840: truncate d0/dd/db9/fce 752597 0 2024-09-17T04:21:08.345 INFO:tasks.workunit.client.1.smithi134.stdout:8/885: mkdir d4/db/d110 0 2024-09-17T04:21:08.345 INFO:tasks.workunit.client.1.smithi134.stdout:8/886: chown d4/c5a 857 1 2024-09-17T04:21:08.348 INFO:tasks.workunit.client.0.smithi088.stdout:0/293: write db/d1b/d36/d47/d37/f26 [21683,112512] 0 2024-09-17T04:21:08.349 INFO:tasks.workunit.client.0.smithi088.stdout:2/435: rename d0/d1/d2d/d33/d4b/c15 to d0/d1/d2d/d33/d65/c8a 0 2024-09-17T04:21:08.351 INFO:tasks.workunit.client.1.smithi134.stdout:7/841: creat d0/d16/d8b/d6a/f10a x:0 0 0 2024-09-17T04:21:08.353 INFO:tasks.workunit.client.0.smithi088.stdout:0/294: mknod db/d1b/d36/d4a/d20/c5f 0 2024-09-17T04:21:08.353 INFO:tasks.workunit.client.1.smithi134.stdout:5/895: sync 2024-09-17T04:21:08.355 INFO:tasks.workunit.client.0.smithi088.stdout:2/436: dwrite d0/d1/d2d/d33/d80/f3e [0,4194304] 0 2024-09-17T04:21:08.356 INFO:tasks.workunit.client.1.smithi134.stdout:4/995: dread d0/df/d17/f24 [4194304,4194304] 0 2024-09-17T04:21:08.357 INFO:tasks.workunit.client.1.smithi134.stdout:4/996: read d0/df/f18 [5808140,29302] 0 2024-09-17T04:21:08.358 INFO:tasks.workunit.client.1.smithi134.stdout:2/962: rename d19/d7e/f81 to d19/d1c/d92/f140 0 2024-09-17T04:21:08.359 INFO:tasks.workunit.client.1.smithi134.stdout:4/997: fsync d0/d13/d40/d42/dc5/fed 0 2024-09-17T04:21:08.360 INFO:tasks.workunit.client.1.smithi134.stdout:4/998: readlink d0/d13/d40/d42/d92/d65/dc2/l11b 0 2024-09-17T04:21:08.360 INFO:tasks.workunit.client.1.smithi134.stdout:4/999: chown d0/ff5 1298508 1 2024-09-17T04:21:08.363 INFO:tasks.workunit.client.0.smithi088.stdout:2/437: dwrite d0/d1/d2d/d33/d4b/d24/d3b/d22/f64 [0,4194304] 0 2024-09-17T04:21:08.365 INFO:tasks.workunit.client.0.smithi088.stdout:0/295: rename db/d3c/d4f/c50 to db/d1b/d36/d47/c60 0 2024-09-17T04:21:08.366 INFO:tasks.workunit.client.0.smithi088.stdout:0/296: write db/fc [667024,7045] 0 2024-09-17T04:21:08.367 INFO:tasks.workunit.client.0.smithi088.stdout:0/297: write db/f19 [1236584,125675] 0 2024-09-17T04:21:08.368 INFO:tasks.workunit.client.0.smithi088.stdout:2/438: creat d0/d1/d2d/d33/d4b/f8b x:0 0 0 2024-09-17T04:21:08.369 INFO:tasks.workunit.client.1.smithi134.stdout:0/948: link d11/d24/d49/d62/fad d11/d48/dd2/dd7/f147 0 2024-09-17T04:21:08.373 INFO:tasks.workunit.client.1.smithi134.stdout:2/963: getdents d19/df8 0 2024-09-17T04:21:08.374 INFO:tasks.workunit.client.0.smithi088.stdout:2/439: rmdir d0/d13 39 2024-09-17T04:21:08.374 INFO:tasks.workunit.client.1.smithi134.stdout:2/964: dread - d19/d1c/d47/d50/d10f/dc1/f104 zero size 2024-09-17T04:21:08.375 INFO:tasks.workunit.client.1.smithi134.stdout:8/887: write d4/d1f/d2b/f2f [2290877,35336] 0 2024-09-17T04:21:08.375 INFO:tasks.workunit.client.0.smithi088.stdout:2/440: dread d0/d1/d2d/f3a [0,4194304] 0 2024-09-17T04:21:08.376 INFO:tasks.workunit.client.1.smithi134.stdout:7/842: creat d0/f10b x:0 0 0 2024-09-17T04:21:08.376 INFO:tasks.workunit.client.1.smithi134.stdout:2/965: write d19/d1c/d92/ff6 [145909,99311] 0 2024-09-17T04:21:08.377 INFO:tasks.workunit.client.0.smithi088.stdout:0/298: symlink db/d1b/d36/d47/d37/l61 0 2024-09-17T04:21:08.379 INFO:tasks.workunit.client.1.smithi134.stdout:7/843: chown d0/dd/db9/ded/cf1 1 1 2024-09-17T04:21:08.380 INFO:tasks.workunit.client.0.smithi088.stdout:0/299: unlink db/d1b/d36/d47/f32 0 2024-09-17T04:21:08.383 INFO:tasks.workunit.client.1.smithi134.stdout:7/844: chown d0/dd/d3a/d3d/fda 3502 1 2024-09-17T04:21:08.389 INFO:tasks.workunit.client.1.smithi134.stdout:0/949: getdents d11/d18/d97/df3/d9a/dea/d114 0 2024-09-17T04:21:08.392 INFO:tasks.workunit.client.0.smithi088.stdout:2/441: dread d0/d1/d2d/d33/d4b/d24/f51 [0,4194304] 0 2024-09-17T04:21:08.393 INFO:tasks.workunit.client.0.smithi088.stdout:0/300: write db/d1b/d36/d4a/f35 [5230085,27399] 0 2024-09-17T04:21:08.394 INFO:tasks.workunit.client.0.smithi088.stdout:0/301: write db/f2a [5272039,90532] 0 2024-09-17T04:21:08.394 INFO:tasks.workunit.client.1.smithi134.stdout:0/950: rename d11/d24/d49/d62/cc0 to d11/d6f/c148 0 2024-09-17T04:21:08.395 INFO:tasks.workunit.client.1.smithi134.stdout:7/845: write d0/d16/d8b/d6a/d70/fa3 [818292,87631] 0 2024-09-17T04:21:08.395 INFO:tasks.workunit.client.0.smithi088.stdout:0/302: readlink db/d1b/d36/d4a/l22 0 2024-09-17T04:21:08.395 INFO:tasks.workunit.client.0.smithi088.stdout:2/442: mkdir d0/d1/d2d/d33/d4b/d24/d3b/d26/d8c 0 2024-09-17T04:21:08.396 INFO:tasks.workunit.client.1.smithi134.stdout:0/951: chown d11/d4c/d12e 1308232 1 2024-09-17T04:21:08.397 INFO:tasks.workunit.client.0.smithi088.stdout:2/443: readlink d0/d1/d2d/d33/d80/l70 0 2024-09-17T04:21:08.398 INFO:tasks.workunit.client.1.smithi134.stdout:8/888: dwrite d4/d1f/f67 [0,4194304] 0 2024-09-17T04:21:08.398 INFO:tasks.workunit.client.1.smithi134.stdout:8/889: chown d4/d1f/f97 427937525 1 2024-09-17T04:21:08.399 INFO:tasks.workunit.client.0.smithi088.stdout:0/303: getdents db/d1b/d36/d4a 0 2024-09-17T04:21:08.400 INFO:tasks.workunit.client.0.smithi088.stdout:0/304: stat db/fc 0 2024-09-17T04:21:08.401 INFO:tasks.workunit.client.1.smithi134.stdout:8/890: dread - d4/d11/da1/dc7/fc6 zero size 2024-09-17T04:21:08.405 INFO:tasks.workunit.client.1.smithi134.stdout:0/952: creat d11/d24/d49/d62/df7/dd8/de2/f149 x:0 0 0 2024-09-17T04:21:08.410 INFO:tasks.workunit.client.0.smithi088.stdout:0/305: write db/d1b/d36/d4a/d20/f41 [329815,82586] 0 2024-09-17T04:21:08.416 INFO:tasks.workunit.client.1.smithi134.stdout:8/891: dwrite d4/d11/da1/dc7/d13/f78 [0,4194304] 0 2024-09-17T04:21:08.416 INFO:tasks.workunit.client.0.smithi088.stdout:2/444: dwrite d0/d1/d2d/d33/d80/f19 [0,4194304] 0 2024-09-17T04:21:08.418 INFO:tasks.workunit.client.0.smithi088.stdout:0/306: dwrite db/f13 [0,4194304] 0 2024-09-17T04:21:08.425 INFO:tasks.workunit.client.1.smithi134.stdout:8/892: creat d4/f111 x:0 0 0 2024-09-17T04:21:08.426 INFO:tasks.workunit.client.0.smithi088.stdout:2/445: creat d0/d1/d2d/d33/d4b/d24/d3b/d26/f8d x:0 0 0 2024-09-17T04:21:08.429 INFO:tasks.workunit.client.0.smithi088.stdout:0/307: truncate db/f12 2074901 0 2024-09-17T04:21:08.431 INFO:tasks.workunit.client.1.smithi134.stdout:8/893: mknod d4/db/dd/d95/c112 0 2024-09-17T04:21:08.449 INFO:tasks.workunit.client.1.smithi134.stdout:8/894: dread d4/f82 [0,4194304] 0 2024-09-17T04:21:08.451 INFO:tasks.workunit.client.1.smithi134.stdout:8/895: creat d4/f113 x:0 0 0 2024-09-17T04:21:08.452 INFO:tasks.workunit.client.1.smithi134.stdout:8/896: truncate d4/d1f/f67 4964040 0 2024-09-17T04:21:08.454 INFO:tasks.workunit.client.1.smithi134.stdout:8/897: rename d4/d1e/l3c to d4/db/dd/d43/l114 0 2024-09-17T04:21:08.456 INFO:tasks.workunit.client.1.smithi134.stdout:8/898: creat d4/db/dd/d72/f115 x:0 0 0 2024-09-17T04:21:08.463 INFO:tasks.workunit.client.1.smithi134.stdout:5/896: sync 2024-09-17T04:21:08.465 INFO:tasks.workunit.client.1.smithi134.stdout:5/897: mkdir d0/da/d69/d128 0 2024-09-17T04:21:08.465 INFO:tasks.workunit.client.1.smithi134.stdout:8/899: dwrite d4/db/dd/d95/f99 [0,4194304] 0 2024-09-17T04:21:08.468 INFO:tasks.workunit.client.1.smithi134.stdout:5/898: mkdir d0/da/d29/d78/da5/d106/d129 0 2024-09-17T04:21:08.469 INFO:tasks.workunit.client.1.smithi134.stdout:8/900: creat d4/db/dd/f116 x:0 0 0 2024-09-17T04:21:08.469 INFO:tasks.workunit.client.1.smithi134.stdout:5/899: rmdir d0/da/d29/d8e 39 2024-09-17T04:21:08.472 INFO:tasks.workunit.client.1.smithi134.stdout:8/901: link d4/d1e/l22 d4/d1f/d25/l117 0 2024-09-17T04:21:08.474 INFO:tasks.workunit.client.1.smithi134.stdout:8/902: mkdir d4/db/dd/d95/d118 0 2024-09-17T04:21:08.474 INFO:tasks.workunit.client.1.smithi134.stdout:8/903: chown d4/d1f/d86/de0 765962373 1 2024-09-17T04:21:08.476 INFO:tasks.workunit.client.1.smithi134.stdout:5/900: link d0/da/d2c/deb/ced d0/d3a/d6b/d9c/c12a 0 2024-09-17T04:21:08.478 INFO:tasks.workunit.client.1.smithi134.stdout:8/904: dread d4/d1f/d2b/fac [0,4194304] 0 2024-09-17T04:21:08.479 INFO:tasks.workunit.client.1.smithi134.stdout:8/905: chown d4/d11/da1/db3/fb7 5942 1 2024-09-17T04:21:08.480 INFO:tasks.workunit.client.1.smithi134.stdout:8/906: stat d4/db/dd/d43/l100 0 2024-09-17T04:21:08.481 INFO:tasks.workunit.client.1.smithi134.stdout:5/901: link d0/da/d29/d78/da5/df0/c107 d0/da/d69/d41/d6d/d89/d11b/c12b 0 2024-09-17T04:21:08.482 INFO:tasks.workunit.client.1.smithi134.stdout:8/907: mknod d4/d1f/d86/de0/c119 0 2024-09-17T04:21:08.484 INFO:tasks.workunit.client.1.smithi134.stdout:8/908: creat d4/d1f/d2b/dbf/dcc/f11a x:0 0 0 2024-09-17T04:21:08.487 INFO:tasks.workunit.client.1.smithi134.stdout:8/909: creat d4/db/d110/f11b x:0 0 0 2024-09-17T04:21:08.489 INFO:tasks.workunit.client.1.smithi134.stdout:8/910: mknod d4/db/dd/d43/da5/c11c 0 2024-09-17T04:21:08.489 INFO:tasks.workunit.client.1.smithi134.stdout:8/911: stat d4/d1f/d86/l93 0 2024-09-17T04:21:08.491 INFO:tasks.workunit.client.1.smithi134.stdout:8/912: truncate d4/d11/f7a 780333 0 2024-09-17T04:21:08.493 INFO:tasks.workunit.client.1.smithi134.stdout:8/913: creat d4/d11/f11d x:0 0 0 2024-09-17T04:21:08.495 INFO:tasks.workunit.client.1.smithi134.stdout:5/902: dread d0/d3a/d2b/d61/d7b/d118/f123 [0,4194304] 0 2024-09-17T04:21:08.495 INFO:tasks.workunit.client.1.smithi134.stdout:8/914: mknod d4/d11/da1/db3/d10f/c11e 0 2024-09-17T04:21:08.496 INFO:tasks.workunit.client.1.smithi134.stdout:5/903: chown d0/da/d2c/deb/ced 0 1 2024-09-17T04:21:08.497 INFO:tasks.workunit.client.1.smithi134.stdout:8/915: rmdir d4/d1f/d25 39 2024-09-17T04:21:08.498 INFO:tasks.workunit.client.1.smithi134.stdout:8/916: truncate d4/d1f/d25/fff 998012 0 2024-09-17T04:21:08.500 INFO:tasks.workunit.client.1.smithi134.stdout:8/917: read d4/d1f/d25/fff [115843,62444] 0 2024-09-17T04:21:08.503 INFO:tasks.workunit.client.1.smithi134.stdout:5/904: dwrite d0/da/d29/f9b [0,4194304] 0 2024-09-17T04:21:08.504 INFO:tasks.workunit.client.1.smithi134.stdout:2/966: sync 2024-09-17T04:21:08.510 INFO:tasks.workunit.client.1.smithi134.stdout:2/967: dread d19/d27/d31/f6e [0,4194304] 0 2024-09-17T04:21:08.515 INFO:tasks.workunit.client.1.smithi134.stdout:8/918: rename d4/db/dd/d43/l114 to d4/db/dd/d72/l11f 0 2024-09-17T04:21:08.516 INFO:tasks.workunit.client.1.smithi134.stdout:5/905: fdatasync d0/da/d69/d41/f49 0 2024-09-17T04:21:08.516 INFO:tasks.workunit.client.1.smithi134.stdout:2/968: dwrite d19/d1c/d47/fcd [0,4194304] 0 2024-09-17T04:21:08.519 INFO:tasks.workunit.client.1.smithi134.stdout:5/906: chown d0/d3a/d2b/d61/d7b/df3/f120 148491 1 2024-09-17T04:21:08.519 INFO:tasks.workunit.client.1.smithi134.stdout:2/969: mkdir d19/df8/d141 0 2024-09-17T04:21:08.522 INFO:tasks.workunit.client.1.smithi134.stdout:2/970: unlink d19/d1c/d92/ddc/dc6/ded/fb9 0 2024-09-17T04:21:08.525 INFO:tasks.workunit.client.1.smithi134.stdout:8/919: fsync d4/d1f/d2b/dbf/dcc/f11a 0 2024-09-17T04:21:08.527 INFO:tasks.workunit.client.1.smithi134.stdout:8/920: write d4/d1f/d2b/f7b [5442556,39483] 0 2024-09-17T04:21:08.528 INFO:tasks.workunit.client.1.smithi134.stdout:5/907: dwrite d0/da/d29/d78/da5/dce/fee [0,4194304] 0 2024-09-17T04:21:08.533 INFO:tasks.workunit.client.1.smithi134.stdout:8/921: rename d4/d11/da1/db3/f105 to d4/d1f/d25/f120 0 2024-09-17T04:21:08.534 INFO:tasks.workunit.client.1.smithi134.stdout:5/908: symlink d0/da/d29/d8e/l12c 0 2024-09-17T04:21:08.536 INFO:tasks.workunit.client.1.smithi134.stdout:8/922: mknod d4/db/dd/d43/d8b/c121 0 2024-09-17T04:21:08.543 INFO:tasks.workunit.client.1.smithi134.stdout:8/923: fdatasync d4/f8d 0 2024-09-17T04:21:08.543 INFO:tasks.workunit.client.1.smithi134.stdout:5/909: dread d0/da/d29/d8e/fb9 [0,4194304] 0 2024-09-17T04:21:08.544 INFO:tasks.workunit.client.1.smithi134.stdout:8/924: chown d4/d1f/d2b/f7b 728 1 2024-09-17T04:21:08.544 INFO:tasks.workunit.client.1.smithi134.stdout:7/846: sync 2024-09-17T04:21:08.545 INFO:tasks.workunit.client.1.smithi134.stdout:0/953: sync 2024-09-17T04:21:08.549 INFO:tasks.workunit.client.1.smithi134.stdout:2/971: dread d19/d1c/d47/d50/f95 [0,4194304] 0 2024-09-17T04:21:08.551 INFO:tasks.workunit.client.1.smithi134.stdout:2/972: truncate d19/d27/d31/d34/f114 7747 0 2024-09-17T04:21:08.557 INFO:tasks.workunit.client.1.smithi134.stdout:7/847: rename d0/d16/f26 to d0/d16/d35/d8d/f10c 0 2024-09-17T04:21:08.558 INFO:tasks.workunit.client.1.smithi134.stdout:2/973: mknod d19/d1c/c142 0 2024-09-17T04:21:08.559 INFO:tasks.workunit.client.1.smithi134.stdout:2/974: chown d19/d27/c2a 856877302 1 2024-09-17T04:21:08.560 INFO:tasks.workunit.client.1.smithi134.stdout:5/910: dread d0/d3a/d2b/f51 [0,4194304] 0 2024-09-17T04:21:08.561 INFO:tasks.workunit.client.1.smithi134.stdout:2/975: write d19/d1c/d92/f123 [887529,42854] 0 2024-09-17T04:21:08.564 INFO:tasks.workunit.client.1.smithi134.stdout:2/976: read d19/d1c/d92/ff6 [67377,105406] 0 2024-09-17T04:21:08.564 INFO:tasks.workunit.client.1.smithi134.stdout:2/977: readlink l18 0 2024-09-17T04:21:08.565 INFO:tasks.workunit.client.1.smithi134.stdout:5/911: truncate d0/da/d69/d41/d6d/f7f 975227 0 2024-09-17T04:21:08.565 INFO:tasks.workunit.client.1.smithi134.stdout:5/912: readlink d0/da/d29/d7c/d9e/ld1 0 2024-09-17T04:21:08.566 INFO:tasks.workunit.client.1.smithi134.stdout:8/925: truncate d4/fe 1294310 0 2024-09-17T04:21:08.567 INFO:tasks.workunit.client.1.smithi134.stdout:2/978: creat d19/d27/d31/d34/df2/d6f/da9/db0/dca/f143 x:0 0 0 2024-09-17T04:21:08.568 INFO:tasks.workunit.client.1.smithi134.stdout:5/913: creat d0/da/d29/d7c/ddf/f12d x:0 0 0 2024-09-17T04:21:08.569 INFO:tasks.workunit.client.1.smithi134.stdout:8/926: mknod d4/db/d10e/c122 0 2024-09-17T04:21:08.574 INFO:tasks.workunit.client.1.smithi134.stdout:7/848: dread d0/d16/d35/f40 [0,4194304] 0 2024-09-17T04:21:08.575 INFO:tasks.workunit.client.1.smithi134.stdout:2/979: link d19/d1c/d92/ddc/dc6/dbc/l79 d19/d1c/d92/ddc/dc6/dbc/l144 0 2024-09-17T04:21:08.576 INFO:tasks.workunit.client.1.smithi134.stdout:0/954: dwrite d11/d18/f57 [0,4194304] 0 2024-09-17T04:21:08.577 INFO:tasks.workunit.client.1.smithi134.stdout:2/980: dread - d19/d1c/d92/ddc/dc6/dbc/f113 zero size 2024-09-17T04:21:08.579 INFO:tasks.workunit.client.1.smithi134.stdout:7/849: creat d0/d16/d35/d4b/d65/f10d x:0 0 0 2024-09-17T04:21:08.583 INFO:tasks.workunit.client.1.smithi134.stdout:7/850: creat d0/d16/d35/d8d/dd0/f10e x:0 0 0 2024-09-17T04:21:08.588 INFO:tasks.workunit.client.1.smithi134.stdout:8/927: dread d4/db/dd/f16 [0,4194304] 0 2024-09-17T04:21:08.590 INFO:tasks.workunit.client.1.smithi134.stdout:2/981: write d19/d1c/d47/dae/dc8/fd9 [189244,68881] 0 2024-09-17T04:21:08.590 INFO:tasks.workunit.client.1.smithi134.stdout:0/955: write d11/d4c/d76/dba/f141 [245344,62124] 0 2024-09-17T04:21:08.592 INFO:tasks.workunit.client.1.smithi134.stdout:2/982: unlink l15 0 2024-09-17T04:21:08.593 INFO:tasks.workunit.client.1.smithi134.stdout:8/928: rename d4/d11/da1/dc7/d13/cbe to d4/d11/da1/c123 0 2024-09-17T04:21:08.594 INFO:tasks.workunit.client.1.smithi134.stdout:2/983: dread - d19/d1c/d92/ddc/dc6/df0/f128 zero size 2024-09-17T04:21:08.599 INFO:tasks.workunit.client.1.smithi134.stdout:8/929: rename d4/db/dd/d43/da5/fc1 to d4/d1e/d8a/f124 0 2024-09-17T04:21:08.603 INFO:tasks.workunit.client.1.smithi134.stdout:2/984: dwrite d19/d1c/d47/d50/d85/fb2 [4194304,4194304] 0 2024-09-17T04:21:08.603 INFO:tasks.workunit.client.1.smithi134.stdout:8/930: mknod d4/db/dd/c125 0 2024-09-17T04:21:08.606 INFO:tasks.workunit.client.1.smithi134.stdout:2/985: chown d19/d1c/d47/d50/fcb 5814 1 2024-09-17T04:21:08.606 INFO:tasks.workunit.client.1.smithi134.stdout:8/931: truncate d4/db/d10e/f101 703535 0 2024-09-17T04:21:08.607 INFO:tasks.workunit.client.1.smithi134.stdout:0/956: dwrite d11/d18/f3d [0,4194304] 0 2024-09-17T04:21:08.610 INFO:tasks.workunit.client.1.smithi134.stdout:0/957: unlink d11/d18/f3d 0 2024-09-17T04:21:08.611 INFO:tasks.workunit.client.1.smithi134.stdout:0/958: chown d11/d19/ddc/f143 3 1 2024-09-17T04:21:08.611 INFO:tasks.workunit.client.1.smithi134.stdout:7/851: dread d0/dd/d3a/d3d/d38/f18 [0,4194304] 0 2024-09-17T04:21:08.614 INFO:tasks.workunit.client.1.smithi134.stdout:7/852: write d0/d16/d8b/d6a/f6d [1080406,12852] 0 2024-09-17T04:21:08.617 INFO:tasks.workunit.client.1.smithi134.stdout:2/986: rmdir d19/d27/d31/d34/df2/d6f/d84/d98/d9f/d13a 0 2024-09-17T04:21:08.617 INFO:tasks.workunit.client.1.smithi134.stdout:8/932: link d4/d1f/d86/cdc d4/d1e/daf/d60/c126 0 2024-09-17T04:21:08.619 INFO:tasks.workunit.client.1.smithi134.stdout:7/853: mkdir d0/d16/d35/d8d/d10f 0 2024-09-17T04:21:08.621 INFO:tasks.workunit.client.1.smithi134.stdout:0/959: dwrite d11/d18/f57 [4194304,4194304] 0 2024-09-17T04:21:08.622 INFO:tasks.workunit.client.1.smithi134.stdout:8/933: unlink d4/d1f/d86/lad 0 2024-09-17T04:21:08.623 INFO:tasks.workunit.client.1.smithi134.stdout:2/987: mknod d19/d27/d31/d34/df2/d6f/da9/c145 0 2024-09-17T04:21:08.627 INFO:tasks.workunit.client.1.smithi134.stdout:2/988: symlink d19/d27/d31/d34/df2/l146 0 2024-09-17T04:21:08.629 INFO:tasks.workunit.client.1.smithi134.stdout:2/989: truncate d19/d1c/f11d 91054 0 2024-09-17T04:21:08.632 INFO:tasks.workunit.client.1.smithi134.stdout:7/854: rename d0/dd/d3a/d3d/d38/da9/fc1 to d0/d16/d35/f110 0 2024-09-17T04:21:08.633 INFO:tasks.workunit.client.1.smithi134.stdout:2/990: mknod d19/d27/d31/d34/df2/d6f/da9/db0/dca/d10a/c147 0 2024-09-17T04:21:08.636 INFO:tasks.workunit.client.1.smithi134.stdout:0/960: write d11/d48/fa1 [1972152,85218] 0 2024-09-17T04:21:08.637 INFO:tasks.workunit.client.1.smithi134.stdout:2/991: link d19/d1c/f87 d19/d27/d31/d34/df2/d6f/da9/db0/daa/f148 0 2024-09-17T04:21:08.638 INFO:tasks.workunit.client.1.smithi134.stdout:0/961: fsync d11/d4c/f92 0 2024-09-17T04:21:08.640 INFO:tasks.workunit.client.1.smithi134.stdout:0/962: write d11/d24/d49/d62/df7/fe8 [739347,115034] 0 2024-09-17T04:21:08.640 INFO:tasks.workunit.client.1.smithi134.stdout:2/992: creat d19/d1c/d92/ddc/dc6/dbc/d107/f149 x:0 0 0 2024-09-17T04:21:08.640 INFO:tasks.workunit.client.1.smithi134.stdout:2/993: stat d19/d7e/ffc 0 2024-09-17T04:21:08.642 INFO:tasks.workunit.client.1.smithi134.stdout:0/963: write d11/d18/d97/df3/f55 [755095,76702] 0 2024-09-17T04:21:08.643 INFO:tasks.workunit.client.1.smithi134.stdout:8/934: truncate d4/d11/da1/dc7/d13/f40 838188 0 2024-09-17T04:21:08.645 INFO:tasks.workunit.client.1.smithi134.stdout:8/935: creat d4/d1e/daf/d60/f127 x:0 0 0 2024-09-17T04:21:08.646 INFO:tasks.workunit.client.1.smithi134.stdout:7/855: truncate d0/d16/d35/d4b/d65/f89 2371545 0 2024-09-17T04:21:08.646 INFO:tasks.workunit.client.1.smithi134.stdout:0/964: mkdir d11/d24/d49/d62/df7/dd8/de2/d14a 0 2024-09-17T04:21:08.685 INFO:tasks.workunit.client.1.smithi134.stdout:0/965: write d11/d18/d97/df3/d45/f13d [796012,75600] 0 2024-09-17T04:21:08.686 INFO:tasks.workunit.client.1.smithi134.stdout:7/856: link d0/dd/d3a/d3d/f78 d0/d16/d35/d4b/f111 0 2024-09-17T04:21:08.688 INFO:tasks.workunit.client.1.smithi134.stdout:0/966: dread d11/d18/f1e [0,4194304] 0 2024-09-17T04:21:08.715 INFO:tasks.workunit.client.1.smithi134.stdout:0/967: mknod d11/d18/d97/df3/d9a/c14b 0 2024-09-17T04:21:08.716 INFO:tasks.workunit.client.1.smithi134.stdout:8/936: link d4/d1f/d25/d6a/l91 d4/db/dd/l128 0 2024-09-17T04:21:08.717 INFO:tasks.workunit.client.1.smithi134.stdout:0/968: truncate d11/d24/d49/fe4 1145354 0 2024-09-17T04:21:08.717 INFO:tasks.workunit.client.1.smithi134.stdout:7/857: rename d0/dd/d3a/d3d/d38/l3f to d0/d16/d35/d4b/l112 0 2024-09-17T04:21:08.717 INFO:tasks.workunit.client.1.smithi134.stdout:8/937: fsync d4/db/dd/d43/d8b/fa3 0 2024-09-17T04:21:08.720 INFO:tasks.workunit.client.1.smithi134.stdout:8/938: creat d4/db/d10e/d10c/f129 x:0 0 0 2024-09-17T04:21:08.721 INFO:tasks.workunit.client.1.smithi134.stdout:8/939: chown d4/db/dd/d43/d8b/d8e/fba 23416251 1 2024-09-17T04:21:08.723 INFO:tasks.workunit.client.1.smithi134.stdout:8/940: creat d4/d1e/daf/d60/f12a x:0 0 0 2024-09-17T04:21:08.733 INFO:tasks.workunit.client.1.smithi134.stdout:0/969: dwrite d11/d24/d49/f68 [0,4194304] 0 2024-09-17T04:21:08.735 INFO:tasks.workunit.client.1.smithi134.stdout:0/970: chown d11/d24/d49/d62/df7/dd8/de2/d14a 647268368 1 2024-09-17T04:21:08.735 INFO:tasks.workunit.client.1.smithi134.stdout:8/941: dread d4/fcf [0,4194304] 0 2024-09-17T04:21:08.738 INFO:tasks.workunit.client.1.smithi134.stdout:0/971: mkdir d11/d48/dd2/df4/d14c 0 2024-09-17T04:21:08.744 INFO:tasks.workunit.client.1.smithi134.stdout:0/972: rename d11/d22/f107 to d11/d18/d97/df3/f14d 0 2024-09-17T04:21:08.745 INFO:tasks.workunit.client.1.smithi134.stdout:0/973: mknod d11/d19/ddc/c14e 0 2024-09-17T04:21:08.751 INFO:tasks.workunit.client.1.smithi134.stdout:8/942: truncate d4/d11/da1/dc7/fe9 168810 0 2024-09-17T04:21:08.757 INFO:tasks.workunit.client.1.smithi134.stdout:8/943: dwrite d4/d1f/d2b/f7b [4194304,4194304] 0 2024-09-17T04:21:08.760 INFO:tasks.workunit.client.1.smithi134.stdout:0/974: dread d11/d18/f40 [0,4194304] 0 2024-09-17T04:21:08.762 INFO:tasks.workunit.client.1.smithi134.stdout:8/944: rename d4/d1e/daf/d60 to d4/d11/d5f/d12b 0 2024-09-17T04:21:08.767 INFO:tasks.workunit.client.1.smithi134.stdout:0/975: rename d11/d6f/c148 to d11/c14f 0 2024-09-17T04:21:08.768 INFO:tasks.workunit.client.1.smithi134.stdout:8/945: dwrite d4/d11/da1/dc7/d13/f61 [0,4194304] 0 2024-09-17T04:21:08.774 INFO:tasks.workunit.client.1.smithi134.stdout:0/976: mknod d11/d4c/d76/c150 0 2024-09-17T04:21:08.775 INFO:tasks.workunit.client.1.smithi134.stdout:8/946: symlink d4/db/dd/l12c 0 2024-09-17T04:21:08.778 INFO:tasks.workunit.client.1.smithi134.stdout:8/947: truncate d4/db/f2d 175808 0 2024-09-17T04:21:08.779 INFO:tasks.workunit.client.1.smithi134.stdout:8/948: chown d4/d1f/d86/d9f/cbc 5757182 1 2024-09-17T04:21:08.781 INFO:tasks.workunit.client.1.smithi134.stdout:0/977: creat d11/d4c/f151 x:0 0 0 2024-09-17T04:21:08.782 INFO:tasks.workunit.client.1.smithi134.stdout:5/914: sync 2024-09-17T04:21:08.782 INFO:tasks.workunit.client.1.smithi134.stdout:0/978: write d11/d48/fc8 [1956506,127702] 0 2024-09-17T04:21:08.784 INFO:tasks.workunit.client.1.smithi134.stdout:5/915: write d0/d48/f82 [485540,96903] 0 2024-09-17T04:21:08.784 INFO:tasks.workunit.client.1.smithi134.stdout:0/979: write d11/d4c/d76/dba/f141 [188377,20972] 0 2024-09-17T04:21:08.785 INFO:tasks.workunit.client.1.smithi134.stdout:5/916: readlink d0/da/d2c/l110 0 2024-09-17T04:21:08.786 INFO:tasks.workunit.client.1.smithi134.stdout:0/980: write d11/d24/d49/d62/df7/dd8/de2/f149 [425394,76341] 0 2024-09-17T04:21:08.787 INFO:tasks.workunit.client.1.smithi134.stdout:0/981: stat d11/d48/fc8 0 2024-09-17T04:21:08.787 INFO:tasks.workunit.client.1.smithi134.stdout:5/917: mknod d0/da/d2c/d73/d8a/c12e 0 2024-09-17T04:21:08.788 INFO:tasks.workunit.client.1.smithi134.stdout:5/918: readlink d0/da/d29/d78/da5/l125 0 2024-09-17T04:21:08.789 INFO:tasks.workunit.client.1.smithi134.stdout:0/982: dread d11/d4c/dd3/f80 [0,4194304] 0 2024-09-17T04:21:08.791 INFO:tasks.workunit.client.1.smithi134.stdout:0/983: rmdir d11/d18/d97/df3/d9a 39 2024-09-17T04:21:08.793 INFO:tasks.workunit.client.1.smithi134.stdout:0/984: write d11/d48/fa1 [3806204,57292] 0 2024-09-17T04:21:08.797 INFO:tasks.workunit.client.1.smithi134.stdout:8/949: write d4/db/dd/d95/f96 [371716,45060] 0 2024-09-17T04:21:08.798 INFO:tasks.workunit.client.1.smithi134.stdout:2/994: sync 2024-09-17T04:21:08.802 INFO:tasks.workunit.client.1.smithi134.stdout:5/919: dwrite d0/f2a [0,4194304] 0 2024-09-17T04:21:08.802 INFO:tasks.workunit.client.1.smithi134.stdout:8/950: dread d4/d1f/d25/d6a/f103 [0,4194304] 0 2024-09-17T04:21:08.807 INFO:tasks.workunit.client.1.smithi134.stdout:8/951: chown d4/db/dd/d72 461844 1 2024-09-17T04:21:08.809 INFO:tasks.workunit.client.1.smithi134.stdout:2/995: rename d19/d27/d31/d34/df2/d6f/da9/db0/dca/c117 to d19/d27/d31/d34/df2/d6f/da9/db0/daa/c14a 0 2024-09-17T04:21:08.810 INFO:tasks.workunit.client.1.smithi134.stdout:8/952: truncate d4/db/dd/d43/d8b/d8e/fba 746515 0 2024-09-17T04:21:08.812 INFO:tasks.workunit.client.1.smithi134.stdout:5/920: rename d0/da/d29/d7c/ddf/cef to d0/d3a/d2b/d61/d7b/df3/c12f 0 2024-09-17T04:21:08.815 INFO:tasks.workunit.client.1.smithi134.stdout:2/996: rename d19/d27/d31/d34/df2/d6f/da9/db0/daa/ld7 to d19/d1c/d92/l14b 0 2024-09-17T04:21:08.816 INFO:tasks.workunit.client.1.smithi134.stdout:2/997: dread - d19/d1c/d92/ddc/dc6/dbc/d107/d125/f12c zero size 2024-09-17T04:21:08.818 INFO:tasks.workunit.client.1.smithi134.stdout:5/921: rename d0/da/d69/d41/d6d/d89/cbb to d0/da/d29/d78/da5/c130 0 2024-09-17T04:21:08.819 INFO:tasks.workunit.client.1.smithi134.stdout:2/998: mknod d19/d27/d31/c14c 0 2024-09-17T04:21:08.828 INFO:tasks.workunit.client.1.smithi134.stdout:2/999: dwrite d19/d1c/d47/d50/d10f/dc1/f104 [0,4194304] 0 2024-09-17T04:21:08.830 INFO:tasks.workunit.client.1.smithi134.stdout:8/953: dread d4/f7e [0,4194304] 0 2024-09-17T04:21:08.840 INFO:tasks.workunit.client.1.smithi134.stdout:5/922: dread d0/d48/f80 [0,4194304] 0 2024-09-17T04:21:08.878 INFO:tasks.workunit.client.0.smithi088.stdout:4/463: sync 2024-09-17T04:21:08.878 INFO:tasks.workunit.client.0.smithi088.stdout:8/465: sync 2024-09-17T04:21:08.883 INFO:tasks.workunit.client.0.smithi088.stdout:4/464: write d5/fb [430606,51807] 0 2024-09-17T04:21:08.883 INFO:tasks.workunit.client.0.smithi088.stdout:4/465: stat d5/d3d/d73/d7e/d5e/f60 0 2024-09-17T04:21:08.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:08 smithi088 ceph-mon[27811]: pgmap v25: 65 pgs: 65 active+clean; 2.8 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 73 MiB/s rd, 211 MiB/s wr, 412 op/s 2024-09-17T04:21:08.889 INFO:tasks.workunit.client.0.smithi088.stdout:8/466: dread f2 [4194304,4194304] 0 2024-09-17T04:21:08.890 INFO:tasks.workunit.client.0.smithi088.stdout:8/467: chown d7/d29/d2a/d3a/f3e 3 1 2024-09-17T04:21:08.891 INFO:tasks.workunit.client.0.smithi088.stdout:8/468: rmdir d7/dd/d31/d47/d55 39 2024-09-17T04:21:08.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:08 smithi134 ceph-mon[35201]: pgmap v25: 65 pgs: 65 active+clean; 2.8 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 73 MiB/s rd, 211 MiB/s wr, 412 op/s 2024-09-17T04:21:08.897 INFO:tasks.workunit.client.0.smithi088.stdout:8/469: creat d7/dd/d31/d47/d55/f99 x:0 0 0 2024-09-17T04:21:08.897 INFO:tasks.workunit.client.0.smithi088.stdout:8/470: fdatasync d7/d29/d2a/f4a 0 2024-09-17T04:21:08.898 INFO:tasks.workunit.client.0.smithi088.stdout:8/471: write d7/dd/f82 [919445,20100] 0 2024-09-17T04:21:08.903 INFO:tasks.workunit.client.0.smithi088.stdout:8/472: dwrite d7/d29/d2a/d38/d3d/f49 [0,4194304] 0 2024-09-17T04:21:08.908 INFO:tasks.workunit.client.0.smithi088.stdout:8/473: truncate d7/f9 2450646 0 2024-09-17T04:21:08.908 INFO:tasks.workunit.client.0.smithi088.stdout:8/474: readlink d7/d29/d2a/d38/d42/l7c 0 2024-09-17T04:21:08.911 INFO:tasks.workunit.client.0.smithi088.stdout:8/475: creat d7/f9a x:0 0 0 2024-09-17T04:21:08.912 INFO:tasks.workunit.client.0.smithi088.stdout:8/476: rmdir d7/d29/d2a/d75 39 2024-09-17T04:21:08.914 INFO:tasks.workunit.client.0.smithi088.stdout:8/477: write d7/dd/d31/d47/d55/d57/f98 [377801,45843] 0 2024-09-17T04:21:08.914 INFO:tasks.workunit.client.0.smithi088.stdout:8/478: write d7/f24 [825292,70565] 0 2024-09-17T04:21:08.921 INFO:tasks.workunit.client.0.smithi088.stdout:8/479: dwrite d7/d7f/f8b [0,4194304] 0 2024-09-17T04:21:08.922 INFO:tasks.workunit.client.0.smithi088.stdout:8/480: fdatasync d7/dd/d31/d47/d55/d57/f84 0 2024-09-17T04:21:08.924 INFO:tasks.workunit.client.0.smithi088.stdout:8/481: mknod d7/d29/c9b 0 2024-09-17T04:21:08.924 INFO:tasks.workunit.client.1.smithi134.stdout:7/858: sync 2024-09-17T04:21:08.976 INFO:tasks.workunit.client.1.smithi134.stdout:0/985: sync 2024-09-17T04:21:08.977 INFO:tasks.workunit.client.1.smithi134.stdout:0/986: fdatasync d11/d18/d97/df3/fb3 0 2024-09-17T04:21:08.978 INFO:tasks.workunit.client.1.smithi134.stdout:0/987: readlink d11/d22/l4e 0 2024-09-17T04:21:08.979 INFO:tasks.workunit.client.1.smithi134.stdout:0/988: stat d11/d24/d49/d62/daf/fb0 0 2024-09-17T04:21:08.980 INFO:tasks.workunit.client.1.smithi134.stdout:0/989: rmdir d11/d24/d49/d62/df7 39 2024-09-17T04:21:08.982 INFO:tasks.workunit.client.1.smithi134.stdout:0/990: creat d11/d22/f152 x:0 0 0 2024-09-17T04:21:08.984 INFO:tasks.workunit.client.1.smithi134.stdout:0/991: creat d11/d48/dd2/dd7/d13f/f153 x:0 0 0 2024-09-17T04:21:08.985 INFO:tasks.workunit.client.1.smithi134.stdout:0/992: truncate d11/d24/f93 110560 0 2024-09-17T04:21:08.986 INFO:tasks.workunit.client.1.smithi134.stdout:0/993: chown d11/f70 23 1 2024-09-17T04:21:08.986 INFO:tasks.workunit.client.1.smithi134.stdout:0/994: chown d11/d22/l4e 636198275 1 2024-09-17T04:21:08.986 INFO:tasks.workunit.client.1.smithi134.stdout:0/995: fdatasync d11/d18/f9f 0 2024-09-17T04:21:08.987 INFO:tasks.workunit.client.1.smithi134.stdout:0/996: rmdir d11/d48/dd2/dd7 39 2024-09-17T04:21:08.988 INFO:tasks.workunit.client.1.smithi134.stdout:0/997: stat d11/d48/dff/c123 0 2024-09-17T04:21:09.034 INFO:tasks.workunit.client.1.smithi134.stdout:7/859: sync 2024-09-17T04:21:09.035 INFO:tasks.workunit.client.1.smithi134.stdout:5/923: sync 2024-09-17T04:21:09.035 INFO:tasks.workunit.client.1.smithi134.stdout:8/954: sync 2024-09-17T04:21:09.037 INFO:tasks.workunit.client.1.smithi134.stdout:8/955: mknod d4/db/dd/d95/c12d 0 2024-09-17T04:21:09.040 INFO:tasks.workunit.client.1.smithi134.stdout:5/924: dread d0/da/d2c/f4c [0,4194304] 0 2024-09-17T04:21:09.047 INFO:tasks.workunit.client.0.smithi088.stdout:5/384: sync 2024-09-17T04:21:09.048 INFO:tasks.workunit.client.0.smithi088.stdout:3/515: sync 2024-09-17T04:21:09.048 INFO:tasks.workunit.client.0.smithi088.stdout:7/474: sync 2024-09-17T04:21:09.048 INFO:tasks.workunit.client.1.smithi134.stdout:7/860: dread d0/dd/fc4 [0,4194304] 0 2024-09-17T04:21:09.048 INFO:tasks.workunit.client.1.smithi134.stdout:5/925: write d0/da/d29/d7c/fe8 [566153,111845] 0 2024-09-17T04:21:09.049 INFO:tasks.workunit.client.0.smithi088.stdout:3/516: dread - d0/d13/d58/d5e/f97 zero size 2024-09-17T04:21:09.049 INFO:tasks.workunit.client.0.smithi088.stdout:5/385: write d2/d31/d33/f18 [333182,83692] 0 2024-09-17T04:21:09.050 INFO:tasks.workunit.client.0.smithi088.stdout:7/475: mknod d2/d1d/d2e/c98 0 2024-09-17T04:21:09.051 INFO:tasks.workunit.client.1.smithi134.stdout:8/956: dread d4/d1e/daf/f4b [0,4194304] 0 2024-09-17T04:21:09.056 INFO:tasks.workunit.client.1.smithi134.stdout:0/998: sync 2024-09-17T04:21:09.056 INFO:tasks.workunit.client.1.smithi134.stdout:8/957: read d4/db/fc [1698116,83392] 0 2024-09-17T04:21:09.056 INFO:tasks.workunit.client.1.smithi134.stdout:0/999: stat d11/d6f/da8/l101 0 2024-09-17T04:21:09.056 INFO:tasks.workunit.client.1.smithi134.stdout:7/861: rename d0/d16/d35/d4b/f111 to d0/d16/d35/d4b/d65/f113 0 2024-09-17T04:21:09.059 INFO:tasks.workunit.client.0.smithi088.stdout:5/386: link d2/d31/d33/d20/d47/f48 d2/d31/d33/d20/d30/d51/d5e/f7a 0 2024-09-17T04:21:09.061 INFO:tasks.workunit.client.0.smithi088.stdout:5/387: fsync d2/d31/d33/f18 0 2024-09-17T04:21:09.061 INFO:tasks.workunit.client.0.smithi088.stdout:3/517: creat d0/d13/d1b/d29/d2b/fa6 x:0 0 0 2024-09-17T04:21:09.062 INFO:tasks.workunit.client.0.smithi088.stdout:7/476: dwrite d2/d4/d7/f36 [0,4194304] 0 2024-09-17T04:21:09.063 INFO:tasks.workunit.client.0.smithi088.stdout:5/388: fdatasync d2/d31/d33/f54 0 2024-09-17T04:21:09.063 INFO:tasks.workunit.client.0.smithi088.stdout:3/518: chown d0/d13/f24 1999712 1 2024-09-17T04:21:09.063 INFO:tasks.workunit.client.1.smithi134.stdout:5/926: dwrite d0/da/d69/fd2 [0,4194304] 0 2024-09-17T04:21:09.063 INFO:tasks.workunit.client.0.smithi088.stdout:5/389: chown d2/f10 126478 1 2024-09-17T04:21:09.064 INFO:tasks.workunit.client.1.smithi134.stdout:7/862: dwrite d0/d16/d35/d4b/d65/f7b [0,4194304] 0 2024-09-17T04:21:09.064 INFO:tasks.workunit.client.1.smithi134.stdout:8/958: rename d4/db/dd/d43/d8b/c121 to d4/db/dd/c12e 0 2024-09-17T04:21:09.065 INFO:tasks.workunit.client.0.smithi088.stdout:5/390: write d2/f40 [710629,7995] 0 2024-09-17T04:21:09.066 INFO:tasks.workunit.client.1.smithi134.stdout:7/863: chown d0/d16/d35/ff3 11 1 2024-09-17T04:21:09.075 INFO:tasks.workunit.client.0.smithi088.stdout:3/519: creat d0/d13/d1b/d29/d30/d35/d65/fa7 x:0 0 0 2024-09-17T04:21:09.075 INFO:tasks.workunit.client.1.smithi134.stdout:8/959: creat d4/d1e/d8a/f12f x:0 0 0 2024-09-17T04:21:09.075 INFO:tasks.workunit.client.1.smithi134.stdout:7/864: dwrite d0/d16/d8b/f9b [0,4194304] 0 2024-09-17T04:21:09.079 INFO:tasks.workunit.client.0.smithi088.stdout:5/391: rmdir d2/d31/d33/d20/d25/d2c 39 2024-09-17T04:21:09.081 INFO:tasks.workunit.client.1.smithi134.stdout:8/960: unlink d4/d11/da1/dc7/c6f 0 2024-09-17T04:21:09.083 INFO:tasks.workunit.client.0.smithi088.stdout:5/392: chown d2/c19 1254 1 2024-09-17T04:21:09.085 INFO:tasks.workunit.client.1.smithi134.stdout:7/865: symlink d0/dd/l114 0 2024-09-17T04:21:09.085 INFO:tasks.workunit.client.0.smithi088.stdout:5/393: creat d2/d31/d33/d20/d30/f7b x:0 0 0 2024-09-17T04:21:09.087 INFO:tasks.workunit.client.1.smithi134.stdout:8/961: creat d4/d1f/d2b/dbf/dcc/f130 x:0 0 0 2024-09-17T04:21:09.087 INFO:tasks.workunit.client.1.smithi134.stdout:5/927: link d0/da/d29/d78/c11c d0/d3a/d6b/d10f/c131 0 2024-09-17T04:21:09.088 INFO:tasks.workunit.client.1.smithi134.stdout:7/866: mkdir d0/d16/d35/d4b/d65/d115 0 2024-09-17T04:21:09.089 INFO:tasks.workunit.client.0.smithi088.stdout:5/394: creat d2/d31/d33/d20/d47/f7c x:0 0 0 2024-09-17T04:21:09.092 INFO:tasks.workunit.client.1.smithi134.stdout:7/867: fsync d0/d16/d35/f110 0 2024-09-17T04:21:09.096 INFO:tasks.workunit.client.0.smithi088.stdout:5/395: creat d2/d31/d33/d20/d30/d51/d5e/d6b/f7d x:0 0 0 2024-09-17T04:21:09.096 INFO:tasks.workunit.client.1.smithi134.stdout:5/928: creat d0/d3a/d2b/d61/f132 x:0 0 0 2024-09-17T04:21:09.097 INFO:tasks.workunit.client.1.smithi134.stdout:7/868: dwrite d0/d16/d35/d8d/dd0/f10e [0,4194304] 0 2024-09-17T04:21:09.100 INFO:tasks.workunit.client.0.smithi088.stdout:5/396: creat d2/d31/d33/f7e x:0 0 0 2024-09-17T04:21:09.101 INFO:tasks.workunit.client.0.smithi088.stdout:7/477: dwrite d2/d1d/d2e/d7d/d23/d45/d62/f77 [0,4194304] 0 2024-09-17T04:21:09.102 INFO:tasks.workunit.client.1.smithi134.stdout:7/869: dread d0/dd/d3a/f9a [0,4194304] 0 2024-09-17T04:21:09.103 INFO:tasks.workunit.client.1.smithi134.stdout:5/929: creat d0/da/d29/d78/d124/f133 x:0 0 0 2024-09-17T04:21:09.104 INFO:tasks.workunit.client.1.smithi134.stdout:5/930: write d0/d48/f82 [4050322,44021] 0 2024-09-17T04:21:09.105 INFO:tasks.workunit.client.1.smithi134.stdout:5/931: fsync d0/da/d29/d7c/fe8 0 2024-09-17T04:21:09.106 INFO:tasks.workunit.client.0.smithi088.stdout:3/520: dread d0/d13/d1b/f88 [0,4194304] 0 2024-09-17T04:21:09.112 INFO:tasks.workunit.client.0.smithi088.stdout:5/397: dread d2/d31/d33/d20/d47/f48 [0,4194304] 0 2024-09-17T04:21:09.112 INFO:tasks.workunit.client.1.smithi134.stdout:7/870: creat d0/f116 x:0 0 0 2024-09-17T04:21:09.113 INFO:tasks.workunit.client.0.smithi088.stdout:3/521: truncate d0/d13/d1b/d29/f3b 4579526 0 2024-09-17T04:21:09.115 INFO:tasks.workunit.client.1.smithi134.stdout:5/932: mknod d0/da/d69/c134 0 2024-09-17T04:21:09.118 INFO:tasks.workunit.client.1.smithi134.stdout:7/871: unlink d0/d16/d35/l62 0 2024-09-17T04:21:09.118 INFO:tasks.workunit.client.1.smithi134.stdout:8/962: write d4/d11/da1/dc7/d5e/fe1 [3178214,91231] 0 2024-09-17T04:21:09.119 INFO:tasks.workunit.client.1.smithi134.stdout:7/872: write d0/d16/d8b/f9b [4110179,123607] 0 2024-09-17T04:21:09.120 INFO:tasks.workunit.client.0.smithi088.stdout:5/398: rename d2/d31/d33/d20/d30/d51/d5e/f6c to d2/d31/d33/d20/d30/d51/d5e/f7f 0 2024-09-17T04:21:09.122 INFO:tasks.workunit.client.0.smithi088.stdout:3/522: dwrite d0/d13/d1b/d29/d30/d3c/d5c/f98 [0,4194304] 0 2024-09-17T04:21:09.125 INFO:tasks.workunit.client.0.smithi088.stdout:1/481: sync 2024-09-17T04:21:09.125 INFO:tasks.workunit.client.0.smithi088.stdout:6/511: sync 2024-09-17T04:21:09.125 INFO:tasks.workunit.client.0.smithi088.stdout:9/505: sync 2024-09-17T04:21:09.126 INFO:tasks.workunit.client.0.smithi088.stdout:9/506: chown d2/c1c 59132 1 2024-09-17T04:21:09.127 INFO:tasks.workunit.client.0.smithi088.stdout:6/512: chown d14/d44/d45/d6b/d29/d3e/c8f 33200 1 2024-09-17T04:21:09.127 INFO:tasks.workunit.client.0.smithi088.stdout:5/399: rmdir d2 39 2024-09-17T04:21:09.130 INFO:tasks.workunit.client.0.smithi088.stdout:1/482: unlink d0/d1/df/d20/f80 0 2024-09-17T04:21:09.131 INFO:tasks.workunit.client.0.smithi088.stdout:9/507: dread - d2/dd/f70 zero size 2024-09-17T04:21:09.132 INFO:tasks.workunit.client.0.smithi088.stdout:1/483: write d0/d1/d16/d2a/f9b [378658,95032] 0 2024-09-17T04:21:09.133 INFO:tasks.workunit.client.0.smithi088.stdout:9/508: chown d2/dd/d11/d30/f89 72070 1 2024-09-17T04:21:09.133 INFO:tasks.workunit.client.1.smithi134.stdout:8/963: unlink d4/d1f/d2b/l42 0 2024-09-17T04:21:09.133 INFO:tasks.workunit.client.0.smithi088.stdout:1/484: chown d0/d13/d84/d5d/f65 308365 1 2024-09-17T04:21:09.135 INFO:tasks.workunit.client.0.smithi088.stdout:7/478: dread d2/d4/d7/f36 [4194304,4194304] 0 2024-09-17T04:21:09.137 INFO:tasks.workunit.client.1.smithi134.stdout:8/964: symlink d4/d1f/d2b/dbf/dcc/l131 0 2024-09-17T04:21:09.139 INFO:tasks.workunit.client.1.smithi134.stdout:7/873: creat d0/dd/f117 x:0 0 0 2024-09-17T04:21:09.140 INFO:tasks.workunit.client.0.smithi088.stdout:3/523: dread d0/d13/d4d/f7c [0,4194304] 0 2024-09-17T04:21:09.145 INFO:tasks.workunit.client.1.smithi134.stdout:5/933: truncate d0/da/d29/f84 1924486 0 2024-09-17T04:21:09.150 INFO:tasks.workunit.client.0.smithi088.stdout:9/509: dwrite d2/dd/f4c [0,4194304] 0 2024-09-17T04:21:09.152 INFO:tasks.workunit.client.0.smithi088.stdout:9/510: readlink d2/dd/d14/d2a/la6 0 2024-09-17T04:21:09.156 INFO:tasks.workunit.client.0.smithi088.stdout:5/400: truncate d2/d31/f44 414823 0 2024-09-17T04:21:09.156 INFO:tasks.workunit.client.1.smithi134.stdout:7/874: dwrite d0/dd/d3a/d3d/fda [0,4194304] 0 2024-09-17T04:21:09.157 INFO:tasks.workunit.client.0.smithi088.stdout:6/513: rename d14/d2f/c40 to d14/d3a/cba 0 2024-09-17T04:21:09.159 INFO:tasks.workunit.client.0.smithi088.stdout:3/524: mknod d0/ca8 0 2024-09-17T04:21:09.162 INFO:tasks.workunit.client.1.smithi134.stdout:8/965: dwrite d4/fe [0,4194304] 0 2024-09-17T04:21:09.164 INFO:tasks.workunit.client.0.smithi088.stdout:3/525: creat d0/d54/fa9 x:0 0 0 2024-09-17T04:21:09.166 INFO:tasks.workunit.client.0.smithi088.stdout:6/514: mknod d14/cbb 0 2024-09-17T04:21:09.167 INFO:tasks.workunit.client.1.smithi134.stdout:8/966: truncate d4/db/f20 2937948 0 2024-09-17T04:21:09.169 INFO:tasks.workunit.client.0.smithi088.stdout:3/526: rename d0/d13/c90 to d0/d13/d1b/d29/d30/caa 0 2024-09-17T04:21:09.170 INFO:tasks.workunit.client.0.smithi088.stdout:6/515: mknod d14/d44/d45/d6b/d2a/d52/d7a/d7b/cbc 0 2024-09-17T04:21:09.172 INFO:tasks.workunit.client.0.smithi088.stdout:3/527: dread d0/d54/f7f [0,4194304] 0 2024-09-17T04:21:09.172 INFO:tasks.workunit.client.0.smithi088.stdout:6/516: dread - d14/d44/d45/d6b/d16/f9c zero size 2024-09-17T04:21:09.172 INFO:tasks.workunit.client.1.smithi134.stdout:8/967: mkdir d4/d1f/d2b/dbf/dcc/d132 0 2024-09-17T04:21:09.174 INFO:tasks.workunit.client.0.smithi088.stdout:3/528: chown d0/d13/d1b/d29/d30/l4b 4963 1 2024-09-17T04:21:09.175 INFO:tasks.workunit.client.0.smithi088.stdout:3/529: dread - d0/d13/d1b/d29/d2b/d50/f91 zero size 2024-09-17T04:21:09.177 INFO:tasks.workunit.client.0.smithi088.stdout:6/517: creat d14/d44/d94/fbd x:0 0 0 2024-09-17T04:21:09.178 INFO:tasks.workunit.client.1.smithi134.stdout:8/968: dwrite d4/d1f/d2b/f2f [0,4194304] 0 2024-09-17T04:21:09.186 INFO:tasks.workunit.client.0.smithi088.stdout:6/518: dwrite d14/d44/d45/d6b/d29/f2d [0,4194304] 0 2024-09-17T04:21:09.188 INFO:tasks.workunit.client.0.smithi088.stdout:9/511: dread d2/dd/d14/d8b/d43/d51/f6b [0,4194304] 0 2024-09-17T04:21:09.189 INFO:tasks.workunit.client.0.smithi088.stdout:3/530: fdatasync d0/d13/d1b/f88 0 2024-09-17T04:21:09.191 INFO:tasks.workunit.client.0.smithi088.stdout:7/479: truncate d2/d4/d7/f34 4230615 0 2024-09-17T04:21:09.194 INFO:tasks.workunit.client.0.smithi088.stdout:7/480: readlink d2/d1d/d2e/d7d/d23/d45/d62/l7e 0 2024-09-17T04:21:09.194 INFO:tasks.workunit.client.0.smithi088.stdout:5/401: write d2/d31/f45 [921341,107412] 0 2024-09-17T04:21:09.197 INFO:tasks.workunit.client.1.smithi134.stdout:8/969: link d4/d1f/d25/f75 d4/d1f/d2b/dbf/f133 0 2024-09-17T04:21:09.198 INFO:tasks.workunit.client.0.smithi088.stdout:3/531: dwrite d0/d13/d58/d5a/d63/f75 [0,4194304] 0 2024-09-17T04:21:09.199 INFO:tasks.workunit.client.1.smithi134.stdout:7/875: write d0/dd/d3a/f4f [1577257,14571] 0 2024-09-17T04:21:09.200 INFO:tasks.workunit.client.0.smithi088.stdout:9/512: symlink d2/d2b/d2e/dab/lb1 0 2024-09-17T04:21:09.200 INFO:tasks.workunit.client.1.smithi134.stdout:7/876: chown d0/d16/d8b/d6a/f10a 28013853 1 2024-09-17T04:21:09.200 INFO:tasks.workunit.client.0.smithi088.stdout:9/513: chown d2 6943806 1 2024-09-17T04:21:09.204 INFO:tasks.workunit.client.0.smithi088.stdout:6/519: creat d14/d44/d45/fbe x:0 0 0 2024-09-17T04:21:09.206 INFO:tasks.workunit.client.1.smithi134.stdout:8/970: mknod d4/c134 0 2024-09-17T04:21:09.207 INFO:tasks.workunit.client.0.smithi088.stdout:3/532: mknod d0/d13/d1b/d29/d30/d3c/cab 0 2024-09-17T04:21:09.207 INFO:tasks.workunit.client.1.smithi134.stdout:7/877: dwrite d0/d16/d35/d8d/dd0/f103 [0,4194304] 0 2024-09-17T04:21:09.210 INFO:tasks.workunit.client.1.smithi134.stdout:7/878: truncate d0/d16/d8b/dc7/fc8 568378 0 2024-09-17T04:21:09.211 INFO:tasks.workunit.client.0.smithi088.stdout:5/402: truncate d2/f10 52161 0 2024-09-17T04:21:09.212 INFO:tasks.workunit.client.0.smithi088.stdout:6/520: dwrite d14/d44/f8e [0,4194304] 0 2024-09-17T04:21:09.214 INFO:tasks.workunit.client.0.smithi088.stdout:9/514: mkdir d2/dd/d14/d8b/d43/db2 0 2024-09-17T04:21:09.215 INFO:tasks.workunit.client.0.smithi088.stdout:9/515: chown d2/dd/d14/d8b/l1f 3261475 1 2024-09-17T04:21:09.215 INFO:tasks.workunit.client.0.smithi088.stdout:3/533: symlink d0/d13/d1b/d29/d30/d3c/lac 0 2024-09-17T04:21:09.221 INFO:tasks.workunit.client.1.smithi134.stdout:7/879: rename d0/d16/d8b/d6a/d70/fcf to d0/d16/d35/f118 0 2024-09-17T04:21:09.222 INFO:tasks.workunit.client.0.smithi088.stdout:7/481: write d2/d4/f69 [1804695,45206] 0 2024-09-17T04:21:09.223 INFO:tasks.workunit.client.0.smithi088.stdout:9/516: mkdir d2/dd/d14/d2a/d76/d98/db3 0 2024-09-17T04:21:09.224 INFO:tasks.workunit.client.1.smithi134.stdout:8/971: dread d4/db/fc [0,4194304] 0 2024-09-17T04:21:09.224 INFO:tasks.workunit.client.1.smithi134.stdout:7/880: rmdir d0/d16/d8b 39 2024-09-17T04:21:09.225 INFO:tasks.workunit.client.0.smithi088.stdout:9/517: truncate d2/d2b/d58/d82/f83 4782289 0 2024-09-17T04:21:09.225 INFO:tasks.workunit.client.1.smithi134.stdout:7/881: chown d0/d16/f5a 3810 1 2024-09-17T04:21:09.226 INFO:tasks.workunit.client.1.smithi134.stdout:7/882: read d0/dd/d3a/d3d/d38/f18 [1228706,97396] 0 2024-09-17T04:21:09.226 INFO:tasks.workunit.client.0.smithi088.stdout:3/534: rename d0/f9d to d0/d54/fad 0 2024-09-17T04:21:09.228 INFO:tasks.workunit.client.0.smithi088.stdout:5/403: mknod d2/d31/d33/d20/d25/d2c/c80 0 2024-09-17T04:21:09.229 INFO:tasks.workunit.client.1.smithi134.stdout:8/972: symlink d4/db/d110/l135 0 2024-09-17T04:21:09.231 INFO:tasks.workunit.client.1.smithi134.stdout:5/934: sync 2024-09-17T04:21:09.232 INFO:tasks.workunit.client.0.smithi088.stdout:9/518: chown d2/dd/d14/d8b/d43/d51/l97 1556211 1 2024-09-17T04:21:09.233 INFO:tasks.workunit.client.1.smithi134.stdout:7/883: mknod d0/d16/d8b/d6a/d70/d85/c119 0 2024-09-17T04:21:09.233 INFO:tasks.workunit.client.0.smithi088.stdout:9/519: write d2/d2b/f8c [444008,108140] 0 2024-09-17T04:21:09.234 INFO:tasks.workunit.client.1.smithi134.stdout:8/973: getdents d4/d1f/d2b/dbf/dcc/d132 0 2024-09-17T04:21:09.234 INFO:tasks.workunit.client.0.smithi088.stdout:7/482: read d2/f6 [410220,65725] 0 2024-09-17T04:21:09.234 INFO:tasks.workunit.client.1.smithi134.stdout:7/884: write d0/dd/d3a/d3d/d38/d60/fca [1451279,65550] 0 2024-09-17T04:21:09.235 INFO:tasks.workunit.client.0.smithi088.stdout:6/521: creat d14/d44/d45/d6b/fbf x:0 0 0 2024-09-17T04:21:09.240 INFO:tasks.workunit.client.0.smithi088.stdout:5/404: rename d2/d31/d33/d20/d30/l63 to d2/d31/d33/d20/d30/d51/d5e/d6b/l81 0 2024-09-17T04:21:09.242 INFO:tasks.workunit.client.0.smithi088.stdout:3/535: mkdir d0/dae 0 2024-09-17T04:21:09.243 INFO:tasks.workunit.client.0.smithi088.stdout:3/536: chown d0/d13/d58/d5e/f9b 907814 1 2024-09-17T04:21:09.245 INFO:tasks.workunit.client.0.smithi088.stdout:7/483: symlink d2/d1d/d2e/d7d/d23/d45/l99 0 2024-09-17T04:21:09.251 INFO:tasks.workunit.client.1.smithi134.stdout:7/885: dread d0/dd/d3a/d3d/d38/fbf [0,4194304] 0 2024-09-17T04:21:09.254 INFO:tasks.workunit.client.1.smithi134.stdout:8/974: write d4/d11/da1/db3/fb7 [574782,97867] 0 2024-09-17T04:21:09.255 INFO:tasks.workunit.client.1.smithi134.stdout:5/935: dwrite d0/da/d29/d7c/fd7 [0,4194304] 0 2024-09-17T04:21:09.256 INFO:tasks.workunit.client.0.smithi088.stdout:6/522: write d14/d44/d45/d6b/d29/f38 [854695,65270] 0 2024-09-17T04:21:09.258 INFO:tasks.workunit.client.0.smithi088.stdout:6/523: write d14/d2f/fa0 [1279225,28986] 0 2024-09-17T04:21:09.258 INFO:tasks.workunit.client.0.smithi088.stdout:3/537: creat d0/d93/faf x:0 0 0 2024-09-17T04:21:09.260 INFO:tasks.workunit.client.0.smithi088.stdout:9/520: truncate d2/dd/d14/d8b/d35/f88 2247417 0 2024-09-17T04:21:09.262 INFO:tasks.workunit.client.0.smithi088.stdout:7/484: link d2/f31 d2/d1d/d2e/d7d/d23/d45/d62/d82/f9a 0 2024-09-17T04:21:09.263 INFO:tasks.workunit.client.1.smithi134.stdout:7/886: creat d0/dd/f11a x:0 0 0 2024-09-17T04:21:09.264 INFO:tasks.workunit.client.1.smithi134.stdout:7/887: chown d0/d16/la 64724 1 2024-09-17T04:21:09.264 INFO:tasks.workunit.client.1.smithi134.stdout:8/975: symlink d4/d11/da1/db3/dec/l136 0 2024-09-17T04:21:09.265 INFO:tasks.workunit.client.0.smithi088.stdout:7/485: fdatasync d2/d4/d7/d20/f90 0 2024-09-17T04:21:09.266 INFO:tasks.workunit.client.0.smithi088.stdout:2/446: sync 2024-09-17T04:21:09.266 INFO:tasks.workunit.client.0.smithi088.stdout:8/482: sync 2024-09-17T04:21:09.266 INFO:tasks.workunit.client.0.smithi088.stdout:0/308: sync 2024-09-17T04:21:09.266 INFO:tasks.workunit.client.0.smithi088.stdout:4/466: sync 2024-09-17T04:21:09.266 INFO:tasks.workunit.client.0.smithi088.stdout:5/405: dwrite d2/d31/d33/f2f [0,4194304] 0 2024-09-17T04:21:09.266 INFO:tasks.workunit.client.1.smithi134.stdout:5/936: creat d0/da/d29/f135 x:0 0 0 2024-09-17T04:21:09.268 INFO:tasks.workunit.client.0.smithi088.stdout:9/521: creat d2/dd/d11/d30/fb4 x:0 0 0 2024-09-17T04:21:09.269 INFO:tasks.workunit.client.0.smithi088.stdout:7/486: chown d2/d1d/d2e/d7d/d23/l38 128904186 1 2024-09-17T04:21:09.271 INFO:tasks.workunit.client.0.smithi088.stdout:6/524: truncate d14/d44/d45/d6b/d16/f9c 241220 0 2024-09-17T04:21:09.273 INFO:tasks.workunit.client.0.smithi088.stdout:3/538: rename d0/d13/d58/d5e/f9b to d0/fb0 0 2024-09-17T04:21:09.273 INFO:tasks.workunit.client.0.smithi088.stdout:2/447: write d0/d1/d2d/d33/d4b/d24/d3b/f1f [4688016,103381] 0 2024-09-17T04:21:09.273 INFO:tasks.workunit.client.0.smithi088.stdout:0/309: read db/d1b/d39/f3a [1435852,90616] 0 2024-09-17T04:21:09.274 INFO:tasks.workunit.client.1.smithi134.stdout:5/937: mkdir d0/da/d2c/d73/d136 0 2024-09-17T04:21:09.277 INFO:tasks.workunit.client.0.smithi088.stdout:3/539: write d0/d13/d1b/d29/d30/f39 [1795153,50510] 0 2024-09-17T04:21:09.280 INFO:tasks.workunit.client.0.smithi088.stdout:9/522: dwrite d2/dd/d11/f79 [0,4194304] 0 2024-09-17T04:21:09.280 INFO:tasks.workunit.client.1.smithi134.stdout:8/976: write d4/db/dd/f30 [26996,37369] 0 2024-09-17T04:21:09.281 INFO:tasks.workunit.client.0.smithi088.stdout:9/523: chown d2/dd/la9 1378 1 2024-09-17T04:21:09.281 INFO:tasks.workunit.client.1.smithi134.stdout:8/977: write d4/db/d110/f11b [897651,15403] 0 2024-09-17T04:21:09.282 INFO:tasks.workunit.client.1.smithi134.stdout:5/938: mkdir d0/da/d69/d41/d6d/d137 0 2024-09-17T04:21:09.287 INFO:tasks.workunit.client.1.smithi134.stdout:8/978: symlink d4/db/d10e/l137 0 2024-09-17T04:21:09.288 INFO:tasks.workunit.client.0.smithi088.stdout:0/310: creat db/d1b/d39/f62 x:0 0 0 2024-09-17T04:21:09.289 INFO:tasks.workunit.client.1.smithi134.stdout:7/888: dwrite d0/dd/d3a/d3d/f56 [0,4194304] 0 2024-09-17T04:21:09.290 INFO:tasks.workunit.client.0.smithi088.stdout:2/448: write d0/d1/d2d/d33/d80/f40 [1552929,57440] 0 2024-09-17T04:21:09.291 INFO:tasks.workunit.client.1.smithi134.stdout:7/889: write d0/d16/d35/d4b/d65/f7b [2645673,47483] 0 2024-09-17T04:21:09.291 INFO:tasks.workunit.client.1.smithi134.stdout:5/939: mkdir d0/da/d69/d41/db6/d138 0 2024-09-17T04:21:09.294 INFO:tasks.workunit.client.0.smithi088.stdout:4/467: mknod d5/d3f/d71/d99/c9a 0 2024-09-17T04:21:09.300 INFO:tasks.workunit.client.0.smithi088.stdout:9/524: write d2/dd/d14/d8b/d43/d51/f6b [36506,70394] 0 2024-09-17T04:21:09.300 INFO:tasks.workunit.client.1.smithi134.stdout:8/979: rename d4/d11/l34 to d4/d11/da1/dc7/l138 0 2024-09-17T04:21:09.302 INFO:tasks.workunit.client.0.smithi088.stdout:7/487: mkdir d2/d4/d9b 0 2024-09-17T04:21:09.302 INFO:tasks.workunit.client.1.smithi134.stdout:5/940: symlink d0/l139 0 2024-09-17T04:21:09.303 INFO:tasks.workunit.client.0.smithi088.stdout:4/468: dwrite d5/d72/f7c [0,4194304] 0 2024-09-17T04:21:09.304 INFO:tasks.workunit.client.0.smithi088.stdout:0/311: symlink db/d1b/d36/d47/d37/l63 0 2024-09-17T04:21:09.311 INFO:tasks.workunit.client.1.smithi134.stdout:5/941: dwrite d0/da/d29/d7c/ddf/f12d [0,4194304] 0 2024-09-17T04:21:09.316 INFO:tasks.workunit.client.1.smithi134.stdout:5/942: read - d0/da/d29/d78/da5/fbc zero size 2024-09-17T04:21:09.318 INFO:tasks.workunit.client.0.smithi088.stdout:9/525: mkdir d2/dd/d11/d4f/db5 0 2024-09-17T04:21:09.318 INFO:tasks.workunit.client.0.smithi088.stdout:5/406: dwrite d2/d31/f67 [0,4194304] 0 2024-09-17T04:21:09.319 INFO:tasks.workunit.client.1.smithi134.stdout:7/890: truncate d0/d16/d8b/fad 3262359 0 2024-09-17T04:21:09.320 INFO:tasks.workunit.client.1.smithi134.stdout:8/980: link d4/db/dd/d95/c12d d4/d1f/d25/c139 0 2024-09-17T04:21:09.321 INFO:tasks.workunit.client.0.smithi088.stdout:5/407: truncate d2/d31/d33/f2f 4884015 0 2024-09-17T04:21:09.321 INFO:tasks.workunit.client.0.smithi088.stdout:7/488: dread d2/d4/d7/f5f [0,4194304] 0 2024-09-17T04:21:09.324 INFO:tasks.workunit.client.0.smithi088.stdout:4/469: creat d5/d3d/d73/f9b x:0 0 0 2024-09-17T04:21:09.325 INFO:tasks.workunit.client.1.smithi134.stdout:8/981: mkdir d4/d1f/d2b/dbf/dcc/d13a 0 2024-09-17T04:21:09.328 INFO:tasks.workunit.client.0.smithi088.stdout:6/525: truncate d14/f32 1423716 0 2024-09-17T04:21:09.328 INFO:tasks.workunit.client.0.smithi088.stdout:2/449: symlink d0/d1/d2d/d33/d85/l8e 0 2024-09-17T04:21:09.330 INFO:tasks.workunit.client.0.smithi088.stdout:3/540: link d0/d13/d1b/d29/d2b/f42 d0/d13/d58/fb1 0 2024-09-17T04:21:09.331 INFO:tasks.workunit.client.0.smithi088.stdout:3/541: readlink d0/d13/d1b/d29/d2b/d40/l7a 0 2024-09-17T04:21:09.332 INFO:tasks.workunit.client.0.smithi088.stdout:5/408: creat d2/d31/d33/d20/d25/d49/f82 x:0 0 0 2024-09-17T04:21:09.332 INFO:tasks.workunit.client.0.smithi088.stdout:3/542: dread - d0/d13/d1b/d29/d2b/f41 zero size 2024-09-17T04:21:09.333 INFO:tasks.workunit.client.0.smithi088.stdout:5/409: chown d2/d31/d33/d20/f6a 14339177 1 2024-09-17T04:21:09.335 INFO:tasks.workunit.client.0.smithi088.stdout:5/410: chown d2/d31/d33/d20/d30/d51/d5e/f78 15 1 2024-09-17T04:21:09.335 INFO:tasks.workunit.client.1.smithi134.stdout:8/982: truncate d4/f57 1042334 0 2024-09-17T04:21:09.338 INFO:tasks.workunit.client.0.smithi088.stdout:0/312: rename db/d1b/d36/d4a/l33 to db/d1b/l64 0 2024-09-17T04:21:09.339 INFO:tasks.workunit.client.0.smithi088.stdout:3/543: mknod d0/d13/d1b/d29/d2b/d50/cb2 0 2024-09-17T04:21:09.340 INFO:tasks.workunit.client.0.smithi088.stdout:5/411: mknod d2/d31/c83 0 2024-09-17T04:21:09.341 INFO:tasks.workunit.client.0.smithi088.stdout:3/544: rmdir d0/d13 39 2024-09-17T04:21:09.341 INFO:tasks.workunit.client.1.smithi134.stdout:8/983: dread d4/d1f/d25/f75 [0,4194304] 0 2024-09-17T04:21:09.342 INFO:tasks.workunit.client.0.smithi088.stdout:0/313: creat db/d3c/d4f/d59/f65 x:0 0 0 2024-09-17T04:21:09.343 INFO:tasks.workunit.client.0.smithi088.stdout:5/412: rmdir d2/d31 39 2024-09-17T04:21:09.343 INFO:tasks.workunit.client.1.smithi134.stdout:7/891: dread d0/dd/f58 [0,4194304] 0 2024-09-17T04:21:09.346 INFO:tasks.workunit.client.0.smithi088.stdout:3/545: truncate d0/d13/d58/d5e/f97 531747 0 2024-09-17T04:21:09.346 INFO:tasks.workunit.client.0.smithi088.stdout:0/314: mkdir db/d3c/d4f/d66 0 2024-09-17T04:21:09.347 INFO:tasks.workunit.client.0.smithi088.stdout:5/413: fsync d2/d31/d33/d20/d30/d51/d5e/f78 0 2024-09-17T04:21:09.348 INFO:tasks.workunit.client.1.smithi134.stdout:7/892: rename d0/dd/db9/ded to d0/dd/d3a/d3d/d38/d60/d75/d11b 0 2024-09-17T04:21:09.348 INFO:tasks.workunit.client.1.smithi134.stdout:8/984: dwrite d4/db/dd/d95/f96 [0,4194304] 0 2024-09-17T04:21:09.348 INFO:tasks.workunit.client.0.smithi088.stdout:3/546: read d0/d13/d1b/d29/d30/d3c/f51 [367645,96336] 0 2024-09-17T04:21:09.349 INFO:tasks.workunit.client.0.smithi088.stdout:0/315: mkdir db/d67 0 2024-09-17T04:21:09.350 INFO:tasks.workunit.client.0.smithi088.stdout:3/547: truncate d0/d93/faf 380148 0 2024-09-17T04:21:09.351 INFO:tasks.workunit.client.0.smithi088.stdout:3/548: fsync d0/d13/d58/d5e/f6a 0 2024-09-17T04:21:09.353 INFO:tasks.workunit.client.0.smithi088.stdout:0/316: creat db/d1b/d36/d47/d37/f68 x:0 0 0 2024-09-17T04:21:09.355 INFO:tasks.workunit.client.0.smithi088.stdout:0/317: stat db/d1b/d36/d47/f30 0 2024-09-17T04:21:09.355 INFO:tasks.workunit.client.0.smithi088.stdout:7/489: dread d2/d1d/d2e/d7d/d23/d45/f5d [0,4194304] 0 2024-09-17T04:21:09.358 INFO:tasks.workunit.client.0.smithi088.stdout:5/414: rename d2/d31/d33/d20/f6a to d2/d31/d33/d20/f84 0 2024-09-17T04:21:09.358 INFO:tasks.workunit.client.1.smithi134.stdout:5/943: truncate d0/da/d29/d78/da5/fe7 1263057 0 2024-09-17T04:21:09.359 INFO:tasks.workunit.client.1.smithi134.stdout:7/893: getdents d0/d16/d35/d8d/d10f 0 2024-09-17T04:21:09.360 INFO:tasks.workunit.client.1.smithi134.stdout:5/944: read d0/d3a/f3b [2635902,53542] 0 2024-09-17T04:21:09.362 INFO:tasks.workunit.client.1.smithi134.stdout:5/945: truncate d0/da/d29/f85 967539 0 2024-09-17T04:21:09.362 INFO:tasks.workunit.client.0.smithi088.stdout:4/470: dread d5/d3f/f39 [0,4194304] 0 2024-09-17T04:21:09.364 INFO:tasks.workunit.client.0.smithi088.stdout:4/471: readlink d5/d3d/d73/d7e/l78 0 2024-09-17T04:21:09.365 INFO:tasks.workunit.client.0.smithi088.stdout:7/490: dwrite d2/d1d/d2e/d7d/f30 [0,4194304] 0 2024-09-17T04:21:09.366 INFO:tasks.workunit.client.0.smithi088.stdout:3/549: dread d0/d13/d1b/d29/f3b [4194304,4194304] 0 2024-09-17T04:21:09.368 INFO:tasks.workunit.client.0.smithi088.stdout:6/526: dread d14/d44/d45/d6b/d2a/f49 [0,4194304] 0 2024-09-17T04:21:09.370 INFO:tasks.workunit.client.0.smithi088.stdout:2/450: write d0/d1/d2d/f53 [993508,17231] 0 2024-09-17T04:21:09.372 INFO:tasks.workunit.client.1.smithi134.stdout:5/946: mknod d0/d3a/d2b/d100/c13a 0 2024-09-17T04:21:09.373 INFO:tasks.workunit.client.0.smithi088.stdout:2/451: write d0/d1/d2d/d33/d4b/d24/d3b/d22/f64 [2477261,121316] 0 2024-09-17T04:21:09.375 INFO:tasks.workunit.client.0.smithi088.stdout:3/550: symlink d0/d13/d1b/d29/d30/d3c/d5c/lb3 0 2024-09-17T04:21:09.381 INFO:tasks.workunit.client.1.smithi134.stdout:8/985: dread d4/db/dd/f2e [8388608,4194304] 0 2024-09-17T04:21:09.381 INFO:tasks.workunit.client.0.smithi088.stdout:0/318: chown db/d1b/d36/d4a/d20/c5f 7241 1 2024-09-17T04:21:09.385 INFO:tasks.workunit.client.0.smithi088.stdout:2/452: creat d0/d1/d2d/d33/d4b/d24/d3b/f8f x:0 0 0 2024-09-17T04:21:09.388 INFO:tasks.workunit.client.1.smithi134.stdout:8/986: symlink d4/d1f/d2b/dbf/dcc/d132/l13b 0 2024-09-17T04:21:09.389 INFO:tasks.workunit.client.0.smithi088.stdout:6/527: fsync d14/f56 0 2024-09-17T04:21:09.391 INFO:tasks.workunit.client.1.smithi134.stdout:7/894: dread d0/f1c [0,4194304] 0 2024-09-17T04:21:09.392 INFO:tasks.workunit.client.1.smithi134.stdout:8/987: symlink d4/d11/d5f/d12b/l13c 0 2024-09-17T04:21:09.393 INFO:tasks.workunit.client.0.smithi088.stdout:1/485: sync 2024-09-17T04:21:09.394 INFO:tasks.workunit.client.0.smithi088.stdout:7/491: rename d2/d1d/d2e/d7d/d23/l59 to d2/d1d/d2e/d7d/l9c 0 2024-09-17T04:21:09.395 INFO:tasks.workunit.client.1.smithi134.stdout:5/947: dread d0/da/d2c/f105 [0,4194304] 0 2024-09-17T04:21:09.398 INFO:tasks.workunit.client.1.smithi134.stdout:8/988: rename d4/d1f/d86/de0/l10d to d4/d1f/d86/l13d 0 2024-09-17T04:21:09.399 INFO:tasks.workunit.client.0.smithi088.stdout:4/472: dread d5/d72/f74 [0,4194304] 0 2024-09-17T04:21:09.400 INFO:tasks.workunit.client.1.smithi134.stdout:5/948: readlink d0/da/d2c/d73/d8a/lf9 0 2024-09-17T04:21:09.402 INFO:tasks.workunit.client.1.smithi134.stdout:7/895: truncate d0/dd/d3a/d3d/d38/f24 1809954 0 2024-09-17T04:21:09.405 INFO:tasks.workunit.client.0.smithi088.stdout:5/415: link d2/d31/d33/d20/d30/d51/d5e/d6b/f75 d2/d31/d33/d20/d47/f85 0 2024-09-17T04:21:09.407 INFO:tasks.workunit.client.1.smithi134.stdout:5/949: creat d0/d48/f13b x:0 0 0 2024-09-17T04:21:09.407 INFO:tasks.workunit.client.1.smithi134.stdout:5/950: readlink d0/da/d2c/deb/lfd 0 2024-09-17T04:21:09.407 INFO:tasks.workunit.client.0.smithi088.stdout:5/416: truncate d2/d31/d33/d20/d25/d49/f4a 993710 0 2024-09-17T04:21:09.408 INFO:tasks.workunit.client.0.smithi088.stdout:0/319: mknod db/d3c/d4f/d66/c69 0 2024-09-17T04:21:09.412 INFO:tasks.workunit.client.1.smithi134.stdout:7/896: truncate d0/d16/d35/d4b/fc0 1441178 0 2024-09-17T04:21:09.414 INFO:tasks.workunit.client.0.smithi088.stdout:7/492: fsync d2/d1d/d2e/d7d/d23/f8b 0 2024-09-17T04:21:09.414 INFO:tasks.workunit.client.0.smithi088.stdout:1/486: truncate d0/d1/d16/d2a/f64 392269 0 2024-09-17T04:21:09.415 INFO:tasks.workunit.client.0.smithi088.stdout:0/320: write db/d1b/d36/d47/f30 [5701066,13253] 0 2024-09-17T04:21:09.415 INFO:tasks.workunit.client.1.smithi134.stdout:5/951: rmdir d0/da/d29/d8e 39 2024-09-17T04:21:09.416 INFO:tasks.workunit.client.1.smithi134.stdout:7/897: mkdir d0/d16/d35/d4b/d11c 0 2024-09-17T04:21:09.418 INFO:tasks.workunit.client.1.smithi134.stdout:7/898: write d0/f20 [5218204,125311] 0 2024-09-17T04:21:09.419 INFO:tasks.workunit.client.1.smithi134.stdout:8/989: dwrite d4/d1f/d2b/fac [0,4194304] 0 2024-09-17T04:21:09.420 INFO:tasks.workunit.client.1.smithi134.stdout:5/952: truncate d0/d3a/fc0 395797 0 2024-09-17T04:21:09.420 INFO:tasks.workunit.client.0.smithi088.stdout:4/473: creat d5/d32/d6b/f9c x:0 0 0 2024-09-17T04:21:09.421 INFO:tasks.workunit.client.1.smithi134.stdout:5/953: fdatasync d0/d3a/ff 0 2024-09-17T04:21:09.422 INFO:tasks.workunit.client.0.smithi088.stdout:1/487: stat d0/d1/d16/d2a/l31 0 2024-09-17T04:21:09.425 INFO:tasks.workunit.client.1.smithi134.stdout:7/899: dwrite d0/d16/d35/f110 [0,4194304] 0 2024-09-17T04:21:09.426 INFO:tasks.workunit.client.0.smithi088.stdout:2/453: dwrite d0/d1/f3 [4194304,4194304] 0 2024-09-17T04:21:09.430 INFO:tasks.workunit.client.0.smithi088.stdout:3/551: dwrite d0/f12 [4194304,4194304] 0 2024-09-17T04:21:09.432 INFO:tasks.workunit.client.1.smithi134.stdout:8/990: rmdir d4/db/dd/d43 39 2024-09-17T04:21:09.433 INFO:tasks.workunit.client.0.smithi088.stdout:0/321: readlink db/d1b/d36/d47/d37/l61 0 2024-09-17T04:21:09.434 INFO:tasks.workunit.client.1.smithi134.stdout:7/900: chown d0/d16/d35/d4b/lea 56394 1 2024-09-17T04:21:09.434 INFO:tasks.workunit.client.1.smithi134.stdout:8/991: write d4/d1f/d2b/f2f [3503303,115194] 0 2024-09-17T04:21:09.434 INFO:tasks.workunit.client.1.smithi134.stdout:5/954: fdatasync d0/f39 0 2024-09-17T04:21:09.440 INFO:tasks.workunit.client.0.smithi088.stdout:5/417: dwrite d2/d31/d33/d20/d25/f57 [0,4194304] 0 2024-09-17T04:21:09.444 INFO:tasks.workunit.client.0.smithi088.stdout:2/454: dwrite d0/f61 [0,4194304] 0 2024-09-17T04:21:09.446 INFO:tasks.workunit.client.1.smithi134.stdout:8/992: creat d4/d11/da1/db3/d10f/f13e x:0 0 0 2024-09-17T04:21:09.448 INFO:tasks.workunit.client.0.smithi088.stdout:5/418: truncate d2/d31/d33/d20/d25/d49/f82 662857 0 2024-09-17T04:21:09.455 INFO:tasks.workunit.client.0.smithi088.stdout:6/528: dwrite d14/d44/d45/d6b/d16/f9c [0,4194304] 0 2024-09-17T04:21:09.469 INFO:tasks.workunit.client.0.smithi088.stdout:2/455: mknod d0/d1/d2d/d33/d4b/d24/d4d/c90 0 2024-09-17T04:21:09.470 INFO:tasks.workunit.client.0.smithi088.stdout:2/456: readlink d0/d1/d2d/d33/d85/l8e 0 2024-09-17T04:21:09.472 INFO:tasks.workunit.client.0.smithi088.stdout:1/488: creat d0/d1/df/d85/da3/fa6 x:0 0 0 2024-09-17T04:21:09.474 INFO:tasks.workunit.client.0.smithi088.stdout:1/489: write d0/d1/d58/f73 [4055748,20979] 0 2024-09-17T04:21:09.474 INFO:tasks.workunit.client.0.smithi088.stdout:5/419: symlink d2/d31/d33/d20/l86 0 2024-09-17T04:21:09.475 INFO:tasks.workunit.client.0.smithi088.stdout:2/457: stat d0/c73 0 2024-09-17T04:21:09.476 INFO:tasks.workunit.client.0.smithi088.stdout:6/529: mkdir d14/d44/dad/dc0 0 2024-09-17T04:21:09.476 INFO:tasks.workunit.client.0.smithi088.stdout:5/420: write d2/d31/d33/d20/f23 [3410062,11189] 0 2024-09-17T04:21:09.477 INFO:tasks.workunit.client.0.smithi088.stdout:1/490: write d0/d13/d84/f71 [941626,33073] 0 2024-09-17T04:21:09.478 INFO:tasks.workunit.client.0.smithi088.stdout:6/530: chown d14/d44/d45/d6b/d16/f8b 67471567 1 2024-09-17T04:21:09.480 INFO:tasks.workunit.client.0.smithi088.stdout:7/493: link d2/d1d/d2e/d7d/f4a d2/d8d/f9d 0 2024-09-17T04:21:09.483 INFO:tasks.workunit.client.1.smithi134.stdout:7/901: link d0/dd/d3a/d3d/d38/d60/fa8 d0/dd/d3a/d3d/d38/f11d 0 2024-09-17T04:21:09.484 INFO:tasks.workunit.client.0.smithi088.stdout:0/322: dread db/d1b/d36/d47/f30 [0,4194304] 0 2024-09-17T04:21:09.485 INFO:tasks.workunit.client.0.smithi088.stdout:5/421: creat d2/d31/d33/d20/d47/f87 x:0 0 0 2024-09-17T04:21:09.486 INFO:tasks.workunit.client.0.smithi088.stdout:2/458: mknod d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/c91 0 2024-09-17T04:21:09.487 INFO:tasks.workunit.client.0.smithi088.stdout:1/491: creat d0/d1/df/d63/fa7 x:0 0 0 2024-09-17T04:21:09.488 INFO:tasks.workunit.client.0.smithi088.stdout:1/492: write d0/d1/df/d63/f6f [692707,53820] 0 2024-09-17T04:21:09.489 INFO:tasks.workunit.client.0.smithi088.stdout:0/323: chown db/d1b/d36/d4a/f40 5 1 2024-09-17T04:21:09.490 INFO:tasks.workunit.client.0.smithi088.stdout:5/422: creat d2/d31/d33/d20/d47/f88 x:0 0 0 2024-09-17T04:21:09.492 INFO:tasks.workunit.client.0.smithi088.stdout:1/493: read d0/d1/d16/d35/f43 [2317736,70159] 0 2024-09-17T04:21:09.492 INFO:tasks.workunit.client.0.smithi088.stdout:6/531: getdents d14/d3a/d41 0 2024-09-17T04:21:09.493 INFO:tasks.workunit.client.0.smithi088.stdout:6/532: chown d14/d44/d45/d6b/d16 64041 1 2024-09-17T04:21:09.496 INFO:tasks.workunit.client.0.smithi088.stdout:0/324: unlink db/d1b/d36/d4a/d20/f41 0 2024-09-17T04:21:09.498 INFO:tasks.workunit.client.0.smithi088.stdout:7/494: truncate d2/d1d/d2e/d7d/f80 653017 0 2024-09-17T04:21:09.498 INFO:tasks.workunit.client.0.smithi088.stdout:1/494: truncate d0/d1/d16/d56/d5b/d87/f93 632461 0 2024-09-17T04:21:09.498 INFO:tasks.workunit.client.0.smithi088.stdout:6/533: read - d14/d44/f8a zero size 2024-09-17T04:21:09.499 INFO:tasks.workunit.client.0.smithi088.stdout:7/495: fdatasync d2/d4/f86 0 2024-09-17T04:21:09.500 INFO:tasks.workunit.client.0.smithi088.stdout:7/496: chown d2/d4/f28 3195 1 2024-09-17T04:21:09.501 INFO:tasks.workunit.client.0.smithi088.stdout:7/497: stat d2/d1d/d2e/d7d/d23/d45/l51 0 2024-09-17T04:21:09.504 INFO:tasks.workunit.client.1.smithi134.stdout:8/993: dwrite d4/d11/da1/dc7/fc6 [0,4194304] 0 2024-09-17T04:21:09.505 INFO:tasks.workunit.client.1.smithi134.stdout:8/994: stat d4/db/d10e 0 2024-09-17T04:21:09.505 INFO:tasks.workunit.client.0.smithi088.stdout:7/498: unlink d2/d1d/d2e/d7d/l93 0 2024-09-17T04:21:09.505 INFO:tasks.workunit.client.1.smithi134.stdout:5/955: dwrite d0/da/d29/d7c/db3/fd8 [0,4194304] 0 2024-09-17T04:21:09.509 INFO:tasks.workunit.client.0.smithi088.stdout:0/325: rename db/d1b/d36/d47/d37 to db/d1b/d36/d4a/d6a 0 2024-09-17T04:21:09.510 INFO:tasks.workunit.client.0.smithi088.stdout:7/499: fsync d2/d1d/d2e/d7d/d23/d45/f4d 0 2024-09-17T04:21:09.511 INFO:tasks.workunit.client.0.smithi088.stdout:7/500: chown d2/d4/d7/f10 14 1 2024-09-17T04:21:09.511 INFO:tasks.workunit.client.0.smithi088.stdout:4/474: write d5/d3d/d73/d7e/d5e/f61 [333145,74460] 0 2024-09-17T04:21:09.512 INFO:tasks.workunit.client.1.smithi134.stdout:5/956: dread d0/da/d29/d78/da5/dce/fee [0,4194304] 0 2024-09-17T04:21:09.512 INFO:tasks.workunit.client.0.smithi088.stdout:7/501: chown d2/d4/c1f 6 1 2024-09-17T04:21:09.513 INFO:tasks.workunit.client.0.smithi088.stdout:6/534: rename d14/d3a/l99 to d14/d44/d45/d6b/d2a/d52/lc1 0 2024-09-17T04:21:09.514 INFO:tasks.workunit.client.1.smithi134.stdout:5/957: fdatasync d0/da/d29/f9b 0 2024-09-17T04:21:09.516 INFO:tasks.workunit.client.1.smithi134.stdout:8/995: symlink d4/db/dd/d43/l13f 0 2024-09-17T04:21:09.519 INFO:tasks.workunit.client.0.smithi088.stdout:7/502: dread d2/f1b [0,4194304] 0 2024-09-17T04:21:09.521 INFO:tasks.workunit.client.1.smithi134.stdout:8/996: dwrite d4/d1e/daf/f6d [0,4194304] 0 2024-09-17T04:21:09.523 INFO:tasks.workunit.client.0.smithi088.stdout:6/535: dread d14/d44/d45/d6b/d29/fab [0,4194304] 0 2024-09-17T04:21:09.523 INFO:tasks.workunit.client.0.smithi088.stdout:3/552: truncate d0/d13/d58/d5a/d63/f75 953380 0 2024-09-17T04:21:09.528 INFO:tasks.workunit.client.0.smithi088.stdout:0/326: mkdir db/d1b/d36/d4a/d6b 0 2024-09-17T04:21:09.529 INFO:tasks.workunit.client.1.smithi134.stdout:8/997: rmdir d4/db/dd/d95 39 2024-09-17T04:21:09.532 INFO:tasks.workunit.client.1.smithi134.stdout:5/958: symlink d0/d3a/d6b/d9c/l13c 0 2024-09-17T04:21:09.534 INFO:tasks.workunit.client.0.smithi088.stdout:7/503: creat d2/d1d/d2e/d7d/d23/d45/d62/f9e x:0 0 0 2024-09-17T04:21:09.536 INFO:tasks.workunit.client.0.smithi088.stdout:7/504: write d2/d1d/d2e/d7d/d23/d45/d85/f92 [942206,24407] 0 2024-09-17T04:21:09.537 INFO:tasks.workunit.client.0.smithi088.stdout:2/459: write d0/f12 [1636458,46348] 0 2024-09-17T04:21:09.538 INFO:tasks.workunit.client.0.smithi088.stdout:2/460: chown d0/c20 73607 1 2024-09-17T04:21:09.539 INFO:tasks.workunit.client.0.smithi088.stdout:3/553: creat d0/d13/d1b/d29/d2b/d50/fb4 x:0 0 0 2024-09-17T04:21:09.540 INFO:tasks.workunit.client.0.smithi088.stdout:2/461: write d0/d1/d2d/d33/d80/f3e [1301400,13266] 0 2024-09-17T04:21:09.541 INFO:tasks.workunit.client.0.smithi088.stdout:6/536: mknod d14/d44/d45/d6b/d2a/d52/d7a/d7b/cc2 0 2024-09-17T04:21:09.544 INFO:tasks.workunit.client.0.smithi088.stdout:7/505: dread d2/d1d/d2e/d7d/d23/d45/f4d [0,4194304] 0 2024-09-17T04:21:09.545 INFO:tasks.workunit.client.0.smithi088.stdout:5/423: write d2/f38 [551671,57384] 0 2024-09-17T04:21:09.547 INFO:tasks.workunit.client.1.smithi134.stdout:5/959: fdatasync d0/da/d2c/f4b 0 2024-09-17T04:21:09.547 INFO:tasks.workunit.client.0.smithi088.stdout:0/327: rename db/d1b/d39/l5a to db/d1b/d39/l6c 0 2024-09-17T04:21:09.548 INFO:tasks.workunit.client.1.smithi134.stdout:5/960: chown d0/d3a/f5b 1820131 1 2024-09-17T04:21:09.548 INFO:tasks.workunit.client.1.smithi134.stdout:8/998: rmdir d4/d1f/d2b/dbf/dcc/d13a 0 2024-09-17T04:21:09.549 INFO:tasks.workunit.client.1.smithi134.stdout:8/999: read d4/fcf [602543,79812] 0 2024-09-17T04:21:09.550 INFO:tasks.workunit.client.0.smithi088.stdout:7/506: dread d2/d4/f33 [0,4194304] 0 2024-09-17T04:21:09.551 INFO:tasks.workunit.client.0.smithi088.stdout:1/495: truncate d0/d1/d16/d35/f5f 2291766 0 2024-09-17T04:21:09.553 INFO:tasks.workunit.client.0.smithi088.stdout:1/496: fsync d0/d1/d16/d2a/f53 0 2024-09-17T04:21:09.554 INFO:tasks.workunit.client.0.smithi088.stdout:7/507: dread d2/d1d/d2e/d7d/d23/d45/f4d [0,4194304] 0 2024-09-17T04:21:09.555 INFO:tasks.workunit.client.0.smithi088.stdout:0/328: dwrite db/d1b/d36/d4a/d6a/f68 [0,4194304] 0 2024-09-17T04:21:09.559 INFO:tasks.workunit.client.0.smithi088.stdout:4/475: write d5/d32/f79 [2356018,6781] 0 2024-09-17T04:21:09.563 INFO:tasks.workunit.client.0.smithi088.stdout:3/554: truncate d0/d13/d1b/d29/d2b/d50/f74 487199 0 2024-09-17T04:21:09.563 INFO:tasks.workunit.client.0.smithi088.stdout:3/555: chown d0/d13/f22 3 1 2024-09-17T04:21:09.567 INFO:tasks.workunit.client.0.smithi088.stdout:5/424: mknod d2/d31/d33/d20/d30/d51/d5e/c89 0 2024-09-17T04:21:09.567 INFO:tasks.workunit.client.0.smithi088.stdout:5/425: fsync d2/d31/d33/f18 0 2024-09-17T04:21:09.580 INFO:tasks.workunit.client.0.smithi088.stdout:6/537: mknod d14/d2f/d87/d9d/cc3 0 2024-09-17T04:21:09.583 INFO:tasks.workunit.client.0.smithi088.stdout:3/556: rename d0/d13/d4d/f7c to d0/d13/d58/d5e/fb5 0 2024-09-17T04:21:09.584 INFO:tasks.workunit.client.0.smithi088.stdout:3/557: truncate d0/d54/f7f 1011755 0 2024-09-17T04:21:09.586 INFO:tasks.workunit.client.0.smithi088.stdout:5/426: mkdir d2/d31/d33/d20/d25/d2c/d8a 0 2024-09-17T04:21:09.588 INFO:tasks.workunit.client.0.smithi088.stdout:1/497: symlink d0/d1/d16/d2a/d9c/la8 0 2024-09-17T04:21:09.590 INFO:tasks.workunit.client.0.smithi088.stdout:1/498: read d0/f94 [2712199,125156] 0 2024-09-17T04:21:09.590 INFO:tasks.workunit.client.0.smithi088.stdout:5/427: dread d2/f40 [0,4194304] 0 2024-09-17T04:21:09.591 INFO:tasks.workunit.client.0.smithi088.stdout:5/428: read d2/f10 [706033,33155] 0 2024-09-17T04:21:09.593 INFO:tasks.workunit.client.0.smithi088.stdout:5/429: truncate d2/d31/d33/d20/d30/d51/d5e/f7f 451376 0 2024-09-17T04:21:09.594 INFO:tasks.workunit.client.0.smithi088.stdout:6/538: read d14/d44/d45/d6b/d29/d3e/f37 [3987993,46023] 0 2024-09-17T04:21:09.595 INFO:tasks.workunit.client.0.smithi088.stdout:4/476: unlink d5/l82 0 2024-09-17T04:21:09.596 INFO:tasks.workunit.client.0.smithi088.stdout:6/539: fdatasync d14/d44/d45/d6b/d16/f6a 0 2024-09-17T04:21:09.596 INFO:tasks.workunit.client.0.smithi088.stdout:4/477: chown d5/d3d/d73/d7e 0 1 2024-09-17T04:21:09.597 INFO:tasks.workunit.client.0.smithi088.stdout:3/558: mknod d0/d13/d8a/cb6 0 2024-09-17T04:21:09.600 INFO:tasks.workunit.client.0.smithi088.stdout:7/508: creat d2/d4/d7/f9f x:0 0 0 2024-09-17T04:21:09.603 INFO:tasks.workunit.client.0.smithi088.stdout:0/329: rmdir db/d1b/d36/d4a/d6b 0 2024-09-17T04:21:09.606 INFO:tasks.workunit.client.0.smithi088.stdout:2/462: getdents d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/d7c 0 2024-09-17T04:21:09.607 INFO:tasks.workunit.client.0.smithi088.stdout:2/463: readlink d0/d1/d2d/d33/d4b/d24/d3b/d22/l44 0 2024-09-17T04:21:09.608 INFO:tasks.workunit.client.1.smithi134.stdout:7/902: sync 2024-09-17T04:21:09.610 INFO:tasks.workunit.client.0.smithi088.stdout:6/540: mknod d14/d44/d45/d6b/d29/cc4 0 2024-09-17T04:21:09.611 INFO:tasks.workunit.client.0.smithi088.stdout:4/478: creat d5/d3f/d71/d99/f9d x:0 0 0 2024-09-17T04:21:09.613 INFO:tasks.workunit.client.0.smithi088.stdout:3/559: creat d0/d54/fb7 x:0 0 0 2024-09-17T04:21:09.615 INFO:tasks.workunit.client.1.smithi134.stdout:5/961: dwrite d0/d3a/d2b/d61/f104 [0,4194304] 0 2024-09-17T04:21:09.615 INFO:tasks.workunit.client.1.smithi134.stdout:7/903: dread d0/dd/db9/f9c [0,4194304] 0 2024-09-17T04:21:09.622 INFO:tasks.workunit.client.0.smithi088.stdout:5/430: mkdir d2/d31/d33/d20/d8b 0 2024-09-17T04:21:09.624 INFO:tasks.workunit.client.0.smithi088.stdout:2/464: rmdir d0/d1/d2d 39 2024-09-17T04:21:09.625 INFO:tasks.workunit.client.0.smithi088.stdout:6/541: chown d14/l28 8415 1 2024-09-17T04:21:09.628 INFO:tasks.workunit.client.0.smithi088.stdout:3/560: fsync d0/d13/d1b/d29/d30/f48 0 2024-09-17T04:21:09.635 INFO:tasks.workunit.client.0.smithi088.stdout:1/499: getdents d0 0 2024-09-17T04:21:09.636 INFO:tasks.workunit.client.0.smithi088.stdout:3/561: mkdir d0/d13/d58/d5a/d63/d80/db8 0 2024-09-17T04:21:09.637 INFO:tasks.workunit.client.0.smithi088.stdout:6/542: mkdir d14/d44/d94/db9/dc5 0 2024-09-17T04:21:09.639 INFO:tasks.workunit.client.0.smithi088.stdout:2/465: mkdir d0/d1/d2d/d33/d4b/d24/d92 0 2024-09-17T04:21:09.640 INFO:tasks.workunit.client.0.smithi088.stdout:4/479: creat d5/d3d/d73/d7e/d5e/f9e x:0 0 0 2024-09-17T04:21:09.641 INFO:tasks.workunit.client.0.smithi088.stdout:1/500: dwrite d0/f4 [0,4194304] 0 2024-09-17T04:21:09.641 INFO:tasks.workunit.client.0.smithi088.stdout:0/330: write db/f1d [585858,126841] 0 2024-09-17T04:21:09.642 INFO:tasks.workunit.client.0.smithi088.stdout:3/562: mkdir d0/d54/d55/db9 0 2024-09-17T04:21:09.644 INFO:tasks.workunit.client.0.smithi088.stdout:2/466: readlink d0/d1/d2d/d33/d4b/d24/d3b/d26/l27 0 2024-09-17T04:21:09.646 INFO:tasks.workunit.client.1.smithi134.stdout:7/904: truncate d0/dd/dbb/fd4 405499 0 2024-09-17T04:21:09.646 INFO:tasks.workunit.client.0.smithi088.stdout:0/331: fsync db/fc 0 2024-09-17T04:21:09.646 INFO:tasks.workunit.client.1.smithi134.stdout:5/962: dwrite d0/da/d2c/f9d [0,4194304] 0 2024-09-17T04:21:09.647 INFO:tasks.workunit.client.0.smithi088.stdout:6/543: link d14/d44/d45/d6b/d29/d3e/f33 d14/d44/d94/db9/fc6 0 2024-09-17T04:21:09.650 INFO:tasks.workunit.client.1.smithi134.stdout:5/963: mkdir d0/da/d29/d7c/d9e/d13d 0 2024-09-17T04:21:09.651 INFO:tasks.workunit.client.1.smithi134.stdout:5/964: dread - d0/da/d69/f66 zero size 2024-09-17T04:21:09.651 INFO:tasks.workunit.client.0.smithi088.stdout:2/467: dread d0/d1/d2d/f3a [0,4194304] 0 2024-09-17T04:21:09.652 INFO:tasks.workunit.client.0.smithi088.stdout:7/509: dwrite d2/d1d/d2e/d7d/d23/d45/f57 [0,4194304] 0 2024-09-17T04:21:09.652 INFO:tasks.workunit.client.1.smithi134.stdout:5/965: fdatasync d0/da/d69/d41/d6d/fb8 0 2024-09-17T04:21:09.652 INFO:tasks.workunit.client.0.smithi088.stdout:1/501: fsync d0/d1/d16/d56/d5b/f82 0 2024-09-17T04:21:09.653 INFO:tasks.workunit.client.1.smithi134.stdout:5/966: chown d0/da/d69/d41/d6d/f76 5543 1 2024-09-17T04:21:09.653 INFO:tasks.workunit.client.0.smithi088.stdout:4/480: creat d5/d3d/f9f x:0 0 0 2024-09-17T04:21:09.654 INFO:tasks.workunit.client.1.smithi134.stdout:5/967: write d0/d48/f82 [2694917,5743] 0 2024-09-17T04:21:09.654 INFO:tasks.workunit.client.0.smithi088.stdout:6/544: chown d14/d44/d45/d6b/d2a/d52/d7a/c98 267674 1 2024-09-17T04:21:09.656 INFO:tasks.workunit.client.0.smithi088.stdout:3/563: creat d0/d13/d1b/d29/d30/d35/d65/fba x:0 0 0 2024-09-17T04:21:09.657 INFO:tasks.workunit.client.0.smithi088.stdout:7/510: chown d2/d4/d7/c13 188 1 2024-09-17T04:21:09.660 INFO:tasks.workunit.client.0.smithi088.stdout:5/431: dwrite d2/d31/d33/f37 [0,4194304] 0 2024-09-17T04:21:09.660 INFO:tasks.workunit.client.0.smithi088.stdout:2/468: dread - d0/fd zero size 2024-09-17T04:21:09.661 INFO:tasks.workunit.client.0.smithi088.stdout:5/432: chown d2/d31/c83 2167631 1 2024-09-17T04:21:09.666 INFO:tasks.workunit.client.0.smithi088.stdout:2/469: dread - d0/d1/d2d/d33/d4b/d24/f7a zero size 2024-09-17T04:21:09.668 INFO:tasks.workunit.client.0.smithi088.stdout:0/332: creat db/f6d x:0 0 0 2024-09-17T04:21:09.668 INFO:tasks.workunit.client.1.smithi134.stdout:7/905: dread d0/d16/d35/d8d/f10c [0,4194304] 0 2024-09-17T04:21:09.670 INFO:tasks.workunit.client.0.smithi088.stdout:1/502: write d0/d13/f47 [182245,39765] 0 2024-09-17T04:21:09.671 INFO:tasks.workunit.client.0.smithi088.stdout:3/564: rmdir d0/d13/d1b 39 2024-09-17T04:21:09.673 INFO:tasks.workunit.client.0.smithi088.stdout:2/470: dread d0/d1/d2d/d33/d4b/d24/d3b/f59 [0,4194304] 0 2024-09-17T04:21:09.674 INFO:tasks.workunit.client.1.smithi134.stdout:5/968: getdents d0/d3a/d6b/d10f 0 2024-09-17T04:21:09.675 INFO:tasks.workunit.client.1.smithi134.stdout:5/969: write d0/d3a/d2b/d61/f104 [4654863,65608] 0 2024-09-17T04:21:09.675 INFO:tasks.workunit.client.0.smithi088.stdout:7/511: rename d2/f1a to d2/d1d/d2e/fa0 0 2024-09-17T04:21:09.677 INFO:tasks.workunit.client.0.smithi088.stdout:5/433: symlink d2/d31/d33/d20/d30/d51/d5e/d6b/l8c 0 2024-09-17T04:21:09.680 INFO:tasks.workunit.client.0.smithi088.stdout:0/333: mknod db/d1b/d39/c6e 0 2024-09-17T04:21:09.680 INFO:tasks.workunit.client.1.smithi134.stdout:5/970: dread - d0/da/d2c/f70 zero size 2024-09-17T04:21:09.681 INFO:tasks.workunit.client.1.smithi134.stdout:7/906: rmdir d0/d16/d35/d4b/dff 0 2024-09-17T04:21:09.682 INFO:tasks.workunit.client.0.smithi088.stdout:1/503: unlink d0/d1/d16/d77/l81 0 2024-09-17T04:21:09.682 INFO:tasks.workunit.client.0.smithi088.stdout:9/526: sync 2024-09-17T04:21:09.682 INFO:tasks.workunit.client.0.smithi088.stdout:8/483: sync 2024-09-17T04:21:09.689 INFO:tasks.workunit.client.0.smithi088.stdout:6/545: write d14/d44/d45/d6b/d29/d3e/f33 [2442450,14135] 0 2024-09-17T04:21:09.690 INFO:tasks.workunit.client.0.smithi088.stdout:5/434: creat d2/d31/d33/d20/d25/d49/f8d x:0 0 0 2024-09-17T04:21:09.690 INFO:tasks.workunit.client.0.smithi088.stdout:0/334: rmdir db/d1b/d39 39 2024-09-17T04:21:09.691 INFO:tasks.workunit.client.0.smithi088.stdout:4/481: write d5/d32/f67 [39500,121871] 0 2024-09-17T04:21:09.692 INFO:tasks.workunit.client.0.smithi088.stdout:5/435: write d2/d31/d33/f54 [801762,14383] 0 2024-09-17T04:21:09.693 INFO:tasks.workunit.client.0.smithi088.stdout:9/527: mkdir d2/dd/d14/d2a/d76/db6 0 2024-09-17T04:21:09.694 INFO:tasks.workunit.client.0.smithi088.stdout:5/436: chown d2/d31/f77 0 1 2024-09-17T04:21:09.694 INFO:tasks.workunit.client.0.smithi088.stdout:8/484: creat d7/d29/d2a/d38/f9c x:0 0 0 2024-09-17T04:21:09.697 INFO:tasks.workunit.client.0.smithi088.stdout:8/485: write d7/dd/d31/d47/d55/d57/f84 [56136,20077] 0 2024-09-17T04:21:09.698 INFO:tasks.workunit.client.0.smithi088.stdout:8/486: chown d7/f8 203033 1 2024-09-17T04:21:09.699 INFO:tasks.workunit.client.0.smithi088.stdout:7/512: symlink d2/d8d/la1 0 2024-09-17T04:21:09.699 INFO:tasks.workunit.client.0.smithi088.stdout:1/504: dread d0/d13/f68 [0,4194304] 0 2024-09-17T04:21:09.701 INFO:tasks.workunit.client.1.smithi134.stdout:7/907: write d0/dd/fc4 [320081,64817] 0 2024-09-17T04:21:09.702 INFO:tasks.workunit.client.0.smithi088.stdout:4/482: mknod d5/d32/d6b/ca0 0 2024-09-17T04:21:09.703 INFO:tasks.workunit.client.0.smithi088.stdout:9/528: creat d2/d2b/d58/fb7 x:0 0 0 2024-09-17T04:21:09.708 INFO:tasks.workunit.client.1.smithi134.stdout:7/908: rename d0/dd/d3a/d3d/d4c/fb1 to d0/dd/d3a/d3d/d38/d60/d75/f11e 0 2024-09-17T04:21:09.708 INFO:tasks.workunit.client.0.smithi088.stdout:5/437: rename d2/d31/d33/f18 to d2/d31/d33/d20/d47/f8e 0 2024-09-17T04:21:09.709 INFO:tasks.workunit.client.0.smithi088.stdout:2/471: creat d0/d1/f93 x:0 0 0 2024-09-17T04:21:09.711 INFO:tasks.workunit.client.1.smithi134.stdout:7/909: dread d0/d16/d35/d8d/dd0/f10e [0,4194304] 0 2024-09-17T04:21:09.712 INFO:tasks.workunit.client.0.smithi088.stdout:1/505: symlink d0/d1/d16/d35/la9 0 2024-09-17T04:21:09.712 INFO:tasks.workunit.client.0.smithi088.stdout:0/335: fsync db/d1b/d39/f3d 0 2024-09-17T04:21:09.713 INFO:tasks.workunit.client.0.smithi088.stdout:3/565: dwrite d0/d13/d1b/d29/f3b [0,4194304] 0 2024-09-17T04:21:09.714 INFO:tasks.workunit.client.0.smithi088.stdout:1/506: write d0/d13/f47 [3291141,129984] 0 2024-09-17T04:21:09.714 INFO:tasks.workunit.client.1.smithi134.stdout:7/910: fdatasync d0/d16/d35/d8d/f10c 0 2024-09-17T04:21:09.715 INFO:tasks.workunit.client.1.smithi134.stdout:7/911: read - d0/f116 zero size 2024-09-17T04:21:09.715 INFO:tasks.workunit.client.0.smithi088.stdout:1/507: write d0/d1/d16/f3c [4390881,118803] 0 2024-09-17T04:21:09.717 INFO:tasks.workunit.client.0.smithi088.stdout:1/508: chown d0/d13/d84/d5d/f65 202528 1 2024-09-17T04:21:09.718 INFO:tasks.workunit.client.0.smithi088.stdout:5/438: rmdir d2 39 2024-09-17T04:21:09.720 INFO:tasks.workunit.client.1.smithi134.stdout:7/912: mkdir d0/d16/d35/d8d/d11f 0 2024-09-17T04:21:09.721 INFO:tasks.workunit.client.0.smithi088.stdout:7/513: rename d2/d4/d7/f2a to d2/d96/fa2 0 2024-09-17T04:21:09.721 INFO:tasks.workunit.client.0.smithi088.stdout:8/487: write d7/d29/f6e [755477,75661] 0 2024-09-17T04:21:09.723 INFO:tasks.workunit.client.0.smithi088.stdout:7/514: readlink d2/d1d/d2e/d7d/d23/l68 0 2024-09-17T04:21:09.724 INFO:tasks.workunit.client.0.smithi088.stdout:6/546: creat d14/d44/d45/fc7 x:0 0 0 2024-09-17T04:21:09.724 INFO:tasks.workunit.client.0.smithi088.stdout:7/515: write d2/d4/f86 [149971,31930] 0 2024-09-17T04:21:09.726 INFO:tasks.workunit.client.0.smithi088.stdout:6/547: chown d14/d44/d45/d6b/d2a/d52/d7a/d7b/cbc 45245 1 2024-09-17T04:21:09.728 INFO:tasks.workunit.client.0.smithi088.stdout:3/566: write d0/fb0 [4060482,57729] 0 2024-09-17T04:21:09.728 INFO:tasks.workunit.client.1.smithi134.stdout:7/913: link d0/d16/d35/d4b/l92 d0/d16/d8b/d6a/d70/dde/l120 0 2024-09-17T04:21:09.729 INFO:tasks.workunit.client.1.smithi134.stdout:7/914: chown d0/dd/d3a/d3d/lee 0 1 2024-09-17T04:21:09.729 INFO:tasks.workunit.client.0.smithi088.stdout:0/336: chown db/d1b/d36/d4a/l24 400629 1 2024-09-17T04:21:09.733 INFO:tasks.workunit.client.1.smithi134.stdout:7/915: symlink d0/d16/d35/d8d/d11f/l121 0 2024-09-17T04:21:09.735 INFO:tasks.workunit.client.0.smithi088.stdout:1/509: rename d0/d1/d16/d56 to d0/d1/d16/d77/daa 0 2024-09-17T04:21:09.736 INFO:tasks.workunit.client.1.smithi134.stdout:7/916: creat d0/d16/d35/d4b/d65/f122 x:0 0 0 2024-09-17T04:21:09.736 INFO:tasks.workunit.client.1.smithi134.stdout:7/917: fdatasync d0/d16/d35/d4b/d65/f10d 0 2024-09-17T04:21:09.737 INFO:tasks.workunit.client.0.smithi088.stdout:8/488: read - d7/dd/d31/f6d zero size 2024-09-17T04:21:09.737 INFO:tasks.workunit.client.0.smithi088.stdout:0/337: dwrite db/f19 [8388608,4194304] 0 2024-09-17T04:21:09.739 INFO:tasks.workunit.client.0.smithi088.stdout:4/483: creat d5/fa1 x:0 0 0 2024-09-17T04:21:09.739 INFO:tasks.workunit.client.0.smithi088.stdout:2/472: dwrite d0/d1/d2d/d33/d4b/f2e [0,4194304] 0 2024-09-17T04:21:09.741 INFO:tasks.workunit.client.0.smithi088.stdout:0/338: read - db/d3c/d4f/f52 zero size 2024-09-17T04:21:09.742 INFO:tasks.workunit.client.1.smithi134.stdout:7/918: symlink d0/dd/d3a/d3d/d38/d60/l123 0 2024-09-17T04:21:09.742 INFO:tasks.workunit.client.0.smithi088.stdout:3/567: creat d0/d13/d58/d5a/d63/fbb x:0 0 0 2024-09-17T04:21:09.742 INFO:tasks.workunit.client.0.smithi088.stdout:4/484: fdatasync d5/d3f/d71/d99/f9d 0 2024-09-17T04:21:09.745 INFO:tasks.workunit.client.0.smithi088.stdout:9/529: rmdir d2/dd/d14/d2a/d76/db6 0 2024-09-17T04:21:09.747 INFO:tasks.workunit.client.0.smithi088.stdout:4/485: write d5/f2d [1535320,67621] 0 2024-09-17T04:21:09.750 INFO:tasks.workunit.client.0.smithi088.stdout:3/568: truncate d0/d13/d1b/d29/d30/f9e 685376 0 2024-09-17T04:21:09.753 INFO:tasks.workunit.client.0.smithi088.stdout:7/516: mkdir d2/d4/d7/d46/da3 0 2024-09-17T04:21:09.754 INFO:tasks.workunit.client.1.smithi134.stdout:7/919: creat d0/d16/d35/d4b/d11c/f124 x:0 0 0 2024-09-17T04:21:09.755 INFO:tasks.workunit.client.0.smithi088.stdout:0/339: dwrite db/d1b/d39/f62 [0,4194304] 0 2024-09-17T04:21:09.758 INFO:tasks.workunit.client.0.smithi088.stdout:6/548: write d14/d44/d45/d6b/d16/f2e [2920737,45351] 0 2024-09-17T04:21:09.758 INFO:tasks.workunit.client.0.smithi088.stdout:8/489: dwrite d7/dd/d31/d47/d55/d57/f98 [0,4194304] 0 2024-09-17T04:21:09.773 INFO:tasks.workunit.client.0.smithi088.stdout:2/473: mkdir d0/d1/d2d/d33/d4b/d6d/d94 0 2024-09-17T04:21:09.774 INFO:tasks.workunit.client.0.smithi088.stdout:6/549: dread d14/d3a/d41/f84 [0,4194304] 0 2024-09-17T04:21:09.782 INFO:tasks.workunit.client.0.smithi088.stdout:8/490: creat d7/d29/d2a/d3a/f9d x:0 0 0 2024-09-17T04:21:09.782 INFO:tasks.workunit.client.0.smithi088.stdout:6/550: dread d14/d44/d45/d6b/d16/f9c [0,4194304] 0 2024-09-17T04:21:09.783 INFO:tasks.workunit.client.1.smithi134.stdout:5/971: sync 2024-09-17T04:21:09.783 INFO:tasks.workunit.client.0.smithi088.stdout:4/486: mknod d5/d32/ca2 0 2024-09-17T04:21:09.783 INFO:tasks.workunit.client.0.smithi088.stdout:2/474: dwrite d0/d1/d2d/d33/d4b/d24/d3b/d22/f64 [0,4194304] 0 2024-09-17T04:21:09.785 INFO:tasks.workunit.client.0.smithi088.stdout:1/510: dread d0/d1/df/d63/fa0 [0,4194304] 0 2024-09-17T04:21:09.787 INFO:tasks.workunit.client.0.smithi088.stdout:1/511: readlink d0/d1/l3d 0 2024-09-17T04:21:09.787 INFO:tasks.workunit.client.0.smithi088.stdout:4/487: stat d5/d3f/d71/d99/c9a 0 2024-09-17T04:21:09.787 INFO:tasks.workunit.client.0.smithi088.stdout:0/340: getdents db/d67 0 2024-09-17T04:21:09.791 INFO:tasks.workunit.client.0.smithi088.stdout:8/491: symlink d7/d29/l9e 0 2024-09-17T04:21:09.792 INFO:tasks.workunit.client.0.smithi088.stdout:3/569: creat d0/d13/d1b/d29/d2b/fbc x:0 0 0 2024-09-17T04:21:09.793 INFO:tasks.workunit.client.0.smithi088.stdout:5/439: truncate d2/d31/d33/d20/f23 3910724 0 2024-09-17T04:21:09.793 INFO:tasks.workunit.client.1.smithi134.stdout:7/920: dwrite d0/d16/d8b/d6a/d70/d85/f93 [0,4194304] 0 2024-09-17T04:21:09.796 INFO:tasks.workunit.client.0.smithi088.stdout:2/475: dwrite d0/d1/d2d/d33/d4b/d24/d3b/f8f [0,4194304] 0 2024-09-17T04:21:09.797 INFO:tasks.workunit.client.0.smithi088.stdout:1/512: unlink d0/d1/f1a 0 2024-09-17T04:21:09.797 INFO:tasks.workunit.client.0.smithi088.stdout:5/440: write d2/d31/d33/f2f [3168798,66671] 0 2024-09-17T04:21:09.797 INFO:tasks.workunit.client.0.smithi088.stdout:7/517: write d2/d1d/d2e/d7d/d23/f35 [926816,103778] 0 2024-09-17T04:21:09.798 INFO:tasks.workunit.client.0.smithi088.stdout:4/488: truncate d5/d32/f44 667964 0 2024-09-17T04:21:09.803 INFO:tasks.workunit.client.0.smithi088.stdout:8/492: mknod d7/dd/d31/c9f 0 2024-09-17T04:21:09.804 INFO:tasks.workunit.client.1.smithi134.stdout:7/921: symlink d0/d16/d8b/d6a/de6/l125 0 2024-09-17T04:21:09.807 INFO:tasks.workunit.client.0.smithi088.stdout:1/513: symlink d0/d1/d16/d2a/lab 0 2024-09-17T04:21:09.809 INFO:tasks.workunit.client.1.smithi134.stdout:5/972: dwrite d0/da/d2c/d73/fa3 [0,4194304] 0 2024-09-17T04:21:09.810 INFO:tasks.workunit.client.0.smithi088.stdout:7/518: creat d2/d1d/d2e/d7d/d23/d45/d85/fa4 x:0 0 0 2024-09-17T04:21:09.811 INFO:tasks.workunit.client.0.smithi088.stdout:8/493: mkdir d7/d29/d2a/d38/d3d/da0 0 2024-09-17T04:21:09.812 INFO:tasks.workunit.client.0.smithi088.stdout:3/570: getdents d0/d13/d1b/d29/d2b/d8b 0 2024-09-17T04:21:09.815 INFO:tasks.workunit.client.0.smithi088.stdout:5/441: symlink d2/d31/d33/d20/d25/l8f 0 2024-09-17T04:21:09.826 INFO:tasks.workunit.client.0.smithi088.stdout:8/494: mknod d7/dd/ca1 0 2024-09-17T04:21:09.829 INFO:tasks.workunit.client.0.smithi088.stdout:6/551: dwrite d14/f32 [0,4194304] 0 2024-09-17T04:21:09.831 INFO:tasks.workunit.client.0.smithi088.stdout:6/552: chown d14/d44/d45/fbe 977148432 1 2024-09-17T04:21:09.836 INFO:tasks.workunit.client.0.smithi088.stdout:1/514: getdents d0/d1/df/d20 0 2024-09-17T04:21:09.836 INFO:tasks.workunit.client.1.smithi134.stdout:7/922: dwrite d0/dd/d3a/d3d/d38/d60/fa8 [0,4194304] 0 2024-09-17T04:21:09.837 INFO:tasks.workunit.client.0.smithi088.stdout:4/489: truncate d5/d3f/f41 2556619 0 2024-09-17T04:21:09.838 INFO:tasks.workunit.client.1.smithi134.stdout:7/923: dread d0/dd/d3a/f9a [0,4194304] 0 2024-09-17T04:21:09.838 INFO:tasks.workunit.client.0.smithi088.stdout:6/553: mkdir d14/d44/d94/db9/dc8 0 2024-09-17T04:21:09.838 INFO:tasks.workunit.client.0.smithi088.stdout:3/571: dwrite d0/f4 [0,4194304] 0 2024-09-17T04:21:09.840 INFO:tasks.workunit.client.1.smithi134.stdout:5/973: dread d0/d48/f82 [0,4194304] 0 2024-09-17T04:21:09.844 INFO:tasks.workunit.client.0.smithi088.stdout:7/519: write d2/d4/d7/d20/f22 [2403390,13778] 0 2024-09-17T04:21:09.847 INFO:tasks.workunit.client.0.smithi088.stdout:6/554: chown d14/cbb 248175 1 2024-09-17T04:21:09.848 INFO:tasks.workunit.client.0.smithi088.stdout:1/515: creat d0/d13/d84/fac x:0 0 0 2024-09-17T04:21:09.849 INFO:tasks.workunit.client.1.smithi134.stdout:5/974: creat d0/da/d69/d41/d6d/d89/dd5/f13e x:0 0 0 2024-09-17T04:21:09.849 INFO:tasks.workunit.client.0.smithi088.stdout:2/476: dwrite d0/d1/d2d/d33/f38 [0,4194304] 0 2024-09-17T04:21:09.851 INFO:tasks.workunit.client.0.smithi088.stdout:3/572: rename d0/d13/d1b/d29/d30/l4b to d0/dae/lbd 0 2024-09-17T04:21:09.853 INFO:tasks.workunit.client.1.smithi134.stdout:7/924: rename d0/d16/d35/d8d/dd0/f103 to d0/dd/d3a/d3d/d38/d60/f126 0 2024-09-17T04:21:09.855 INFO:tasks.workunit.client.0.smithi088.stdout:5/442: dread d2/d31/d33/f1f [0,4194304] 0 2024-09-17T04:21:09.856 INFO:tasks.workunit.client.1.smithi134.stdout:5/975: dwrite d0/da/d29/d7c/d9e/fc1 [0,4194304] 0 2024-09-17T04:21:09.856 INFO:tasks.workunit.client.0.smithi088.stdout:2/477: unlink d0/c10 0 2024-09-17T04:21:09.859 INFO:tasks.workunit.client.0.smithi088.stdout:4/490: dwrite d5/d3f/d71/d8b/f88 [0,4194304] 0 2024-09-17T04:21:09.860 INFO:tasks.workunit.client.1.smithi134.stdout:7/925: creat d0/d16/d35/d4b/d11c/f127 x:0 0 0 2024-09-17T04:21:09.860 INFO:tasks.workunit.client.1.smithi134.stdout:5/976: truncate d0/da/d29/db5/f115 2590539 0 2024-09-17T04:21:09.862 INFO:tasks.workunit.client.1.smithi134.stdout:7/926: readlink d0/dd/d3a/d3d/l5e 0 2024-09-17T04:21:09.863 INFO:tasks.workunit.client.1.smithi134.stdout:7/927: write d0/dd/db9/f94 [24397,25808] 0 2024-09-17T04:21:09.863 INFO:tasks.workunit.client.0.smithi088.stdout:1/516: rename d0/f6a to d0/d1/d16/d2a/fad 0 2024-09-17T04:21:09.865 INFO:tasks.workunit.client.1.smithi134.stdout:7/928: truncate d0/d16/d35/d4b/d11c/f127 70842 0 2024-09-17T04:21:09.866 INFO:tasks.workunit.client.1.smithi134.stdout:7/929: dread - d0/d16/d35/ff3 zero size 2024-09-17T04:21:09.866 INFO:tasks.workunit.client.0.smithi088.stdout:3/573: unlink d0/d13/d1b/d29/l3a 0 2024-09-17T04:21:09.867 INFO:tasks.workunit.client.0.smithi088.stdout:2/478: dwrite d0/f5d [0,4194304] 0 2024-09-17T04:21:09.872 INFO:tasks.workunit.client.0.smithi088.stdout:4/491: creat d5/d72/fa3 x:0 0 0 2024-09-17T04:21:09.873 INFO:tasks.workunit.client.0.smithi088.stdout:4/492: chown d5/d3d/c40 0 1 2024-09-17T04:21:09.878 INFO:tasks.workunit.client.0.smithi088.stdout:6/555: write d14/d44/d45/d6b/f96 [446043,91935] 0 2024-09-17T04:21:09.880 INFO:tasks.workunit.client.1.smithi134.stdout:5/977: rename d0/da/d69/d41/d72/cd9 to d0/da/d29/d78/da5/df0/c13f 0 2024-09-17T04:21:09.881 INFO:tasks.workunit.client.0.smithi088.stdout:3/574: mknod d0/d13/d1b/d29/d56/cbe 0 2024-09-17T04:21:09.882 INFO:tasks.workunit.client.0.smithi088.stdout:2/479: symlink d0/d1/d2d/l95 0 2024-09-17T04:21:09.882 INFO:tasks.workunit.client.0.smithi088.stdout:2/480: readlink d0/l42 0 2024-09-17T04:21:09.883 INFO:tasks.workunit.client.0.smithi088.stdout:2/481: chown d0/l68 34453825 1 2024-09-17T04:21:09.883 INFO:tasks.workunit.client.0.smithi088.stdout:2/482: readlink d0/l42 0 2024-09-17T04:21:09.886 INFO:tasks.workunit.client.1.smithi134.stdout:7/930: rename d0/d16/de3/cf6 to d0/d16/d35/d4b/d65/d115/c128 0 2024-09-17T04:21:09.886 INFO:tasks.workunit.client.1.smithi134.stdout:7/931: chown d0/dd/c8e 32795171 1 2024-09-17T04:21:09.889 INFO:tasks.workunit.client.0.smithi088.stdout:3/575: unlink d0/f4 0 2024-09-17T04:21:09.889 INFO:tasks.workunit.client.1.smithi134.stdout:7/932: readlink d0/d16/d35/d4b/l92 0 2024-09-17T04:21:09.893 INFO:tasks.workunit.client.1.smithi134.stdout:5/978: mkdir d0/da/d29/d8e/d10d/d140 0 2024-09-17T04:21:09.894 INFO:tasks.workunit.client.1.smithi134.stdout:7/933: fdatasync d0/d16/d35/d4b/fc0 0 2024-09-17T04:21:09.897 INFO:tasks.workunit.client.0.smithi088.stdout:2/483: dread d0/d1/d2d/d33/d80/f40 [0,4194304] 0 2024-09-17T04:21:09.898 INFO:tasks.workunit.client.0.smithi088.stdout:3/576: unlink d0/d54/d55/l76 0 2024-09-17T04:21:09.900 INFO:tasks.workunit.client.0.smithi088.stdout:4/493: dread d5/d32/f79 [0,4194304] 0 2024-09-17T04:21:09.900 INFO:tasks.workunit.client.0.smithi088.stdout:4/494: stat d5/d72/fa3 0 2024-09-17T04:21:09.901 INFO:tasks.workunit.client.0.smithi088.stdout:7/520: truncate d2/d1d/d2e/d7d/d23/d45/f5d 1535766 0 2024-09-17T04:21:09.901 INFO:tasks.workunit.client.0.smithi088.stdout:4/495: dread - d5/fa1 zero size 2024-09-17T04:21:09.902 INFO:tasks.workunit.client.0.smithi088.stdout:7/521: truncate d2/d4/d7/d20/f22 2676554 0 2024-09-17T04:21:09.902 INFO:tasks.workunit.client.1.smithi134.stdout:7/934: unlink d0/d16/d8b/f9b 0 2024-09-17T04:21:09.903 INFO:tasks.workunit.client.0.smithi088.stdout:4/496: truncate d5/d3d/d73/d7e/d5e/f8d 685517 0 2024-09-17T04:21:09.903 INFO:tasks.workunit.client.0.smithi088.stdout:7/522: chown d2/d1d/d2e/d7d/d23/l38 961 1 2024-09-17T04:21:09.903 INFO:tasks.workunit.client.0.smithi088.stdout:4/497: stat d5/d32/d6b/f86 0 2024-09-17T04:21:09.904 INFO:tasks.workunit.client.1.smithi134.stdout:7/935: write d0/dd/d3a/d3d/d38/d60/fdd [1585736,108919] 0 2024-09-17T04:21:09.906 INFO:tasks.workunit.client.1.smithi134.stdout:5/979: mknod d0/da/d29/d78/da5/d106/d129/c141 0 2024-09-17T04:21:09.909 INFO:tasks.workunit.client.0.smithi088.stdout:3/577: truncate d0/d13/d1b/d29/d30/d35/f66 2220670 0 2024-09-17T04:21:09.911 INFO:tasks.workunit.client.1.smithi134.stdout:7/936: rename d0/dd/d3a/d3d/d38/d60/fdd to d0/d16/d8b/dc7/f129 0 2024-09-17T04:21:09.912 INFO:tasks.workunit.client.0.smithi088.stdout:4/498: unlink d5/d3f/d71/d99/f9d 0 2024-09-17T04:21:09.913 INFO:tasks.workunit.client.0.smithi088.stdout:4/499: truncate d5/d32/f67 1430361 0 2024-09-17T04:21:09.914 INFO:tasks.workunit.client.1.smithi134.stdout:5/980: mknod d0/d3a/d6b/c142 0 2024-09-17T04:21:09.915 INFO:tasks.workunit.client.1.smithi134.stdout:5/981: chown d0/da/d69/d41/d6d/d89/fb4 42989 1 2024-09-17T04:21:09.915 INFO:tasks.workunit.client.0.smithi088.stdout:7/523: creat d2/d1d/d2e/d7d/d23/fa5 x:0 0 0 2024-09-17T04:21:09.920 INFO:tasks.workunit.client.0.smithi088.stdout:6/556: getdents d14/d44/d45/d6b/d16/d42/d92 0 2024-09-17T04:21:09.921 INFO:tasks.workunit.client.0.smithi088.stdout:2/484: symlink d0/d1/d2d/d33/d4b/d24/d92/l96 0 2024-09-17T04:21:09.923 INFO:tasks.workunit.client.0.smithi088.stdout:7/524: dwrite d2/d4/f33 [0,4194304] 0 2024-09-17T04:21:09.925 INFO:tasks.workunit.client.0.smithi088.stdout:7/525: chown d2/d4/d9b 0 1 2024-09-17T04:21:09.925 INFO:tasks.workunit.client.0.smithi088.stdout:1/517: dwrite d0/d1/d16/d35/f36 [0,4194304] 0 2024-09-17T04:21:09.925 INFO:tasks.workunit.client.1.smithi134.stdout:7/937: link d0/dd/d3a/d3d/d4c/fc6 d0/d16/d35/d8d/d11f/f12a 0 2024-09-17T04:21:09.928 INFO:tasks.workunit.client.1.smithi134.stdout:5/982: mknod d0/d3a/c143 0 2024-09-17T04:21:09.929 INFO:tasks.workunit.client.1.smithi134.stdout:5/983: chown d0/da/d29/db5/f115 137804 1 2024-09-17T04:21:09.933 INFO:tasks.workunit.client.0.smithi088.stdout:4/500: rename d5/d3d/d73/d7e to d5/d3f/d71/d8b/d68/da4 0 2024-09-17T04:21:09.935 INFO:tasks.workunit.client.1.smithi134.stdout:5/984: rename d0/da/d29/d8e/d10d to d0/da/d29/d7c/d9e/d11f/d144 0 2024-09-17T04:21:09.939 INFO:tasks.workunit.client.1.smithi134.stdout:7/938: link d0/dd/d3a/f4f d0/dd/d3a/d3d/d38/d60/d75/f12b 0 2024-09-17T04:21:09.940 INFO:tasks.workunit.client.0.smithi088.stdout:6/557: fdatasync f4 0 2024-09-17T04:21:09.941 INFO:tasks.workunit.client.1.smithi134.stdout:5/985: stat d0/c19 0 2024-09-17T04:21:09.944 INFO:tasks.workunit.client.1.smithi134.stdout:7/939: unlink d0/d16/d8b/d6a/d70/d85/cb0 0 2024-09-17T04:21:09.946 INFO:tasks.workunit.client.0.smithi088.stdout:7/526: mknod d2/d96/ca6 0 2024-09-17T04:21:09.947 INFO:tasks.workunit.client.1.smithi134.stdout:5/986: symlink d0/da/d29/d7c/d9e/d11f/d144/l145 0 2024-09-17T04:21:09.947 INFO:tasks.workunit.client.0.smithi088.stdout:6/558: dread d14/d2f/fa0 [0,4194304] 0 2024-09-17T04:21:09.948 INFO:tasks.workunit.client.1.smithi134.stdout:7/940: mkdir d0/d16/d8b/d6a/d70/d12c 0 2024-09-17T04:21:09.948 INFO:tasks.workunit.client.0.smithi088.stdout:1/518: read d0/d1/df/f3e [796611,90269] 0 2024-09-17T04:21:09.949 INFO:tasks.workunit.client.1.smithi134.stdout:7/941: fsync d0/dd/d3a/d3d/fd8 0 2024-09-17T04:21:09.949 INFO:tasks.workunit.client.0.smithi088.stdout:6/559: chown d14/d44/f76 17 1 2024-09-17T04:21:09.949 INFO:tasks.workunit.client.0.smithi088.stdout:6/560: chown d14/f32 43564 1 2024-09-17T04:21:09.950 INFO:tasks.workunit.client.1.smithi134.stdout:7/942: chown d0/dd/d3a/d3d/d38/f108 15519 1 2024-09-17T04:21:09.950 INFO:tasks.workunit.client.0.smithi088.stdout:3/578: link d0/d13/f25 d0/d93/fbf 0 2024-09-17T04:21:09.952 INFO:tasks.workunit.client.0.smithi088.stdout:1/519: read d0/d1/df/d20/f2e [3510970,54259] 0 2024-09-17T04:21:09.954 INFO:tasks.workunit.client.0.smithi088.stdout:1/520: write d0/d1/d16/d77/f99 [775059,54711] 0 2024-09-17T04:21:09.957 INFO:tasks.workunit.client.0.smithi088.stdout:3/579: dwrite d0/d13/d1b/d29/d30/d35/d65/fa7 [0,4194304] 0 2024-09-17T04:21:09.960 INFO:tasks.workunit.client.0.smithi088.stdout:2/485: creat d0/d13/f97 x:0 0 0 2024-09-17T04:21:09.964 INFO:tasks.workunit.client.1.smithi134.stdout:7/943: dread d0/d16/d8b/d6a/f6d [4194304,4194304] 0 2024-09-17T04:21:09.967 INFO:tasks.workunit.client.0.smithi088.stdout:6/561: dwrite d14/d2f/f67 [0,4194304] 0 2024-09-17T04:21:09.969 INFO:tasks.workunit.client.1.smithi134.stdout:5/987: dwrite d0/d3a/d2b/f34 [0,4194304] 0 2024-09-17T04:21:09.969 INFO:tasks.workunit.client.1.smithi134.stdout:5/988: fdatasync d0/da/d2c/f9d 0 2024-09-17T04:21:09.971 INFO:tasks.workunit.client.1.smithi134.stdout:5/989: write d0/d3a/d2b/df2/f11a [658587,96079] 0 2024-09-17T04:21:09.972 INFO:tasks.workunit.client.0.smithi088.stdout:3/580: chown d0/d13/d58/d5e/l6f 11255 1 2024-09-17T04:21:09.977 INFO:tasks.workunit.client.1.smithi134.stdout:5/990: fdatasync d0/da/d29/d7c/ddf/ff5 0 2024-09-17T04:21:09.979 INFO:tasks.workunit.client.0.smithi088.stdout:7/527: getdents d2/d4 0 2024-09-17T04:21:09.982 INFO:tasks.workunit.client.1.smithi134.stdout:5/991: symlink d0/da/d29/d7c/d9e/d11f/d144/d140/l146 0 2024-09-17T04:21:09.983 INFO:tasks.workunit.client.0.smithi088.stdout:6/562: symlink d14/d44/d94/db9/dc5/lc9 0 2024-09-17T04:21:09.984 INFO:tasks.workunit.client.0.smithi088.stdout:7/528: dread - d2/d1d/d2e/d7d/d23/d45/d62/f76 zero size 2024-09-17T04:21:09.992 INFO:tasks.workunit.client.1.smithi134.stdout:7/944: dwrite d0/dd/d3a/d3d/d38/d60/d75/f11e [0,4194304] 0 2024-09-17T04:21:09.997 INFO:tasks.workunit.client.0.smithi088.stdout:2/486: truncate d0/d1/d2d/d33/d80/f40 329191 0 2024-09-17T04:21:09.998 INFO:tasks.workunit.client.1.smithi134.stdout:7/945: creat d0/dd/f12d x:0 0 0 2024-09-17T04:21:09.998 INFO:tasks.workunit.client.1.smithi134.stdout:7/946: truncate d0/f33 4826975 0 2024-09-17T04:21:10.003 INFO:tasks.workunit.client.0.smithi088.stdout:1/521: truncate d0/d13/d84/d5d/f6d 7098921 0 2024-09-17T04:21:10.003 INFO:tasks.workunit.client.0.smithi088.stdout:6/563: dread d14/d44/d45/d6b/d16/f8b [0,4194304] 0 2024-09-17T04:21:10.004 INFO:tasks.workunit.client.0.smithi088.stdout:2/487: mknod d0/d1/d2d/d33/d4b/d24/c98 0 2024-09-17T04:21:10.005 INFO:tasks.workunit.client.0.smithi088.stdout:3/581: dread d0/f33 [0,4194304] 0 2024-09-17T04:21:10.006 INFO:tasks.workunit.client.0.smithi088.stdout:1/522: chown d0/d1/d16/d35/f36 0 1 2024-09-17T04:21:10.006 INFO:tasks.workunit.client.0.smithi088.stdout:7/529: write d2/d1d/f6a [13435348,14266] 0 2024-09-17T04:21:10.007 INFO:tasks.workunit.client.0.smithi088.stdout:2/488: readlink d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/d7c/l81 0 2024-09-17T04:21:10.008 INFO:tasks.workunit.client.0.smithi088.stdout:6/564: creat d14/d44/d45/d6b/d29/dac/fca x:0 0 0 2024-09-17T04:21:10.009 INFO:tasks.workunit.client.1.smithi134.stdout:5/992: dwrite d0/f39 [0,4194304] 0 2024-09-17T04:21:10.009 INFO:tasks.workunit.client.1.smithi134.stdout:7/947: creat d0/f12e x:0 0 0 2024-09-17T04:21:10.010 INFO:tasks.workunit.client.1.smithi134.stdout:5/993: stat d0/d3a/d2b/faf 0 2024-09-17T04:21:10.010 INFO:tasks.workunit.client.0.smithi088.stdout:2/489: dread - d0/d1/d2d/d33/f82 zero size 2024-09-17T04:21:10.011 INFO:tasks.workunit.client.0.smithi088.stdout:3/582: creat d0/d13/d1b/fc0 x:0 0 0 2024-09-17T04:21:10.013 INFO:tasks.workunit.client.1.smithi134.stdout:7/948: mkdir d0/d16/de3/d12f 0 2024-09-17T04:21:10.013 INFO:tasks.workunit.client.0.smithi088.stdout:1/523: mkdir d0/d1/d16/dae 0 2024-09-17T04:21:10.014 INFO:tasks.workunit.client.1.smithi134.stdout:5/994: mkdir d0/da/d29/d78/da5/df0/d147 0 2024-09-17T04:21:10.017 INFO:tasks.workunit.client.0.smithi088.stdout:7/530: dwrite d2/d1d/d2e/d7d/d23/d45/d62/f9e [0,4194304] 0 2024-09-17T04:21:10.017 INFO:tasks.workunit.client.1.smithi134.stdout:7/949: creat d0/dd/d3a/d3d/d38/d74/f130 x:0 0 0 2024-09-17T04:21:10.022 INFO:tasks.workunit.client.0.smithi088.stdout:2/490: rename d0/d1/d2d/d33/d4b/d24/d3b/d26/l27 to d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/l99 0 2024-09-17T04:21:10.024 INFO:tasks.workunit.client.1.smithi134.stdout:5/995: creat d0/da/d2c/f148 x:0 0 0 2024-09-17T04:21:10.026 INFO:tasks.workunit.client.0.smithi088.stdout:1/524: dread d0/d1/d16/d35/f8b [0,4194304] 0 2024-09-17T04:21:10.026 INFO:tasks.workunit.client.1.smithi134.stdout:7/950: creat d0/d16/d35/d8d/f131 x:0 0 0 2024-09-17T04:21:10.033 INFO:tasks.workunit.client.1.smithi134.stdout:7/951: symlink d0/d16/d35/d4b/d65/l132 0 2024-09-17T04:21:10.033 INFO:tasks.workunit.client.0.smithi088.stdout:2/491: dwrite d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/f78 [0,4194304] 0 2024-09-17T04:21:10.035 INFO:tasks.workunit.client.0.smithi088.stdout:2/492: fsync d0/d1/d2d/d33/d4b/d24/d3b/f8f 0 2024-09-17T04:21:10.036 INFO:tasks.workunit.client.0.smithi088.stdout:1/525: rename d0/d1/d16/f3c to d0/d1/d16/d2a/da4/faf 0 2024-09-17T04:21:10.038 INFO:tasks.workunit.client.0.smithi088.stdout:1/526: chown d0/d1/df/d20/c7d 2 1 2024-09-17T04:21:10.039 INFO:tasks.workunit.client.1.smithi134.stdout:7/952: mkdir d0/dd/dbb/d133 0 2024-09-17T04:21:10.040 INFO:tasks.workunit.client.0.smithi088.stdout:7/531: link d2/d4/c44 d2/d1d/d2e/d7d/d23/d45/d85/ca7 0 2024-09-17T04:21:10.045 INFO:tasks.workunit.client.0.smithi088.stdout:2/493: mkdir d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/d9a 0 2024-09-17T04:21:10.047 INFO:tasks.workunit.client.0.smithi088.stdout:7/532: unlink d2/d1d/d2e/c8c 0 2024-09-17T04:21:10.050 INFO:tasks.workunit.client.0.smithi088.stdout:7/533: write d2/d1d/d2e/d7d/d23/d45/d62/f77 [4857169,113525] 0 2024-09-17T04:21:10.052 INFO:tasks.workunit.client.0.smithi088.stdout:1/527: creat d0/d1/d16/d77/daa/d5b/fb0 x:0 0 0 2024-09-17T04:21:10.056 INFO:tasks.workunit.client.1.smithi134.stdout:5/996: dread d0/d3a/d2b/d61/f65 [0,4194304] 0 2024-09-17T04:21:10.057 INFO:tasks.workunit.client.0.smithi088.stdout:7/534: getdents d2/d4/d7/d20 0 2024-09-17T04:21:10.057 INFO:tasks.workunit.client.0.smithi088.stdout:1/528: dread d0/d1/d16/d35/f36 [0,4194304] 0 2024-09-17T04:21:10.058 INFO:tasks.workunit.client.0.smithi088.stdout:1/529: fsync d0/d1/d16/d2a/f53 0 2024-09-17T04:21:10.059 INFO:tasks.workunit.client.0.smithi088.stdout:3/583: write d0/d13/d58/d5a/d63/f75 [1804893,81238] 0 2024-09-17T04:21:10.068 INFO:tasks.workunit.client.1.smithi134.stdout:7/953: write d0/d16/d35/d4b/d65/f102 [452129,76426] 0 2024-09-17T04:21:10.069 INFO:tasks.workunit.client.1.smithi134.stdout:7/954: write d0/d16/d35/d4b/d65/f7b [3569679,79582] 0 2024-09-17T04:21:10.070 INFO:tasks.workunit.client.1.smithi134.stdout:7/955: chown d0/f55 421680031 1 2024-09-17T04:21:10.073 INFO:tasks.workunit.client.0.smithi088.stdout:7/535: write d2/d1d/d2e/d7d/d23/d45/f63 [54896,12139] 0 2024-09-17T04:21:10.074 INFO:tasks.workunit.client.1.smithi134.stdout:5/997: dread d0/f4 [0,4194304] 0 2024-09-17T04:21:10.074 INFO:tasks.workunit.client.0.smithi088.stdout:3/584: dread d0/f16 [0,4194304] 0 2024-09-17T04:21:10.074 INFO:tasks.workunit.client.1.smithi134.stdout:7/956: rename d0/dd/fe to d0/dd/d3a/f134 0 2024-09-17T04:21:10.075 INFO:tasks.workunit.client.1.smithi134.stdout:7/957: stat d0/dd/d3a/d3d/d38/d60/d75/d11b 0 2024-09-17T04:21:10.076 INFO:tasks.workunit.client.0.smithi088.stdout:2/494: dwrite d0/d1/fe [0,4194304] 0 2024-09-17T04:21:10.077 INFO:tasks.workunit.client.1.smithi134.stdout:7/958: read d0/d16/d8b/d6a/d70/fa3 [268996,53321] 0 2024-09-17T04:21:10.107 INFO:tasks.workunit.client.0.smithi088.stdout:7/536: dread d2/d1d/d2e/d7d/d23/d45/f63 [0,4194304] 0 2024-09-17T04:21:10.107 INFO:tasks.workunit.client.1.smithi134.stdout:5/998: rename d0/da/d29/d78/d124/f133 to d0/d3a/d2b/d61/d7b/df3/f149 0 2024-09-17T04:21:10.109 INFO:tasks.workunit.client.0.smithi088.stdout:3/585: creat d0/d13/d4d/fc1 x:0 0 0 2024-09-17T04:21:10.109 INFO:tasks.workunit.client.0.smithi088.stdout:1/530: dwrite d0/d13/f55 [0,4194304] 0 2024-09-17T04:21:10.111 INFO:tasks.workunit.client.0.smithi088.stdout:1/531: readlink d0/d1/d16/d2a/l89 0 2024-09-17T04:21:10.116 INFO:tasks.workunit.client.1.smithi134.stdout:5/999: rename d0/da/d69/d41 to d0/da/d29/d7c/d9e/d13d/d14a 0 2024-09-17T04:21:10.118 INFO:tasks.workunit.client.0.smithi088.stdout:2/495: rename d0/d1/d2d/d33/d4b/f7e to d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/d7c/f9b 0 2024-09-17T04:21:10.120 INFO:tasks.workunit.client.0.smithi088.stdout:2/496: write d0/d1/d2d/d33/d80/f3e [4148169,100296] 0 2024-09-17T04:21:10.122 INFO:tasks.workunit.client.1.smithi134.stdout:7/959: write d0/dd/db9/f9c [1876312,18197] 0 2024-09-17T04:21:10.124 INFO:tasks.workunit.client.0.smithi088.stdout:2/497: creat d0/d1/d2d/d33/d4b/d24/d92/f9c x:0 0 0 2024-09-17T04:21:10.126 INFO:tasks.workunit.client.1.smithi134.stdout:7/960: creat d0/d16/d35/d8d/f135 x:0 0 0 2024-09-17T04:21:10.127 INFO:tasks.workunit.client.1.smithi134.stdout:7/961: dread - d0/f10b zero size 2024-09-17T04:21:10.127 INFO:tasks.workunit.client.0.smithi088.stdout:7/537: write d2/d1d/d2e/d7d/d23/f2f [4302606,16133] 0 2024-09-17T04:21:10.128 INFO:tasks.workunit.client.1.smithi134.stdout:7/962: read d0/d16/d35/d4b/d11c/f127 [69902,73722] 0 2024-09-17T04:21:10.130 INFO:tasks.workunit.client.0.smithi088.stdout:7/538: write d2/d1d/d2e/d7d/d23/fa5 [869127,14573] 0 2024-09-17T04:21:10.132 INFO:tasks.workunit.client.1.smithi134.stdout:7/963: rename d0/d16/d8b/d6a/la7 to d0/dd/dbb/l136 0 2024-09-17T04:21:10.132 INFO:tasks.workunit.client.0.smithi088.stdout:2/498: dwrite d0/d1/d2d/f53 [0,4194304] 0 2024-09-17T04:21:10.133 INFO:tasks.workunit.client.0.smithi088.stdout:3/586: dread d0/d13/d1b/d29/d30/d35/f3d [0,4194304] 0 2024-09-17T04:21:10.134 INFO:tasks.workunit.client.0.smithi088.stdout:1/532: dread d0/d1/d58/f73 [0,4194304] 0 2024-09-17T04:21:10.135 INFO:tasks.workunit.client.0.smithi088.stdout:1/533: readlink d0/d1/d16/d35/la9 0 2024-09-17T04:21:10.137 INFO:tasks.workunit.client.1.smithi134.stdout:7/964: rename d0/d16/d8b/d6a/d70/d12c to d0/dd/d3a/d137 0 2024-09-17T04:21:10.137 INFO:tasks.workunit.client.0.smithi088.stdout:2/499: write d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/d7c/f9b [716357,103521] 0 2024-09-17T04:21:10.139 INFO:tasks.workunit.client.0.smithi088.stdout:1/534: truncate d0/d13/f44 5070635 0 2024-09-17T04:21:10.141 INFO:tasks.workunit.client.1.smithi134.stdout:7/965: creat d0/d16/dd9/f138 x:0 0 0 2024-09-17T04:21:10.144 INFO:tasks.workunit.client.0.smithi088.stdout:7/539: rename d2/d1d/d2e/d7d/d23/l4b to d2/d4/d7/la8 0 2024-09-17T04:21:10.145 INFO:tasks.workunit.client.0.smithi088.stdout:7/540: stat d2/d4/d7/d46/da3 0 2024-09-17T04:21:10.146 INFO:tasks.workunit.client.0.smithi088.stdout:1/535: symlink d0/d1/df/d63/d91/lb1 0 2024-09-17T04:21:10.147 INFO:tasks.workunit.client.0.smithi088.stdout:7/541: creat d2/d4/d7/d46/d67/fa9 x:0 0 0 2024-09-17T04:21:10.148 INFO:tasks.workunit.client.0.smithi088.stdout:1/536: creat d0/d1/d58/fb2 x:0 0 0 2024-09-17T04:21:10.149 INFO:tasks.workunit.client.0.smithi088.stdout:7/542: rmdir d2/d4/d7/d46 39 2024-09-17T04:21:10.149 INFO:tasks.workunit.client.0.smithi088.stdout:1/537: write d0/d1/df/d63/f9f [889193,117961] 0 2024-09-17T04:21:10.150 INFO:tasks.workunit.client.1.smithi134.stdout:7/966: dwrite d0/d16/d8b/d6a/d70/d85/fab [0,4194304] 0 2024-09-17T04:21:10.150 INFO:tasks.workunit.client.1.smithi134.stdout:7/967: chown d0/cc9 313 1 2024-09-17T04:21:10.152 INFO:tasks.workunit.client.0.smithi088.stdout:7/543: unlink d2/d1d/d2e/d7d/d23/d45/f65 0 2024-09-17T04:21:10.154 INFO:tasks.workunit.client.0.smithi088.stdout:1/538: truncate d0/d1/f61 546281 0 2024-09-17T04:21:10.154 INFO:tasks.workunit.client.1.smithi134.stdout:7/968: dread d0/dd/d3a/d3d/fda [0,4194304] 0 2024-09-17T04:21:10.156 INFO:tasks.workunit.client.0.smithi088.stdout:7/544: mkdir d2/d1d/d2e/d7d/d23/d45/d85/daa 0 2024-09-17T04:21:10.157 INFO:tasks.workunit.client.0.smithi088.stdout:1/539: chown d0/f3b 471631 1 2024-09-17T04:21:10.158 INFO:tasks.workunit.client.0.smithi088.stdout:1/540: stat d0/d1/df/d20/f62 0 2024-09-17T04:21:10.159 INFO:tasks.workunit.client.1.smithi134.stdout:7/969: mkdir d0/d16/d8b/d6a/d70/d139 0 2024-09-17T04:21:10.162 INFO:tasks.workunit.client.0.smithi088.stdout:7/545: dwrite d2/f8a [0,4194304] 0 2024-09-17T04:21:10.163 INFO:tasks.workunit.client.0.smithi088.stdout:3/587: truncate d0/d13/d1b/d29/d30/f68 2699572 0 2024-09-17T04:21:10.164 INFO:tasks.workunit.client.1.smithi134.stdout:7/970: mkdir d0/dd/d3a/d3d/d109/d13a 0 2024-09-17T04:21:10.165 INFO:tasks.workunit.client.0.smithi088.stdout:7/546: truncate d2/d4/d7/d20/f6b 1254882 0 2024-09-17T04:21:10.167 INFO:tasks.workunit.client.1.smithi134.stdout:7/971: write d0/dd/d3a/d3d/d38/d60/f126 [4712907,101711] 0 2024-09-17T04:21:10.168 INFO:tasks.workunit.client.0.smithi088.stdout:3/588: symlink d0/d13/d1b/d29/d30/d81/lc2 0 2024-09-17T04:21:10.171 INFO:tasks.workunit.client.0.smithi088.stdout:2/500: dwrite d0/d1/d2d/d33/d4b/d24/d3b/d26/f4e [0,4194304] 0 2024-09-17T04:21:10.173 INFO:tasks.workunit.client.1.smithi134.stdout:7/972: rename d0/c8c to d0/d16/de3/d12f/c13b 0 2024-09-17T04:21:10.173 INFO:tasks.workunit.client.1.smithi134.stdout:7/973: chown d0/dd/d3a/ca2 5803673 1 2024-09-17T04:21:10.178 INFO:tasks.workunit.client.0.smithi088.stdout:3/589: rename d0/d13/c86 to d0/d13/cc3 0 2024-09-17T04:21:10.179 INFO:tasks.workunit.client.1.smithi134.stdout:7/974: fdatasync d0/dd/d3a/d3d/d38/d74/faf 0 2024-09-17T04:21:10.180 INFO:tasks.workunit.client.0.smithi088.stdout:2/501: dwrite d0/d1/d2d/f6a [0,4194304] 0 2024-09-17T04:21:10.180 INFO:tasks.workunit.client.1.smithi134.stdout:7/975: chown d0/d16/d35/d8d/dd0/f10e 8 1 2024-09-17T04:21:10.182 INFO:tasks.workunit.client.1.smithi134.stdout:7/976: dread d0/d16/d35/f118 [0,4194304] 0 2024-09-17T04:21:10.185 INFO:tasks.workunit.client.0.smithi088.stdout:3/590: stat d0/d13/d1b/d29/d30/d35/l46 0 2024-09-17T04:21:10.187 INFO:tasks.workunit.client.1.smithi134.stdout:7/977: mknod d0/dd/d3a/d137/c13c 0 2024-09-17T04:21:10.189 INFO:tasks.workunit.client.0.smithi088.stdout:3/591: fsync d0/d13/d4d/f6c 0 2024-09-17T04:21:10.191 INFO:tasks.workunit.client.0.smithi088.stdout:2/502: link d0/d13/c4a d0/d1/d2d/d33/d65/c9d 0 2024-09-17T04:21:10.193 INFO:tasks.workunit.client.1.smithi134.stdout:7/978: creat d0/dd/d3a/d3d/d109/d13a/f13d x:0 0 0 2024-09-17T04:21:10.194 INFO:tasks.workunit.client.0.smithi088.stdout:2/503: write d0/d1/d2d/d33/d4b/d24/d3b/f7f [5033396,121916] 0 2024-09-17T04:21:10.194 INFO:tasks.workunit.client.0.smithi088.stdout:1/541: write d0/d1/d16/d2a/f64 [1411125,79705] 0 2024-09-17T04:21:10.195 INFO:tasks.workunit.client.1.smithi134.stdout:7/979: fdatasync d0/dd/d3a/d3d/d38/f23 0 2024-09-17T04:21:10.197 INFO:tasks.workunit.client.0.smithi088.stdout:2/504: chown d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/c74 3278 1 2024-09-17T04:21:10.198 INFO:tasks.workunit.client.1.smithi134.stdout:7/980: mknod d0/d16/d8b/d6a/d70/d85/c13e 0 2024-09-17T04:21:10.199 INFO:tasks.workunit.client.0.smithi088.stdout:3/592: dread d0/f79 [0,4194304] 0 2024-09-17T04:21:10.200 INFO:tasks.workunit.client.0.smithi088.stdout:3/593: chown d0/d13/d8a 97794454 1 2024-09-17T04:21:10.203 INFO:tasks.workunit.client.0.smithi088.stdout:3/594: dread - d0/d13/d1b/d29/d2b/d50/f91 zero size 2024-09-17T04:21:10.204 INFO:tasks.workunit.client.0.smithi088.stdout:7/547: dwrite d2/d1d/d2e/d7d/d23/d45/f5d [0,4194304] 0 2024-09-17T04:21:10.207 INFO:tasks.workunit.client.0.smithi088.stdout:7/548: mknod d2/d8d/cab 0 2024-09-17T04:21:10.208 INFO:tasks.workunit.client.0.smithi088.stdout:3/595: truncate d0/d13/d1b/d29/d30/d3c/f51 630870 0 2024-09-17T04:21:10.209 INFO:tasks.workunit.client.0.smithi088.stdout:7/549: write d2/d1d/d2e/d7d/d23/d45/d62/f77 [4172576,115661] 0 2024-09-17T04:21:10.210 INFO:tasks.workunit.client.0.smithi088.stdout:2/505: truncate d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/f5b 1141445 0 2024-09-17T04:21:10.212 INFO:tasks.workunit.client.0.smithi088.stdout:7/550: fdatasync d2/d4/f18 0 2024-09-17T04:21:10.213 INFO:tasks.workunit.client.0.smithi088.stdout:3/596: symlink d0/d13/d58/d5e/lc4 0 2024-09-17T04:21:10.214 INFO:tasks.workunit.client.0.smithi088.stdout:7/551: chown d2/d1d/d2e/f91 689859494 1 2024-09-17T04:21:10.215 INFO:tasks.workunit.client.0.smithi088.stdout:3/597: write d0/d13/d1b/d29/f5b [4309997,74790] 0 2024-09-17T04:21:10.216 INFO:tasks.workunit.client.0.smithi088.stdout:7/552: creat d2/d96/fac x:0 0 0 2024-09-17T04:21:10.217 INFO:tasks.workunit.client.0.smithi088.stdout:3/598: fdatasync d0/d13/d58/fb1 0 2024-09-17T04:21:10.218 INFO:tasks.workunit.client.0.smithi088.stdout:7/553: chown d2/d1d/d2e/d7d/d23/d45/d62/f76 86 1 2024-09-17T04:21:10.221 INFO:tasks.workunit.client.0.smithi088.stdout:1/542: dread d0/f3b [0,4194304] 0 2024-09-17T04:21:10.226 INFO:tasks.workunit.client.0.smithi088.stdout:2/506: truncate d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/f78 173611 0 2024-09-17T04:21:10.227 INFO:tasks.workunit.client.0.smithi088.stdout:7/554: dwrite d2/d1d/d2e/d7d/d23/fa5 [0,4194304] 0 2024-09-17T04:21:10.231 INFO:tasks.workunit.client.0.smithi088.stdout:3/599: truncate d0/d13/d58/fb1 2417810 0 2024-09-17T04:21:10.234 INFO:tasks.workunit.client.0.smithi088.stdout:1/543: truncate d0/d1/d16/d77/f99 96459 0 2024-09-17T04:21:10.235 INFO:tasks.workunit.client.0.smithi088.stdout:2/507: dwrite d0/d1/d2d/d33/d4b/d24/f7a [0,4194304] 0 2024-09-17T04:21:10.296 INFO:tasks.workunit.client.0.smithi088.stdout:3/600: symlink d0/d13/d1b/d29/d2b/lc5 0 2024-09-17T04:21:10.296 INFO:tasks.workunit.client.0.smithi088.stdout:1/544: truncate d0/d1/fa 6584118 0 2024-09-17T04:21:10.296 INFO:tasks.workunit.client.0.smithi088.stdout:3/601: chown d0/dae 17935 1 2024-09-17T04:21:10.296 INFO:tasks.workunit.client.0.smithi088.stdout:2/508: rename d0/l8 to d0/d1/d2d/d33/d85/l9e 0 2024-09-17T04:21:10.296 INFO:tasks.workunit.client.0.smithi088.stdout:2/509: fsync d0/f61 0 2024-09-17T04:21:10.296 INFO:tasks.workunit.client.0.smithi088.stdout:3/602: mkdir d0/d13/d58/d5e/dc6 0 2024-09-17T04:21:10.296 INFO:tasks.workunit.client.0.smithi088.stdout:1/545: creat d0/d1/d16/d77/d9e/fb3 x:0 0 0 2024-09-17T04:21:10.297 INFO:tasks.workunit.client.0.smithi088.stdout:1/546: mknod d0/d1/d16/d77/daa/cb4 0 2024-09-17T04:21:10.297 INFO:tasks.workunit.client.0.smithi088.stdout:2/510: chown d0/d1/d2d/d33/d4b/d24/d3b/d26/l62 24783 1 2024-09-17T04:21:10.300 INFO:tasks.workunit.client.0.smithi088.stdout:1/547: rename d0/f41 to d0/d1/df/d63/fb5 0 2024-09-17T04:21:10.301 INFO:tasks.workunit.client.0.smithi088.stdout:2/511: mknod d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/d9a/c9f 0 2024-09-17T04:21:10.302 INFO:tasks.workunit.client.0.smithi088.stdout:2/512: fsync d0/d1/d2d/d33/d4b/d24/d3b/d26/f4e 0 2024-09-17T04:21:10.303 INFO:tasks.workunit.client.0.smithi088.stdout:2/513: fdatasync d0/fd 0 2024-09-17T04:21:10.305 INFO:tasks.workunit.client.0.smithi088.stdout:2/514: rmdir d0/d1/d2d/d33/d4b/d24/d92 39 2024-09-17T04:21:10.306 INFO:tasks.workunit.client.0.smithi088.stdout:2/515: read - d0/d1/d2d/d33/d4b/f8b zero size 2024-09-17T04:21:10.306 INFO:tasks.workunit.client.0.smithi088.stdout:2/516: stat d0/d1/d2d/d33/d4b 0 2024-09-17T04:21:10.308 INFO:tasks.workunit.client.0.smithi088.stdout:2/517: unlink d0/d1/l47 0 2024-09-17T04:21:10.311 INFO:tasks.workunit.client.0.smithi088.stdout:2/518: creat d0/d1/d2d/d33/d85/fa0 x:0 0 0 2024-09-17T04:21:10.312 INFO:tasks.workunit.client.0.smithi088.stdout:1/548: stat d0/d1/d16/d2a/da4/faf 0 2024-09-17T04:21:10.317 INFO:tasks.workunit.client.0.smithi088.stdout:2/519: getdents d0/d1/d2d/d33/d4b/d24/d3b/d26 0 2024-09-17T04:21:10.318 INFO:tasks.workunit.client.0.smithi088.stdout:2/520: dread - d0/d1/d2d/d33/f82 zero size 2024-09-17T04:21:10.319 INFO:tasks.workunit.client.0.smithi088.stdout:2/521: creat d0/d1/d2d/fa1 x:0 0 0 2024-09-17T04:21:10.325 INFO:tasks.workunit.client.0.smithi088.stdout:1/549: dread d0/d1/d16/d35/f5f [0,4194304] 0 2024-09-17T04:21:10.328 INFO:tasks.workunit.client.0.smithi088.stdout:1/550: unlink d0/d1/d16/d2a/lab 0 2024-09-17T04:21:10.329 INFO:tasks.workunit.client.0.smithi088.stdout:1/551: dread - d0/d13/d84/f59 zero size 2024-09-17T04:21:10.334 INFO:tasks.workunit.client.0.smithi088.stdout:2/522: dread d0/d1/d2d/d33/d4b/d24/d3b/f7f [0,4194304] 0 2024-09-17T04:21:10.336 INFO:tasks.workunit.client.0.smithi088.stdout:2/523: truncate d0/d1/d2d/d33/f38 4973851 0 2024-09-17T04:21:10.338 INFO:tasks.workunit.client.0.smithi088.stdout:1/552: write d0/d1/df/d20/f5e [3432373,28032] 0 2024-09-17T04:21:10.343 INFO:tasks.workunit.client.0.smithi088.stdout:1/553: getdents d0/d1/d16/d2a 0 2024-09-17T04:21:10.344 INFO:tasks.workunit.client.0.smithi088.stdout:1/554: mknod d0/d13/cb6 0 2024-09-17T04:21:10.345 INFO:tasks.workunit.client.0.smithi088.stdout:2/524: truncate d0/d1/d2d/d33/d80/f3e 2265404 0 2024-09-17T04:21:10.348 INFO:tasks.workunit.client.0.smithi088.stdout:2/525: chown d0/d1/d2d/d33/d85/l9e 1740127 1 2024-09-17T04:21:10.349 INFO:tasks.workunit.client.1.smithi134.stdout:7/981: sync 2024-09-17T04:21:10.349 INFO:tasks.workunit.client.0.smithi088.stdout:2/526: mknod d0/d1/d2d/d33/d4b/d24/d89/ca2 0 2024-09-17T04:21:10.352 INFO:tasks.workunit.client.0.smithi088.stdout:2/527: unlink d0/f9 0 2024-09-17T04:21:10.353 INFO:tasks.workunit.client.0.smithi088.stdout:1/555: truncate d0/d1/df/f10 1121667 0 2024-09-17T04:21:10.354 INFO:tasks.workunit.client.1.smithi134.stdout:7/982: creat d0/d16/d35/d4b/d11c/f13f x:0 0 0 2024-09-17T04:21:10.357 INFO:tasks.workunit.client.0.smithi088.stdout:1/556: creat d0/d1/d16/d77/daa/d5b/d87/fb7 x:0 0 0 2024-09-17T04:21:10.359 INFO:tasks.workunit.client.0.smithi088.stdout:2/528: dwrite d0/d1/d2d/d33/d4b/d24/f7a [0,4194304] 0 2024-09-17T04:21:10.359 INFO:tasks.workunit.client.0.smithi088.stdout:1/557: write d0/d1/d16/d77/d9e/fb3 [296224,11686] 0 2024-09-17T04:21:10.367 INFO:tasks.workunit.client.1.smithi134.stdout:7/983: creat d0/d16/f140 x:0 0 0 2024-09-17T04:21:10.369 INFO:tasks.workunit.client.0.smithi088.stdout:1/558: mkdir d0/d1/d16/dae/db8 0 2024-09-17T04:21:10.374 INFO:tasks.workunit.client.0.smithi088.stdout:1/559: getdents d0/d1 0 2024-09-17T04:21:10.379 INFO:tasks.workunit.client.0.smithi088.stdout:1/560: dread d0/d1/df/d63/f6f [0,4194304] 0 2024-09-17T04:21:10.384 INFO:tasks.workunit.client.0.smithi088.stdout:2/529: dread d0/d1/d2d/d33/d80/f19 [0,4194304] 0 2024-09-17T04:21:10.386 INFO:tasks.workunit.client.0.smithi088.stdout:2/530: write d0/d1/d2d/d33/f38 [3221433,9181] 0 2024-09-17T04:21:10.467 INFO:tasks.workunit.client.1.smithi134.stdout:7/984: truncate d0/dd/d3a/d3d/d38/d60/f126 3075753 0 2024-09-17T04:21:10.504 INFO:tasks.workunit.client.0.smithi088.stdout:2/531: symlink d0/d1/d2d/d33/d4b/d24/d4d/la3 0 2024-09-17T04:21:10.504 INFO:tasks.workunit.client.0.smithi088.stdout:2/532: fsync d0/d1/d2d/f6a 0 2024-09-17T04:21:10.522 INFO:tasks.workunit.client.0.smithi088.stdout:2/533: creat d0/d1/d2d/d33/d4b/d6d/fa4 x:0 0 0 2024-09-17T04:21:10.527 INFO:tasks.workunit.client.0.smithi088.stdout:2/534: mkdir d0/d1/d2d/d33/d4b/d6d/d94/da5 0 2024-09-17T04:21:10.529 INFO:tasks.workunit.client.0.smithi088.stdout:2/535: fsync d0/d1/d2d/d33/d4b/d24/d3b/f54 0 2024-09-17T04:21:10.535 INFO:tasks.workunit.client.0.smithi088.stdout:2/536: chown d0/d1/d2d/d33/d4b/d24/d3b/d22 776046 1 2024-09-17T04:21:10.536 INFO:tasks.workunit.client.0.smithi088.stdout:2/537: unlink d0/d1/d2d/d33/d4b/d24/d3b/d26/l56 0 2024-09-17T04:21:10.564 INFO:tasks.workunit.client.1.smithi134.stdout:7/985: write d0/dd/d3a/d3d/d38/d60/fb8 [3228897,111186] 0 2024-09-17T04:21:10.610 INFO:tasks.workunit.client.1.smithi134.stdout:7/986: unlink d0/d16/d35/d8d/d11f/l121 0 2024-09-17T04:21:10.640 INFO:tasks.workunit.client.1.smithi134.stdout:7/987: dwrite d0/dd/d3a/d3d/d4c/fc6 [0,4194304] 0 2024-09-17T04:21:10.644 INFO:tasks.workunit.client.1.smithi134.stdout:7/988: dread d0/dd/d3a/d3d/fd8 [0,4194304] 0 2024-09-17T04:21:10.647 INFO:tasks.workunit.client.1.smithi134.stdout:7/989: fdatasync d0/dd/db9/f90 0 2024-09-17T04:21:10.648 INFO:tasks.workunit.client.1.smithi134.stdout:7/990: fdatasync d0/d16/d35/f118 0 2024-09-17T04:21:10.650 INFO:tasks.workunit.client.1.smithi134.stdout:7/991: chown d0/d16/d8b/fad 24372068 1 2024-09-17T04:21:10.650 INFO:tasks.workunit.client.1.smithi134.stdout:7/992: chown d0/d16/d35/d4b/d11c/f127 82 1 2024-09-17T04:21:10.652 INFO:tasks.workunit.client.1.smithi134.stdout:7/993: creat d0/dd/d3a/d137/f141 x:0 0 0 2024-09-17T04:21:10.654 INFO:tasks.workunit.client.1.smithi134.stdout:7/994: mkdir d0/d142 0 2024-09-17T04:21:10.660 INFO:tasks.workunit.client.1.smithi134.stdout:7/995: dwrite d0/dd/d3a/d3d/d38/fbf [4194304,4194304] 0 2024-09-17T04:21:10.662 INFO:tasks.workunit.client.1.smithi134.stdout:7/996: truncate d0/d16/d35/d8d/f135 712991 0 2024-09-17T04:21:10.664 INFO:tasks.workunit.client.1.smithi134.stdout:7/997: truncate d0/dd/d3a/ff0 699608 0 2024-09-17T04:21:10.667 INFO:tasks.workunit.client.1.smithi134.stdout:7/998: symlink d0/d16/dd9/l143 0 2024-09-17T04:21:10.671 INFO:tasks.workunit.client.1.smithi134.stdout:7/999: write d0/d16/d35/d4b/d11c/f127 [286940,36969] 0 2024-09-17T04:21:10.675 INFO:tasks.workunit.client.1.smithi134.stderr:+ rm -rf -- ./tmp.W7orocEuSc 2024-09-17T04:21:10.818 INFO:tasks.workunit.client.0.smithi088.stdout:9/530: sync 2024-09-17T04:21:10.821 INFO:tasks.workunit.client.0.smithi088.stdout:9/531: mkdir d2/db8 0 2024-09-17T04:21:10.823 INFO:tasks.workunit.client.0.smithi088.stdout:9/532: truncate d2/dd/d14/d8b/d35/f6c 898551 0 2024-09-17T04:21:10.823 INFO:tasks.workunit.client.0.smithi088.stdout:9/533: chown d2/dd/d11/f4b 0 1 2024-09-17T04:21:10.835 INFO:tasks.workunit.client.0.smithi088.stdout:9/534: link d2/c59 d2/dd/d14/cb9 0 2024-09-17T04:21:10.837 INFO:tasks.workunit.client.0.smithi088.stdout:9/535: fsync d2/dd/d11/d30/d49/f42 0 2024-09-17T04:21:10.838 INFO:tasks.workunit.client.0.smithi088.stdout:9/536: chown d2/dd/l29 953731823 1 2024-09-17T04:21:10.843 INFO:tasks.workunit.client.0.smithi088.stdout:9/537: write d2/dd/d14/d8b/f4d [1625411,104633] 0 2024-09-17T04:21:10.845 INFO:tasks.workunit.client.0.smithi088.stdout:9/538: symlink d2/dd/d14/d8b/d35/lba 0 2024-09-17T04:21:10.846 INFO:tasks.workunit.client.0.smithi088.stdout:9/539: dread - d2/dd/d11/f96 zero size 2024-09-17T04:21:10.848 INFO:tasks.workunit.client.0.smithi088.stdout:9/540: truncate d2/dd/d11/d30/d49/f9f 422949 0 2024-09-17T04:21:10.853 INFO:tasks.workunit.client.0.smithi088.stdout:9/541: write d2/dd/f70 [685517,80164] 0 2024-09-17T04:21:10.854 INFO:tasks.workunit.client.0.smithi088.stdout:9/542: truncate d2/dd/f70 1422496 0 2024-09-17T04:21:10.857 INFO:tasks.workunit.client.0.smithi088.stdout:9/543: mkdir d2/d2b/d2e/dbb 0 2024-09-17T04:21:10.858 INFO:tasks.workunit.client.0.smithi088.stdout:9/544: fsync d2/dd/d11/d30/d49/f42 0 2024-09-17T04:21:10.860 INFO:tasks.workunit.client.0.smithi088.stdout:9/545: dread d2/dd/d14/d8b/d35/f5f [0,4194304] 0 2024-09-17T04:21:10.863 INFO:tasks.workunit.client.0.smithi088.stdout:9/546: unlink d2/d16/f34 0 2024-09-17T04:21:10.866 INFO:tasks.workunit.client.0.smithi088.stdout:9/547: rename d2/d2b/d2e/dab to d2/dd/d11/d4f/d5c/dbc 0 2024-09-17T04:21:10.867 INFO:tasks.workunit.client.0.smithi088.stdout:9/548: readlink d2/l4e 0 2024-09-17T04:21:10.867 INFO:tasks.workunit.client.0.smithi088.stdout:9/549: dread - d2/dd/d11/d4f/d5c/faa zero size 2024-09-17T04:21:10.869 INFO:tasks.workunit.client.0.smithi088.stdout:9/550: creat d2/dd/d14/d2a/d76/fbd x:0 0 0 2024-09-17T04:21:10.870 INFO:tasks.workunit.client.0.smithi088.stdout:9/551: fdatasync d2/f8 0 2024-09-17T04:21:10.871 INFO:tasks.workunit.client.0.smithi088.stdout:9/552: chown d2/dd/d11/d4f/d5c/dbc 48 1 2024-09-17T04:21:10.876 INFO:tasks.workunit.client.0.smithi088.stdout:9/553: unlink d2/dd/d11/d4f/d5c/c61 0 2024-09-17T04:21:10.878 INFO:tasks.workunit.client.0.smithi088.stdout:9/554: rmdir d2/dd/d14/d8b 39 2024-09-17T04:21:10.880 INFO:tasks.workunit.client.0.smithi088.stdout:9/555: read d2/dd/d14/f19 [1352612,43618] 0 2024-09-17T04:21:10.882 INFO:tasks.workunit.client.0.smithi088.stdout:9/556: stat d2/dd/f15 0 2024-09-17T04:21:10.884 INFO:tasks.workunit.client.0.smithi088.stdout:9/557: truncate d2/dd/d11/d30/d49/f9f 834725 0 2024-09-17T04:21:10.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:10 smithi088 ceph-mon[27811]: pgmap v26: 65 pgs: 65 active+clean; 2.8 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 73 MiB/s rd, 211 MiB/s wr, 412 op/s 2024-09-17T04:21:10.890 INFO:tasks.workunit.client.0.smithi088.stdout:9/558: link d2/c4 d2/cbe 0 2024-09-17T04:21:10.892 INFO:tasks.workunit.client.0.smithi088.stdout:9/559: mkdir d2/d2b/dbf 0 2024-09-17T04:21:10.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:10 smithi134 ceph-mon[35201]: pgmap v26: 65 pgs: 65 active+clean; 2.8 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 73 MiB/s rd, 211 MiB/s wr, 412 op/s 2024-09-17T04:21:10.898 INFO:tasks.workunit.client.0.smithi088.stdout:9/560: dwrite d2/d2b/d2e/f57 [0,4194304] 0 2024-09-17T04:21:10.903 INFO:tasks.workunit.client.0.smithi088.stdout:9/561: rename d2/dd/d14/d8b/d43/l46 to d2/dd/d14/d8b/d35/d94/lc0 0 2024-09-17T04:21:10.905 INFO:tasks.workunit.client.0.smithi088.stdout:9/562: fsync d2/f26 0 2024-09-17T04:21:10.907 INFO:tasks.workunit.client.0.smithi088.stdout:9/563: creat d2/dd/d11/d4f/d5c/fc1 x:0 0 0 2024-09-17T04:21:10.908 INFO:tasks.workunit.client.0.smithi088.stdout:9/564: stat d2/dd/d14/d8b/d35/l3a 0 2024-09-17T04:21:10.934 INFO:tasks.workunit.client.0.smithi088.stdout:9/565: dwrite d2/dd/f15 [0,4194304] 0 2024-09-17T04:21:10.935 INFO:tasks.workunit.client.0.smithi088.stdout:9/566: read d2/d2b/d2e/f8a [1081700,26576] 0 2024-09-17T04:21:10.936 INFO:tasks.workunit.client.0.smithi088.stdout:9/567: chown d2/d16/fa8 2 1 2024-09-17T04:21:10.940 INFO:tasks.workunit.client.0.smithi088.stdout:9/568: write d2/dd/d14/d8b/d43/d51/fb0 [443966,52557] 0 2024-09-17T04:21:10.941 INFO:tasks.workunit.client.0.smithi088.stdout:9/569: write d2/d2b/d58/f5b [4991671,57017] 0 2024-09-17T04:21:10.942 INFO:tasks.workunit.client.0.smithi088.stdout:9/570: chown d2/dd/d11/d4f/d72/d74/fa0 1684041 1 2024-09-17T04:21:10.946 INFO:tasks.workunit.client.0.smithi088.stdout:9/571: symlink d2/dd/d11/d4f/db5/lc2 0 2024-09-17T04:21:10.948 INFO:tasks.workunit.client.0.smithi088.stdout:9/572: symlink d2/dd/d11/d4f/lc3 0 2024-09-17T04:21:10.965 INFO:tasks.workunit.client.0.smithi088.stdout:9/573: dwrite d2/d2b/d58/f6a [0,4194304] 0 2024-09-17T04:21:10.966 INFO:tasks.workunit.client.0.smithi088.stdout:9/574: read - d2/dd/d11/d4f/d5c/faa zero size 2024-09-17T04:21:10.966 INFO:tasks.workunit.client.0.smithi088.stdout:9/575: fsync d2/f9 0 2024-09-17T04:21:10.980 INFO:tasks.workunit.client.0.smithi088.stdout:9/576: write d2/dd/d11/d30/f7f [5781890,18011] 0 2024-09-17T04:21:10.981 INFO:tasks.workunit.client.0.smithi088.stdout:9/577: chown d2/d2b/l52 160 1 2024-09-17T04:21:10.993 INFO:tasks.workunit.client.0.smithi088.stdout:9/578: dwrite d2/dd/d14/d8b/d35/f5f [0,4194304] 0 2024-09-17T04:21:10.999 INFO:tasks.workunit.client.0.smithi088.stdout:9/579: link d2/d16/c91 d2/dd/d14/d2a/d8f/d99/cc4 0 2024-09-17T04:21:11.002 INFO:tasks.workunit.client.0.smithi088.stdout:9/580: creat d2/dd/d11/d4f/d5c/dbc/fc5 x:0 0 0 2024-09-17T04:21:11.004 INFO:tasks.workunit.client.0.smithi088.stdout:9/581: creat d2/dd/d11/d4f/d72/d74/fc6 x:0 0 0 2024-09-17T04:21:11.006 INFO:tasks.workunit.client.0.smithi088.stdout:9/582: dread d2/dd/d11/d30/d49/f42 [0,4194304] 0 2024-09-17T04:21:11.008 INFO:tasks.workunit.client.0.smithi088.stdout:9/583: read d2/dd/f4c [3126457,125634] 0 2024-09-17T04:21:11.024 INFO:tasks.workunit.client.0.smithi088.stdout:9/584: write d2/dd/d11/d30/d49/f45 [1115422,23408] 0 2024-09-17T04:21:11.027 INFO:tasks.workunit.client.0.smithi088.stdout:9/585: creat d2/dd/d11/d30/fc7 x:0 0 0 2024-09-17T04:21:11.030 INFO:tasks.workunit.client.0.smithi088.stdout:9/586: mknod d2/dd/d14/cc8 0 2024-09-17T04:21:11.036 INFO:tasks.workunit.client.0.smithi088.stdout:9/587: dwrite d2/dd/d11/d30/fc7 [0,4194304] 0 2024-09-17T04:21:11.057 INFO:tasks.workunit.client.0.smithi088.stdout:9/588: dread d2/d2b/d58/d82/f83 [0,4194304] 0 2024-09-17T04:21:11.072 INFO:tasks.workunit.client.0.smithi088.stdout:9/589: dread d2/fc [0,4194304] 0 2024-09-17T04:21:11.074 INFO:tasks.workunit.client.0.smithi088.stdout:9/590: write d2/dd/f87 [3143200,40355] 0 2024-09-17T04:21:11.079 INFO:tasks.workunit.client.0.smithi088.stdout:9/591: getdents d2/dd/d14/d2a/d76 0 2024-09-17T04:21:11.081 INFO:tasks.workunit.client.0.smithi088.stdout:9/592: chown d2/dd/d14/d2a/l6e 20 1 2024-09-17T04:21:11.084 INFO:tasks.workunit.client.0.smithi088.stdout:9/593: creat d2/dd/d14/d2a/d76/d98/db3/fc9 x:0 0 0 2024-09-17T04:21:11.088 INFO:tasks.workunit.client.0.smithi088.stdout:9/594: getdents d2/d2b 0 2024-09-17T04:21:11.103 INFO:tasks.workunit.client.0.smithi088.stdout:9/595: dread d2/dd/d14/f20 [0,4194304] 0 2024-09-17T04:21:11.104 INFO:tasks.workunit.client.0.smithi088.stdout:9/596: read - d2/dd/d11/d4f/d5c/fc1 zero size 2024-09-17T04:21:11.105 INFO:tasks.workunit.client.0.smithi088.stdout:9/597: dread - d2/dd/d11/d4f/d72/d74/fae zero size 2024-09-17T04:21:11.108 INFO:tasks.workunit.client.0.smithi088.stdout:9/598: creat d2/dd/d14/d8b/d43/fca x:0 0 0 2024-09-17T04:21:11.109 INFO:tasks.workunit.client.0.smithi088.stdout:9/599: write d2/dd/d11/d4f/d5c/fc1 [408772,71268] 0 2024-09-17T04:21:11.115 INFO:tasks.workunit.client.0.smithi088.stdout:9/600: dwrite d2/dd/d11/d30/d49/f45 [0,4194304] 0 2024-09-17T04:21:11.118 INFO:tasks.workunit.client.0.smithi088.stdout:9/601: creat d2/dd/d14/d8b/d35/fcb x:0 0 0 2024-09-17T04:21:11.122 INFO:tasks.workunit.client.0.smithi088.stdout:9/602: creat d2/dd/d14/d2a/d76/d98/fcc x:0 0 0 2024-09-17T04:21:11.123 INFO:tasks.workunit.client.0.smithi088.stdout:9/603: write d2/dd/d11/d30/f7f [3583011,57447] 0 2024-09-17T04:21:11.123 INFO:tasks.workunit.client.0.smithi088.stdout:9/604: stat d2/dd/d14/c36 0 2024-09-17T04:21:11.126 INFO:tasks.workunit.client.0.smithi088.stdout:9/605: mknod d2/db8/ccd 0 2024-09-17T04:21:11.128 INFO:tasks.workunit.client.0.smithi088.stdout:9/606: creat d2/dd/d14/d2a/d8f/d99/fce x:0 0 0 2024-09-17T04:21:11.131 INFO:tasks.workunit.client.0.smithi088.stdout:9/607: read d2/dd/d14/d8b/d43/d51/f6b [523634,43755] 0 2024-09-17T04:21:11.132 INFO:tasks.workunit.client.0.smithi088.stdout:9/608: write d2/dd/f87 [4121096,36224] 0 2024-09-17T04:21:11.134 INFO:tasks.workunit.client.0.smithi088.stdout:9/609: mkdir d2/d2b/d58/dcf 0 2024-09-17T04:21:11.135 INFO:tasks.workunit.client.0.smithi088.stdout:9/610: write d2/dd/d11/f25 [2340542,53700] 0 2024-09-17T04:21:11.136 INFO:tasks.workunit.client.0.smithi088.stdout:9/611: write d2/d2b/d58/d82/f85 [1025889,13202] 0 2024-09-17T04:21:11.139 INFO:tasks.workunit.client.0.smithi088.stdout:9/612: mknod d2/dd/d14/d8b/d35/d94/cd0 0 2024-09-17T04:21:11.141 INFO:tasks.workunit.client.0.smithi088.stdout:9/613: truncate d2/dd/d11/d4f/d72/d74/fae 744679 0 2024-09-17T04:21:11.166 INFO:tasks.workunit.client.0.smithi088.stdout:9/614: write d2/dd/d14/d2a/d76/d98/f9c [799321,49804] 0 2024-09-17T04:21:11.168 INFO:tasks.workunit.client.0.smithi088.stdout:9/615: truncate d2/d2b/d58/d82/f83 5459116 0 2024-09-17T04:21:11.189 INFO:tasks.workunit.client.0.smithi088.stdout:9/616: dwrite d2/d2b/d58/d82/f95 [0,4194304] 0 2024-09-17T04:21:11.200 INFO:tasks.workunit.client.0.smithi088.stdout:9/617: dwrite d2/dd/d14/d8b/f7e [0,4194304] 0 2024-09-17T04:21:11.207 INFO:tasks.workunit.client.0.smithi088.stdout:9/618: link d2/dd/d14/d2a/d76/fbd d2/dd/d14/d8b/d43/fd1 0 2024-09-17T04:21:11.208 INFO:tasks.workunit.client.0.smithi088.stdout:9/619: rmdir d2/dd/d14/d8b/d35/d94 39 2024-09-17T04:21:11.211 INFO:tasks.workunit.client.0.smithi088.stdout:9/620: read d2/dd/d11/d30/f7f [2095564,61002] 0 2024-09-17T04:21:11.213 INFO:tasks.workunit.client.0.smithi088.stdout:9/621: mknod d2/dd/d14/d2a/d76/cd2 0 2024-09-17T04:21:11.230 INFO:tasks.workunit.client.0.smithi088.stdout:0/341: sync 2024-09-17T04:21:11.231 INFO:tasks.workunit.client.0.smithi088.stdout:9/622: write d2/dd/d14/d8b/f37 [4903342,31605] 0 2024-09-17T04:21:11.232 INFO:tasks.workunit.client.0.smithi088.stdout:0/342: mknod db/d3c/d4f/c6f 0 2024-09-17T04:21:11.233 INFO:tasks.workunit.client.0.smithi088.stdout:0/343: readlink db/le 0 2024-09-17T04:21:11.234 INFO:tasks.workunit.client.0.smithi088.stdout:0/344: write db/f1d [1371773,97173] 0 2024-09-17T04:21:11.234 INFO:tasks.workunit.client.0.smithi088.stdout:0/345: fdatasync f0 0 2024-09-17T04:21:11.235 INFO:tasks.workunit.client.0.smithi088.stdout:9/623: creat d2/dd/d11/d4f/fd3 x:0 0 0 2024-09-17T04:21:11.237 INFO:tasks.workunit.client.0.smithi088.stdout:9/624: creat d2/dd/d11/d30/fd4 x:0 0 0 2024-09-17T04:21:11.241 INFO:tasks.workunit.client.0.smithi088.stdout:9/625: mkdir d2/dd/d11/d4f/dd5 0 2024-09-17T04:21:11.244 INFO:tasks.workunit.client.0.smithi088.stdout:9/626: mknod d2/dd/d11/d4f/dd5/cd6 0 2024-09-17T04:21:11.246 INFO:tasks.workunit.client.0.smithi088.stdout:0/346: truncate db/f2a 2426256 0 2024-09-17T04:21:11.249 INFO:tasks.workunit.client.0.smithi088.stdout:0/347: creat db/d3c/d4f/d66/f70 x:0 0 0 2024-09-17T04:21:11.250 INFO:tasks.workunit.client.0.smithi088.stdout:9/627: dwrite d2/dd/fe [0,4194304] 0 2024-09-17T04:21:11.255 INFO:tasks.workunit.client.0.smithi088.stdout:0/348: creat db/d3c/d4f/d66/f71 x:0 0 0 2024-09-17T04:21:11.255 INFO:tasks.workunit.client.0.smithi088.stdout:9/628: dwrite d2/dd/d14/d8b/f4d [0,4194304] 0 2024-09-17T04:21:11.262 INFO:tasks.workunit.client.0.smithi088.stdout:0/349: creat db/f72 x:0 0 0 2024-09-17T04:21:11.265 INFO:tasks.workunit.client.0.smithi088.stdout:0/350: creat db/d1b/d39/f73 x:0 0 0 2024-09-17T04:21:11.271 INFO:tasks.workunit.client.0.smithi088.stdout:0/351: truncate f0 3845922 0 2024-09-17T04:21:11.271 INFO:tasks.workunit.client.0.smithi088.stdout:0/352: stat db/f12 0 2024-09-17T04:21:11.275 INFO:tasks.workunit.client.0.smithi088.stdout:9/629: dread d2/dd/d11/d4f/d72/d74/fa0 [0,4194304] 0 2024-09-17T04:21:11.276 INFO:tasks.workunit.client.0.smithi088.stdout:9/630: dread - d2/dd/d14/d2a/d76/fbd zero size 2024-09-17T04:21:11.277 INFO:tasks.workunit.client.0.smithi088.stdout:0/353: rename db/d3c/d4f/f52 to db/d1b/d36/d4a/d6a/f74 0 2024-09-17T04:21:11.278 INFO:tasks.workunit.client.0.smithi088.stdout:0/354: write db/d1b/d39/f62 [2044063,78672] 0 2024-09-17T04:21:11.282 INFO:tasks.workunit.client.0.smithi088.stdout:3/603: sync 2024-09-17T04:21:11.282 INFO:tasks.workunit.client.0.smithi088.stdout:6/565: sync 2024-09-17T04:21:11.282 INFO:tasks.workunit.client.0.smithi088.stdout:4/501: sync 2024-09-17T04:21:11.283 INFO:tasks.workunit.client.0.smithi088.stdout:5/443: sync 2024-09-17T04:21:11.283 INFO:tasks.workunit.client.0.smithi088.stdout:8/495: sync 2024-09-17T04:21:11.283 INFO:tasks.workunit.client.0.smithi088.stdout:2/538: sync 2024-09-17T04:21:11.283 INFO:tasks.workunit.client.0.smithi088.stdout:1/561: sync 2024-09-17T04:21:11.283 INFO:tasks.workunit.client.0.smithi088.stdout:7/555: sync 2024-09-17T04:21:11.286 INFO:tasks.workunit.client.0.smithi088.stdout:5/444: stat d2/d31/d33/d20/d47/f7c 0 2024-09-17T04:21:11.288 INFO:tasks.workunit.client.0.smithi088.stdout:6/566: chown d14/d44/d45/d6b/d29/d3e/f37 8757 1 2024-09-17T04:21:11.292 INFO:tasks.workunit.client.0.smithi088.stdout:0/355: creat db/d3c/d4f/f75 x:0 0 0 2024-09-17T04:21:11.294 INFO:tasks.workunit.client.0.smithi088.stdout:1/562: symlink d0/d13/lb9 0 2024-09-17T04:21:11.298 INFO:tasks.workunit.client.0.smithi088.stdout:2/539: dwrite d0/d1/f93 [0,4194304] 0 2024-09-17T04:21:11.298 INFO:tasks.workunit.client.0.smithi088.stdout:3/604: dwrite d0/d13/d1b/d29/d2b/fa6 [0,4194304] 0 2024-09-17T04:21:11.300 INFO:tasks.workunit.client.0.smithi088.stdout:4/502: creat d5/d3f/d71/d8b/d68/fa5 x:0 0 0 2024-09-17T04:21:11.303 INFO:tasks.workunit.client.0.smithi088.stdout:2/540: chown d0/d1/d2d/d33/d4b/d24/d3b/d22/f64 48 1 2024-09-17T04:21:11.305 INFO:tasks.workunit.client.0.smithi088.stdout:6/567: creat d14/d44/dad/fcb x:0 0 0 2024-09-17T04:21:11.306 INFO:tasks.workunit.client.0.smithi088.stdout:3/605: truncate d0/d13/f25 1731747 0 2024-09-17T04:21:11.306 INFO:tasks.workunit.client.0.smithi088.stdout:9/631: dread d2/d2b/d58/f5b [0,4194304] 0 2024-09-17T04:21:11.309 INFO:tasks.workunit.client.0.smithi088.stdout:6/568: read d14/d44/d45/d6b/d2a/f5a [347176,26351] 0 2024-09-17T04:21:11.309 INFO:tasks.workunit.client.0.smithi088.stdout:4/503: rmdir d5/d3d/d73 39 2024-09-17T04:21:11.310 INFO:tasks.workunit.client.0.smithi088.stdout:2/541: mknod d0/d1/d2d/d33/d4b/d6d/d94/ca6 0 2024-09-17T04:21:11.311 INFO:tasks.workunit.client.0.smithi088.stdout:0/356: mkdir db/d67/d76 0 2024-09-17T04:21:11.312 INFO:tasks.workunit.client.0.smithi088.stdout:2/542: chown d0/d1/d2d 108806 1 2024-09-17T04:21:11.312 INFO:tasks.workunit.client.0.smithi088.stdout:7/556: symlink d2/d4/d7/d46/da3/lad 0 2024-09-17T04:21:11.315 INFO:tasks.workunit.client.0.smithi088.stdout:1/563: getdents d0/d1/df/d20 0 2024-09-17T04:21:11.317 INFO:tasks.workunit.client.0.smithi088.stdout:5/445: rename d2/d31/d33/fc to d2/f90 0 2024-09-17T04:21:11.318 INFO:tasks.workunit.client.0.smithi088.stdout:3/606: dread d0/d13/d1b/d29/d30/d35/d65/fa7 [0,4194304] 0 2024-09-17T04:21:11.319 INFO:tasks.workunit.client.0.smithi088.stdout:9/632: fsync d2/dd/d14/d8b/d43/f55 0 2024-09-17T04:21:11.319 INFO:tasks.workunit.client.0.smithi088.stdout:6/569: dread - d14/d44/d45/d6b/d2a/d52/d7a/d7b/fa9 zero size 2024-09-17T04:21:11.323 INFO:tasks.workunit.client.0.smithi088.stdout:4/504: rmdir d5/d3f/d71/d8b/d75 39 2024-09-17T04:21:11.329 INFO:tasks.workunit.client.0.smithi088.stdout:7/557: mknod d2/d1d/d2e/d7d/d23/cae 0 2024-09-17T04:21:11.330 INFO:tasks.workunit.client.0.smithi088.stdout:4/505: dwrite d5/d3f/d71/f91 [0,4194304] 0 2024-09-17T04:21:11.337 INFO:tasks.workunit.client.0.smithi088.stdout:9/633: truncate d2/dd/d11/d30/d49/f42 1572854 0 2024-09-17T04:21:11.337 INFO:tasks.workunit.client.0.smithi088.stdout:9/634: chown d2/dd/d14/d8b/d43/fd1 15 1 2024-09-17T04:21:11.339 INFO:tasks.workunit.client.0.smithi088.stdout:9/635: write d2/dd/d11/d30/d49/f9f [1211463,97017] 0 2024-09-17T04:21:11.340 INFO:tasks.workunit.client.0.smithi088.stdout:1/564: mknod d0/d1/d16/cba 0 2024-09-17T04:21:11.341 INFO:tasks.workunit.client.0.smithi088.stdout:7/558: rmdir d2/d79 39 2024-09-17T04:21:11.342 INFO:tasks.workunit.client.0.smithi088.stdout:0/357: dread db/f2a [0,4194304] 0 2024-09-17T04:21:11.343 INFO:tasks.workunit.client.0.smithi088.stdout:7/559: write d2/d1d/d2e/d7d/d23/f35 [1008337,57264] 0 2024-09-17T04:21:11.344 INFO:tasks.workunit.client.0.smithi088.stdout:4/506: creat d5/d3f/d71/d99/fa6 x:0 0 0 2024-09-17T04:21:11.344 INFO:tasks.workunit.client.0.smithi088.stdout:7/560: readlink d2/d1d/d2e/l4c 0 2024-09-17T04:21:11.346 INFO:tasks.workunit.client.0.smithi088.stdout:3/607: link d0/d13/f22 d0/d13/d1b/d29/d30/fc7 0 2024-09-17T04:21:11.348 INFO:tasks.workunit.client.0.smithi088.stdout:6/570: link d14/d44/d45/d6b/d2a/f8d d14/d63/fcc 0 2024-09-17T04:21:11.353 INFO:tasks.workunit.client.0.smithi088.stdout:9/636: mkdir d2/d16/dd7 0 2024-09-17T04:21:11.353 INFO:tasks.workunit.client.0.smithi088.stdout:6/571: dread d14/d44/d45/d6b/f96 [0,4194304] 0 2024-09-17T04:21:11.356 INFO:tasks.workunit.client.0.smithi088.stdout:0/358: mknod db/d1b/d36/d47/c77 0 2024-09-17T04:21:11.357 INFO:tasks.workunit.client.0.smithi088.stdout:1/565: dwrite d0/d13/f60 [0,4194304] 0 2024-09-17T04:21:11.363 INFO:tasks.workunit.client.0.smithi088.stdout:6/572: truncate d14/d44/d45/d6b/d29/fab 3212113 0 2024-09-17T04:21:11.364 INFO:tasks.workunit.client.0.smithi088.stdout:0/359: dread - db/d1b/d39/f3d zero size 2024-09-17T04:21:11.365 INFO:tasks.workunit.client.0.smithi088.stdout:7/561: dread - d2/d79/f7a zero size 2024-09-17T04:21:11.366 INFO:tasks.workunit.client.0.smithi088.stdout:4/507: mknod d5/d3d/d73/ca7 0 2024-09-17T04:21:11.368 INFO:tasks.workunit.client.0.smithi088.stdout:2/543: getdents d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/d9a 0 2024-09-17T04:21:11.371 INFO:tasks.workunit.client.0.smithi088.stdout:2/544: write d0/d1/d2d/d33/d4b/f8b [637783,76746] 0 2024-09-17T04:21:11.378 INFO:tasks.workunit.client.0.smithi088.stdout:6/573: read d14/d44/d45/d6b/d16/f30 [1295704,10285] 0 2024-09-17T04:21:11.379 INFO:tasks.workunit.client.0.smithi088.stdout:6/574: chown d14/d44/d94/l91 902332 1 2024-09-17T04:21:11.380 INFO:tasks.workunit.client.0.smithi088.stdout:2/545: creat d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/d9a/fa7 x:0 0 0 2024-09-17T04:21:11.385 INFO:tasks.workunit.client.0.smithi088.stdout:0/360: symlink db/d67/d76/l78 0 2024-09-17T04:21:11.386 INFO:tasks.workunit.client.0.smithi088.stdout:9/637: dwrite d2/dd/d14/f20 [0,4194304] 0 2024-09-17T04:21:11.386 INFO:tasks.workunit.client.0.smithi088.stdout:7/562: symlink d2/laf 0 2024-09-17T04:21:11.388 INFO:tasks.workunit.client.0.smithi088.stdout:0/361: write db/d1b/d36/d4a/d6a/f56 [512484,85399] 0 2024-09-17T04:21:11.389 INFO:tasks.workunit.client.0.smithi088.stdout:3/608: truncate d0/fb0 3079267 0 2024-09-17T04:21:11.392 INFO:tasks.workunit.client.0.smithi088.stdout:1/566: getdents d0/d1/d16/d2a/da4 0 2024-09-17T04:21:11.395 INFO:tasks.workunit.client.0.smithi088.stdout:3/609: symlink d0/d13/d1b/d29/d56/lc8 0 2024-09-17T04:21:11.396 INFO:tasks.workunit.client.0.smithi088.stdout:9/638: creat d2/dd/d14/d2a/d8f/fd8 x:0 0 0 2024-09-17T04:21:11.403 INFO:tasks.workunit.client.0.smithi088.stdout:3/610: dread d0/d13/d58/d5e/f97 [0,4194304] 0 2024-09-17T04:21:11.403 INFO:tasks.workunit.client.0.smithi088.stdout:7/563: dwrite d2/d4/d7/f36 [0,4194304] 0 2024-09-17T04:21:11.407 INFO:tasks.workunit.client.0.smithi088.stdout:0/362: dwrite db/d3c/d4f/f75 [0,4194304] 0 2024-09-17T04:21:11.410 INFO:tasks.workunit.client.0.smithi088.stdout:2/546: creat d0/d1/d2d/d33/fa8 x:0 0 0 2024-09-17T04:21:11.416 INFO:tasks.workunit.client.0.smithi088.stdout:0/363: read - db/d3c/d4f/d66/f71 zero size 2024-09-17T04:21:11.419 INFO:tasks.workunit.client.0.smithi088.stdout:7/564: rmdir d2/d1d/d2e/d7d/d23/d45/d62 39 2024-09-17T04:21:11.419 INFO:tasks.workunit.client.0.smithi088.stdout:6/575: dwrite d14/d44/d45/d6b/f96 [0,4194304] 0 2024-09-17T04:21:11.419 INFO:tasks.workunit.client.0.smithi088.stdout:0/364: chown db/f72 6776 1 2024-09-17T04:21:11.424 INFO:tasks.workunit.client.0.smithi088.stdout:3/611: rename d0/d13/d8a to d0/d13/d1b/d29/d30/d3c/dc9 0 2024-09-17T04:21:11.425 INFO:tasks.workunit.client.0.smithi088.stdout:2/547: dread d0/d1/d2d/f53 [0,4194304] 0 2024-09-17T04:21:11.425 INFO:tasks.workunit.client.0.smithi088.stdout:0/365: fsync db/d1b/d36/d4a/d6a/f26 0 2024-09-17T04:21:11.428 INFO:tasks.workunit.client.0.smithi088.stdout:2/548: write d0/d13/f97 [848256,27740] 0 2024-09-17T04:21:11.428 INFO:tasks.workunit.client.0.smithi088.stdout:3/612: write d0/d13/d1b/d29/d30/d3c/d5c/f89 [696192,52438] 0 2024-09-17T04:21:11.428 INFO:tasks.workunit.client.0.smithi088.stdout:6/576: symlink d14/d44/d45/d6b/d2a/d52/lcd 0 2024-09-17T04:21:11.431 INFO:tasks.workunit.client.0.smithi088.stdout:6/577: stat d14/d44/d45/fbe 0 2024-09-17T04:21:11.433 INFO:tasks.workunit.client.0.smithi088.stdout:7/565: rename d2/d1d/d2e/d7d to d2/d1d/d2e/db0 0 2024-09-17T04:21:11.433 INFO:tasks.workunit.client.0.smithi088.stdout:1/567: write d0/d1/df/f10 [1994119,36389] 0 2024-09-17T04:21:11.436 INFO:tasks.workunit.client.0.smithi088.stdout:9/639: creat d2/dd/d14/d8b/d43/fd9 x:0 0 0 2024-09-17T04:21:11.439 INFO:tasks.workunit.client.0.smithi088.stdout:2/549: creat d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/d9a/fa9 x:0 0 0 2024-09-17T04:21:11.442 INFO:tasks.workunit.client.0.smithi088.stdout:0/366: dwrite db/f13 [0,4194304] 0 2024-09-17T04:21:11.446 INFO:tasks.workunit.client.0.smithi088.stdout:7/566: dread d2/d8d/f9d [0,4194304] 0 2024-09-17T04:21:11.446 INFO:tasks.workunit.client.0.smithi088.stdout:0/367: fdatasync db/f72 0 2024-09-17T04:21:11.448 INFO:tasks.workunit.client.0.smithi088.stdout:3/613: dwrite d0/d13/d1b/d29/d2b/fbc [0,4194304] 0 2024-09-17T04:21:11.455 INFO:tasks.workunit.client.0.smithi088.stdout:6/578: dwrite d14/d44/d45/d4d/d97/fa1 [0,4194304] 0 2024-09-17T04:21:11.458 INFO:tasks.workunit.client.0.smithi088.stdout:0/368: creat db/d67/f79 x:0 0 0 2024-09-17T04:21:11.461 INFO:tasks.workunit.client.0.smithi088.stdout:3/614: dread - d0/d13/d1b/d29/d30/d3c/d5c/f96 zero size 2024-09-17T04:21:11.464 INFO:tasks.workunit.client.0.smithi088.stdout:6/579: dread - d14/d3a/d41/f69 zero size 2024-09-17T04:21:11.464 INFO:tasks.workunit.client.0.smithi088.stdout:7/567: truncate d2/d1d/d2e/db0/f5a 3691214 0 2024-09-17T04:21:11.467 INFO:tasks.workunit.client.0.smithi088.stdout:2/550: dwrite d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/d9a/fa7 [0,4194304] 0 2024-09-17T04:21:11.467 INFO:tasks.workunit.client.0.smithi088.stdout:9/640: dread d2/fb [0,4194304] 0 2024-09-17T04:21:11.468 INFO:tasks.workunit.client.0.smithi088.stdout:0/369: write db/d1b/d39/f3a [2782611,83928] 0 2024-09-17T04:21:11.469 INFO:tasks.workunit.client.0.smithi088.stdout:3/615: dread - d0/d13/d58/d5a/f8c zero size 2024-09-17T04:21:11.469 INFO:tasks.workunit.client.0.smithi088.stdout:6/580: write d14/d44/d94/fbd [272017,5776] 0 2024-09-17T04:21:11.474 INFO:tasks.workunit.client.0.smithi088.stdout:3/616: dread - d0/d54/fb7 zero size 2024-09-17T04:21:11.475 INFO:tasks.workunit.client.0.smithi088.stdout:7/568: mknod d2/d1d/d2e/db0/cb1 0 2024-09-17T04:21:11.475 INFO:tasks.workunit.client.0.smithi088.stdout:1/568: dwrite d0/d1/df/d63/fb5 [0,4194304] 0 2024-09-17T04:21:11.478 INFO:tasks.workunit.client.0.smithi088.stdout:2/551: readlink d0/d1/d2d/d33/d4b/d24/d3b/d26/l62 0 2024-09-17T04:21:11.480 INFO:tasks.workunit.client.0.smithi088.stdout:9/641: write d2/f3 [661742,10682] 0 2024-09-17T04:21:11.480 INFO:tasks.workunit.client.0.smithi088.stdout:1/569: write d0/d13/f60 [1904131,15303] 0 2024-09-17T04:21:11.484 INFO:tasks.workunit.client.0.smithi088.stdout:0/370: creat db/d1b/d36/d4a/d20/f7a x:0 0 0 2024-09-17T04:21:11.486 INFO:tasks.workunit.client.0.smithi088.stdout:3/617: write d0/d54/fa9 [292848,61323] 0 2024-09-17T04:21:11.486 INFO:tasks.workunit.client.0.smithi088.stdout:3/618: stat d0/d13/d58/d5a/f8c 0 2024-09-17T04:21:11.493 INFO:tasks.workunit.client.0.smithi088.stdout:1/570: creat d0/d13/d84/fbb x:0 0 0 2024-09-17T04:21:11.495 INFO:tasks.workunit.client.0.smithi088.stdout:6/581: dread d14/d44/d45/d6b/d2a/f49 [0,4194304] 0 2024-09-17T04:21:11.496 INFO:tasks.workunit.client.0.smithi088.stdout:2/552: dwrite d0/d1/d2d/f6a [0,4194304] 0 2024-09-17T04:21:11.498 INFO:tasks.workunit.client.0.smithi088.stdout:0/371: creat db/d3c/d4f/d59/f7b x:0 0 0 2024-09-17T04:21:11.505 INFO:tasks.workunit.client.0.smithi088.stdout:3/619: stat d0/d13/d1b/d29/d2b/f42 0 2024-09-17T04:21:11.507 INFO:tasks.workunit.client.0.smithi088.stdout:7/569: rename d2/d4/d7/c13 to d2/d1d/d2e/db0/d23/d45/cb2 0 2024-09-17T04:21:11.509 INFO:tasks.workunit.client.0.smithi088.stdout:1/571: symlink d0/d1/d16/d2a/d9c/lbc 0 2024-09-17T04:21:11.511 INFO:tasks.workunit.client.0.smithi088.stdout:7/570: dread d2/d1d/d2e/db0/f4a [0,4194304] 0 2024-09-17T04:21:11.511 INFO:tasks.workunit.client.0.smithi088.stdout:0/372: dwrite db/d1b/d36/d4a/d6a/f68 [0,4194304] 0 2024-09-17T04:21:11.514 INFO:tasks.workunit.client.0.smithi088.stdout:9/642: creat d2/dd/d14/d8b/d35/fda x:0 0 0 2024-09-17T04:21:11.537 INFO:tasks.workunit.client.0.smithi088.stdout:6/582: mkdir d14/dce 0 2024-09-17T04:21:11.543 INFO:tasks.workunit.client.0.smithi088.stdout:1/572: dread d0/d1/f61 [0,4194304] 0 2024-09-17T04:21:11.544 INFO:tasks.workunit.client.0.smithi088.stdout:0/373: mkdir db/d67/d7c 0 2024-09-17T04:21:11.547 INFO:tasks.workunit.client.0.smithi088.stdout:9/643: readlink d2/dd/d11/d30/l32 0 2024-09-17T04:21:11.548 INFO:tasks.workunit.client.0.smithi088.stdout:9/644: chown d2/d16/l7d 3058290 1 2024-09-17T04:21:11.550 INFO:tasks.workunit.client.0.smithi088.stdout:6/583: rmdir d14/d44/d45/d6b/da7 39 2024-09-17T04:21:11.553 INFO:tasks.workunit.client.0.smithi088.stdout:1/573: unlink d0/d1/d58/l6e 0 2024-09-17T04:21:11.555 INFO:tasks.workunit.client.0.smithi088.stdout:0/374: creat db/d1b/d39/f7d x:0 0 0 2024-09-17T04:21:11.558 INFO:tasks.workunit.client.0.smithi088.stdout:2/553: truncate d0/f12 2519930 0 2024-09-17T04:21:11.561 INFO:tasks.workunit.client.0.smithi088.stdout:7/571: write d2/d4/f14 [3944035,20700] 0 2024-09-17T04:21:11.563 INFO:tasks.workunit.client.0.smithi088.stdout:6/584: mkdir d14/d44/d45/d6b/d2a/d52/dcf 0 2024-09-17T04:21:11.564 INFO:tasks.workunit.client.0.smithi088.stdout:1/574: mkdir d0/d1/df/d20/dbd 0 2024-09-17T04:21:11.565 INFO:tasks.workunit.client.0.smithi088.stdout:0/375: rmdir db/d1b/d36/d4a/d6a 39 2024-09-17T04:21:11.566 INFO:tasks.workunit.client.0.smithi088.stdout:3/620: link d0/d13/d1b/d29/d2b/d40/ca1 d0/d13/d1b/d29/d56/d85/cca 0 2024-09-17T04:21:11.569 INFO:tasks.workunit.client.0.smithi088.stdout:7/572: mkdir d2/d79/db3 0 2024-09-17T04:21:11.573 INFO:tasks.workunit.client.0.smithi088.stdout:6/585: creat d14/d44/d94/db9/fd0 x:0 0 0 2024-09-17T04:21:11.575 INFO:tasks.workunit.client.0.smithi088.stdout:6/586: write d14/d44/d45/d6b/fbf [503809,105139] 0 2024-09-17T04:21:11.575 INFO:tasks.workunit.client.0.smithi088.stdout:1/575: mkdir d0/d1/df/dbe 0 2024-09-17T04:21:11.575 INFO:tasks.workunit.client.0.smithi088.stdout:2/554: dread d0/d1/d2d/d33/d4b/d24/f2c [0,4194304] 0 2024-09-17T04:21:11.576 INFO:tasks.workunit.client.0.smithi088.stdout:0/376: symlink db/d3c/d4f/d59/l7e 0 2024-09-17T04:21:11.578 INFO:tasks.workunit.client.0.smithi088.stdout:3/621: unlink d0/d54/c8d 0 2024-09-17T04:21:11.581 INFO:tasks.workunit.client.0.smithi088.stdout:9/645: creat d2/dd/d14/d8b/d43/fdb x:0 0 0 2024-09-17T04:21:11.582 INFO:tasks.workunit.client.0.smithi088.stdout:7/573: readlink d2/d4/d7/l5b 0 2024-09-17T04:21:11.586 INFO:tasks.workunit.client.0.smithi088.stdout:6/587: mkdir d14/d44/d45/d6b/d2a/d52/dd1 0 2024-09-17T04:21:11.589 INFO:tasks.workunit.client.0.smithi088.stdout:0/377: truncate db/d1b/d36/d4a/d6a/f56 1552246 0 2024-09-17T04:21:11.595 INFO:tasks.workunit.client.0.smithi088.stdout:7/574: fdatasync d2/f6 0 2024-09-17T04:21:11.604 INFO:tasks.workunit.client.0.smithi088.stdout:0/378: mknod db/d67/d76/c7f 0 2024-09-17T04:21:11.607 INFO:tasks.workunit.client.0.smithi088.stdout:3/622: mkdir d0/d13/d1b/d29/d30/d35/dcb 0 2024-09-17T04:21:11.611 INFO:tasks.workunit.client.0.smithi088.stdout:0/379: dwrite db/d3c/d4f/f75 [4194304,4194304] 0 2024-09-17T04:21:11.621 INFO:tasks.workunit.client.0.smithi088.stdout:2/555: write d0/d1/f1e [1504563,51397] 0 2024-09-17T04:21:11.683 INFO:tasks.workunit.client.0.smithi088.stdout:0/380: creat db/d1b/d39/f80 x:0 0 0 2024-09-17T04:21:11.683 INFO:tasks.workunit.client.0.smithi088.stdout:0/381: stat db/d1b/d36/d4a/d6a/f68 0 2024-09-17T04:21:11.686 INFO:tasks.workunit.client.0.smithi088.stdout:1/576: getdents d0/d13 0 2024-09-17T04:21:11.687 INFO:tasks.workunit.client.0.smithi088.stdout:2/556: symlink d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/laa 0 2024-09-17T04:21:11.691 INFO:tasks.workunit.client.0.smithi088.stdout:0/382: stat db/d1b/d36/d4a/l51 0 2024-09-17T04:21:11.693 INFO:tasks.workunit.client.0.smithi088.stdout:7/575: creat d2/fb4 x:0 0 0 2024-09-17T04:21:11.694 INFO:tasks.workunit.client.0.smithi088.stdout:6/588: dwrite d14/d44/f5d [0,4194304] 0 2024-09-17T04:21:11.698 INFO:tasks.workunit.client.0.smithi088.stdout:1/577: readlink d0/l7e 0 2024-09-17T04:21:11.700 INFO:tasks.workunit.client.0.smithi088.stdout:1/578: write d0/d1/df/d63/f9f [1709685,99403] 0 2024-09-17T04:21:11.701 INFO:tasks.workunit.client.0.smithi088.stdout:9/646: truncate d2/dd/d14/d8b/f37 976314 0 2024-09-17T04:21:11.702 INFO:tasks.workunit.client.0.smithi088.stdout:9/647: chown d2/dd/d11/d30/f89 1194 1 2024-09-17T04:21:11.703 INFO:tasks.workunit.client.0.smithi088.stdout:9/648: dread - d2/dd/d11/d4f/f63 zero size 2024-09-17T04:21:11.704 INFO:tasks.workunit.client.0.smithi088.stdout:9/649: dread - d2/dd/d14/d2a/d76/fbd zero size 2024-09-17T04:21:11.707 INFO:tasks.workunit.client.0.smithi088.stdout:0/383: rename db/d1b/d36/c57 to db/d1b/d36/c81 0 2024-09-17T04:21:11.710 INFO:tasks.workunit.client.0.smithi088.stdout:9/650: dwrite d2/dd/f70 [0,4194304] 0 2024-09-17T04:21:11.723 INFO:tasks.workunit.client.0.smithi088.stdout:7/576: symlink d2/lb5 0 2024-09-17T04:21:11.723 INFO:tasks.workunit.client.0.smithi088.stdout:7/577: stat d2/f31 0 2024-09-17T04:21:11.724 INFO:tasks.workunit.client.0.smithi088.stdout:3/623: dwrite d0/d13/d1b/d29/d2b/d50/f74 [0,4194304] 0 2024-09-17T04:21:11.725 INFO:tasks.workunit.client.0.smithi088.stdout:9/651: rename d2/dd/d14/c6f to d2/dd/d14/d2a/d8f/d99/cdc 0 2024-09-17T04:21:11.735 INFO:tasks.workunit.client.0.smithi088.stdout:7/578: unlink d2/d1d/d2e/db0/d23/d45/f4d 0 2024-09-17T04:21:11.737 INFO:tasks.workunit.client.0.smithi088.stdout:3/624: rmdir d0/d13/d1b/d29/d56/d85 39 2024-09-17T04:21:11.740 INFO:tasks.workunit.client.0.smithi088.stdout:9/652: rmdir d2/dd/d14/d2a/d8f/d99 39 2024-09-17T04:21:11.743 INFO:tasks.workunit.client.0.smithi088.stdout:7/579: dwrite d2/d1d/d2e/db0/d23/d45/d85/f92 [0,4194304] 0 2024-09-17T04:21:11.744 INFO:tasks.workunit.client.0.smithi088.stdout:7/580: chown d2/d1d/c55 223 1 2024-09-17T04:21:11.746 INFO:tasks.workunit.client.0.smithi088.stdout:2/557: write d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/f5b [108021,45109] 0 2024-09-17T04:21:11.750 INFO:tasks.workunit.client.0.smithi088.stdout:3/625: rename d0/d13/d4d/f7d to d0/d13/d1b/d29/d2b/d40/fcc 0 2024-09-17T04:21:11.750 INFO:tasks.workunit.client.0.smithi088.stdout:6/589: dwrite d14/d44/d45/d6b/d2a/f8d [0,4194304] 0 2024-09-17T04:21:11.752 INFO:tasks.workunit.client.0.smithi088.stdout:9/653: mkdir d2/d16/ddd 0 2024-09-17T04:21:11.752 INFO:tasks.workunit.client.0.smithi088.stdout:6/590: fdatasync d14/d44/d45/d6b/d29/dac/fb1 0 2024-09-17T04:21:11.756 INFO:tasks.workunit.client.0.smithi088.stdout:0/384: getdents db/d3c 0 2024-09-17T04:21:11.758 INFO:tasks.workunit.client.0.smithi088.stdout:1/579: write d0/f4f [728571,24243] 0 2024-09-17T04:21:11.762 INFO:tasks.workunit.client.0.smithi088.stdout:7/581: symlink d2/d4/d7/d46/lb6 0 2024-09-17T04:21:11.763 INFO:tasks.workunit.client.0.smithi088.stdout:0/385: dwrite db/d1b/d39/f5c [0,4194304] 0 2024-09-17T04:21:11.764 INFO:tasks.workunit.client.0.smithi088.stdout:2/558: mknod d0/d1/d2d/cab 0 2024-09-17T04:21:11.766 INFO:tasks.workunit.client.0.smithi088.stdout:2/559: write d0/d1/d2d/d33/f38 [2755603,93158] 0 2024-09-17T04:21:11.773 INFO:tasks.workunit.client.0.smithi088.stdout:6/591: rename d14/d44/d45/d6b/d16/fb7 to d14/d44/d45/d6b/d2a/d52/dcf/fd2 0 2024-09-17T04:21:11.777 INFO:tasks.workunit.client.0.smithi088.stdout:7/582: readlink d2/d4/d7/la8 0 2024-09-17T04:21:11.784 INFO:tasks.workunit.client.0.smithi088.stdout:7/583: dwrite d2/d4/f28 [0,4194304] 0 2024-09-17T04:21:11.784 INFO:tasks.workunit.client.0.smithi088.stdout:0/386: dread db/d1b/d39/f62 [0,4194304] 0 2024-09-17T04:21:11.785 INFO:tasks.workunit.client.0.smithi088.stdout:3/626: mkdir d0/d13/d58/d5e/dc6/dcd 0 2024-09-17T04:21:11.786 INFO:tasks.workunit.client.0.smithi088.stdout:7/584: chown d2/d4/d7/d46/d67/f72 5646 1 2024-09-17T04:21:11.787 INFO:tasks.workunit.client.0.smithi088.stdout:9/654: mknod d2/dd/d14/d8b/d35/cde 0 2024-09-17T04:21:11.789 INFO:tasks.workunit.client.0.smithi088.stdout:7/585: chown d2/d1d/d2e/db0/d23/d45/d85/f92 1136 1 2024-09-17T04:21:11.790 INFO:tasks.workunit.client.0.smithi088.stdout:7/586: chown d2/d1d/d2e/db0/f3b 7952883 1 2024-09-17T04:21:11.797 INFO:tasks.workunit.client.0.smithi088.stdout:2/560: dread d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/f67 [0,4194304] 0 2024-09-17T04:21:11.798 INFO:tasks.workunit.client.0.smithi088.stdout:0/387: rename db/d67/d76 to db/d3c/d4f/d66/d82 0 2024-09-17T04:21:11.798 INFO:tasks.workunit.client.0.smithi088.stdout:2/561: stat d0/d1/d2d/f3c 0 2024-09-17T04:21:11.802 INFO:tasks.workunit.client.0.smithi088.stdout:7/587: fdatasync d2/f21 0 2024-09-17T04:21:11.803 INFO:tasks.workunit.client.0.smithi088.stdout:7/588: readlink d2/d1d/d2e/db0/d23/l7f 0 2024-09-17T04:21:11.803 INFO:tasks.workunit.client.0.smithi088.stdout:1/580: creat d0/d1/d16/d77/daa/d5b/fbf x:0 0 0 2024-09-17T04:21:11.806 INFO:tasks.workunit.client.0.smithi088.stdout:0/388: write db/d1b/d36/d4a/d6a/f74 [169379,58133] 0 2024-09-17T04:21:11.808 INFO:tasks.workunit.client.0.smithi088.stdout:9/655: mknod d2/d16/dd7/cdf 0 2024-09-17T04:21:11.809 INFO:tasks.workunit.client.0.smithi088.stdout:0/389: stat db/d1b/d36/d4a/d20/c5f 0 2024-09-17T04:21:11.811 INFO:tasks.workunit.client.0.smithi088.stdout:6/592: dread d14/d44/d45/d6b/f39 [0,4194304] 0 2024-09-17T04:21:11.813 INFO:tasks.workunit.client.0.smithi088.stdout:7/589: dread d2/d4/f52 [0,4194304] 0 2024-09-17T04:21:11.813 INFO:tasks.workunit.client.0.smithi088.stdout:2/562: getdents d0/d1/d2d/d33/d4b 0 2024-09-17T04:21:11.814 INFO:tasks.workunit.client.0.smithi088.stdout:9/656: readlink d2/dd/d11/d4f/d72/d74/la3 0 2024-09-17T04:21:11.815 INFO:tasks.workunit.client.0.smithi088.stdout:0/390: mkdir db/d1b/d39/d83 0 2024-09-17T04:21:11.817 INFO:tasks.workunit.client.0.smithi088.stdout:3/627: dread d0/d13/d1b/d29/d30/d35/f66 [0,4194304] 0 2024-09-17T04:21:11.818 INFO:tasks.workunit.client.0.smithi088.stdout:1/581: dwrite d0/d1/d16/d77/daa/d5b/f82 [0,4194304] 0 2024-09-17T04:21:11.821 INFO:tasks.workunit.client.0.smithi088.stdout:7/590: symlink d2/d4/lb7 0 2024-09-17T04:21:11.828 INFO:tasks.workunit.client.0.smithi088.stdout:9/657: rename d2/dd/d14/f19 to d2/dd/d11/d4f/db5/fe0 0 2024-09-17T04:21:11.833 INFO:tasks.workunit.client.0.smithi088.stdout:2/563: creat d0/d1/d2d/d33/d4b/d24/d92/fac x:0 0 0 2024-09-17T04:21:11.833 INFO:tasks.workunit.client.0.smithi088.stdout:6/593: write d14/d3a/d41/f69 [789969,111955] 0 2024-09-17T04:21:11.836 INFO:tasks.workunit.client.0.smithi088.stdout:0/391: mknod db/c84 0 2024-09-17T04:21:11.838 INFO:tasks.workunit.client.0.smithi088.stdout:9/658: symlink d2/dd/d11/d4f/d5c/le1 0 2024-09-17T04:21:11.842 INFO:tasks.workunit.client.0.smithi088.stdout:6/594: fsync d14/d44/d45/d6b/d2a/d52/d7a/d7b/f81 0 2024-09-17T04:21:11.843 INFO:tasks.workunit.client.0.smithi088.stdout:4/508: sync 2024-09-17T04:21:11.843 INFO:tasks.workunit.client.0.smithi088.stdout:8/496: sync 2024-09-17T04:21:11.843 INFO:tasks.workunit.client.0.smithi088.stdout:5/446: sync 2024-09-17T04:21:11.843 INFO:tasks.workunit.client.0.smithi088.stdout:6/595: chown d14/d44/d94/f78 48477 1 2024-09-17T04:21:11.844 INFO:tasks.workunit.client.0.smithi088.stdout:7/591: fdatasync d2/d1d/d2e/db0/d23/d45/d62/f76 0 2024-09-17T04:21:11.847 INFO:tasks.workunit.client.0.smithi088.stdout:3/628: creat d0/d13/fce x:0 0 0 2024-09-17T04:21:11.848 INFO:tasks.workunit.client.0.smithi088.stdout:5/447: truncate d2/d31/f77 1002582 0 2024-09-17T04:21:11.849 INFO:tasks.workunit.client.0.smithi088.stdout:7/592: readlink d2/d1d/d2e/db0/d23/l7f 0 2024-09-17T04:21:11.850 INFO:tasks.workunit.client.0.smithi088.stdout:0/392: chown db/d1b/d36/d4a/f35 14687 1 2024-09-17T04:21:11.854 INFO:tasks.workunit.client.0.smithi088.stdout:1/582: dwrite d0/d1/d16/d77/f8e [0,4194304] 0 2024-09-17T04:21:11.860 INFO:tasks.workunit.client.0.smithi088.stdout:2/564: write d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/f78 [670758,48785] 0 2024-09-17T04:21:11.861 INFO:tasks.workunit.client.0.smithi088.stdout:4/509: dwrite d5/d3f/d71/d8b/d68/da4/d5e/f9e [0,4194304] 0 2024-09-17T04:21:11.862 INFO:tasks.workunit.client.0.smithi088.stdout:3/629: dread d0/d13/d1b/d29/d2b/fbc [0,4194304] 0 2024-09-17T04:21:11.863 INFO:tasks.workunit.client.0.smithi088.stdout:6/596: unlink d14/d44/d45/d6b/d16/f6e 0 2024-09-17T04:21:11.874 INFO:tasks.workunit.client.0.smithi088.stdout:1/583: fsync d0/f8d 0 2024-09-17T04:21:11.884 INFO:tasks.workunit.client.0.smithi088.stdout:0/393: chown db/d1b/d36/d4a/l4b 3372379 1 2024-09-17T04:21:11.884 INFO:tasks.workunit.client.0.smithi088.stdout:4/510: rename d5/d32 to d5/d32/da8 22 2024-09-17T04:21:11.885 INFO:tasks.workunit.client.0.smithi088.stdout:8/497: fdatasync d7/dd/d31/f3b 0 2024-09-17T04:21:11.885 INFO:tasks.workunit.client.0.smithi088.stdout:2/565: symlink d0/d1/d2d/d33/d4b/d24/d4d/lad 0 2024-09-17T04:21:11.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:11 smithi088 ceph-mon[27811]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:21:11.888 INFO:tasks.workunit.client.0.smithi088.stdout:7/593: creat d2/d79/db3/fb8 x:0 0 0 2024-09-17T04:21:11.889 INFO:tasks.workunit.client.0.smithi088.stdout:9/659: rmdir d2/dd/d14/d8b/d43/db2 0 2024-09-17T04:21:11.890 INFO:tasks.workunit.client.0.smithi088.stdout:5/448: dwrite d2/d31/d33/d20/d25/f41 [0,4194304] 0 2024-09-17T04:21:11.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:11 smithi134 ceph-mon[35201]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:21:11.896 INFO:tasks.workunit.client.0.smithi088.stdout:4/511: mknod d5/d32/d6b/ca9 0 2024-09-17T04:21:11.898 INFO:tasks.workunit.client.0.smithi088.stdout:0/394: rename db/d3c/d4f/d66/c69 to db/d1b/d36/c85 0 2024-09-17T04:21:11.900 INFO:tasks.workunit.client.0.smithi088.stdout:7/594: mkdir d2/d96/db9 0 2024-09-17T04:21:11.902 INFO:tasks.workunit.client.0.smithi088.stdout:6/597: dwrite d14/d44/f8a [0,4194304] 0 2024-09-17T04:21:11.903 INFO:tasks.workunit.client.0.smithi088.stdout:2/566: fsync d0/d1/d2d/d33/d4b/d24/d3b/f1f 0 2024-09-17T04:21:11.904 INFO:tasks.workunit.client.0.smithi088.stdout:3/630: write d0/d13/d58/d5e/fb5 [4204704,49753] 0 2024-09-17T04:21:11.905 INFO:tasks.workunit.client.0.smithi088.stdout:1/584: creat d0/d1/d16/dae/db8/fc0 x:0 0 0 2024-09-17T04:21:11.908 INFO:tasks.workunit.client.0.smithi088.stdout:3/631: write d0/d13/d1b/d29/d2b/fa6 [3767223,71864] 0 2024-09-17T04:21:11.910 INFO:tasks.workunit.client.0.smithi088.stdout:4/512: creat d5/d3f/d71/d99/faa x:0 0 0 2024-09-17T04:21:11.910 INFO:tasks.workunit.client.0.smithi088.stdout:3/632: write d0/f12 [8779491,128500] 0 2024-09-17T04:21:11.913 INFO:tasks.workunit.client.0.smithi088.stdout:3/633: dread - d0/d13/d1b/d29/d30/d3c/f94 zero size 2024-09-17T04:21:11.913 INFO:tasks.workunit.client.0.smithi088.stdout:8/498: rename d7/d29/c9b to d7/d29/d7e/ca2 0 2024-09-17T04:21:11.920 INFO:tasks.workunit.client.0.smithi088.stdout:4/513: dwrite d5/d3d/d73/f9b [0,4194304] 0 2024-09-17T04:21:11.920 INFO:tasks.workunit.client.0.smithi088.stdout:0/395: mknod db/d1b/d36/d4a/d20/c86 0 2024-09-17T04:21:11.922 INFO:tasks.workunit.client.0.smithi088.stdout:2/567: mknod d0/d1/d2d/d33/d85/cae 0 2024-09-17T04:21:11.925 INFO:tasks.workunit.client.0.smithi088.stdout:4/514: write d5/d32/f57 [1554864,110966] 0 2024-09-17T04:21:11.925 INFO:tasks.workunit.client.0.smithi088.stdout:0/396: chown db/d3c/d4f/d66/d82/c7f 283 1 2024-09-17T04:21:11.930 INFO:tasks.workunit.client.0.smithi088.stdout:9/660: creat d2/dd/d14/fe2 x:0 0 0 2024-09-17T04:21:11.937 INFO:tasks.workunit.client.0.smithi088.stdout:2/568: mknod d0/d1/d2d/d33/d4b/caf 0 2024-09-17T04:21:11.938 INFO:tasks.workunit.client.0.smithi088.stdout:2/569: readlink d0/d1/d2d/l95 0 2024-09-17T04:21:11.940 INFO:tasks.workunit.client.0.smithi088.stdout:4/515: mkdir d5/d3f/d71/d8b/d68/dab 0 2024-09-17T04:21:11.941 INFO:tasks.workunit.client.0.smithi088.stdout:4/516: stat d5/d3f 0 2024-09-17T04:21:11.942 INFO:tasks.workunit.client.0.smithi088.stdout:8/499: truncate d7/d29/f3c 3377183 0 2024-09-17T04:21:11.945 INFO:tasks.workunit.client.0.smithi088.stdout:4/517: read d5/d32/d6b/f86 [387885,116687] 0 2024-09-17T04:21:11.946 INFO:tasks.workunit.client.0.smithi088.stdout:5/449: getdents d2/d31/d33/d20 0 2024-09-17T04:21:11.947 INFO:tasks.workunit.client.0.smithi088.stdout:2/570: readlink d0/d1/d2d/d33/d4b/d24/d4d/l50 0 2024-09-17T04:21:11.948 INFO:tasks.workunit.client.0.smithi088.stdout:1/585: rename d0/d1/d27/c2d to d0/cc1 0 2024-09-17T04:21:11.949 INFO:tasks.workunit.client.0.smithi088.stdout:2/571: chown d0/d1/d2d/d33/d4b/d6d/d94/da5 3 1 2024-09-17T04:21:11.950 INFO:tasks.workunit.client.0.smithi088.stdout:9/661: symlink d2/d2b/d7c/le3 0 2024-09-17T04:21:11.952 INFO:tasks.workunit.client.0.smithi088.stdout:7/595: link d2/d4/d7/d46/d67/fa9 d2/d1d/d2e/db0/d23/d45/d6d/fba 0 2024-09-17T04:21:11.953 INFO:tasks.workunit.client.0.smithi088.stdout:0/397: dread db/f14 [0,4194304] 0 2024-09-17T04:21:11.954 INFO:tasks.workunit.client.0.smithi088.stdout:5/450: fsync d2/d31/d33/d20/d25/d2c/f3c 0 2024-09-17T04:21:11.955 INFO:tasks.workunit.client.0.smithi088.stdout:0/398: fdatasync db/d1b/d39/f3a 0 2024-09-17T04:21:11.957 INFO:tasks.workunit.client.0.smithi088.stdout:6/598: rename d14/d44/d45/d6b/d2a/l79 to d14/d44/d45/d6b/d16/d42/ld3 0 2024-09-17T04:21:11.957 INFO:tasks.workunit.client.0.smithi088.stdout:3/634: link d0/l20 d0/d13/d1b/d29/d2b/d40/lcf 0 2024-09-17T04:21:11.957 INFO:tasks.workunit.client.0.smithi088.stdout:1/586: dread - d0/d1/d16/d77/daa/d5b/d87/fb7 zero size 2024-09-17T04:21:11.958 INFO:tasks.workunit.client.0.smithi088.stdout:0/399: chown db/d1b/d39/f5c 404186872 1 2024-09-17T04:21:11.958 INFO:tasks.workunit.client.0.smithi088.stdout:6/599: chown d14/d44/d45/d6b 64669292 1 2024-09-17T04:21:11.964 INFO:tasks.workunit.client.0.smithi088.stdout:8/500: symlink d7/dd/d6f/la3 0 2024-09-17T04:21:11.974 INFO:tasks.workunit.client.0.smithi088.stdout:7/596: dread d2/d1d/d2e/db0/f30 [0,4194304] 0 2024-09-17T04:21:11.974 INFO:tasks.workunit.client.0.smithi088.stdout:5/451: creat d2/d31/d33/d20/d30/f91 x:0 0 0 2024-09-17T04:21:11.978 INFO:tasks.workunit.client.0.smithi088.stdout:1/587: dread d0/d13/d84/d5d/f72 [0,4194304] 0 2024-09-17T04:21:11.978 INFO:tasks.workunit.client.0.smithi088.stdout:3/635: unlink d0/d13/d1b/d29/d56/f64 0 2024-09-17T04:21:11.979 INFO:tasks.workunit.client.0.smithi088.stdout:3/636: write d0/d13/f99 [618677,109511] 0 2024-09-17T04:21:11.981 INFO:tasks.workunit.client.0.smithi088.stdout:3/637: dread - d0/d13/d1b/d29/d30/d3c/fa4 zero size 2024-09-17T04:21:11.983 INFO:tasks.workunit.client.0.smithi088.stdout:8/501: chown d7/dd/c1e 3406882 1 2024-09-17T04:21:11.983 INFO:tasks.workunit.client.0.smithi088.stdout:8/502: readlink d7/l17 0 2024-09-17T04:21:11.992 INFO:tasks.workunit.client.0.smithi088.stdout:5/452: creat d2/d31/d33/d20/d30/d51/d5e/d6b/f92 x:0 0 0 2024-09-17T04:21:11.995 INFO:tasks.workunit.client.0.smithi088.stdout:2/572: dwrite d0/f12 [0,4194304] 0 2024-09-17T04:21:11.995 INFO:tasks.workunit.client.0.smithi088.stdout:1/588: creat d0/d13/d84/fc2 x:0 0 0 2024-09-17T04:21:12.000 INFO:tasks.workunit.client.0.smithi088.stdout:9/662: creat d2/dd/fe4 x:0 0 0 2024-09-17T04:21:12.001 INFO:tasks.workunit.client.0.smithi088.stdout:4/518: getdents d5/d72 0 2024-09-17T04:21:12.005 INFO:tasks.workunit.client.0.smithi088.stdout:8/503: rename d7/c32 to d7/d29/d2a/d38/d3d/ca4 0 2024-09-17T04:21:12.006 INFO:tasks.workunit.client.0.smithi088.stdout:7/597: mkdir d2/d1d/d2e/db0/d23/d97/dbb 0 2024-09-17T04:21:12.007 INFO:tasks.workunit.client.0.smithi088.stdout:0/400: creat db/d1b/f87 x:0 0 0 2024-09-17T04:21:12.009 INFO:tasks.workunit.client.0.smithi088.stdout:5/453: creat d2/d31/d33/d20/d25/d2c/d3d/f93 x:0 0 0 2024-09-17T04:21:12.012 INFO:tasks.workunit.client.0.smithi088.stdout:9/663: fdatasync d2/d2b/f80 0 2024-09-17T04:21:12.013 INFO:tasks.workunit.client.0.smithi088.stdout:4/519: mknod d5/d3f/d71/d99/cac 0 2024-09-17T04:21:12.014 INFO:tasks.workunit.client.0.smithi088.stdout:4/520: fdatasync d5/d3d/f7a 0 2024-09-17T04:21:12.021 INFO:tasks.workunit.client.0.smithi088.stdout:0/401: creat db/d3c/d4f/d66/f88 x:0 0 0 2024-09-17T04:21:12.022 INFO:tasks.workunit.client.0.smithi088.stdout:2/573: symlink d0/d1/d2d/d33/d4b/d24/d3b/d26/d8c/lb0 0 2024-09-17T04:21:12.026 INFO:tasks.workunit.client.0.smithi088.stdout:5/454: rename d2/d31/d33/d20/d30/l3a to d2/d31/d33/d20/d25/d49/l94 0 2024-09-17T04:21:12.029 INFO:tasks.workunit.client.0.smithi088.stdout:9/664: creat d2/d16/dd7/fe5 x:0 0 0 2024-09-17T04:21:12.032 INFO:tasks.workunit.client.0.smithi088.stdout:3/638: truncate d0/d13/d1b/d29/d2b/fa6 1718477 0 2024-09-17T04:21:12.036 INFO:tasks.workunit.client.0.smithi088.stdout:2/574: creat d0/d1/d2d/d33/d4b/d6d/d94/fb1 x:0 0 0 2024-09-17T04:21:12.040 INFO:tasks.workunit.client.0.smithi088.stdout:9/665: rmdir d2/dd/d11 39 2024-09-17T04:21:12.042 INFO:tasks.workunit.client.0.smithi088.stdout:5/455: creat d2/d31/d33/d20/d30/d51/d5e/d6b/f95 x:0 0 0 2024-09-17T04:21:12.043 INFO:tasks.workunit.client.0.smithi088.stdout:4/521: mknod d5/d32/cad 0 2024-09-17T04:21:12.044 INFO:tasks.workunit.client.0.smithi088.stdout:8/504: write d7/d29/f12 [17260881,27176] 0 2024-09-17T04:21:12.046 INFO:tasks.workunit.client.0.smithi088.stdout:3/639: dwrite d0/d13/d58/d5a/d63/fbb [0,4194304] 0 2024-09-17T04:21:12.046 INFO:tasks.workunit.client.0.smithi088.stdout:0/402: truncate db/d1b/d39/f3a 7626754 0 2024-09-17T04:21:12.048 INFO:tasks.workunit.client.0.smithi088.stdout:0/403: readlink db/l16 0 2024-09-17T04:21:12.049 INFO:tasks.workunit.client.0.smithi088.stdout:3/640: dread d0/d93/faf [0,4194304] 0 2024-09-17T04:21:12.049 INFO:tasks.workunit.client.0.smithi088.stdout:2/575: mknod d0/d1/d2d/d33/d4b/d6d/cb2 0 2024-09-17T04:21:12.053 INFO:tasks.workunit.client.0.smithi088.stdout:9/666: stat d2/dd/d11/d4f/d5c/dbc 0 2024-09-17T04:21:12.054 INFO:tasks.workunit.client.0.smithi088.stdout:8/505: symlink d7/d7f/la5 0 2024-09-17T04:21:12.058 INFO:tasks.workunit.client.0.smithi088.stdout:7/598: dwrite d2/d1d/d2e/db0/f5e [4194304,4194304] 0 2024-09-17T04:21:12.059 INFO:tasks.workunit.client.0.smithi088.stdout:0/404: unlink db/d1b/d36/d4a/d6a/l63 0 2024-09-17T04:21:12.062 INFO:tasks.workunit.client.0.smithi088.stdout:2/576: mknod d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/d7c/cb3 0 2024-09-17T04:21:12.065 INFO:tasks.workunit.client.0.smithi088.stdout:4/522: dread d5/f1f [0,4194304] 0 2024-09-17T04:21:12.073 INFO:tasks.workunit.client.0.smithi088.stdout:9/667: rename d2/dd/d14/d2a/fa2 to d2/dd/d11/d4f/d72/d74/fe6 0 2024-09-17T04:21:12.074 INFO:tasks.workunit.client.0.smithi088.stdout:5/456: dread d2/d31/d33/f58 [0,4194304] 0 2024-09-17T04:21:12.076 INFO:tasks.workunit.client.0.smithi088.stdout:9/668: write d2/dd/d14/d8b/f4d [3771954,53049] 0 2024-09-17T04:21:12.080 INFO:tasks.workunit.client.0.smithi088.stdout:2/577: fdatasync d0/d1/d2d/d33/d80/f40 0 2024-09-17T04:21:12.080 INFO:tasks.workunit.client.0.smithi088.stdout:9/669: readlink d2/dd/d11/d4f/db5/lc2 0 2024-09-17T04:21:12.083 INFO:tasks.workunit.client.0.smithi088.stdout:9/670: read d2/dd/d14/d2a/d76/d98/f9c [814402,92536] 0 2024-09-17T04:21:12.091 INFO:tasks.workunit.client.0.smithi088.stdout:2/578: unlink d0/d1/d2d/d33/d4b/d24/d3b/d26/l62 0 2024-09-17T04:21:12.092 INFO:tasks.workunit.client.0.smithi088.stdout:4/523: creat d5/d3f/d71/d8b/d68/dab/fae x:0 0 0 2024-09-17T04:21:12.092 INFO:tasks.workunit.client.0.smithi088.stdout:2/579: stat d0/c20 0 2024-09-17T04:21:12.093 INFO:tasks.workunit.client.0.smithi088.stdout:8/506: dwrite d7/dd/d31/d47/f93 [0,4194304] 0 2024-09-17T04:21:12.094 INFO:tasks.workunit.client.0.smithi088.stdout:4/524: fsync d5/d32/d6b/f9c 0 2024-09-17T04:21:12.096 INFO:tasks.workunit.client.0.smithi088.stdout:9/671: mknod d2/dd/d14/d2a/d76/d98/db3/ce7 0 2024-09-17T04:21:12.097 INFO:tasks.workunit.client.0.smithi088.stdout:2/580: write d0/d1/d2d/d33/f6f [3186907,75643] 0 2024-09-17T04:21:12.099 INFO:tasks.workunit.client.0.smithi088.stdout:9/672: write d2/dd/d14/d8b/d43/d51/f71 [960090,81097] 0 2024-09-17T04:21:12.101 INFO:tasks.workunit.client.0.smithi088.stdout:2/581: readlink d0/d1/d2d/d33/d4b/d24/d3b/l1a 0 2024-09-17T04:21:12.102 INFO:tasks.workunit.client.0.smithi088.stdout:0/405: creat db/d1b/f89 x:0 0 0 2024-09-17T04:21:12.104 INFO:tasks.workunit.client.0.smithi088.stdout:2/582: read d0/d1/d2d/d33/d80/f40 [587780,89317] 0 2024-09-17T04:21:12.105 INFO:tasks.workunit.client.0.smithi088.stdout:7/599: rename d2/d1d/d2e/db0/d23/d45/l48 to d2/d4/lbc 0 2024-09-17T04:21:12.105 INFO:tasks.workunit.client.0.smithi088.stdout:2/583: write d0/d13/f97 [418209,1895] 0 2024-09-17T04:21:12.107 INFO:tasks.workunit.client.0.smithi088.stdout:2/584: write d0/d13/f97 [308547,104092] 0 2024-09-17T04:21:12.108 INFO:tasks.workunit.client.0.smithi088.stdout:0/406: read db/d1b/d36/f43 [2899142,121148] 0 2024-09-17T04:21:12.108 INFO:tasks.workunit.client.0.smithi088.stdout:8/507: write d7/dd/d31/f76 [344560,70390] 0 2024-09-17T04:21:12.115 INFO:tasks.workunit.client.0.smithi088.stdout:5/457: write d2/f27 [387867,106689] 0 2024-09-17T04:21:12.130 INFO:tasks.workunit.client.0.smithi088.stdout:0/407: symlink db/d1b/d39/l8a 0 2024-09-17T04:21:12.130 INFO:tasks.workunit.client.0.smithi088.stdout:0/408: chown db/d1b/d39/l8a 2073637 1 2024-09-17T04:21:12.132 INFO:tasks.workunit.client.0.smithi088.stdout:2/585: unlink d0/d1/d2d/d33/d4b/d24/d3b/c31 0 2024-09-17T04:21:12.134 INFO:tasks.workunit.client.0.smithi088.stdout:4/525: unlink d5/d3f/d71/d8b/d68/dab/fae 0 2024-09-17T04:21:12.139 INFO:tasks.workunit.client.0.smithi088.stdout:8/508: mknod d7/dd/ca6 0 2024-09-17T04:21:12.140 INFO:tasks.workunit.client.0.smithi088.stdout:8/509: write d7/f24 [3698949,70039] 0 2024-09-17T04:21:12.140 INFO:tasks.workunit.client.0.smithi088.stdout:0/409: rmdir db/d1b/d39 39 2024-09-17T04:21:12.141 INFO:tasks.workunit.client.0.smithi088.stdout:8/510: readlink d7/d29/d2a/l59 0 2024-09-17T04:21:12.142 INFO:tasks.workunit.client.0.smithi088.stdout:2/586: mknod d0/d1/d2d/d33/d4b/d24/d92/cb4 0 2024-09-17T04:21:12.149 INFO:tasks.workunit.client.0.smithi088.stdout:7/600: rename d2/d1d/d2e/db0/d23/l7f to d2/d1d/d2e/db0/d23/d45/lbd 0 2024-09-17T04:21:12.151 INFO:tasks.workunit.client.0.smithi088.stdout:9/673: write d2/dd/f1b [1930846,29655] 0 2024-09-17T04:21:12.157 INFO:tasks.workunit.client.0.smithi088.stdout:8/511: symlink d7/d29/d2a/d38/la7 0 2024-09-17T04:21:12.161 INFO:tasks.workunit.client.0.smithi088.stdout:2/587: creat d0/d1/d2d/d33/d4b/d24/d92/fb5 x:0 0 0 2024-09-17T04:21:12.161 INFO:tasks.workunit.client.0.smithi088.stdout:0/410: write db/f12 [428416,61924] 0 2024-09-17T04:21:12.162 INFO:tasks.workunit.client.0.smithi088.stdout:5/458: dwrite d2/d31/d33/d20/d47/f8e [0,4194304] 0 2024-09-17T04:21:12.168 INFO:tasks.workunit.client.0.smithi088.stdout:7/601: mkdir d2/d96/dbe 0 2024-09-17T04:21:12.168 INFO:tasks.workunit.client.0.smithi088.stdout:8/512: truncate d7/dd/d31/f70 43311 0 2024-09-17T04:21:12.171 INFO:tasks.workunit.client.0.smithi088.stdout:5/459: truncate d2/d31/d33/f58 4344507 0 2024-09-17T04:21:12.171 INFO:tasks.workunit.client.0.smithi088.stdout:7/602: truncate d2/d1d/d2e/db0/d23/d45/f57 4712866 0 2024-09-17T04:21:12.175 INFO:tasks.workunit.client.0.smithi088.stdout:4/526: rename d5/d32/l59 to d5/laf 0 2024-09-17T04:21:12.176 INFO:tasks.workunit.client.0.smithi088.stdout:8/513: mkdir d7/d29/d2a/d38/d3d/da0/da8 0 2024-09-17T04:21:12.178 INFO:tasks.workunit.client.0.smithi088.stdout:7/603: write d2/d4/f86 [682819,121133] 0 2024-09-17T04:21:12.178 INFO:tasks.workunit.client.0.smithi088.stdout:4/527: unlink d5/l5a 0 2024-09-17T04:21:12.181 INFO:tasks.workunit.client.0.smithi088.stdout:7/604: chown d2/d1d/d2e/db0/f30 0 1 2024-09-17T04:21:12.182 INFO:tasks.workunit.client.0.smithi088.stdout:9/674: rename d2/d2b/f38 to d2/dd/d14/d2a/d76/fe8 0 2024-09-17T04:21:12.186 INFO:tasks.workunit.client.0.smithi088.stdout:8/514: write d7/d29/d2a/d75/f7a [957158,85783] 0 2024-09-17T04:21:12.190 INFO:tasks.workunit.client.0.smithi088.stdout:4/528: rename d5/d3f/d71/d8b/d68/da4/l4a to d5/d3f/lb0 0 2024-09-17T04:21:12.192 INFO:tasks.workunit.client.0.smithi088.stdout:4/529: write d5/d72/fa3 [16097,51475] 0 2024-09-17T04:21:12.192 INFO:tasks.workunit.client.0.smithi088.stdout:9/675: link d2/d2b/d2e/f57 d2/dd/d14/d2a/d76/fe9 0 2024-09-17T04:21:12.195 INFO:tasks.workunit.client.0.smithi088.stdout:4/530: fsync d5/f4b 0 2024-09-17T04:21:12.195 INFO:tasks.workunit.client.0.smithi088.stdout:0/411: dread f0 [0,4194304] 0 2024-09-17T04:21:12.199 INFO:tasks.workunit.client.0.smithi088.stdout:0/412: write db/d1b/d36/d4a/d6a/f68 [1486459,54460] 0 2024-09-17T04:21:12.200 INFO:tasks.workunit.client.0.smithi088.stdout:4/531: rename d5/d72/f7c to d5/d3f/d71/d8b/d68/dab/fb1 0 2024-09-17T04:21:12.208 INFO:tasks.workunit.client.0.smithi088.stdout:7/605: dread d2/d1d/d2e/db0/f5e [0,4194304] 0 2024-09-17T04:21:12.209 INFO:tasks.workunit.client.0.smithi088.stdout:7/606: readlink d2/d1d/d2e/db0/d23/l38 0 2024-09-17T04:21:12.212 INFO:tasks.workunit.client.0.smithi088.stdout:0/413: mknod db/d67/d7c/c8b 0 2024-09-17T04:21:12.223 INFO:tasks.workunit.client.0.smithi088.stdout:0/414: dwrite db/d1b/f87 [0,4194304] 0 2024-09-17T04:21:12.223 INFO:tasks.workunit.client.0.smithi088.stdout:4/532: dread d5/f1a [0,4194304] 0 2024-09-17T04:21:12.229 INFO:tasks.workunit.client.0.smithi088.stdout:8/515: truncate d7/dd/f82 910018 0 2024-09-17T04:21:12.231 INFO:tasks.workunit.client.0.smithi088.stdout:4/533: unlink d5/d3f/lb0 0 2024-09-17T04:21:12.232 INFO:tasks.workunit.client.0.smithi088.stdout:8/516: mknod d7/d29/ca9 0 2024-09-17T04:21:12.233 INFO:tasks.workunit.client.0.smithi088.stdout:7/607: dread d2/d1d/d2e/db0/d23/d45/d62/f77 [0,4194304] 0 2024-09-17T04:21:12.234 INFO:tasks.workunit.client.0.smithi088.stdout:0/415: dwrite db/d3c/d4f/d66/f70 [0,4194304] 0 2024-09-17T04:21:12.238 INFO:tasks.workunit.client.0.smithi088.stdout:8/517: write d7/f9a [503726,42129] 0 2024-09-17T04:21:12.239 INFO:tasks.workunit.client.0.smithi088.stdout:9/676: dwrite d2/dd/d14/d2a/d76/d98/f9c [0,4194304] 0 2024-09-17T04:21:12.242 INFO:tasks.workunit.client.0.smithi088.stdout:9/677: truncate d2/d2b/d58/f9b 182003 0 2024-09-17T04:21:12.243 INFO:tasks.workunit.client.0.smithi088.stdout:9/678: fsync d2/dd/d14/f20 0 2024-09-17T04:21:12.243 INFO:tasks.workunit.client.0.smithi088.stdout:8/518: rmdir d7/d29/d2a 39 2024-09-17T04:21:12.245 INFO:tasks.workunit.client.0.smithi088.stdout:9/679: fsync d2/dd/d14/d8b/f7e 0 2024-09-17T04:21:12.245 INFO:tasks.workunit.client.0.smithi088.stdout:7/608: symlink d2/d4/d7/d46/da3/lbf 0 2024-09-17T04:21:12.251 INFO:tasks.workunit.client.0.smithi088.stdout:4/534: link d5/d3f/d71/d8b/d68/da4/d5e/f61 d5/d3f/d71/d8b/d68/dab/fb2 0 2024-09-17T04:21:12.252 INFO:tasks.workunit.client.0.smithi088.stdout:0/416: getdents db/d1b/d39/d83 0 2024-09-17T04:21:12.253 INFO:tasks.workunit.client.0.smithi088.stdout:9/680: write d2/dd/d14/d2a/d8f/d99/fce [607668,120906] 0 2024-09-17T04:21:12.254 INFO:tasks.workunit.client.0.smithi088.stdout:8/519: mkdir d7/d29/daa 0 2024-09-17T04:21:12.258 INFO:tasks.workunit.client.0.smithi088.stdout:7/609: link d2/d4/d7/d46/d67/f72 d2/d4/d7/d46/da3/fc0 0 2024-09-17T04:21:12.261 INFO:tasks.workunit.client.0.smithi088.stdout:0/417: dread db/d1b/d39/f5c [0,4194304] 0 2024-09-17T04:21:12.263 INFO:tasks.workunit.client.0.smithi088.stdout:9/681: dwrite d2/dd/d14/d8b/d43/d51/fb0 [0,4194304] 0 2024-09-17T04:21:12.270 INFO:tasks.workunit.client.0.smithi088.stdout:0/418: stat db/d1b/d36/c81 0 2024-09-17T04:21:12.273 INFO:tasks.workunit.client.0.smithi088.stdout:8/520: rename d7/d29/d2a/d3a/f9d to d7/d29/d2a/d38/d3d/fab 0 2024-09-17T04:21:12.274 INFO:tasks.workunit.client.0.smithi088.stdout:9/682: dwrite d2/d2b/f8c [0,4194304] 0 2024-09-17T04:21:12.277 INFO:tasks.workunit.client.0.smithi088.stdout:0/419: mkdir db/d67/d8c 0 2024-09-17T04:21:12.281 INFO:tasks.workunit.client.0.smithi088.stdout:9/683: mknod d2/db8/cea 0 2024-09-17T04:21:12.283 INFO:tasks.workunit.client.0.smithi088.stdout:0/420: creat db/d1b/d39/f8d x:0 0 0 2024-09-17T04:21:12.283 INFO:tasks.workunit.client.0.smithi088.stdout:4/535: write d5/d32/f44 [1696296,114315] 0 2024-09-17T04:21:12.288 INFO:tasks.workunit.client.0.smithi088.stdout:7/610: dwrite d2/d1d/d2e/db0/d23/d45/d62/d82/f9a [4194304,4194304] 0 2024-09-17T04:21:12.289 INFO:tasks.workunit.client.0.smithi088.stdout:9/684: symlink d2/dd/d11/d30/d49/leb 0 2024-09-17T04:21:12.289 INFO:tasks.workunit.client.0.smithi088.stdout:0/421: fsync db/d1b/d39/f5c 0 2024-09-17T04:21:12.294 INFO:tasks.workunit.client.0.smithi088.stdout:9/685: unlink d2/d16/ca7 0 2024-09-17T04:21:12.299 INFO:tasks.workunit.client.0.smithi088.stdout:7/611: dwrite d2/d1d/d2e/db0/d23/fa5 [0,4194304] 0 2024-09-17T04:21:12.302 INFO:tasks.workunit.client.0.smithi088.stdout:8/521: write d7/dd/d31/f70 [937185,128253] 0 2024-09-17T04:21:12.305 INFO:tasks.workunit.client.0.smithi088.stdout:7/612: fdatasync d2/f6 0 2024-09-17T04:21:12.307 INFO:tasks.workunit.client.0.smithi088.stdout:4/536: getdents d5/d3d 0 2024-09-17T04:21:12.309 INFO:tasks.workunit.client.0.smithi088.stdout:8/522: dread d7/d29/f6e [0,4194304] 0 2024-09-17T04:21:12.313 INFO:tasks.workunit.client.0.smithi088.stdout:9/686: write d2/dd/d14/d2a/d76/fe9 [2342088,20440] 0 2024-09-17T04:21:12.316 INFO:tasks.workunit.client.0.smithi088.stdout:7/613: fsync d2/d1d/d2e/db0/d23/fa5 0 2024-09-17T04:21:12.318 INFO:tasks.workunit.client.0.smithi088.stdout:8/523: unlink d7/l85 0 2024-09-17T04:21:12.318 INFO:tasks.workunit.client.0.smithi088.stdout:0/422: dwrite db/f10 [0,4194304] 0 2024-09-17T04:21:12.320 INFO:tasks.workunit.client.0.smithi088.stdout:0/423: chown db/d1b 577 1 2024-09-17T04:21:12.320 INFO:tasks.workunit.client.0.smithi088.stdout:8/524: dread - d7/dd/d6f/f8d zero size 2024-09-17T04:21:12.321 INFO:tasks.workunit.client.0.smithi088.stdout:7/614: rmdir d2/d1d/d2e/db0/d23/d45/d85 39 2024-09-17T04:21:12.322 INFO:tasks.workunit.client.0.smithi088.stdout:7/615: write d2/d1d/d2e/f78 [3035755,120953] 0 2024-09-17T04:21:12.324 INFO:tasks.workunit.client.0.smithi088.stdout:7/616: read d2/d4/d7/d20/f3c [281872,114239] 0 2024-09-17T04:21:12.328 INFO:tasks.workunit.client.0.smithi088.stdout:4/537: dwrite d5/f1f [0,4194304] 0 2024-09-17T04:21:12.331 INFO:tasks.workunit.client.0.smithi088.stdout:8/525: link d7/d29/d2a/d38/d3d/l89 d7/d29/daa/lac 0 2024-09-17T04:21:12.333 INFO:tasks.workunit.client.0.smithi088.stdout:8/526: chown d7/dd/d31/d47/d55/d57/f71 68 1 2024-09-17T04:21:12.334 INFO:tasks.workunit.client.0.smithi088.stdout:7/617: symlink d2/d1d/d2e/db0/lc1 0 2024-09-17T04:21:12.336 INFO:tasks.workunit.client.0.smithi088.stdout:7/618: mkdir d2/d96/dc2 0 2024-09-17T04:21:12.337 INFO:tasks.workunit.client.0.smithi088.stdout:8/527: unlink d7/d29/d2a/d38/d3d/f80 0 2024-09-17T04:21:12.341 INFO:tasks.workunit.client.0.smithi088.stdout:8/528: creat d7/dd/d31/d47/d55/fad x:0 0 0 2024-09-17T04:21:12.341 INFO:tasks.workunit.client.0.smithi088.stdout:7/619: symlink d2/d1d/d2e/db0/d23/d45/lc3 0 2024-09-17T04:21:12.342 INFO:tasks.workunit.client.0.smithi088.stdout:4/538: dread d5/d32/f67 [0,4194304] 0 2024-09-17T04:21:12.348 INFO:tasks.workunit.client.0.smithi088.stdout:4/539: creat d5/d3f/d71/d8b/fb3 x:0 0 0 2024-09-17T04:21:12.350 INFO:tasks.workunit.client.0.smithi088.stdout:7/620: dwrite d2/d4/f33 [0,4194304] 0 2024-09-17T04:21:12.351 INFO:tasks.workunit.client.0.smithi088.stdout:4/540: symlink d5/d3d/lb4 0 2024-09-17T04:21:12.353 INFO:tasks.workunit.client.0.smithi088.stdout:7/621: write d2/d1d/d2e/f78 [2394508,1965] 0 2024-09-17T04:21:12.357 INFO:tasks.workunit.client.0.smithi088.stdout:7/622: stat d2/d1d/d2e/db0/d23/d45/cb2 0 2024-09-17T04:21:12.359 INFO:tasks.workunit.client.0.smithi088.stdout:4/541: creat d5/d3f/d71/d8b/d68/da4/d5e/fb5 x:0 0 0 2024-09-17T04:21:12.365 INFO:tasks.workunit.client.0.smithi088.stdout:8/529: dread d7/d7f/f8b [0,4194304] 0 2024-09-17T04:21:12.368 INFO:tasks.workunit.client.0.smithi088.stdout:4/542: dwrite d5/d32/f90 [0,4194304] 0 2024-09-17T04:21:12.370 INFO:tasks.workunit.client.0.smithi088.stdout:8/530: creat d7/d29/d2a/d38/d3d/da0/da8/fae x:0 0 0 2024-09-17T04:21:12.378 INFO:tasks.workunit.client.0.smithi088.stdout:4/543: dwrite d5/d3f/d71/d8b/d68/da4/f52 [0,4194304] 0 2024-09-17T04:21:12.380 INFO:tasks.workunit.client.0.smithi088.stdout:8/531: dread d7/dd/d31/d47/f93 [0,4194304] 0 2024-09-17T04:21:12.382 INFO:tasks.workunit.client.0.smithi088.stdout:4/544: fsync d5/d3f/d71/d99/faa 0 2024-09-17T04:21:12.384 INFO:tasks.workunit.client.0.smithi088.stdout:7/623: dwrite d2/d1d/f58 [0,4194304] 0 2024-09-17T04:21:12.386 INFO:tasks.workunit.client.0.smithi088.stdout:8/532: write d7/dd/d31/d47/d55/f74 [1470767,3485] 0 2024-09-17T04:21:12.386 INFO:tasks.workunit.client.0.smithi088.stdout:7/624: write d2/d1d/d2e/db0/d23/f2f [3327103,4564] 0 2024-09-17T04:21:12.389 INFO:tasks.workunit.client.0.smithi088.stdout:8/533: write d7/d29/d2a/d38/d3d/da0/da8/fae [847476,24213] 0 2024-09-17T04:21:12.393 INFO:tasks.workunit.client.0.smithi088.stdout:7/625: symlink d2/d1d/d2e/db0/d23/lc4 0 2024-09-17T04:21:12.393 INFO:tasks.workunit.client.0.smithi088.stdout:4/545: symlink d5/d3f/lb6 0 2024-09-17T04:21:12.395 INFO:tasks.workunit.client.0.smithi088.stdout:4/546: readlink d5/d3f/d71/d8b/d68/l8f 0 2024-09-17T04:21:12.395 INFO:tasks.workunit.client.0.smithi088.stdout:4/547: chown d5/d32/l5b 24416090 1 2024-09-17T04:21:12.397 INFO:tasks.workunit.client.0.smithi088.stdout:8/534: dread d7/dd/f56 [0,4194304] 0 2024-09-17T04:21:12.411 INFO:tasks.workunit.client.0.smithi088.stdout:8/535: dread d7/d29/f2e [0,4194304] 0 2024-09-17T04:21:12.415 INFO:tasks.workunit.client.0.smithi088.stdout:4/548: dwrite d5/f4b [0,4194304] 0 2024-09-17T04:21:12.417 INFO:tasks.workunit.client.0.smithi088.stdout:8/536: mkdir d7/d29/d2a/d38/daf 0 2024-09-17T04:21:12.419 INFO:tasks.workunit.client.0.smithi088.stdout:4/549: dread d5/d32/d6b/f86 [0,4194304] 0 2024-09-17T04:21:12.420 INFO:tasks.workunit.client.0.smithi088.stdout:8/537: mknod d7/d29/d2a/d38/d3d/da0/cb0 0 2024-09-17T04:21:12.420 INFO:tasks.workunit.client.0.smithi088.stdout:8/538: chown d7/dd 3 1 2024-09-17T04:21:12.421 INFO:tasks.workunit.client.0.smithi088.stdout:4/550: stat d5/d32/f79 0 2024-09-17T04:21:12.422 INFO:tasks.workunit.client.0.smithi088.stdout:7/626: dread d2/f21 [0,4194304] 0 2024-09-17T04:21:12.425 INFO:tasks.workunit.client.0.smithi088.stdout:8/539: unlink d7/d29/d2a/c86 0 2024-09-17T04:21:12.426 INFO:tasks.workunit.client.0.smithi088.stdout:4/551: mknod d5/d3f/d71/d8b/d68/da4/d5e/cb7 0 2024-09-17T04:21:12.427 INFO:tasks.workunit.client.0.smithi088.stdout:4/552: chown d5/d3f/f39 2 1 2024-09-17T04:21:12.429 INFO:tasks.workunit.client.0.smithi088.stdout:4/553: write d5/d32/d6b/f8c [530296,52117] 0 2024-09-17T04:21:12.432 INFO:tasks.workunit.client.0.smithi088.stdout:4/554: read d5/f2d [1300545,21623] 0 2024-09-17T04:21:12.433 INFO:tasks.workunit.client.0.smithi088.stdout:4/555: chown d5/d32/d6b/f9c 5001650 1 2024-09-17T04:21:12.442 INFO:tasks.workunit.client.0.smithi088.stdout:4/556: rename d5/f23 to d5/d3d/d73/fb8 0 2024-09-17T04:21:12.443 INFO:tasks.workunit.client.0.smithi088.stdout:8/540: truncate d7/dd/d31/f76 67034 0 2024-09-17T04:21:12.444 INFO:tasks.workunit.client.0.smithi088.stdout:4/557: stat d5/d3f/f41 0 2024-09-17T04:21:12.445 INFO:tasks.workunit.client.0.smithi088.stdout:8/541: write d7/d7f/f8b [329981,15374] 0 2024-09-17T04:21:12.446 INFO:tasks.workunit.client.0.smithi088.stdout:4/558: fsync d5/d72/f74 0 2024-09-17T04:21:12.447 INFO:tasks.workunit.client.0.smithi088.stdout:8/542: fdatasync d7/d29/f2e 0 2024-09-17T04:21:12.448 INFO:tasks.workunit.client.0.smithi088.stdout:4/559: creat d5/d3f/d71/d8b/d68/fb9 x:0 0 0 2024-09-17T04:21:12.449 INFO:tasks.workunit.client.0.smithi088.stdout:4/560: dread - d5/d3f/d71/d8b/d68/da4/f8a zero size 2024-09-17T04:21:12.450 INFO:tasks.workunit.client.0.smithi088.stdout:8/543: mknod d7/dd/d6f/cb1 0 2024-09-17T04:21:12.451 INFO:tasks.workunit.client.0.smithi088.stdout:8/544: readlink d7/dd/d6f/la3 0 2024-09-17T04:21:12.452 INFO:tasks.workunit.client.0.smithi088.stdout:4/561: symlink d5/d3f/d71/d8b/d68/lba 0 2024-09-17T04:21:12.453 INFO:tasks.workunit.client.0.smithi088.stdout:8/545: mkdir d7/d29/d2a/d38/d3d/d63/db2 0 2024-09-17T04:21:12.454 INFO:tasks.workunit.client.0.smithi088.stdout:4/562: chown d5/d3f/f3b 1102757893 1 2024-09-17T04:21:12.456 INFO:tasks.workunit.client.0.smithi088.stdout:4/563: write d5/d32/d6b/f86 [1240142,118260] 0 2024-09-17T04:21:12.457 INFO:tasks.workunit.client.0.smithi088.stdout:4/564: chown d5/d3f/d71/d8b/d68/da4/f52 5449 1 2024-09-17T04:21:12.458 INFO:tasks.workunit.client.0.smithi088.stdout:8/546: rename d7/dd/d31/d47/d55/d57/f98 to d7/d7f/fb3 0 2024-09-17T04:21:12.464 INFO:tasks.workunit.client.0.smithi088.stdout:8/547: rename d7/dd/d31/l6a to d7/d29/d2a/d75/lb4 0 2024-09-17T04:21:12.467 INFO:tasks.workunit.client.0.smithi088.stdout:8/548: dread d7/f9a [0,4194304] 0 2024-09-17T04:21:12.473 INFO:tasks.workunit.client.0.smithi088.stdout:4/565: dread d5/d3f/d71/d8b/f88 [0,4194304] 0 2024-09-17T04:21:12.474 INFO:tasks.workunit.client.0.smithi088.stdout:8/549: rename d7/f24 to d7/dd/d31/fb5 0 2024-09-17T04:21:12.480 INFO:tasks.workunit.client.0.smithi088.stdout:8/550: mkdir d7/dd/d6f/db6 0 2024-09-17T04:21:12.483 INFO:tasks.workunit.client.0.smithi088.stdout:4/566: mkdir d5/d3f/d71/d8b/d68/dab/dbb 0 2024-09-17T04:21:12.484 INFO:tasks.workunit.client.0.smithi088.stdout:8/551: mkdir d7/d29/d2a/d38/d3d/d63/db7 0 2024-09-17T04:21:12.485 INFO:tasks.workunit.client.0.smithi088.stdout:8/552: chown d7/dd/ca1 31744 1 2024-09-17T04:21:12.486 INFO:tasks.workunit.client.0.smithi088.stdout:4/567: dread d5/d32/d6b/f86 [0,4194304] 0 2024-09-17T04:21:12.490 INFO:tasks.workunit.client.0.smithi088.stdout:8/553: creat d7/d29/d2a/d38/d3d/da0/da8/fb8 x:0 0 0 2024-09-17T04:21:12.491 INFO:tasks.workunit.client.0.smithi088.stdout:8/554: chown d7/d29/d2a/f35 224 1 2024-09-17T04:21:12.497 INFO:tasks.workunit.client.0.smithi088.stdout:4/568: link d5/d3f/d71/d8b/d68/dab/fb1 d5/d3f/d71/d8b/d68/da4/d5e/d83/fbc 0 2024-09-17T04:21:12.506 INFO:tasks.workunit.client.0.smithi088.stdout:8/555: dread d7/d29/d2a/f2b [0,4194304] 0 2024-09-17T04:21:12.519 INFO:tasks.workunit.client.0.smithi088.stdout:4/569: write d5/d3f/d71/d8b/d68/da4/d5e/f6a [1285098,57010] 0 2024-09-17T04:21:12.521 INFO:tasks.workunit.client.0.smithi088.stdout:4/570: truncate d5/d32/d6b/f9c 561663 0 2024-09-17T04:21:12.536 INFO:tasks.workunit.client.0.smithi088.stdout:8/556: creat d7/dd/d6f/fb9 x:0 0 0 2024-09-17T04:21:12.538 INFO:tasks.workunit.client.0.smithi088.stdout:6/600: sync 2024-09-17T04:21:12.539 INFO:tasks.workunit.client.0.smithi088.stdout:6/601: fsync d14/d44/d45/d6b/d29/f2d 0 2024-09-17T04:21:12.542 INFO:tasks.workunit.client.0.smithi088.stdout:4/571: dwrite d5/f2d [0,4194304] 0 2024-09-17T04:21:12.548 INFO:tasks.workunit.client.0.smithi088.stdout:8/557: dwrite d7/d29/d2a/f35 [0,4194304] 0 2024-09-17T04:21:12.550 INFO:tasks.workunit.client.0.smithi088.stdout:8/558: chown d7/d29/d2a/d38/d42/f5b 750832 1 2024-09-17T04:21:12.553 INFO:tasks.workunit.client.0.smithi088.stdout:4/572: dwrite d5/d3f/d71/f91 [0,4194304] 0 2024-09-17T04:21:12.559 INFO:tasks.workunit.client.0.smithi088.stdout:8/559: dwrite d7/d29/d2a/f4a [0,4194304] 0 2024-09-17T04:21:12.563 INFO:tasks.workunit.client.0.smithi088.stdout:4/573: symlink d5/d3f/d71/d8b/d68/dab/dbb/lbd 0 2024-09-17T04:21:12.566 INFO:tasks.workunit.client.0.smithi088.stdout:6/602: truncate d14/d44/d45/d6b/d2a/f49 3300418 0 2024-09-17T04:21:12.572 INFO:tasks.workunit.client.0.smithi088.stdout:4/574: dwrite d5/d3f/d71/d8b/fb3 [0,4194304] 0 2024-09-17T04:21:12.572 INFO:tasks.workunit.client.0.smithi088.stdout:4/575: fdatasync d5/d32/f57 0 2024-09-17T04:21:12.577 INFO:tasks.workunit.client.0.smithi088.stdout:4/576: rename d5/d3f/d71/d8b/d68/da4/l78 to d5/d3f/d71/d8b/d68/dab/lbe 0 2024-09-17T04:21:12.586 INFO:tasks.workunit.client.0.smithi088.stdout:4/577: dread d5/d3f/d71/d8b/d68/dab/fb2 [0,4194304] 0 2024-09-17T04:21:12.590 INFO:tasks.workunit.client.0.smithi088.stdout:8/560: truncate d7/d29/d2a/f4a 5238811 0 2024-09-17T04:21:12.593 INFO:tasks.workunit.client.0.smithi088.stdout:8/561: mknod d7/d29/d2a/d38/d3d/cba 0 2024-09-17T04:21:12.594 INFO:tasks.workunit.client.0.smithi088.stdout:8/562: readlink d7/dd/d31/d47/d55/l66 0 2024-09-17T04:21:12.596 INFO:tasks.workunit.client.0.smithi088.stdout:4/578: creat d5/d3f/fbf x:0 0 0 2024-09-17T04:21:12.596 INFO:tasks.workunit.client.0.smithi088.stdout:8/563: fsync d7/dd/d31/d47/d55/fad 0 2024-09-17T04:21:12.597 INFO:tasks.workunit.client.0.smithi088.stdout:8/564: chown d7/d29/d2a/d38/d3d/da0 38283 1 2024-09-17T04:21:12.608 INFO:tasks.workunit.client.0.smithi088.stdout:4/579: rename d5/d3f/d71/d99/faa to d5/d3f/d71/d8b/d68/da4/d5e/fc0 0 2024-09-17T04:21:12.610 INFO:tasks.workunit.client.0.smithi088.stdout:8/565: rename d7/dd/d31/c8f to d7/d29/d2a/d75/cbb 0 2024-09-17T04:21:12.614 INFO:tasks.workunit.client.0.smithi088.stdout:8/566: rmdir d7/dd/d31/d47/d55/d57/d6b 39 2024-09-17T04:21:12.620 INFO:tasks.workunit.client.0.smithi088.stdout:4/580: link d5/d3d/c40 d5/d3f/d71/d8b/d68/da4/d5e/cc1 0 2024-09-17T04:21:12.632 INFO:tasks.workunit.client.0.smithi088.stdout:8/567: write d7/d29/d2a/d3a/d79/f81 [846529,93799] 0 2024-09-17T04:21:12.641 INFO:tasks.workunit.client.0.smithi088.stdout:8/568: dwrite d7/dd/d31/f6d [0,4194304] 0 2024-09-17T04:21:12.645 INFO:tasks.workunit.client.0.smithi088.stdout:8/569: fdatasync d7/d29/d2a/d38/d3d/fab 0 2024-09-17T04:21:12.650 INFO:tasks.workunit.client.0.smithi088.stdout:8/570: creat d7/fbc x:0 0 0 2024-09-17T04:21:12.700 INFO:tasks.workunit.client.0.smithi088.stdout:1/589: sync 2024-09-17T04:21:12.703 INFO:tasks.workunit.client.0.smithi088.stdout:1/590: creat d0/d1/df/d20/dbd/fc3 x:0 0 0 2024-09-17T04:21:12.707 INFO:tasks.workunit.client.0.smithi088.stdout:1/591: getdents d0/d1/d58 0 2024-09-17T04:21:12.710 INFO:tasks.workunit.client.0.smithi088.stdout:1/592: getdents d0/d1/d16/d77/daa/d5b/d87 0 2024-09-17T04:21:12.715 INFO:tasks.workunit.client.0.smithi088.stdout:1/593: dwrite d0/f4f [0,4194304] 0 2024-09-17T04:21:12.721 INFO:tasks.workunit.client.0.smithi088.stdout:1/594: dwrite d0/d1/df/d20/f62 [0,4194304] 0 2024-09-17T04:21:12.722 INFO:tasks.workunit.client.0.smithi088.stdout:1/595: readlink d0/l92 0 2024-09-17T04:21:12.724 INFO:tasks.workunit.client.0.smithi088.stdout:1/596: rmdir d0/d1/d27 39 2024-09-17T04:21:12.725 INFO:tasks.workunit.client.0.smithi088.stdout:1/597: read - d0/d1/df/d63/f76 zero size 2024-09-17T04:21:12.727 INFO:tasks.workunit.client.0.smithi088.stdout:1/598: symlink d0/d1/d16/d77/daa/d5b/d87/lc4 0 2024-09-17T04:21:12.747 INFO:tasks.workunit.client.0.smithi088.stdout:1/599: dwrite d0/d13/d84/d5d/f65 [0,4194304] 0 2024-09-17T04:21:12.761 INFO:tasks.workunit.client.0.smithi088.stdout:1/600: write d0/d13/d84/f59 [397440,28259] 0 2024-09-17T04:21:12.762 INFO:tasks.workunit.client.0.smithi088.stdout:1/601: chown d0/d1/fa 963918635 1 2024-09-17T04:21:12.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:12 smithi088 ceph-mon[27811]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:21:12.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:12 smithi088 ceph-mon[27811]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:21:12.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:12 smithi088 ceph-mon[27811]: Reconfiguring prometheus.smithi088 (dependencies changed)... 2024-09-17T04:21:12.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:12 smithi088 ceph-mon[27811]: Reconfiguring daemon prometheus.smithi088 on smithi088 2024-09-17T04:21:12.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:12 smithi088 ceph-mon[27811]: pgmap v27: 65 pgs: 65 active+clean; 3.3 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail; 112 MiB/s rd, 296 MiB/s wr, 611 op/s 2024-09-17T04:21:12.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:12 smithi134 ceph-mon[35201]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:21:12.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:12 smithi134 ceph-mon[35201]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:21:12.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:12 smithi134 ceph-mon[35201]: Reconfiguring prometheus.smithi088 (dependencies changed)... 2024-09-17T04:21:12.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:12 smithi134 ceph-mon[35201]: Reconfiguring daemon prometheus.smithi088 on smithi088 2024-09-17T04:21:12.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:12 smithi134 ceph-mon[35201]: pgmap v27: 65 pgs: 65 active+clean; 3.3 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail; 112 MiB/s rd, 296 MiB/s wr, 611 op/s 2024-09-17T04:21:13.128 INFO:tasks.workunit.client.0.smithi088.stdout:3/641: sync 2024-09-17T04:21:13.132 INFO:tasks.workunit.client.0.smithi088.stdout:3/642: creat d0/d13/d1b/d29/d72/fd0 x:0 0 0 2024-09-17T04:21:13.134 INFO:tasks.workunit.client.0.smithi088.stdout:3/643: unlink d0/d13/d1b/f88 0 2024-09-17T04:21:13.134 INFO:tasks.workunit.client.0.smithi088.stdout:3/644: chown d0/d54/d55/f7b 122 1 2024-09-17T04:21:13.136 INFO:tasks.workunit.client.0.smithi088.stdout:3/645: readlink d0/d13/d1b/d29/d30/d35/l5f 0 2024-09-17T04:21:13.139 INFO:tasks.workunit.client.0.smithi088.stdout:3/646: link d0/d13/f99 d0/d54/fd1 0 2024-09-17T04:21:13.142 INFO:tasks.workunit.client.0.smithi088.stdout:3/647: getdents d0/d13/d58/d5a/d63/d80 0 2024-09-17T04:21:13.144 INFO:tasks.workunit.client.0.smithi088.stdout:3/648: rmdir d0/d13/d58/d5e/dc6 39 2024-09-17T04:21:13.144 INFO:tasks.workunit.client.0.smithi088.stdout:3/649: chown d0/d13/d1b/d29/d56 486052323 1 2024-09-17T04:21:13.145 INFO:tasks.workunit.client.0.smithi088.stdout:3/650: chown d0/d13/d1b/d29/d30/d3c/d5c/f89 5 1 2024-09-17T04:21:13.148 INFO:tasks.workunit.client.0.smithi088.stdout:3/651: mknod d0/d13/d1b/d29/cd2 0 2024-09-17T04:21:13.148 INFO:tasks.workunit.client.0.smithi088.stdout:3/652: dread - d0/d13/f9a zero size 2024-09-17T04:21:13.152 INFO:tasks.workunit.client.0.smithi088.stdout:3/653: rename d0/d13/c4a to d0/d13/d58/cd3 0 2024-09-17T04:21:13.156 INFO:tasks.workunit.client.0.smithi088.stdout:3/654: rename d0/d13/d58/d5a/d63/d80/db8 to d0/d13/d1b/d29/d72/dd4 0 2024-09-17T04:21:13.158 INFO:tasks.workunit.client.0.smithi088.stdout:3/655: fsync d0/d54/f84 0 2024-09-17T04:21:13.159 INFO:tasks.workunit.client.0.smithi088.stdout:3/656: fdatasync d0/d13/fce 0 2024-09-17T04:21:13.161 INFO:tasks.workunit.client.0.smithi088.stdout:3/657: creat d0/d13/d58/d5a/d63/d80/fd5 x:0 0 0 2024-09-17T04:21:13.166 INFO:tasks.workunit.client.0.smithi088.stdout:3/658: mknod d0/d13/d1b/d29/d2b/cd6 0 2024-09-17T04:21:13.171 INFO:tasks.workunit.client.0.smithi088.stdout:3/659: truncate d0/f2 3275837 0 2024-09-17T04:21:13.177 INFO:tasks.workunit.client.0.smithi088.stdout:3/660: truncate d0/f12 6941514 0 2024-09-17T04:21:13.179 INFO:tasks.workunit.client.0.smithi088.stdout:3/661: dread - d0/d54/d55/f7b zero size 2024-09-17T04:21:13.184 INFO:tasks.workunit.client.0.smithi088.stdout:3/662: rename d0/d13/d1b/d29/d72 to d0/d13/d58/dd7 0 2024-09-17T04:21:13.186 INFO:tasks.workunit.client.0.smithi088.stdout:3/663: dread d0/d13/d1b/d29/d30/f48 [0,4194304] 0 2024-09-17T04:21:13.224 INFO:tasks.workunit.client.0.smithi088.stdout:3/664: dread d0/f12 [0,4194304] 0 2024-09-17T04:21:13.225 INFO:tasks.workunit.client.0.smithi088.stdout:3/665: dread d0/d13/d1b/d29/d30/f48 [0,4194304] 0 2024-09-17T04:21:13.427 INFO:tasks.workunit.client.0.smithi088.stdout:2/588: sync 2024-09-17T04:21:13.429 INFO:tasks.workunit.client.0.smithi088.stdout:2/589: chown d0/d1/d2d/d33/d80/f3e 7606042 1 2024-09-17T04:21:13.429 INFO:tasks.workunit.client.0.smithi088.stdout:2/590: chown d0/d1/d2d/d33/d4b/d24/d92 116 1 2024-09-17T04:21:13.430 INFO:tasks.workunit.client.0.smithi088.stdout:2/591: stat d0/d1/d2d/d33/d4b/c58 0 2024-09-17T04:21:13.443 INFO:tasks.workunit.client.0.smithi088.stdout:2/592: dread d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/d9a/fa7 [0,4194304] 0 2024-09-17T04:21:13.445 INFO:tasks.workunit.client.0.smithi088.stdout:2/593: creat d0/d1/d2d/fb6 x:0 0 0 2024-09-17T04:21:13.448 INFO:tasks.workunit.client.0.smithi088.stdout:2/594: unlink d0/d1/d2d/d33/d4b/d24/d3b/d22/l44 0 2024-09-17T04:21:13.452 INFO:tasks.workunit.client.0.smithi088.stdout:2/595: dread d0/d1/d2d/f3a [0,4194304] 0 2024-09-17T04:21:13.454 INFO:tasks.workunit.client.0.smithi088.stdout:2/596: creat d0/d1/d2d/d33/d4b/d24/d3b/fb7 x:0 0 0 2024-09-17T04:21:13.463 INFO:tasks.workunit.client.0.smithi088.stdout:2/597: link d0/d1/d2d/d33/d4b/d24/d3b/d26/c48 d0/d1/d2d/d77/cb8 0 2024-09-17T04:21:13.465 INFO:tasks.workunit.client.0.smithi088.stdout:2/598: write d0/d1/d2d/d33/d80/f19 [1565174,113823] 0 2024-09-17T04:21:13.466 INFO:tasks.workunit.client.0.smithi088.stdout:2/599: dread - d0/d1/d2d/d33/d4b/d6d/d94/fb1 zero size 2024-09-17T04:21:13.468 INFO:tasks.workunit.client.0.smithi088.stdout:2/600: write d0/d1/f1e [1137277,94055] 0 2024-09-17T04:21:13.473 INFO:tasks.workunit.client.0.smithi088.stdout:2/601: rename d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/d9a/fa9 to d0/d1/d2d/d33/d4b/d24/d3b/fb9 0 2024-09-17T04:21:13.475 INFO:tasks.workunit.client.0.smithi088.stdout:2/602: mkdir d0/d1/d2d/d33/d4b/d24/d3b/d22/dba 0 2024-09-17T04:21:13.483 INFO:tasks.workunit.client.0.smithi088.stdout:2/603: write d0/d1/d2d/f3a [415259,103864] 0 2024-09-17T04:21:13.491 INFO:tasks.workunit.client.0.smithi088.stdout:2/604: dwrite d0/d1/d2d/f75 [0,4194304] 0 2024-09-17T04:21:13.493 INFO:tasks.workunit.client.0.smithi088.stdout:2/605: rmdir d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/d7c 39 2024-09-17T04:21:13.497 INFO:tasks.workunit.client.0.smithi088.stdout:2/606: getdents d0/d1/d2d/d33/d4b/d24 0 2024-09-17T04:21:13.498 INFO:tasks.workunit.client.0.smithi088.stdout:2/607: write d0/d1/d2d/fa1 [413712,57321] 0 2024-09-17T04:21:13.506 INFO:tasks.workunit.client.0.smithi088.stdout:2/608: dwrite d0/d1/d2d/d33/d4b/d24/d3b/fb7 [0,4194304] 0 2024-09-17T04:21:13.509 INFO:tasks.workunit.client.0.smithi088.stdout:2/609: creat d0/d1/d2d/d33/d4b/d6d/fbb x:0 0 0 2024-09-17T04:21:13.511 INFO:tasks.workunit.client.0.smithi088.stdout:2/610: mkdir d0/dbc 0 2024-09-17T04:21:13.548 INFO:tasks.workunit.client.0.smithi088.stdout:5/460: sync 2024-09-17T04:21:13.548 INFO:tasks.workunit.client.0.smithi088.stdout:9/687: sync 2024-09-17T04:21:13.549 INFO:tasks.workunit.client.0.smithi088.stdout:5/461: truncate d2/d31/f45 1941701 0 2024-09-17T04:21:13.549 INFO:tasks.workunit.client.0.smithi088.stdout:5/462: fdatasync d2/d31/d33/f7e 0 2024-09-17T04:21:13.550 INFO:tasks.workunit.client.0.smithi088.stdout:5/463: dread - d2/d31/d33/d20/d30/d51/d5e/f78 zero size 2024-09-17T04:21:13.586 INFO:tasks.workunit.client.0.smithi088.stdout:2/611: chown d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/d7c/cb3 0 1 2024-09-17T04:21:13.588 INFO:tasks.workunit.client.0.smithi088.stdout:5/464: creat d2/d31/d33/d20/d25/d49/f96 x:0 0 0 2024-09-17T04:21:13.589 INFO:tasks.workunit.client.0.smithi088.stdout:2/612: mkdir d0/d1/d2d/dbd 0 2024-09-17T04:21:13.590 INFO:tasks.workunit.client.0.smithi088.stdout:9/688: symlink d2/d2b/dbf/lec 0 2024-09-17T04:21:13.591 INFO:tasks.workunit.client.0.smithi088.stdout:5/465: write d2/d31/d33/d20/f84 [340900,115607] 0 2024-09-17T04:21:13.593 INFO:tasks.workunit.client.0.smithi088.stdout:5/466: write d2/d31/d33/d20/d25/d49/f4a [1994246,64239] 0 2024-09-17T04:21:13.598 INFO:tasks.workunit.client.0.smithi088.stdout:2/613: dwrite d0/d1/d2d/f53 [0,4194304] 0 2024-09-17T04:21:13.598 INFO:tasks.workunit.client.0.smithi088.stdout:5/467: truncate d2/d31/d33/d20/d30/d51/d5e/d6b/f95 519693 0 2024-09-17T04:21:13.600 INFO:tasks.workunit.client.0.smithi088.stdout:2/614: fsync d0/d1/d2d/d33/d4b/d24/d3b/f59 0 2024-09-17T04:21:13.605 INFO:tasks.workunit.client.0.smithi088.stdout:5/468: truncate d2/d31/d33/d20/d47/f48 213088 0 2024-09-17T04:21:13.606 INFO:tasks.workunit.client.0.smithi088.stdout:2/615: dwrite d0/d1/d2d/d33/d4b/d24/d3b/d26/f4e [0,4194304] 0 2024-09-17T04:21:13.610 INFO:tasks.workunit.client.0.smithi088.stdout:5/469: mknod d2/d31/d33/d20/d25/c97 0 2024-09-17T04:21:13.614 INFO:tasks.workunit.client.0.smithi088.stdout:2/616: rename d0/d1/d2d/d33/d80/f3e to d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/d7c/fbe 0 2024-09-17T04:21:13.615 INFO:tasks.workunit.client.0.smithi088.stdout:5/470: fdatasync d2/f15 0 2024-09-17T04:21:13.630 INFO:tasks.workunit.client.0.smithi088.stdout:2/617: fsync d0/d1/d2d/d33/d4b/d24/d3b/f59 0 2024-09-17T04:21:13.631 INFO:tasks.workunit.client.0.smithi088.stdout:2/618: read - d0/d1/d2d/d33/d85/fa0 zero size 2024-09-17T04:21:13.635 INFO:tasks.workunit.client.0.smithi088.stdout:2/619: creat d0/d1/d2d/dbd/fbf x:0 0 0 2024-09-17T04:21:13.637 INFO:tasks.workunit.client.0.smithi088.stdout:9/689: dwrite d2/d2b/d2e/f8a [0,4194304] 0 2024-09-17T04:21:13.641 INFO:tasks.workunit.client.0.smithi088.stdout:9/690: creat d2/d16/fed x:0 0 0 2024-09-17T04:21:13.644 INFO:tasks.workunit.client.0.smithi088.stdout:2/620: symlink d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/d7c/lc0 0 2024-09-17T04:21:13.647 INFO:tasks.workunit.client.0.smithi088.stdout:2/621: stat d0/d1/d2d/d33/d4b/d6d/c87 0 2024-09-17T04:21:13.648 INFO:tasks.workunit.client.0.smithi088.stdout:2/622: fdatasync d0/d1/d2d/d33/f38 0 2024-09-17T04:21:13.649 INFO:tasks.workunit.client.0.smithi088.stdout:2/623: chown d0/d1/d2d/d33/d4b/c7b 501856 1 2024-09-17T04:21:13.653 INFO:tasks.workunit.client.0.smithi088.stdout:2/624: creat d0/d1/d2d/d33/d4b/d24/d3b/d26/d8c/fc1 x:0 0 0 2024-09-17T04:21:13.653 INFO:tasks.workunit.client.0.smithi088.stdout:9/691: getdents d2/d2b/d58/d82 0 2024-09-17T04:21:13.657 INFO:tasks.workunit.client.0.smithi088.stdout:9/692: symlink d2/dd/d11/lee 0 2024-09-17T04:21:13.660 INFO:tasks.workunit.client.0.smithi088.stdout:2/625: creat d0/d1/d2d/d33/d4b/d24/d3b/d22/dba/fc2 x:0 0 0 2024-09-17T04:21:13.661 INFO:tasks.workunit.client.0.smithi088.stdout:9/693: creat d2/dd/d11/d30/d49/fef x:0 0 0 2024-09-17T04:21:13.661 INFO:tasks.workunit.client.0.smithi088.stdout:5/471: dwrite d2/d31/d33/d20/d47/f71 [0,4194304] 0 2024-09-17T04:21:13.666 INFO:tasks.workunit.client.0.smithi088.stdout:5/472: creat d2/d31/d33/d20/d47/f98 x:0 0 0 2024-09-17T04:21:13.669 INFO:tasks.workunit.client.0.smithi088.stdout:9/694: mknod d2/dd/d11/d4f/d5c/dbc/cf0 0 2024-09-17T04:21:13.673 INFO:tasks.workunit.client.0.smithi088.stdout:9/695: read d2/fc [33532,15833] 0 2024-09-17T04:21:13.678 INFO:tasks.workunit.client.0.smithi088.stdout:2/626: dread d0/d1/d2d/d33/d80/f40 [0,4194304] 0 2024-09-17T04:21:13.681 INFO:tasks.workunit.client.0.smithi088.stdout:2/627: unlink d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/d9a/c9f 0 2024-09-17T04:21:13.682 INFO:tasks.workunit.client.0.smithi088.stdout:2/628: write d0/d1/d2d/d33/d4b/d24/d3b/d22/dba/fc2 [755995,107116] 0 2024-09-17T04:21:13.685 INFO:tasks.workunit.client.0.smithi088.stdout:2/629: symlink d0/d1/d2d/d33/d4b/d24/d3b/d22/lc3 0 2024-09-17T04:21:13.691 INFO:tasks.workunit.client.0.smithi088.stdout:5/473: truncate d2/d31/d33/d20/d47/f8e 1931801 0 2024-09-17T04:21:13.694 INFO:tasks.workunit.client.0.smithi088.stdout:5/474: unlink d2/d31/d33/d20/d25/d2c/f3c 0 2024-09-17T04:21:13.695 INFO:tasks.workunit.client.0.smithi088.stdout:9/696: dwrite d2/d2b/f80 [0,4194304] 0 2024-09-17T04:21:13.697 INFO:tasks.workunit.client.0.smithi088.stdout:9/697: fsync d2/dd/d11/d30/f7f 0 2024-09-17T04:21:13.700 INFO:tasks.workunit.client.0.smithi088.stdout:2/630: dread d0/d1/d2d/d33/d4b/d24/d3b/f1f [0,4194304] 0 2024-09-17T04:21:13.700 INFO:tasks.workunit.client.0.smithi088.stdout:5/475: creat d2/d31/d33/d20/d30/d51/d5e/d6b/f99 x:0 0 0 2024-09-17T04:21:13.708 INFO:tasks.workunit.client.0.smithi088.stdout:5/476: creat d2/d31/d33/d20/d25/d49/f9a x:0 0 0 2024-09-17T04:21:13.711 INFO:tasks.workunit.client.0.smithi088.stdout:9/698: symlink d2/dd/d14/d8b/d43/lf1 0 2024-09-17T04:21:13.711 INFO:tasks.workunit.client.0.smithi088.stdout:9/699: chown d2/dd/d14/d2a/d76/d98/db3 89106 1 2024-09-17T04:21:13.715 INFO:tasks.workunit.client.0.smithi088.stdout:5/477: mknod d2/d31/d33/d20/d30/d51/c9b 0 2024-09-17T04:21:13.726 INFO:tasks.workunit.client.0.smithi088.stdout:2/631: truncate d0/d1/d2d/d33/d80/f19 3306904 0 2024-09-17T04:21:13.727 INFO:tasks.workunit.client.0.smithi088.stdout:2/632: readlink d0/l76 0 2024-09-17T04:21:13.729 INFO:tasks.workunit.client.0.smithi088.stdout:2/633: unlink d0/d1/d2d/d33/d4b/d24/d3b/c23 0 2024-09-17T04:21:13.730 INFO:tasks.workunit.client.0.smithi088.stdout:5/478: write d2/d31/d33/f21 [4468832,75322] 0 2024-09-17T04:21:13.731 INFO:tasks.workunit.client.0.smithi088.stdout:2/634: rmdir d0/d1/d2d/d33/d85 39 2024-09-17T04:21:13.733 INFO:tasks.workunit.client.0.smithi088.stdout:5/479: symlink d2/d31/d33/d20/d47/l9c 0 2024-09-17T04:21:13.735 INFO:tasks.workunit.client.0.smithi088.stdout:2/635: truncate d0/d1/f11 7786854 0 2024-09-17T04:21:13.735 INFO:tasks.workunit.client.0.smithi088.stdout:9/700: dwrite d2/dd/d14/d8b/d43/d51/f9d [0,4194304] 0 2024-09-17T04:21:13.741 INFO:tasks.workunit.client.0.smithi088.stdout:2/636: symlink d0/d1/d2d/d33/d4b/lc4 0 2024-09-17T04:21:13.744 INFO:tasks.workunit.client.0.smithi088.stdout:2/637: read d0/d1/d2d/d33/d4b/d24/d3b/d22/f64 [222454,125858] 0 2024-09-17T04:21:13.746 INFO:tasks.workunit.client.0.smithi088.stdout:2/638: fsync d0/d1/d2d/d33/d4b/d6d/d94/fb1 0 2024-09-17T04:21:13.747 INFO:tasks.workunit.client.0.smithi088.stdout:2/639: stat d0/d1/d2d/d33/d4b/d24/d3b/d26/c5a 0 2024-09-17T04:21:13.758 INFO:tasks.workunit.client.0.smithi088.stdout:2/640: mkdir d0/d1/dc5 0 2024-09-17T04:21:13.764 INFO:tasks.workunit.client.0.smithi088.stdout:5/480: dwrite d2/d31/d33/d20/d30/d51/d5e/f7a [0,4194304] 0 2024-09-17T04:21:13.765 INFO:tasks.workunit.client.0.smithi088.stdout:5/481: readlink d2/d31/d33/l2d 0 2024-09-17T04:21:13.768 INFO:tasks.workunit.client.0.smithi088.stdout:5/482: unlink d2/d31/d33/d20/d30/d51/c9b 0 2024-09-17T04:21:13.772 INFO:tasks.workunit.client.0.smithi088.stdout:2/641: truncate d0/d1/d2d/d33/d4b/d24/d3b/fb7 1991644 0 2024-09-17T04:21:13.774 INFO:tasks.workunit.client.0.smithi088.stdout:2/642: truncate d0/d1/d2d/d33/d4b/d24/d92/fac 277517 0 2024-09-17T04:21:13.775 INFO:tasks.workunit.client.0.smithi088.stdout:5/483: rename d2/d31/d33/f7e to d2/d31/d33/f9d 0 2024-09-17T04:21:13.776 INFO:tasks.workunit.client.0.smithi088.stdout:2/643: read d0/d1/d2d/d33/d4b/d24/d3b/d26/f4e [940943,5968] 0 2024-09-17T04:21:13.777 INFO:tasks.workunit.client.0.smithi088.stdout:5/484: write d2/d31/d33/d20/d25/f41 [4511763,5786] 0 2024-09-17T04:21:13.779 INFO:tasks.workunit.client.0.smithi088.stdout:2/644: mkdir d0/d1/d2d/d33/d4b/d24/d3b/d22/dba/dc6 0 2024-09-17T04:21:13.780 INFO:tasks.workunit.client.0.smithi088.stdout:5/485: creat d2/d31/d33/d20/d8b/f9e x:0 0 0 2024-09-17T04:21:13.783 INFO:tasks.workunit.client.0.smithi088.stdout:5/486: mkdir d2/d31/d33/d20/d30/d9f 0 2024-09-17T04:21:13.784 INFO:tasks.workunit.client.0.smithi088.stdout:5/487: stat d2/d31/d33/d20/d25/d49/f8d 0 2024-09-17T04:21:13.788 INFO:tasks.workunit.client.0.smithi088.stdout:5/488: creat d2/d31/d33/d20/d30/d51/d5e/d6b/fa0 x:0 0 0 2024-09-17T04:21:13.789 INFO:tasks.workunit.client.0.smithi088.stdout:5/489: fsync d2/d31/d33/d20/d47/f98 0 2024-09-17T04:21:13.790 INFO:tasks.workunit.client.0.smithi088.stdout:2/645: rename d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/d7c/cb3 to d0/d1/d2d/d33/d4b/d6d/d94/cc7 0 2024-09-17T04:21:13.794 INFO:tasks.workunit.client.0.smithi088.stdout:2/646: creat d0/d1/d2d/d33/d4b/d24/d3b/fc8 x:0 0 0 2024-09-17T04:21:13.797 INFO:tasks.workunit.client.0.smithi088.stdout:5/490: rename d2/f5 to d2/d31/d33/d20/d30/d51/fa1 0 2024-09-17T04:21:13.808 INFO:tasks.workunit.client.0.smithi088.stdout:2/647: chown d0/d1/d2d/d33/d4b/d24/d3b/fb7 566903 1 2024-09-17T04:21:13.809 INFO:tasks.workunit.client.0.smithi088.stdout:2/648: read d0/d1/d2d/d33/d80/f40 [720269,28367] 0 2024-09-17T04:21:13.809 INFO:tasks.workunit.client.0.smithi088.stdout:2/649: fdatasync d0/d1/d2d/d33/d4b/d24/d92/f9c 0 2024-09-17T04:21:13.810 INFO:tasks.workunit.client.0.smithi088.stdout:5/491: dread d2/d31/d33/fa [0,4194304] 0 2024-09-17T04:21:13.811 INFO:tasks.workunit.client.0.smithi088.stdout:5/492: chown d2/d31/d33/d20/d47/f48 18937 1 2024-09-17T04:21:13.811 INFO:tasks.workunit.client.0.smithi088.stdout:2/650: dread - d0/d1/d2d/f84 zero size 2024-09-17T04:21:13.813 INFO:tasks.workunit.client.0.smithi088.stdout:5/493: symlink d2/d31/d33/d20/d30/d51/d5e/la2 0 2024-09-17T04:21:13.814 INFO:tasks.workunit.client.0.smithi088.stdout:2/651: creat d0/d1/fc9 x:0 0 0 2024-09-17T04:21:13.815 INFO:tasks.workunit.client.0.smithi088.stdout:2/652: truncate d0/d1/d2d/dbd/fbf 269476 0 2024-09-17T04:21:13.820 INFO:tasks.workunit.client.0.smithi088.stdout:5/494: dwrite d2/d31/d33/d20/d47/f88 [0,4194304] 0 2024-09-17T04:21:13.825 INFO:tasks.workunit.client.0.smithi088.stdout:5/495: chown d2/d31/d33/d20/d25/l42 11388549 1 2024-09-17T04:21:13.829 INFO:tasks.workunit.client.0.smithi088.stdout:2/653: link d0/d1/d2d/d33/d4b/d24/d3b/d26/c30 d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/d9a/cca 0 2024-09-17T04:21:13.831 INFO:tasks.workunit.client.0.smithi088.stdout:2/654: symlink d0/d1/dc5/lcb 0 2024-09-17T04:21:13.831 INFO:tasks.workunit.client.0.smithi088.stdout:2/655: stat d0/d1/d2d/fa1 0 2024-09-17T04:21:13.841 INFO:tasks.workunit.client.0.smithi088.stdout:2/656: write d0/d1/d2d/f3c [1339854,117588] 0 2024-09-17T04:21:13.842 INFO:tasks.workunit.client.0.smithi088.stdout:5/496: dwrite d2/d31/d33/d20/d30/f4e [0,4194304] 0 2024-09-17T04:21:13.843 INFO:tasks.workunit.client.0.smithi088.stdout:2/657: stat d0/d1/d2d/d33/d4b/d24/d3b/d22/dba 0 2024-09-17T04:21:13.850 INFO:tasks.workunit.client.0.smithi088.stdout:5/497: dwrite d2/d31/d33/d20/d25/d49/f82 [0,4194304] 0 2024-09-17T04:21:13.855 INFO:tasks.workunit.client.0.smithi088.stdout:5/498: getdents d2/d31/d33/d20/d47 0 2024-09-17T04:21:13.868 INFO:tasks.workunit.client.0.smithi088.stdout:5/499: truncate d2/d31/d33/d20/d30/d51/d5e/d6b/f75 2070300 0 2024-09-17T04:21:13.870 INFO:tasks.workunit.client.0.smithi088.stdout:5/500: symlink d2/d31/d33/d20/d25/d2c/la3 0 2024-09-17T04:21:13.875 INFO:tasks.workunit.client.0.smithi088.stdout:5/501: mkdir d2/d31/d33/d20/d30/d9f/da4 0 2024-09-17T04:21:13.877 INFO:tasks.workunit.client.0.smithi088.stdout:5/502: mkdir d2/d31/d33/d20/d25/d2c/d3d/da5 0 2024-09-17T04:21:13.889 INFO:tasks.workunit.client.0.smithi088.stdout:5/503: dwrite d2/d31/d33/d20/d47/f85 [0,4194304] 0 2024-09-17T04:21:13.897 INFO:tasks.workunit.client.0.smithi088.stdout:5/504: rmdir d2/d31/d33/d20/d30/d51/d5e 39 2024-09-17T04:21:13.897 INFO:tasks.workunit.client.0.smithi088.stdout:5/505: chown d2/d31/d33/d20/d47/f71 899222 1 2024-09-17T04:21:13.897 INFO:tasks.workunit.client.0.smithi088.stdout:5/506: dread - d2/d31/f36 zero size 2024-09-17T04:21:13.898 INFO:tasks.workunit.client.0.smithi088.stdout:5/507: mknod d2/d31/d33/d20/d30/d51/d5e/d6b/ca6 0 2024-09-17T04:21:13.898 INFO:tasks.workunit.client.0.smithi088.stdout:5/508: chown d2/d31/d33/l24 1890 1 2024-09-17T04:21:13.899 INFO:tasks.workunit.client.0.smithi088.stdout:5/509: creat d2/d31/d33/d20/d30/d9f/da4/fa7 x:0 0 0 2024-09-17T04:21:13.904 INFO:tasks.workunit.client.0.smithi088.stdout:5/510: link d2/d31/d33/d20/d30/l3b d2/d31/d33/la8 0 2024-09-17T04:21:13.913 INFO:tasks.workunit.client.0.smithi088.stdout:5/511: dread d2/d31/d33/d20/d25/d49/f64 [0,4194304] 0 2024-09-17T04:21:13.914 INFO:tasks.workunit.client.0.smithi088.stdout:5/512: truncate d2/f27 1258195 0 2024-09-17T04:21:13.916 INFO:tasks.workunit.client.0.smithi088.stdout:5/513: read d2/d31/d33/d20/f46 [1970238,19443] 0 2024-09-17T04:21:13.925 INFO:tasks.workunit.client.0.smithi088.stdout:5/514: dwrite d2/f10 [0,4194304] 0 2024-09-17T04:21:14.038 INFO:tasks.workunit.client.0.smithi088.stdout:5/515: mkdir d2/da9 0 2024-09-17T04:21:14.038 INFO:tasks.workunit.client.0.smithi088.stdout:5/516: creat d2/d31/faa x:0 0 0 2024-09-17T04:21:14.038 INFO:tasks.workunit.client.0.smithi088.stdout:5/517: fsync d2/d31/d33/d20/d30/f4e 0 2024-09-17T04:21:14.038 INFO:tasks.workunit.client.0.smithi088.stdout:5/518: creat d2/d31/d33/d20/d8b/fab x:0 0 0 2024-09-17T04:21:14.038 INFO:tasks.workunit.client.0.smithi088.stdout:5/519: mknod d2/d31/d33/d20/d30/d51/d5e/d6b/cac 0 2024-09-17T04:21:14.038 INFO:tasks.workunit.client.0.smithi088.stdout:5/520: dread - d2/d31/d33/d20/d30/d9f/da4/fa7 zero size 2024-09-17T04:21:14.039 INFO:tasks.workunit.client.0.smithi088.stdout:5/521: mknod d2/d31/d33/d20/d30/d9f/cad 0 2024-09-17T04:21:14.039 INFO:tasks.workunit.client.0.smithi088.stdout:5/522: symlink d2/d31/d33/d20/d25/d2c/lae 0 2024-09-17T04:21:14.039 INFO:tasks.workunit.client.0.smithi088.stdout:5/523: read d2/d31/d33/f21 [1869287,94930] 0 2024-09-17T04:21:14.039 INFO:tasks.workunit.client.0.smithi088.stdout:5/524: rmdir d2/d31 39 2024-09-17T04:21:14.039 INFO:tasks.workunit.client.0.smithi088.stdout:5/525: readlink d2/d31/d33/d20/d25/d2c/la3 0 2024-09-17T04:21:14.039 INFO:tasks.workunit.client.0.smithi088.stdout:5/526: symlink d2/d31/d33/d20/d25/d2c/d3d/da5/laf 0 2024-09-17T04:21:14.039 INFO:tasks.workunit.client.0.smithi088.stdout:5/527: chown d2/d31/d33/d20/d25/d49/f60 131 1 2024-09-17T04:21:14.039 INFO:tasks.workunit.client.0.smithi088.stdout:5/528: unlink d2/d31/d33/d20/d47/l9c 0 2024-09-17T04:21:14.040 INFO:tasks.workunit.client.0.smithi088.stdout:5/529: chown d2/d31/d33/d20/d30/d9f/da4 538616608 1 2024-09-17T04:21:14.040 INFO:tasks.workunit.client.0.smithi088.stdout:0/424: sync 2024-09-17T04:21:14.040 INFO:tasks.workunit.client.0.smithi088.stdout:7/627: sync 2024-09-17T04:21:14.040 INFO:tasks.workunit.client.0.smithi088.stdout:0/425: write db/d1b/f89 [271712,59558] 0 2024-09-17T04:21:14.040 INFO:tasks.workunit.client.0.smithi088.stdout:0/426: write db/f25 [225696,67035] 0 2024-09-17T04:21:14.040 INFO:tasks.workunit.client.0.smithi088.stdout:0/427: creat db/d1b/d36/d4a/d20/f8e x:0 0 0 2024-09-17T04:21:14.040 INFO:tasks.workunit.client.0.smithi088.stdout:5/530: creat d2/d31/d33/d20/d25/fb0 x:0 0 0 2024-09-17T04:21:14.041 INFO:tasks.workunit.client.0.smithi088.stdout:5/531: fdatasync d2/d31/d33/f2f 0 2024-09-17T04:21:14.041 INFO:tasks.workunit.client.0.smithi088.stdout:0/428: mknod db/d3c/d4f/d66/d82/c8f 0 2024-09-17T04:21:14.041 INFO:tasks.workunit.client.0.smithi088.stdout:5/532: creat d2/d31/d33/d20/fb1 x:0 0 0 2024-09-17T04:21:14.041 INFO:tasks.workunit.client.0.smithi088.stdout:7/628: write d2/d1d/d2e/fa0 [569436,80826] 0 2024-09-17T04:21:14.041 INFO:tasks.workunit.client.0.smithi088.stdout:7/629: fdatasync d2/d4/f52 0 2024-09-17T04:21:14.041 INFO:tasks.workunit.client.0.smithi088.stdout:0/429: getdents db/d3c 0 2024-09-17T04:21:14.041 INFO:tasks.workunit.client.0.smithi088.stdout:7/630: truncate d2/d1d/d2e/fa0 1581556 0 2024-09-17T04:21:14.041 INFO:tasks.workunit.client.0.smithi088.stdout:5/533: dread d2/f90 [0,4194304] 0 2024-09-17T04:21:14.041 INFO:tasks.workunit.client.0.smithi088.stdout:5/534: unlink d2/d31/d33/d20/d25/d49/f82 0 2024-09-17T04:21:14.042 INFO:tasks.workunit.client.0.smithi088.stdout:5/535: dread - d2/d31/d33/d20/f55 zero size 2024-09-17T04:21:14.042 INFO:tasks.workunit.client.0.smithi088.stdout:7/631: dwrite d2/d4/d7/f10 [0,4194304] 0 2024-09-17T04:21:14.042 INFO:tasks.workunit.client.0.smithi088.stdout:5/536: unlink d2/d31/d33/d20/f2e 0 2024-09-17T04:21:14.042 INFO:tasks.workunit.client.0.smithi088.stdout:0/430: dread db/d3c/d4f/f75 [0,4194304] 0 2024-09-17T04:21:14.042 INFO:tasks.workunit.client.0.smithi088.stdout:5/537: mkdir d2/d31/d33/d20/d25/d2c/d8a/db2 0 2024-09-17T04:21:14.042 INFO:tasks.workunit.client.0.smithi088.stdout:5/538: dread - d2/d31/d33/d20/d25/d2c/d3d/f93 zero size 2024-09-17T04:21:14.042 INFO:tasks.workunit.client.0.smithi088.stdout:0/431: symlink db/d1b/d39/l90 0 2024-09-17T04:21:14.042 INFO:tasks.workunit.client.0.smithi088.stdout:0/432: unlink db/f25 0 2024-09-17T04:21:14.042 INFO:tasks.workunit.client.0.smithi088.stdout:5/539: dwrite d2/d31/d33/d20/d25/d49/f4a [0,4194304] 0 2024-09-17T04:21:14.042 INFO:tasks.workunit.client.0.smithi088.stdout:7/632: dread d2/d4/d7/f36 [4194304,4194304] 0 2024-09-17T04:21:14.043 INFO:tasks.workunit.client.0.smithi088.stdout:0/433: symlink db/d67/d8c/l91 0 2024-09-17T04:21:14.043 INFO:tasks.workunit.client.0.smithi088.stdout:5/540: mkdir d2/db3 0 2024-09-17T04:21:14.043 INFO:tasks.workunit.client.0.smithi088.stdout:5/541: chown d2/d31/d33/d20/d25/f41 1 1 2024-09-17T04:21:14.043 INFO:tasks.workunit.client.0.smithi088.stdout:5/542: chown d2/d31/d33/d20/d8b 206314 1 2024-09-17T04:21:14.043 INFO:tasks.workunit.client.0.smithi088.stdout:0/434: mknod db/d3c/d4f/d66/d82/c92 0 2024-09-17T04:21:14.043 INFO:tasks.workunit.client.0.smithi088.stdout:5/543: read - d2/d31/d33/d20/d30/f7b zero size 2024-09-17T04:21:14.043 INFO:tasks.workunit.client.0.smithi088.stdout:7/633: rename d2/d4/c1f to d2/d1d/cc5 0 2024-09-17T04:21:14.043 INFO:tasks.workunit.client.0.smithi088.stdout:0/435: mknod db/d1b/d36/d4a/d6a/c93 0 2024-09-17T04:21:14.043 INFO:tasks.workunit.client.0.smithi088.stdout:5/544: chown d2/d31/d33/d20/d25/d49/l59 254 1 2024-09-17T04:21:14.043 INFO:tasks.workunit.client.0.smithi088.stdout:7/634: unlink d2/d8d/la1 0 2024-09-17T04:21:14.043 INFO:tasks.workunit.client.0.smithi088.stdout:7/635: fdatasync d2/d4/f14 0 2024-09-17T04:21:14.044 INFO:tasks.workunit.client.0.smithi088.stdout:7/636: dread - d2/d96/fac zero size 2024-09-17T04:21:14.045 INFO:tasks.workunit.client.0.smithi088.stdout:5/545: creat d2/d31/d33/fb4 x:0 0 0 2024-09-17T04:21:14.045 INFO:tasks.workunit.client.0.smithi088.stdout:7/637: symlink d2/d4/d9b/lc6 0 2024-09-17T04:21:14.045 INFO:tasks.workunit.client.0.smithi088.stdout:5/546: truncate d2/d31/d33/f1f 3872572 0 2024-09-17T04:21:14.045 INFO:tasks.workunit.client.0.smithi088.stdout:5/547: write d2/d31/d33/d20/d25/d49/f8d [219693,5293] 0 2024-09-17T04:21:14.047 INFO:tasks.workunit.client.0.smithi088.stdout:7/638: rename d2/d1d/d2e/db0/d23/l68 to d2/d96/lc7 0 2024-09-17T04:21:14.048 INFO:tasks.workunit.client.0.smithi088.stdout:7/639: chown d2/cb 2430 1 2024-09-17T04:21:14.049 INFO:tasks.workunit.client.0.smithi088.stdout:7/640: write d2/d1d/d2e/db0/d23/d45/d62/d82/f9a [1696559,102227] 0 2024-09-17T04:21:14.053 INFO:tasks.workunit.client.0.smithi088.stdout:7/641: fdatasync d2/d1d/d2e/db0/f3b 0 2024-09-17T04:21:14.070 INFO:tasks.workunit.client.0.smithi088.stdout:0/436: truncate db/d1b/d36/d4a/d6a/f68 53471 0 2024-09-17T04:21:14.073 INFO:tasks.workunit.client.0.smithi088.stdout:0/437: mknod db/d3c/d4f/c94 0 2024-09-17T04:21:14.078 INFO:tasks.workunit.client.0.smithi088.stdout:0/438: symlink db/d1b/d36/d4a/l95 0 2024-09-17T04:21:14.099 INFO:tasks.workunit.client.0.smithi088.stdout:0/439: rmdir db/d1b/d36/d4a/d20 39 2024-09-17T04:21:14.102 INFO:tasks.workunit.client.0.smithi088.stdout:0/440: mkdir db/d1b/d39/d83/d96 0 2024-09-17T04:21:14.105 INFO:tasks.workunit.client.0.smithi088.stdout:5/548: write d2/d31/d33/d20/d25/d2c/f52 [219710,17052] 0 2024-09-17T04:21:14.113 INFO:tasks.workunit.client.0.smithi088.stdout:5/549: dwrite d2/d31/d33/d20/d47/f48 [0,4194304] 0 2024-09-17T04:21:14.115 INFO:tasks.workunit.client.0.smithi088.stdout:5/550: write d2/d31/d33/d20/d30/d51/d5e/d6b/f99 [954429,6636] 0 2024-09-17T04:21:14.118 INFO:tasks.workunit.client.0.smithi088.stdout:5/551: mkdir d2/d31/d33/d20/d30/d51/d5e/d6b/db5 0 2024-09-17T04:21:14.122 INFO:tasks.workunit.client.0.smithi088.stdout:5/552: getdents d2/d31/d33/d20/d30/d51/d5e 0 2024-09-17T04:21:14.473 INFO:tasks.workunit.client.0.smithi088.stdout:0/441: sync 2024-09-17T04:21:14.474 INFO:tasks.workunit.client.0.smithi088.stdout:8/571: sync 2024-09-17T04:21:14.474 INFO:tasks.workunit.client.0.smithi088.stdout:7/642: sync 2024-09-17T04:21:14.474 INFO:tasks.workunit.client.0.smithi088.stdout:2/658: sync 2024-09-17T04:21:14.474 INFO:tasks.workunit.client.0.smithi088.stdout:3/666: sync 2024-09-17T04:21:14.474 INFO:tasks.workunit.client.0.smithi088.stdout:4/581: sync 2024-09-17T04:21:14.474 INFO:tasks.workunit.client.0.smithi088.stdout:1/602: sync 2024-09-17T04:21:14.474 INFO:tasks.workunit.client.0.smithi088.stdout:9/701: sync 2024-09-17T04:21:14.474 INFO:tasks.workunit.client.0.smithi088.stdout:6/603: sync 2024-09-17T04:21:14.475 INFO:tasks.workunit.client.0.smithi088.stdout:6/604: rmdir d14 39 2024-09-17T04:21:14.476 INFO:tasks.workunit.client.0.smithi088.stdout:4/582: truncate d5/d72/fa3 1107488 0 2024-09-17T04:21:14.477 INFO:tasks.workunit.client.0.smithi088.stdout:3/667: symlink d0/ld8 0 2024-09-17T04:21:14.478 INFO:tasks.workunit.client.0.smithi088.stdout:2/659: dread d0/d1/d2d/d33/d80/f40 [0,4194304] 0 2024-09-17T04:21:14.478 INFO:tasks.workunit.client.0.smithi088.stdout:4/583: write d5/d3f/d71/d8b/d68/fa5 [890119,70474] 0 2024-09-17T04:21:14.480 INFO:tasks.workunit.client.0.smithi088.stdout:1/603: mkdir d0/d1/d16/d35/dc5 0 2024-09-17T04:21:14.480 INFO:tasks.workunit.client.0.smithi088.stdout:2/660: readlink d0/d1/d2d/d33/d4b/d24/d3b/l1a 0 2024-09-17T04:21:14.481 INFO:tasks.workunit.client.0.smithi088.stdout:9/702: chown d2/dd/d14/d2a/d76/fe8 166 1 2024-09-17T04:21:14.482 INFO:tasks.workunit.client.0.smithi088.stdout:2/661: chown d0/d1/d2d/d33/d4b/d24 7344 1 2024-09-17T04:21:14.483 INFO:tasks.workunit.client.0.smithi088.stdout:9/703: chown d2/dd/d14/d8b/d43/fca 0 1 2024-09-17T04:21:14.483 INFO:tasks.workunit.client.0.smithi088.stdout:6/605: write d14/d44/d45/d6b/d29/dac/fb1 [809007,52027] 0 2024-09-17T04:21:14.484 INFO:tasks.workunit.client.0.smithi088.stdout:8/572: symlink d7/d29/d2a/lbd 0 2024-09-17T04:21:14.488 INFO:tasks.workunit.client.0.smithi088.stdout:0/442: write db/d1b/d36/d4a/d6a/f74 [18118,109622] 0 2024-09-17T04:21:14.491 INFO:tasks.workunit.client.0.smithi088.stdout:6/606: dwrite d14/d44/d45/d6b/d29/f2d [0,4194304] 0 2024-09-17T04:21:14.493 INFO:tasks.workunit.client.0.smithi088.stdout:6/607: write d14/d44/d94/fbd [112817,25627] 0 2024-09-17T04:21:14.493 INFO:tasks.workunit.client.0.smithi088.stdout:1/604: creat d0/d1/df/d85/fc6 x:0 0 0 2024-09-17T04:21:14.498 INFO:tasks.workunit.client.0.smithi088.stdout:7/643: link d2/d4/d7/f9f d2/d96/dbe/fc8 0 2024-09-17T04:21:14.511 INFO:tasks.workunit.client.0.smithi088.stdout:9/704: rmdir d2/dd/d14/d8b/d35/d94 39 2024-09-17T04:21:14.513 INFO:tasks.workunit.client.0.smithi088.stdout:6/608: fsync d14/d44/d45/d4d/d97/fa2 0 2024-09-17T04:21:14.514 INFO:tasks.workunit.client.0.smithi088.stdout:4/584: write d5/d3f/d71/d8b/d68/da4/d5e/d83/f87 [29793,92906] 0 2024-09-17T04:21:14.515 INFO:tasks.workunit.client.0.smithi088.stdout:6/609: dread - d14/d44/d45/d6b/d2a/d52/dcf/fd2 zero size 2024-09-17T04:21:14.518 INFO:tasks.workunit.client.0.smithi088.stdout:1/605: truncate d0/d1/df/d63/f76 341911 0 2024-09-17T04:21:14.519 INFO:tasks.workunit.client.0.smithi088.stdout:7/644: creat d2/d1d/fc9 x:0 0 0 2024-09-17T04:21:14.519 INFO:tasks.workunit.client.0.smithi088.stdout:8/573: symlink d7/d29/daa/lbe 0 2024-09-17T04:21:14.520 INFO:tasks.workunit.client.0.smithi088.stdout:3/668: write d0/d13/d1b/d29/d30/f68 [2529084,63554] 0 2024-09-17T04:21:14.521 INFO:tasks.workunit.client.0.smithi088.stdout:1/606: chown d0/d1/d16/d2a/c74 1080 1 2024-09-17T04:21:14.523 INFO:tasks.workunit.client.0.smithi088.stdout:0/443: rename db/d1b/d36/d4a/d6a/c23 to db/d3c/c97 0 2024-09-17T04:21:14.525 INFO:tasks.workunit.client.0.smithi088.stdout:2/662: dwrite d0/d1/fb [0,4194304] 0 2024-09-17T04:21:14.526 INFO:tasks.workunit.client.0.smithi088.stdout:9/705: symlink d2/dd/d11/d4f/dd5/lf2 0 2024-09-17T04:21:14.532 INFO:tasks.workunit.client.0.smithi088.stdout:2/663: dread d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/d9a/fa7 [0,4194304] 0 2024-09-17T04:21:14.533 INFO:tasks.workunit.client.0.smithi088.stdout:4/585: dwrite d5/d3d/f47 [0,4194304] 0 2024-09-17T04:21:14.535 INFO:tasks.workunit.client.0.smithi088.stdout:4/586: chown d5/d3d/lb4 86883 1 2024-09-17T04:21:14.535 INFO:tasks.workunit.client.0.smithi088.stdout:4/587: chown d5/l19 38920 1 2024-09-17T04:21:14.552 INFO:tasks.workunit.client.0.smithi088.stdout:6/610: rmdir d14/d44/d45/d4d 39 2024-09-17T04:21:14.552 INFO:tasks.workunit.client.0.smithi088.stdout:6/611: dread - d14/d44/d94/db9/fd0 zero size 2024-09-17T04:21:14.556 INFO:tasks.workunit.client.0.smithi088.stdout:8/574: mkdir d7/d29/d2a/d38/d3d/d63/dbf 0 2024-09-17T04:21:14.557 INFO:tasks.workunit.client.0.smithi088.stdout:0/444: readlink db/d1b/d36/d4a/d6a/l55 0 2024-09-17T04:21:14.559 INFO:tasks.workunit.client.0.smithi088.stdout:9/706: mkdir d2/d2b/d58/d82/df3 0 2024-09-17T04:21:14.559 INFO:tasks.workunit.client.0.smithi088.stdout:9/707: chown d2/dd/d14/d2a/l66 358019 1 2024-09-17T04:21:14.560 INFO:tasks.workunit.client.0.smithi088.stdout:4/588: creat d5/d3f/d71/fc2 x:0 0 0 2024-09-17T04:21:14.561 INFO:tasks.workunit.client.0.smithi088.stdout:9/708: chown d2/dd/la9 40 1 2024-09-17T04:21:14.561 INFO:tasks.workunit.client.0.smithi088.stdout:4/589: chown d5/d32/c34 1 1 2024-09-17T04:21:14.562 INFO:tasks.workunit.client.0.smithi088.stdout:7/645: creat d2/d96/dc2/fca x:0 0 0 2024-09-17T04:21:14.562 INFO:tasks.workunit.client.0.smithi088.stdout:6/612: rmdir d14/d44/d45/d6b/d16/d42/d92 39 2024-09-17T04:21:14.565 INFO:tasks.workunit.client.0.smithi088.stdout:8/575: creat d7/d29/d7e/fc0 x:0 0 0 2024-09-17T04:21:14.566 INFO:tasks.workunit.client.0.smithi088.stdout:0/445: mknod db/d1b/d39/d83/c98 0 2024-09-17T04:21:14.567 INFO:tasks.workunit.client.0.smithi088.stdout:7/646: creat d2/d1d/d2e/db0/d23/d45/d62/fcb x:0 0 0 2024-09-17T04:21:14.568 INFO:tasks.workunit.client.0.smithi088.stdout:6/613: fdatasync d14/d63/f82 0 2024-09-17T04:21:14.573 INFO:tasks.workunit.client.0.smithi088.stdout:1/607: rename d0/c23 to d0/d1/d27/d9a/cc7 0 2024-09-17T04:21:14.575 INFO:tasks.workunit.client.0.smithi088.stdout:1/608: write d0/d1/d16/d77/daa/d5b/fb0 [559539,6826] 0 2024-09-17T04:21:14.578 INFO:tasks.workunit.client.0.smithi088.stdout:7/647: chown d2/d1d/d2e/db0/d23/d45/d85 12 1 2024-09-17T04:21:14.581 INFO:tasks.workunit.client.0.smithi088.stdout:0/446: dwrite db/d1b/d36/d4a/f40 [0,4194304] 0 2024-09-17T04:21:14.583 INFO:tasks.workunit.client.0.smithi088.stdout:9/709: rename d2/dd/d11/d30/fb4 to d2/d2b/d2e/ff4 0 2024-09-17T04:21:14.586 INFO:tasks.workunit.client.0.smithi088.stdout:1/609: readlink d0/d13/d84/d5d/l75 0 2024-09-17T04:21:14.587 INFO:tasks.workunit.client.0.smithi088.stdout:1/610: stat d0/d1/d16/d2a/da4/faf 0 2024-09-17T04:21:14.590 INFO:tasks.workunit.client.0.smithi088.stdout:6/614: symlink d14/d44/d45/d6b/d2a/ld4 0 2024-09-17T04:21:14.592 INFO:tasks.workunit.client.0.smithi088.stdout:0/447: creat db/d67/f99 x:0 0 0 2024-09-17T04:21:14.595 INFO:tasks.workunit.client.0.smithi088.stdout:9/710: rmdir d2 39 2024-09-17T04:21:14.596 INFO:tasks.workunit.client.0.smithi088.stdout:1/611: chown d0/la1 1406507928 1 2024-09-17T04:21:14.597 INFO:tasks.workunit.client.0.smithi088.stdout:6/615: rmdir d14 39 2024-09-17T04:21:14.597 INFO:tasks.workunit.client.0.smithi088.stdout:1/612: stat d0/d1/df/d63/fb5 0 2024-09-17T04:21:14.601 INFO:tasks.workunit.client.0.smithi088.stdout:4/590: rename d5/d3d/d73/fb8 to d5/d3f/d71/d8b/d68/da4/d5e/d83/fc3 0 2024-09-17T04:21:14.603 INFO:tasks.workunit.client.0.smithi088.stdout:9/711: write d2/d16/dd7/fe5 [205442,83014] 0 2024-09-17T04:21:14.607 INFO:tasks.workunit.client.0.smithi088.stdout:8/576: rename d7/dd/d31/c9f to d7/d29/d2a/d38/d42/cc1 0 2024-09-17T04:21:14.608 INFO:tasks.workunit.client.0.smithi088.stdout:7/648: dread d2/d1d/d2e/db0/f24 [0,4194304] 0 2024-09-17T04:21:14.610 INFO:tasks.workunit.client.0.smithi088.stdout:4/591: fdatasync d5/d3f/d71/d8b/d68/da4/d5e/f60 0 2024-09-17T04:21:14.610 INFO:tasks.workunit.client.0.smithi088.stdout:6/616: dread d14/d44/d45/d6b/d29/dac/fb1 [0,4194304] 0 2024-09-17T04:21:14.615 INFO:tasks.workunit.client.0.smithi088.stdout:8/577: dwrite d7/d29/d2a/d3a/d79/f81 [0,4194304] 0 2024-09-17T04:21:14.617 INFO:tasks.workunit.client.0.smithi088.stdout:1/613: rename d0/d1/d58 to d0/d1/d16/d2a/d9c/dc8 0 2024-09-17T04:21:14.618 INFO:tasks.workunit.client.0.smithi088.stdout:9/712: dwrite d2/d2b/d58/d82/f83 [4194304,4194304] 0 2024-09-17T04:21:14.627 INFO:tasks.workunit.client.0.smithi088.stdout:4/592: fsync d5/f4e 0 2024-09-17T04:21:14.628 INFO:tasks.workunit.client.0.smithi088.stdout:9/713: dwrite d2/dd/d14/d8b/d35/f5f [0,4194304] 0 2024-09-17T04:21:14.629 INFO:tasks.workunit.client.0.smithi088.stdout:0/448: write db/f12 [4897866,4216] 0 2024-09-17T04:21:14.630 INFO:tasks.workunit.client.0.smithi088.stdout:8/578: rmdir d7/d29 39 2024-09-17T04:21:14.632 INFO:tasks.workunit.client.0.smithi088.stdout:7/649: dwrite d2/d1d/d2e/db0/f5e [0,4194304] 0 2024-09-17T04:21:14.637 INFO:tasks.workunit.client.0.smithi088.stdout:6/617: rename d14/f32 to d14/d44/d94/db9/fd5 0 2024-09-17T04:21:14.637 INFO:tasks.workunit.client.0.smithi088.stdout:7/650: chown d2/d4/d7/ce 32722726 1 2024-09-17T04:21:14.637 INFO:tasks.workunit.client.0.smithi088.stdout:0/449: write db/d1b/d39/f8d [93789,63708] 0 2024-09-17T04:21:14.639 INFO:tasks.workunit.client.0.smithi088.stdout:0/450: read db/f1d [1001874,79800] 0 2024-09-17T04:21:14.644 INFO:tasks.workunit.client.0.smithi088.stdout:8/579: chown d7/dd/l26 564 1 2024-09-17T04:21:14.656 INFO:tasks.workunit.client.0.smithi088.stdout:9/714: dread d2/fb [0,4194304] 0 2024-09-17T04:21:14.657 INFO:tasks.workunit.client.0.smithi088.stdout:7/651: link d2/d1d/f6a d2/d1d/d2e/db0/d23/d45/d85/fcc 0 2024-09-17T04:21:14.658 INFO:tasks.workunit.client.0.smithi088.stdout:7/652: write d2/d1d/d2e/db0/d23/f2f [2919623,12365] 0 2024-09-17T04:21:14.660 INFO:tasks.workunit.client.0.smithi088.stdout:6/618: rename d14/d44/d45/d6b/d16/d42/cb5 to d14/d44/d45/d6b/d16/cd6 0 2024-09-17T04:21:14.667 INFO:tasks.workunit.client.0.smithi088.stdout:6/619: dwrite d14/d2f/f67 [0,4194304] 0 2024-09-17T04:21:14.667 INFO:tasks.workunit.client.0.smithi088.stdout:9/715: link d2/c4 d2/d2b/d58/d82/df3/cf5 0 2024-09-17T04:21:14.668 INFO:tasks.workunit.client.0.smithi088.stdout:6/620: stat d14/d44/f76 0 2024-09-17T04:21:14.671 INFO:tasks.workunit.client.0.smithi088.stdout:6/621: mknod d14/d44/d94/db9/cd7 0 2024-09-17T04:21:14.673 INFO:tasks.workunit.client.0.smithi088.stdout:8/580: write d7/dd/d31/d47/d55/f99 [97348,62408] 0 2024-09-17T04:21:14.674 INFO:tasks.workunit.client.0.smithi088.stdout:6/622: fdatasync d14/f24 0 2024-09-17T04:21:14.675 INFO:tasks.workunit.client.0.smithi088.stdout:4/593: dwrite d5/d32/f67 [0,4194304] 0 2024-09-17T04:21:14.676 INFO:tasks.workunit.client.0.smithi088.stdout:7/653: dread d2/d1d/d2e/db0/f3b [4194304,4194304] 0 2024-09-17T04:21:14.676 INFO:tasks.workunit.client.0.smithi088.stdout:6/623: chown d14/d44/d45/d6b/d29 326 1 2024-09-17T04:21:14.676 INFO:tasks.workunit.client.0.smithi088.stdout:4/594: readlink d5/l19 0 2024-09-17T04:21:14.678 INFO:tasks.workunit.client.0.smithi088.stdout:4/595: chown d5 9 1 2024-09-17T04:21:14.680 INFO:tasks.workunit.client.0.smithi088.stdout:0/451: truncate db/d3c/d4f/f75 3559684 0 2024-09-17T04:21:14.683 INFO:tasks.workunit.client.0.smithi088.stdout:8/581: dread d7/d29/d2a/d38/d42/f5b [0,4194304] 0 2024-09-17T04:21:14.685 INFO:tasks.workunit.client.0.smithi088.stdout:6/624: creat d14/d44/d94/fd8 x:0 0 0 2024-09-17T04:21:14.685 INFO:tasks.workunit.client.0.smithi088.stdout:6/625: fdatasync d14/d3a/d41/f84 0 2024-09-17T04:21:14.686 INFO:tasks.workunit.client.0.smithi088.stdout:7/654: creat d2/d8d/fcd x:0 0 0 2024-09-17T04:21:14.688 INFO:tasks.workunit.client.0.smithi088.stdout:4/596: creat d5/d3d/d73/fc4 x:0 0 0 2024-09-17T04:21:14.692 INFO:tasks.workunit.client.0.smithi088.stdout:6/626: symlink d14/d44/d45/d6b/d2a/d52/d7a/d7b/ld9 0 2024-09-17T04:21:14.692 INFO:tasks.workunit.client.0.smithi088.stdout:9/716: dwrite d2/f26 [0,4194304] 0 2024-09-17T04:21:14.697 INFO:tasks.workunit.client.0.smithi088.stdout:7/655: creat d2/d96/dc2/fce x:0 0 0 2024-09-17T04:21:14.698 INFO:tasks.workunit.client.0.smithi088.stdout:7/656: chown d2/d79 2343 1 2024-09-17T04:21:14.701 INFO:tasks.workunit.client.0.smithi088.stdout:7/657: dread d2/d4/d7/d20/f3c [0,4194304] 0 2024-09-17T04:21:14.702 INFO:tasks.workunit.client.0.smithi088.stdout:0/452: write db/d1b/d39/f3d [49487,70804] 0 2024-09-17T04:21:14.703 INFO:tasks.workunit.client.0.smithi088.stdout:0/453: chown db/f6d 14 1 2024-09-17T04:21:14.703 INFO:tasks.workunit.client.0.smithi088.stdout:5/553: sync 2024-09-17T04:21:14.705 INFO:tasks.workunit.client.0.smithi088.stdout:5/554: chown d2/d31/d33/d20/d25/d2c/l56 15040527 1 2024-09-17T04:21:14.713 INFO:tasks.workunit.client.0.smithi088.stdout:5/555: fsync d2/f15 0 2024-09-17T04:21:14.714 INFO:tasks.workunit.client.0.smithi088.stdout:6/627: dwrite d14/d3a/d41/f60 [0,4194304] 0 2024-09-17T04:21:14.715 INFO:tasks.workunit.client.0.smithi088.stdout:9/717: truncate d2/dd/d11/d30/d49/f42 231853 0 2024-09-17T04:21:14.717 INFO:tasks.workunit.client.0.smithi088.stdout:8/582: getdents d7/d29/d2a/d38/d42 0 2024-09-17T04:21:14.719 INFO:tasks.workunit.client.0.smithi088.stdout:7/658: mkdir d2/d1d/d2e/db0/d23/d97/dbb/dcf 0 2024-09-17T04:21:14.719 INFO:tasks.workunit.client.0.smithi088.stdout:7/659: stat d2/d8d 0 2024-09-17T04:21:14.722 INFO:tasks.workunit.client.0.smithi088.stdout:5/556: mknod d2/d31/d33/d20/d30/d51/d5e/cb6 0 2024-09-17T04:21:14.723 INFO:tasks.workunit.client.0.smithi088.stdout:5/557: readlink d2/d31/d33/d20/d25/l42 0 2024-09-17T04:21:14.726 INFO:tasks.workunit.client.0.smithi088.stdout:4/597: link d5/laf d5/d3f/d71/d8b/d68/lc5 0 2024-09-17T04:21:14.731 INFO:tasks.workunit.client.0.smithi088.stdout:6/628: write d14/d44/d45/d6b/d2a/d52/d7a/f83 [1198522,1589] 0 2024-09-17T04:21:14.732 INFO:tasks.workunit.client.0.smithi088.stdout:0/454: dwrite db/d1b/d39/f3a [0,4194304] 0 2024-09-17T04:21:14.733 INFO:tasks.workunit.client.0.smithi088.stdout:6/629: chown d14/f24 873204293 1 2024-09-17T04:21:14.740 INFO:tasks.workunit.client.0.smithi088.stdout:6/630: dread d14/d3a/d41/f69 [0,4194304] 0 2024-09-17T04:21:14.751 INFO:tasks.workunit.client.0.smithi088.stdout:9/718: dwrite d2/dd/d11/d4f/d72/d74/fe6 [0,4194304] 0 2024-09-17T04:21:14.753 INFO:tasks.workunit.client.0.smithi088.stdout:4/598: creat d5/d3f/d71/d8b/d68/da4/d5e/fc6 x:0 0 0 2024-09-17T04:21:14.754 INFO:tasks.workunit.client.0.smithi088.stdout:8/583: dwrite d7/dd/d31/f76 [0,4194304] 0 2024-09-17T04:21:14.757 INFO:tasks.workunit.client.0.smithi088.stdout:5/558: dwrite d2/d31/d33/f58 [4194304,4194304] 0 2024-09-17T04:21:14.758 INFO:tasks.workunit.client.0.smithi088.stdout:8/584: stat d7/d29/d2a/c8c 0 2024-09-17T04:21:14.758 INFO:tasks.workunit.client.0.smithi088.stdout:9/719: stat d2/d2b/d2e/c56 0 2024-09-17T04:21:14.760 INFO:tasks.workunit.client.0.smithi088.stdout:7/660: getdents d2/d96/dbe 0 2024-09-17T04:21:14.766 INFO:tasks.workunit.client.0.smithi088.stdout:5/559: mknod d2/d31/d33/d20/d30/d9f/da4/cb7 0 2024-09-17T04:21:14.771 INFO:tasks.workunit.client.0.smithi088.stdout:5/560: mkdir d2/da9/db8 0 2024-09-17T04:21:14.772 INFO:tasks.workunit.client.0.smithi088.stdout:6/631: dwrite d14/d63/f82 [0,4194304] 0 2024-09-17T04:21:14.773 INFO:tasks.workunit.client.0.smithi088.stdout:0/455: dread db/d1b/d36/d4a/d6a/f49 [0,4194304] 0 2024-09-17T04:21:14.778 INFO:tasks.workunit.client.0.smithi088.stdout:4/599: write d5/d3f/d71/d8b/d68/da4/d5e/f60 [23972,81421] 0 2024-09-17T04:21:14.781 INFO:tasks.workunit.client.0.smithi088.stdout:4/600: chown d5/d3f/d71/d8b/fb3 3 1 2024-09-17T04:21:14.782 INFO:tasks.workunit.client.0.smithi088.stdout:0/456: truncate db/d1b/d36/d4a/d6a/f26 852195 0 2024-09-17T04:21:14.783 INFO:tasks.workunit.client.0.smithi088.stdout:5/561: dread d2/d31/d33/d20/d30/d51/d5e/d6b/f75 [0,4194304] 0 2024-09-17T04:21:14.783 INFO:tasks.workunit.client.0.smithi088.stdout:7/661: write d2/d4/d7/f9f [932853,95876] 0 2024-09-17T04:21:14.785 INFO:tasks.workunit.client.0.smithi088.stdout:8/585: write d7/d29/f3c [4329153,108917] 0 2024-09-17T04:21:14.785 INFO:tasks.workunit.client.0.smithi088.stdout:6/632: dwrite d14/d44/d45/d6b/d16/f6a [0,4194304] 0 2024-09-17T04:21:14.787 INFO:tasks.workunit.client.0.smithi088.stdout:0/457: write db/d1b/d39/f7d [44687,59333] 0 2024-09-17T04:21:14.791 INFO:tasks.workunit.client.0.smithi088.stdout:6/633: mknod d14/d44/d94/db9/cda 0 2024-09-17T04:21:14.792 INFO:tasks.workunit.client.0.smithi088.stdout:8/586: mknod d7/cc2 0 2024-09-17T04:21:14.795 INFO:tasks.workunit.client.0.smithi088.stdout:8/587: write d7/dd/d31/d47/d55/f74 [4148042,56718] 0 2024-09-17T04:21:14.798 INFO:tasks.workunit.client.0.smithi088.stdout:9/720: dread d2/fc [0,4194304] 0 2024-09-17T04:21:14.799 INFO:tasks.workunit.client.0.smithi088.stdout:0/458: symlink db/d1b/d36/d4a/l9a 0 2024-09-17T04:21:14.800 INFO:tasks.workunit.client.0.smithi088.stdout:7/662: write d2/d1d/f6a [13939770,15323] 0 2024-09-17T04:21:14.802 INFO:tasks.workunit.client.0.smithi088.stdout:4/601: dread d5/d3f/d71/d8b/d68/da4/d5e/f6a [0,4194304] 0 2024-09-17T04:21:14.802 INFO:tasks.workunit.client.0.smithi088.stdout:9/721: mknod d2/d2b/d58/dcf/cf6 0 2024-09-17T04:21:14.803 INFO:tasks.workunit.client.0.smithi088.stdout:9/722: chown d2/d2b/d58/f9b 3507 1 2024-09-17T04:21:14.803 INFO:tasks.workunit.client.0.smithi088.stdout:8/588: symlink d7/d29/lc3 0 2024-09-17T04:21:14.804 INFO:tasks.workunit.client.0.smithi088.stdout:7/663: unlink d2/d4/f52 0 2024-09-17T04:21:14.808 INFO:tasks.workunit.client.0.smithi088.stdout:8/589: dread - d7/d29/f94 zero size 2024-09-17T04:21:14.809 INFO:tasks.workunit.client.0.smithi088.stdout:9/723: unlink d2/dd/d11/d4f/d5c/c7a 0 2024-09-17T04:21:14.813 INFO:tasks.workunit.client.0.smithi088.stdout:7/664: unlink d2/d1d/d2e/db0/f4a 0 2024-09-17T04:21:14.814 INFO:tasks.workunit.client.0.smithi088.stdout:6/634: dwrite d14/d44/d45/d6b/d16/f30 [0,4194304] 0 2024-09-17T04:21:14.816 INFO:tasks.workunit.client.0.smithi088.stdout:6/635: stat d14/d44/d45/d6b/l7d 0 2024-09-17T04:21:14.816 INFO:tasks.workunit.client.0.smithi088.stdout:7/665: chown d2/d1d/d2e/db0/d23/d45/d85/fa4 144327816 1 2024-09-17T04:21:14.818 INFO:tasks.workunit.client.0.smithi088.stdout:5/562: dread d2/d31/d33/d20/d25/d49/f5f [0,4194304] 0 2024-09-17T04:21:14.819 INFO:tasks.workunit.client.0.smithi088.stdout:5/563: readlink d2/d31/d33/d20/d30/d51/l6d 0 2024-09-17T04:21:14.821 INFO:tasks.workunit.client.0.smithi088.stdout:8/590: mknod d7/d29/d2a/d3a/cc4 0 2024-09-17T04:21:14.823 INFO:tasks.workunit.client.0.smithi088.stdout:9/724: truncate d2/dd/d14/d8b/d43/fd1 53423 0 2024-09-17T04:21:14.825 INFO:tasks.workunit.client.0.smithi088.stdout:0/459: getdents db/d1b/d36/d47 0 2024-09-17T04:21:14.827 INFO:tasks.workunit.client.0.smithi088.stdout:4/602: dwrite d5/f1a [0,4194304] 0 2024-09-17T04:21:14.827 INFO:tasks.workunit.client.0.smithi088.stdout:7/666: unlink d2/d1d/d2e/db0/d23/d45/d62/d82/c84 0 2024-09-17T04:21:14.828 INFO:tasks.workunit.client.0.smithi088.stdout:5/564: creat d2/d31/d33/d20/d30/fb9 x:0 0 0 2024-09-17T04:21:14.829 INFO:tasks.workunit.client.0.smithi088.stdout:7/667: chown d2/d1d/d2e/db0/d23/d45/d62/c7c 33375 1 2024-09-17T04:21:14.829 INFO:tasks.workunit.client.0.smithi088.stdout:9/725: mkdir d2/d16/df7 0 2024-09-17T04:21:14.833 INFO:tasks.workunit.client.0.smithi088.stdout:0/460: creat db/d67/d8c/f9b x:0 0 0 2024-09-17T04:21:14.834 INFO:tasks.workunit.client.0.smithi088.stdout:4/603: mknod d5/d72/cc7 0 2024-09-17T04:21:14.835 INFO:tasks.workunit.client.0.smithi088.stdout:8/591: mknod d7/cc5 0 2024-09-17T04:21:14.838 INFO:tasks.workunit.client.0.smithi088.stdout:8/592: dread d7/d29/d2a/d38/d42/f5b [0,4194304] 0 2024-09-17T04:21:14.838 INFO:tasks.workunit.client.0.smithi088.stdout:5/565: mknod d2/d31/d33/d20/d25/d2c/d8a/cba 0 2024-09-17T04:21:14.842 INFO:tasks.workunit.client.0.smithi088.stdout:7/668: creat d2/d1d/fd0 x:0 0 0 2024-09-17T04:21:14.845 INFO:tasks.workunit.client.0.smithi088.stdout:6/636: write d14/d44/d45/d6b/d16/f51 [301285,95034] 0 2024-09-17T04:21:14.845 INFO:tasks.workunit.client.0.smithi088.stdout:8/593: dwrite d7/fbc [0,4194304] 0 2024-09-17T04:21:14.847 INFO:tasks.workunit.client.0.smithi088.stdout:4/604: unlink d5/d3f/lb6 0 2024-09-17T04:21:14.849 INFO:tasks.workunit.client.0.smithi088.stdout:4/605: read d5/f2d [2258200,36242] 0 2024-09-17T04:21:14.851 INFO:tasks.workunit.client.0.smithi088.stdout:9/726: mknod d2/dd/d11/cf8 0 2024-09-17T04:21:14.853 INFO:tasks.workunit.client.0.smithi088.stdout:5/566: creat d2/d31/d33/d20/d30/d51/d5e/fbb x:0 0 0 2024-09-17T04:21:14.853 INFO:tasks.workunit.client.0.smithi088.stdout:6/637: dwrite d14/d44/d45/d6b/d2a/d52/d7a/f83 [0,4194304] 0 2024-09-17T04:21:14.855 INFO:tasks.workunit.client.0.smithi088.stdout:9/727: write d2/d2b/f80 [958726,19129] 0 2024-09-17T04:21:14.856 INFO:tasks.workunit.client.0.smithi088.stdout:0/461: dread db/d1b/d39/f62 [0,4194304] 0 2024-09-17T04:21:14.858 INFO:tasks.workunit.client.0.smithi088.stdout:0/462: readlink db/d1b/d36/d4a/l4b 0 2024-09-17T04:21:14.860 INFO:tasks.workunit.client.0.smithi088.stdout:4/606: creat d5/d3f/d71/d8b/d68/dab/dbb/fc8 x:0 0 0 2024-09-17T04:21:14.865 INFO:tasks.workunit.client.0.smithi088.stdout:6/638: symlink d14/d44/d94/db9/ldb 0 2024-09-17T04:21:14.866 INFO:tasks.workunit.client.0.smithi088.stdout:6/639: chown d14/d3a 3472 1 2024-09-17T04:21:14.867 INFO:tasks.workunit.client.0.smithi088.stdout:8/594: mkdir d7/dd/d31/d47/dc6 0 2024-09-17T04:21:14.870 INFO:tasks.workunit.client.0.smithi088.stdout:9/728: rename d2/dd/d11/d4f/d5c/le1 to d2/dd/d11/d4f/db5/lf9 0 2024-09-17T04:21:14.872 INFO:tasks.workunit.client.0.smithi088.stdout:0/463: creat db/d1b/d36/f9c x:0 0 0 2024-09-17T04:21:14.874 INFO:tasks.workunit.client.0.smithi088.stdout:8/595: dwrite d7/d29/d2a/d75/f7a [0,4194304] 0 2024-09-17T04:21:14.878 INFO:tasks.workunit.client.0.smithi088.stdout:7/669: rmdir d2/d8d 39 2024-09-17T04:21:14.880 INFO:tasks.workunit.client.0.smithi088.stdout:9/729: creat d2/d2b/d58/dcf/ffa x:0 0 0 2024-09-17T04:21:14.881 INFO:tasks.workunit.client.0.smithi088.stdout:9/730: write d2/dd/d14/d2a/d76/fe9 [4975712,78606] 0 2024-09-17T04:21:14.882 INFO:tasks.workunit.client.0.smithi088.stdout:9/731: write d2/dd/fe4 [178722,106231] 0 2024-09-17T04:21:14.883 INFO:tasks.workunit.client.0.smithi088.stdout:9/732: chown d2/l39 30 1 2024-09-17T04:21:14.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:14 smithi088 ceph-mon[27811]: pgmap v28: 65 pgs: 65 active+clean; 3.3 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail; 76 MiB/s rd, 178 MiB/s wr, 400 op/s 2024-09-17T04:21:14.889 INFO:tasks.workunit.client.0.smithi088.stdout:7/670: rmdir d2/d96/dc2 39 2024-09-17T04:21:14.893 INFO:tasks.workunit.client.0.smithi088.stdout:5/567: dwrite d2/d31/d33/d20/d30/d51/fa1 [0,4194304] 0 2024-09-17T04:21:14.893 INFO:tasks.workunit.client.0.smithi088.stdout:4/607: creat d5/d3f/d71/d8b/d68/da4/d5e/fc9 x:0 0 0 2024-09-17T04:21:14.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:14 smithi134 ceph-mon[35201]: pgmap v28: 65 pgs: 65 active+clean; 3.3 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail; 76 MiB/s rd, 178 MiB/s wr, 400 op/s 2024-09-17T04:21:14.897 INFO:tasks.workunit.client.0.smithi088.stdout:0/464: creat db/f9d x:0 0 0 2024-09-17T04:21:14.899 INFO:tasks.workunit.client.0.smithi088.stdout:8/596: link d7/d29/d2a/d75/c8a d7/dd/d31/d47/dc6/cc7 0 2024-09-17T04:21:14.899 INFO:tasks.workunit.client.0.smithi088.stdout:0/465: chown db/c3e 1627 1 2024-09-17T04:21:14.900 INFO:tasks.workunit.client.0.smithi088.stdout:6/640: getdents d14/d2f/d87/d9d 0 2024-09-17T04:21:14.901 INFO:tasks.workunit.client.0.smithi088.stdout:4/608: chown d5/d3f/d71/d8b/d68/da4/d5e/f6a 12740 1 2024-09-17T04:21:14.901 INFO:tasks.workunit.client.0.smithi088.stdout:7/671: dread d2/d8d/f9d [0,4194304] 0 2024-09-17T04:21:14.903 INFO:tasks.workunit.client.0.smithi088.stdout:9/733: dwrite d2/d2b/d58/f9b [0,4194304] 0 2024-09-17T04:21:14.904 INFO:tasks.workunit.client.0.smithi088.stdout:8/597: symlink d7/d29/d2a/d38/daf/lc8 0 2024-09-17T04:21:14.905 INFO:tasks.workunit.client.0.smithi088.stdout:6/641: chown d14/d44/d45/d6b/d29 226615277 1 2024-09-17T04:21:14.907 INFO:tasks.workunit.client.0.smithi088.stdout:5/568: rename d2/d31/d33/d20/f55 to d2/d31/d33/fbc 0 2024-09-17T04:21:14.909 INFO:tasks.workunit.client.0.smithi088.stdout:7/672: chown d2/d1d/d2e/db0/f5a 1649 1 2024-09-17T04:21:14.909 INFO:tasks.workunit.client.0.smithi088.stdout:8/598: creat d7/d29/d2a/d3a/fc9 x:0 0 0 2024-09-17T04:21:14.911 INFO:tasks.workunit.client.0.smithi088.stdout:0/466: rename db/d1b/d36/d4a/d6a/l55 to db/d3c/d4f/d66/d82/l9e 0 2024-09-17T04:21:14.913 INFO:tasks.workunit.client.0.smithi088.stdout:6/642: creat d14/d44/d45/d6b/d2a/d52/fdc x:0 0 0 2024-09-17T04:21:14.913 INFO:tasks.workunit.client.0.smithi088.stdout:9/734: dread d2/dd/d14/f20 [4194304,4194304] 0 2024-09-17T04:21:14.914 INFO:tasks.workunit.client.0.smithi088.stdout:6/643: chown d14/d3a/d41/f60 5201 1 2024-09-17T04:21:14.916 INFO:tasks.workunit.client.0.smithi088.stdout:8/599: write d7/d29/d2a/f4a [5959052,84586] 0 2024-09-17T04:21:14.918 INFO:tasks.workunit.client.0.smithi088.stdout:8/600: stat d7/d29/d2a/d38/f44 0 2024-09-17T04:21:14.918 INFO:tasks.workunit.client.0.smithi088.stdout:0/467: mkdir db/d3c/d4f/d9f 0 2024-09-17T04:21:14.918 INFO:tasks.workunit.client.0.smithi088.stdout:8/601: stat d7/d29/d2a/d38/d42/f5b 0 2024-09-17T04:21:14.919 INFO:tasks.workunit.client.0.smithi088.stdout:5/569: mknod d2/da9/db8/cbd 0 2024-09-17T04:21:14.920 INFO:tasks.workunit.client.0.smithi088.stdout:6/644: truncate d14/d44/d45/d6b/d2a/d52/d7a/d7b/f7c 773256 0 2024-09-17T04:21:14.921 INFO:tasks.workunit.client.0.smithi088.stdout:5/570: truncate d2/d31/d33/d20/d30/f91 1000791 0 2024-09-17T04:21:14.921 INFO:tasks.workunit.client.0.smithi088.stdout:0/468: creat db/d3c/d4f/fa0 x:0 0 0 2024-09-17T04:21:14.922 INFO:tasks.workunit.client.0.smithi088.stdout:0/469: fsync db/d1b/d36/f9c 0 2024-09-17T04:21:14.923 INFO:tasks.workunit.client.0.smithi088.stdout:8/602: mkdir d7/dd/d31/dca 0 2024-09-17T04:21:14.924 INFO:tasks.workunit.client.0.smithi088.stdout:9/735: symlink d2/d2b/d2e/dbb/lfb 0 2024-09-17T04:21:14.925 INFO:tasks.workunit.client.0.smithi088.stdout:9/736: write d2/d2b/d58/d82/f83 [8779283,33237] 0 2024-09-17T04:21:14.927 INFO:tasks.workunit.client.0.smithi088.stdout:0/470: dread db/f12 [0,4194304] 0 2024-09-17T04:21:14.927 INFO:tasks.workunit.client.0.smithi088.stdout:9/737: chown d2/dd/d11/d4f/d72/d74/fae 564 1 2024-09-17T04:21:14.928 INFO:tasks.workunit.client.0.smithi088.stdout:9/738: read - d2/dd/d14/fe2 zero size 2024-09-17T04:21:14.930 INFO:tasks.workunit.client.0.smithi088.stdout:6/645: rename d14/d44/d45/d6b/d29/d3e/l53 to d14/d44/d45/d6b/d29/ldd 0 2024-09-17T04:21:14.931 INFO:tasks.workunit.client.0.smithi088.stdout:6/646: write d14/d44/dad/fcb [854318,41461] 0 2024-09-17T04:21:14.936 INFO:tasks.workunit.client.0.smithi088.stdout:4/609: truncate d5/d3f/d71/d8b/f88 2003237 0 2024-09-17T04:21:14.941 INFO:tasks.workunit.client.0.smithi088.stdout:5/571: dread d2/f15 [0,4194304] 0 2024-09-17T04:21:14.942 INFO:tasks.workunit.client.0.smithi088.stdout:6/647: symlink d14/d44/d45/d6b/d29/dac/lde 0 2024-09-17T04:21:14.943 INFO:tasks.workunit.client.0.smithi088.stdout:5/572: write d2/d31/d33/d20/d30/fb9 [650188,60176] 0 2024-09-17T04:21:14.944 INFO:tasks.workunit.client.0.smithi088.stdout:5/573: chown d2/d31/d33/d20/d47/f85 363375657 1 2024-09-17T04:21:14.945 INFO:tasks.workunit.client.0.smithi088.stdout:5/574: read d2/d31/d33/d20/f84 [18442,122388] 0 2024-09-17T04:21:14.946 INFO:tasks.workunit.client.0.smithi088.stdout:9/739: mkdir d2/dd/d14/d8b/d35/d94/dfc 0 2024-09-17T04:21:14.947 INFO:tasks.workunit.client.0.smithi088.stdout:6/648: mkdir d14/d44/d45/d6b/d2a/d52/d7a/d7b/ddf 0 2024-09-17T04:21:14.951 INFO:tasks.workunit.client.0.smithi088.stdout:5/575: mkdir d2/d31/d33/d20/d30/d9f/da4/dbe 0 2024-09-17T04:21:14.952 INFO:tasks.workunit.client.0.smithi088.stdout:0/471: write db/f1d [1123381,109820] 0 2024-09-17T04:21:14.952 INFO:tasks.workunit.client.0.smithi088.stdout:8/603: dwrite f2 [4194304,4194304] 0 2024-09-17T04:21:14.954 INFO:tasks.workunit.client.0.smithi088.stdout:5/576: chown d2/d31/d33/d20/d25/d2c/d3d/c66 5 1 2024-09-17T04:21:14.962 INFO:tasks.workunit.client.0.smithi088.stdout:0/472: symlink db/d1b/d39/la1 0 2024-09-17T04:21:14.964 INFO:tasks.workunit.client.0.smithi088.stdout:6/649: rename d14/d44/d45/d6b/d16/d42/d92 to d14/d63/de0 0 2024-09-17T04:21:14.966 INFO:tasks.workunit.client.0.smithi088.stdout:8/604: mknod d7/dd/ccb 0 2024-09-17T04:21:14.967 INFO:tasks.workunit.client.0.smithi088.stdout:8/605: chown d7/d29/d2a/d38/d42/cc1 13279728 1 2024-09-17T04:21:14.967 INFO:tasks.workunit.client.0.smithi088.stdout:9/740: creat d2/dd/d14/d8b/ffd x:0 0 0 2024-09-17T04:21:14.969 INFO:tasks.workunit.client.0.smithi088.stdout:9/741: dread - d2/dd/d14/d2a/d76/d98/db3/fc9 zero size 2024-09-17T04:21:14.970 INFO:tasks.workunit.client.0.smithi088.stdout:5/577: link d2/d31/d33/d20/d25/d49/f60 d2/d31/d33/d20/d30/d51/d5e/d6b/db5/fbf 0 2024-09-17T04:21:14.972 INFO:tasks.workunit.client.0.smithi088.stdout:0/473: creat db/d1b/d36/d4a/fa2 x:0 0 0 2024-09-17T04:21:14.973 INFO:tasks.workunit.client.0.smithi088.stdout:9/742: creat d2/dd/d11/d4f/dd5/ffe x:0 0 0 2024-09-17T04:21:14.980 INFO:tasks.workunit.client.0.smithi088.stdout:0/474: unlink db/d1b/d36/d4a/d6a/f49 0 2024-09-17T04:21:14.983 INFO:tasks.workunit.client.0.smithi088.stdout:6/650: dread f4 [0,4194304] 0 2024-09-17T04:21:14.986 INFO:tasks.workunit.client.0.smithi088.stdout:0/475: truncate db/f12 376128 0 2024-09-17T04:21:14.986 INFO:tasks.workunit.client.0.smithi088.stdout:6/651: read d14/d44/d45/d6b/f96 [1439586,73584] 0 2024-09-17T04:21:14.988 INFO:tasks.workunit.client.0.smithi088.stdout:0/476: truncate db/fc 1496092 0 2024-09-17T04:21:14.988 INFO:tasks.workunit.client.0.smithi088.stdout:0/477: stat db/f9d 0 2024-09-17T04:21:14.991 INFO:tasks.workunit.client.0.smithi088.stdout:5/578: dread d2/d31/d33/d20/d47/f71 [0,4194304] 0 2024-09-17T04:21:14.993 INFO:tasks.workunit.client.0.smithi088.stdout:9/743: dread d2/d16/fa8 [0,4194304] 0 2024-09-17T04:21:15.000 INFO:tasks.workunit.client.0.smithi088.stdout:8/606: dwrite d7/dd/f28 [0,4194304] 0 2024-09-17T04:21:15.001 INFO:tasks.workunit.client.0.smithi088.stdout:6/652: dwrite d14/d44/d94/db9/fd5 [0,4194304] 0 2024-09-17T04:21:15.002 INFO:tasks.workunit.client.0.smithi088.stdout:9/744: dread d2/dd/d11/f79 [0,4194304] 0 2024-09-17T04:21:15.003 INFO:tasks.workunit.client.0.smithi088.stdout:8/607: stat d7/d29/c2f 0 2024-09-17T04:21:15.006 INFO:tasks.workunit.client.0.smithi088.stdout:5/579: creat d2/d31/d33/d20/d25/fc0 x:0 0 0 2024-09-17T04:21:15.006 INFO:tasks.workunit.client.0.smithi088.stdout:9/745: write d2/dd/d11/d4f/d5c/fc1 [854127,123792] 0 2024-09-17T04:21:15.010 INFO:tasks.workunit.client.0.smithi088.stdout:0/478: link db/d1b/d39/f8d db/d1b/d36/d4a/d20/fa3 0 2024-09-17T04:21:15.016 INFO:tasks.workunit.client.0.smithi088.stdout:9/746: dwrite d2/dd/d11/d4f/dd5/ffe [0,4194304] 0 2024-09-17T04:21:15.023 INFO:tasks.workunit.client.0.smithi088.stdout:5/580: symlink d2/d31/d33/d20/d25/d2c/d3d/da5/lc1 0 2024-09-17T04:21:15.025 INFO:tasks.workunit.client.0.smithi088.stdout:5/581: truncate d2/d31/d33/d20/d30/f91 1206384 0 2024-09-17T04:21:15.026 INFO:tasks.workunit.client.0.smithi088.stdout:0/479: mkdir db/d3c/d4f/d59/da4 0 2024-09-17T04:21:15.029 INFO:tasks.workunit.client.0.smithi088.stdout:8/608: creat d7/dd/d6f/db6/fcc x:0 0 0 2024-09-17T04:21:15.033 INFO:tasks.workunit.client.0.smithi088.stdout:6/653: write d14/d44/d45/d6b/d29/dac/fb1 [1585080,86076] 0 2024-09-17T04:21:15.033 INFO:tasks.workunit.client.0.smithi088.stdout:5/582: dread d2/d31/d33/d20/d30/d51/d5e/f74 [0,4194304] 0 2024-09-17T04:21:15.034 INFO:tasks.workunit.client.0.smithi088.stdout:9/747: creat d2/dd/d14/d8b/d35/da5/fff x:0 0 0 2024-09-17T04:21:15.039 INFO:tasks.workunit.client.0.smithi088.stdout:0/480: mknod db/d3c/d4f/d9f/ca5 0 2024-09-17T04:21:15.040 INFO:tasks.workunit.client.0.smithi088.stdout:0/481: write db/f9d [615121,85617] 0 2024-09-17T04:21:15.043 INFO:tasks.workunit.client.0.smithi088.stdout:9/748: rename d2/dd/d11/d30/d49/l92 to d2/dd/d14/d8b/d35/d94/dfc/l100 0 2024-09-17T04:21:15.048 INFO:tasks.workunit.client.0.smithi088.stdout:6/654: creat d14/d44/d45/d6b/d16/fe1 x:0 0 0 2024-09-17T04:21:15.050 INFO:tasks.workunit.client.0.smithi088.stdout:8/609: getdents d7/d29 0 2024-09-17T04:21:15.051 INFO:tasks.workunit.client.0.smithi088.stdout:9/749: link d2/dd/d11/d4f/d72/d74/fae d2/dd/d11/d30/f101 0 2024-09-17T04:21:15.052 INFO:tasks.workunit.client.0.smithi088.stdout:9/750: dread - d2/dd/d14/fe2 zero size 2024-09-17T04:21:15.054 INFO:tasks.workunit.client.0.smithi088.stdout:6/655: fsync d14/d44/d45/d6b/d2a/f49 0 2024-09-17T04:21:15.057 INFO:tasks.workunit.client.0.smithi088.stdout:6/656: readlink d14/d44/d45/d6b/d16/d42/l71 0 2024-09-17T04:21:15.059 INFO:tasks.workunit.client.0.smithi088.stdout:9/751: dwrite d2/f8 [0,4194304] 0 2024-09-17T04:21:15.061 INFO:tasks.workunit.client.0.smithi088.stdout:5/583: dwrite d2/f40 [0,4194304] 0 2024-09-17T04:21:15.064 INFO:tasks.workunit.client.0.smithi088.stdout:5/584: readlink d2/d31/d33/d20/d25/d2c/la3 0 2024-09-17T04:21:15.064 INFO:tasks.workunit.client.0.smithi088.stdout:5/585: fdatasync d2/f38 0 2024-09-17T04:21:15.066 INFO:tasks.workunit.client.0.smithi088.stdout:9/752: write d2/d16/fa8 [761629,70511] 0 2024-09-17T04:21:15.068 INFO:tasks.workunit.client.0.smithi088.stdout:6/657: truncate d14/d44/d45/d6b/d29/d3e/f73 98964 0 2024-09-17T04:21:15.070 INFO:tasks.workunit.client.0.smithi088.stdout:6/658: write d14/d44/d45/d6b/d16/f51 [342874,55926] 0 2024-09-17T04:21:15.074 INFO:tasks.workunit.client.0.smithi088.stdout:5/586: creat d2/d31/d33/d20/d25/d2c/d8a/fc2 x:0 0 0 2024-09-17T04:21:15.074 INFO:tasks.workunit.client.0.smithi088.stdout:9/753: mknod d2/dd/d11/d4f/d5c/dbc/c102 0 2024-09-17T04:21:15.080 INFO:tasks.workunit.client.0.smithi088.stdout:9/754: unlink d2/dd/f1b 0 2024-09-17T04:21:15.080 INFO:tasks.workunit.client.0.smithi088.stdout:6/659: dwrite d14/d44/d45/fc7 [0,4194304] 0 2024-09-17T04:21:15.081 INFO:tasks.workunit.client.0.smithi088.stdout:0/482: dwrite db/f14 [4194304,4194304] 0 2024-09-17T04:21:15.088 INFO:tasks.workunit.client.0.smithi088.stdout:9/755: creat d2/dd/d11/d4f/f103 x:0 0 0 2024-09-17T04:21:15.089 INFO:tasks.workunit.client.0.smithi088.stdout:9/756: readlink d2/d2b/lad 0 2024-09-17T04:21:15.090 INFO:tasks.workunit.client.0.smithi088.stdout:8/610: dwrite d7/d29/f94 [0,4194304] 0 2024-09-17T04:21:15.091 INFO:tasks.workunit.client.0.smithi088.stdout:8/611: readlink d7/d29/l9e 0 2024-09-17T04:21:15.092 INFO:tasks.workunit.client.0.smithi088.stdout:5/587: mkdir d2/d31/d33/d20/d25/d2c/d8a/db2/dc3 0 2024-09-17T04:21:15.092 INFO:tasks.workunit.client.0.smithi088.stdout:3/669: sync 2024-09-17T04:21:15.097 INFO:tasks.workunit.client.0.smithi088.stdout:9/757: unlink d2/dd/d14/d8b/d35/c3c 0 2024-09-17T04:21:15.099 INFO:tasks.workunit.client.0.smithi088.stdout:8/612: read d7/f9a [131098,91616] 0 2024-09-17T04:21:15.100 INFO:tasks.workunit.client.0.smithi088.stdout:8/613: chown d7/dd/d31/d47/d55 53 1 2024-09-17T04:21:15.101 INFO:tasks.workunit.client.0.smithi088.stdout:5/588: fsync d2/d31/d33/d20/d25/f57 0 2024-09-17T04:21:15.102 INFO:tasks.workunit.client.0.smithi088.stdout:5/589: read d2/d31/f77 [323035,32545] 0 2024-09-17T04:21:15.103 INFO:tasks.workunit.client.0.smithi088.stdout:0/483: link db/d1b/c5d db/d3c/d4f/ca6 0 2024-09-17T04:21:15.103 INFO:tasks.workunit.client.0.smithi088.stdout:0/484: fsync db/f19 0 2024-09-17T04:21:15.105 INFO:tasks.workunit.client.0.smithi088.stdout:3/670: symlink d0/d13/d58/ld9 0 2024-09-17T04:21:15.113 INFO:tasks.workunit.client.0.smithi088.stdout:5/590: unlink d2/d31/d33/d20/d47/f7c 0 2024-09-17T04:21:15.113 INFO:tasks.workunit.client.0.smithi088.stdout:0/485: mknod db/d1b/d36/d47/ca7 0 2024-09-17T04:21:15.114 INFO:tasks.workunit.client.0.smithi088.stdout:5/591: dread - d2/d31/d33/d20/d30/d51/d5e/d6b/fa0 zero size 2024-09-17T04:21:15.116 INFO:tasks.workunit.client.0.smithi088.stdout:3/671: mkdir d0/d54/dda 0 2024-09-17T04:21:15.117 INFO:tasks.workunit.client.0.smithi088.stdout:9/758: dread d2/dd/d14/d8b/d43/f55 [4194304,4194304] 0 2024-09-17T04:21:15.118 INFO:tasks.workunit.client.0.smithi088.stdout:8/614: unlink d7/d29/d2a/d75/cbb 0 2024-09-17T04:21:15.121 INFO:tasks.workunit.client.0.smithi088.stdout:9/759: dread d2/dd/d14/d2a/d76/fe9 [4194304,4194304] 0 2024-09-17T04:21:15.123 INFO:tasks.workunit.client.0.smithi088.stdout:3/672: symlink d0/d13/d4d/ldb 0 2024-09-17T04:21:15.126 INFO:tasks.workunit.client.0.smithi088.stdout:8/615: mknod d7/d29/d2a/d38/d42/ccd 0 2024-09-17T04:21:15.128 INFO:tasks.workunit.client.0.smithi088.stdout:3/673: creat d0/d13/d1b/d29/d56/d85/fdc x:0 0 0 2024-09-17T04:21:15.131 INFO:tasks.workunit.client.0.smithi088.stdout:8/616: read d7/dd/f1a [4640056,21977] 0 2024-09-17T04:21:15.131 INFO:tasks.workunit.client.0.smithi088.stdout:0/486: rename db/d1b/d39/c58 to db/ca8 0 2024-09-17T04:21:15.133 INFO:tasks.workunit.client.0.smithi088.stdout:3/674: dread - d0/d13/d58/d5e/f6a zero size 2024-09-17T04:21:15.134 INFO:tasks.workunit.client.0.smithi088.stdout:9/760: rename d2/dd/d11/d4f to d2/d2b/d2e/dbb/d104 0 2024-09-17T04:21:15.136 INFO:tasks.workunit.client.0.smithi088.stdout:9/761: write d2/dd/d14/d8b/d43/d51/fb0 [3481604,15770] 0 2024-09-17T04:21:15.139 INFO:tasks.workunit.client.0.smithi088.stdout:3/675: write d0/d13/d1b/d29/d2b/d40/fcc [3400411,109870] 0 2024-09-17T04:21:15.145 INFO:tasks.workunit.client.0.smithi088.stdout:8/617: dwrite d7/dd/d31/f36 [4194304,4194304] 0 2024-09-17T04:21:15.146 INFO:tasks.workunit.client.0.smithi088.stdout:0/487: dwrite db/d1b/d36/d47/f30 [4194304,4194304] 0 2024-09-17T04:21:15.146 INFO:tasks.workunit.client.0.smithi088.stdout:9/762: dread d2/fb [0,4194304] 0 2024-09-17T04:21:15.148 INFO:tasks.workunit.client.0.smithi088.stdout:0/488: chown db/d1b/d36 17636739 1 2024-09-17T04:21:15.149 INFO:tasks.workunit.client.0.smithi088.stdout:8/618: chown d7/dd/d31/f58 72904522 1 2024-09-17T04:21:15.151 INFO:tasks.workunit.client.0.smithi088.stdout:8/619: write d7/dd/d6f/fb9 [940575,93016] 0 2024-09-17T04:21:15.159 INFO:tasks.workunit.client.0.smithi088.stdout:3/676: dread d0/f12 [0,4194304] 0 2024-09-17T04:21:15.161 INFO:tasks.workunit.client.0.smithi088.stdout:0/489: dwrite db/d1b/d36/d4a/d6a/f74 [0,4194304] 0 2024-09-17T04:21:15.161 INFO:tasks.workunit.client.0.smithi088.stdout:9/763: rmdir d2/d2b/dbf 39 2024-09-17T04:21:15.162 INFO:tasks.workunit.client.0.smithi088.stdout:3/677: chown d0/d13/d1b/d29/d2b/d8b 24348 1 2024-09-17T04:21:15.164 INFO:tasks.workunit.client.0.smithi088.stdout:8/620: fsync d7/d29/d7e/f83 0 2024-09-17T04:21:15.165 INFO:tasks.workunit.client.0.smithi088.stdout:8/621: dread - d7/d29/f5c zero size 2024-09-17T04:21:15.167 INFO:tasks.workunit.client.0.smithi088.stdout:9/764: rmdir d2/dd/d14/d8b/d35/da5 39 2024-09-17T04:21:15.168 INFO:tasks.workunit.client.0.smithi088.stdout:3/678: symlink d0/d13/d1b/d29/d2b/d40/ldd 0 2024-09-17T04:21:15.171 INFO:tasks.workunit.client.0.smithi088.stdout:0/490: symlink db/d1b/d36/d47/la9 0 2024-09-17T04:21:15.173 INFO:tasks.workunit.client.0.smithi088.stdout:3/679: read d0/d13/d1b/d29/d2b/d40/fcc [3591204,9010] 0 2024-09-17T04:21:15.174 INFO:tasks.workunit.client.0.smithi088.stdout:5/592: write d2/d31/d33/d20/d25/d49/f64 [802694,10136] 0 2024-09-17T04:21:15.175 INFO:tasks.workunit.client.0.smithi088.stdout:8/622: dwrite d7/dd/d31/f6d [0,4194304] 0 2024-09-17T04:21:15.176 INFO:tasks.workunit.client.0.smithi088.stdout:5/593: read d2/f15 [841249,41465] 0 2024-09-17T04:21:15.177 INFO:tasks.workunit.client.0.smithi088.stdout:5/594: dread - d2/d31/d33/d20/d25/d49/f9a zero size 2024-09-17T04:21:15.203 INFO:tasks.workunit.client.0.smithi088.stdout:5/595: dread d2/d31/d33/d20/d25/f41 [0,4194304] 0 2024-09-17T04:21:15.205 INFO:tasks.workunit.client.0.smithi088.stdout:3/680: mkdir d0/d13/d1b/d29/d30/dde 0 2024-09-17T04:21:15.207 INFO:tasks.workunit.client.0.smithi088.stdout:3/681: fsync d0/d13/d1b/d29/d30/d3c/d5c/f96 0 2024-09-17T04:21:15.209 INFO:tasks.workunit.client.0.smithi088.stdout:8/623: mknod d7/d29/d2a/d38/daf/cce 0 2024-09-17T04:21:15.216 INFO:tasks.workunit.client.0.smithi088.stdout:5/596: unlink d2/d31/d33/fbc 0 2024-09-17T04:21:15.221 INFO:tasks.workunit.client.0.smithi088.stdout:0/491: dread db/d3c/d4f/d66/f70 [0,4194304] 0 2024-09-17T04:21:15.221 INFO:tasks.workunit.client.0.smithi088.stdout:0/492: fsync db/f14 0 2024-09-17T04:21:15.224 INFO:tasks.workunit.client.0.smithi088.stdout:5/597: dread d2/d31/d33/d20/d25/d49/f64 [0,4194304] 0 2024-09-17T04:21:15.226 INFO:tasks.workunit.client.0.smithi088.stdout:5/598: fsync d2/d31/d33/d20/d25/d49/f8d 0 2024-09-17T04:21:15.232 INFO:tasks.workunit.client.0.smithi088.stdout:3/682: link d0/d13/c14 d0/d13/d1b/d29/d2b/d50/cdf 0 2024-09-17T04:21:15.237 INFO:tasks.workunit.client.0.smithi088.stdout:5/599: unlink d2/d31/d33/d20/d25/d2c/d3d/c6e 0 2024-09-17T04:21:15.241 INFO:tasks.workunit.client.0.smithi088.stdout:3/683: fdatasync d0/f12 0 2024-09-17T04:21:15.242 INFO:tasks.workunit.client.0.smithi088.stdout:9/765: mkdir d2/d16/ddd/d105 0 2024-09-17T04:21:15.243 INFO:tasks.workunit.client.0.smithi088.stdout:5/600: dread d2/d31/d33/d20/d25/d49/f5f [0,4194304] 0 2024-09-17T04:21:15.245 INFO:tasks.workunit.client.0.smithi088.stdout:0/493: creat db/d1b/d36/d4a/d6a/faa x:0 0 0 2024-09-17T04:21:15.249 INFO:tasks.workunit.client.0.smithi088.stdout:8/624: dread d7/d29/d2a/f4a [0,4194304] 0 2024-09-17T04:21:15.250 INFO:tasks.workunit.client.0.smithi088.stdout:8/625: chown d7/dd/d31/f6d 6 1 2024-09-17T04:21:15.250 INFO:tasks.workunit.client.0.smithi088.stdout:5/601: creat d2/d31/d33/d20/d47/fc4 x:0 0 0 2024-09-17T04:21:15.253 INFO:tasks.workunit.client.0.smithi088.stdout:0/494: creat db/d3c/d4f/d66/fab x:0 0 0 2024-09-17T04:21:15.253 INFO:tasks.workunit.client.0.smithi088.stdout:5/602: dread - d2/d31/d33/d20/d30/d9f/da4/fa7 zero size 2024-09-17T04:21:15.254 INFO:tasks.workunit.client.0.smithi088.stdout:9/766: symlink d2/l106 0 2024-09-17T04:21:15.255 INFO:tasks.workunit.client.0.smithi088.stdout:5/603: chown d2/d31/d33/d20/d25/d2c/f72 956590 1 2024-09-17T04:21:15.256 INFO:tasks.workunit.client.0.smithi088.stdout:8/626: truncate d7/d29/d2a/f33 1889342 0 2024-09-17T04:21:15.258 INFO:tasks.workunit.client.0.smithi088.stdout:0/495: symlink db/d3c/d4f/d9f/lac 0 2024-09-17T04:21:15.261 INFO:tasks.workunit.client.0.smithi088.stdout:9/767: mkdir d2/dd/d11/d30/d107 0 2024-09-17T04:21:15.263 INFO:tasks.workunit.client.0.smithi088.stdout:8/627: dread d7/dd/d6f/fb9 [0,4194304] 0 2024-09-17T04:21:15.266 INFO:tasks.workunit.client.0.smithi088.stdout:3/684: getdents d0/d13 0 2024-09-17T04:21:15.268 INFO:tasks.workunit.client.0.smithi088.stdout:3/685: truncate d0/d13/f28 1789366 0 2024-09-17T04:21:15.268 INFO:tasks.workunit.client.0.smithi088.stdout:5/604: dread d2/d31/d33/d20/d47/f8e [0,4194304] 0 2024-09-17T04:21:15.269 INFO:tasks.workunit.client.0.smithi088.stdout:8/628: symlink d7/d29/daa/lcf 0 2024-09-17T04:21:15.301 INFO:tasks.workunit.client.0.smithi088.stdout:1/614: sync 2024-09-17T04:21:15.301 INFO:tasks.workunit.client.0.smithi088.stdout:2/664: sync 2024-09-17T04:21:15.302 INFO:tasks.workunit.client.0.smithi088.stdout:3/686: mkdir d0/d13/d1b/d29/d30/d81/de0 0 2024-09-17T04:21:15.303 INFO:tasks.workunit.client.0.smithi088.stdout:8/629: chown d7/dd/d31/fb5 818239729 1 2024-09-17T04:21:15.304 INFO:tasks.workunit.client.0.smithi088.stdout:2/665: write d0/d1/d2d/d33/d4b/d24/f7a [2239072,74897] 0 2024-09-17T04:21:15.305 INFO:tasks.workunit.client.0.smithi088.stdout:0/496: truncate db/d1b/d36/f43 2544781 0 2024-09-17T04:21:15.307 INFO:tasks.workunit.client.0.smithi088.stdout:3/687: dread d0/d54/fa9 [0,4194304] 0 2024-09-17T04:21:15.307 INFO:tasks.workunit.client.0.smithi088.stdout:1/615: creat d0/d1/d27/d9a/fc9 x:0 0 0 2024-09-17T04:21:15.308 INFO:tasks.workunit.client.0.smithi088.stdout:2/666: stat d0/d1/d2d/d33/d4b/d24/d92/f9c 0 2024-09-17T04:21:15.309 INFO:tasks.workunit.client.0.smithi088.stdout:2/667: chown d0/d1/d2d 45374707 1 2024-09-17T04:21:15.309 INFO:tasks.workunit.client.0.smithi088.stdout:1/616: dread - d0/d13/d84/fac zero size 2024-09-17T04:21:15.310 INFO:tasks.workunit.client.0.smithi088.stdout:5/605: rename d2/d31/d33/f9d to d2/fc5 0 2024-09-17T04:21:15.311 INFO:tasks.workunit.client.0.smithi088.stdout:3/688: truncate d0/d13/d58/d5a/f8c 440524 0 2024-09-17T04:21:15.313 INFO:tasks.workunit.client.0.smithi088.stdout:2/668: mknod d0/d1/d2d/d33/d4b/ccc 0 2024-09-17T04:21:15.320 INFO:tasks.workunit.client.0.smithi088.stdout:2/669: dread d0/d1/d2d/d33/d4b/f8b [0,4194304] 0 2024-09-17T04:21:15.324 INFO:tasks.workunit.client.0.smithi088.stdout:8/630: truncate d7/d29/f3c 968956 0 2024-09-17T04:21:15.328 INFO:tasks.workunit.client.0.smithi088.stdout:3/689: write d0/d13/f99 [1654281,9085] 0 2024-09-17T04:21:15.329 INFO:tasks.workunit.client.0.smithi088.stdout:5/606: write d2/d31/d33/d20/d47/f8e [1896006,16166] 0 2024-09-17T04:21:15.330 INFO:tasks.workunit.client.0.smithi088.stdout:5/607: readlink d2/d31/d33/d20/d25/d2c/l56 0 2024-09-17T04:21:15.332 INFO:tasks.workunit.client.0.smithi088.stdout:0/497: truncate db/d1b/d36/d4a/d6a/f74 1139237 0 2024-09-17T04:21:15.333 INFO:tasks.workunit.client.0.smithi088.stdout:8/631: symlink d7/d29/d2a/d38/d3d/da0/ld0 0 2024-09-17T04:21:15.336 INFO:tasks.workunit.client.0.smithi088.stdout:8/632: write d7/dd/d31/d47/d55/fad [695072,124629] 0 2024-09-17T04:21:15.338 INFO:tasks.workunit.client.0.smithi088.stdout:3/690: dwrite d0/d13/d1b/d29/d30/f9e [0,4194304] 0 2024-09-17T04:21:15.338 INFO:tasks.workunit.client.0.smithi088.stdout:1/617: truncate d0/d13/d84/d5d/f78 912617 0 2024-09-17T04:21:15.339 INFO:tasks.workunit.client.0.smithi088.stdout:3/691: stat d0/f9f 0 2024-09-17T04:21:15.339 INFO:tasks.workunit.client.0.smithi088.stdout:8/633: chown d7/d29/d2a/d38/d3d/d63/d97 23 1 2024-09-17T04:21:15.339 INFO:tasks.workunit.client.0.smithi088.stdout:1/618: stat d0/d1/d16/d35/c70 0 2024-09-17T04:21:15.340 INFO:tasks.workunit.client.0.smithi088.stdout:5/608: mkdir d2/d31/d33/d20/d25/d2c/d8a/dc6 0 2024-09-17T04:21:15.342 INFO:tasks.workunit.client.0.smithi088.stdout:1/619: write d0/d1/df/d63/fb5 [3473607,116859] 0 2024-09-17T04:21:15.345 INFO:tasks.workunit.client.0.smithi088.stdout:0/498: rename db/d1b/d36/d4a/d20/f2c to db/d67/fad 0 2024-09-17T04:21:15.348 INFO:tasks.workunit.client.0.smithi088.stdout:3/692: rmdir d0/d13/d58 39 2024-09-17T04:21:15.352 INFO:tasks.workunit.client.0.smithi088.stdout:2/670: dwrite d0/d1/d2d/f84 [0,4194304] 0 2024-09-17T04:21:15.352 INFO:tasks.workunit.client.0.smithi088.stdout:1/620: chown d0/f28 172 1 2024-09-17T04:21:15.353 INFO:tasks.workunit.client.0.smithi088.stdout:8/634: dwrite d7/dd/d6f/f8d [0,4194304] 0 2024-09-17T04:21:15.357 INFO:tasks.workunit.client.0.smithi088.stdout:5/609: rename d2/da9/db8/cbd to d2/d31/d33/d20/d30/d9f/da4/dbe/cc7 0 2024-09-17T04:21:15.359 INFO:tasks.workunit.client.0.smithi088.stdout:0/499: rmdir db/d1b/d36/d4a/d20 39 2024-09-17T04:21:15.362 INFO:tasks.workunit.client.0.smithi088.stdout:3/693: symlink d0/dae/le1 0 2024-09-17T04:21:15.363 INFO:tasks.workunit.client.0.smithi088.stdout:1/621: fsync d0/d1/df/f3e 0 2024-09-17T04:21:15.368 INFO:tasks.workunit.client.0.smithi088.stdout:2/671: unlink d0/d1/d2d/d33/d4b/d24/d92/cb4 0 2024-09-17T04:21:15.370 INFO:tasks.workunit.client.0.smithi088.stdout:2/672: write d0/d1/d2d/d33/f82 [388090,107088] 0 2024-09-17T04:21:15.373 INFO:tasks.workunit.client.0.smithi088.stdout:8/635: dwrite d7/dd/d31/fb5 [0,4194304] 0 2024-09-17T04:21:15.375 INFO:tasks.workunit.client.0.smithi088.stdout:0/500: mkdir db/d67/d7c/dae 0 2024-09-17T04:21:15.377 INFO:tasks.workunit.client.0.smithi088.stdout:0/501: read - db/f72 zero size 2024-09-17T04:21:15.385 INFO:tasks.workunit.client.0.smithi088.stdout:8/636: rename d7/cc5 to d7/dd/d31/cd1 0 2024-09-17T04:21:15.387 INFO:tasks.workunit.client.0.smithi088.stdout:0/502: creat db/d3c/d4f/d9f/faf x:0 0 0 2024-09-17T04:21:15.390 INFO:tasks.workunit.client.0.smithi088.stdout:2/673: dread d0/d1/d2d/d33/d4b/d24/d3b/f7f [0,4194304] 0 2024-09-17T04:21:15.392 INFO:tasks.workunit.client.0.smithi088.stdout:0/503: creat db/d67/d7c/fb0 x:0 0 0 2024-09-17T04:21:15.396 INFO:tasks.workunit.client.0.smithi088.stdout:5/610: getdents d2/d31 0 2024-09-17T04:21:15.396 INFO:tasks.workunit.client.0.smithi088.stdout:8/637: mknod d7/dd/d31/d47/dc6/cd2 0 2024-09-17T04:21:15.400 INFO:tasks.workunit.client.0.smithi088.stdout:2/674: dwrite d0/d1/d2d/d33/f38 [0,4194304] 0 2024-09-17T04:21:15.400 INFO:tasks.workunit.client.0.smithi088.stdout:5/611: truncate d2/d31/d33/f54 950594 0 2024-09-17T04:21:15.403 INFO:tasks.workunit.client.0.smithi088.stdout:1/622: dread d0/f4 [0,4194304] 0 2024-09-17T04:21:15.404 INFO:tasks.workunit.client.0.smithi088.stdout:5/612: write d2/d31/d33/d20/d47/fc4 [1013531,119100] 0 2024-09-17T04:21:15.405 INFO:tasks.workunit.client.0.smithi088.stdout:8/638: dread d7/d29/f94 [0,4194304] 0 2024-09-17T04:21:15.407 INFO:tasks.workunit.client.0.smithi088.stdout:1/623: write d0/d1/d16/dae/db8/fc0 [558663,85336] 0 2024-09-17T04:21:15.407 INFO:tasks.workunit.client.0.smithi088.stdout:5/613: write d2/d31/d33/d20/d8b/fab [411882,41577] 0 2024-09-17T04:21:15.411 INFO:tasks.workunit.client.0.smithi088.stdout:2/675: rename d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/f78 to d0/d1/d2d/d33/d4b/d24/d3b/fcd 0 2024-09-17T04:21:15.413 INFO:tasks.workunit.client.0.smithi088.stdout:7/673: sync 2024-09-17T04:21:15.413 INFO:tasks.workunit.client.0.smithi088.stdout:8/639: mknod d7/d29/d2a/cd3 0 2024-09-17T04:21:15.421 INFO:tasks.workunit.client.0.smithi088.stdout:3/694: dwrite d0/d13/d58/d5e/f97 [0,4194304] 0 2024-09-17T04:21:15.422 INFO:tasks.workunit.client.0.smithi088.stdout:2/676: dread d0/d1/d2d/f3a [0,4194304] 0 2024-09-17T04:21:15.425 INFO:tasks.workunit.client.0.smithi088.stdout:5/614: dread d2/f90 [4194304,4194304] 0 2024-09-17T04:21:15.425 INFO:tasks.workunit.client.0.smithi088.stdout:5/615: fdatasync d2/f40 0 2024-09-17T04:21:15.431 INFO:tasks.workunit.client.0.smithi088.stdout:2/677: dread d0/d1/d2d/fa1 [0,4194304] 0 2024-09-17T04:21:15.435 INFO:tasks.workunit.client.0.smithi088.stdout:5/616: dwrite d2/d31/d33/d20/d25/d2c/f52 [0,4194304] 0 2024-09-17T04:21:15.435 INFO:tasks.workunit.client.0.smithi088.stdout:2/678: write d0/d1/d2d/f3a [779799,73873] 0 2024-09-17T04:21:15.443 INFO:tasks.workunit.client.0.smithi088.stdout:5/617: dwrite d2/f40 [0,4194304] 0 2024-09-17T04:21:15.453 INFO:tasks.workunit.client.0.smithi088.stdout:5/618: dwrite d2/d31/d33/d20/d30/d51/d5e/d6b/fa0 [0,4194304] 0 2024-09-17T04:21:15.459 INFO:tasks.workunit.client.0.smithi088.stdout:5/619: dwrite d2/d31/d33/fb4 [0,4194304] 0 2024-09-17T04:21:15.474 INFO:tasks.workunit.client.0.smithi088.stdout:0/504: write db/d1b/d36/d4a/f35 [1024399,24366] 0 2024-09-17T04:21:15.475 INFO:tasks.workunit.client.0.smithi088.stdout:0/505: chown db/d1b/d36/d4a/l4b 255956 1 2024-09-17T04:21:15.490 INFO:tasks.workunit.client.0.smithi088.stdout:8/640: creat d7/dd/d31/d47/dc6/fd4 x:0 0 0 2024-09-17T04:21:15.497 INFO:tasks.workunit.client.0.smithi088.stdout:3/695: dread d0/d13/d4d/f6c [0,4194304] 0 2024-09-17T04:21:15.501 INFO:tasks.workunit.client.0.smithi088.stdout:2/679: rename d0/d1/d2d/d33/d4b/d24/d3b/d26/f4e to d0/d1/d2d/d33/d4b/d6d/d94/fce 0 2024-09-17T04:21:15.537 INFO:tasks.workunit.client.0.smithi088.stdout:8/641: dread d7/d29/d2a/f33 [0,4194304] 0 2024-09-17T04:21:15.539 INFO:tasks.workunit.client.0.smithi088.stdout:0/506: getdents db/d3c/d4f/d59/da4 0 2024-09-17T04:21:15.541 INFO:tasks.workunit.client.0.smithi088.stdout:7/674: rmdir d2/d1d/d2e/db0/d23/d45/d85/daa 0 2024-09-17T04:21:15.557 INFO:tasks.workunit.client.0.smithi088.stdout:7/675: dread d2/d1d/d2e/db0/f3b [4194304,4194304] 0 2024-09-17T04:21:15.558 INFO:tasks.workunit.client.0.smithi088.stdout:7/676: dread - d2/fb4 zero size 2024-09-17T04:21:15.574 INFO:tasks.workunit.client.0.smithi088.stdout:7/677: dread d2/d4/d7/f10 [0,4194304] 0 2024-09-17T04:21:15.626 INFO:tasks.workunit.client.0.smithi088.stdout:2/680: mknod d0/ccf 0 2024-09-17T04:21:15.626 INFO:tasks.workunit.client.0.smithi088.stdout:1/624: write d0/d1/d16/d77/f99 [593082,44030] 0 2024-09-17T04:21:15.629 INFO:tasks.workunit.client.0.smithi088.stdout:2/681: creat d0/d1/d2d/d33/d4b/d24/d89/fd0 x:0 0 0 2024-09-17T04:21:15.629 INFO:tasks.workunit.client.0.smithi088.stdout:1/625: read d0/f94 [3916438,105852] 0 2024-09-17T04:21:15.632 INFO:tasks.workunit.client.0.smithi088.stdout:2/682: mkdir d0/d13/dd1 0 2024-09-17T04:21:15.634 INFO:tasks.workunit.client.0.smithi088.stdout:1/626: read d0/d13/f47 [1321939,51673] 0 2024-09-17T04:21:15.636 INFO:tasks.workunit.client.0.smithi088.stdout:2/683: dread d0/d13/f97 [0,4194304] 0 2024-09-17T04:21:15.637 INFO:tasks.workunit.client.0.smithi088.stdout:1/627: creat d0/d1/df/d20/dbd/fca x:0 0 0 2024-09-17T04:21:15.639 INFO:tasks.workunit.client.0.smithi088.stdout:1/628: mkdir d0/d1/d16/d2a/da4/dcb 0 2024-09-17T04:21:15.641 INFO:tasks.workunit.client.0.smithi088.stdout:3/696: creat d0/d13/d1b/fe2 x:0 0 0 2024-09-17T04:21:15.653 INFO:tasks.workunit.client.0.smithi088.stdout:4/610: sync 2024-09-17T04:21:15.653 INFO:tasks.workunit.client.0.smithi088.stdout:9/768: sync 2024-09-17T04:21:15.653 INFO:tasks.workunit.client.0.smithi088.stdout:6/660: sync 2024-09-17T04:21:15.655 INFO:tasks.workunit.client.0.smithi088.stdout:6/661: dread d14/d44/dad/fcb [0,4194304] 0 2024-09-17T04:21:15.656 INFO:tasks.workunit.client.0.smithi088.stdout:6/662: chown d14/d44/d94/fd8 10215 1 2024-09-17T04:21:15.721 INFO:tasks.workunit.client.0.smithi088.stdout:9/769: dread d2/dd/d14/d8b/d35/f6c [0,4194304] 0 2024-09-17T04:21:15.724 INFO:tasks.workunit.client.0.smithi088.stdout:4/611: rename d5/d32/f67 to d5/d3f/d71/d99/fca 0 2024-09-17T04:21:15.749 INFO:tasks.workunit.client.0.smithi088.stdout:4/612: rmdir d5/d3f/d71/d8b/d68/dab 39 2024-09-17T04:21:15.750 INFO:tasks.workunit.client.0.smithi088.stdout:4/613: fsync d5/f1f 0 2024-09-17T04:21:15.751 INFO:tasks.workunit.client.0.smithi088.stdout:6/663: symlink d14/le2 0 2024-09-17T04:21:15.754 INFO:tasks.workunit.client.0.smithi088.stdout:3/697: creat d0/d13/d1b/d29/d2b/fe3 x:0 0 0 2024-09-17T04:21:15.756 INFO:tasks.workunit.client.0.smithi088.stdout:6/664: fdatasync d14/d44/d45/d6b/d29/d3e/f37 0 2024-09-17T04:21:15.757 INFO:tasks.workunit.client.0.smithi088.stdout:6/665: dread - d14/d44/d94/fd8 zero size 2024-09-17T04:21:15.757 INFO:tasks.workunit.client.0.smithi088.stdout:6/666: stat d14/d44/d45/d6b/d29/f2d 0 2024-09-17T04:21:15.761 INFO:tasks.workunit.client.0.smithi088.stdout:3/698: creat d0/d13/d58/fe4 x:0 0 0 2024-09-17T04:21:15.762 INFO:tasks.workunit.client.0.smithi088.stdout:6/667: creat d14/d44/d94/db9/dc8/fe3 x:0 0 0 2024-09-17T04:21:15.762 INFO:tasks.workunit.client.0.smithi088.stdout:3/699: chown d0/d13/d1b/d29/d30/d35/f3d 3261319 1 2024-09-17T04:21:15.764 INFO:tasks.workunit.client.0.smithi088.stdout:3/700: write d0/d13/d4d/f6c [2427514,65124] 0 2024-09-17T04:21:15.765 INFO:tasks.workunit.client.0.smithi088.stdout:6/668: mkdir d14/d44/d45/d6b/d29/d5e/de4 0 2024-09-17T04:21:15.770 INFO:tasks.workunit.client.0.smithi088.stdout:6/669: rename d14/d2f/f67 to d14/d3a/fe5 0 2024-09-17T04:21:15.772 INFO:tasks.workunit.client.0.smithi088.stdout:6/670: mkdir d14/d2f/de6 0 2024-09-17T04:21:15.777 INFO:tasks.workunit.client.0.smithi088.stdout:1/629: rmdir d0/d1/d16/d35 39 2024-09-17T04:21:15.782 INFO:tasks.workunit.client.0.smithi088.stdout:8/642: creat d7/dd/d31/d47/d55/d57/fd5 x:0 0 0 2024-09-17T04:21:15.783 INFO:tasks.workunit.client.0.smithi088.stdout:5/620: creat d2/d31/d33/d20/d30/d51/fc8 x:0 0 0 2024-09-17T04:21:15.783 INFO:tasks.workunit.client.0.smithi088.stdout:8/643: stat d7/d29/d2a/d38/d3d/da0/da8/fb8 0 2024-09-17T04:21:15.787 INFO:tasks.workunit.client.0.smithi088.stdout:8/644: rename d7/d29/d2a/c8c to d7/d29/d2a/d3a/cd6 0 2024-09-17T04:21:15.788 INFO:tasks.workunit.client.0.smithi088.stdout:5/621: dread d2/d31/d33/d20/f23 [0,4194304] 0 2024-09-17T04:21:15.790 INFO:tasks.workunit.client.0.smithi088.stdout:5/622: fdatasync d2/d31/d33/d20/d30/d51/d5e/d6b/f7d 0 2024-09-17T04:21:15.791 INFO:tasks.workunit.client.0.smithi088.stdout:8/645: rmdir d7/dd/d31/d47/d55/d57/d6b 39 2024-09-17T04:21:15.792 INFO:tasks.workunit.client.0.smithi088.stdout:8/646: write d7/d29/f12 [10027222,67459] 0 2024-09-17T04:21:15.793 INFO:tasks.workunit.client.0.smithi088.stdout:5/623: mknod d2/d31/d33/d20/d25/d2c/cc9 0 2024-09-17T04:21:15.794 INFO:tasks.workunit.client.0.smithi088.stdout:8/647: chown d7/d29/d2a/d38/d42/cc1 677 1 2024-09-17T04:21:15.794 INFO:tasks.workunit.client.0.smithi088.stdout:5/624: fdatasync d2/d31/d33/d20/d47/f98 0 2024-09-17T04:21:15.794 INFO:tasks.workunit.client.0.smithi088.stdout:8/648: readlink d7/d29/daa/lbe 0 2024-09-17T04:21:15.796 INFO:tasks.workunit.client.0.smithi088.stdout:5/625: dread - d2/d31/d33/d20/d30/d51/d5e/f78 zero size 2024-09-17T04:21:15.797 INFO:tasks.workunit.client.0.smithi088.stdout:0/507: write db/d1b/f2b [619809,91804] 0 2024-09-17T04:21:15.800 INFO:tasks.workunit.client.0.smithi088.stdout:8/649: rename d7/dd/f82 to d7/dd/d31/fd7 0 2024-09-17T04:21:15.801 INFO:tasks.workunit.client.0.smithi088.stdout:7/678: dwrite d2/d1d/d2e/db0/f24 [0,4194304] 0 2024-09-17T04:21:15.801 INFO:tasks.workunit.client.0.smithi088.stdout:5/626: mknod d2/da9/db8/cca 0 2024-09-17T04:21:15.803 INFO:tasks.workunit.client.0.smithi088.stdout:0/508: mknod db/d3c/d4f/cb1 0 2024-09-17T04:21:15.803 INFO:tasks.workunit.client.0.smithi088.stdout:7/679: stat d2/d79/c95 0 2024-09-17T04:21:15.803 INFO:tasks.workunit.client.0.smithi088.stdout:7/680: fdatasync d2/fb4 0 2024-09-17T04:21:15.804 INFO:tasks.workunit.client.0.smithi088.stdout:5/627: rmdir d2/d31/d33/d20/d8b 39 2024-09-17T04:21:15.807 INFO:tasks.workunit.client.0.smithi088.stdout:7/681: mkdir d2/d4/d7/d46/da3/dd1 0 2024-09-17T04:21:15.807 INFO:tasks.workunit.client.0.smithi088.stdout:0/509: mkdir db/db2 0 2024-09-17T04:21:15.808 INFO:tasks.workunit.client.0.smithi088.stdout:5/628: creat d2/d31/d33/d20/d25/d2c/d3d/da5/fcb x:0 0 0 2024-09-17T04:21:15.813 INFO:tasks.workunit.client.0.smithi088.stdout:7/682: read d2/d4/f69 [1750286,6868] 0 2024-09-17T04:21:15.814 INFO:tasks.workunit.client.0.smithi088.stdout:5/629: creat d2/d31/d33/d20/d30/d9f/da4/dbe/fcc x:0 0 0 2024-09-17T04:21:15.814 INFO:tasks.workunit.client.0.smithi088.stdout:0/510: dwrite db/f19 [4194304,4194304] 0 2024-09-17T04:21:15.818 INFO:tasks.workunit.client.0.smithi088.stdout:7/683: write d2/d96/dc2/fce [1037615,100060] 0 2024-09-17T04:21:15.818 INFO:tasks.workunit.client.0.smithi088.stdout:5/630: creat d2/d31/d33/d20/d30/fcd x:0 0 0 2024-09-17T04:21:15.819 INFO:tasks.workunit.client.0.smithi088.stdout:0/511: creat db/d3c/d4f/d66/fb3 x:0 0 0 2024-09-17T04:21:15.821 INFO:tasks.workunit.client.0.smithi088.stdout:9/770: write d2/d2b/d2e/ff4 [865291,26920] 0 2024-09-17T04:21:15.821 INFO:tasks.workunit.client.0.smithi088.stdout:5/631: rmdir d2/d31/d33/d20/d47 39 2024-09-17T04:21:15.823 INFO:tasks.workunit.client.0.smithi088.stdout:0/512: write db/d3c/d4f/d66/f88 [137322,3505] 0 2024-09-17T04:21:15.825 INFO:tasks.workunit.client.0.smithi088.stdout:8/650: dread d7/d7f/f8b [0,4194304] 0 2024-09-17T04:21:15.829 INFO:tasks.workunit.client.0.smithi088.stdout:1/630: write d0/d1/df/f3e [757472,18944] 0 2024-09-17T04:21:15.830 INFO:tasks.workunit.client.0.smithi088.stdout:7/684: dwrite d2/d1d/d2e/db0/f24 [0,4194304] 0 2024-09-17T04:21:15.830 INFO:tasks.workunit.client.0.smithi088.stdout:0/513: truncate db/d3c/d4f/d66/fb3 753044 0 2024-09-17T04:21:15.836 INFO:tasks.workunit.client.0.smithi088.stdout:0/514: dread - db/d1b/d39/f80 zero size 2024-09-17T04:21:15.839 INFO:tasks.workunit.client.0.smithi088.stdout:1/631: symlink d0/d1/df/d85/lcc 0 2024-09-17T04:21:15.840 INFO:tasks.workunit.client.0.smithi088.stdout:5/632: dwrite d2/d31/d33/d20/fb1 [0,4194304] 0 2024-09-17T04:21:15.842 INFO:tasks.workunit.client.0.smithi088.stdout:0/515: fsync db/d1b/d39/f3d 0 2024-09-17T04:21:15.844 INFO:tasks.workunit.client.0.smithi088.stdout:6/671: dwrite d14/d3a/d41/f69 [0,4194304] 0 2024-09-17T04:21:15.848 INFO:tasks.workunit.client.0.smithi088.stdout:9/771: dread d2/d2b/d58/f5b [0,4194304] 0 2024-09-17T04:21:15.852 INFO:tasks.workunit.client.0.smithi088.stdout:5/633: dread d2/d31/d33/d20/d25/d2c/f52 [0,4194304] 0 2024-09-17T04:21:15.854 INFO:tasks.workunit.client.0.smithi088.stdout:7/685: rename d2/d1d/d2e/db0/d23/d45/d85/ca7 to d2/d4/d7/d46/da3/dd1/cd2 0 2024-09-17T04:21:15.862 INFO:tasks.workunit.client.0.smithi088.stdout:8/651: dread d7/dd/d31/d47/d55/d57/f71 [0,4194304] 0 2024-09-17T04:21:15.864 INFO:tasks.workunit.client.0.smithi088.stdout:8/652: read d7/d29/d2a/d38/d3d/d63/f77 [34289,73248] 0 2024-09-17T04:21:15.926 INFO:tasks.workunit.client.0.smithi088.stdout:0/516: dwrite db/d1b/d36/d4a/d6a/f56 [0,4194304] 0 2024-09-17T04:21:15.926 INFO:tasks.workunit.client.0.smithi088.stdout:9/772: creat d2/db8/f108 x:0 0 0 2024-09-17T04:21:15.928 INFO:tasks.workunit.client.0.smithi088.stdout:9/773: read d2/dd/f15 [2372749,14447] 0 2024-09-17T04:21:15.931 INFO:tasks.workunit.client.0.smithi088.stdout:7/686: truncate d2/d4/d7/f7b 411043 0 2024-09-17T04:21:15.933 INFO:tasks.workunit.client.0.smithi088.stdout:8/653: rename d7/d29/c1b to d7/d29/d2a/d38/d3d/d63/db2/cd8 0 2024-09-17T04:21:15.935 INFO:tasks.workunit.client.0.smithi088.stdout:1/632: write d0/d1/df/d63/f76 [173297,109789] 0 2024-09-17T04:21:15.939 INFO:tasks.workunit.client.0.smithi088.stdout:0/517: mknod db/d3c/d4f/d66/cb4 0 2024-09-17T04:21:15.941 INFO:tasks.workunit.client.0.smithi088.stdout:9/774: creat d2/dd/d14/d2a/d76/f109 x:0 0 0 2024-09-17T04:21:15.944 INFO:tasks.workunit.client.0.smithi088.stdout:8/654: truncate f6 2851326 0 2024-09-17T04:21:15.945 INFO:tasks.workunit.client.0.smithi088.stdout:6/672: link d14/d44/d45/d6b/fbf d14/d44/d45/d6b/fe7 0 2024-09-17T04:21:15.948 INFO:tasks.workunit.client.0.smithi088.stdout:0/518: rmdir db/d1b/d36/d47 39 2024-09-17T04:21:15.949 INFO:tasks.workunit.client.0.smithi088.stdout:5/634: link d2/d31/f36 d2/d31/d33/d20/d30/d51/d5e/d6b/db5/fce 0 2024-09-17T04:21:15.951 INFO:tasks.workunit.client.0.smithi088.stdout:7/687: mknod d2/d8d/cd3 0 2024-09-17T04:21:15.954 INFO:tasks.workunit.client.0.smithi088.stdout:1/633: dread d0/d13/f47 [0,4194304] 0 2024-09-17T04:21:15.955 INFO:tasks.workunit.client.0.smithi088.stdout:8/655: chown d7/dd/c5f 852 1 2024-09-17T04:21:15.955 INFO:tasks.workunit.client.0.smithi088.stdout:6/673: dread - d14/d44/d45/fbe zero size 2024-09-17T04:21:15.962 INFO:tasks.workunit.client.0.smithi088.stdout:9/775: dread d2/d2b/d2e/dbb/d104/d72/d74/fe6 [0,4194304] 0 2024-09-17T04:21:15.963 INFO:tasks.workunit.client.0.smithi088.stdout:9/776: truncate d2/dd/d14/d8b/d43/fdb 38877 0 2024-09-17T04:21:15.967 INFO:tasks.workunit.client.0.smithi088.stdout:1/634: mkdir d0/d13/d84/dcd 0 2024-09-17T04:21:15.969 INFO:tasks.workunit.client.0.smithi088.stdout:5/635: symlink d2/d31/d33/d20/d25/d2c/d8a/db2/dc3/lcf 0 2024-09-17T04:21:15.973 INFO:tasks.workunit.client.0.smithi088.stdout:1/635: dread - d0/d1/d16/d2a/f53 zero size 2024-09-17T04:21:15.974 INFO:tasks.workunit.client.0.smithi088.stdout:0/519: creat db/d1b/d36/fb5 x:0 0 0 2024-09-17T04:21:15.975 INFO:tasks.workunit.client.0.smithi088.stdout:7/688: dwrite d2/d4/d7/f5f [0,4194304] 0 2024-09-17T04:21:15.976 INFO:tasks.workunit.client.0.smithi088.stdout:5/636: symlink d2/d31/d33/d20/d25/d2c/d8a/db2/ld0 0 2024-09-17T04:21:15.979 INFO:tasks.workunit.client.0.smithi088.stdout:7/689: write d2/d4/f14 [2998478,100843] 0 2024-09-17T04:21:15.982 INFO:tasks.workunit.client.0.smithi088.stdout:1/636: read d0/d1/d16/d2a/f79 [1931667,120113] 0 2024-09-17T04:21:15.986 INFO:tasks.workunit.client.0.smithi088.stdout:0/520: dwrite db/f10 [0,4194304] 0 2024-09-17T04:21:15.987 INFO:tasks.workunit.client.0.smithi088.stdout:8/656: creat d7/d29/d2a/d38/d3d/d63/d97/fd9 x:0 0 0 2024-09-17T04:21:15.990 INFO:tasks.workunit.client.0.smithi088.stdout:8/657: write d7/d29/d2a/d38/d3d/da0/da8/fb8 [636605,60767] 0 2024-09-17T04:21:15.992 INFO:tasks.workunit.client.0.smithi088.stdout:5/637: dwrite d2/d31/d33/d20/d25/d2c/d8a/fc2 [0,4194304] 0 2024-09-17T04:21:15.994 INFO:tasks.workunit.client.0.smithi088.stdout:1/637: symlink d0/d1/d16/d2a/d9c/lce 0 2024-09-17T04:21:15.994 INFO:tasks.workunit.client.0.smithi088.stdout:0/521: dread db/f9d [0,4194304] 0 2024-09-17T04:21:15.998 INFO:tasks.workunit.client.0.smithi088.stdout:9/777: dread d2/d16/f3f [0,4194304] 0 2024-09-17T04:21:15.998 INFO:tasks.workunit.client.0.smithi088.stdout:0/522: stat db/f13 0 2024-09-17T04:21:15.999 INFO:tasks.workunit.client.0.smithi088.stdout:8/658: creat d7/dd/d6f/fda x:0 0 0 2024-09-17T04:21:16.003 INFO:tasks.workunit.client.0.smithi088.stdout:5/638: symlink d2/d31/d33/d20/d25/d2c/d8a/db2/ld1 0 2024-09-17T04:21:16.005 INFO:tasks.workunit.client.0.smithi088.stdout:5/639: readlink d2/d31/d33/d20/d47/l73 0 2024-09-17T04:21:16.006 INFO:tasks.workunit.client.0.smithi088.stdout:8/659: mkdir d7/dd/d31/d47/d55/d57/d6b/ddb 0 2024-09-17T04:21:16.008 INFO:tasks.workunit.client.0.smithi088.stdout:8/660: chown d7/d7f 1937654 1 2024-09-17T04:21:16.008 INFO:tasks.workunit.client.0.smithi088.stdout:9/778: creat d2/d16/df7/f10a x:0 0 0 2024-09-17T04:21:16.008 INFO:tasks.workunit.client.0.smithi088.stdout:9/779: fsync d2/d2b/d58/d82/f83 0 2024-09-17T04:21:16.009 INFO:tasks.workunit.client.0.smithi088.stdout:9/780: write d2/dd/d11/d30/d49/f9f [1118093,56061] 0 2024-09-17T04:21:16.009 INFO:tasks.workunit.client.0.smithi088.stdout:0/523: creat db/d1b/d36/d4a/fb6 x:0 0 0 2024-09-17T04:21:16.014 INFO:tasks.workunit.client.0.smithi088.stdout:0/524: symlink db/d3c/d4f/d9f/lb7 0 2024-09-17T04:21:16.014 INFO:tasks.workunit.client.0.smithi088.stdout:5/640: dread d2/d31/d33/d20/d25/d49/f60 [0,4194304] 0 2024-09-17T04:21:16.015 INFO:tasks.workunit.client.0.smithi088.stdout:8/661: dread d7/dd/d31/fd7 [0,4194304] 0 2024-09-17T04:21:16.018 INFO:tasks.workunit.client.0.smithi088.stdout:9/781: mknod d2/dd/d11/d30/d107/c10b 0 2024-09-17T04:21:16.018 INFO:tasks.workunit.client.0.smithi088.stdout:5/641: fdatasync d2/d31/d33/d20/d30/fcd 0 2024-09-17T04:21:16.021 INFO:tasks.workunit.client.0.smithi088.stdout:5/642: readlink d2/d31/d33/l2d 0 2024-09-17T04:21:16.022 INFO:tasks.workunit.client.0.smithi088.stdout:9/782: chown d2/dd/d14/d2a/d76/d98 62 1 2024-09-17T04:21:16.023 INFO:tasks.workunit.client.0.smithi088.stdout:7/690: dwrite d2/d4/d7/d46/da3/fc0 [0,4194304] 0 2024-09-17T04:21:16.024 INFO:tasks.workunit.client.0.smithi088.stdout:0/525: rename db/d3c/d4f/d59/l7e to db/d1b/d36/d47/lb8 0 2024-09-17T04:21:16.028 INFO:tasks.workunit.client.0.smithi088.stdout:7/691: stat d2/d4/d7/l5b 0 2024-09-17T04:21:16.028 INFO:tasks.workunit.client.0.smithi088.stdout:5/643: chown d2/d31/d33/d20/d25/d2c/d3d/da5/lc1 518727 1 2024-09-17T04:21:16.028 INFO:tasks.workunit.client.0.smithi088.stdout:1/638: dwrite d0/d1/df/d20/f2e [4194304,4194304] 0 2024-09-17T04:21:16.029 INFO:tasks.workunit.client.0.smithi088.stdout:7/692: stat d2/d1d/f6a 0 2024-09-17T04:21:16.033 INFO:tasks.workunit.client.0.smithi088.stdout:5/644: truncate d2/d31/faa 282641 0 2024-09-17T04:21:16.038 INFO:tasks.workunit.client.0.smithi088.stdout:9/783: dwrite d2/dd/d14/d8b/ffd [0,4194304] 0 2024-09-17T04:21:16.042 INFO:tasks.workunit.client.0.smithi088.stdout:7/693: unlink d2/d1d/c55 0 2024-09-17T04:21:16.043 INFO:tasks.workunit.client.0.smithi088.stdout:1/639: dwrite d0/d13/d84/fac [0,4194304] 0 2024-09-17T04:21:16.048 INFO:tasks.workunit.client.0.smithi088.stdout:5/645: creat d2/d31/d33/d20/d25/d2c/d3d/da5/fd2 x:0 0 0 2024-09-17T04:21:16.053 INFO:tasks.workunit.client.0.smithi088.stdout:8/662: write d7/d29/d2a/d38/f44 [543738,98151] 0 2024-09-17T04:21:16.054 INFO:tasks.workunit.client.0.smithi088.stdout:0/526: rmdir db/d1b/d39/d83/d96 0 2024-09-17T04:21:16.056 INFO:tasks.workunit.client.0.smithi088.stdout:5/646: rename d2/d31/d33/d20/d30/d51/d5e/d6b/cac to d2/d31/d33/d20/d25/d2c/d8a/db2/cd3 0 2024-09-17T04:21:16.058 INFO:tasks.workunit.client.0.smithi088.stdout:8/663: fdatasync d7/d29/d7e/fc0 0 2024-09-17T04:21:16.059 INFO:tasks.workunit.client.0.smithi088.stdout:0/527: mkdir db/d1b/d36/d47/db9 0 2024-09-17T04:21:16.061 INFO:tasks.workunit.client.0.smithi088.stdout:7/694: link d2/d96/ca6 d2/d1d/d2e/db0/d23/d45/d62/d82/cd4 0 2024-09-17T04:21:16.061 INFO:tasks.workunit.client.0.smithi088.stdout:7/695: stat d2/d4/d7/f5f 0 2024-09-17T04:21:16.064 INFO:tasks.workunit.client.0.smithi088.stdout:8/664: symlink d7/dd/d62/ldc 0 2024-09-17T04:21:16.065 INFO:tasks.workunit.client.0.smithi088.stdout:8/665: chown d7/dd/ca6 0 1 2024-09-17T04:21:16.066 INFO:tasks.workunit.client.0.smithi088.stdout:7/696: dread - d2/d4/d7/d46/d67/f75 zero size 2024-09-17T04:21:16.070 INFO:tasks.workunit.client.0.smithi088.stdout:5/647: getdents d2/d31/d33/d20 0 2024-09-17T04:21:16.073 INFO:tasks.workunit.client.0.smithi088.stdout:1/640: dread d0/d1/df/d20/f49 [0,4194304] 0 2024-09-17T04:21:16.074 INFO:tasks.workunit.client.0.smithi088.stdout:5/648: readlink d2/d31/d33/d20/d25/l43 0 2024-09-17T04:21:16.074 INFO:tasks.workunit.client.0.smithi088.stdout:8/666: creat d7/fdd x:0 0 0 2024-09-17T04:21:16.076 INFO:tasks.workunit.client.0.smithi088.stdout:1/641: mknod d0/d1/df/d85/ccf 0 2024-09-17T04:21:16.079 INFO:tasks.workunit.client.0.smithi088.stdout:1/642: mknod d0/d1/d16/d77/d9e/cd0 0 2024-09-17T04:21:16.080 INFO:tasks.workunit.client.0.smithi088.stdout:7/697: dread d2/f6 [0,4194304] 0 2024-09-17T04:21:16.081 INFO:tasks.workunit.client.0.smithi088.stdout:7/698: fsync d2/d96/fac 0 2024-09-17T04:21:16.082 INFO:tasks.workunit.client.0.smithi088.stdout:2/684: sync 2024-09-17T04:21:16.085 INFO:tasks.workunit.client.0.smithi088.stdout:2/685: fsync d0/d1/f2 0 2024-09-17T04:21:16.086 INFO:tasks.workunit.client.0.smithi088.stdout:7/699: symlink d2/d1d/d2e/db0/d23/d97/ld5 0 2024-09-17T04:21:16.088 INFO:tasks.workunit.client.0.smithi088.stdout:1/643: dwrite d0/d13/d84/fac [0,4194304] 0 2024-09-17T04:21:16.089 INFO:tasks.workunit.client.0.smithi088.stdout:7/700: write d2/d96/dc2/fce [1821856,120587] 0 2024-09-17T04:21:16.095 INFO:tasks.workunit.client.0.smithi088.stdout:8/667: dread d7/d29/f12 [8388608,4194304] 0 2024-09-17T04:21:16.095 INFO:tasks.workunit.client.0.smithi088.stdout:2/686: rename d0/d13/f16 to d0/d1/d2d/d33/d4b/d6d/d94/fd2 0 2024-09-17T04:21:16.098 INFO:tasks.workunit.client.0.smithi088.stdout:7/701: mkdir d2/d4/d7/d46/d67/dd6 0 2024-09-17T04:21:16.102 INFO:tasks.workunit.client.0.smithi088.stdout:2/687: unlink d0/d1/d2d/d33/d4b/d24/d3b/d26/c60 0 2024-09-17T04:21:16.108 INFO:tasks.workunit.client.0.smithi088.stdout:2/688: creat d0/d1/d2d/fd3 x:0 0 0 2024-09-17T04:21:16.114 INFO:tasks.workunit.client.0.smithi088.stdout:7/702: rename d2/d1d/d2e/db0/d23/fa5 to d2/d1d/d2e/db0/fd7 0 2024-09-17T04:21:16.115 INFO:tasks.workunit.client.0.smithi088.stdout:7/703: fdatasync d2/d4/d7/d20/f3a 0 2024-09-17T04:21:16.116 INFO:tasks.workunit.client.0.smithi088.stdout:7/704: fdatasync d2/d1d/fd0 0 2024-09-17T04:21:16.229 INFO:tasks.workunit.client.0.smithi088.stdout:8/668: write d7/dd/d31/fd7 [1446297,78571] 0 2024-09-17T04:21:16.240 INFO:tasks.workunit.client.0.smithi088.stdout:1/644: dwrite d0/d1/d16/d35/f69 [0,4194304] 0 2024-09-17T04:21:16.250 INFO:tasks.workunit.client.0.smithi088.stdout:2/689: dwrite d0/fd [0,4194304] 0 2024-09-17T04:21:16.252 INFO:tasks.workunit.client.0.smithi088.stdout:2/690: write d0/d1/f93 [1967029,27802] 0 2024-09-17T04:21:16.253 INFO:tasks.workunit.client.0.smithi088.stdout:7/705: truncate d2/d4/d7/f9f 209386 0 2024-09-17T04:21:16.260 INFO:tasks.workunit.client.0.smithi088.stdout:2/691: mknod d0/d1/d2d/d33/d4b/d24/d3b/d22/dba/cd4 0 2024-09-17T04:21:16.262 INFO:tasks.workunit.client.0.smithi088.stdout:7/706: fsync d2/d1d/d2e/db0/f80 0 2024-09-17T04:21:16.264 INFO:tasks.workunit.client.0.smithi088.stdout:2/692: mkdir d0/d1/dc5/dd5 0 2024-09-17T04:21:16.267 INFO:tasks.workunit.client.0.smithi088.stdout:2/693: creat d0/d1/d2d/fd6 x:0 0 0 2024-09-17T04:21:16.269 INFO:tasks.workunit.client.0.smithi088.stdout:8/669: write d7/f9 [1089451,5763] 0 2024-09-17T04:21:16.269 INFO:tasks.workunit.client.0.smithi088.stdout:6/674: sync 2024-09-17T04:21:16.269 INFO:tasks.workunit.client.0.smithi088.stdout:4/614: sync 2024-09-17T04:21:16.269 INFO:tasks.workunit.client.0.smithi088.stdout:3/701: sync 2024-09-17T04:21:16.270 INFO:tasks.workunit.client.0.smithi088.stdout:1/645: write d0/d1/fa [6460679,102659] 0 2024-09-17T04:21:16.272 INFO:tasks.workunit.client.0.smithi088.stdout:3/702: fsync d0/d13/d1b/d29/d30/d3c/fa4 0 2024-09-17T04:21:16.273 INFO:tasks.workunit.client.0.smithi088.stdout:1/646: chown d0/d1/d16/d2a/f53 197082171 1 2024-09-17T04:21:16.273 INFO:tasks.workunit.client.0.smithi088.stdout:6/675: write d14/d3a/fe5 [153187,119034] 0 2024-09-17T04:21:16.276 INFO:tasks.workunit.client.0.smithi088.stdout:3/703: truncate d0/f12 3992164 0 2024-09-17T04:21:16.278 INFO:tasks.workunit.client.0.smithi088.stdout:2/694: read d0/d1/d2d/d33/d4b/d24/d3b/d22/f64 [1880457,51121] 0 2024-09-17T04:21:16.281 INFO:tasks.workunit.client.0.smithi088.stdout:6/676: creat d14/d44/d94/db9/fe8 x:0 0 0 2024-09-17T04:21:16.284 INFO:tasks.workunit.client.0.smithi088.stdout:3/704: read d0/d13/f25 [1505774,80637] 0 2024-09-17T04:21:16.285 INFO:tasks.workunit.client.0.smithi088.stdout:6/677: readlink d14/l28 0 2024-09-17T04:21:16.285 INFO:tasks.workunit.client.0.smithi088.stdout:8/670: getdents d7/dd/d31/d47/d55 0 2024-09-17T04:21:16.285 INFO:tasks.workunit.client.0.smithi088.stdout:1/647: dwrite d0/d1/d16/d35/f69 [0,4194304] 0 2024-09-17T04:21:16.288 INFO:tasks.workunit.client.0.smithi088.stdout:3/705: readlink d0/ld8 0 2024-09-17T04:21:16.288 INFO:tasks.workunit.client.0.smithi088.stdout:2/695: write d0/d1/d2d/d33/d4b/d24/d92/f9c [331228,74715] 0 2024-09-17T04:21:16.292 INFO:tasks.workunit.client.0.smithi088.stdout:8/671: readlink d7/d29/d2a/d38/daf/lc8 0 2024-09-17T04:21:16.292 INFO:tasks.workunit.client.0.smithi088.stdout:6/678: creat d14/d44/d45/d6b/d2a/d52/fe9 x:0 0 0 2024-09-17T04:21:16.293 INFO:tasks.workunit.client.0.smithi088.stdout:1/648: unlink d0/d1/d16/d35/f8b 0 2024-09-17T04:21:16.294 INFO:tasks.workunit.client.0.smithi088.stdout:1/649: chown d0/d1/df 1894 1 2024-09-17T04:21:16.296 INFO:tasks.workunit.client.0.smithi088.stdout:3/706: mkdir d0/dae/de5 0 2024-09-17T04:21:16.299 INFO:tasks.workunit.client.0.smithi088.stdout:4/615: dread d5/f4b [0,4194304] 0 2024-09-17T04:21:16.305 INFO:tasks.workunit.client.0.smithi088.stdout:8/672: mknod d7/dd/d31/dca/cde 0 2024-09-17T04:21:16.309 INFO:tasks.workunit.client.0.smithi088.stdout:3/707: creat d0/d13/d1b/d29/d30/d3c/fe6 x:0 0 0 2024-09-17T04:21:16.309 INFO:tasks.workunit.client.0.smithi088.stdout:7/707: dwrite d2/d4/d7/f9f [0,4194304] 0 2024-09-17T04:21:16.310 INFO:tasks.workunit.client.0.smithi088.stdout:3/708: fsync d0/d13/d58/d5a/d63/fbb 0 2024-09-17T04:21:16.316 INFO:tasks.workunit.client.0.smithi088.stdout:2/696: write d0/d1/d2d/d33/d4b/d24/f51 [3083506,104708] 0 2024-09-17T04:21:16.317 INFO:tasks.workunit.client.0.smithi088.stdout:6/679: write d14/d44/d45/d6b/d16/f74 [3112271,18552] 0 2024-09-17T04:21:16.317 INFO:tasks.workunit.client.0.smithi088.stdout:2/697: stat d0/d13/c49 0 2024-09-17T04:21:16.320 INFO:tasks.workunit.client.0.smithi088.stdout:8/673: rename d7/f87 to d7/dd/d31/d47/d55/fdf 0 2024-09-17T04:21:16.322 INFO:tasks.workunit.client.0.smithi088.stdout:4/616: dread d5/d3f/d71/d8b/d68/dab/fb2 [0,4194304] 0 2024-09-17T04:21:16.323 INFO:tasks.workunit.client.0.smithi088.stdout:7/708: mknod d2/d1d/d2e/db0/d23/d97/cd8 0 2024-09-17T04:21:16.324 INFO:tasks.workunit.client.0.smithi088.stdout:7/709: chown d2/lb5 7650 1 2024-09-17T04:21:16.324 INFO:tasks.workunit.client.0.smithi088.stdout:4/617: dread - d5/d3d/d73/fc4 zero size 2024-09-17T04:21:16.328 INFO:tasks.workunit.client.0.smithi088.stdout:3/709: dread d0/f33 [0,4194304] 0 2024-09-17T04:21:16.328 INFO:tasks.workunit.client.0.smithi088.stdout:1/650: dwrite d0/d13/f44 [0,4194304] 0 2024-09-17T04:21:16.329 INFO:tasks.workunit.client.0.smithi088.stdout:8/674: creat d7/d29/d2a/d3a/d79/fe0 x:0 0 0 2024-09-17T04:21:16.330 INFO:tasks.workunit.client.0.smithi088.stdout:8/675: chown d7/dd/d31/d47/d55 231539722 1 2024-09-17T04:21:16.337 INFO:tasks.workunit.client.0.smithi088.stdout:6/680: unlink d14/d44/d45/d4d/d97/fa2 0 2024-09-17T04:21:16.338 INFO:tasks.workunit.client.0.smithi088.stdout:6/681: dread - d14/d44/d45/d6b/d2a/d52/fe9 zero size 2024-09-17T04:21:16.338 INFO:tasks.workunit.client.0.smithi088.stdout:1/651: creat d0/d1/d16/d2a/fd1 x:0 0 0 2024-09-17T04:21:16.339 INFO:tasks.workunit.client.0.smithi088.stdout:6/682: chown d14/d3a/d41/f60 14551502 1 2024-09-17T04:21:16.340 INFO:tasks.workunit.client.0.smithi088.stdout:8/676: unlink d7/d29/d2a/d38/d3d/fab 0 2024-09-17T04:21:16.343 INFO:tasks.workunit.client.0.smithi088.stdout:2/698: rename d0/d1/d2d/d33/d80/c6b to d0/d1/d2d/d33/d4b/d24/d3b/d26/cd7 0 2024-09-17T04:21:16.346 INFO:tasks.workunit.client.0.smithi088.stdout:6/683: dwrite d14/d44/d45/d6b/d16/f51 [0,4194304] 0 2024-09-17T04:21:16.346 INFO:tasks.workunit.client.0.smithi088.stdout:7/710: write d2/d4/d7/fa [5296329,61526] 0 2024-09-17T04:21:16.349 INFO:tasks.workunit.client.0.smithi088.stdout:0/528: sync 2024-09-17T04:21:16.349 INFO:tasks.workunit.client.0.smithi088.stdout:9/784: sync 2024-09-17T04:21:16.351 INFO:tasks.workunit.client.0.smithi088.stdout:0/529: read db/f10 [739632,95822] 0 2024-09-17T04:21:16.352 INFO:tasks.workunit.client.0.smithi088.stdout:4/618: dwrite d5/d32/f79 [0,4194304] 0 2024-09-17T04:21:16.352 INFO:tasks.workunit.client.0.smithi088.stdout:1/652: creat d0/d13/d84/dcd/fd2 x:0 0 0 2024-09-17T04:21:16.356 INFO:tasks.workunit.client.0.smithi088.stdout:3/710: rename d0/d13/d58/d5e/c73 to d0/d13/d58/d5a/d63/d80/ce7 0 2024-09-17T04:21:16.360 INFO:tasks.workunit.client.0.smithi088.stdout:9/785: creat d2/d2b/d2e/f10c x:0 0 0 2024-09-17T04:21:16.362 INFO:tasks.workunit.client.0.smithi088.stdout:4/619: creat d5/d3d/d73/fcb x:0 0 0 2024-09-17T04:21:16.364 INFO:tasks.workunit.client.0.smithi088.stdout:0/530: dread - db/d3c/d4f/d59/f65 zero size 2024-09-17T04:21:16.364 INFO:tasks.workunit.client.0.smithi088.stdout:1/653: rmdir d0/d13/d84/d5d 39 2024-09-17T04:21:16.365 INFO:tasks.workunit.client.0.smithi088.stdout:2/699: dwrite d0/d1/d2d/d33/d80/f4c [4194304,4194304] 0 2024-09-17T04:21:16.367 INFO:tasks.workunit.client.0.smithi088.stdout:8/677: rename d7/d29/daa/lcf to d7/dd/d31/d47/d55/le1 0 2024-09-17T04:21:16.368 INFO:tasks.workunit.client.0.smithi088.stdout:8/678: stat d7/dd/d6f/cb1 0 2024-09-17T04:21:16.372 INFO:tasks.workunit.client.0.smithi088.stdout:7/711: creat d2/d1d/d2e/db0/fd9 x:0 0 0 2024-09-17T04:21:16.375 INFO:tasks.workunit.client.0.smithi088.stdout:2/700: symlink d0/d1/d2d/d33/d4b/d24/d3b/ld8 0 2024-09-17T04:21:16.375 INFO:tasks.workunit.client.0.smithi088.stdout:6/684: dread d14/d3a/fe5 [0,4194304] 0 2024-09-17T04:21:16.378 INFO:tasks.workunit.client.0.smithi088.stdout:1/654: rename d0/d1/d16/d2a/d9c/la8 to d0/d1/d16/d77/ld3 0 2024-09-17T04:21:16.379 INFO:tasks.workunit.client.0.smithi088.stdout:1/655: chown d0/d1/d16/dae/db8 2389624 1 2024-09-17T04:21:16.384 INFO:tasks.workunit.client.0.smithi088.stdout:9/786: creat d2/dd/d14/d8b/d35/da5/f10d x:0 0 0 2024-09-17T04:21:16.385 INFO:tasks.workunit.client.0.smithi088.stdout:2/701: mkdir d0/d1/d2d/d33/d4b/d24/d92/dd9 0 2024-09-17T04:21:16.389 INFO:tasks.workunit.client.0.smithi088.stdout:7/712: symlink d2/d4/d7/lda 0 2024-09-17T04:21:16.391 INFO:tasks.workunit.client.0.smithi088.stdout:9/787: symlink d2/dd/d14/d2a/d8f/d99/l10e 0 2024-09-17T04:21:16.394 INFO:tasks.workunit.client.0.smithi088.stdout:3/711: write d0/d13/d1b/d29/d2b/f47 [1184448,99076] 0 2024-09-17T04:21:16.395 INFO:tasks.workunit.client.0.smithi088.stdout:3/712: chown d0/d13/d1b/d29/d30/d35/f66 181890580 1 2024-09-17T04:21:16.396 INFO:tasks.workunit.client.0.smithi088.stdout:8/679: creat d7/dd/d31/d47/fe2 x:0 0 0 2024-09-17T04:21:16.399 INFO:tasks.workunit.client.0.smithi088.stdout:6/685: creat d14/fea x:0 0 0 2024-09-17T04:21:16.399 INFO:tasks.workunit.client.0.smithi088.stdout:7/713: unlink d2/d1d/d2e/db0/fd7 0 2024-09-17T04:21:16.403 INFO:tasks.workunit.client.0.smithi088.stdout:0/531: link db/d3c/d4f/d66/d82/c7f db/d1b/d36/d4a/d20/cba 0 2024-09-17T04:21:16.404 INFO:tasks.workunit.client.0.smithi088.stdout:0/532: fsync db/d3c/d4f/d66/fab 0 2024-09-17T04:21:16.405 INFO:tasks.workunit.client.0.smithi088.stdout:3/713: rmdir d0/d13/d1b/d29/d30/d35 39 2024-09-17T04:21:16.406 INFO:tasks.workunit.client.0.smithi088.stdout:0/533: truncate db/d3c/d4f/fa0 359929 0 2024-09-17T04:21:16.407 INFO:tasks.workunit.client.0.smithi088.stdout:8/680: creat d7/d29/d2a/d3a/fe3 x:0 0 0 2024-09-17T04:21:16.408 INFO:tasks.workunit.client.0.smithi088.stdout:6/686: unlink d14/d44/d45/d6b/f66 0 2024-09-17T04:21:16.411 INFO:tasks.workunit.client.0.smithi088.stdout:7/714: mknod d2/d4/d7/d46/d67/cdb 0 2024-09-17T04:21:16.411 INFO:tasks.workunit.client.0.smithi088.stdout:7/715: chown d2/d79/db3/fb8 406 1 2024-09-17T04:21:16.412 INFO:tasks.workunit.client.0.smithi088.stdout:1/656: getdents d0/d1/d16/d77 0 2024-09-17T04:21:16.414 INFO:tasks.workunit.client.0.smithi088.stdout:3/714: mkdir d0/d13/d58/dd7/de8 0 2024-09-17T04:21:16.416 INFO:tasks.workunit.client.0.smithi088.stdout:2/702: dwrite d0/d1/d2d/d33/d80/f19 [0,4194304] 0 2024-09-17T04:21:16.417 INFO:tasks.workunit.client.0.smithi088.stdout:8/681: creat d7/d29/d2a/d38/d3d/d63/d97/fe4 x:0 0 0 2024-09-17T04:21:16.418 INFO:tasks.workunit.client.0.smithi088.stdout:6/687: unlink d14/d44/d94/db9/fd5 0 2024-09-17T04:21:16.422 INFO:tasks.workunit.client.0.smithi088.stdout:9/788: rename d2/dd/d14/d8b/d43/fca to d2/d16/f10f 0 2024-09-17T04:21:16.423 INFO:tasks.workunit.client.0.smithi088.stdout:7/716: readlink d2/d4/l8 0 2024-09-17T04:21:16.424 INFO:tasks.workunit.client.0.smithi088.stdout:1/657: creat d0/d1/d16/d77/d9e/fd4 x:0 0 0 2024-09-17T04:21:16.424 INFO:tasks.workunit.client.0.smithi088.stdout:2/703: dread d0/d1/d2d/d33/d4b/d24/d3b/f1f [0,4194304] 0 2024-09-17T04:21:16.424 INFO:tasks.workunit.client.0.smithi088.stdout:8/682: dread d7/dd/d6f/fb9 [0,4194304] 0 2024-09-17T04:21:16.427 INFO:tasks.workunit.client.0.smithi088.stdout:2/704: truncate d0/d1/d2d/d33/d80/f40 2002429 0 2024-09-17T04:21:16.428 INFO:tasks.workunit.client.0.smithi088.stdout:2/705: fsync d0/d1/d2d/f84 0 2024-09-17T04:21:16.430 INFO:tasks.workunit.client.0.smithi088.stdout:0/534: creat db/fbb x:0 0 0 2024-09-17T04:21:16.431 INFO:tasks.workunit.client.0.smithi088.stdout:7/717: read d2/d4/d7/f34 [3386709,10493] 0 2024-09-17T04:21:16.432 INFO:tasks.workunit.client.0.smithi088.stdout:9/789: creat d2/dd/d14/d8b/d43/d51/f110 x:0 0 0 2024-09-17T04:21:16.433 INFO:tasks.workunit.client.0.smithi088.stdout:9/790: readlink d2/dd/d11/d30/d49/leb 0 2024-09-17T04:21:16.434 INFO:tasks.workunit.client.0.smithi088.stdout:1/658: rename d0/d1/df/d20/f62 to d0/d13/fd5 0 2024-09-17T04:21:16.441 INFO:tasks.workunit.client.0.smithi088.stdout:2/706: rmdir d0/d1/d2d/d33/d4b/d24/d3b/d22/dba 39 2024-09-17T04:21:16.441 INFO:tasks.workunit.client.0.smithi088.stdout:2/707: chown d0/d13/f97 17411954 1 2024-09-17T04:21:16.447 INFO:tasks.workunit.client.0.smithi088.stdout:7/718: mknod d2/d1d/d2e/db0/d23/d45/d85/cdc 0 2024-09-17T04:21:16.449 INFO:tasks.workunit.client.0.smithi088.stdout:3/715: truncate d0/d13/d1b/d29/d2b/fbc 434732 0 2024-09-17T04:21:16.449 INFO:tasks.workunit.client.0.smithi088.stdout:6/688: dwrite d14/d44/d45/d6b/f96 [0,4194304] 0 2024-09-17T04:21:16.450 INFO:tasks.workunit.client.0.smithi088.stdout:6/689: fsync d14/fea 0 2024-09-17T04:21:16.451 INFO:tasks.workunit.client.0.smithi088.stdout:1/659: mknod d0/d1/d16/d2a/cd6 0 2024-09-17T04:21:16.451 INFO:tasks.workunit.client.0.smithi088.stdout:6/690: write d14/d44/f8a [1908294,59828] 0 2024-09-17T04:21:16.453 INFO:tasks.workunit.client.0.smithi088.stdout:1/660: write d0/d1/d16/d77/f99 [1413319,119373] 0 2024-09-17T04:21:16.456 INFO:tasks.workunit.client.0.smithi088.stdout:0/535: write db/f10 [1771806,39119] 0 2024-09-17T04:21:16.460 INFO:tasks.workunit.client.0.smithi088.stdout:2/708: truncate d0/d1/d2d/d33/f52 1264989 0 2024-09-17T04:21:16.460 INFO:tasks.workunit.client.0.smithi088.stdout:9/791: write d2/dd/d11/d30/f101 [93852,77244] 0 2024-09-17T04:21:16.466 INFO:tasks.workunit.client.0.smithi088.stdout:3/716: rename d0/d13/d1b/d29/d30/f39 to d0/d13/d58/dd7/dd4/fe9 0 2024-09-17T04:21:16.466 INFO:tasks.workunit.client.0.smithi088.stdout:6/691: mknod d14/d2f/ceb 0 2024-09-17T04:21:16.467 INFO:tasks.workunit.client.0.smithi088.stdout:9/792: dread d2/dd/d11/d30/d49/f9f [0,4194304] 0 2024-09-17T04:21:16.468 INFO:tasks.workunit.client.0.smithi088.stdout:6/692: dread - d14/d44/d45/d6b/d2a/d52/fdc zero size 2024-09-17T04:21:16.468 INFO:tasks.workunit.client.0.smithi088.stdout:9/793: chown d2/dd/d14/d8b/d35/da5 123197 1 2024-09-17T04:21:16.470 INFO:tasks.workunit.client.0.smithi088.stdout:1/661: unlink d0/d1/df/d63/fa7 0 2024-09-17T04:21:16.470 INFO:tasks.workunit.client.0.smithi088.stdout:1/662: chown d0/d1/d27/c5a 94523606 1 2024-09-17T04:21:16.474 INFO:tasks.workunit.client.0.smithi088.stdout:7/719: mkdir d2/d8d/ddd 0 2024-09-17T04:21:16.477 INFO:tasks.workunit.client.0.smithi088.stdout:1/663: dwrite d0/d1/d16/dae/db8/fc0 [0,4194304] 0 2024-09-17T04:21:16.479 INFO:tasks.workunit.client.0.smithi088.stdout:9/794: rmdir d2/dd/d11/d30 39 2024-09-17T04:21:16.480 INFO:tasks.workunit.client.0.smithi088.stdout:8/683: getdents d7/d29/d2a/d38/d3d/da0/da8 0 2024-09-17T04:21:16.484 INFO:tasks.workunit.client.0.smithi088.stdout:6/693: rename d14/l17 to d14/d2f/d87/lec 0 2024-09-17T04:21:16.486 INFO:tasks.workunit.client.0.smithi088.stdout:1/664: fdatasync d0/f94 0 2024-09-17T04:21:16.491 INFO:tasks.workunit.client.0.smithi088.stdout:2/709: creat d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/fda x:0 0 0 2024-09-17T04:21:16.492 INFO:tasks.workunit.client.0.smithi088.stdout:6/694: dwrite d14/d44/d45/d6b/d29/dac/fb1 [0,4194304] 0 2024-09-17T04:21:16.494 INFO:tasks.workunit.client.0.smithi088.stdout:3/717: creat d0/d13/d1b/d29/fea x:0 0 0 2024-09-17T04:21:16.495 INFO:tasks.workunit.client.0.smithi088.stdout:2/710: dread - d0/d1/d2d/fb6 zero size 2024-09-17T04:21:16.496 INFO:tasks.workunit.client.0.smithi088.stdout:7/720: rename d2/d4/d7/d20/f22 to d2/d1d/d2e/db0/d23/d97/dbb/dcf/fde 0 2024-09-17T04:21:16.497 INFO:tasks.workunit.client.0.smithi088.stdout:9/795: dwrite d2/d16/df7/f10a [0,4194304] 0 2024-09-17T04:21:16.499 INFO:tasks.workunit.client.0.smithi088.stdout:9/796: dread - d2/d2b/d2e/dbb/d104/f103 zero size 2024-09-17T04:21:16.501 INFO:tasks.workunit.client.0.smithi088.stdout:1/665: fdatasync d0/d1/d16/d35/f50 0 2024-09-17T04:21:16.504 INFO:tasks.workunit.client.0.smithi088.stdout:0/536: link db/d1b/d36/d4a/c1f db/d3c/d4f/d59/cbc 0 2024-09-17T04:21:16.505 INFO:tasks.workunit.client.0.smithi088.stdout:8/684: link d7/d29/d2a/d3a/d79/fe0 d7/dd/d6f/fe5 0 2024-09-17T04:21:16.514 INFO:tasks.workunit.client.0.smithi088.stdout:9/797: write d2/dd/d11/d30/d49/f45 [2666422,46927] 0 2024-09-17T04:21:16.521 INFO:tasks.workunit.client.0.smithi088.stdout:5/649: sync 2024-09-17T04:21:16.522 INFO:tasks.workunit.client.0.smithi088.stdout:5/650: readlink d2/d31/d33/d20/d25/d2c/l56 0 2024-09-17T04:21:16.522 INFO:tasks.workunit.client.0.smithi088.stdout:8/685: mkdir d7/dd/d31/dca/de6 0 2024-09-17T04:21:16.531 INFO:tasks.workunit.client.0.smithi088.stdout:7/721: mkdir d2/d1d/d2e/db0/ddf 0 2024-09-17T04:21:16.532 INFO:tasks.workunit.client.0.smithi088.stdout:9/798: readlink d2/d2b/d2e/dbb/d104/db5/lf9 0 2024-09-17T04:21:16.532 INFO:tasks.workunit.client.0.smithi088.stdout:1/666: dread d0/d1/df/d63/fb5 [0,4194304] 0 2024-09-17T04:21:16.533 INFO:tasks.workunit.client.0.smithi088.stdout:7/722: chown d2/d1d/d2e/db0/d23/l38 29012 1 2024-09-17T04:21:16.533 INFO:tasks.workunit.client.0.smithi088.stdout:3/718: write d0/d13/d1b/d29/d30/d3c/f61 [719188,76026] 0 2024-09-17T04:21:16.535 INFO:tasks.workunit.client.0.smithi088.stdout:3/719: write d0/d13/d4d/f6c [807421,105580] 0 2024-09-17T04:21:16.535 INFO:tasks.workunit.client.0.smithi088.stdout:0/537: truncate db/f12 46408 0 2024-09-17T04:21:16.537 INFO:tasks.workunit.client.0.smithi088.stdout:6/695: rename d14/d3a/d41/f69 to d14/d44/d45/fed 0 2024-09-17T04:21:16.538 INFO:tasks.workunit.client.0.smithi088.stdout:8/686: creat d7/dd/d6f/db6/fe7 x:0 0 0 2024-09-17T04:21:16.550 INFO:tasks.workunit.client.0.smithi088.stdout:4/620: sync 2024-09-17T04:21:16.551 INFO:tasks.workunit.client.0.smithi088.stdout:4/621: truncate d5/d3f/d71/fc2 471489 0 2024-09-17T04:21:16.568 INFO:tasks.workunit.client.0.smithi088.stdout:2/711: creat d0/d1/d2d/d33/d4b/d24/d3b/d22/fdb x:0 0 0 2024-09-17T04:21:16.570 INFO:tasks.workunit.client.0.smithi088.stdout:9/799: mknod d2/dd/d14/d2a/d76/c111 0 2024-09-17T04:21:16.571 INFO:tasks.workunit.client.0.smithi088.stdout:1/667: symlink d0/d1/d27/d9a/ld7 0 2024-09-17T04:21:16.573 INFO:tasks.workunit.client.0.smithi088.stdout:7/723: fdatasync d2/d4/d7/f10 0 2024-09-17T04:21:16.574 INFO:tasks.workunit.client.0.smithi088.stdout:7/724: fsync d2/d1d/d2e/db0/d23/f2f 0 2024-09-17T04:21:16.584 INFO:tasks.workunit.client.0.smithi088.stdout:8/687: unlink d7/d29/f12 0 2024-09-17T04:21:16.585 INFO:tasks.workunit.client.0.smithi088.stdout:4/622: creat d5/d3f/d71/d99/fcc x:0 0 0 2024-09-17T04:21:16.586 INFO:tasks.workunit.client.0.smithi088.stdout:2/712: dread - d0/d1/d2d/d33/d85/fa0 zero size 2024-09-17T04:21:16.587 INFO:tasks.workunit.client.0.smithi088.stdout:2/713: fsync d0/d1/d2d/fb6 0 2024-09-17T04:21:16.588 INFO:tasks.workunit.client.0.smithi088.stdout:1/668: rename d0/d1/df/f8f to d0/d1/d16/d35/fd8 0 2024-09-17T04:21:16.590 INFO:tasks.workunit.client.0.smithi088.stdout:7/725: fdatasync d2/d4/f69 0 2024-09-17T04:21:16.591 INFO:tasks.workunit.client.0.smithi088.stdout:3/720: dread - d0/d13/d1b/d29/d30/d35/d65/fba zero size 2024-09-17T04:21:16.594 INFO:tasks.workunit.client.0.smithi088.stdout:6/696: mknod d14/d44/d45/d6b/d2a/d52/dd1/cee 0 2024-09-17T04:21:16.595 INFO:tasks.workunit.client.0.smithi088.stdout:6/697: truncate d14/d44/d45/d6b/fbf 1286487 0 2024-09-17T04:21:16.595 INFO:tasks.workunit.client.0.smithi088.stdout:6/698: stat d14/f24 0 2024-09-17T04:21:16.596 INFO:tasks.workunit.client.0.smithi088.stdout:6/699: stat d14/f24 0 2024-09-17T04:21:16.598 INFO:tasks.workunit.client.0.smithi088.stdout:1/669: fdatasync d0/f4 0 2024-09-17T04:21:16.600 INFO:tasks.workunit.client.0.smithi088.stdout:2/714: rmdir d0/d1/d2d/d33/d4b/d24/d3b/d22 39 2024-09-17T04:21:16.601 INFO:tasks.workunit.client.0.smithi088.stdout:5/651: truncate d2/d31/d33/d20/d30/d51/d5e/f7a 1873697 0 2024-09-17T04:21:16.602 INFO:tasks.workunit.client.0.smithi088.stdout:5/652: chown d2/d31/d33/d20/d25/d2c/c5c 0 1 2024-09-17T04:21:16.603 INFO:tasks.workunit.client.0.smithi088.stdout:5/653: chown d2/d31/d33/d20/d30/d9f/da4/cb7 12649 1 2024-09-17T04:21:16.608 INFO:tasks.workunit.client.0.smithi088.stdout:8/688: fsync f6 0 2024-09-17T04:21:16.613 INFO:tasks.workunit.client.0.smithi088.stdout:9/800: link d2/d2b/d2e/dbb/d104/d5c/fc1 d2/d16/f112 0 2024-09-17T04:21:16.616 INFO:tasks.workunit.client.0.smithi088.stdout:1/670: creat d0/d1/d16/d2a/da4/fd9 x:0 0 0 2024-09-17T04:21:16.618 INFO:tasks.workunit.client.0.smithi088.stdout:8/689: dwrite d7/d29/d2a/d3a/fe3 [0,4194304] 0 2024-09-17T04:21:16.619 INFO:tasks.workunit.client.0.smithi088.stdout:4/623: dwrite d5/d3f/d71/d99/fa6 [0,4194304] 0 2024-09-17T04:21:16.621 INFO:tasks.workunit.client.0.smithi088.stdout:7/726: write d2/d4/d7/d46/d67/f75 [1034097,58209] 0 2024-09-17T04:21:16.621 INFO:tasks.workunit.client.0.smithi088.stdout:5/654: fsync d2/d31/d33/d20/f23 0 2024-09-17T04:21:16.622 INFO:tasks.workunit.client.0.smithi088.stdout:6/700: write d14/d44/d45/d6b/fbf [359986,48392] 0 2024-09-17T04:21:16.625 INFO:tasks.workunit.client.0.smithi088.stdout:0/538: getdents db/d3c/d4f 0 2024-09-17T04:21:16.633 INFO:tasks.workunit.client.0.smithi088.stdout:3/721: dwrite d0/d13/d1b/d29/d2b/f41 [0,4194304] 0 2024-09-17T04:21:16.637 INFO:tasks.workunit.client.0.smithi088.stdout:8/690: truncate d7/d29/d2a/d38/d3d/f78 171472 0 2024-09-17T04:21:16.640 INFO:tasks.workunit.client.0.smithi088.stdout:8/691: stat d7/dd/ca1 0 2024-09-17T04:21:16.640 INFO:tasks.workunit.client.0.smithi088.stdout:2/715: dwrite d0/d1/d2d/d33/d4b/d24/f2c [0,4194304] 0 2024-09-17T04:21:16.641 INFO:tasks.workunit.client.0.smithi088.stdout:0/539: mknod db/d1b/d36/d47/cbd 0 2024-09-17T04:21:16.643 INFO:tasks.workunit.client.0.smithi088.stdout:2/716: chown d0/d1/d2d/d33/d4b/d24/d4d/l50 320037 1 2024-09-17T04:21:16.646 INFO:tasks.workunit.client.0.smithi088.stdout:4/624: mkdir d5/dcd 0 2024-09-17T04:21:16.655 INFO:tasks.workunit.client.0.smithi088.stdout:7/727: write d2/d1d/d2e/db0/d23/d45/d62/f9e [2320867,79334] 0 2024-09-17T04:21:16.657 INFO:tasks.workunit.client.0.smithi088.stdout:8/692: dwrite d7/dd/d31/d47/f93 [0,4194304] 0 2024-09-17T04:21:16.657 INFO:tasks.workunit.client.0.smithi088.stdout:7/728: chown d2/d4/d7/d46 58 1 2024-09-17T04:21:16.659 INFO:tasks.workunit.client.0.smithi088.stdout:2/717: unlink d0/d1/d2d/d33/d85/cae 0 2024-09-17T04:21:16.659 INFO:tasks.workunit.client.0.smithi088.stdout:6/701: dwrite d14/d44/d45/d6b/d16/f6a [0,4194304] 0 2024-09-17T04:21:16.661 INFO:tasks.workunit.client.0.smithi088.stdout:9/801: write d2/d16/fa8 [1165995,122824] 0 2024-09-17T04:21:16.664 INFO:tasks.workunit.client.0.smithi088.stdout:5/655: rename d2/d31/d33/d20/d47/c76 to d2/d31/d33/cd4 0 2024-09-17T04:21:16.664 INFO:tasks.workunit.client.0.smithi088.stdout:1/671: link d0/d13/f3f d0/d1/fda 0 2024-09-17T04:21:16.666 INFO:tasks.workunit.client.0.smithi088.stdout:2/718: fdatasync d0/d1/d2d/f3a 0 2024-09-17T04:21:16.668 INFO:tasks.workunit.client.0.smithi088.stdout:4/625: unlink d5/d3d/l84 0 2024-09-17T04:21:16.670 INFO:tasks.workunit.client.0.smithi088.stdout:5/656: mkdir d2/d31/dd5 0 2024-09-17T04:21:16.673 INFO:tasks.workunit.client.0.smithi088.stdout:6/702: rename d14/d44/d45/fed to d14/d44/d45/d6b/d2a/d52/fef 0 2024-09-17T04:21:16.674 INFO:tasks.workunit.client.0.smithi088.stdout:9/802: dwrite d2/dd/d14/d8b/f7e [0,4194304] 0 2024-09-17T04:21:16.676 INFO:tasks.workunit.client.0.smithi088.stdout:3/722: dwrite d0/d13/d1b/d29/d2b/f42 [0,4194304] 0 2024-09-17T04:21:16.684 INFO:tasks.workunit.client.0.smithi088.stdout:9/803: chown d2/dd/d14/d2a/d8f/fd8 874 1 2024-09-17T04:21:16.685 INFO:tasks.workunit.client.0.smithi088.stdout:2/719: creat d0/d1/d2d/d33/d65/fdc x:0 0 0 2024-09-17T04:21:16.685 INFO:tasks.workunit.client.0.smithi088.stdout:4/626: write d5/f4b [2690129,35260] 0 2024-09-17T04:21:16.686 INFO:tasks.workunit.client.0.smithi088.stdout:6/703: symlink d14/d44/d45/d4d/d97/lf0 0 2024-09-17T04:21:16.688 INFO:tasks.workunit.client.0.smithi088.stdout:1/672: link d0/d1/df/d20/dbd/fca d0/d1/d16/d2a/d9c/dc8/fdb 0 2024-09-17T04:21:16.689 INFO:tasks.workunit.client.0.smithi088.stdout:0/540: dwrite db/d1b/d39/f8d [0,4194304] 0 2024-09-17T04:21:16.691 INFO:tasks.workunit.client.0.smithi088.stdout:5/657: dwrite d2/f10 [4194304,4194304] 0 2024-09-17T04:21:16.694 INFO:tasks.workunit.client.0.smithi088.stdout:1/673: stat d0/d1/d16/d2a/d9c 0 2024-09-17T04:21:16.697 INFO:tasks.workunit.client.0.smithi088.stdout:4/627: stat d5/d3f/d71/d8b/d68/dab/fb1 0 2024-09-17T04:21:16.699 INFO:tasks.workunit.client.0.smithi088.stdout:9/804: symlink d2/d2b/d58/dcf/l113 0 2024-09-17T04:21:16.702 INFO:tasks.workunit.client.0.smithi088.stdout:6/704: mkdir d14/d44/d45/d6b/d2a/d52/dd1/df1 0 2024-09-17T04:21:16.703 INFO:tasks.workunit.client.0.smithi088.stdout:9/805: chown d2/d2b 29 1 2024-09-17T04:21:16.705 INFO:tasks.workunit.client.0.smithi088.stdout:0/541: rmdir db/d1b/d36/d4a/d20 39 2024-09-17T04:21:16.706 INFO:tasks.workunit.client.0.smithi088.stdout:6/705: readlink d14/d63/de0/l9e 0 2024-09-17T04:21:16.707 INFO:tasks.workunit.client.0.smithi088.stdout:7/729: dwrite d2/d79/f7a [0,4194304] 0 2024-09-17T04:21:16.708 INFO:tasks.workunit.client.0.smithi088.stdout:3/723: truncate d0/d13/d1b/d29/d2b/d40/f43 303314 0 2024-09-17T04:21:16.710 INFO:tasks.workunit.client.0.smithi088.stdout:1/674: creat d0/d1/d16/d77/d9e/fdc x:0 0 0 2024-09-17T04:21:16.713 INFO:tasks.workunit.client.0.smithi088.stdout:9/806: write d2/d16/dd7/fe5 [871511,80818] 0 2024-09-17T04:21:16.715 INFO:tasks.workunit.client.0.smithi088.stdout:1/675: chown d0/d1/d16/d2a/f53 46804285 1 2024-09-17T04:21:16.715 INFO:tasks.workunit.client.0.smithi088.stdout:9/807: stat d2/d2b/d2e/dbb/d104/d5c 0 2024-09-17T04:21:16.716 INFO:tasks.workunit.client.0.smithi088.stdout:4/628: truncate d5/d32/d6b/f86 191868 0 2024-09-17T04:21:16.717 INFO:tasks.workunit.client.0.smithi088.stdout:2/720: creat d0/d1/d2d/d33/d4b/d24/d3b/d22/dba/fdd x:0 0 0 2024-09-17T04:21:16.724 INFO:tasks.workunit.client.0.smithi088.stdout:5/658: truncate d2/d31/d33/fb4 2302342 0 2024-09-17T04:21:16.726 INFO:tasks.workunit.client.0.smithi088.stdout:7/730: creat d2/d4/d7/d46/d67/dd6/fe0 x:0 0 0 2024-09-17T04:21:16.726 INFO:tasks.workunit.client.0.smithi088.stdout:7/731: chown d2/d1d/d2e/l4c 214 1 2024-09-17T04:21:16.727 INFO:tasks.workunit.client.0.smithi088.stdout:6/706: fdatasync d14/d44/d45/d6b/d2a/fa4 0 2024-09-17T04:21:16.728 INFO:tasks.workunit.client.0.smithi088.stdout:1/676: read d0/d13/f68 [143941,95536] 0 2024-09-17T04:21:16.745 INFO:tasks.workunit.client.0.smithi088.stdout:6/707: symlink d14/d44/d94/db9/dc8/lf2 0 2024-09-17T04:21:16.746 INFO:tasks.workunit.client.0.smithi088.stdout:3/724: truncate d0/d13/d1b/d29/d30/f68 971116 0 2024-09-17T04:21:16.747 INFO:tasks.workunit.client.0.smithi088.stdout:7/732: mknod d2/d1d/d2e/db0/d23/d97/dbb/ce1 0 2024-09-17T04:21:16.747 INFO:tasks.workunit.client.0.smithi088.stdout:3/725: fdatasync d0/d13/d1b/d29/d30/d3c/f94 0 2024-09-17T04:21:16.748 INFO:tasks.workunit.client.0.smithi088.stdout:3/726: readlink d0/d13/d58/ld9 0 2024-09-17T04:21:16.749 INFO:tasks.workunit.client.0.smithi088.stdout:1/677: unlink d0/d1/d16/c7a 0 2024-09-17T04:21:16.750 INFO:tasks.workunit.client.0.smithi088.stdout:5/659: write d2/d31/d33/d20/f84 [738990,61462] 0 2024-09-17T04:21:16.752 INFO:tasks.workunit.client.0.smithi088.stdout:5/660: stat d2/d31/d33/d20/fb1 0 2024-09-17T04:21:16.752 INFO:tasks.workunit.client.0.smithi088.stdout:0/542: link db/d1b/d36/d47/la9 db/d1b/d36/d4a/d20/lbe 0 2024-09-17T04:21:16.755 INFO:tasks.workunit.client.0.smithi088.stdout:7/733: creat d2/d4/d7/d46/fe2 x:0 0 0 2024-09-17T04:21:16.758 INFO:tasks.workunit.client.0.smithi088.stdout:1/678: dwrite d0/d1/d16/d2a/fd1 [0,4194304] 0 2024-09-17T04:21:16.758 INFO:tasks.workunit.client.0.smithi088.stdout:3/727: fdatasync d0/d13/f99 0 2024-09-17T04:21:16.763 INFO:tasks.workunit.client.0.smithi088.stdout:9/808: getdents d2/d16/dd7 0 2024-09-17T04:21:16.764 INFO:tasks.workunit.client.0.smithi088.stdout:5/661: dwrite d2/d31/d33/d20/d30/d9f/da4/dbe/fcc [0,4194304] 0 2024-09-17T04:21:16.764 INFO:tasks.workunit.client.0.smithi088.stdout:4/629: getdents d5/d32/d6b 0 2024-09-17T04:21:16.766 INFO:tasks.workunit.client.0.smithi088.stdout:5/662: fdatasync d2/d31/d33/d20/d30/d9f/da4/fa7 0 2024-09-17T04:21:16.767 INFO:tasks.workunit.client.0.smithi088.stdout:2/721: truncate d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/d9a/fa7 1099304 0 2024-09-17T04:21:16.768 INFO:tasks.workunit.client.0.smithi088.stdout:9/809: write d2/dd/d14/d8b/d43/fdb [1005345,117660] 0 2024-09-17T04:21:16.774 INFO:tasks.workunit.client.0.smithi088.stdout:4/630: symlink d5/d72/lce 0 2024-09-17T04:21:16.775 INFO:tasks.workunit.client.0.smithi088.stdout:4/631: read - d5/d3f/d71/d8b/d68/fb9 zero size 2024-09-17T04:21:16.777 INFO:tasks.workunit.client.0.smithi088.stdout:5/663: rmdir d2/d31/d33/d20/d8b 39 2024-09-17T04:21:16.783 INFO:tasks.workunit.client.0.smithi088.stdout:6/708: mkdir d14/d44/d45/d6b/d16/d42/df3 0 2024-09-17T04:21:16.784 INFO:tasks.workunit.client.0.smithi088.stdout:6/709: dread - d14/d44/d45/d6b/d2a/d52/fe9 zero size 2024-09-17T04:21:16.785 INFO:tasks.workunit.client.0.smithi088.stdout:1/679: dread d0/d1/d16/d2a/f79 [0,4194304] 0 2024-09-17T04:21:16.786 INFO:tasks.workunit.client.0.smithi088.stdout:6/710: chown d14/d44/d94/db9/fe8 52937 1 2024-09-17T04:21:16.786 INFO:tasks.workunit.client.0.smithi088.stdout:7/734: rename d2/d1d/d2e/db0/d23/d45/d62/d82/cd4 to d2/d1d/d2e/db0/ddf/ce3 0 2024-09-17T04:21:16.787 INFO:tasks.workunit.client.0.smithi088.stdout:6/711: stat d14/d44/d45/d6b/d2a/d52/d90 0 2024-09-17T04:21:16.788 INFO:tasks.workunit.client.0.smithi088.stdout:6/712: chown d14/d44/d45/d6b/d29/cc4 463417 1 2024-09-17T04:21:16.789 INFO:tasks.workunit.client.0.smithi088.stdout:6/713: chown d14/d63/de0/l9e 153 1 2024-09-17T04:21:16.792 INFO:tasks.workunit.client.0.smithi088.stdout:9/810: mkdir d2/dd/d14/d8b/d35/d114 0 2024-09-17T04:21:16.793 INFO:tasks.workunit.client.0.smithi088.stdout:2/722: mknod d0/d1/d2d/d33/d4b/d24/d3b/cde 0 2024-09-17T04:21:16.794 INFO:tasks.workunit.client.0.smithi088.stdout:9/811: read - d2/dd/d14/d2a/d76/f109 zero size 2024-09-17T04:21:16.794 INFO:tasks.workunit.client.0.smithi088.stdout:4/632: dwrite d5/d3f/d71/d99/fca [0,4194304] 0 2024-09-17T04:21:16.796 INFO:tasks.workunit.client.0.smithi088.stdout:1/680: mknod d0/d1/df/d20/dbd/cdd 0 2024-09-17T04:21:16.796 INFO:tasks.workunit.client.0.smithi088.stdout:6/714: creat d14/d63/de0/ff4 x:0 0 0 2024-09-17T04:21:16.798 INFO:tasks.workunit.client.0.smithi088.stdout:9/812: readlink d2/dd/d14/d8b/d35/lba 0 2024-09-17T04:21:16.798 INFO:tasks.workunit.client.0.smithi088.stdout:2/723: read d0/d1/d2d/d33/d4b/d24/d3b/fcd [196723,56355] 0 2024-09-17T04:21:16.800 INFO:tasks.workunit.client.0.smithi088.stdout:5/664: dread - d2/d31/d33/d20/d25/d2c/d3d/f93 zero size 2024-09-17T04:21:16.801 INFO:tasks.workunit.client.0.smithi088.stdout:6/715: read d14/d44/d45/d6b/d2a/d52/d7a/f83 [2924642,121210] 0 2024-09-17T04:21:16.804 INFO:tasks.workunit.client.0.smithi088.stdout:9/813: unlink d2/dd/d11/lee 0 2024-09-17T04:21:16.805 INFO:tasks.workunit.client.0.smithi088.stdout:9/814: chown d2/dd/d11/d30/f7f 7737049 1 2024-09-17T04:21:16.807 INFO:tasks.workunit.client.0.smithi088.stdout:2/724: truncate d0/d1/d2d/f3a 1029237 0 2024-09-17T04:21:16.808 INFO:tasks.workunit.client.0.smithi088.stdout:4/633: mknod d5/dcd/ccf 0 2024-09-17T04:21:16.809 INFO:tasks.workunit.client.0.smithi088.stdout:2/725: write d0/d1/d2d/d33/d4b/d24/d92/fac [260439,29430] 0 2024-09-17T04:21:16.810 INFO:tasks.workunit.client.0.smithi088.stdout:5/665: creat d2/da9/db8/fd6 x:0 0 0 2024-09-17T04:21:16.814 INFO:tasks.workunit.client.0.smithi088.stdout:9/815: read d2/dd/d14/d8b/d35/f6c [531823,18166] 0 2024-09-17T04:21:16.817 INFO:tasks.workunit.client.0.smithi088.stdout:6/716: fsync d14/d44/d45/d6b/d16/f9c 0 2024-09-17T04:21:16.818 INFO:tasks.workunit.client.0.smithi088.stdout:6/717: readlink d14/d44/d94/db9/ldb 0 2024-09-17T04:21:16.821 INFO:tasks.workunit.client.0.smithi088.stdout:9/816: mkdir d2/db8/d115 0 2024-09-17T04:21:16.823 INFO:tasks.workunit.client.0.smithi088.stdout:4/634: mkdir d5/d3f/d71/d8b/d75/dd0 0 2024-09-17T04:21:16.826 INFO:tasks.workunit.client.0.smithi088.stdout:5/666: mknod d2/d31/dd5/cd7 0 2024-09-17T04:21:16.831 INFO:tasks.workunit.client.0.smithi088.stdout:4/635: symlink d5/d32/d6b/ld1 0 2024-09-17T04:21:16.832 INFO:tasks.workunit.client.0.smithi088.stdout:2/726: dwrite d0/d1/d2d/d33/d4b/d24/d3b/f54 [4194304,4194304] 0 2024-09-17T04:21:16.833 INFO:tasks.workunit.client.0.smithi088.stdout:5/667: chown d2/d31/d33/d20/d30/d51/d5e/d6b/f99 5 1 2024-09-17T04:21:16.834 INFO:tasks.workunit.client.0.smithi088.stdout:1/681: link d0/f28 d0/d1/fde 0 2024-09-17T04:21:16.842 INFO:tasks.workunit.client.0.smithi088.stdout:2/727: creat d0/d1/d2d/d33/d4b/d24/fdf x:0 0 0 2024-09-17T04:21:16.881 INFO:tasks.workunit.client.0.smithi088.stdout:9/817: rename d2/dd/d11/d30/d49 to d2/d16/d116 0 2024-09-17T04:21:16.883 INFO:tasks.workunit.client.0.smithi088.stdout:6/718: truncate d14/d3a/fe5 3104523 0 2024-09-17T04:21:16.885 INFO:tasks.workunit.client.0.smithi088.stdout:1/682: rename d0/d1/d16/d2a/da4 to d0/d1/df/d20/ddf 0 2024-09-17T04:21:16.887 INFO:tasks.workunit.client.0.smithi088.stdout:9/818: creat d2/d2b/d2e/dbb/d104/d72/d74/f117 x:0 0 0 2024-09-17T04:21:16.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:16 smithi088 ceph-mon[27811]: pgmap v29: 65 pgs: 65 active+clean; 3.1 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 100 MiB/s rd, 224 MiB/s wr, 547 op/s 2024-09-17T04:21:16.889 INFO:tasks.workunit.client.0.smithi088.stdout:4/636: dwrite d5/d3f/d71/d8b/d68/da4/d5e/f8d [0,4194304] 0 2024-09-17T04:21:16.889 INFO:tasks.workunit.client.0.smithi088.stdout:1/683: truncate d0/d1/d16/d77/d9e/fdc 1037315 0 2024-09-17T04:21:16.891 INFO:tasks.workunit.client.0.smithi088.stdout:5/668: rmdir d2/db3 0 2024-09-17T04:21:16.895 INFO:tasks.workunit.client.0.smithi088.stdout:2/728: stat d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/d7c/f9b 0 2024-09-17T04:21:16.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:16 smithi134 ceph-mon[35201]: pgmap v29: 65 pgs: 65 active+clean; 3.1 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 100 MiB/s rd, 224 MiB/s wr, 547 op/s 2024-09-17T04:21:16.896 INFO:tasks.workunit.client.0.smithi088.stdout:2/729: chown d0/d13/c49 15485541 1 2024-09-17T04:21:16.897 INFO:tasks.workunit.client.0.smithi088.stdout:9/819: mknod d2/d2b/d2e/dbb/d104/d5c/c118 0 2024-09-17T04:21:16.899 INFO:tasks.workunit.client.0.smithi088.stdout:4/637: mkdir d5/d32/d6b/dd2 0 2024-09-17T04:21:16.901 INFO:tasks.workunit.client.0.smithi088.stdout:1/684: mkdir d0/d1/df/d85/da3/de0 0 2024-09-17T04:21:16.902 INFO:tasks.workunit.client.0.smithi088.stdout:1/685: fdatasync d0/d1/d16/d77/d9e/fdc 0 2024-09-17T04:21:16.904 INFO:tasks.workunit.client.0.smithi088.stdout:5/669: creat d2/d31/d33/d20/d25/d2c/d3d/da5/fd8 x:0 0 0 2024-09-17T04:21:16.911 INFO:tasks.workunit.client.0.smithi088.stdout:1/686: fsync d0/d13/f54 0 2024-09-17T04:21:16.916 INFO:tasks.workunit.client.0.smithi088.stdout:5/670: mkdir d2/d31/d33/d20/dd9 0 2024-09-17T04:21:16.918 INFO:tasks.workunit.client.0.smithi088.stdout:6/719: getdents d14/d3a 0 2024-09-17T04:21:16.918 INFO:tasks.workunit.client.0.smithi088.stdout:2/730: write d0/d1/f11 [7264720,21446] 0 2024-09-17T04:21:16.920 INFO:tasks.workunit.client.0.smithi088.stdout:9/820: creat d2/d16/ddd/d105/f119 x:0 0 0 2024-09-17T04:21:16.921 INFO:tasks.workunit.client.0.smithi088.stdout:4/638: creat d5/d3f/fd3 x:0 0 0 2024-09-17T04:21:16.924 INFO:tasks.workunit.client.0.smithi088.stdout:1/687: rename d0/d1/df/d63/d91/lb1 to d0/le1 0 2024-09-17T04:21:16.925 INFO:tasks.workunit.client.0.smithi088.stdout:1/688: chown d0/d1/d16/d35/dc5 1090406 1 2024-09-17T04:21:16.925 INFO:tasks.workunit.client.0.smithi088.stdout:4/639: creat d5/d32/d6b/fd4 x:0 0 0 2024-09-17T04:21:16.926 INFO:tasks.workunit.client.0.smithi088.stdout:5/671: link d2/d31/d33/d20/d30/d51/d5e/d6b/f92 d2/d31/d33/d20/d25/d49/fda 0 2024-09-17T04:21:16.928 INFO:tasks.workunit.client.0.smithi088.stdout:2/731: symlink d0/d1/dc5/dd5/le0 0 2024-09-17T04:21:16.932 INFO:tasks.workunit.client.0.smithi088.stdout:6/720: creat d14/d44/d45/ff5 x:0 0 0 2024-09-17T04:21:16.934 INFO:tasks.workunit.client.0.smithi088.stdout:5/672: symlink d2/d31/d33/d20/d25/d49/ldb 0 2024-09-17T04:21:16.935 INFO:tasks.workunit.client.0.smithi088.stdout:2/732: chown d0/c6 1273 1 2024-09-17T04:21:16.936 INFO:tasks.workunit.client.0.smithi088.stdout:5/673: chown d2/d31/d33/d20/d25/c97 10755414 1 2024-09-17T04:21:16.937 INFO:tasks.workunit.client.0.smithi088.stdout:5/674: dread - d2/d31/d33/d20/d25/fb0 zero size 2024-09-17T04:21:16.938 INFO:tasks.workunit.client.0.smithi088.stdout:6/721: mknod d14/d2f/d87/d9d/cf6 0 2024-09-17T04:21:16.939 INFO:tasks.workunit.client.0.smithi088.stdout:9/821: rename d2/dd/d14/d8b/cac to d2/dd/d14/d8b/d43/c11a 0 2024-09-17T04:21:16.940 INFO:tasks.workunit.client.0.smithi088.stdout:6/722: chown d14/d44/d45/d6b/d2a/d52/d7a/c98 12134 1 2024-09-17T04:21:16.941 INFO:tasks.workunit.client.0.smithi088.stdout:5/675: write d2/d31/d33/d20/d30/d51/fa1 [2881222,73315] 0 2024-09-17T04:21:16.944 INFO:tasks.workunit.client.0.smithi088.stdout:1/689: dread d0/f94 [0,4194304] 0 2024-09-17T04:21:16.948 INFO:tasks.workunit.client.0.smithi088.stdout:4/640: dread d5/d3f/d71/f91 [0,4194304] 0 2024-09-17T04:21:16.948 INFO:tasks.workunit.client.0.smithi088.stdout:2/733: dwrite d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/fda [0,4194304] 0 2024-09-17T04:21:16.952 INFO:tasks.workunit.client.0.smithi088.stdout:5/676: symlink d2/d31/d33/d20/d25/d2c/d8a/db2/ldc 0 2024-09-17T04:21:16.956 INFO:tasks.workunit.client.0.smithi088.stdout:6/723: rename d14/d44/d45/d6b/d2a/d52/dd1 to d14/d44/d94/db9/dc8/df7 0 2024-09-17T04:21:16.958 INFO:tasks.workunit.client.0.smithi088.stdout:5/677: dwrite d2/d31/d33/f2f [0,4194304] 0 2024-09-17T04:21:16.967 INFO:tasks.workunit.client.0.smithi088.stdout:1/690: mkdir d0/d1/d16/d35/dc5/de2 0 2024-09-17T04:21:16.969 INFO:tasks.workunit.client.0.smithi088.stdout:6/724: creat d14/d44/d45/d6b/d2a/d52/d7a/d7b/ff8 x:0 0 0 2024-09-17T04:21:16.970 INFO:tasks.workunit.client.0.smithi088.stdout:5/678: symlink d2/d31/ldd 0 2024-09-17T04:21:16.971 INFO:tasks.workunit.client.0.smithi088.stdout:4/641: write d5/d3f/f39 [4486022,75069] 0 2024-09-17T04:21:16.973 INFO:tasks.workunit.client.0.smithi088.stdout:9/822: truncate d2/dd/d14/d8b/f4d 776719 0 2024-09-17T04:21:16.976 INFO:tasks.workunit.client.0.smithi088.stdout:4/642: mknod d5/dcd/cd5 0 2024-09-17T04:21:16.977 INFO:tasks.workunit.client.0.smithi088.stdout:6/725: dwrite d14/d44/d45/ff5 [0,4194304] 0 2024-09-17T04:21:16.978 INFO:tasks.workunit.client.0.smithi088.stdout:4/643: chown d5/d32/cad 13094 1 2024-09-17T04:21:16.978 INFO:tasks.workunit.client.0.smithi088.stdout:4/644: stat d5/d3f/c63 0 2024-09-17T04:21:16.980 INFO:tasks.workunit.client.0.smithi088.stdout:1/691: rename d0/d1/d27/d9a to d0/de3 0 2024-09-17T04:21:16.980 INFO:tasks.workunit.client.0.smithi088.stdout:9/823: mknod d2/d2b/d2e/dbb/d104/d5c/c11b 0 2024-09-17T04:21:16.982 INFO:tasks.workunit.client.0.smithi088.stdout:6/726: fsync d14/d44/d45/d6b/d2a/d52/dcf/fd2 0 2024-09-17T04:21:17.000 INFO:tasks.workunit.client.0.smithi088.stdout:5/679: dread d2/d31/d33/d20/d25/d2c/f72 [0,4194304] 0 2024-09-17T04:21:17.001 INFO:tasks.workunit.client.0.smithi088.stdout:5/680: fsync d2/d31/d33/d20/d30/fcd 0 2024-09-17T04:21:17.097 INFO:tasks.workunit.client.0.smithi088.stdout:2/734: rename d0/d1/d2d/d33/f71 to d0/d1/d2d/d33/d4b/d6d/d94/da5/fe1 0 2024-09-17T04:21:17.098 INFO:tasks.workunit.client.0.smithi088.stdout:2/735: fsync d0/d1/d2d/d33/d4b/d24/d3b/d22/dba/fc2 0 2024-09-17T04:21:17.113 INFO:tasks.workunit.client.0.smithi088.stdout:1/692: write d0/d1/d16/d2a/d9c/dc8/f73 [3569454,3113] 0 2024-09-17T04:21:17.116 INFO:tasks.workunit.client.0.smithi088.stdout:2/736: creat d0/d1/d2d/d33/d4b/d24/d3b/d22/dba/dc6/fe2 x:0 0 0 2024-09-17T04:21:17.116 INFO:tasks.workunit.client.0.smithi088.stdout:5/681: write d2/d31/d33/fa [321367,13114] 0 2024-09-17T04:21:17.118 INFO:tasks.workunit.client.0.smithi088.stdout:4/645: getdents d5/d3f 0 2024-09-17T04:21:17.121 INFO:tasks.workunit.client.0.smithi088.stdout:2/737: dread - d0/d1/d2d/d33/d4b/d24/d3b/d26/f8d zero size 2024-09-17T04:21:17.123 INFO:tasks.workunit.client.0.smithi088.stdout:6/727: getdents d14/d2f/d87/d9d 0 2024-09-17T04:21:17.125 INFO:tasks.workunit.client.0.smithi088.stdout:5/682: mkdir d2/d31/d33/d20/d25/d2c/d8a/dc6/dde 0 2024-09-17T04:21:17.125 INFO:tasks.workunit.client.0.smithi088.stdout:9/824: dwrite d2/d2b/d2e/dbb/d104/db5/fe0 [0,4194304] 0 2024-09-17T04:21:17.127 INFO:tasks.workunit.client.0.smithi088.stdout:2/738: unlink d0/d1/d2d/l95 0 2024-09-17T04:21:17.128 INFO:tasks.workunit.client.0.smithi088.stdout:5/683: symlink d2/d31/ldf 0 2024-09-17T04:21:17.130 INFO:tasks.workunit.client.0.smithi088.stdout:9/825: mkdir d2/d16/dd7/d11c 0 2024-09-17T04:21:17.136 INFO:tasks.workunit.client.0.smithi088.stdout:5/684: fsync d2/d31/d33/d20/d47/f8e 0 2024-09-17T04:21:17.136 INFO:tasks.workunit.client.0.smithi088.stdout:9/826: chown d2/d16/d116/f42 263 1 2024-09-17T04:21:17.139 INFO:tasks.workunit.client.0.smithi088.stdout:1/693: dread d0/d1/d16/d77/d9e/fa5 [0,4194304] 0 2024-09-17T04:21:17.140 INFO:tasks.workunit.client.0.smithi088.stdout:6/728: dwrite d14/d44/d45/d6b/d2a/d52/d7a/d7b/ff8 [0,4194304] 0 2024-09-17T04:21:17.141 INFO:tasks.workunit.client.0.smithi088.stdout:2/739: dwrite d0/d1/d2d/fd6 [0,4194304] 0 2024-09-17T04:21:17.145 INFO:tasks.workunit.client.0.smithi088.stdout:6/729: write d14/d44/f8a [1398955,93623] 0 2024-09-17T04:21:17.150 INFO:tasks.workunit.client.0.smithi088.stdout:2/740: dread d0/d1/d2d/d33/d4b/d24/d3b/f7f [0,4194304] 0 2024-09-17T04:21:17.152 INFO:tasks.workunit.client.0.smithi088.stdout:9/827: mkdir d2/d2b/d2e/dbb/d104/d72/d11d 0 2024-09-17T04:21:17.158 INFO:tasks.workunit.client.0.smithi088.stdout:5/685: rename d2/d31/d33/d20/d25/d2c/d3d to d2/d31/d33/d20/d47/de0 0 2024-09-17T04:21:17.159 INFO:tasks.workunit.client.0.smithi088.stdout:1/694: fsync d0/d1/d16/d2a/f9b 0 2024-09-17T04:21:17.163 INFO:tasks.workunit.client.0.smithi088.stdout:2/741: mkdir d0/d1/d2d/d33/d4b/d6d/d94/da5/de3 0 2024-09-17T04:21:17.165 INFO:tasks.workunit.client.0.smithi088.stdout:9/828: rename d2/d2b/d58/fb7 to d2/d2b/d58/f11e 0 2024-09-17T04:21:17.176 INFO:tasks.workunit.client.0.smithi088.stdout:9/829: mkdir d2/d2b/d58/dcf/d11f 0 2024-09-17T04:21:17.178 INFO:tasks.workunit.client.0.smithi088.stdout:6/730: rename d14/d44/d45/d6b/d29/c4a to d14/d44/dad/cf9 0 2024-09-17T04:21:17.180 INFO:tasks.workunit.client.0.smithi088.stdout:5/686: mknod d2/d31/d33/ce1 0 2024-09-17T04:21:17.183 INFO:tasks.workunit.client.0.smithi088.stdout:2/742: creat d0/d1/d2d/d33/d4b/d24/d4d/fe4 x:0 0 0 2024-09-17T04:21:17.186 INFO:tasks.workunit.client.0.smithi088.stdout:6/731: fsync d14/d44/d45/d6b/d16/f8b 0 2024-09-17T04:21:17.187 INFO:tasks.workunit.client.0.smithi088.stdout:1/695: link d0/d13/d84/l7f d0/d1/d16/d35/dc5/de2/le4 0 2024-09-17T04:21:17.188 INFO:tasks.workunit.client.0.smithi088.stdout:5/687: dwrite d2/d31/d33/d20/d25/d49/f4a [0,4194304] 0 2024-09-17T04:21:17.192 INFO:tasks.workunit.client.0.smithi088.stdout:2/743: symlink d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/d7c/le5 0 2024-09-17T04:21:17.193 INFO:tasks.workunit.client.0.smithi088.stdout:6/732: rmdir d14/d44/d45/d6b/d29/d3e 39 2024-09-17T04:21:17.194 INFO:tasks.workunit.client.0.smithi088.stdout:6/733: chown cd 326933 1 2024-09-17T04:21:17.196 INFO:tasks.workunit.client.0.smithi088.stdout:5/688: rmdir d2/d31/d33/d20/d30/d9f/da4/dbe 39 2024-09-17T04:21:17.196 INFO:tasks.workunit.client.0.smithi088.stdout:9/830: dread d2/dd/d14/d8b/d43/d51/fb0 [0,4194304] 0 2024-09-17T04:21:17.209 INFO:tasks.workunit.client.0.smithi088.stdout:5/689: dwrite d2/d31/d33/d20/d25/d49/f64 [0,4194304] 0 2024-09-17T04:21:17.210 INFO:tasks.workunit.client.0.smithi088.stdout:5/690: chown d2/d31/d33/d20/d25/d2c/d8a/db2/ld1 1009106095 1 2024-09-17T04:21:17.212 INFO:tasks.workunit.client.0.smithi088.stdout:5/691: read - d2/d31/d33/d20/d25/d49/f9a zero size 2024-09-17T04:21:17.214 INFO:tasks.workunit.client.0.smithi088.stdout:1/696: link d0/d13/d84/c66 d0/d1/d16/dae/ce5 0 2024-09-17T04:21:17.219 INFO:tasks.workunit.client.0.smithi088.stdout:5/692: dwrite d2/d31/d33/d20/d25/d49/f96 [0,4194304] 0 2024-09-17T04:21:17.222 INFO:tasks.workunit.client.0.smithi088.stdout:6/734: dread d14/d44/d45/fc7 [0,4194304] 0 2024-09-17T04:21:17.231 INFO:tasks.workunit.client.0.smithi088.stdout:1/697: dwrite d0/d1/d16/d2a/f79 [0,4194304] 0 2024-09-17T04:21:17.236 INFO:tasks.workunit.client.0.smithi088.stdout:5/693: dwrite d2/fc5 [0,4194304] 0 2024-09-17T04:21:17.238 INFO:tasks.workunit.client.0.smithi088.stdout:2/744: dwrite d0/d1/d2d/d33/fa8 [0,4194304] 0 2024-09-17T04:21:17.242 INFO:tasks.workunit.client.0.smithi088.stdout:6/735: write f4 [4152341,107730] 0 2024-09-17T04:21:17.248 INFO:tasks.workunit.client.0.smithi088.stdout:9/831: dwrite d2/dd/d11/f4b [0,4194304] 0 2024-09-17T04:21:17.256 INFO:tasks.workunit.client.0.smithi088.stdout:2/745: dwrite d0/f12 [4194304,4194304] 0 2024-09-17T04:21:17.257 INFO:tasks.workunit.client.0.smithi088.stdout:1/698: dwrite d0/d13/f47 [0,4194304] 0 2024-09-17T04:21:17.257 INFO:tasks.workunit.client.0.smithi088.stdout:9/832: creat d2/dd/d14/d2a/d76/f120 x:0 0 0 2024-09-17T04:21:17.265 INFO:tasks.workunit.client.0.smithi088.stdout:5/694: link d2/d31/d33/d20/d30/d51/d5e/d6b/fa0 d2/d31/d33/d20/d30/d51/fe2 0 2024-09-17T04:21:17.268 INFO:tasks.workunit.client.0.smithi088.stdout:9/833: creat d2/dd/d11/d30/f121 x:0 0 0 2024-09-17T04:21:17.269 INFO:tasks.workunit.client.0.smithi088.stdout:2/746: dwrite d0/d1/d2d/d33/d4b/d24/d3b/fc8 [0,4194304] 0 2024-09-17T04:21:17.271 INFO:tasks.workunit.client.0.smithi088.stdout:5/695: symlink d2/d31/d33/d20/d25/d2c/d8a/dc6/le3 0 2024-09-17T04:21:17.276 INFO:tasks.workunit.client.0.smithi088.stdout:2/747: creat d0/d1/d2d/d33/d4b/d24/d3b/d22/dba/fe6 x:0 0 0 2024-09-17T04:21:17.277 INFO:tasks.workunit.client.0.smithi088.stdout:5/696: symlink d2/d31/d33/d20/d47/de0/le4 0 2024-09-17T04:21:17.277 INFO:tasks.workunit.client.0.smithi088.stdout:9/834: getdents d2/d2b/d2e/dbb/d104/d5c/dbc 0 2024-09-17T04:21:17.277 INFO:tasks.workunit.client.0.smithi088.stdout:5/697: truncate d2/f15 1579618 0 2024-09-17T04:21:17.277 INFO:tasks.workunit.client.0.smithi088.stdout:2/748: fdatasync d0/d1/d2d/d33/d4b/d24/d3b/fb7 0 2024-09-17T04:21:17.278 INFO:tasks.workunit.client.0.smithi088.stdout:9/835: read d2/d2b/d2e/dbb/d104/d5c/fc1 [80176,91948] 0 2024-09-17T04:21:17.281 INFO:tasks.workunit.client.0.smithi088.stdout:5/698: truncate d2/d31/d33/d20/d47/f87 1002337 0 2024-09-17T04:21:17.292 INFO:tasks.workunit.client.0.smithi088.stdout:6/736: dwrite d14/d44/d94/f78 [0,4194304] 0 2024-09-17T04:21:17.298 INFO:tasks.workunit.client.0.smithi088.stdout:1/699: dread d0/d1/df/d20/ddf/faf [0,4194304] 0 2024-09-17T04:21:17.302 INFO:tasks.workunit.client.0.smithi088.stdout:1/700: fsync d0/d1/d16/d2a/f9b 0 2024-09-17T04:21:17.309 INFO:tasks.workunit.client.0.smithi088.stdout:9/836: dread d2/dd/d14/d8b/d43/f55 [4194304,4194304] 0 2024-09-17T04:21:17.309 INFO:tasks.workunit.client.0.smithi088.stdout:9/837: readlink d2/d2b/d7c/le3 0 2024-09-17T04:21:17.314 INFO:tasks.workunit.client.0.smithi088.stdout:9/838: getdents d2/dd/d14/d8b/d35 0 2024-09-17T04:21:17.315 INFO:tasks.workunit.client.0.smithi088.stdout:1/701: write d0/d1/d16/d77/d9e/fb3 [626842,129516] 0 2024-09-17T04:21:17.319 INFO:tasks.workunit.client.0.smithi088.stdout:6/737: dwrite d14/d44/d45/d6b/d16/f62 [0,4194304] 0 2024-09-17T04:21:17.322 INFO:tasks.workunit.client.0.smithi088.stdout:1/702: unlink d0/d13/fd5 0 2024-09-17T04:21:17.322 INFO:tasks.workunit.client.0.smithi088.stdout:1/703: chown d0/d1/df/d85/da3 0 1 2024-09-17T04:21:17.323 INFO:tasks.workunit.client.0.smithi088.stdout:6/738: mknod d14/d3a/d41/cfa 0 2024-09-17T04:21:17.324 INFO:tasks.workunit.client.0.smithi088.stdout:6/739: fdatasync d14/d44/d45/d6b/d2a/d52/fdc 0 2024-09-17T04:21:17.326 INFO:tasks.workunit.client.0.smithi088.stdout:1/704: dread d0/d1/df/d63/fb5 [0,4194304] 0 2024-09-17T04:21:17.327 INFO:tasks.workunit.client.0.smithi088.stdout:6/740: write d14/d44/d45/d6b/d16/fe1 [715148,97898] 0 2024-09-17T04:21:17.329 INFO:tasks.workunit.client.0.smithi088.stdout:1/705: mknod d0/d1/d16/ce6 0 2024-09-17T04:21:17.330 INFO:tasks.workunit.client.0.smithi088.stdout:1/706: chown d0/d13/lb9 2604 1 2024-09-17T04:21:17.330 INFO:tasks.workunit.client.0.smithi088.stdout:6/741: mknod d14/d44/d45/d6b/d29/d5e/de4/cfb 0 2024-09-17T04:21:17.331 INFO:tasks.workunit.client.0.smithi088.stdout:6/742: chown d14/d44/d45/d6b 628475566 1 2024-09-17T04:21:17.332 INFO:tasks.workunit.client.0.smithi088.stdout:1/707: mkdir d0/d1/de7 0 2024-09-17T04:21:17.333 INFO:tasks.workunit.client.0.smithi088.stdout:6/743: creat d14/d63/ffc x:0 0 0 2024-09-17T04:21:17.336 INFO:tasks.workunit.client.0.smithi088.stdout:9/839: dread d2/d16/fa8 [0,4194304] 0 2024-09-17T04:21:17.340 INFO:tasks.workunit.client.0.smithi088.stdout:6/744: link d14/d63/f82 d14/d44/d45/d6b/d29/ffd 0 2024-09-17T04:21:17.344 INFO:tasks.workunit.client.0.smithi088.stdout:1/708: write d0/d1/fe [2431540,40074] 0 2024-09-17T04:21:17.349 INFO:tasks.workunit.client.0.smithi088.stdout:6/745: getdents d14/d44/d94 0 2024-09-17T04:21:17.351 INFO:tasks.workunit.client.0.smithi088.stdout:9/840: dread d2/dd/d14/d8b/d43/f55 [0,4194304] 0 2024-09-17T04:21:17.358 INFO:tasks.workunit.client.0.smithi088.stdout:9/841: creat d2/dd/d14/d8b/d35/d114/f122 x:0 0 0 2024-09-17T04:21:17.359 INFO:tasks.workunit.client.0.smithi088.stdout:6/746: write d14/d44/d45/d6b/d29/f38 [492186,102505] 0 2024-09-17T04:21:17.364 INFO:tasks.workunit.client.0.smithi088.stdout:6/747: read d14/d44/d45/d6b/d29/f5f [741162,39729] 0 2024-09-17T04:21:17.364 INFO:tasks.workunit.client.0.smithi088.stdout:1/709: dwrite d0/d13/d84/d5d/f78 [0,4194304] 0 2024-09-17T04:21:17.366 INFO:tasks.workunit.client.0.smithi088.stdout:6/748: chown d14/d44/d45/d6b/d2a/d52 7591 1 2024-09-17T04:21:17.366 INFO:tasks.workunit.client.0.smithi088.stdout:6/749: chown d14/d44/d94/db9 245882 1 2024-09-17T04:21:17.369 INFO:tasks.workunit.client.0.smithi088.stdout:6/750: readlink d14/d44/d45/d6b/d2a/l8c 0 2024-09-17T04:21:17.373 INFO:tasks.workunit.client.0.smithi088.stdout:6/751: rename d14/d63 to d14/dce/dfe 0 2024-09-17T04:21:17.375 INFO:tasks.workunit.client.0.smithi088.stdout:1/710: getdents d0/d1/d16/d35 0 2024-09-17T04:21:17.375 INFO:tasks.workunit.client.0.smithi088.stdout:6/752: stat d14/d44/d45/d6b/d16/fe1 0 2024-09-17T04:21:17.378 INFO:tasks.workunit.client.0.smithi088.stdout:1/711: mknod d0/d13/d84/ce8 0 2024-09-17T04:21:17.379 INFO:tasks.workunit.client.0.smithi088.stdout:6/753: truncate d14/d44/d45/d6b/d2a/f49 2683280 0 2024-09-17T04:21:17.385 INFO:tasks.workunit.client.0.smithi088.stdout:9/842: dread d2/dd/d11/d30/f62 [0,4194304] 0 2024-09-17T04:21:17.386 INFO:tasks.workunit.client.0.smithi088.stdout:9/843: chown d2/dd/d14/d2a/l5d 274389 1 2024-09-17T04:21:17.394 INFO:tasks.workunit.client.0.smithi088.stdout:1/712: dread d0/d1/df/d20/f2e [4194304,4194304] 0 2024-09-17T04:21:17.397 INFO:tasks.workunit.client.0.smithi088.stdout:1/713: chown d0/d1/d16/d77/d9e/fdc 1650513224 1 2024-09-17T04:21:17.397 INFO:tasks.workunit.client.0.smithi088.stdout:6/754: dwrite d14/d44/d94/fa5 [0,4194304] 0 2024-09-17T04:21:17.399 INFO:tasks.workunit.client.0.smithi088.stdout:1/714: readlink d0/d1/d16/d2a/d9c/lbc 0 2024-09-17T04:21:17.401 INFO:tasks.workunit.client.0.smithi088.stdout:9/844: dwrite d2/d2b/d2e/f57 [0,4194304] 0 2024-09-17T04:21:17.403 INFO:tasks.workunit.client.0.smithi088.stdout:6/755: chown d14/d44/d45/d6b/d16/c5b 15 1 2024-09-17T04:21:17.404 INFO:tasks.workunit.client.0.smithi088.stdout:1/715: symlink d0/d1/d16/d35/dc5/de2/le9 0 2024-09-17T04:21:17.405 INFO:tasks.workunit.client.0.smithi088.stdout:9/845: creat d2/d2b/d2e/dbb/f123 x:0 0 0 2024-09-17T04:21:17.475 INFO:tasks.workunit.client.0.smithi088.stdout:8/693: sync 2024-09-17T04:21:17.476 INFO:tasks.workunit.client.0.smithi088.stdout:8/694: dread - d7/d29/d7e/f83 zero size 2024-09-17T04:21:17.555 INFO:tasks.workunit.client.0.smithi088.stdout:1/716: creat d0/d1/de7/fea x:0 0 0 2024-09-17T04:21:17.587 INFO:tasks.workunit.client.0.smithi088.stdout:6/756: getdents d14/d44/d94 0 2024-09-17T04:21:17.589 INFO:tasks.workunit.client.0.smithi088.stdout:8/695: getdents d7/dd/d31/dca/de6 0 2024-09-17T04:21:17.591 INFO:tasks.workunit.client.0.smithi088.stdout:6/757: truncate d14/f56 1422331 0 2024-09-17T04:21:17.592 INFO:tasks.workunit.client.0.smithi088.stdout:9/846: getdents d2/dd/d14/d8b/d43/d51 0 2024-09-17T04:21:17.596 INFO:tasks.workunit.client.0.smithi088.stdout:1/717: rename d0/d13/d84/l7f to d0/d1/d16/d77/daa/d5b/leb 0 2024-09-17T04:21:17.598 INFO:tasks.workunit.client.0.smithi088.stdout:6/758: mknod d14/d44/d45/cff 0 2024-09-17T04:21:17.599 INFO:tasks.workunit.client.0.smithi088.stdout:1/718: read - d0/d13/d84/fc2 zero size 2024-09-17T04:21:17.599 INFO:tasks.workunit.client.0.smithi088.stdout:1/719: fdatasync d0/d13/d84/d5d/f78 0 2024-09-17T04:21:17.603 INFO:tasks.workunit.client.0.smithi088.stdout:1/720: rmdir d0/d1/d16/d2a/d9c/dc8 39 2024-09-17T04:21:17.604 INFO:tasks.workunit.client.0.smithi088.stdout:1/721: fdatasync d0/d1/d16/d77/d9e/fd4 0 2024-09-17T04:21:17.604 INFO:tasks.workunit.client.0.smithi088.stdout:6/759: mknod d14/d44/d45/d6b/da7/c100 0 2024-09-17T04:21:17.605 INFO:tasks.workunit.client.0.smithi088.stdout:9/847: link d2/dd/d14/d2a/d8f/d99/cdc d2/d2b/d2e/dbb/d104/d72/d74/c124 0 2024-09-17T04:21:17.605 INFO:tasks.workunit.client.0.smithi088.stdout:6/760: write d14/d44/f5d [1308368,16320] 0 2024-09-17T04:21:17.608 INFO:tasks.workunit.client.0.smithi088.stdout:6/761: creat d14/d44/d94/db9/dc8/df7/f101 x:0 0 0 2024-09-17T04:21:17.610 INFO:tasks.workunit.client.0.smithi088.stdout:6/762: mknod d14/d44/d45/d6b/d29/dac/c102 0 2024-09-17T04:21:17.614 INFO:tasks.workunit.client.0.smithi088.stdout:6/763: rename d14/d44/d45/d6b/d16/f62 to d14/d44/f103 0 2024-09-17T04:21:17.614 INFO:tasks.workunit.client.0.smithi088.stdout:6/764: chown d14/d44/d45/d6b/d2a/l65 4177 1 2024-09-17T04:21:17.616 INFO:tasks.workunit.client.0.smithi088.stdout:6/765: creat d14/d2f/d87/d9d/f104 x:0 0 0 2024-09-17T04:21:17.625 INFO:tasks.workunit.client.0.smithi088.stdout:6/766: dwrite d14/d44/d45/d6b/d29/f38 [0,4194304] 0 2024-09-17T04:21:17.626 INFO:tasks.workunit.client.0.smithi088.stdout:8/696: dwrite d7/d29/d2a/d38/d3d/f78 [0,4194304] 0 2024-09-17T04:21:17.628 INFO:tasks.workunit.client.0.smithi088.stdout:8/697: read - d7/dd/d6f/fda zero size 2024-09-17T04:21:17.633 INFO:tasks.workunit.client.0.smithi088.stdout:1/722: dwrite d0/d1/df/d20/f49 [0,4194304] 0 2024-09-17T04:21:17.634 INFO:tasks.workunit.client.0.smithi088.stdout:6/767: mkdir d14/d44/d45/d6b/d29/dac/d105 0 2024-09-17T04:21:17.636 INFO:tasks.workunit.client.0.smithi088.stdout:8/698: creat d7/d29/d2a/d38/d3d/da0/da8/fe8 x:0 0 0 2024-09-17T04:21:17.639 INFO:tasks.workunit.client.0.smithi088.stdout:1/723: dread d0/d1/df/f10 [0,4194304] 0 2024-09-17T04:21:17.644 INFO:tasks.workunit.client.0.smithi088.stdout:1/724: dread d0/d1/df/f10 [0,4194304] 0 2024-09-17T04:21:17.645 INFO:tasks.workunit.client.0.smithi088.stdout:8/699: rename d7/c22 to d7/d29/ce9 0 2024-09-17T04:21:17.646 INFO:tasks.workunit.client.0.smithi088.stdout:8/700: dread - d7/dd/d31/d47/dc6/fd4 zero size 2024-09-17T04:21:17.649 INFO:tasks.workunit.client.0.smithi088.stdout:1/725: mkdir d0/d1/df/d20/dbd/dec 0 2024-09-17T04:21:17.649 INFO:tasks.workunit.client.0.smithi088.stdout:1/726: chown d0/d1/d16/d2a/fd1 1227 1 2024-09-17T04:21:17.654 INFO:tasks.workunit.client.0.smithi088.stdout:1/727: fdatasync d0/d1/d27/f40 0 2024-09-17T04:21:17.658 INFO:tasks.workunit.client.0.smithi088.stdout:6/768: write d14/d44/d45/d6b/d29/d3e/f73 [666528,93278] 0 2024-09-17T04:21:17.658 INFO:tasks.workunit.client.0.smithi088.stdout:1/728: write d0/d1/df/d63/fb5 [779922,50866] 0 2024-09-17T04:21:17.661 INFO:tasks.workunit.client.0.smithi088.stdout:1/729: fdatasync d0/d13/d84/fac 0 2024-09-17T04:21:17.661 INFO:tasks.workunit.client.0.smithi088.stdout:8/701: write d7/dd/f1a [3082707,12495] 0 2024-09-17T04:21:17.662 INFO:tasks.workunit.client.0.smithi088.stdout:6/769: mknod d14/d44/d45/d6b/da7/c106 0 2024-09-17T04:21:17.663 INFO:tasks.workunit.client.0.smithi088.stdout:1/730: mkdir d0/d1/d16/d77/ded 0 2024-09-17T04:21:17.664 INFO:tasks.workunit.client.0.smithi088.stdout:1/731: readlink d0/d1/d16/d2a/l89 0 2024-09-17T04:21:17.666 INFO:tasks.workunit.client.0.smithi088.stdout:6/770: creat d14/d44/d45/d6b/da7/f107 x:0 0 0 2024-09-17T04:21:17.671 INFO:tasks.workunit.client.0.smithi088.stdout:8/702: dwrite d7/dd/f56 [0,4194304] 0 2024-09-17T04:21:17.672 INFO:tasks.workunit.client.0.smithi088.stdout:8/703: chown d7 63632815 1 2024-09-17T04:21:17.673 INFO:tasks.workunit.client.0.smithi088.stdout:6/771: creat d14/d44/dad/dc0/f108 x:0 0 0 2024-09-17T04:21:17.676 INFO:tasks.workunit.client.0.smithi088.stdout:8/704: creat d7/d29/d2a/d38/daf/fea x:0 0 0 2024-09-17T04:21:17.678 INFO:tasks.workunit.client.0.smithi088.stdout:1/732: dwrite d0/d1/fde [0,4194304] 0 2024-09-17T04:21:17.680 INFO:tasks.workunit.client.0.smithi088.stdout:8/705: creat d7/d7f/feb x:0 0 0 2024-09-17T04:21:17.681 INFO:tasks.workunit.client.0.smithi088.stdout:1/733: truncate d0/d1/df/d63/f76 887436 0 2024-09-17T04:21:17.682 INFO:tasks.workunit.client.0.smithi088.stdout:8/706: chown d7/d7f/feb 1932449242 1 2024-09-17T04:21:17.685 INFO:tasks.workunit.client.0.smithi088.stdout:6/772: rmdir d14/d2f/de6 0 2024-09-17T04:21:17.688 INFO:tasks.workunit.client.0.smithi088.stdout:6/773: dread d14/d44/d45/d6b/d29/f38 [0,4194304] 0 2024-09-17T04:21:17.712 INFO:tasks.workunit.client.0.smithi088.stdout:8/707: getdents d7/dd/d31/dca/de6 0 2024-09-17T04:21:17.719 INFO:tasks.workunit.client.0.smithi088.stdout:8/708: mknod d7/dd/d31/d47/d55/d57/cec 0 2024-09-17T04:21:17.721 INFO:tasks.workunit.client.0.smithi088.stdout:1/734: write d0/d1/df/d63/f6f [541211,88605] 0 2024-09-17T04:21:17.722 INFO:tasks.workunit.client.0.smithi088.stdout:8/709: mknod d7/d29/d2a/d38/d3d/da0/da8/ced 0 2024-09-17T04:21:17.723 INFO:tasks.workunit.client.0.smithi088.stdout:8/710: readlink d7/l92 0 2024-09-17T04:21:17.725 INFO:tasks.workunit.client.0.smithi088.stdout:1/735: fdatasync d0/d1/df/d20/dbd/fca 0 2024-09-17T04:21:17.728 INFO:tasks.workunit.client.0.smithi088.stdout:8/711: creat d7/d29/d2a/d38/d3d/d63/fee x:0 0 0 2024-09-17T04:21:17.730 INFO:tasks.workunit.client.0.smithi088.stdout:6/774: dread d14/d44/d45/d6b/d2a/d52/fef [0,4194304] 0 2024-09-17T04:21:17.730 INFO:tasks.workunit.client.0.smithi088.stdout:1/736: dread - d0/d1/d16/d2a/d9c/dc8/fdb zero size 2024-09-17T04:21:17.735 INFO:tasks.workunit.client.0.smithi088.stdout:6/775: creat d14/dce/dfe/de0/f109 x:0 0 0 2024-09-17T04:21:17.735 INFO:tasks.workunit.client.0.smithi088.stdout:8/712: dwrite d7/dd/d31/fd7 [0,4194304] 0 2024-09-17T04:21:17.739 INFO:tasks.workunit.client.0.smithi088.stdout:1/737: rename d0/d1/d16/d35/f36 to d0/d1/df/d20/dbd/fee 0 2024-09-17T04:21:17.742 INFO:tasks.workunit.client.0.smithi088.stdout:6/776: unlink d14/d44/d94/db9/dc8/df7/cee 0 2024-09-17T04:21:17.745 INFO:tasks.workunit.client.0.smithi088.stdout:8/713: symlink d7/dd/d31/d47/lef 0 2024-09-17T04:21:17.750 INFO:tasks.workunit.client.0.smithi088.stdout:1/738: dwrite d0/d1/df/d20/f2e [4194304,4194304] 0 2024-09-17T04:21:17.755 INFO:tasks.workunit.client.0.smithi088.stdout:8/714: dwrite d7/dd/d31/d47/dc6/fd4 [0,4194304] 0 2024-09-17T04:21:17.760 INFO:tasks.workunit.client.0.smithi088.stdout:1/739: truncate d0/d13/d84/d5d/f72 982884 0 2024-09-17T04:21:17.761 INFO:tasks.workunit.client.0.smithi088.stdout:8/715: mkdir d7/d29/d2a/d75/df0 0 2024-09-17T04:21:17.762 INFO:tasks.workunit.client.0.smithi088.stdout:6/777: dwrite d14/d3a/fa8 [0,4194304] 0 2024-09-17T04:21:17.763 INFO:tasks.workunit.client.0.smithi088.stdout:1/740: unlink d0/d13/cb6 0 2024-09-17T04:21:17.764 INFO:tasks.workunit.client.0.smithi088.stdout:6/778: dread - d14/d44/d45/d6b/d2a/d52/fdc zero size 2024-09-17T04:21:17.765 INFO:tasks.workunit.client.0.smithi088.stdout:8/716: rmdir d7/dd/d6f/db6 39 2024-09-17T04:21:17.766 INFO:tasks.workunit.client.0.smithi088.stdout:1/741: truncate d0/d1/df/f3e 1304545 0 2024-09-17T04:21:17.767 INFO:tasks.workunit.client.0.smithi088.stdout:8/717: chown d7/d29/d2a/d3a/d79/fe0 483012376 1 2024-09-17T04:21:17.769 INFO:tasks.workunit.client.0.smithi088.stdout:6/779: symlink d14/d44/d45/d6b/d2a/d52/d7a/d7b/l10a 0 2024-09-17T04:21:17.770 INFO:tasks.workunit.client.0.smithi088.stdout:8/718: write d7/dd/d6f/fb9 [636454,75073] 0 2024-09-17T04:21:17.772 INFO:tasks.workunit.client.0.smithi088.stdout:8/719: write d7/dd/d31/f6d [4086891,53289] 0 2024-09-17T04:21:17.774 INFO:tasks.workunit.client.0.smithi088.stdout:1/742: creat d0/d1/df/d20/dbd/dec/fef x:0 0 0 2024-09-17T04:21:17.777 INFO:tasks.workunit.client.0.smithi088.stdout:6/780: dwrite d14/d44/f5d [4194304,4194304] 0 2024-09-17T04:21:17.777 INFO:tasks.workunit.client.0.smithi088.stdout:1/743: dread - d0/d1/d16/d2a/f53 zero size 2024-09-17T04:21:17.778 INFO:tasks.workunit.client.0.smithi088.stdout:6/781: dread - d14/d44/d45/d6b/da7/f107 zero size 2024-09-17T04:21:17.780 INFO:tasks.workunit.client.0.smithi088.stdout:6/782: creat d14/d44/f10b x:0 0 0 2024-09-17T04:21:17.783 INFO:tasks.workunit.client.0.smithi088.stdout:6/783: creat d14/d44/f10c x:0 0 0 2024-09-17T04:21:17.786 INFO:tasks.workunit.client.0.smithi088.stdout:6/784: read d14/d44/d45/d6b/d2a/d52/d7a/d7b/f7c [641570,84418] 0 2024-09-17T04:21:17.789 INFO:tasks.workunit.client.0.smithi088.stdout:6/785: rename d14/d44/d45/d6b/d29/ldd to d14/dce/l10d 0 2024-09-17T04:21:17.794 INFO:tasks.workunit.client.0.smithi088.stdout:6/786: dread d14/d44/dad/fcb [0,4194304] 0 2024-09-17T04:21:17.796 INFO:tasks.workunit.client.0.smithi088.stdout:8/720: write d7/f51 [1140140,8507] 0 2024-09-17T04:21:17.797 INFO:tasks.workunit.client.0.smithi088.stdout:6/787: unlink d14/d44/d45/d4d/c54 0 2024-09-17T04:21:17.799 INFO:tasks.workunit.client.0.smithi088.stdout:1/744: dread d0/d1/d16/d77/f8e [0,4194304] 0 2024-09-17T04:21:17.801 INFO:tasks.workunit.client.0.smithi088.stdout:8/721: link d7/dd/d31/f36 d7/dd/d31/dca/de6/ff1 0 2024-09-17T04:21:17.802 INFO:tasks.workunit.client.0.smithi088.stdout:1/745: mknod d0/d1/df/d20/cf0 0 2024-09-17T04:21:17.803 INFO:tasks.workunit.client.0.smithi088.stdout:8/722: truncate d7/d29/d2a/d38/d3d/f78 4683138 0 2024-09-17T04:21:17.803 INFO:tasks.workunit.client.0.smithi088.stdout:6/788: creat d14/d44/d45/d6b/d16/d42/f10e x:0 0 0 2024-09-17T04:21:17.805 INFO:tasks.workunit.client.0.smithi088.stdout:8/723: unlink d7/dd/f1a 0 2024-09-17T04:21:17.807 INFO:tasks.workunit.client.0.smithi088.stdout:6/789: mknod d14/d2f/d87/d9d/c10f 0 2024-09-17T04:21:17.808 INFO:tasks.workunit.client.0.smithi088.stdout:1/746: truncate d0/d13/d84/fac 2081477 0 2024-09-17T04:21:17.814 INFO:tasks.workunit.client.0.smithi088.stdout:1/747: mkdir d0/d1/df/d63/df1 0 2024-09-17T04:21:17.815 INFO:tasks.workunit.client.0.smithi088.stdout:1/748: creat d0/d1/d16/d35/ff2 x:0 0 0 2024-09-17T04:21:17.822 INFO:tasks.workunit.client.0.smithi088.stdout:6/790: dread d14/d3a/fe5 [0,4194304] 0 2024-09-17T04:21:17.880 INFO:tasks.workunit.client.0.smithi088.stdout:6/791: truncate d14/d44/d45/d6b/d2a/fa6 305145 0 2024-09-17T04:21:17.880 INFO:tasks.workunit.client.0.smithi088.stdout:7/735: sync 2024-09-17T04:21:17.880 INFO:tasks.workunit.client.0.smithi088.stdout:0/543: sync 2024-09-17T04:21:17.880 INFO:tasks.workunit.client.0.smithi088.stdout:3/728: sync 2024-09-17T04:21:17.881 INFO:tasks.workunit.client.0.smithi088.stdout:0/544: write db/fbb [473989,98345] 0 2024-09-17T04:21:17.881 INFO:tasks.workunit.client.0.smithi088.stdout:1/749: creat d0/d1/df/d20/ddf/dcb/ff3 x:0 0 0 2024-09-17T04:21:17.883 INFO:tasks.workunit.client.0.smithi088.stdout:7/736: mknod d2/d1d/d2e/db0/d23/d97/dbb/ce4 0 2024-09-17T04:21:17.888 INFO:tasks.workunit.client.0.smithi088.stdout:1/750: creat d0/d1/df/d20/dbd/dec/ff4 x:0 0 0 2024-09-17T04:21:17.889 INFO:tasks.workunit.client.0.smithi088.stdout:3/729: creat d0/feb x:0 0 0 2024-09-17T04:21:17.892 INFO:tasks.workunit.client.0.smithi088.stdout:0/545: dwrite db/d1b/f2b [0,4194304] 0 2024-09-17T04:21:17.894 INFO:tasks.workunit.client.0.smithi088.stdout:7/737: dwrite d2/d1d/d2e/fa0 [0,4194304] 0 2024-09-17T04:21:17.896 INFO:tasks.workunit.client.0.smithi088.stdout:1/751: truncate d0/d1/d16/d35/fd8 80627 0 2024-09-17T04:21:17.897 INFO:tasks.workunit.client.0.smithi088.stdout:6/792: dread d14/d44/d45/d6b/d2a/d52/f9b [0,4194304] 0 2024-09-17T04:21:17.903 INFO:tasks.workunit.client.0.smithi088.stdout:3/730: mknod d0/d13/d58/cec 0 2024-09-17T04:21:17.904 INFO:tasks.workunit.client.0.smithi088.stdout:1/752: mkdir d0/de3/df5 0 2024-09-17T04:21:17.906 INFO:tasks.workunit.client.0.smithi088.stdout:7/738: rename d2/d1d/d2e/db0/d23/d45/cb2 to d2/d96/dc2/ce5 0 2024-09-17T04:21:17.912 INFO:tasks.workunit.client.0.smithi088.stdout:1/753: rename d0/d1/d16/d77 to d0/d1/df/d85/da3/df6 0 2024-09-17T04:21:17.915 INFO:tasks.workunit.client.0.smithi088.stdout:7/739: unlink d2/d4/d7/ce 0 2024-09-17T04:21:17.915 INFO:tasks.workunit.client.0.smithi088.stdout:6/793: mknod d14/d44/d45/d6b/d2a/d52/d7a/d7b/ddf/c110 0 2024-09-17T04:21:17.918 INFO:tasks.workunit.client.0.smithi088.stdout:0/546: getdents db/d1b 0 2024-09-17T04:21:17.919 INFO:tasks.workunit.client.0.smithi088.stdout:1/754: write d0/d1/df/d20/ddf/faf [2080437,68878] 0 2024-09-17T04:21:17.920 INFO:tasks.workunit.client.0.smithi088.stdout:7/740: truncate d2/d1d/d2e/db0/f29 1294299 0 2024-09-17T04:21:17.925 INFO:tasks.workunit.client.0.smithi088.stdout:7/741: dwrite d2/d4/d7/f9f [0,4194304] 0 2024-09-17T04:21:17.930 INFO:tasks.workunit.client.0.smithi088.stdout:1/755: creat d0/d1/df/d63/ff7 x:0 0 0 2024-09-17T04:21:17.930 INFO:tasks.workunit.client.0.smithi088.stdout:3/731: write d0/d13/d1b/d29/d2b/fbc [5426,83982] 0 2024-09-17T04:21:17.931 INFO:tasks.workunit.client.0.smithi088.stdout:1/756: chown d0/d1/df/d20/dbd/dec 4114 1 2024-09-17T04:21:17.935 INFO:tasks.workunit.client.0.smithi088.stdout:0/547: mknod db/d1b/d36/d4a/d6a/cbf 0 2024-09-17T04:21:17.938 INFO:tasks.workunit.client.0.smithi088.stdout:1/757: rmdir d0/d1/df/d20/dbd/dec 39 2024-09-17T04:21:17.940 INFO:tasks.workunit.client.0.smithi088.stdout:3/732: read d0/fb0 [361702,21802] 0 2024-09-17T04:21:17.940 INFO:tasks.workunit.client.0.smithi088.stdout:3/733: stat d0/d13/f25 0 2024-09-17T04:21:17.941 INFO:tasks.workunit.client.0.smithi088.stdout:3/734: stat d0/d13/d58/dd7/dd4 0 2024-09-17T04:21:17.942 INFO:tasks.workunit.client.0.smithi088.stdout:6/794: rename d14/d44/d45/d6b/d16/f74 to d14/d44/d45/d6b/d2a/d52/d7a/f111 0 2024-09-17T04:21:17.942 INFO:tasks.workunit.client.0.smithi088.stdout:3/735: chown d0/d13/d58/fb1 19 1 2024-09-17T04:21:17.944 INFO:tasks.workunit.client.0.smithi088.stdout:1/758: creat d0/d1/d16/d2a/d9c/dc8/ff8 x:0 0 0 2024-09-17T04:21:17.946 INFO:tasks.workunit.client.0.smithi088.stdout:1/759: write d0/d13/f60 [3127406,82517] 0 2024-09-17T04:21:17.949 INFO:tasks.workunit.client.0.smithi088.stdout:6/795: mkdir d14/d44/d45/d6b/d16/d42/df3/d112 0 2024-09-17T04:21:17.949 INFO:tasks.workunit.client.0.smithi088.stdout:7/742: dread d2/d1d/d2e/db0/d23/d45/d85/f92 [0,4194304] 0 2024-09-17T04:21:17.953 INFO:tasks.workunit.client.0.smithi088.stdout:0/548: getdents db/d1b/d39 0 2024-09-17T04:21:17.955 INFO:tasks.workunit.client.0.smithi088.stdout:7/743: truncate d2/d1d/d2e/db0/f30 1596059 0 2024-09-17T04:21:17.956 INFO:tasks.workunit.client.0.smithi088.stdout:7/744: chown d2/d4/d7/la8 8143 1 2024-09-17T04:21:17.959 INFO:tasks.workunit.client.0.smithi088.stdout:7/745: creat d2/d1d/d2e/fe6 x:0 0 0 2024-09-17T04:21:17.959 INFO:tasks.workunit.client.0.smithi088.stdout:6/796: dwrite d14/d44/d45/fc7 [0,4194304] 0 2024-09-17T04:21:17.965 INFO:tasks.workunit.client.0.smithi088.stdout:6/797: mknod d14/d44/d94/db9/c113 0 2024-09-17T04:21:17.966 INFO:tasks.workunit.client.0.smithi088.stdout:6/798: dread - d14/dce/dfe/de0/f109 zero size 2024-09-17T04:21:17.969 INFO:tasks.workunit.client.0.smithi088.stdout:1/760: dwrite d0/d1/d16/d35/f43 [0,4194304] 0 2024-09-17T04:21:17.970 INFO:tasks.workunit.client.0.smithi088.stdout:1/761: chown d0/f28 11 1 2024-09-17T04:21:17.971 INFO:tasks.workunit.client.0.smithi088.stdout:6/799: mkdir d14/d44/d45/d6b/d16/d42/df3/d112/d114 0 2024-09-17T04:21:17.973 INFO:tasks.workunit.client.0.smithi088.stdout:3/736: dread d0/d13/d1b/d29/f3b [0,4194304] 0 2024-09-17T04:21:17.973 INFO:tasks.workunit.client.0.smithi088.stdout:1/762: mknod d0/d1/df/d20/dbd/cf9 0 2024-09-17T04:21:17.975 INFO:tasks.workunit.client.0.smithi088.stdout:6/800: rmdir d14/d44/d45/d6b/d2a/d52/d90 39 2024-09-17T04:21:17.978 INFO:tasks.workunit.client.0.smithi088.stdout:1/763: mknod d0/d1/d16/cfa 0 2024-09-17T04:21:17.979 INFO:tasks.workunit.client.0.smithi088.stdout:1/764: readlink d0/d13/l4c 0 2024-09-17T04:21:17.987 INFO:tasks.workunit.client.0.smithi088.stdout:1/765: dwrite d0/d1/df/d20/dbd/dec/ff4 [0,4194304] 0 2024-09-17T04:21:17.992 INFO:tasks.workunit.client.0.smithi088.stdout:3/737: write d0/d13/d58/d5e/f6a [231646,120184] 0 2024-09-17T04:21:17.997 INFO:tasks.workunit.client.0.smithi088.stdout:3/738: truncate d0/d13/d1b/d29/d30/d35/d65/fa7 3203436 0 2024-09-17T04:21:17.997 INFO:tasks.workunit.client.0.smithi088.stdout:7/746: dread d2/f60 [0,4194304] 0 2024-09-17T04:21:17.998 INFO:tasks.workunit.client.0.smithi088.stdout:3/739: fdatasync d0/d13/d1b/d29/d30/d3c/f94 0 2024-09-17T04:21:18.000 INFO:tasks.workunit.client.0.smithi088.stdout:7/747: symlink d2/d1d/d2e/db0/d23/d45/d62/d82/le7 0 2024-09-17T04:21:18.001 INFO:tasks.workunit.client.0.smithi088.stdout:7/748: write d2/d1d/d2e/db0/f5e [3977668,124863] 0 2024-09-17T04:21:18.002 INFO:tasks.workunit.client.0.smithi088.stdout:3/740: creat d0/d13/d1b/d29/d2b/d8b/fed x:0 0 0 2024-09-17T04:21:18.003 INFO:tasks.workunit.client.0.smithi088.stdout:3/741: chown d0/d54/d55 91667 1 2024-09-17T04:21:18.014 INFO:tasks.workunit.client.0.smithi088.stdout:1/766: dwrite d0/d1/df/d85/da3/df6/f8e [0,4194304] 0 2024-09-17T04:21:18.019 INFO:tasks.workunit.client.0.smithi088.stdout:1/767: creat d0/d1/df/d85/da3/de0/ffb x:0 0 0 2024-09-17T04:21:18.020 INFO:tasks.workunit.client.0.smithi088.stdout:7/749: write d2/d4/d7/f61 [1723211,82953] 0 2024-09-17T04:21:18.021 INFO:tasks.workunit.client.0.smithi088.stdout:1/768: creat d0/d1/d16/d35/ffc x:0 0 0 2024-09-17T04:21:18.024 INFO:tasks.workunit.client.0.smithi088.stdout:7/750: read d2/d1d/d2e/db0/f29 [526957,16814] 0 2024-09-17T04:21:18.024 INFO:tasks.workunit.client.0.smithi088.stdout:3/742: truncate d0/d13/d4d/f6c 1828117 0 2024-09-17T04:21:18.031 INFO:tasks.workunit.client.0.smithi088.stdout:7/751: mkdir d2/d4/d7/d46/d67/de8 0 2024-09-17T04:21:18.031 INFO:tasks.workunit.client.0.smithi088.stdout:1/769: write d0/d13/d84/fbb [803581,48552] 0 2024-09-17T04:21:18.036 INFO:tasks.workunit.client.0.smithi088.stdout:1/770: creat d0/d1/df/d85/da3/df6/d9e/ffd x:0 0 0 2024-09-17T04:21:18.037 INFO:tasks.workunit.client.0.smithi088.stdout:3/743: write d0/fb0 [3814119,22390] 0 2024-09-17T04:21:18.037 INFO:tasks.workunit.client.0.smithi088.stdout:1/771: write d0/d1/fa [1385909,114616] 0 2024-09-17T04:21:18.039 INFO:tasks.workunit.client.0.smithi088.stdout:1/772: read d0/d1/df/d85/da3/df6/d9e/fdc [321358,57955] 0 2024-09-17T04:21:18.040 INFO:tasks.workunit.client.0.smithi088.stdout:7/752: write d2/d4/d7/f10 [1204594,83701] 0 2024-09-17T04:21:18.042 INFO:tasks.workunit.client.0.smithi088.stdout:3/744: symlink d0/d13/d1b/d29/d30/d35/dcb/lee 0 2024-09-17T04:21:18.043 INFO:tasks.workunit.client.0.smithi088.stdout:1/773: mkdir d0/d1/df/d85/da3/df6/daa/dfe 0 2024-09-17T04:21:18.044 INFO:tasks.workunit.client.0.smithi088.stdout:3/745: dread d0/d54/f84 [0,4194304] 0 2024-09-17T04:21:18.044 INFO:tasks.workunit.client.0.smithi088.stdout:1/774: dread - d0/d13/d84/fc2 zero size 2024-09-17T04:21:18.045 INFO:tasks.workunit.client.0.smithi088.stdout:1/775: dread - d0/d13/d84/dcd/fd2 zero size 2024-09-17T04:21:18.045 INFO:tasks.workunit.client.0.smithi088.stdout:7/753: mknod d2/d96/db9/ce9 0 2024-09-17T04:21:18.048 INFO:tasks.workunit.client.0.smithi088.stdout:1/776: creat d0/d1/df/d63/fff x:0 0 0 2024-09-17T04:21:18.050 INFO:tasks.workunit.client.0.smithi088.stdout:1/777: chown d0/d1/df/d85/da3/df6/daa/d5b/d87/fb7 25452484 1 2024-09-17T04:21:18.050 INFO:tasks.workunit.client.0.smithi088.stdout:3/746: symlink d0/d13/d58/d5e/dc6/lef 0 2024-09-17T04:21:18.051 INFO:tasks.workunit.client.0.smithi088.stdout:1/778: chown d0/d1/df/d20/dbd/fc3 496380 1 2024-09-17T04:21:18.053 INFO:tasks.workunit.client.0.smithi088.stdout:3/747: dread - d0/d13/d1b/fc0 zero size 2024-09-17T04:21:18.056 INFO:tasks.workunit.client.0.smithi088.stdout:3/748: creat d0/d13/d1b/d29/d30/d3c/dc9/ff0 x:0 0 0 2024-09-17T04:21:18.058 INFO:tasks.workunit.client.0.smithi088.stdout:3/749: dread - d0/d13/d1b/d29/d2b/d50/fa5 zero size 2024-09-17T04:21:18.061 INFO:tasks.workunit.client.0.smithi088.stdout:3/750: symlink d0/d13/d1b/d29/lf1 0 2024-09-17T04:21:18.062 INFO:tasks.workunit.client.0.smithi088.stdout:1/779: write d0/d1/df/d85/da3/df6/daa/d5b/d87/f93 [1416241,47697] 0 2024-09-17T04:21:18.063 INFO:tasks.workunit.client.0.smithi088.stdout:7/754: dwrite d2/d1d/f58 [0,4194304] 0 2024-09-17T04:21:18.065 INFO:tasks.workunit.client.0.smithi088.stdout:1/780: chown d0/d1/df/d85/da3/df6/d9e/fd4 163938 1 2024-09-17T04:21:18.068 INFO:tasks.workunit.client.0.smithi088.stdout:7/755: symlink d2/d4/d7/lea 0 2024-09-17T04:21:18.069 INFO:tasks.workunit.client.0.smithi088.stdout:1/781: mknod d0/d1/d16/d2a/d9c/dc8/c100 0 2024-09-17T04:21:18.070 INFO:tasks.workunit.client.0.smithi088.stdout:1/782: write d0/d1/d16/d35/f69 [4993475,13310] 0 2024-09-17T04:21:18.072 INFO:tasks.workunit.client.0.smithi088.stdout:3/751: link d0/d13/d1b/d29/c31 d0/d13/d1b/d29/d30/d35/d65/cf2 0 2024-09-17T04:21:18.074 INFO:tasks.workunit.client.0.smithi088.stdout:7/756: rmdir d2/d8d/ddd 0 2024-09-17T04:21:18.075 INFO:tasks.workunit.client.0.smithi088.stdout:1/783: symlink d0/d1/df/d85/da3/df6/ded/l101 0 2024-09-17T04:21:18.076 INFO:tasks.workunit.client.0.smithi088.stdout:1/784: write d0/f4 [731469,28326] 0 2024-09-17T04:21:18.077 INFO:tasks.workunit.client.0.smithi088.stdout:3/752: creat d0/d13/d1b/d29/d2b/d40/ff3 x:0 0 0 2024-09-17T04:21:18.079 INFO:tasks.workunit.client.0.smithi088.stdout:7/757: creat d2/d1d/d2e/db0/d23/d45/d62/d82/feb x:0 0 0 2024-09-17T04:21:18.080 INFO:tasks.workunit.client.0.smithi088.stdout:3/753: rmdir d0/d13/d1b/d29/d2b 39 2024-09-17T04:21:18.080 INFO:tasks.workunit.client.0.smithi088.stdout:7/758: stat d2/d1d/d2e/db0/d23/d45/d62/d82/le7 0 2024-09-17T04:21:18.081 INFO:tasks.workunit.client.0.smithi088.stdout:7/759: readlink d2/laf 0 2024-09-17T04:21:18.081 INFO:tasks.workunit.client.0.smithi088.stdout:1/785: truncate d0/d1/df/d63/f9f 1095581 0 2024-09-17T04:21:18.082 INFO:tasks.workunit.client.0.smithi088.stdout:7/760: write d2/d4/d7/d46/d67/f75 [1900393,15075] 0 2024-09-17T04:21:18.083 INFO:tasks.workunit.client.0.smithi088.stdout:3/754: dread - d0/d13/d1b/d29/d2b/d50/f91 zero size 2024-09-17T04:21:18.085 INFO:tasks.workunit.client.0.smithi088.stdout:7/761: rmdir d2/d8d 39 2024-09-17T04:21:18.087 INFO:tasks.workunit.client.0.smithi088.stdout:3/755: truncate d0/d54/f84 1270137 0 2024-09-17T04:21:18.088 INFO:tasks.workunit.client.0.smithi088.stdout:1/786: truncate d0/d13/d84/d5d/f78 3907469 0 2024-09-17T04:21:18.092 INFO:tasks.workunit.client.0.smithi088.stdout:7/762: mknod d2/d8d/cec 0 2024-09-17T04:21:18.093 INFO:tasks.workunit.client.0.smithi088.stdout:7/763: stat d2/d1d/d2e/db0/d23/d45/d85 0 2024-09-17T04:21:18.093 INFO:tasks.workunit.client.0.smithi088.stdout:1/787: truncate d0/d1/df/d85/da3/df6/daa/d5b/d87/fb7 770468 0 2024-09-17T04:21:18.093 INFO:tasks.workunit.client.0.smithi088.stdout:7/764: getdents d2/d4/d7/d46/d67/de8 0 2024-09-17T04:21:18.093 INFO:tasks.workunit.client.0.smithi088.stdout:1/788: chown d0/d1/df/d85/ccf 410118 1 2024-09-17T04:21:18.094 INFO:tasks.workunit.client.0.smithi088.stdout:7/765: creat d2/d96/dc2/fed x:0 0 0 2024-09-17T04:21:18.098 INFO:tasks.workunit.client.0.smithi088.stdout:7/766: creat d2/fee x:0 0 0 2024-09-17T04:21:18.099 INFO:tasks.workunit.client.0.smithi088.stdout:7/767: rmdir d2/d79 39 2024-09-17T04:21:18.100 INFO:tasks.workunit.client.0.smithi088.stdout:3/756: dread d0/d13/d58/d5e/fb5 [0,4194304] 0 2024-09-17T04:21:18.105 INFO:tasks.workunit.client.0.smithi088.stdout:3/757: unlink d0/d13/d1b/fc0 0 2024-09-17T04:21:18.106 INFO:tasks.workunit.client.0.smithi088.stdout:7/768: mknod d2/d1d/d2e/db0/d23/d45/d62/cef 0 2024-09-17T04:21:18.106 INFO:tasks.workunit.client.0.smithi088.stdout:3/758: mknod d0/d13/d58/d5a/d63/cf4 0 2024-09-17T04:21:18.108 INFO:tasks.workunit.client.0.smithi088.stdout:3/759: creat d0/d13/d1b/d29/d30/ff5 x:0 0 0 2024-09-17T04:21:18.109 INFO:tasks.workunit.client.0.smithi088.stdout:3/760: chown d0/d13/d58/d5a/f8c 4112 1 2024-09-17T04:21:18.112 INFO:tasks.workunit.client.0.smithi088.stdout:3/761: dread d0/d13/f25 [0,4194304] 0 2024-09-17T04:21:18.114 INFO:tasks.workunit.client.0.smithi088.stdout:3/762: rmdir d0/d13/d58/d5a 39 2024-09-17T04:21:18.115 INFO:tasks.workunit.client.0.smithi088.stdout:3/763: write d0/d13/d1b/d29/d30/d3c/d5c/f96 [850275,79782] 0 2024-09-17T04:21:18.117 INFO:tasks.workunit.client.0.smithi088.stdout:3/764: rename d0/d13/d1b/d29/d2b/d40/l7a to d0/d54/d55/lf6 0 2024-09-17T04:21:18.120 INFO:tasks.workunit.client.0.smithi088.stdout:3/765: link d0/d13/d4d/f6c d0/d13/d58/d5e/dc6/dcd/ff7 0 2024-09-17T04:21:18.121 INFO:tasks.workunit.client.0.smithi088.stdout:3/766: dread - d0/d13/d58/dd7/fd0 zero size 2024-09-17T04:21:18.123 INFO:tasks.workunit.client.0.smithi088.stdout:3/767: symlink d0/d13/d1b/d29/d56/d85/lf8 0 2024-09-17T04:21:18.151 INFO:tasks.workunit.client.0.smithi088.stdout:1/789: dwrite d0/d13/d84/d5d/f72 [0,4194304] 0 2024-09-17T04:21:18.155 INFO:tasks.workunit.client.0.smithi088.stdout:1/790: creat d0/d1/f102 x:0 0 0 2024-09-17T04:21:18.156 INFO:tasks.workunit.client.0.smithi088.stdout:1/791: readlink d0/d1/d16/d2a/l31 0 2024-09-17T04:21:18.158 INFO:tasks.workunit.client.0.smithi088.stdout:3/768: dwrite d0/d13/d1b/d29/d30/d35/d65/fa7 [0,4194304] 0 2024-09-17T04:21:18.165 INFO:tasks.workunit.client.0.smithi088.stdout:1/792: truncate d0/d1/df/d20/dbd/fee 5232933 0 2024-09-17T04:21:18.167 INFO:tasks.workunit.client.0.smithi088.stdout:3/769: rename d0/d13/d58/dd7/fd0 to d0/d13/d1b/d29/d30/ff9 0 2024-09-17T04:21:18.174 INFO:tasks.workunit.client.0.smithi088.stdout:1/793: dwrite d0/d13/f47 [0,4194304] 0 2024-09-17T04:21:18.175 INFO:tasks.workunit.client.0.smithi088.stdout:1/794: write d0/d1/fe [3999190,53404] 0 2024-09-17T04:21:18.200 INFO:tasks.workunit.client.0.smithi088.stdout:3/770: write d0/d13/d1b/d29/d2b/d50/fb4 [432845,72491] 0 2024-09-17T04:21:18.204 INFO:tasks.workunit.client.0.smithi088.stdout:3/771: mknod d0/dae/de5/cfa 0 2024-09-17T04:21:18.207 INFO:tasks.workunit.client.0.smithi088.stdout:3/772: fdatasync d0/d13/d58/fe4 0 2024-09-17T04:21:18.208 INFO:tasks.workunit.client.0.smithi088.stdout:1/795: dwrite d0/d1/d16/d2a/f64 [0,4194304] 0 2024-09-17T04:21:18.209 INFO:tasks.workunit.client.0.smithi088.stdout:3/773: dread - d0/d13/d1b/d29/fea zero size 2024-09-17T04:21:18.209 INFO:tasks.workunit.client.0.smithi088.stdout:1/796: chown d0/d1/fda 222 1 2024-09-17T04:21:18.210 INFO:tasks.workunit.client.0.smithi088.stdout:1/797: write d0/de3/fc9 [83110,51600] 0 2024-09-17T04:21:18.211 INFO:tasks.workunit.client.0.smithi088.stdout:1/798: readlink d0/d1/d16/d2a/d9c/lce 0 2024-09-17T04:21:18.212 INFO:tasks.workunit.client.0.smithi088.stdout:1/799: fdatasync d0/d1/fda 0 2024-09-17T04:21:18.214 INFO:tasks.workunit.client.0.smithi088.stdout:1/800: stat d0/d1/df/d20/dbd/dec/ff4 0 2024-09-17T04:21:18.222 INFO:tasks.workunit.client.0.smithi088.stdout:1/801: write d0/d1/d16/d2a/f9b [1144860,55841] 0 2024-09-17T04:21:18.229 INFO:tasks.workunit.client.0.smithi088.stdout:1/802: dwrite d0/d1/df/f3e [0,4194304] 0 2024-09-17T04:21:18.230 INFO:tasks.workunit.client.0.smithi088.stdout:1/803: chown d0/d1/df/d20 134 1 2024-09-17T04:21:18.232 INFO:tasks.workunit.client.0.smithi088.stdout:1/804: mkdir d0/d1/de7/d103 0 2024-09-17T04:21:18.234 INFO:tasks.workunit.client.0.smithi088.stdout:1/805: write d0/d1/df/f10 [91086,112179] 0 2024-09-17T04:21:18.255 INFO:tasks.workunit.client.0.smithi088.stdout:1/806: dread d0/f94 [0,4194304] 0 2024-09-17T04:21:18.256 INFO:tasks.workunit.client.0.smithi088.stdout:1/807: fsync d0/d1/df/d20/dbd/dec/fef 0 2024-09-17T04:21:18.257 INFO:tasks.workunit.client.0.smithi088.stdout:1/808: creat d0/d1/d27/f104 x:0 0 0 2024-09-17T04:21:18.263 INFO:tasks.workunit.client.0.smithi088.stdout:1/809: dwrite d0/d1/df/f3e [0,4194304] 0 2024-09-17T04:21:18.265 INFO:tasks.workunit.client.0.smithi088.stdout:1/810: read d0/d13/d84/f59 [121245,44009] 0 2024-09-17T04:21:18.270 INFO:tasks.workunit.client.0.smithi088.stdout:1/811: mkdir d0/d1/df/dbe/d105 0 2024-09-17T04:21:18.270 INFO:tasks.workunit.client.0.smithi088.stdout:1/812: chown d0/d13/f54 804489036 1 2024-09-17T04:21:18.272 INFO:tasks.workunit.client.0.smithi088.stdout:1/813: mknod d0/d1/df/d20/ddf/c106 0 2024-09-17T04:21:18.276 INFO:tasks.workunit.client.0.smithi088.stdout:1/814: dread d0/d1/df/d63/fb5 [0,4194304] 0 2024-09-17T04:21:18.277 INFO:tasks.workunit.client.0.smithi088.stdout:1/815: chown d0/d1/d16/d35/c4b 1639 1 2024-09-17T04:21:18.278 INFO:tasks.workunit.client.0.smithi088.stdout:1/816: symlink d0/d1/df/d20/l107 0 2024-09-17T04:21:18.279 INFO:tasks.workunit.client.0.smithi088.stdout:1/817: readlink d0/d1/df/l1d 0 2024-09-17T04:21:18.281 INFO:tasks.workunit.client.0.smithi088.stdout:1/818: mkdir d0/d1/d27/d108 0 2024-09-17T04:21:18.282 INFO:tasks.workunit.client.0.smithi088.stdout:1/819: write d0/d1/df/d20/f49 [1326677,33376] 0 2024-09-17T04:21:18.288 INFO:tasks.workunit.client.0.smithi088.stdout:1/820: rename d0/d1/d16/d2a/d9c/dc8/fb2 to d0/d1/df/d85/da3/df6/daa/d5b/f109 0 2024-09-17T04:21:18.289 INFO:tasks.workunit.client.0.smithi088.stdout:1/821: creat d0/de3/df5/f10a x:0 0 0 2024-09-17T04:21:18.293 INFO:tasks.workunit.client.0.smithi088.stdout:1/822: getdents d0/d1/df/d85/da3/df6/daa 0 2024-09-17T04:21:18.294 INFO:tasks.workunit.client.0.smithi088.stdout:1/823: dread - d0/d1/de7/fea zero size 2024-09-17T04:21:18.296 INFO:tasks.workunit.client.0.smithi088.stdout:1/824: symlink d0/d1/d16/d2a/d9c/dc8/l10b 0 2024-09-17T04:21:18.299 INFO:tasks.workunit.client.0.smithi088.stdout:1/825: link d0/d1/df/d63/f6f d0/d1/df/d85/da3/df6/daa/d5b/d87/f10c 0 2024-09-17T04:21:18.310 INFO:tasks.workunit.client.0.smithi088.stdout:1/826: dread d0/d1/df/d85/da3/df6/daa/d5b/f82 [0,4194304] 0 2024-09-17T04:21:18.313 INFO:tasks.workunit.client.0.smithi088.stdout:1/827: symlink d0/d1/df/d85/da3/df6/ded/l10d 0 2024-09-17T04:21:18.318 INFO:tasks.workunit.client.0.smithi088.stdout:1/828: dwrite d0/d1/df/d20/dbd/dec/fef [0,4194304] 0 2024-09-17T04:21:18.323 INFO:tasks.workunit.client.0.smithi088.stdout:1/829: creat d0/d1/d27/d108/f10e x:0 0 0 2024-09-17T04:21:18.324 INFO:tasks.workunit.client.0.smithi088.stdout:1/830: readlink d0/d1/df/d85/da3/df6/daa/d5b/d87/lc4 0 2024-09-17T04:21:18.338 INFO:tasks.workunit.client.0.smithi088.stdout:1/831: dwrite d0/d1/df/d85/da3/df6/daa/d5b/f109 [0,4194304] 0 2024-09-17T04:21:18.339 INFO:tasks.workunit.client.0.smithi088.stdout:1/832: fsync d0/d1/d16/d2a/fd1 0 2024-09-17T04:21:18.340 INFO:tasks.workunit.client.0.smithi088.stdout:1/833: write d0/d1/fda [5448972,10618] 0 2024-09-17T04:21:18.346 INFO:tasks.workunit.client.0.smithi088.stdout:1/834: unlink d0/d13/d84/f59 0 2024-09-17T04:21:18.349 INFO:tasks.workunit.client.0.smithi088.stdout:1/835: mkdir d0/d1/df/d85/da3/d10f 0 2024-09-17T04:21:18.349 INFO:tasks.workunit.client.0.smithi088.stdout:1/836: fsync d0/d1/f102 0 2024-09-17T04:21:18.350 INFO:tasks.workunit.client.0.smithi088.stdout:1/837: write d0/d1/df/f3e [1172093,40377] 0 2024-09-17T04:21:18.351 INFO:tasks.workunit.client.0.smithi088.stdout:1/838: truncate d0/f4 7630479 0 2024-09-17T04:21:18.352 INFO:tasks.workunit.client.0.smithi088.stdout:1/839: write d0/d1/df/d85/da3/de0/ffb [759155,124288] 0 2024-09-17T04:21:18.353 INFO:tasks.workunit.client.0.smithi088.stdout:1/840: readlink d0/d1/df/d85/da3/df6/ld3 0 2024-09-17T04:21:18.358 INFO:tasks.workunit.client.0.smithi088.stdout:5/699: sync 2024-09-17T04:21:18.358 INFO:tasks.workunit.client.0.smithi088.stdout:4/646: sync 2024-09-17T04:21:18.358 INFO:tasks.workunit.client.0.smithi088.stdout:2/749: sync 2024-09-17T04:21:18.359 INFO:tasks.workunit.client.0.smithi088.stdout:2/750: write d0/d1/d2d/dbd/fbf [821232,91240] 0 2024-09-17T04:21:18.360 INFO:tasks.workunit.client.0.smithi088.stdout:5/700: creat d2/da9/fe5 x:0 0 0 2024-09-17T04:21:18.363 INFO:tasks.workunit.client.0.smithi088.stdout:4/647: dread d5/d32/d6b/f86 [0,4194304] 0 2024-09-17T04:21:18.364 INFO:tasks.workunit.client.0.smithi088.stdout:5/701: creat d2/d31/d33/d20/d30/d51/d5e/d6b/fe6 x:0 0 0 2024-09-17T04:21:18.370 INFO:tasks.workunit.client.0.smithi088.stdout:5/702: rename d2/d31/d33/d20/d47/de0/da5/fd2 to d2/d31/d33/d20/d25/d2c/fe7 0 2024-09-17T04:21:18.376 INFO:tasks.workunit.client.0.smithi088.stdout:5/703: rmdir d2/d31/d33/d20/d25/d2c/d8a/dc6/dde 0 2024-09-17T04:21:18.378 INFO:tasks.workunit.client.0.smithi088.stdout:4/648: dread d5/f2a [0,4194304] 0 2024-09-17T04:21:18.378 INFO:tasks.workunit.client.0.smithi088.stdout:2/751: truncate d0/d1/d2d/d33/d4b/d24/d3b/fc8 407122 0 2024-09-17T04:21:18.379 INFO:tasks.workunit.client.0.smithi088.stdout:4/649: readlink d5/d3f/d71/d8b/l93 0 2024-09-17T04:21:18.381 INFO:tasks.workunit.client.0.smithi088.stdout:5/704: rename d2/d31/d33/l1a to d2/d31/d33/d20/d30/d51/d5e/le8 0 2024-09-17T04:21:18.383 INFO:tasks.workunit.client.0.smithi088.stdout:5/705: truncate d2/d31/d33/d20/d30/f7b 453595 0 2024-09-17T04:21:18.383 INFO:tasks.workunit.client.0.smithi088.stdout:2/752: symlink d0/d1/d2d/d33/d4b/le7 0 2024-09-17T04:21:18.385 INFO:tasks.workunit.client.0.smithi088.stdout:5/706: readlink d2/d31/ldf 0 2024-09-17T04:21:18.387 INFO:tasks.workunit.client.0.smithi088.stdout:5/707: creat d2/da9/fe9 x:0 0 0 2024-09-17T04:21:18.388 INFO:tasks.workunit.client.0.smithi088.stdout:2/753: mkdir d0/d13/dd1/de8 0 2024-09-17T04:21:18.395 INFO:tasks.workunit.client.0.smithi088.stdout:2/754: rename d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/d7c/f9b to d0/d1/d2d/d33/d4b/d6d/fe9 0 2024-09-17T04:21:18.395 INFO:tasks.workunit.client.0.smithi088.stdout:5/708: dwrite d2/d31/d33/d20/d25/d2c/fe7 [0,4194304] 0 2024-09-17T04:21:18.399 INFO:tasks.workunit.client.0.smithi088.stdout:5/709: readlink d2/d31/d33/d20/d30/d51/l6d 0 2024-09-17T04:21:18.401 INFO:tasks.workunit.client.0.smithi088.stdout:2/755: symlink d0/d1/d2d/d33/d4b/lea 0 2024-09-17T04:21:18.401 INFO:tasks.workunit.client.0.smithi088.stdout:5/710: write d2/d31/d33/d20/d30/d51/d5e/f74 [3654988,25928] 0 2024-09-17T04:21:18.404 INFO:tasks.workunit.client.0.smithi088.stdout:4/650: dwrite d5/d3d/f80 [0,4194304] 0 2024-09-17T04:21:18.405 INFO:tasks.workunit.client.0.smithi088.stdout:2/756: chown d0/d1/d2d/d33/d4b/d24/d3b/d26/f8d 3739507 1 2024-09-17T04:21:18.410 INFO:tasks.workunit.client.0.smithi088.stdout:4/651: symlink d5/d72/ld6 0 2024-09-17T04:21:18.412 INFO:tasks.workunit.client.0.smithi088.stdout:5/711: dwrite d2/d31/d33/f54 [0,4194304] 0 2024-09-17T04:21:18.413 INFO:tasks.workunit.client.0.smithi088.stdout:2/757: rename d0/d1/d2d/d33/d4b/d24/d3b/f1f to d0/d1/d2d/d33/d4b/d24/d3b/d26/feb 0 2024-09-17T04:21:18.415 INFO:tasks.workunit.client.0.smithi088.stdout:2/758: chown d0/d1/d2d/d33/d4b/d24/d3b/d22/c45 1370 1 2024-09-17T04:21:18.416 INFO:tasks.workunit.client.0.smithi088.stdout:5/712: write d2/d31/d33/d20/d25/fb0 [569595,121284] 0 2024-09-17T04:21:18.417 INFO:tasks.workunit.client.0.smithi088.stdout:2/759: stat d0/d1/d2d/d33/d4b/c29 0 2024-09-17T04:21:18.419 INFO:tasks.workunit.client.0.smithi088.stdout:2/760: creat d0/d13/fec x:0 0 0 2024-09-17T04:21:18.422 INFO:tasks.workunit.client.0.smithi088.stdout:2/761: fdatasync d0/d1/d2d/d33/d4b/d24/d3b/fb7 0 2024-09-17T04:21:18.424 INFO:tasks.workunit.client.0.smithi088.stdout:2/762: write d0/d13/fec [379836,39145] 0 2024-09-17T04:21:18.434 INFO:tasks.workunit.client.0.smithi088.stdout:4/652: write d5/f4e [1007836,17158] 0 2024-09-17T04:21:18.435 INFO:tasks.workunit.client.0.smithi088.stdout:4/653: chown d5/d3f/d71/l7f 7514190 1 2024-09-17T04:21:18.437 INFO:tasks.workunit.client.0.smithi088.stdout:4/654: symlink d5/d3d/d73/ld7 0 2024-09-17T04:21:18.438 INFO:tasks.workunit.client.0.smithi088.stdout:5/713: dread d2/f40 [0,4194304] 0 2024-09-17T04:21:18.440 INFO:tasks.workunit.client.0.smithi088.stdout:5/714: mkdir d2/d31/d33/d20/d30/dea 0 2024-09-17T04:21:18.442 INFO:tasks.workunit.client.0.smithi088.stdout:4/655: getdents d5/d3f/d71/d8b 0 2024-09-17T04:21:18.444 INFO:tasks.workunit.client.0.smithi088.stdout:2/763: dread d0/d1/d2d/d33/d4b/d24/d3b/f54 [4194304,4194304] 0 2024-09-17T04:21:18.444 INFO:tasks.workunit.client.0.smithi088.stdout:5/715: rename d2/d31/d33/d20/d30/d51/d5e/f74 to d2/d31/dd5/feb 0 2024-09-17T04:21:18.445 INFO:tasks.workunit.client.0.smithi088.stdout:5/716: chown d2/d31/d33/d20/d30/d51/d5e/d6b/l8c 222768 1 2024-09-17T04:21:18.446 INFO:tasks.workunit.client.0.smithi088.stdout:4/656: mkdir d5/d3f/d71/dd8 0 2024-09-17T04:21:18.448 INFO:tasks.workunit.client.0.smithi088.stdout:5/717: read d2/d31/d33/fa [129536,40294] 0 2024-09-17T04:21:18.448 INFO:tasks.workunit.client.0.smithi088.stdout:4/657: stat d5/d3f/d71/f91 0 2024-09-17T04:21:18.451 INFO:tasks.workunit.client.0.smithi088.stdout:2/764: dwrite d0/d1/d2d/d33/d4b/d24/d3b/d22/dba/fc2 [0,4194304] 0 2024-09-17T04:21:18.462 INFO:tasks.workunit.client.0.smithi088.stdout:4/658: link d5/c5c d5/d3f/d71/d8b/d68/dab/dbb/cd9 0 2024-09-17T04:21:18.466 INFO:tasks.workunit.client.0.smithi088.stdout:2/765: mknod d0/d1/d2d/d33/d4b/d6d/d94/da5/de3/ced 0 2024-09-17T04:21:18.467 INFO:tasks.workunit.client.0.smithi088.stdout:4/659: creat d5/d3f/d71/dd8/fda x:0 0 0 2024-09-17T04:21:18.468 INFO:tasks.workunit.client.0.smithi088.stdout:4/660: chown d5/l12 1538 1 2024-09-17T04:21:18.470 INFO:tasks.workunit.client.0.smithi088.stdout:4/661: truncate d5/d32/d6b/fd4 832499 0 2024-09-17T04:21:18.470 INFO:tasks.workunit.client.0.smithi088.stdout:4/662: chown d5/d3f 924547 1 2024-09-17T04:21:18.471 INFO:tasks.workunit.client.0.smithi088.stdout:2/766: getdents d0/d1/d2d 0 2024-09-17T04:21:18.472 INFO:tasks.workunit.client.0.smithi088.stdout:2/767: stat d0/d13/dd1 0 2024-09-17T04:21:18.473 INFO:tasks.workunit.client.0.smithi088.stdout:4/663: creat d5/d3f/fdb x:0 0 0 2024-09-17T04:21:18.476 INFO:tasks.workunit.client.0.smithi088.stdout:5/718: dwrite d2/d31/d33/d20/d30/d51/d5e/f7a [0,4194304] 0 2024-09-17T04:21:18.478 INFO:tasks.workunit.client.0.smithi088.stdout:5/719: write d2/d31/d33/d20/d30/d51/fc8 [868807,106016] 0 2024-09-17T04:21:18.479 INFO:tasks.workunit.client.0.smithi088.stdout:4/664: read d5/d32/d6b/f8c [332533,67527] 0 2024-09-17T04:21:18.480 INFO:tasks.workunit.client.0.smithi088.stdout:2/768: rename d0/l4 to d0/d1/lee 0 2024-09-17T04:21:18.490 INFO:tasks.workunit.client.0.smithi088.stdout:4/665: chown d5/d3f/d71/d8b/d68/da4/d5e/f6a 1533156 1 2024-09-17T04:21:18.493 INFO:tasks.workunit.client.0.smithi088.stdout:4/666: rename d5/d32/cad to d5/d3f/d71/dd8/cdc 0 2024-09-17T04:21:18.494 INFO:tasks.workunit.client.0.smithi088.stdout:2/769: dwrite d0/d1/d2d/d33/d4b/d24/d3b/d22/f64 [0,4194304] 0 2024-09-17T04:21:18.497 INFO:tasks.workunit.client.0.smithi088.stdout:2/770: mkdir d0/d13/dd1/def 0 2024-09-17T04:21:18.500 INFO:tasks.workunit.client.0.smithi088.stdout:4/667: creat d5/d3f/d71/d8b/d68/da4/fdd x:0 0 0 2024-09-17T04:21:18.501 INFO:tasks.workunit.client.0.smithi088.stdout:4/668: chown d5/d3f/d71/d8b/d75 47 1 2024-09-17T04:21:18.502 INFO:tasks.workunit.client.0.smithi088.stdout:2/771: symlink d0/d1/d2d/d33/d4b/d6d/d94/da5/de3/lf0 0 2024-09-17T04:21:18.503 INFO:tasks.workunit.client.0.smithi088.stdout:4/669: read d5/f1f [2248068,71446] 0 2024-09-17T04:21:18.504 INFO:tasks.workunit.client.0.smithi088.stdout:5/720: dread d2/fc5 [0,4194304] 0 2024-09-17T04:21:18.507 INFO:tasks.workunit.client.0.smithi088.stdout:4/670: creat d5/dcd/fde x:0 0 0 2024-09-17T04:21:18.514 INFO:tasks.workunit.client.0.smithi088.stdout:5/721: dread d2/d31/d33/d20/d25/d2c/f72 [0,4194304] 0 2024-09-17T04:21:18.515 INFO:tasks.workunit.client.0.smithi088.stdout:5/722: write d2/d31/d33/d20/d25/d49/f96 [4120486,90115] 0 2024-09-17T04:21:18.521 INFO:tasks.workunit.client.0.smithi088.stdout:5/723: unlink d2/d31/d33/d20/d47/de0/l69 0 2024-09-17T04:21:18.521 INFO:tasks.workunit.client.0.smithi088.stdout:2/772: truncate d0/d1/d2d/f53 598073 0 2024-09-17T04:21:18.521 INFO:tasks.workunit.client.0.smithi088.stdout:5/724: stat d2/d31/d33/f21 0 2024-09-17T04:21:18.526 INFO:tasks.workunit.client.0.smithi088.stdout:2/773: creat d0/d1/d2d/d33/d4b/d24/d4d/ff1 x:0 0 0 2024-09-17T04:21:18.529 INFO:tasks.workunit.client.0.smithi088.stdout:5/725: dwrite d2/d31/d33/d20/d25/d2c/d8a/fc2 [0,4194304] 0 2024-09-17T04:21:18.530 INFO:tasks.workunit.client.0.smithi088.stdout:4/671: dwrite d5/d72/f74 [0,4194304] 0 2024-09-17T04:21:18.531 INFO:tasks.workunit.client.0.smithi088.stdout:5/726: chown d2/d31/d33/d20/d25/l42 1597 1 2024-09-17T04:21:18.535 INFO:tasks.workunit.client.0.smithi088.stdout:2/774: rmdir d0/d1/d2d/dbd 39 2024-09-17T04:21:18.536 INFO:tasks.workunit.client.0.smithi088.stdout:2/775: fdatasync d0/d1/d2d/d33/d4b/d6d/d94/fb1 0 2024-09-17T04:21:18.538 INFO:tasks.workunit.client.0.smithi088.stdout:4/672: symlink d5/d32/d6b/ldf 0 2024-09-17T04:21:18.542 INFO:tasks.workunit.client.0.smithi088.stdout:5/727: creat d2/d31/d33/d20/d47/de0/da5/fec x:0 0 0 2024-09-17T04:21:18.544 INFO:tasks.workunit.client.0.smithi088.stdout:4/673: rmdir d5/d32/d6b 39 2024-09-17T04:21:18.549 INFO:tasks.workunit.client.0.smithi088.stdout:4/674: unlink f1 0 2024-09-17T04:21:18.549 INFO:tasks.workunit.client.0.smithi088.stdout:2/776: dwrite d0/d1/d2d/dbd/fbf [0,4194304] 0 2024-09-17T04:21:18.549 INFO:tasks.workunit.client.0.smithi088.stdout:4/675: readlink d5/d72/ld6 0 2024-09-17T04:21:18.550 INFO:tasks.workunit.client.0.smithi088.stdout:5/728: symlink d2/d31/d33/d20/led 0 2024-09-17T04:21:18.552 INFO:tasks.workunit.client.0.smithi088.stdout:2/777: readlink d0/d1/d2d/d33/d4b/d24/d92/l96 0 2024-09-17T04:21:18.559 INFO:tasks.workunit.client.0.smithi088.stdout:5/729: mkdir d2/d31/d33/d20/d25/d2c/d8a/db2/dc3/dee 0 2024-09-17T04:21:18.574 INFO:tasks.workunit.client.0.smithi088.stdout:4/676: dwrite d5/d32/d6b/f8c [0,4194304] 0 2024-09-17T04:21:18.579 INFO:tasks.workunit.client.0.smithi088.stdout:4/677: dread - d5/d3f/d71/d8b/d68/da4/f8a zero size 2024-09-17T04:21:18.580 INFO:tasks.workunit.client.0.smithi088.stdout:4/678: chown d5/dcd/cd5 30 1 2024-09-17T04:21:18.581 INFO:tasks.workunit.client.0.smithi088.stdout:5/730: creat d2/d31/d33/d20/d30/d51/fef x:0 0 0 2024-09-17T04:21:18.582 INFO:tasks.workunit.client.0.smithi088.stdout:2/778: getdents d0/d1/d2d/d33/d4b/d6d/d94/da5/de3 0 2024-09-17T04:21:18.584 INFO:tasks.workunit.client.0.smithi088.stdout:4/679: creat d5/d3f/d71/d99/fe0 x:0 0 0 2024-09-17T04:21:18.585 INFO:tasks.workunit.client.0.smithi088.stdout:2/779: rmdir d0/d1 39 2024-09-17T04:21:18.588 INFO:tasks.workunit.client.0.smithi088.stdout:4/680: symlink d5/d3f/d71/d8b/d68/dab/dbb/le1 0 2024-09-17T04:21:18.590 INFO:tasks.workunit.client.0.smithi088.stdout:2/780: dwrite d0/d13/fec [0,4194304] 0 2024-09-17T04:21:18.611 INFO:tasks.workunit.client.0.smithi088.stdout:2/781: mknod d0/d1/d2d/d33/d4b/d24/d3b/cf2 0 2024-09-17T04:21:18.615 INFO:tasks.workunit.client.0.smithi088.stdout:2/782: dread d0/d1/d2d/d33/d80/f40 [0,4194304] 0 2024-09-17T04:21:18.619 INFO:tasks.workunit.client.0.smithi088.stdout:4/681: dread d5/d3d/f7a [0,4194304] 0 2024-09-17T04:21:18.621 INFO:tasks.workunit.client.0.smithi088.stdout:2/783: dwrite d0/d1/d2d/d33/d4b/d24/d3b/d22/dba/fc2 [0,4194304] 0 2024-09-17T04:21:18.664 INFO:tasks.workunit.client.0.smithi088.stdout:2/784: rmdir d0/d1/d2d/d33/d4b/d6d/d94/da5 39 2024-09-17T04:21:18.727 INFO:tasks.workunit.client.0.smithi088.stdout:9/848: sync 2024-09-17T04:21:18.727 INFO:tasks.workunit.client.0.smithi088.stdout:9/849: read - d2/dd/d14/d2a/d76/d98/db3/fc9 zero size 2024-09-17T04:21:18.771 INFO:tasks.workunit.client.0.smithi088.stdout:9/850: symlink d2/dd/d14/l125 0 2024-09-17T04:21:18.773 INFO:tasks.workunit.client.0.smithi088.stdout:4/682: dwrite d5/d32/d6b/f86 [0,4194304] 0 2024-09-17T04:21:18.773 INFO:tasks.workunit.client.0.smithi088.stdout:2/785: getdents d0/d1/d2d/d33 0 2024-09-17T04:21:18.779 INFO:tasks.workunit.client.0.smithi088.stdout:4/683: write d5/d3f/fd3 [528754,6550] 0 2024-09-17T04:21:18.781 INFO:tasks.workunit.client.0.smithi088.stdout:2/786: dwrite d0/fd [0,4194304] 0 2024-09-17T04:21:18.781 INFO:tasks.workunit.client.0.smithi088.stdout:4/684: write d5/d3f/fd3 [502467,8609] 0 2024-09-17T04:21:18.782 INFO:tasks.workunit.client.0.smithi088.stdout:4/685: chown d5/l1c 1936 1 2024-09-17T04:21:18.785 INFO:tasks.workunit.client.0.smithi088.stdout:2/787: truncate d0/d1/d2d/d33/d4b/d24/d3b/d22/dba/fe6 254497 0 2024-09-17T04:21:18.788 INFO:tasks.workunit.client.0.smithi088.stdout:9/851: link d2/d2b/d2e/dbb/d104/d72/d74/fae d2/dd/d14/d8b/d43/d51/f126 0 2024-09-17T04:21:18.792 INFO:tasks.workunit.client.0.smithi088.stdout:9/852: fdatasync d2/f7 0 2024-09-17T04:21:18.798 INFO:tasks.workunit.client.0.smithi088.stdout:2/788: fsync d0/d1/d2d/d33/d4b/d6d/d94/da5/fe1 0 2024-09-17T04:21:18.801 INFO:tasks.workunit.client.0.smithi088.stdout:9/853: getdents d2/d2b/d2e/dbb/d104/d5c 0 2024-09-17T04:21:18.801 INFO:tasks.workunit.client.0.smithi088.stdout:2/789: write d0/d1/d2d/d33/f38 [4834770,91680] 0 2024-09-17T04:21:18.805 INFO:tasks.workunit.client.0.smithi088.stdout:4/686: dwrite d5/d3f/d71/d8b/d68/da4/d5e/fb5 [0,4194304] 0 2024-09-17T04:21:18.807 INFO:tasks.workunit.client.0.smithi088.stdout:9/854: mknod d2/d2b/d2e/dbb/d104/d5c/dbc/c127 0 2024-09-17T04:21:18.812 INFO:tasks.workunit.client.0.smithi088.stdout:9/855: truncate d2/dd/f87 2976811 0 2024-09-17T04:21:18.814 INFO:tasks.workunit.client.0.smithi088.stdout:4/687: creat d5/d3f/d71/d8b/d68/da4/d5e/fe2 x:0 0 0 2024-09-17T04:21:18.816 INFO:tasks.workunit.client.0.smithi088.stdout:9/856: rename d2/d16/d116/f42 to d2/d2b/d2e/f128 0 2024-09-17T04:21:18.817 INFO:tasks.workunit.client.0.smithi088.stdout:9/857: readlink d2/d2b/d2e/dbb/d104/db5/lf9 0 2024-09-17T04:21:18.876 INFO:tasks.workunit.client.0.smithi088.stdout:8/724: sync 2024-09-17T04:21:18.877 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:18 smithi088 ceph-mon[27811]: pgmap v30: 65 pgs: 65 active+clean; 3.1 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 64 MiB/s rd, 131 MiB/s wr, 345 op/s 2024-09-17T04:21:18.877 INFO:tasks.workunit.client.0.smithi088.stdout:8/725: chown d7/d29/d2a/d38/daf/lc8 25 1 2024-09-17T04:21:18.878 INFO:tasks.workunit.client.0.smithi088.stdout:2/790: write d0/d1/d2d/d33/d4b/d6d/d94/fd2 [1689905,48086] 0 2024-09-17T04:21:18.879 INFO:tasks.workunit.client.0.smithi088.stdout:9/858: mknod d2/dd/d14/d8b/d35/d94/dfc/c129 0 2024-09-17T04:21:18.881 INFO:tasks.workunit.client.0.smithi088.stdout:4/688: mknod d5/ce3 0 2024-09-17T04:21:18.883 INFO:tasks.workunit.client.0.smithi088.stdout:2/791: rmdir d0/d1/d2d/d33/d4b/d24/d3b/d26/d8c 39 2024-09-17T04:21:18.885 INFO:tasks.workunit.client.0.smithi088.stdout:9/859: symlink d2/d2b/d2e/dbb/d104/db5/l12a 0 2024-09-17T04:21:18.888 INFO:tasks.workunit.client.0.smithi088.stdout:4/689: symlink d5/d3f/d71/d8b/d68/da4/d5e/d83/le4 0 2024-09-17T04:21:18.888 INFO:tasks.workunit.client.0.smithi088.stdout:8/726: write d7/dd/d31/d47/d55/f61 [990013,9572] 0 2024-09-17T04:21:18.889 INFO:tasks.workunit.client.0.smithi088.stdout:2/792: creat d0/d1/d2d/d33/ff3 x:0 0 0 2024-09-17T04:21:18.890 INFO:tasks.workunit.client.0.smithi088.stdout:8/727: truncate d7/dd/f28 4618764 0 2024-09-17T04:21:18.891 INFO:tasks.workunit.client.0.smithi088.stdout:9/860: fdatasync d2/dd/d14/d2a/d8f/d99/fce 0 2024-09-17T04:21:18.892 INFO:tasks.workunit.client.0.smithi088.stdout:9/861: dread - d2/dd/d14/fe2 zero size 2024-09-17T04:21:18.893 INFO:tasks.workunit.client.0.smithi088.stdout:4/690: creat d5/dcd/fe5 x:0 0 0 2024-09-17T04:21:18.894 INFO:tasks.workunit.client.0.smithi088.stdout:9/862: read d2/dd/d14/d8b/d43/d51/f9d [3172009,42933] 0 2024-09-17T04:21:18.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:18 smithi134 ceph-mon[35201]: pgmap v30: 65 pgs: 65 active+clean; 3.1 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 64 MiB/s rd, 131 MiB/s wr, 345 op/s 2024-09-17T04:21:18.900 INFO:tasks.workunit.client.0.smithi088.stdout:8/728: link d7/dd/c5f d7/dd/d31/dca/de6/cf2 0 2024-09-17T04:21:18.903 INFO:tasks.workunit.client.0.smithi088.stdout:8/729: creat d7/d7f/ff3 x:0 0 0 2024-09-17T04:21:18.908 INFO:tasks.workunit.client.0.smithi088.stdout:2/793: dwrite d0/d1/d2d/d33/d4b/d24/d92/f9c [0,4194304] 0 2024-09-17T04:21:18.912 INFO:tasks.workunit.client.0.smithi088.stdout:8/730: rename d7/dd/d31/d47/d55/d57/d6b/c88 to d7/dd/d31/d47/d55/d57/cf4 0 2024-09-17T04:21:18.914 INFO:tasks.workunit.client.0.smithi088.stdout:4/691: dread d5/d3d/f42 [0,4194304] 0 2024-09-17T04:21:18.917 INFO:tasks.workunit.client.0.smithi088.stdout:4/692: fsync d5/d3f/f33 0 2024-09-17T04:21:18.920 INFO:tasks.workunit.client.0.smithi088.stdout:4/693: rename d5/d3f/d71/d8b/f88 to d5/d3f/d71/d8b/fe6 0 2024-09-17T04:21:18.925 INFO:tasks.workunit.client.0.smithi088.stdout:2/794: dwrite d0/f61 [0,4194304] 0 2024-09-17T04:21:18.925 INFO:tasks.workunit.client.0.smithi088.stdout:4/694: mkdir d5/d3d/d73/de7 0 2024-09-17T04:21:18.927 INFO:tasks.workunit.client.0.smithi088.stdout:4/695: unlink d5/d3d/d73/f9b 0 2024-09-17T04:21:18.930 INFO:tasks.workunit.client.0.smithi088.stdout:4/696: unlink d5/c1d 0 2024-09-17T04:21:18.932 INFO:tasks.workunit.client.0.smithi088.stdout:4/697: write d5/d72/fa3 [1360195,103928] 0 2024-09-17T04:21:18.935 INFO:tasks.workunit.client.0.smithi088.stdout:2/795: dwrite d0/d1/d2d/d33/d85/fa0 [0,4194304] 0 2024-09-17T04:21:18.942 INFO:tasks.workunit.client.0.smithi088.stdout:2/796: dread d0/d13/fec [0,4194304] 0 2024-09-17T04:21:18.948 INFO:tasks.workunit.client.0.smithi088.stdout:2/797: mknod d0/d13/dd1/de8/cf4 0 2024-09-17T04:21:18.955 INFO:tasks.workunit.client.0.smithi088.stdout:2/798: creat d0/d13/dd1/def/ff5 x:0 0 0 2024-09-17T04:21:18.957 INFO:tasks.workunit.client.0.smithi088.stdout:4/698: dread d5/d3f/d71/d8b/fe6 [0,4194304] 0 2024-09-17T04:21:18.958 INFO:tasks.workunit.client.0.smithi088.stdout:2/799: dread - d0/d1/d2d/d33/d65/fdc zero size 2024-09-17T04:21:18.964 INFO:tasks.workunit.client.0.smithi088.stdout:4/699: getdents d5/d3d/d73 0 2024-09-17T04:21:18.965 INFO:tasks.workunit.client.0.smithi088.stdout:2/800: getdents d0/d1/d2d/dbd 0 2024-09-17T04:21:18.966 INFO:tasks.workunit.client.0.smithi088.stdout:2/801: write d0/d1/f93 [3364135,111934] 0 2024-09-17T04:21:18.971 INFO:tasks.workunit.client.0.smithi088.stdout:2/802: creat d0/d1/d2d/d77/ff6 x:0 0 0 2024-09-17T04:21:18.971 INFO:tasks.workunit.client.0.smithi088.stdout:4/700: dwrite d5/d3d/f80 [0,4194304] 0 2024-09-17T04:21:18.972 INFO:tasks.workunit.client.0.smithi088.stdout:4/701: write d5/d3d/f47 [4197823,61270] 0 2024-09-17T04:21:18.983 INFO:tasks.workunit.client.0.smithi088.stdout:2/803: getdents d0/d1/d2d/d33/d4b/d24/d3b/d26/d8c 0 2024-09-17T04:21:18.988 INFO:tasks.workunit.client.0.smithi088.stdout:2/804: dwrite d0/d1/d2d/d33/d80/f4c [4194304,4194304] 0 2024-09-17T04:21:18.990 INFO:tasks.workunit.client.0.smithi088.stdout:2/805: write d0/d1/d2d/f84 [1350413,63742] 0 2024-09-17T04:21:19.001 INFO:tasks.workunit.client.0.smithi088.stdout:2/806: write d0/d1/f3 [2384291,97863] 0 2024-09-17T04:21:19.003 INFO:tasks.workunit.client.0.smithi088.stdout:2/807: fsync d0/d1/d2d/d33/d4b/d24/d3b/f59 0 2024-09-17T04:21:19.004 INFO:tasks.workunit.client.0.smithi088.stdout:2/808: write d0/d1/d2d/d33/d65/fdc [362470,25670] 0 2024-09-17T04:21:19.010 INFO:tasks.workunit.client.0.smithi088.stdout:2/809: getdents d0/d1/d2d/d33/d4b/d24/d92 0 2024-09-17T04:21:19.015 INFO:tasks.workunit.client.0.smithi088.stdout:2/810: write d0/d1/d2d/d33/d4b/d24/d3b/fc8 [351670,94969] 0 2024-09-17T04:21:19.018 INFO:tasks.workunit.client.0.smithi088.stdout:2/811: mknod d0/d1/d2d/d33/d80/cf7 0 2024-09-17T04:21:19.023 INFO:tasks.workunit.client.0.smithi088.stdout:2/812: write d0/d1/d2d/d33/d4b/d24/d92/fb5 [245279,9337] 0 2024-09-17T04:21:19.036 INFO:tasks.workunit.client.0.smithi088.stdout:2/813: dread d0/d1/d2d/d33/fa8 [0,4194304] 0 2024-09-17T04:21:19.037 INFO:tasks.workunit.client.0.smithi088.stdout:0/549: sync 2024-09-17T04:21:19.041 INFO:tasks.workunit.client.0.smithi088.stdout:0/550: write db/f12 [314251,20973] 0 2024-09-17T04:21:19.042 INFO:tasks.workunit.client.0.smithi088.stdout:0/551: write db/d1b/d36/d4a/f40 [581312,113132] 0 2024-09-17T04:21:19.044 INFO:tasks.workunit.client.0.smithi088.stdout:0/552: readlink db/d1b/d36/d47/l42 0 2024-09-17T04:21:19.047 INFO:tasks.workunit.client.0.smithi088.stdout:0/553: rename db/d67/d8c to db/db2/dc0 0 2024-09-17T04:21:19.049 INFO:tasks.workunit.client.0.smithi088.stdout:0/554: rename db/l16 to db/d3c/d4f/d59/da4/lc1 0 2024-09-17T04:21:19.051 INFO:tasks.workunit.client.0.smithi088.stdout:0/555: rmdir db/d1b/d36/d4a 39 2024-09-17T04:21:19.053 INFO:tasks.workunit.client.0.smithi088.stdout:0/556: mknod db/d3c/d4f/d66/d82/cc2 0 2024-09-17T04:21:19.054 INFO:tasks.workunit.client.0.smithi088.stdout:0/557: rmdir db/d3c 39 2024-09-17T04:21:19.065 INFO:tasks.workunit.client.0.smithi088.stdout:0/558: dread db/d1b/d39/f5c [0,4194304] 0 2024-09-17T04:21:19.066 INFO:tasks.workunit.client.0.smithi088.stdout:0/559: readlink db/d1b/d36/d4a/l9a 0 2024-09-17T04:21:19.071 INFO:tasks.workunit.client.0.smithi088.stdout:0/560: fsync db/d3c/d4f/d59/f7b 0 2024-09-17T04:21:19.089 INFO:tasks.workunit.client.0.smithi088.stdout:0/561: dwrite db/d1b/d36/d4a/d6a/f74 [0,4194304] 0 2024-09-17T04:21:19.093 INFO:tasks.workunit.client.0.smithi088.stdout:0/562: mknod db/d1b/d36/d4a/d6a/cc3 0 2024-09-17T04:21:19.095 INFO:tasks.workunit.client.0.smithi088.stdout:0/563: mkdir db/d3c/d4f/d9f/dc4 0 2024-09-17T04:21:19.098 INFO:tasks.workunit.client.0.smithi088.stdout:0/564: creat db/d1b/d36/d47/db9/fc5 x:0 0 0 2024-09-17T04:21:19.101 INFO:tasks.workunit.client.0.smithi088.stdout:0/565: link db/d3c/d4f/d66/d82/l78 db/lc6 0 2024-09-17T04:21:19.119 INFO:tasks.workunit.client.0.smithi088.stdout:0/566: dwrite db/f13 [4194304,4194304] 0 2024-09-17T04:21:19.125 INFO:tasks.workunit.client.0.smithi088.stdout:0/567: creat db/db2/fc7 x:0 0 0 2024-09-17T04:21:19.130 INFO:tasks.workunit.client.0.smithi088.stdout:0/568: dread db/d1b/f89 [0,4194304] 0 2024-09-17T04:21:19.131 INFO:tasks.workunit.client.0.smithi088.stdout:0/569: write db/d1b/d36/d47/db9/fc5 [934222,93610] 0 2024-09-17T04:21:19.196 INFO:tasks.workunit.client.0.smithi088.stdout:6/801: sync 2024-09-17T04:21:19.196 INFO:tasks.workunit.client.0.smithi088.stdout:7/769: sync 2024-09-17T04:21:19.197 INFO:tasks.workunit.client.0.smithi088.stdout:6/802: write d14/dce/dfe/ffc [466617,89044] 0 2024-09-17T04:21:19.202 INFO:tasks.workunit.client.0.smithi088.stdout:6/803: rename d14/d44/f8e to d14/d44/d45/d6b/d2a/d52/d90/f115 0 2024-09-17T04:21:19.204 INFO:tasks.workunit.client.0.smithi088.stdout:6/804: fdatasync d14/d44/d45/d6b/d16/f30 0 2024-09-17T04:21:19.211 INFO:tasks.workunit.client.0.smithi088.stdout:7/770: dread d2/d4/f33 [0,4194304] 0 2024-09-17T04:21:19.215 INFO:tasks.workunit.client.0.smithi088.stdout:7/771: truncate d2/d4/d7/d20/f6b 844206 0 2024-09-17T04:21:19.215 INFO:tasks.workunit.client.0.smithi088.stdout:7/772: chown d2/d1d/d2e/db0/d23/d97 202049 1 2024-09-17T04:21:19.219 INFO:tasks.workunit.client.0.smithi088.stdout:7/773: creat d2/d1d/d2e/db0/d23/d45/d85/ff0 x:0 0 0 2024-09-17T04:21:19.220 INFO:tasks.workunit.client.0.smithi088.stdout:6/805: dread d14/d44/d45/d6b/d29/ffd [0,4194304] 0 2024-09-17T04:21:19.221 INFO:tasks.workunit.client.0.smithi088.stdout:6/806: chown d14/d44/d45/d6b/d2a/d52/d90/cb8 1714 1 2024-09-17T04:21:19.223 INFO:tasks.workunit.client.0.smithi088.stdout:7/774: rename d2/d4/f86 to d2/d96/dc2/ff1 0 2024-09-17T04:21:19.224 INFO:tasks.workunit.client.0.smithi088.stdout:6/807: truncate d14/f24 805177 0 2024-09-17T04:21:19.226 INFO:tasks.workunit.client.0.smithi088.stdout:6/808: mkdir d14/d44/d116 0 2024-09-17T04:21:19.229 INFO:tasks.workunit.client.0.smithi088.stdout:7/775: dwrite d2/d1d/d2e/db0/d23/d45/d62/fcb [0,4194304] 0 2024-09-17T04:21:19.236 INFO:tasks.workunit.client.0.smithi088.stdout:6/809: dwrite d14/d44/d45/d6b/d16/f51 [0,4194304] 0 2024-09-17T04:21:19.256 INFO:tasks.workunit.client.0.smithi088.stdout:7/776: truncate d2/d1d/d2e/db0/f24 734369 0 2024-09-17T04:21:19.256 INFO:tasks.workunit.client.0.smithi088.stdout:7/777: chown d2/d1d/d2e/db0 48123464 1 2024-09-17T04:21:19.257 INFO:tasks.workunit.client.0.smithi088.stdout:7/778: write d2/d1d/d2e/db0/d23/f2f [1919388,82847] 0 2024-09-17T04:21:19.265 INFO:tasks.workunit.client.0.smithi088.stdout:6/810: dwrite d14/d3a/fe5 [0,4194304] 0 2024-09-17T04:21:19.269 INFO:tasks.workunit.client.0.smithi088.stdout:6/811: unlink d14/d3a/c9a 0 2024-09-17T04:21:19.269 INFO:tasks.workunit.client.0.smithi088.stdout:7/779: dwrite d2/d1d/d2e/db0/f3b [0,4194304] 0 2024-09-17T04:21:19.276 INFO:tasks.workunit.client.0.smithi088.stdout:6/812: getdents d14/d44/d45/d6b/d2a/d52 0 2024-09-17T04:21:19.277 INFO:tasks.workunit.client.0.smithi088.stdout:6/813: chown d14/d44/d45/d6b/l7d 0 1 2024-09-17T04:21:19.282 INFO:tasks.workunit.client.0.smithi088.stdout:7/780: write d2/d4/d7/f7b [418330,17676] 0 2024-09-17T04:21:19.282 INFO:tasks.workunit.client.0.smithi088.stdout:7/781: chown d2/d4/d7/d20 313797123 1 2024-09-17T04:21:19.285 INFO:tasks.workunit.client.0.smithi088.stdout:7/782: mkdir d2/d96/df2 0 2024-09-17T04:21:19.287 INFO:tasks.workunit.client.0.smithi088.stdout:6/814: write d14/dce/dfe/fcc [2807104,111372] 0 2024-09-17T04:21:19.289 INFO:tasks.workunit.client.0.smithi088.stdout:7/783: dread d2/d1d/f58 [0,4194304] 0 2024-09-17T04:21:19.292 INFO:tasks.workunit.client.0.smithi088.stdout:6/815: link d14/d44/d45/d6b/d2a/caf d14/d44/d45/d6b/d29/d3e/c117 0 2024-09-17T04:21:19.293 INFO:tasks.workunit.client.0.smithi088.stdout:7/784: dwrite d2/d4/f14 [0,4194304] 0 2024-09-17T04:21:19.307 INFO:tasks.workunit.client.0.smithi088.stdout:6/816: symlink d14/d44/d45/d6b/d29/d3e/l118 0 2024-09-17T04:21:19.308 INFO:tasks.workunit.client.0.smithi088.stdout:7/785: write d2/d1d/d2e/db0/d23/d45/d85/ff0 [802349,21967] 0 2024-09-17T04:21:19.308 INFO:tasks.workunit.client.0.smithi088.stdout:6/817: write d14/d44/d94/fbd [1114198,43432] 0 2024-09-17T04:21:19.308 INFO:tasks.workunit.client.0.smithi088.stdout:6/818: write d14/dce/dfe/f82 [3985029,46073] 0 2024-09-17T04:21:19.309 INFO:tasks.workunit.client.0.smithi088.stdout:7/786: mknod d2/d1d/d2e/db0/cf3 0 2024-09-17T04:21:19.309 INFO:tasks.workunit.client.0.smithi088.stdout:6/819: write d14/d44/d45/d6b/d16/d42/f89 [4702072,35255] 0 2024-09-17T04:21:19.309 INFO:tasks.workunit.client.0.smithi088.stdout:7/787: dread d2/d1d/d2e/db0/d23/d45/f63 [0,4194304] 0 2024-09-17T04:21:19.309 INFO:tasks.workunit.client.0.smithi088.stdout:6/820: mknod d14/d44/dad/c119 0 2024-09-17T04:21:19.309 INFO:tasks.workunit.client.0.smithi088.stdout:6/821: chown d14/d44/d45/d6b/d29/ffd 3 1 2024-09-17T04:21:19.310 INFO:tasks.workunit.client.0.smithi088.stdout:6/822: chown d14/d44/d45/d6b/d16/c5b 69 1 2024-09-17T04:21:19.317 INFO:tasks.workunit.client.0.smithi088.stdout:7/788: dwrite d2/d96/dc2/fed [0,4194304] 0 2024-09-17T04:21:19.317 INFO:tasks.workunit.client.0.smithi088.stdout:6/823: rmdir d14/d44/d45/d6b/d29/dac/d105 0 2024-09-17T04:21:19.318 INFO:tasks.workunit.client.0.smithi088.stdout:7/789: creat d2/d1d/d2e/db0/d23/d45/d62/ff4 x:0 0 0 2024-09-17T04:21:19.319 INFO:tasks.workunit.client.0.smithi088.stdout:7/790: write d2/d4/d7/d46/d67/f75 [2562487,116343] 0 2024-09-17T04:21:19.321 INFO:tasks.workunit.client.0.smithi088.stdout:6/824: mkdir d14/d44/d45/d6b/d29/dac/d11a 0 2024-09-17T04:21:19.327 INFO:tasks.workunit.client.0.smithi088.stdout:7/791: creat d2/d96/df2/ff5 x:0 0 0 2024-09-17T04:21:19.336 INFO:tasks.workunit.client.0.smithi088.stdout:6/825: write d14/d44/d45/d6b/d2a/fa6 [1220724,55832] 0 2024-09-17T04:21:19.341 INFO:tasks.workunit.client.0.smithi088.stdout:6/826: dread d14/d44/d45/d6b/d2a/fa4 [0,4194304] 0 2024-09-17T04:21:19.342 INFO:tasks.workunit.client.0.smithi088.stdout:7/792: dwrite d2/d8d/f9d [0,4194304] 0 2024-09-17T04:21:19.342 INFO:tasks.workunit.client.0.smithi088.stdout:6/827: chown d14/l28 0 1 2024-09-17T04:21:19.343 INFO:tasks.workunit.client.0.smithi088.stdout:6/828: chown d14/d44/d94/db9/dc8 238349847 1 2024-09-17T04:21:19.346 INFO:tasks.workunit.client.0.smithi088.stdout:6/829: creat d14/d44/dad/f11b x:0 0 0 2024-09-17T04:21:19.347 INFO:tasks.workunit.client.0.smithi088.stdout:7/793: rename d2/d1d/d2e/db0/d23/d45/d85/f92 to d2/d1d/ff6 0 2024-09-17T04:21:19.354 INFO:tasks.workunit.client.0.smithi088.stdout:7/794: rename d2/d4/lbc to d2/d96/db9/lf7 0 2024-09-17T04:21:19.362 INFO:tasks.workunit.client.0.smithi088.stdout:7/795: getdents d2/d79 0 2024-09-17T04:21:19.364 INFO:tasks.workunit.client.0.smithi088.stdout:7/796: truncate d2/f60 3765758 0 2024-09-17T04:21:19.366 INFO:tasks.workunit.client.0.smithi088.stdout:6/830: dwrite d14/f56 [0,4194304] 0 2024-09-17T04:21:19.368 INFO:tasks.workunit.client.0.smithi088.stdout:7/797: mknod d2/d1d/d2e/db0/d23/d97/dbb/dcf/cf8 0 2024-09-17T04:21:19.368 INFO:tasks.workunit.client.0.smithi088.stdout:6/831: read d14/d3a/fa8 [1316523,37935] 0 2024-09-17T04:21:19.376 INFO:tasks.workunit.client.0.smithi088.stdout:6/832: truncate d14/d44/d45/d6b/d2a/f5a 398071 0 2024-09-17T04:21:19.382 INFO:tasks.workunit.client.0.smithi088.stdout:6/833: mknod d14/d44/d45/d4d/c11c 0 2024-09-17T04:21:19.385 INFO:tasks.workunit.client.0.smithi088.stdout:6/834: unlink d14/d44/d45/d6b/l7d 0 2024-09-17T04:21:19.385 INFO:tasks.workunit.client.0.smithi088.stdout:6/835: fdatasync d14/d44/d94/fd8 0 2024-09-17T04:21:19.388 INFO:tasks.workunit.client.0.smithi088.stdout:7/798: link d2/d4/d9b/lc6 d2/d4/d7/lf9 0 2024-09-17T04:21:19.393 INFO:tasks.workunit.client.0.smithi088.stdout:7/799: dwrite d2/d4/f14 [0,4194304] 0 2024-09-17T04:21:19.394 INFO:tasks.workunit.client.0.smithi088.stdout:6/836: creat d14/d44/d45/f11d x:0 0 0 2024-09-17T04:21:19.397 INFO:tasks.workunit.client.0.smithi088.stdout:7/800: creat d2/d4/d9b/ffa x:0 0 0 2024-09-17T04:21:19.399 INFO:tasks.workunit.client.0.smithi088.stdout:6/837: rmdir d14/d44/d45/d6b/d2a/d52 39 2024-09-17T04:21:19.400 INFO:tasks.workunit.client.0.smithi088.stdout:6/838: readlink d14/d2f/d87/lb6 0 2024-09-17T04:21:19.401 INFO:tasks.workunit.client.0.smithi088.stdout:7/801: creat d2/d1d/d2e/db0/d23/d97/dbb/dcf/ffb x:0 0 0 2024-09-17T04:21:19.407 INFO:tasks.workunit.client.0.smithi088.stdout:7/802: link d2/d1d/d2e/db0/d23/d97/cd8 d2/d96/dc2/cfc 0 2024-09-17T04:21:19.409 INFO:tasks.workunit.client.0.smithi088.stdout:7/803: creat d2/d1d/d2e/db0/d23/d45/d6d/ffd x:0 0 0 2024-09-17T04:21:19.410 INFO:tasks.workunit.client.0.smithi088.stdout:7/804: dread - d2/d1d/d2e/fe6 zero size 2024-09-17T04:21:19.411 INFO:tasks.workunit.client.0.smithi088.stdout:7/805: dread d2/d1d/d2e/db0/d23/d45/f63 [0,4194304] 0 2024-09-17T04:21:19.412 INFO:tasks.workunit.client.0.smithi088.stdout:7/806: chown d2/d1d/d2e/db0/d23/d45/d85/fcc 5 1 2024-09-17T04:21:19.414 INFO:tasks.workunit.client.0.smithi088.stdout:7/807: mknod d2/d79/cfe 0 2024-09-17T04:21:19.418 INFO:tasks.workunit.client.0.smithi088.stdout:7/808: mknod d2/d1d/d2e/db0/d23/d97/dbb/dcf/cff 0 2024-09-17T04:21:19.418 INFO:tasks.workunit.client.0.smithi088.stdout:6/839: write d14/d44/d45/d6b/d2a/fa4 [506141,38751] 0 2024-09-17T04:21:19.419 INFO:tasks.workunit.client.0.smithi088.stdout:6/840: chown d14/d44/dad 1 1 2024-09-17T04:21:19.421 INFO:tasks.workunit.client.0.smithi088.stdout:7/809: creat d2/d96/dc2/f100 x:0 0 0 2024-09-17T04:21:19.424 INFO:tasks.workunit.client.0.smithi088.stdout:7/810: creat d2/d4/d7/d20/f101 x:0 0 0 2024-09-17T04:21:19.425 INFO:tasks.workunit.client.0.smithi088.stdout:6/841: dwrite d14/d44/dad/f11b [0,4194304] 0 2024-09-17T04:21:19.427 INFO:tasks.workunit.client.0.smithi088.stdout:7/811: write d2/d4/d7/d46/d67/dd6/fe0 [945130,108828] 0 2024-09-17T04:21:19.431 INFO:tasks.workunit.client.0.smithi088.stdout:6/842: mkdir d14/d44/d45/d6b/d2a/d52/d90/d11e 0 2024-09-17T04:21:19.432 INFO:tasks.workunit.client.0.smithi088.stdout:7/812: unlink d2/d1d/d2e/db0/d23/d45/d62/d82/f9a 0 2024-09-17T04:21:19.433 INFO:tasks.workunit.client.0.smithi088.stdout:6/843: read d14/d44/d45/d6b/d16/fe1 [645692,28488] 0 2024-09-17T04:21:19.434 INFO:tasks.workunit.client.0.smithi088.stdout:7/813: readlink d2/d1d/d2e/db0/d23/d45/d62/d82/le7 0 2024-09-17T04:21:19.436 INFO:tasks.workunit.client.0.smithi088.stdout:6/844: creat d14/d44/d45/d6b/d2a/d52/d90/f11f x:0 0 0 2024-09-17T04:21:19.438 INFO:tasks.workunit.client.0.smithi088.stdout:7/814: mknod d2/d4/d9b/c102 0 2024-09-17T04:21:19.439 INFO:tasks.workunit.client.0.smithi088.stdout:7/815: dread - d2/fee zero size 2024-09-17T04:21:19.441 INFO:tasks.workunit.client.0.smithi088.stdout:6/845: creat d14/d44/dad/f120 x:0 0 0 2024-09-17T04:21:19.442 INFO:tasks.workunit.client.0.smithi088.stdout:7/816: mknod d2/d96/df2/c103 0 2024-09-17T04:21:19.446 INFO:tasks.workunit.client.0.smithi088.stdout:6/846: link d14/d44/dad/f120 d14/d44/d45/d6b/d29/d3e/f121 0 2024-09-17T04:21:19.448 INFO:tasks.workunit.client.0.smithi088.stdout:7/817: dwrite d2/fb4 [0,4194304] 0 2024-09-17T04:21:19.450 INFO:tasks.workunit.client.0.smithi088.stdout:7/818: write d2/d1d/d2e/db0/f3b [1882280,97957] 0 2024-09-17T04:21:19.451 INFO:tasks.workunit.client.0.smithi088.stdout:6/847: read d14/d44/d45/d6b/d29/fab [2946669,54652] 0 2024-09-17T04:21:19.453 INFO:tasks.workunit.client.0.smithi088.stdout:7/819: chown d2/f60 3693396 1 2024-09-17T04:21:19.455 INFO:tasks.workunit.client.0.smithi088.stdout:6/848: mkdir d14/d44/d45/d6b/d29/d122 0 2024-09-17T04:21:19.455 INFO:tasks.workunit.client.0.smithi088.stdout:6/849: fdatasync d14/d44/d94/fa5 0 2024-09-17T04:21:19.457 INFO:tasks.workunit.client.0.smithi088.stdout:7/820: fdatasync d2/d1d/d2e/db0/d23/d45/d6d/fba 0 2024-09-17T04:21:19.460 INFO:tasks.workunit.client.0.smithi088.stdout:7/821: mknod d2/d1d/d2e/db0/d23/d45/d62/c104 0 2024-09-17T04:21:19.461 INFO:tasks.workunit.client.0.smithi088.stdout:7/822: chown d2/d79/f7a 77885766 1 2024-09-17T04:21:19.474 INFO:tasks.workunit.client.0.smithi088.stdout:6/850: dread d14/d44/d45/d6b/d2a/d52/d7a/f111 [0,4194304] 0 2024-09-17T04:21:19.476 INFO:tasks.workunit.client.0.smithi088.stdout:6/851: symlink d14/d44/d45/d6b/d2a/d52/d90/l123 0 2024-09-17T04:21:19.481 INFO:tasks.workunit.client.0.smithi088.stdout:6/852: dwrite d14/d44/d45/f11d [0,4194304] 0 2024-09-17T04:21:19.485 INFO:tasks.workunit.client.0.smithi088.stdout:6/853: creat d14/d44/d94/db9/dc8/df7/f124 x:0 0 0 2024-09-17T04:21:19.503 INFO:tasks.workunit.client.0.smithi088.stdout:6/854: dread d14/d44/d45/d6b/d16/f9c [0,4194304] 0 2024-09-17T04:21:19.521 INFO:tasks.workunit.client.0.smithi088.stdout:6/855: dread d14/d44/d45/d6b/d2a/d52/d90/f115 [0,4194304] 0 2024-09-17T04:21:19.522 INFO:tasks.workunit.client.0.smithi088.stdout:6/856: unlink d14/d44/d45/d6b/d2a/d52/d7a/f83 0 2024-09-17T04:21:19.523 INFO:tasks.workunit.client.0.smithi088.stdout:6/857: write d14/d44/dad/f11b [5224703,93989] 0 2024-09-17T04:21:19.524 INFO:tasks.workunit.client.0.smithi088.stdout:6/858: write d14/d44/d94/db9/fe8 [559245,131062] 0 2024-09-17T04:21:19.526 INFO:tasks.workunit.client.0.smithi088.stdout:6/859: write d14/d2f/d87/d9d/f104 [48232,2930] 0 2024-09-17T04:21:19.528 INFO:tasks.workunit.client.0.smithi088.stdout:6/860: mkdir d14/d44/d45/d6b/d2a/d52/dcf/d125 0 2024-09-17T04:21:19.530 INFO:tasks.workunit.client.0.smithi088.stdout:6/861: symlink d14/d44/d45/d6b/d29/d5e/l126 0 2024-09-17T04:21:19.531 INFO:tasks.workunit.client.0.smithi088.stdout:6/862: dread - d14/d44/d94/db9/fd0 zero size 2024-09-17T04:21:19.545 INFO:tasks.workunit.client.0.smithi088.stdout:6/863: dread d14/d44/d45/d6b/f39 [0,4194304] 0 2024-09-17T04:21:19.551 INFO:tasks.workunit.client.0.smithi088.stdout:6/864: rename d14/d44/d45/d6b/d2a/caf to d14/d44/d45/d6b/d2a/d52/dcf/c127 0 2024-09-17T04:21:19.554 INFO:tasks.workunit.client.0.smithi088.stdout:6/865: rename d14/d44/d45/d6b/d2a/d52/d7a/d7b/ddf/c110 to d14/dce/c128 0 2024-09-17T04:21:19.563 INFO:tasks.workunit.client.0.smithi088.stdout:6/866: dwrite d14/d44/d94/db9/dc8/df7/f101 [0,4194304] 0 2024-09-17T04:21:19.585 INFO:tasks.workunit.client.0.smithi088.stdout:6/867: link d14/d44/d45/d6b/d2a/d52/d90/f11f d14/d44/d45/d6b/d16/d42/df3/d112/f129 0 2024-09-17T04:21:19.588 INFO:tasks.workunit.client.0.smithi088.stdout:6/868: getdents d14/d2f/d87 0 2024-09-17T04:21:19.590 INFO:tasks.workunit.client.0.smithi088.stdout:6/869: symlink d14/d44/d45/d6b/d2a/d52/l12a 0 2024-09-17T04:21:19.591 INFO:tasks.workunit.client.0.smithi088.stdout:6/870: chown d14/d44/d45/d6b/d29/d5e/de4/cfb 603 1 2024-09-17T04:21:19.595 INFO:tasks.workunit.client.0.smithi088.stdout:6/871: rmdir d14/d44/d45/d6b/d16/d42/df3/d112/d114 0 2024-09-17T04:21:19.600 INFO:tasks.workunit.client.0.smithi088.stdout:6/872: dwrite d14/d3a/d41/f60 [0,4194304] 0 2024-09-17T04:21:19.604 INFO:tasks.workunit.client.0.smithi088.stdout:6/873: mkdir d14/d44/d45/d6b/d2a/d12b 0 2024-09-17T04:21:19.613 INFO:tasks.workunit.client.0.smithi088.stdout:6/874: creat d14/d44/d45/d6b/d2a/d52/dcf/f12c x:0 0 0 2024-09-17T04:21:19.613 INFO:tasks.workunit.client.0.smithi088.stdout:6/875: write f4 [3068825,57534] 0 2024-09-17T04:21:19.618 INFO:tasks.workunit.client.0.smithi088.stdout:3/774: sync 2024-09-17T04:21:19.621 INFO:tasks.workunit.client.0.smithi088.stdout:6/876: link d14/d44/d45/d6b/d2a/d52/lc1 d14/d44/d45/d6b/d2a/d52/d7a/d7b/ddf/l12d 0 2024-09-17T04:21:19.622 INFO:tasks.workunit.client.0.smithi088.stdout:6/877: write d14/d2f/d87/d9d/f104 [493063,107769] 0 2024-09-17T04:21:19.622 INFO:tasks.workunit.client.0.smithi088.stdout:3/775: symlink d0/d13/d58/d5e/dc6/dcd/lfb 0 2024-09-17T04:21:19.633 INFO:tasks.workunit.client.0.smithi088.stdout:6/878: dwrite d14/d2f/f36 [4194304,4194304] 0 2024-09-17T04:21:19.633 INFO:tasks.workunit.client.0.smithi088.stdout:3/776: getdents d0/d13/d58/d5a/d63 0 2024-09-17T04:21:19.634 INFO:tasks.workunit.client.0.smithi088.stdout:6/879: fdatasync d14/d44/d45/d6b/f96 0 2024-09-17T04:21:19.641 INFO:tasks.workunit.client.0.smithi088.stdout:3/777: write d0/d13/d58/dd7/dd4/fe9 [575651,94253] 0 2024-09-17T04:21:19.643 INFO:tasks.workunit.client.0.smithi088.stdout:6/880: dwrite d14/d44/d45/d6b/d2a/fa4 [0,4194304] 0 2024-09-17T04:21:19.644 INFO:tasks.workunit.client.0.smithi088.stdout:6/881: read d14/d44/d45/d6b/d16/f51 [2567464,80237] 0 2024-09-17T04:21:19.650 INFO:tasks.workunit.client.0.smithi088.stdout:3/778: dwrite d0/d13/d1b/d29/d2b/fbc [0,4194304] 0 2024-09-17T04:21:19.652 INFO:tasks.workunit.client.0.smithi088.stdout:3/779: fsync d0/d13/d1b/d29/d30/d3c/d5c/f96 0 2024-09-17T04:21:19.653 INFO:tasks.workunit.client.0.smithi088.stdout:6/882: truncate d14/d44/d45/d6b/d2a/f5a 1051584 0 2024-09-17T04:21:19.656 INFO:tasks.workunit.client.0.smithi088.stdout:3/780: rmdir d0/d13/d58/dd7/dd4 39 2024-09-17T04:21:19.656 INFO:tasks.workunit.client.0.smithi088.stdout:6/883: rmdir d14/d44/d45/d6b/d2a/d52/d7a/d7b/ddf 39 2024-09-17T04:21:19.657 INFO:tasks.workunit.client.0.smithi088.stdout:3/781: write d0/d13/d1b/d29/d2b/f47 [234464,126439] 0 2024-09-17T04:21:19.659 INFO:tasks.workunit.client.0.smithi088.stdout:6/884: fdatasync d14/d44/d45/d6b/d2a/d52/d7a/d7b/fa9 0 2024-09-17T04:21:19.661 INFO:tasks.workunit.client.0.smithi088.stdout:3/782: creat d0/d13/d1b/d29/d30/d35/dcb/ffc x:0 0 0 2024-09-17T04:21:19.663 INFO:tasks.workunit.client.0.smithi088.stdout:3/783: mkdir d0/d13/d58/dfd 0 2024-09-17T04:21:19.664 INFO:tasks.workunit.client.0.smithi088.stdout:3/784: chown d0/d13/d1b/d29/d2b/d8b/fed 135 1 2024-09-17T04:21:19.665 INFO:tasks.workunit.client.0.smithi088.stdout:3/785: fsync d0/d13/d1b/d29/d30/fc7 0 2024-09-17T04:21:19.666 INFO:tasks.workunit.client.0.smithi088.stdout:3/786: readlink d0/d13/d58/d5e/lc4 0 2024-09-17T04:21:19.669 INFO:tasks.workunit.client.0.smithi088.stdout:3/787: unlink d0/d13/d1b/d29/d56/d85/cca 0 2024-09-17T04:21:19.675 INFO:tasks.workunit.client.0.smithi088.stdout:3/788: dwrite d0/d13/d1b/d29/d30/d3c/d5c/f96 [0,4194304] 0 2024-09-17T04:21:19.682 INFO:tasks.workunit.client.0.smithi088.stdout:6/885: dread d14/d44/d45/d6b/d29/d3e/f37 [0,4194304] 0 2024-09-17T04:21:19.687 INFO:tasks.workunit.client.0.smithi088.stdout:3/789: write d0/f12 [3268201,6449] 0 2024-09-17T04:21:19.688 INFO:tasks.workunit.client.0.smithi088.stdout:6/886: link d14/d44/d45/d6b/d16/l18 d14/d44/dad/dc0/l12e 0 2024-09-17T04:21:19.690 INFO:tasks.workunit.client.0.smithi088.stdout:6/887: write d14/d44/d94/db9/dc8/df7/f101 [4447094,70436] 0 2024-09-17T04:21:19.692 INFO:tasks.workunit.client.0.smithi088.stdout:6/888: write d14/fea [582354,33767] 0 2024-09-17T04:21:19.704 INFO:tasks.workunit.client.0.smithi088.stdout:3/790: dread d0/d13/d58/d5e/f97 [0,4194304] 0 2024-09-17T04:21:19.704 INFO:tasks.workunit.client.0.smithi088.stdout:3/791: chown d0/d13/d1b/d29/f3b 2831 1 2024-09-17T04:21:19.705 INFO:tasks.workunit.client.0.smithi088.stdout:3/792: write d0/d13/d1b/d29/d2b/d8b/fed [827551,4387] 0 2024-09-17T04:21:19.756 INFO:tasks.workunit.client.0.smithi088.stdout:3/793: rename d0/d13/d1b/d29/d30/d3c/f61 to d0/d13/d58/dfd/ffe 0 2024-09-17T04:21:19.756 INFO:tasks.workunit.client.0.smithi088.stdout:6/889: mkdir d14/d44/d45/d6b/d29/d12f 0 2024-09-17T04:21:19.757 INFO:tasks.workunit.client.0.smithi088.stdout:6/890: fsync d14/dce/dfe/f82 0 2024-09-17T04:21:19.761 INFO:tasks.workunit.client.0.smithi088.stdout:6/891: creat d14/d3a/f130 x:0 0 0 2024-09-17T04:21:19.763 INFO:tasks.workunit.client.0.smithi088.stdout:6/892: mknod d14/d44/d94/c131 0 2024-09-17T04:21:19.766 INFO:tasks.workunit.client.0.smithi088.stdout:6/893: creat d14/d44/d94/db9/dc5/f132 x:0 0 0 2024-09-17T04:21:19.766 INFO:tasks.workunit.client.0.smithi088.stdout:6/894: fdatasync d14/f56 0 2024-09-17T04:21:19.767 INFO:tasks.workunit.client.0.smithi088.stdout:3/794: write d0/d13/d58/d5a/d63/f75 [299191,112960] 0 2024-09-17T04:21:19.769 INFO:tasks.workunit.client.0.smithi088.stdout:3/795: chown d0/d13/f6b 0 1 2024-09-17T04:21:19.773 INFO:tasks.workunit.client.0.smithi088.stdout:3/796: symlink d0/d13/d58/d5a/d63/d80/lff 0 2024-09-17T04:21:19.774 INFO:tasks.workunit.client.0.smithi088.stdout:6/895: dwrite d14/d44/d45/d6b/d2a/f8d [4194304,4194304] 0 2024-09-17T04:21:19.778 INFO:tasks.workunit.client.0.smithi088.stdout:6/896: symlink d14/d44/d45/d6b/d29/d5e/l133 0 2024-09-17T04:21:19.791 INFO:tasks.workunit.client.0.smithi088.stdout:3/797: truncate d0/d13/d58/d5e/f97 3513391 0 2024-09-17T04:21:19.797 INFO:tasks.workunit.client.0.smithi088.stdout:3/798: dwrite d0/d13/d1b/d29/fea [0,4194304] 0 2024-09-17T04:21:19.802 INFO:tasks.workunit.client.0.smithi088.stdout:3/799: dread - d0/d54/d55/f69 zero size 2024-09-17T04:21:19.805 INFO:tasks.workunit.client.0.smithi088.stdout:3/800: creat d0/dae/f100 x:0 0 0 2024-09-17T04:21:19.805 INFO:tasks.workunit.client.0.smithi088.stdout:3/801: stat d0/d13/d1b/d29/d30/c37 0 2024-09-17T04:21:19.808 INFO:tasks.workunit.client.0.smithi088.stdout:3/802: symlink d0/d13/d1b/d29/l101 0 2024-09-17T04:21:19.811 INFO:tasks.workunit.client.0.smithi088.stdout:3/803: symlink d0/d13/d1b/d29/l102 0 2024-09-17T04:21:19.821 INFO:tasks.workunit.client.0.smithi088.stdout:3/804: dwrite d0/d13/d1b/d29/d2b/d50/f74 [0,4194304] 0 2024-09-17T04:21:19.826 INFO:tasks.workunit.client.0.smithi088.stdout:3/805: write d0/f79 [1326445,1979] 0 2024-09-17T04:21:19.829 INFO:tasks.workunit.client.0.smithi088.stdout:3/806: creat d0/d13/d1b/d29/d30/d81/de0/f103 x:0 0 0 2024-09-17T04:21:19.908 INFO:tasks.workunit.client.0.smithi088.stdout:1/841: sync 2024-09-17T04:21:19.909 INFO:tasks.workunit.client.0.smithi088.stdout:1/842: truncate d0/d1/df/d85/da3/df6/d9e/fd4 76871 0 2024-09-17T04:21:19.911 INFO:tasks.workunit.client.0.smithi088.stdout:1/843: rmdir d0/d13/d84/dcd 39 2024-09-17T04:21:20.048 INFO:tasks.workunit.client.0.smithi088.stdout:5/731: sync 2024-09-17T04:21:20.049 INFO:tasks.workunit.client.0.smithi088.stdout:9/863: sync 2024-09-17T04:21:20.049 INFO:tasks.workunit.client.0.smithi088.stdout:8/731: sync 2024-09-17T04:21:20.052 INFO:tasks.workunit.client.0.smithi088.stdout:8/732: fdatasync d7/d29/d2a/d38/d42/f4e 0 2024-09-17T04:21:20.059 INFO:tasks.workunit.client.0.smithi088.stdout:8/733: rmdir d7/d29/daa 39 2024-09-17T04:21:20.062 INFO:tasks.workunit.client.0.smithi088.stdout:8/734: fdatasync d7/f8 0 2024-09-17T04:21:20.062 INFO:tasks.workunit.client.0.smithi088.stdout:8/735: stat d7/f9 0 2024-09-17T04:21:20.066 INFO:tasks.workunit.client.0.smithi088.stdout:8/736: creat d7/d29/daa/ff5 x:0 0 0 2024-09-17T04:21:20.068 INFO:tasks.workunit.client.0.smithi088.stdout:8/737: symlink d7/d29/d2a/d38/d3d/da0/lf6 0 2024-09-17T04:21:20.083 INFO:tasks.workunit.client.0.smithi088.stdout:8/738: dread d7/dd/d31/f76 [0,4194304] 0 2024-09-17T04:21:20.085 INFO:tasks.workunit.client.0.smithi088.stdout:9/864: dwrite d2/dd/d14/d8b/d43/d51/f126 [0,4194304] 0 2024-09-17T04:21:20.085 INFO:tasks.workunit.client.0.smithi088.stdout:5/732: dwrite d2/d31/d33/d20/d25/d49/f5f [0,4194304] 0 2024-09-17T04:21:20.090 INFO:tasks.workunit.client.0.smithi088.stdout:9/865: unlink d2/db8/f108 0 2024-09-17T04:21:20.093 INFO:tasks.workunit.client.0.smithi088.stdout:5/733: rename d2/d31/d33/d20/d25/d2c/d8a/db2/dc3/dee to d2/d31/d33/d20/d25/d2c/df0 0 2024-09-17T04:21:20.093 INFO:tasks.workunit.client.0.smithi088.stdout:8/739: creat d7/dd/d6f/db6/ff7 x:0 0 0 2024-09-17T04:21:20.094 INFO:tasks.workunit.client.0.smithi088.stdout:9/866: creat d2/db8/f12b x:0 0 0 2024-09-17T04:21:20.097 INFO:tasks.workunit.client.0.smithi088.stdout:9/867: dread - d2/dd/d14/d2a/f60 zero size 2024-09-17T04:21:20.097 INFO:tasks.workunit.client.0.smithi088.stdout:5/734: read d2/d31/d33/d20/d47/f48 [3503826,60265] 0 2024-09-17T04:21:20.102 INFO:tasks.workunit.client.0.smithi088.stdout:8/740: dwrite d7/d29/d2a/d3a/d79/f81 [0,4194304] 0 2024-09-17T04:21:20.108 INFO:tasks.workunit.client.0.smithi088.stdout:5/735: dwrite d2/d31/d33/f2f [0,4194304] 0 2024-09-17T04:21:20.108 INFO:tasks.workunit.client.0.smithi088.stdout:8/741: unlink d7/dd/d31/d47/d55/d57/f60 0 2024-09-17T04:21:20.115 INFO:tasks.workunit.client.0.smithi088.stdout:7/823: sync 2024-09-17T04:21:20.115 INFO:tasks.workunit.client.0.smithi088.stdout:6/897: sync 2024-09-17T04:21:20.116 INFO:tasks.workunit.client.0.smithi088.stdout:2/814: sync 2024-09-17T04:21:20.116 INFO:tasks.workunit.client.0.smithi088.stdout:4/702: sync 2024-09-17T04:21:20.116 INFO:tasks.workunit.client.0.smithi088.stdout:1/844: sync 2024-09-17T04:21:20.117 INFO:tasks.workunit.client.0.smithi088.stdout:3/807: sync 2024-09-17T04:21:20.117 INFO:tasks.workunit.client.0.smithi088.stdout:0/570: sync 2024-09-17T04:21:20.118 INFO:tasks.workunit.client.0.smithi088.stdout:7/824: stat d2/d4/d7/d46/fe2 0 2024-09-17T04:21:20.119 INFO:tasks.workunit.client.0.smithi088.stdout:5/736: fdatasync d2/d31/dd5/feb 0 2024-09-17T04:21:20.122 INFO:tasks.workunit.client.0.smithi088.stdout:9/868: dread d2/d2b/d2e/dbb/d104/d72/d74/fe6 [0,4194304] 0 2024-09-17T04:21:20.124 INFO:tasks.workunit.client.0.smithi088.stdout:0/571: write db/d1b/d39/f80 [80753,121643] 0 2024-09-17T04:21:20.126 INFO:tasks.workunit.client.0.smithi088.stdout:2/815: mknod d0/d1/d2d/dbd/cf8 0 2024-09-17T04:21:20.127 INFO:tasks.workunit.client.0.smithi088.stdout:6/898: mknod d14/d44/d45/d6b/d29/dac/c134 0 2024-09-17T04:21:20.132 INFO:tasks.workunit.client.0.smithi088.stdout:5/737: mknod d2/da9/cf1 0 2024-09-17T04:21:20.132 INFO:tasks.workunit.client.0.smithi088.stdout:7/825: rmdir d2/d1d/d2e/db0/d23/d45/d62/d82 39 2024-09-17T04:21:20.132 INFO:tasks.workunit.client.0.smithi088.stdout:1/845: dwrite d0/d1/df/d63/ff7 [0,4194304] 0 2024-09-17T04:21:20.133 INFO:tasks.workunit.client.0.smithi088.stdout:1/846: stat d0/d1/df/d63 0 2024-09-17T04:21:20.144 INFO:tasks.workunit.client.0.smithi088.stdout:8/742: dwrite d7/d29/f6e [0,4194304] 0 2024-09-17T04:21:20.144 INFO:tasks.workunit.client.0.smithi088.stdout:6/899: fsync d14/d44/d45/d6b/f39 0 2024-09-17T04:21:20.149 INFO:tasks.workunit.client.0.smithi088.stdout:2/816: truncate d0/d1/d2d/d33/d4b/d24/d3b/d26/f8d 595185 0 2024-09-17T04:21:20.151 INFO:tasks.workunit.client.0.smithi088.stdout:5/738: creat d2/d31/d33/d20/d30/d51/d5e/d6b/ff2 x:0 0 0 2024-09-17T04:21:20.157 INFO:tasks.workunit.client.0.smithi088.stdout:1/847: dread d0/d1/df/d20/dbd/dec/ff4 [0,4194304] 0 2024-09-17T04:21:20.157 INFO:tasks.workunit.client.0.smithi088.stdout:3/808: dread d0/d13/d1b/d29/d2b/f41 [0,4194304] 0 2024-09-17T04:21:20.157 INFO:tasks.workunit.client.0.smithi088.stdout:0/572: write db/f4d [3466618,40722] 0 2024-09-17T04:21:20.159 INFO:tasks.workunit.client.0.smithi088.stdout:1/848: stat d0/d1/df/d85/da3/df6/daa/dfe 0 2024-09-17T04:21:20.159 INFO:tasks.workunit.client.0.smithi088.stdout:0/573: fdatasync db/d1b/d36/d4a/fa2 0 2024-09-17T04:21:20.160 INFO:tasks.workunit.client.0.smithi088.stdout:6/900: symlink d14/d44/d45/d4d/d97/l135 0 2024-09-17T04:21:20.161 INFO:tasks.workunit.client.0.smithi088.stdout:7/826: mknod d2/d4/d7/c105 0 2024-09-17T04:21:20.165 INFO:tasks.workunit.client.0.smithi088.stdout:4/703: unlink d5/d3f/d71/d8b/d75/c76 0 2024-09-17T04:21:20.168 INFO:tasks.workunit.client.0.smithi088.stdout:6/901: dwrite d14/dce/dfe/de0/ff4 [0,4194304] 0 2024-09-17T04:21:20.169 INFO:tasks.workunit.client.0.smithi088.stdout:5/739: unlink d2/d31/d33/d20/d25/d49/l59 0 2024-09-17T04:21:20.176 INFO:tasks.workunit.client.0.smithi088.stdout:8/743: fsync d7/d29/f94 0 2024-09-17T04:21:20.176 INFO:tasks.workunit.client.0.smithi088.stdout:0/574: dread f0 [0,4194304] 0 2024-09-17T04:21:20.176 INFO:tasks.workunit.client.0.smithi088.stdout:8/744: fsync d7/dd/d31/d47/d55/d57/fd5 0 2024-09-17T04:21:20.176 INFO:tasks.workunit.client.0.smithi088.stdout:0/575: dread - db/d67/d7c/fb0 zero size 2024-09-17T04:21:20.177 INFO:tasks.workunit.client.0.smithi088.stdout:8/745: readlink d7/d29/d2a/d38/daf/lc8 0 2024-09-17T04:21:20.179 INFO:tasks.workunit.client.0.smithi088.stdout:9/869: write d2/dd/d14/d8b/d43/d51/f71 [2989146,32284] 0 2024-09-17T04:21:20.180 INFO:tasks.workunit.client.0.smithi088.stdout:4/704: mknod d5/d32/d6b/ce8 0 2024-09-17T04:21:20.184 INFO:tasks.workunit.client.0.smithi088.stdout:0/576: stat db/d1b/c5d 0 2024-09-17T04:21:20.186 INFO:tasks.workunit.client.0.smithi088.stdout:0/577: chown db/d1b/c5d 2511823 1 2024-09-17T04:21:20.186 INFO:tasks.workunit.client.0.smithi088.stdout:9/870: dwrite d2/dd/d11/f4b [0,4194304] 0 2024-09-17T04:21:20.188 INFO:tasks.workunit.client.0.smithi088.stdout:2/817: creat d0/d1/d2d/d33/d80/ff9 x:0 0 0 2024-09-17T04:21:20.188 INFO:tasks.workunit.client.0.smithi088.stdout:0/578: readlink db/d1b/d39/l8a 0 2024-09-17T04:21:20.189 INFO:tasks.workunit.client.0.smithi088.stdout:8/746: mkdir d7/d29/d2a/d38/df8 0 2024-09-17T04:21:20.191 INFO:tasks.workunit.client.0.smithi088.stdout:6/902: mknod d14/d44/d45/d6b/d2a/d52/dcf/d125/c136 0 2024-09-17T04:21:20.193 INFO:tasks.workunit.client.0.smithi088.stdout:5/740: link d2/d31/d33/d20/d25/d49/f64 d2/d31/d33/d20/d25/d49/ff3 0 2024-09-17T04:21:20.193 INFO:tasks.workunit.client.0.smithi088.stdout:1/849: link d0/d1/d16/d35/c48 d0/d1/df/d85/da3/de0/c110 0 2024-09-17T04:21:20.194 INFO:tasks.workunit.client.0.smithi088.stdout:3/809: dread d0/d13/d1b/d29/d30/d35/f3d [0,4194304] 0 2024-09-17T04:21:20.197 INFO:tasks.workunit.client.0.smithi088.stdout:9/871: mkdir d2/dd/d14/d8b/d43/d51/d12c 0 2024-09-17T04:21:20.209 INFO:tasks.workunit.client.0.smithi088.stdout:7/827: getdents d2/d8d 0 2024-09-17T04:21:20.210 INFO:tasks.workunit.client.0.smithi088.stdout:4/705: dread d5/f1f [0,4194304] 0 2024-09-17T04:21:20.211 INFO:tasks.workunit.client.0.smithi088.stdout:2/818: dread d0/d1/d2d/d33/d4b/d24/d3b/d26/f8d [0,4194304] 0 2024-09-17T04:21:20.212 INFO:tasks.workunit.client.0.smithi088.stdout:1/850: dread d0/d1/df/d85/da3/df6/f99 [0,4194304] 0 2024-09-17T04:21:20.213 INFO:tasks.workunit.client.0.smithi088.stdout:9/872: rename d2/dd/d11/f96 to d2/db8/d115/f12d 0 2024-09-17T04:21:20.214 INFO:tasks.workunit.client.0.smithi088.stdout:8/747: truncate d7/d29/f3c 615394 0 2024-09-17T04:21:20.214 INFO:tasks.workunit.client.0.smithi088.stdout:7/828: write d2/d4/d7/d46/da3/fc0 [4528300,17164] 0 2024-09-17T04:21:20.215 INFO:tasks.workunit.client.0.smithi088.stdout:3/810: creat d0/d13/d58/f104 x:0 0 0 2024-09-17T04:21:20.217 INFO:tasks.workunit.client.0.smithi088.stdout:6/903: dread d14/d44/d45/d6b/d16/f51 [0,4194304] 0 2024-09-17T04:21:20.218 INFO:tasks.workunit.client.0.smithi088.stdout:8/748: write d7/d29/d2a/d75/f7a [2519127,107161] 0 2024-09-17T04:21:20.220 INFO:tasks.workunit.client.0.smithi088.stdout:6/904: chown d14/d44/d45/d6b/da7/f107 124 1 2024-09-17T04:21:20.222 INFO:tasks.workunit.client.0.smithi088.stdout:2/819: write d0/d1/d2d/d33/d4b/d24/f86 [5746078,20759] 0 2024-09-17T04:21:20.223 INFO:tasks.workunit.client.0.smithi088.stdout:5/741: dread d2/d31/d33/d20/d30/f4e [0,4194304] 0 2024-09-17T04:21:20.228 INFO:tasks.workunit.client.0.smithi088.stdout:1/851: rename d0/l7e to d0/d1/de7/d103/l111 0 2024-09-17T04:21:20.229 INFO:tasks.workunit.client.0.smithi088.stdout:6/905: mknod d14/d44/d94/db9/dc8/df7/c137 0 2024-09-17T04:21:20.230 INFO:tasks.workunit.client.0.smithi088.stdout:3/811: symlink d0/l105 0 2024-09-17T04:21:20.231 INFO:tasks.workunit.client.0.smithi088.stdout:2/820: unlink d0/d1/d2d/d33/d4b/d6d/d94/ca6 0 2024-09-17T04:21:20.233 INFO:tasks.workunit.client.0.smithi088.stdout:2/821: write d0/d1/d2d/d77/ff6 [230853,54289] 0 2024-09-17T04:21:20.233 INFO:tasks.workunit.client.0.smithi088.stdout:7/829: unlink d2/d1d/d2e/db0/d23/d45/lbd 0 2024-09-17T04:21:20.240 INFO:tasks.workunit.client.0.smithi088.stdout:7/830: dread d2/d4/f33 [0,4194304] 0 2024-09-17T04:21:20.241 INFO:tasks.workunit.client.0.smithi088.stdout:1/852: rmdir d0/d1/df/d20/dbd/dec 39 2024-09-17T04:21:20.244 INFO:tasks.workunit.client.0.smithi088.stdout:3/812: mknod d0/d54/d55/c106 0 2024-09-17T04:21:20.244 INFO:tasks.workunit.client.0.smithi088.stdout:2/822: creat d0/d13/dd1/ffa x:0 0 0 2024-09-17T04:21:20.245 INFO:tasks.workunit.client.0.smithi088.stdout:8/749: rmdir d7/d29/d2a/d38/d3d/d63/dbf 0 2024-09-17T04:21:20.251 INFO:tasks.workunit.client.0.smithi088.stdout:5/742: symlink d2/d31/d33/d20/d25/lf4 0 2024-09-17T04:21:20.252 INFO:tasks.workunit.client.0.smithi088.stdout:7/831: creat d2/d4/d7/d46/d67/f106 x:0 0 0 2024-09-17T04:21:20.253 INFO:tasks.workunit.client.0.smithi088.stdout:3/813: creat d0/d13/d4d/f107 x:0 0 0 2024-09-17T04:21:20.272 INFO:tasks.workunit.client.0.smithi088.stdout:3/814: fsync d0/d13/d1b/d29/d2b/d40/fcc 0 2024-09-17T04:21:20.273 INFO:tasks.workunit.client.0.smithi088.stdout:3/815: stat d0/d13/d1b/d29/fea 0 2024-09-17T04:21:20.275 INFO:tasks.workunit.client.0.smithi088.stdout:4/706: write d5/d32/d6b/f9c [837940,13269] 0 2024-09-17T04:21:20.276 INFO:tasks.workunit.client.0.smithi088.stdout:3/816: dread d0/d13/d58/d5a/f8c [0,4194304] 0 2024-09-17T04:21:20.276 INFO:tasks.workunit.client.0.smithi088.stdout:9/873: write d2/f50 [2837731,35332] 0 2024-09-17T04:21:20.279 INFO:tasks.workunit.client.0.smithi088.stdout:1/853: link d0/d1/d16/d35/la9 d0/d1/d16/d2a/l112 0 2024-09-17T04:21:20.283 INFO:tasks.workunit.client.0.smithi088.stdout:4/707: mknod d5/d3f/d71/d8b/d75/ce9 0 2024-09-17T04:21:20.284 INFO:tasks.workunit.client.0.smithi088.stdout:1/854: symlink d0/d1/de7/l113 0 2024-09-17T04:21:20.286 INFO:tasks.workunit.client.0.smithi088.stdout:3/817: creat d0/d54/dda/f108 x:0 0 0 2024-09-17T04:21:20.288 INFO:tasks.workunit.client.0.smithi088.stdout:1/855: symlink d0/d13/d84/d5d/l114 0 2024-09-17T04:21:20.289 INFO:tasks.workunit.client.0.smithi088.stdout:8/750: link d7/d29/ca9 d7/d29/d2a/cf9 0 2024-09-17T04:21:20.290 INFO:tasks.workunit.client.0.smithi088.stdout:8/751: write d7/dd/f56 [1591532,39073] 0 2024-09-17T04:21:20.290 INFO:tasks.workunit.client.0.smithi088.stdout:9/874: rename d2/d2b/d2e/f84 to d2/dd/d14/f12e 0 2024-09-17T04:21:20.292 INFO:tasks.workunit.client.0.smithi088.stdout:3/818: chown d0/d13/f22 122483 1 2024-09-17T04:21:20.297 INFO:tasks.workunit.client.0.smithi088.stdout:8/752: chown d7/d29/f2e 22904897 1 2024-09-17T04:21:20.299 INFO:tasks.workunit.client.0.smithi088.stdout:9/875: mknod d2/d2b/d58/c12f 0 2024-09-17T04:21:20.300 INFO:tasks.workunit.client.0.smithi088.stdout:9/876: chown d2/d2b/d2e/dbb/d104/d72/d74/fe6 7609267 1 2024-09-17T04:21:20.301 INFO:tasks.workunit.client.0.smithi088.stdout:1/856: dread d0/d1/df/d20/f49 [0,4194304] 0 2024-09-17T04:21:20.301 INFO:tasks.workunit.client.0.smithi088.stdout:3/819: creat d0/d13/d1b/d29/d30/d35/d65/f109 x:0 0 0 2024-09-17T04:21:20.303 INFO:tasks.workunit.client.0.smithi088.stdout:7/832: write d2/d1d/d2e/db0/d23/d45/d62/f76 [821042,76851] 0 2024-09-17T04:21:20.303 INFO:tasks.workunit.client.0.smithi088.stdout:7/833: chown d2 0 1 2024-09-17T04:21:20.304 INFO:tasks.workunit.client.0.smithi088.stdout:7/834: stat d2 0 2024-09-17T04:21:20.306 INFO:tasks.workunit.client.0.smithi088.stdout:7/835: read d2/d4/d7/d20/f3a [1763674,82248] 0 2024-09-17T04:21:20.308 INFO:tasks.workunit.client.0.smithi088.stdout:5/743: dwrite d2/d31/d33/d20/d25/f57 [0,4194304] 0 2024-09-17T04:21:20.308 INFO:tasks.workunit.client.0.smithi088.stdout:2/823: truncate d0/d1/d2d/d33/fa8 3521519 0 2024-09-17T04:21:20.310 INFO:tasks.workunit.client.0.smithi088.stdout:2/824: chown d0/d1/d2d/f84 0 1 2024-09-17T04:21:20.312 INFO:tasks.workunit.client.0.smithi088.stdout:1/857: symlink d0/d1/df/l115 0 2024-09-17T04:21:20.313 INFO:tasks.workunit.client.0.smithi088.stdout:2/825: write d0/d1/d2d/d33/d4b/d24/d3b/f59 [3458994,89469] 0 2024-09-17T04:21:20.318 INFO:tasks.workunit.client.0.smithi088.stdout:7/836: creat d2/d1d/d2e/db0/d23/d45/d6d/f107 x:0 0 0 2024-09-17T04:21:20.319 INFO:tasks.workunit.client.0.smithi088.stdout:3/820: dread d0/d13/d1b/d29/d30/d3c/f51 [0,4194304] 0 2024-09-17T04:21:20.320 INFO:tasks.workunit.client.0.smithi088.stdout:5/744: creat d2/da9/ff5 x:0 0 0 2024-09-17T04:21:20.322 INFO:tasks.workunit.client.0.smithi088.stdout:3/821: chown d0/d13/d1b/d29/d2b/d50/l8f 1309 1 2024-09-17T04:21:20.323 INFO:tasks.workunit.client.0.smithi088.stdout:5/745: dread - d2/d31/d33/d20/d25/d49/f9a zero size 2024-09-17T04:21:20.326 INFO:tasks.workunit.client.0.smithi088.stdout:4/708: dwrite d5/d3f/d71/d8b/d68/dab/fb2 [0,4194304] 0 2024-09-17T04:21:20.328 INFO:tasks.workunit.client.0.smithi088.stdout:2/826: rename d0/d1/d2d/d33/d80/f40 to d0/d1/d2d/d33/d4b/d6d/d94/da5/ffb 0 2024-09-17T04:21:20.329 INFO:tasks.workunit.client.0.smithi088.stdout:4/709: stat d5/d3f/d71/d8b/d68/da4/d5e/f8d 0 2024-09-17T04:21:20.331 INFO:tasks.workunit.client.0.smithi088.stdout:1/858: link d0/d1/df/d63/f76 d0/d1/d16/d2a/d9c/dc8/f116 0 2024-09-17T04:21:20.335 INFO:tasks.workunit.client.0.smithi088.stdout:5/746: dwrite d2/f10 [0,4194304] 0 2024-09-17T04:21:20.336 INFO:tasks.workunit.client.0.smithi088.stdout:8/753: link d7/d29/c25 d7/d29/cfa 0 2024-09-17T04:21:20.338 INFO:tasks.workunit.client.0.smithi088.stdout:4/710: mknod d5/d3d/d73/cea 0 2024-09-17T04:21:20.340 INFO:tasks.workunit.client.0.smithi088.stdout:8/754: chown d7/d29/d2a/d38/l4b 0 1 2024-09-17T04:21:20.341 INFO:tasks.workunit.client.0.smithi088.stdout:9/877: dwrite d2/dd/d14/d8b/d35/f88 [0,4194304] 0 2024-09-17T04:21:20.342 INFO:tasks.workunit.client.0.smithi088.stdout:8/755: dread - d7/d7f/ff3 zero size 2024-09-17T04:21:20.344 INFO:tasks.workunit.client.0.smithi088.stdout:3/822: symlink d0/d13/d58/dd7/dd4/l10a 0 2024-09-17T04:21:20.344 INFO:tasks.workunit.client.0.smithi088.stdout:2/827: mkdir d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/d7c/dfc 0 2024-09-17T04:21:20.347 INFO:tasks.workunit.client.0.smithi088.stdout:1/859: rmdir d0/d1/df/d85/da3/df6/d9e 39 2024-09-17T04:21:20.348 INFO:tasks.workunit.client.0.smithi088.stdout:2/828: write d0/d1/d2d/d33/d80/ff9 [244170,16571] 0 2024-09-17T04:21:20.353 INFO:tasks.workunit.client.0.smithi088.stdout:4/711: mkdir d5/d3f/d71/d8b/d68/dab/deb 0 2024-09-17T04:21:20.355 INFO:tasks.workunit.client.0.smithi088.stdout:9/878: dread - d2/d16/fed zero size 2024-09-17T04:21:20.356 INFO:tasks.workunit.client.0.smithi088.stdout:9/879: chown d2/dd/d14/d8b/d35 317398772 1 2024-09-17T04:21:20.357 INFO:tasks.workunit.client.0.smithi088.stdout:3/823: rename d0/d93 to d0/d13/d1b/d29/d30/d35/d65/d10b 0 2024-09-17T04:21:20.359 INFO:tasks.workunit.client.0.smithi088.stdout:5/747: creat d2/d31/d33/d20/d8b/ff6 x:0 0 0 2024-09-17T04:21:20.361 INFO:tasks.workunit.client.0.smithi088.stdout:1/860: rename d0/d1/df/d85/da3/de0 to d0/d1/d16/d35/d117 0 2024-09-17T04:21:20.363 INFO:tasks.workunit.client.0.smithi088.stdout:3/824: creat d0/d13/d1b/d29/d2b/d40/f10c x:0 0 0 2024-09-17T04:21:20.365 INFO:tasks.workunit.client.0.smithi088.stdout:2/829: creat d0/d1/d2d/d33/ffd x:0 0 0 2024-09-17T04:21:20.366 INFO:tasks.workunit.client.0.smithi088.stdout:9/880: dwrite d2/d2b/d2e/f10c [0,4194304] 0 2024-09-17T04:21:20.368 INFO:tasks.workunit.client.0.smithi088.stdout:4/712: rename d5/d3d/d73/c94 to d5/d3f/d71/d8b/d75/dd0/cec 0 2024-09-17T04:21:20.371 INFO:tasks.workunit.client.0.smithi088.stdout:1/861: creat d0/d1/d16/d35/dc5/f118 x:0 0 0 2024-09-17T04:21:20.372 INFO:tasks.workunit.client.0.smithi088.stdout:3/825: dread d0/d13/d1b/d29/d2b/d50/fb4 [0,4194304] 0 2024-09-17T04:21:20.374 INFO:tasks.workunit.client.0.smithi088.stdout:3/826: chown d0/d13/d1b/d29/d2b/d40 24 1 2024-09-17T04:21:20.375 INFO:tasks.workunit.client.0.smithi088.stdout:8/756: dread d7/d7f/f8b [0,4194304] 0 2024-09-17T04:21:20.376 INFO:tasks.workunit.client.0.smithi088.stdout:9/881: chown d2/dd/d14/d8b/d43/c11a 959 1 2024-09-17T04:21:20.377 INFO:tasks.workunit.client.0.smithi088.stdout:2/830: dread - d0/d1/d2d/d33/d4b/d24/d3b/d22/fdb zero size 2024-09-17T04:21:20.377 INFO:tasks.workunit.client.0.smithi088.stdout:1/862: dread d0/d1/d16/d2a/fad [0,4194304] 0 2024-09-17T04:21:20.378 INFO:tasks.workunit.client.0.smithi088.stdout:4/713: symlink d5/d3f/d71/d8b/d75/dd0/led 0 2024-09-17T04:21:20.385 INFO:tasks.workunit.client.0.smithi088.stdout:4/714: dwrite d5/d3f/d71/d99/fe0 [0,4194304] 0 2024-09-17T04:21:20.387 INFO:tasks.workunit.client.0.smithi088.stdout:3/827: symlink d0/d13/d1b/d29/d30/dde/l10d 0 2024-09-17T04:21:20.388 INFO:tasks.workunit.client.0.smithi088.stdout:8/757: mkdir d7/d29/d2a/d38/df8/dfb 0 2024-09-17T04:21:20.390 INFO:tasks.workunit.client.0.smithi088.stdout:9/882: symlink d2/dd/d11/l130 0 2024-09-17T04:21:20.392 INFO:tasks.workunit.client.0.smithi088.stdout:8/758: write d7/dd/d31/d47/d55/f61 [768517,125020] 0 2024-09-17T04:21:20.394 INFO:tasks.workunit.client.0.smithi088.stdout:8/759: write d7/dd/f56 [2194171,5160] 0 2024-09-17T04:21:20.395 INFO:tasks.workunit.client.0.smithi088.stdout:4/715: dwrite d5/f1f [0,4194304] 0 2024-09-17T04:21:20.396 INFO:tasks.workunit.client.0.smithi088.stdout:1/863: mkdir d0/d1/d16/d119 0 2024-09-17T04:21:20.397 INFO:tasks.workunit.client.0.smithi088.stdout:3/828: read - d0/f9f zero size 2024-09-17T04:21:20.399 INFO:tasks.workunit.client.0.smithi088.stdout:2/831: dread d0/d1/f11 [0,4194304] 0 2024-09-17T04:21:20.400 INFO:tasks.workunit.client.0.smithi088.stdout:9/883: dread d2/f7 [0,4194304] 0 2024-09-17T04:21:20.402 INFO:tasks.workunit.client.0.smithi088.stdout:8/760: symlink d7/d29/d2a/d38/d3d/lfc 0 2024-09-17T04:21:20.402 INFO:tasks.workunit.client.0.smithi088.stdout:4/716: write d5/d3f/d71/d99/fe0 [5008594,39343] 0 2024-09-17T04:21:20.404 INFO:tasks.workunit.client.0.smithi088.stdout:8/761: write d7/dd/d6f/db6/ff7 [16699,41274] 0 2024-09-17T04:21:20.411 INFO:tasks.workunit.client.0.smithi088.stdout:1/864: symlink d0/d1/df/d85/da3/d10f/l11a 0 2024-09-17T04:21:20.411 INFO:tasks.workunit.client.0.smithi088.stdout:4/717: mkdir d5/d3d/dee 0 2024-09-17T04:21:20.412 INFO:tasks.workunit.client.0.smithi088.stdout:1/865: dread - d0/d1/df/d63/d91/f97 zero size 2024-09-17T04:21:20.413 INFO:tasks.workunit.client.0.smithi088.stdout:1/866: stat d0/d1/d27/f40 0 2024-09-17T04:21:20.421 INFO:tasks.workunit.client.0.smithi088.stdout:1/867: dwrite d0/d1/de7/fea [0,4194304] 0 2024-09-17T04:21:20.431 INFO:tasks.workunit.client.0.smithi088.stdout:2/832: dread d0/d1/d2d/d33/d4b/d6d/d94/da5/fe1 [0,4194304] 0 2024-09-17T04:21:20.452 INFO:tasks.workunit.client.0.smithi088.stdout:4/718: rename d5/d3f/d71/d8b/d68/da4/d5e/f60 to d5/d3f/d71/d8b/d68/da4/d5e/d83/fef 0 2024-09-17T04:21:20.453 INFO:tasks.workunit.client.0.smithi088.stdout:4/719: write d5/f4e [242751,92170] 0 2024-09-17T04:21:20.454 INFO:tasks.workunit.client.0.smithi088.stdout:4/720: chown d5/d3f/d71/d8b/d68/l97 1314 1 2024-09-17T04:21:20.460 INFO:tasks.workunit.client.0.smithi088.stdout:8/762: getdents d7/dd/d31 0 2024-09-17T04:21:20.470 INFO:tasks.workunit.client.0.smithi088.stdout:9/884: dwrite d2/dd/d14/d2a/d76/d98/fcc [0,4194304] 0 2024-09-17T04:21:20.470 INFO:tasks.workunit.client.0.smithi088.stdout:2/833: dread d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/d9a/fa7 [0,4194304] 0 2024-09-17T04:21:20.473 INFO:tasks.workunit.client.0.smithi088.stdout:4/721: dread d5/d3f/d71/d8b/d68/da4/d5e/d83/f87 [0,4194304] 0 2024-09-17T04:21:20.473 INFO:tasks.workunit.client.0.smithi088.stdout:3/829: dwrite d0/d13/f24 [0,4194304] 0 2024-09-17T04:21:20.474 INFO:tasks.workunit.client.0.smithi088.stdout:9/885: chown d2/dd/d14/d8b/d35/da5/f10d 10 1 2024-09-17T04:21:20.486 INFO:tasks.workunit.client.0.smithi088.stdout:4/722: creat d5/d3f/d71/ff0 x:0 0 0 2024-09-17T04:21:20.492 INFO:tasks.workunit.client.0.smithi088.stdout:1/868: getdents d0/d1/d16/d35/dc5 0 2024-09-17T04:21:20.500 INFO:tasks.workunit.client.0.smithi088.stdout:9/886: mkdir d2/dd/d14/d131 0 2024-09-17T04:21:20.500 INFO:tasks.workunit.client.0.smithi088.stdout:3/830: dread d0/f12 [0,4194304] 0 2024-09-17T04:21:20.505 INFO:tasks.workunit.client.0.smithi088.stdout:4/723: symlink d5/d3d/d73/de7/lf1 0 2024-09-17T04:21:20.508 INFO:tasks.workunit.client.0.smithi088.stdout:3/831: read d0/f2 [1004325,95726] 0 2024-09-17T04:21:20.512 INFO:tasks.workunit.client.0.smithi088.stdout:9/887: mknod d2/d2b/d58/d82/df3/c132 0 2024-09-17T04:21:20.514 INFO:tasks.workunit.client.0.smithi088.stdout:3/832: truncate d0/d54/f7f 1508025 0 2024-09-17T04:21:20.515 INFO:tasks.workunit.client.0.smithi088.stdout:1/869: link d0/d1/df/d85/lcc d0/d1/d16/dae/db8/l11b 0 2024-09-17T04:21:20.524 INFO:tasks.workunit.client.0.smithi088.stdout:1/870: unlink d0/d1/df/d85/da3/df6/daa/d5b/c5c 0 2024-09-17T04:21:20.529 INFO:tasks.workunit.client.0.smithi088.stdout:4/724: getdents d5/d32/d6b 0 2024-09-17T04:21:20.536 INFO:tasks.workunit.client.0.smithi088.stdout:3/833: dread d0/d13/d1b/d29/d30/d3c/f87 [0,4194304] 0 2024-09-17T04:21:20.541 INFO:tasks.workunit.client.0.smithi088.stdout:3/834: rmdir d0/d13/d1b/d29/d2b/d50 39 2024-09-17T04:21:20.541 INFO:tasks.workunit.client.0.smithi088.stdout:3/835: chown d0/d13/d1b/d29/d30/d81/de0 4556136 1 2024-09-17T04:21:20.542 INFO:tasks.workunit.client.0.smithi088.stdout:3/836: rename d0/l20 to d0/dae/l10e 0 2024-09-17T04:21:20.544 INFO:tasks.workunit.client.0.smithi088.stdout:3/837: write d0/d13/d1b/d29/d2b/f41 [101868,47922] 0 2024-09-17T04:21:20.550 INFO:tasks.workunit.client.0.smithi088.stdout:4/725: dread d5/d3f/d71/d8b/d68/dab/fb1 [0,4194304] 0 2024-09-17T04:21:20.553 INFO:tasks.workunit.client.0.smithi088.stdout:4/726: creat d5/d32/ff2 x:0 0 0 2024-09-17T04:21:20.569 INFO:tasks.workunit.client.0.smithi088.stdout:8/763: write d7/d29/d2a/f33 [2314317,52769] 0 2024-09-17T04:21:20.587 INFO:tasks.workunit.client.0.smithi088.stdout:2/834: dwrite d0/d1/d2d/f53 [0,4194304] 0 2024-09-17T04:21:20.593 INFO:tasks.workunit.client.0.smithi088.stdout:2/835: dwrite d0/d1/f3 [8388608,4194304] 0 2024-09-17T04:21:20.605 INFO:tasks.workunit.client.0.smithi088.stdout:1/871: creat d0/d1/df/d85/da3/df6/daa/f11c x:0 0 0 2024-09-17T04:21:20.606 INFO:tasks.workunit.client.0.smithi088.stdout:1/872: write d0/d1/d27/d108/f10e [777279,16647] 0 2024-09-17T04:21:20.618 INFO:tasks.workunit.client.0.smithi088.stdout:1/873: dread d0/d1/df/d20/ddf/faf [0,4194304] 0 2024-09-17T04:21:20.622 INFO:tasks.workunit.client.0.smithi088.stdout:2/836: link d0/d1/d2d/d33/d4b/d24/d92/fac d0/d13/dd1/ffe 0 2024-09-17T04:21:20.624 INFO:tasks.workunit.client.0.smithi088.stdout:2/837: fsync d0/d1/d2d/d33/d4b/d24/fdf 0 2024-09-17T04:21:20.626 INFO:tasks.workunit.client.0.smithi088.stdout:3/838: dwrite d0/d13/d1b/d29/d2b/d50/f91 [0,4194304] 0 2024-09-17T04:21:20.629 INFO:tasks.workunit.client.0.smithi088.stdout:2/838: read d0/d1/d2d/d33/d4b/d24/d3b/d22/dba/fc2 [2339341,19187] 0 2024-09-17T04:21:20.743 INFO:tasks.workunit.client.0.smithi088.stdout:8/764: rename d7/d29/d2a/d38/c91 to d7/dd/cfd 0 2024-09-17T04:21:20.747 INFO:tasks.workunit.client.0.smithi088.stdout:4/727: dwrite d5/d3f/d71/d8b/d75/f8e [0,4194304] 0 2024-09-17T04:21:20.747 INFO:tasks.workunit.client.0.smithi088.stdout:1/874: dread d0/d1/d16/d2a/f79 [0,4194304] 0 2024-09-17T04:21:20.749 INFO:tasks.workunit.client.0.smithi088.stdout:3/839: mkdir d0/d13/d58/d5e/d10f 0 2024-09-17T04:21:20.750 INFO:tasks.workunit.client.0.smithi088.stdout:2/839: creat d0/d1/d2d/d33/d4b/d24/d3b/d26/d8c/fff x:0 0 0 2024-09-17T04:21:20.754 INFO:tasks.workunit.client.0.smithi088.stdout:9/888: link d2/d2b/d58/f11e d2/dd/d14/d2a/d76/d98/f133 0 2024-09-17T04:21:20.755 INFO:tasks.workunit.client.0.smithi088.stdout:4/728: symlink d5/lf3 0 2024-09-17T04:21:20.757 INFO:tasks.workunit.client.0.smithi088.stdout:1/875: dwrite d0/d1/d16/d35/dc5/f118 [0,4194304] 0 2024-09-17T04:21:20.757 INFO:tasks.workunit.client.0.smithi088.stdout:8/765: creat d7/d29/d2a/d38/d3d/d63/db7/ffe x:0 0 0 2024-09-17T04:21:20.760 INFO:tasks.workunit.client.0.smithi088.stdout:3/840: symlink d0/d13/d1b/d29/d30/l110 0 2024-09-17T04:21:20.763 INFO:tasks.workunit.client.0.smithi088.stdout:1/876: symlink d0/d1/d16/d2a/l11d 0 2024-09-17T04:21:20.765 INFO:tasks.workunit.client.0.smithi088.stdout:8/766: rmdir d7/dd/d31 39 2024-09-17T04:21:20.765 INFO:tasks.workunit.client.0.smithi088.stdout:1/877: fdatasync d0/d1/df/d20/ddf/fd9 0 2024-09-17T04:21:20.767 INFO:tasks.workunit.client.0.smithi088.stdout:8/767: write d7/d29/d2a/d38/d3d/d63/d97/fd9 [93238,32612] 0 2024-09-17T04:21:20.771 INFO:tasks.workunit.client.0.smithi088.stdout:3/841: creat d0/d13/d58/d5e/dc6/dcd/f111 x:0 0 0 2024-09-17T04:21:20.772 INFO:tasks.workunit.client.0.smithi088.stdout:2/840: write d0/d1/f1e [2817816,95653] 0 2024-09-17T04:21:20.775 INFO:tasks.workunit.client.0.smithi088.stdout:9/889: truncate d2/d2b/d58/f11e 857809 0 2024-09-17T04:21:20.777 INFO:tasks.workunit.client.0.smithi088.stdout:3/842: read d0/d13/d1b/d29/d2b/d40/fcc [2105603,107908] 0 2024-09-17T04:21:20.777 INFO:tasks.workunit.client.0.smithi088.stdout:8/768: rmdir d7/dd/d31/dca/de6 39 2024-09-17T04:21:20.779 INFO:tasks.workunit.client.0.smithi088.stdout:9/890: creat d2/d2b/d2e/dbb/f134 x:0 0 0 2024-09-17T04:21:20.780 INFO:tasks.workunit.client.0.smithi088.stdout:2/841: truncate d0/d1/d2d/d33/d4b/d24/d3b/d22/dba/fc2 5239576 0 2024-09-17T04:21:20.784 INFO:tasks.workunit.client.0.smithi088.stdout:1/878: dread d0/d1/fda [0,4194304] 0 2024-09-17T04:21:20.784 INFO:tasks.workunit.client.0.smithi088.stdout:9/891: fsync d2/d2b/f54 0 2024-09-17T04:21:20.784 INFO:tasks.workunit.client.0.smithi088.stdout:2/842: rmdir d0/d13/dd1/def 39 2024-09-17T04:21:20.791 INFO:tasks.workunit.client.0.smithi088.stdout:8/769: creat d7/dd/d31/dca/fff x:0 0 0 2024-09-17T04:21:20.792 INFO:tasks.workunit.client.0.smithi088.stdout:9/892: fdatasync d2/d16/d116/fef 0 2024-09-17T04:21:20.802 INFO:tasks.workunit.client.0.smithi088.stdout:1/879: symlink d0/d1/df/d85/da3/df6/d9e/l11e 0 2024-09-17T04:21:20.804 INFO:tasks.workunit.client.0.smithi088.stdout:1/880: read d0/d1/d16/d35/d117/ffb [107028,6834] 0 2024-09-17T04:21:20.804 INFO:tasks.workunit.client.0.smithi088.stdout:2/843: link d0/d1/f11 d0/d1/d2d/d33/d4b/d6d/d94/da5/f100 0 2024-09-17T04:21:20.805 INFO:tasks.workunit.client.0.smithi088.stdout:8/770: write d7/d29/d2a/d38/d42/f4e [4026569,92044] 0 2024-09-17T04:21:20.806 INFO:tasks.workunit.client.0.smithi088.stdout:3/843: getdents d0/d13/d58/d5a/d63/d80 0 2024-09-17T04:21:20.806 INFO:tasks.workunit.client.0.smithi088.stdout:9/893: write d2/dd/d11/d30/f62 [5116321,109153] 0 2024-09-17T04:21:20.808 INFO:tasks.workunit.client.0.smithi088.stdout:8/771: dread - d7/dd/d31/d47/fe2 zero size 2024-09-17T04:21:20.811 INFO:tasks.workunit.client.0.smithi088.stdout:3/844: truncate d0/d13/d1b/d29/d2b/fbc 4519804 0 2024-09-17T04:21:20.812 INFO:tasks.workunit.client.0.smithi088.stdout:1/881: dwrite d0/d1/de7/fea [0,4194304] 0 2024-09-17T04:21:20.814 INFO:tasks.workunit.client.0.smithi088.stdout:8/772: mknod d7/dd/d31/d47/dc6/c100 0 2024-09-17T04:21:20.814 INFO:tasks.workunit.client.0.smithi088.stdout:1/882: write d0/d13/f54 [4351301,129145] 0 2024-09-17T04:21:20.815 INFO:tasks.workunit.client.0.smithi088.stdout:1/883: stat d0/d13/d84/ce8 0 2024-09-17T04:21:20.817 INFO:tasks.workunit.client.0.smithi088.stdout:3/845: fsync d0/d13/d1b/d29/d2b/d40/fcc 0 2024-09-17T04:21:20.821 INFO:tasks.workunit.client.0.smithi088.stdout:8/773: unlink d7/dd/d6f/db6/fcc 0 2024-09-17T04:21:20.823 INFO:tasks.workunit.client.0.smithi088.stdout:9/894: creat d2/d2b/d2e/dbb/d104/d72/d11d/f135 x:0 0 0 2024-09-17T04:21:20.826 INFO:tasks.workunit.client.0.smithi088.stdout:3/846: mknod d0/d13/d1b/d29/d30/d35/d65/c112 0 2024-09-17T04:21:20.827 INFO:tasks.workunit.client.0.smithi088.stdout:3/847: dread - d0/d13/d1b/d29/d2b/d50/fa5 zero size 2024-09-17T04:21:20.829 INFO:tasks.workunit.client.0.smithi088.stdout:3/848: write d0/d13/d58/dd7/dd4/fe9 [1428110,126271] 0 2024-09-17T04:21:20.829 INFO:tasks.workunit.client.0.smithi088.stdout:9/895: unlink d2/d16/d116/fef 0 2024-09-17T04:21:20.835 INFO:tasks.workunit.client.0.smithi088.stdout:9/896: mkdir d2/d2b/d2e/dbb/d104/d72/d136 0 2024-09-17T04:21:20.836 INFO:tasks.workunit.client.0.smithi088.stdout:1/884: getdents d0/d1/df/d20/dbd 0 2024-09-17T04:21:20.840 INFO:tasks.workunit.client.0.smithi088.stdout:9/897: symlink d2/dd/d14/d2a/d76/d98/db3/l137 0 2024-09-17T04:21:20.841 INFO:tasks.workunit.client.0.smithi088.stdout:9/898: write d2/f50 [4377572,106320] 0 2024-09-17T04:21:20.842 INFO:tasks.workunit.client.0.smithi088.stdout:9/899: chown d2/dd/d14/d8b/d35/da5/fff 7642 1 2024-09-17T04:21:20.845 INFO:tasks.workunit.client.0.smithi088.stdout:9/900: fsync d2/d2b/f54 0 2024-09-17T04:21:20.847 INFO:tasks.workunit.client.0.smithi088.stdout:1/885: write d0/d1/d16/d35/f5f [1875858,95228] 0 2024-09-17T04:21:20.847 INFO:tasks.workunit.client.0.smithi088.stdout:3/849: dwrite d0/d13/d1b/d29/d2b/f3f [0,4194304] 0 2024-09-17T04:21:20.851 INFO:tasks.workunit.client.0.smithi088.stdout:1/886: creat d0/d1/df/d85/da3/df6/ded/f11f x:0 0 0 2024-09-17T04:21:20.854 INFO:tasks.workunit.client.0.smithi088.stdout:3/850: truncate d0/d13/d58/d5a/d63/d80/f9c 422866 0 2024-09-17T04:21:20.854 INFO:tasks.workunit.client.0.smithi088.stdout:9/901: getdents d2/dd/d14/d8b/d35/d94 0 2024-09-17T04:21:20.856 INFO:tasks.workunit.client.0.smithi088.stdout:9/902: write d2/d2b/d2e/dbb/d104/d72/d74/f117 [357139,39587] 0 2024-09-17T04:21:20.858 INFO:tasks.workunit.client.0.smithi088.stdout:3/851: symlink d0/d54/l113 0 2024-09-17T04:21:20.860 INFO:tasks.workunit.client.0.smithi088.stdout:9/903: mkdir d2/dd/d14/d8b/d43/d51/d12c/d138 0 2024-09-17T04:21:20.864 INFO:tasks.workunit.client.0.smithi088.stdout:9/904: truncate d2/d2b/d58/d82/f95 977875 0 2024-09-17T04:21:20.864 INFO:tasks.workunit.client.0.smithi088.stdout:1/887: dread d0/d1/df/d85/da3/df6/daa/d5b/d87/f93 [0,4194304] 0 2024-09-17T04:21:20.867 INFO:tasks.workunit.client.0.smithi088.stdout:1/888: dread d0/d1/d16/d35/fd8 [0,4194304] 0 2024-09-17T04:21:20.867 INFO:tasks.workunit.client.0.smithi088.stdout:9/905: truncate d2/dd/d14/d8b/d35/f6c 4240875 0 2024-09-17T04:21:20.870 INFO:tasks.workunit.client.0.smithi088.stdout:3/852: dread d0/d13/d58/d5e/dc6/dcd/ff7 [0,4194304] 0 2024-09-17T04:21:20.871 INFO:tasks.workunit.client.0.smithi088.stdout:3/853: stat d0/d54/l113 0 2024-09-17T04:21:20.873 INFO:tasks.workunit.client.0.smithi088.stdout:3/854: dread - d0/d13/d58/d5e/dc6/dcd/f111 zero size 2024-09-17T04:21:20.874 INFO:tasks.workunit.client.0.smithi088.stdout:9/906: dwrite d2/d2b/d2e/ff4 [0,4194304] 0 2024-09-17T04:21:20.874 INFO:tasks.workunit.client.0.smithi088.stdout:3/855: chown d0/d13/d58/cec 711 1 2024-09-17T04:21:20.878 INFO:tasks.workunit.client.0.smithi088.stdout:9/907: creat d2/dd/d14/d8b/d35/d94/dfc/f139 x:0 0 0 2024-09-17T04:21:20.879 INFO:tasks.workunit.client.0.smithi088.stdout:3/856: creat d0/d13/d58/d5e/d10f/f114 x:0 0 0 2024-09-17T04:21:20.879 INFO:tasks.workunit.client.0.smithi088.stdout:3/857: fsync d0/d13/d1b/fe2 0 2024-09-17T04:21:20.880 INFO:tasks.workunit.client.0.smithi088.stdout:9/908: mkdir d2/d16/d13a 0 2024-09-17T04:21:20.881 INFO:tasks.workunit.client.0.smithi088.stdout:3/858: write d0/d13/d1b/d29/d30/ff5 [146177,100748] 0 2024-09-17T04:21:20.883 INFO:tasks.workunit.client.0.smithi088.stdout:3/859: chown d0/d13/d1b/d29/d30/d3c/f51 33 1 2024-09-17T04:21:20.886 INFO:tasks.workunit.client.0.smithi088.stdout:9/909: dread d2/dd/d14/d2a/d8f/d99/fce [0,4194304] 0 2024-09-17T04:21:20.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:20 smithi088 ceph-mon[27811]: pgmap v31: 65 pgs: 65 active+clean; 3.1 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 64 MiB/s rd, 131 MiB/s wr, 345 op/s 2024-09-17T04:21:20.889 INFO:tasks.workunit.client.0.smithi088.stdout:9/910: read d2/d2b/d2e/dbb/d104/d72/d74/f117 [265644,8224] 0 2024-09-17T04:21:20.894 INFO:tasks.workunit.client.0.smithi088.stdout:3/860: dread d0/d13/d58/d5a/d63/f75 [0,4194304] 0 2024-09-17T04:21:20.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:20 smithi134 ceph-mon[35201]: pgmap v31: 65 pgs: 65 active+clean; 3.1 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 64 MiB/s rd, 131 MiB/s wr, 345 op/s 2024-09-17T04:21:20.898 INFO:tasks.workunit.client.0.smithi088.stdout:9/911: rename d2/d2b/d7c/le3 to d2/dd/d14/l13b 0 2024-09-17T04:21:20.903 INFO:tasks.workunit.client.0.smithi088.stdout:9/912: link d2/dd/d14/d2a/d76/f120 d2/d2b/d58/f13c 0 2024-09-17T04:21:20.905 INFO:tasks.workunit.client.0.smithi088.stdout:9/913: creat d2/d16/ddd/d105/f13d x:0 0 0 2024-09-17T04:21:20.906 INFO:tasks.workunit.client.0.smithi088.stdout:9/914: write d2/dd/d14/fe2 [146658,121164] 0 2024-09-17T04:21:20.908 INFO:tasks.workunit.client.0.smithi088.stdout:3/861: write d0/d13/d58/d5e/dc6/dcd/ff7 [2284175,59444] 0 2024-09-17T04:21:20.910 INFO:tasks.workunit.client.0.smithi088.stdout:3/862: fdatasync d0/d13/d1b/d29/d2b/d50/fa5 0 2024-09-17T04:21:20.912 INFO:tasks.workunit.client.0.smithi088.stdout:3/863: write d0/d13/d1b/d29/d2b/d50/f74 [2855660,26729] 0 2024-09-17T04:21:20.912 INFO:tasks.workunit.client.0.smithi088.stdout:3/864: chown d0/dae/de5 2497527 1 2024-09-17T04:21:20.925 INFO:tasks.workunit.client.0.smithi088.stdout:3/865: dwrite d0/d13/f53 [0,4194304] 0 2024-09-17T04:21:20.928 INFO:tasks.workunit.client.0.smithi088.stdout:3/866: dread d0/d13/d1b/d29/d2b/d50/fb4 [0,4194304] 0 2024-09-17T04:21:20.934 INFO:tasks.workunit.client.0.smithi088.stdout:3/867: dwrite d0/d13/d1b/d29/d30/d81/de0/f103 [0,4194304] 0 2024-09-17T04:21:20.944 INFO:tasks.workunit.client.0.smithi088.stdout:3/868: dwrite d0/d13/d1b/d29/f3b [0,4194304] 0 2024-09-17T04:21:20.949 INFO:tasks.workunit.client.0.smithi088.stdout:3/869: fsync d0/d13/fce 0 2024-09-17T04:21:20.955 INFO:tasks.workunit.client.0.smithi088.stdout:3/870: rmdir d0/d54/d55/db9 0 2024-09-17T04:21:20.960 INFO:tasks.workunit.client.0.smithi088.stdout:3/871: dwrite d0/d13/d1b/d29/d2b/f41 [0,4194304] 0 2024-09-17T04:21:20.962 INFO:tasks.workunit.client.0.smithi088.stdout:3/872: chown d0/d13/d1b/d29/d2b/d40/ldd 8196247 1 2024-09-17T04:21:20.962 INFO:tasks.workunit.client.0.smithi088.stdout:3/873: fdatasync d0/d13/d1b/d29/d30/d3c/dc9/ff0 0 2024-09-17T04:21:20.963 INFO:tasks.workunit.client.0.smithi088.stdout:3/874: chown d0/d54/d55/c106 2068816098 1 2024-09-17T04:21:20.964 INFO:tasks.workunit.client.0.smithi088.stdout:3/875: rmdir d0/d13/d58/dfd 39 2024-09-17T04:21:20.978 INFO:tasks.workunit.client.0.smithi088.stdout:3/876: dwrite d0/d13/d1b/d29/d30/f48 [0,4194304] 0 2024-09-17T04:21:20.986 INFO:tasks.workunit.client.0.smithi088.stdout:3/877: dwrite d0/d13/d1b/d29/d30/d3c/dc9/ff0 [0,4194304] 0 2024-09-17T04:21:20.990 INFO:tasks.workunit.client.0.smithi088.stdout:3/878: link d0/d13/d1b/d29/d2b/d50/f67 d0/d13/d58/d5e/f115 0 2024-09-17T04:21:20.994 INFO:tasks.workunit.client.0.smithi088.stdout:3/879: truncate d0/d54/fb7 366364 0 2024-09-17T04:21:20.996 INFO:tasks.workunit.client.0.smithi088.stdout:3/880: fsync d0/d13/d1b/d29/d30/d35/d65/f109 0 2024-09-17T04:21:20.998 INFO:tasks.workunit.client.0.smithi088.stdout:3/881: creat d0/d13/d58/d5e/dc6/dcd/f116 x:0 0 0 2024-09-17T04:21:21.005 INFO:tasks.workunit.client.0.smithi088.stdout:3/882: dwrite d0/d13/d1b/d29/d30/d3c/fa4 [0,4194304] 0 2024-09-17T04:21:21.008 INFO:tasks.workunit.client.0.smithi088.stdout:3/883: fsync d0/d13/fce 0 2024-09-17T04:21:21.014 INFO:tasks.workunit.client.0.smithi088.stdout:3/884: symlink d0/d13/d1b/d29/d2b/l117 0 2024-09-17T04:21:21.017 INFO:tasks.workunit.client.0.smithi088.stdout:3/885: truncate d0/d13/d1b/f21 334008 0 2024-09-17T04:21:21.019 INFO:tasks.workunit.client.0.smithi088.stdout:3/886: dread - d0/d13/d1b/d29/d56/d85/fdc zero size 2024-09-17T04:21:21.078 INFO:tasks.workunit.client.0.smithi088.stdout:0/579: sync 2024-09-17T04:21:21.079 INFO:tasks.workunit.client.0.smithi088.stdout:0/580: rmdir db/d1b/d39/d83 39 2024-09-17T04:21:21.080 INFO:tasks.workunit.client.0.smithi088.stdout:0/581: write db/f13 [630154,100230] 0 2024-09-17T04:21:21.083 INFO:tasks.workunit.client.0.smithi088.stdout:0/582: mkdir db/d3c/d4f/d59/da4/dc8 0 2024-09-17T04:21:21.085 INFO:tasks.workunit.client.0.smithi088.stdout:0/583: creat db/d1b/d36/d47/fc9 x:0 0 0 2024-09-17T04:21:21.087 INFO:tasks.workunit.client.0.smithi088.stdout:0/584: creat db/d1b/d36/d4a/d20/fca x:0 0 0 2024-09-17T04:21:21.091 INFO:tasks.workunit.client.0.smithi088.stdout:0/585: getdents db/d1b 0 2024-09-17T04:21:21.094 INFO:tasks.workunit.client.0.smithi088.stdout:0/586: mknod db/d1b/d39/d83/ccb 0 2024-09-17T04:21:21.095 INFO:tasks.workunit.client.0.smithi088.stdout:0/587: mknod db/d1b/d39/d83/ccc 0 2024-09-17T04:21:21.098 INFO:tasks.workunit.client.0.smithi088.stdout:0/588: link db/d1b/d39/f62 db/d3c/d4f/d9f/dc4/fcd 0 2024-09-17T04:21:21.100 INFO:tasks.workunit.client.0.smithi088.stdout:0/589: creat db/d67/d7c/fce x:0 0 0 2024-09-17T04:21:21.100 INFO:tasks.workunit.client.0.smithi088.stdout:0/590: chown db/d3c/d4f/d66 0 1 2024-09-17T04:21:21.105 INFO:tasks.workunit.client.0.smithi088.stdout:0/591: getdents db/d3c/d4f 0 2024-09-17T04:21:21.110 INFO:tasks.workunit.client.0.smithi088.stdout:0/592: dwrite db/d1b/d36/d4a/d6a/f56 [0,4194304] 0 2024-09-17T04:21:21.135 INFO:tasks.workunit.client.0.smithi088.stdout:0/593: dwrite db/d1b/d36/f9c [0,4194304] 0 2024-09-17T04:21:21.136 INFO:tasks.workunit.client.0.smithi088.stdout:0/594: readlink db/d1b/d39/l45 0 2024-09-17T04:21:21.139 INFO:tasks.workunit.client.0.smithi088.stdout:0/595: unlink db/c38 0 2024-09-17T04:21:21.142 INFO:tasks.workunit.client.0.smithi088.stdout:0/596: creat db/d1b/d36/d47/db9/fcf x:0 0 0 2024-09-17T04:21:21.145 INFO:tasks.workunit.client.0.smithi088.stdout:0/597: creat db/d1b/d39/fd0 x:0 0 0 2024-09-17T04:21:21.153 INFO:tasks.workunit.client.0.smithi088.stdout:0/598: dread db/f12 [0,4194304] 0 2024-09-17T04:21:21.154 INFO:tasks.workunit.client.0.smithi088.stdout:0/599: readlink db/le 0 2024-09-17T04:21:21.157 INFO:tasks.workunit.client.0.smithi088.stdout:0/600: symlink db/db2/dc0/ld1 0 2024-09-17T04:21:21.160 INFO:tasks.workunit.client.0.smithi088.stdout:0/601: creat db/d3c/fd2 x:0 0 0 2024-09-17T04:21:21.194 INFO:tasks.workunit.client.0.smithi088.stdout:0/602: dread db/f4c [0,4194304] 0 2024-09-17T04:21:21.199 INFO:tasks.workunit.client.0.smithi088.stdout:0/603: mkdir db/d1b/d36/d4a/dd3 0 2024-09-17T04:21:21.202 INFO:tasks.workunit.client.0.smithi088.stdout:0/604: rename db/d1b/d36/d4a/d6a/f56 to db/d3c/d4f/d9f/fd4 0 2024-09-17T04:21:21.204 INFO:tasks.workunit.client.0.smithi088.stdout:0/605: fdatasync db/d1b/f89 0 2024-09-17T04:21:21.205 INFO:tasks.workunit.client.0.smithi088.stdout:7/837: sync 2024-09-17T04:21:21.205 INFO:tasks.workunit.client.0.smithi088.stdout:6/906: sync 2024-09-17T04:21:21.207 INFO:tasks.workunit.client.0.smithi088.stdout:0/606: mkdir db/d3c/d4f/dd5 0 2024-09-17T04:21:21.207 INFO:tasks.workunit.client.0.smithi088.stdout:0/607: write db/d1b/d39/fd0 [842633,28032] 0 2024-09-17T04:21:21.208 INFO:tasks.workunit.client.0.smithi088.stdout:7/838: mknod d2/d4/d7/d20/c108 0 2024-09-17T04:21:21.209 INFO:tasks.workunit.client.0.smithi088.stdout:7/839: chown d2/d1d/d2e/l4c 1 1 2024-09-17T04:21:21.210 INFO:tasks.workunit.client.0.smithi088.stdout:0/608: truncate db/d3c/d4f/d66/fab 327388 0 2024-09-17T04:21:21.211 INFO:tasks.workunit.client.0.smithi088.stdout:7/840: write d2/d1d/d2e/db0/d23/d45/d62/f76 [1569576,17199] 0 2024-09-17T04:21:21.213 INFO:tasks.workunit.client.0.smithi088.stdout:0/609: symlink db/ld6 0 2024-09-17T04:21:21.217 INFO:tasks.workunit.client.0.smithi088.stdout:6/907: dwrite d14/d44/d45/d6b/d2a/d52/fdc [0,4194304] 0 2024-09-17T04:21:21.220 INFO:tasks.workunit.client.0.smithi088.stdout:7/841: dwrite d2/d4/d7/f9f [0,4194304] 0 2024-09-17T04:21:21.222 INFO:tasks.workunit.client.0.smithi088.stdout:6/908: rename d14/d44/d94/db9/dc8/df7/f101 to d14/d44/dad/f138 0 2024-09-17T04:21:21.226 INFO:tasks.workunit.client.0.smithi088.stdout:6/909: fsync d14/d44/d45/d6b/d16/d42/df3/d112/f129 0 2024-09-17T04:21:21.230 INFO:tasks.workunit.client.0.smithi088.stdout:0/610: dread db/d1b/f89 [0,4194304] 0 2024-09-17T04:21:21.232 INFO:tasks.workunit.client.0.smithi088.stdout:6/910: dwrite d14/d44/d94/db9/fe8 [0,4194304] 0 2024-09-17T04:21:21.234 INFO:tasks.workunit.client.0.smithi088.stdout:6/911: fdatasync d14/d44/f8a 0 2024-09-17T04:21:21.360 INFO:tasks.workunit.client.0.smithi088.stdout:0/611: unlink db/d3c/d4f/d66/d82/cc2 0 2024-09-17T04:21:21.424 INFO:tasks.workunit.client.0.smithi088.stdout:0/612: fsync db/d3c/d4f/d9f/fd4 0 2024-09-17T04:21:21.426 INFO:tasks.workunit.client.0.smithi088.stdout:6/912: symlink d14/d44/d45/d6b/d2a/d52/d90/d11e/l139 0 2024-09-17T04:21:21.427 INFO:tasks.workunit.client.0.smithi088.stdout:7/842: dwrite d2/d1d/ff6 [0,4194304] 0 2024-09-17T04:21:21.429 INFO:tasks.workunit.client.0.smithi088.stdout:0/613: unlink db/d1b/d36/f43 0 2024-09-17T04:21:21.430 INFO:tasks.workunit.client.0.smithi088.stdout:7/843: truncate d2/d4/d7/d46/fe2 696223 0 2024-09-17T04:21:21.430 INFO:tasks.workunit.client.0.smithi088.stdout:0/614: dread - db/d67/d7c/fce zero size 2024-09-17T04:21:21.431 INFO:tasks.workunit.client.0.smithi088.stdout:7/844: fsync d2/d79/f7a 0 2024-09-17T04:21:21.432 INFO:tasks.workunit.client.0.smithi088.stdout:6/913: rename d14/d44/d45/d6b/d29/d5e/l126 to d14/d44/d45/d6b/d29/dac/d11a/l13a 0 2024-09-17T04:21:21.433 INFO:tasks.workunit.client.0.smithi088.stdout:7/845: dread - d2/d1d/d2e/db0/d23/d45/d6d/f107 zero size 2024-09-17T04:21:21.441 INFO:tasks.workunit.client.0.smithi088.stdout:6/914: rename d14/d44/d45/d6b/fe7 to d14/d44/d45/d6b/d2a/d52/f13b 0 2024-09-17T04:21:21.442 INFO:tasks.workunit.client.0.smithi088.stdout:6/915: symlink d14/d3a/l13c 0 2024-09-17T04:21:21.444 INFO:tasks.workunit.client.0.smithi088.stdout:6/916: mknod d14/d44/d45/d6b/da7/c13d 0 2024-09-17T04:21:21.464 INFO:tasks.workunit.client.0.smithi088.stdout:6/917: write d14/d44/d45/d6b/d29/f5f [850539,25467] 0 2024-09-17T04:21:21.464 INFO:tasks.workunit.client.0.smithi088.stdout:7/846: dwrite d2/d4/d7/f34 [0,4194304] 0 2024-09-17T04:21:21.465 INFO:tasks.workunit.client.0.smithi088.stdout:0/615: dwrite db/d1b/d36/d4a/d6a/f68 [0,4194304] 0 2024-09-17T04:21:21.471 INFO:tasks.workunit.client.0.smithi088.stdout:7/847: rmdir d2/d4/d7/d46/d67 39 2024-09-17T04:21:21.474 INFO:tasks.workunit.client.0.smithi088.stdout:7/848: write d2/d1d/d2e/db0/d23/d45/d62/ff4 [492347,36112] 0 2024-09-17T04:21:21.474 INFO:tasks.workunit.client.0.smithi088.stdout:0/616: readlink db/d3c/d4f/d59/da4/lc1 0 2024-09-17T04:21:21.483 INFO:tasks.workunit.client.0.smithi088.stdout:0/617: read db/d1b/d36/d47/f30 [1889081,50056] 0 2024-09-17T04:21:21.485 INFO:tasks.workunit.client.0.smithi088.stdout:0/618: creat db/d3c/d4f/d59/fd7 x:0 0 0 2024-09-17T04:21:21.487 INFO:tasks.workunit.client.0.smithi088.stdout:0/619: truncate db/d1b/d39/f80 794319 0 2024-09-17T04:21:21.487 INFO:tasks.workunit.client.0.smithi088.stdout:0/620: truncate db/db2/fc7 118327 0 2024-09-17T04:21:21.493 INFO:tasks.workunit.client.0.smithi088.stdout:0/621: link db/d1b/d39/c6e db/cd8 0 2024-09-17T04:21:21.493 INFO:tasks.workunit.client.0.smithi088.stdout:7/849: dwrite d2/f8a [0,4194304] 0 2024-09-17T04:21:21.496 INFO:tasks.workunit.client.0.smithi088.stdout:0/622: unlink db/lf 0 2024-09-17T04:21:21.497 INFO:tasks.workunit.client.0.smithi088.stdout:0/623: read - db/d3c/fd2 zero size 2024-09-17T04:21:21.499 INFO:tasks.workunit.client.0.smithi088.stdout:7/850: dwrite d2/d4/d7/d46/da3/fc0 [0,4194304] 0 2024-09-17T04:21:21.502 INFO:tasks.workunit.client.0.smithi088.stdout:7/851: truncate d2/f6 728244 0 2024-09-17T04:21:21.504 INFO:tasks.workunit.client.0.smithi088.stdout:5/748: sync 2024-09-17T04:21:21.505 INFO:tasks.workunit.client.0.smithi088.stdout:6/918: dread d14/d44/d45/d6b/d29/f2d [0,4194304] 0 2024-09-17T04:21:21.506 INFO:tasks.workunit.client.0.smithi088.stdout:6/919: truncate d14/d44/dad/dc0/f108 549571 0 2024-09-17T04:21:21.507 INFO:tasks.workunit.client.0.smithi088.stdout:7/852: mkdir d2/d1d/d2e/db0/d23/d45/d6d/d109 0 2024-09-17T04:21:21.510 INFO:tasks.workunit.client.0.smithi088.stdout:5/749: unlink d2/da9/ff5 0 2024-09-17T04:21:21.513 INFO:tasks.workunit.client.0.smithi088.stdout:5/750: write d2/d31/d33/d20/d30/d51/d5e/f78 [106440,6945] 0 2024-09-17T04:21:21.514 INFO:tasks.workunit.client.0.smithi088.stdout:0/624: write db/d1b/d39/f3a [1850928,50779] 0 2024-09-17T04:21:21.515 INFO:tasks.workunit.client.0.smithi088.stdout:6/920: dwrite d14/d2f/d87/d9d/f104 [0,4194304] 0 2024-09-17T04:21:21.525 INFO:tasks.workunit.client.0.smithi088.stdout:6/921: creat d14/d44/d45/f13e x:0 0 0 2024-09-17T04:21:21.528 INFO:tasks.workunit.client.0.smithi088.stdout:7/853: write d2/d1d/f6a [10164776,34034] 0 2024-09-17T04:21:21.532 INFO:tasks.workunit.client.0.smithi088.stdout:5/751: write d2/d31/d33/d20/f46 [3192609,93249] 0 2024-09-17T04:21:21.534 INFO:tasks.workunit.client.0.smithi088.stdout:5/752: fsync d2/d31/d33/d20/d30/fcd 0 2024-09-17T04:21:21.534 INFO:tasks.workunit.client.0.smithi088.stdout:7/854: dwrite d2/d4/d7/f5f [0,4194304] 0 2024-09-17T04:21:21.535 INFO:tasks.workunit.client.0.smithi088.stdout:6/922: link d14/d44/d45/d4d/c11c d14/d44/d45/d6b/d29/d5e/c13f 0 2024-09-17T04:21:21.535 INFO:tasks.workunit.client.0.smithi088.stdout:5/753: fdatasync d2/d31/f67 0 2024-09-17T04:21:21.536 INFO:tasks.workunit.client.0.smithi088.stdout:7/855: chown d2/d4 1154779 1 2024-09-17T04:21:21.540 INFO:tasks.workunit.client.0.smithi088.stdout:6/923: unlink d14/dce/dfe/lb4 0 2024-09-17T04:21:21.546 INFO:tasks.workunit.client.0.smithi088.stdout:0/625: dread db/fc [0,4194304] 0 2024-09-17T04:21:21.546 INFO:tasks.workunit.client.0.smithi088.stdout:7/856: dwrite d2/d1d/d2e/db0/d23/d45/d62/f9e [0,4194304] 0 2024-09-17T04:21:21.548 INFO:tasks.workunit.client.0.smithi088.stdout:6/924: rename d14/d44/d45/d6b/d2a to d14/d44/d45/d6b/da7/d140 0 2024-09-17T04:21:21.550 INFO:tasks.workunit.client.0.smithi088.stdout:6/925: write d14/d44/d45/d6b/d29/d3e/f73 [924477,17014] 0 2024-09-17T04:21:21.551 INFO:tasks.workunit.client.0.smithi088.stdout:4/729: sync 2024-09-17T04:21:21.551 INFO:tasks.workunit.client.0.smithi088.stdout:8/774: sync 2024-09-17T04:21:21.551 INFO:tasks.workunit.client.0.smithi088.stdout:2/844: sync 2024-09-17T04:21:21.551 INFO:tasks.workunit.client.0.smithi088.stdout:3/887: sync 2024-09-17T04:21:21.551 INFO:tasks.workunit.client.0.smithi088.stdout:9/915: sync 2024-09-17T04:21:21.551 INFO:tasks.workunit.client.0.smithi088.stdout:1/889: sync 2024-09-17T04:21:21.553 INFO:tasks.workunit.client.0.smithi088.stdout:0/626: symlink db/d67/d7c/ld9 0 2024-09-17T04:21:21.553 INFO:tasks.workunit.client.0.smithi088.stdout:1/890: chown d0/d13/f54 53399 1 2024-09-17T04:21:21.555 INFO:tasks.workunit.client.0.smithi088.stdout:8/775: write d7/d29/d7e/fc0 [239195,74970] 0 2024-09-17T04:21:21.556 INFO:tasks.workunit.client.0.smithi088.stdout:2/845: write d0/d1/d2d/d33/d4b/d24/d3b/d22/dba/fe6 [200489,97341] 0 2024-09-17T04:21:21.560 INFO:tasks.workunit.client.0.smithi088.stdout:7/857: rmdir d2/d1d/d2e/db0/d23/d45/d6d/d109 0 2024-09-17T04:21:21.561 INFO:tasks.workunit.client.0.smithi088.stdout:7/858: write d2/d4/d7/d20/f101 [985845,44008] 0 2024-09-17T04:21:21.561 INFO:tasks.workunit.client.0.smithi088.stdout:3/888: creat d0/d13/d58/d5a/d63/d80/f118 x:0 0 0 2024-09-17T04:21:21.563 INFO:tasks.workunit.client.0.smithi088.stdout:3/889: stat d0/d13/d1b/d29/d30/d3c/d5c/f98 0 2024-09-17T04:21:21.564 INFO:tasks.workunit.client.0.smithi088.stdout:3/890: stat d0/d13/d58/fb1 0 2024-09-17T04:21:21.566 INFO:tasks.workunit.client.0.smithi088.stdout:2/846: unlink d0/d1/d2d/d33/d4b/d24/d3b/f7f 0 2024-09-17T04:21:21.568 INFO:tasks.workunit.client.0.smithi088.stdout:4/730: rename d5/d3f/fbf to d5/d3f/d71/d99/ff4 0 2024-09-17T04:21:21.573 INFO:tasks.workunit.client.0.smithi088.stdout:0/627: mkdir db/d1b/d36/d47/db9/dda 0 2024-09-17T04:21:21.573 INFO:tasks.workunit.client.0.smithi088.stdout:7/859: truncate d2/d4/d7/d46/f4e 721950 0 2024-09-17T04:21:21.574 INFO:tasks.workunit.client.0.smithi088.stdout:4/731: write d5/d3f/d71/dd8/fda [62015,113430] 0 2024-09-17T04:21:21.577 INFO:tasks.workunit.client.0.smithi088.stdout:4/732: write d5/d32/d6b/f9c [496388,88925] 0 2024-09-17T04:21:21.578 INFO:tasks.workunit.client.0.smithi088.stdout:2/847: read d0/d1/d2d/d33/d65/fdc [19403,92882] 0 2024-09-17T04:21:21.580 INFO:tasks.workunit.client.0.smithi088.stdout:6/926: write d14/d44/d45/d6b/da7/d140/f5a [935480,17917] 0 2024-09-17T04:21:21.582 INFO:tasks.workunit.client.0.smithi088.stdout:7/860: dread d2/d4/d7/d20/f101 [0,4194304] 0 2024-09-17T04:21:21.583 INFO:tasks.workunit.client.0.smithi088.stdout:9/916: dwrite d2/dd/d14/f20 [0,4194304] 0 2024-09-17T04:21:21.587 INFO:tasks.workunit.client.0.smithi088.stdout:2/848: dread d0/d13/dd1/ffe [0,4194304] 0 2024-09-17T04:21:21.587 INFO:tasks.workunit.client.0.smithi088.stdout:9/917: readlink d2/d2b/d58/dcf/l113 0 2024-09-17T04:21:21.591 INFO:tasks.workunit.client.0.smithi088.stdout:9/918: write d2/dd/d14/d8b/d35/d94/dfc/f139 [552710,57795] 0 2024-09-17T04:21:21.595 INFO:tasks.workunit.client.0.smithi088.stdout:6/927: dwrite d14/d44/d45/d6b/da7/d140/f5a [0,4194304] 0 2024-09-17T04:21:21.595 INFO:tasks.workunit.client.0.smithi088.stdout:9/919: chown d2/dd/d11/d30/f121 60656 1 2024-09-17T04:21:21.596 INFO:tasks.workunit.client.0.smithi088.stdout:1/891: dwrite d0/d13/d84/d5d/f78 [0,4194304] 0 2024-09-17T04:21:21.599 INFO:tasks.workunit.client.0.smithi088.stdout:3/891: dread d0/d13/d1b/d29/d30/d3c/d5c/f98 [0,4194304] 0 2024-09-17T04:21:21.604 INFO:tasks.workunit.client.0.smithi088.stdout:9/920: dwrite d2/dd/d14/d8b/d43/d51/f126 [0,4194304] 0 2024-09-17T04:21:21.606 INFO:tasks.workunit.client.0.smithi088.stdout:9/921: stat d2/d2b/d2e/dbb/d104/d5c/dbc/cf0 0 2024-09-17T04:21:21.620 INFO:tasks.workunit.client.0.smithi088.stdout:0/628: dread db/d3c/d4f/d66/fab [0,4194304] 0 2024-09-17T04:21:21.624 INFO:tasks.workunit.client.0.smithi088.stdout:7/861: creat d2/d1d/d2e/db0/d23/d45/d6d/f10a x:0 0 0 2024-09-17T04:21:21.627 INFO:tasks.workunit.client.0.smithi088.stdout:6/928: write d14/d44/f103 [4904568,43864] 0 2024-09-17T04:21:21.628 INFO:tasks.workunit.client.0.smithi088.stdout:6/929: readlink d14/d44/d45/d6b/d29/d3e/l48 0 2024-09-17T04:21:21.630 INFO:tasks.workunit.client.0.smithi088.stdout:6/930: truncate d14/d44/d45/d6b/fbf 1869973 0 2024-09-17T04:21:21.631 INFO:tasks.workunit.client.0.smithi088.stdout:3/892: mkdir d0/d13/d1b/d29/d30/d3c/dc9/d119 0 2024-09-17T04:21:21.633 INFO:tasks.workunit.client.0.smithi088.stdout:9/922: unlink d2/dd/d11/d30/fc7 0 2024-09-17T04:21:21.639 INFO:tasks.workunit.client.0.smithi088.stdout:7/862: rmdir d2/d4/d9b 39 2024-09-17T04:21:21.643 INFO:tasks.workunit.client.0.smithi088.stdout:6/931: rename d14/d44/d45/d6b/da7 to d14/d44/d116/d141 0 2024-09-17T04:21:21.648 INFO:tasks.workunit.client.0.smithi088.stdout:0/629: mknod db/d1b/d39/cdb 0 2024-09-17T04:21:21.651 INFO:tasks.workunit.client.0.smithi088.stdout:1/892: rmdir d0/d1/d16/d119 0 2024-09-17T04:21:21.651 INFO:tasks.workunit.client.0.smithi088.stdout:9/923: dwrite d2/d16/d116/f45 [0,4194304] 0 2024-09-17T04:21:21.653 INFO:tasks.workunit.client.0.smithi088.stdout:1/893: truncate d0/de3/df5/f10a 994686 0 2024-09-17T04:21:21.654 INFO:tasks.workunit.client.0.smithi088.stdout:6/932: mkdir d14/d44/d116/d141/d142 0 2024-09-17T04:21:21.657 INFO:tasks.workunit.client.0.smithi088.stdout:0/630: fsync db/d1b/d39/f73 0 2024-09-17T04:21:21.658 INFO:tasks.workunit.client.0.smithi088.stdout:6/933: chown d14/dce/dfe/ffc 0 1 2024-09-17T04:21:21.660 INFO:tasks.workunit.client.0.smithi088.stdout:7/863: dread d2/d1d/d2e/db0/d23/d45/d62/fcb [0,4194304] 0 2024-09-17T04:21:21.661 INFO:tasks.workunit.client.0.smithi088.stdout:9/924: dwrite d2/db8/f12b [0,4194304] 0 2024-09-17T04:21:21.662 INFO:tasks.workunit.client.0.smithi088.stdout:1/894: dread d0/d1/df/d85/da3/df6/d9e/fd4 [0,4194304] 0 2024-09-17T04:21:21.665 INFO:tasks.workunit.client.0.smithi088.stdout:1/895: write d0/d1/fa [1630341,48783] 0 2024-09-17T04:21:21.667 INFO:tasks.workunit.client.0.smithi088.stdout:6/934: creat d14/d44/d45/d4d/f143 x:0 0 0 2024-09-17T04:21:21.667 INFO:tasks.workunit.client.0.smithi088.stdout:1/896: stat d0/d1/df/d85/da3/df6/d9e/ffd 0 2024-09-17T04:21:21.668 INFO:tasks.workunit.client.0.smithi088.stdout:0/631: rename db/d1b/d39/d83/ccc to db/d3c/d4f/d59/cdc 0 2024-09-17T04:21:21.671 INFO:tasks.workunit.client.0.smithi088.stdout:9/925: creat d2/dd/d14/d2a/d8f/d99/f13e x:0 0 0 2024-09-17T04:21:21.673 INFO:tasks.workunit.client.0.smithi088.stdout:1/897: write d0/d13/d84/dcd/fd2 [372451,78206] 0 2024-09-17T04:21:21.675 INFO:tasks.workunit.client.0.smithi088.stdout:9/926: creat d2/d2b/d58/f13f x:0 0 0 2024-09-17T04:21:21.675 INFO:tasks.workunit.client.0.smithi088.stdout:6/935: mkdir d14/d44/d116/d141/d140/d52/d90/d144 0 2024-09-17T04:21:21.678 INFO:tasks.workunit.client.0.smithi088.stdout:6/936: fsync d14/d44/d45/d6b/f39 0 2024-09-17T04:21:21.680 INFO:tasks.workunit.client.0.smithi088.stdout:9/927: creat d2/d16/dd7/d11c/f140 x:0 0 0 2024-09-17T04:21:21.681 INFO:tasks.workunit.client.0.smithi088.stdout:4/733: write d5/d3f/d71/d8b/d68/da4/d5e/fc9 [785345,42162] 0 2024-09-17T04:21:21.681 INFO:tasks.workunit.client.0.smithi088.stdout:9/928: chown d2/dd/d14/d2a/d76/f120 3 1 2024-09-17T04:21:21.684 INFO:tasks.workunit.client.0.smithi088.stdout:9/929: write d2/dd/d14/d2a/d76/d98/db3/fc9 [533322,48994] 0 2024-09-17T04:21:21.684 INFO:tasks.workunit.client.0.smithi088.stdout:6/937: getdents d14/d44/d94/db9 0 2024-09-17T04:21:21.687 INFO:tasks.workunit.client.0.smithi088.stdout:9/930: fdatasync d2/dd/f15 0 2024-09-17T04:21:21.690 INFO:tasks.workunit.client.0.smithi088.stdout:6/938: truncate d14/d44/d45/d4d/d97/fa1 807352 0 2024-09-17T04:21:21.692 INFO:tasks.workunit.client.0.smithi088.stdout:2/849: write d0/d1/d2d/d33/d4b/d6d/d94/da5/ffb [250965,51038] 0 2024-09-17T04:21:21.693 INFO:tasks.workunit.client.0.smithi088.stdout:9/931: truncate d2/dd/d14/d8b/d35/f5f 2037823 0 2024-09-17T04:21:21.695 INFO:tasks.workunit.client.0.smithi088.stdout:0/632: dread db/d3c/d4f/f75 [0,4194304] 0 2024-09-17T04:21:21.698 INFO:tasks.workunit.client.0.smithi088.stdout:1/898: dread d0/d1/f61 [0,4194304] 0 2024-09-17T04:21:21.699 INFO:tasks.workunit.client.0.smithi088.stdout:1/899: chown d0/d1/de7/d103 88949 1 2024-09-17T04:21:21.700 INFO:tasks.workunit.client.0.smithi088.stdout:6/939: mknod d14/d44/d45/d6b/d29/d122/c145 0 2024-09-17T04:21:21.701 INFO:tasks.workunit.client.0.smithi088.stdout:3/893: dwrite d0/d13/d58/d5e/fb5 [0,4194304] 0 2024-09-17T04:21:21.709 INFO:tasks.workunit.client.0.smithi088.stdout:2/850: dread d0/d1/d2d/d33/d4b/d6d/d94/da5/fe1 [0,4194304] 0 2024-09-17T04:21:21.711 INFO:tasks.workunit.client.0.smithi088.stdout:6/940: dwrite d14/d2f/f36 [4194304,4194304] 0 2024-09-17T04:21:21.716 INFO:tasks.workunit.client.0.smithi088.stdout:3/894: dwrite d0/d13/d1b/d29/d2b/f3f [0,4194304] 0 2024-09-17T04:21:21.717 INFO:tasks.workunit.client.0.smithi088.stdout:6/941: symlink d14/d44/d94/db9/l146 0 2024-09-17T04:21:21.719 INFO:tasks.workunit.client.0.smithi088.stdout:7/864: dwrite d2/d4/f33 [0,4194304] 0 2024-09-17T04:21:21.721 INFO:tasks.workunit.client.0.smithi088.stdout:7/865: chown d2/d1d/d2e/db0/d23/d97/dbb/ce1 50250985 1 2024-09-17T04:21:21.722 INFO:tasks.workunit.client.0.smithi088.stdout:7/866: readlink d2/d1d/d2e/db0/l26 0 2024-09-17T04:21:21.724 INFO:tasks.workunit.client.0.smithi088.stdout:3/895: creat d0/d13/d58/d5e/dc6/f11a x:0 0 0 2024-09-17T04:21:21.725 INFO:tasks.workunit.client.0.smithi088.stdout:6/942: creat d14/d44/d116/f147 x:0 0 0 2024-09-17T04:21:21.727 INFO:tasks.workunit.client.0.smithi088.stdout:6/943: write d14/dce/dfe/de0/ff4 [110988,91737] 0 2024-09-17T04:21:21.731 INFO:tasks.workunit.client.0.smithi088.stdout:0/633: rename db/d3c/d4f/d59/cdc to db/cdd 0 2024-09-17T04:21:21.731 INFO:tasks.workunit.client.0.smithi088.stdout:3/896: read d0/d13/d1b/d29/d2b/d50/f74 [3800108,81386] 0 2024-09-17T04:21:21.733 INFO:tasks.workunit.client.0.smithi088.stdout:7/867: fdatasync d2/d4/d7/d46/d67/f72 0 2024-09-17T04:21:21.738 INFO:tasks.workunit.client.0.smithi088.stdout:9/932: write d2/d2b/d2e/dbb/d104/dd5/ffe [2678406,122512] 0 2024-09-17T04:21:21.744 INFO:tasks.workunit.client.0.smithi088.stdout:1/900: rename d0/d1/df/d20/cf0 to d0/d1/df/d85/da3/df6/ded/c120 0 2024-09-17T04:21:21.745 INFO:tasks.workunit.client.0.smithi088.stdout:1/901: dread d0/d1/d16/d35/fd8 [0,4194304] 0 2024-09-17T04:21:21.748 INFO:tasks.workunit.client.0.smithi088.stdout:7/868: mknod d2/d1d/d2e/db0/ddf/c10b 0 2024-09-17T04:21:21.748 INFO:tasks.workunit.client.0.smithi088.stdout:7/869: fdatasync d2/fee 0 2024-09-17T04:21:21.752 INFO:tasks.workunit.client.0.smithi088.stdout:9/933: fdatasync d2/f8 0 2024-09-17T04:21:21.755 INFO:tasks.workunit.client.0.smithi088.stdout:2/851: dwrite d0/d1/d2d/d33/f82 [0,4194304] 0 2024-09-17T04:21:21.755 INFO:tasks.workunit.client.0.smithi088.stdout:3/897: dread d0/f2 [0,4194304] 0 2024-09-17T04:21:21.756 INFO:tasks.workunit.client.0.smithi088.stdout:0/634: mknod db/d3c/d4f/d59/da4/cde 0 2024-09-17T04:21:21.758 INFO:tasks.workunit.client.0.smithi088.stdout:3/898: dread - d0/d13/d58/fe4 zero size 2024-09-17T04:21:21.761 INFO:tasks.workunit.client.0.smithi088.stdout:7/870: creat d2/d4/d7/d46/da3/dd1/f10c x:0 0 0 2024-09-17T04:21:21.761 INFO:tasks.workunit.client.0.smithi088.stdout:6/944: write d14/d44/dad/fcb [1928966,124459] 0 2024-09-17T04:21:21.764 INFO:tasks.workunit.client.0.smithi088.stdout:9/934: dwrite d2/d16/d116/f45 [0,4194304] 0 2024-09-17T04:21:21.773 INFO:tasks.workunit.client.0.smithi088.stdout:3/899: creat d0/d13/d1b/d29/d30/dde/f11b x:0 0 0 2024-09-17T04:21:21.774 INFO:tasks.workunit.client.0.smithi088.stdout:0/635: read db/f9d [427317,54952] 0 2024-09-17T04:21:21.775 INFO:tasks.workunit.client.0.smithi088.stdout:6/945: mknod d14/d44/d45/d6b/d29/d5e/c148 0 2024-09-17T04:21:21.777 INFO:tasks.workunit.client.0.smithi088.stdout:9/935: fsync d2/dd/d14/d8b/d43/fd9 0 2024-09-17T04:21:21.778 INFO:tasks.workunit.client.0.smithi088.stdout:9/936: readlink d2/l4e 0 2024-09-17T04:21:21.780 INFO:tasks.workunit.client.0.smithi088.stdout:1/902: truncate d0/d13/f68 3089686 0 2024-09-17T04:21:21.783 INFO:tasks.workunit.client.0.smithi088.stdout:6/946: fdatasync d14/d44/d45/d6b/d29/f2d 0 2024-09-17T04:21:21.785 INFO:tasks.workunit.client.0.smithi088.stdout:6/947: write d14/d44/d94/fbd [1811071,56004] 0 2024-09-17T04:21:21.791 INFO:tasks.workunit.client.0.smithi088.stdout:2/852: creat d0/d1/d2d/d33/d4b/d24/d3b/f101 x:0 0 0 2024-09-17T04:21:21.791 INFO:tasks.workunit.client.0.smithi088.stdout:7/871: truncate d2/d4/d7/f34 1882058 0 2024-09-17T04:21:21.792 INFO:tasks.workunit.client.0.smithi088.stdout:3/900: dwrite d0/d13/d1b/d29/d30/d35/f66 [0,4194304] 0 2024-09-17T04:21:21.793 INFO:tasks.workunit.client.0.smithi088.stdout:3/901: read - d0/d13/d4d/f107 zero size 2024-09-17T04:21:21.796 INFO:tasks.workunit.client.0.smithi088.stdout:0/636: unlink db/d1b/d36/d4a/d20/c86 0 2024-09-17T04:21:21.805 INFO:tasks.workunit.client.0.smithi088.stdout:2/853: symlink d0/d1/dc5/l102 0 2024-09-17T04:21:21.808 INFO:tasks.workunit.client.0.smithi088.stdout:1/903: dwrite d0/d13/d84/f90 [0,4194304] 0 2024-09-17T04:21:21.808 INFO:tasks.workunit.client.0.smithi088.stdout:7/872: truncate d2/d4/d7/d46/d67/fa9 86784 0 2024-09-17T04:21:21.810 INFO:tasks.workunit.client.0.smithi088.stdout:6/948: dwrite d14/d44/d45/d6b/fbf [0,4194304] 0 2024-09-17T04:21:21.817 INFO:tasks.workunit.client.0.smithi088.stdout:3/902: unlink d0/d13/d1b/d29/d30/d35/l46 0 2024-09-17T04:21:21.824 INFO:tasks.workunit.client.0.smithi088.stdout:6/949: readlink d14/d44/dad/dc0/l12e 0 2024-09-17T04:21:21.825 INFO:tasks.workunit.client.0.smithi088.stdout:6/950: chown d14/d44/dad/dc0/l12e 48825 1 2024-09-17T04:21:21.826 INFO:tasks.workunit.client.0.smithi088.stdout:6/951: dread - d14/d44/d45/d6b/d29/d3e/f121 zero size 2024-09-17T04:21:21.827 INFO:tasks.workunit.client.0.smithi088.stdout:9/937: getdents d2/d2b/d2e/dbb/d104/d72/d11d 0 2024-09-17T04:21:21.830 INFO:tasks.workunit.client.0.smithi088.stdout:3/903: mkdir d0/d13/d1b/d29/d2b/d11c 0 2024-09-17T04:21:21.831 INFO:tasks.workunit.client.0.smithi088.stdout:6/952: mkdir d14/d44/d45/d6b/d29/d3e/d149 0 2024-09-17T04:21:21.832 INFO:tasks.workunit.client.0.smithi088.stdout:9/938: mkdir d2/db8/d141 0 2024-09-17T04:21:21.836 INFO:tasks.workunit.client.0.smithi088.stdout:6/953: write d14/d44/d116/d141/d140/d52/d7a/d7b/ff8 [3030657,37584] 0 2024-09-17T04:21:21.837 INFO:tasks.workunit.client.0.smithi088.stdout:9/939: mkdir d2/dd/d14/d2a/d76/d98/d142 0 2024-09-17T04:21:21.838 INFO:tasks.workunit.client.0.smithi088.stdout:9/940: stat d2/d2b/d2e/dbb/d104/d72/d74 0 2024-09-17T04:21:21.839 INFO:tasks.workunit.client.0.smithi088.stdout:8/776: sync 2024-09-17T04:21:21.839 INFO:tasks.workunit.client.0.smithi088.stdout:5/754: sync 2024-09-17T04:21:21.842 INFO:tasks.workunit.client.0.smithi088.stdout:6/954: rmdir d14/d44/d45/d6b/d16/d42/df3 39 2024-09-17T04:21:21.844 INFO:tasks.workunit.client.0.smithi088.stdout:9/941: creat d2/dd/d11/d30/d107/f143 x:0 0 0 2024-09-17T04:21:21.846 INFO:tasks.workunit.client.0.smithi088.stdout:0/637: dwrite db/d3c/d4f/d59/f7b [0,4194304] 0 2024-09-17T04:21:21.849 INFO:tasks.workunit.client.0.smithi088.stdout:5/755: rmdir d2/d31/d33/d20/d30/d9f/da4 39 2024-09-17T04:21:21.850 INFO:tasks.workunit.client.0.smithi088.stdout:1/904: write d0/d1/df/d85/da3/df6/daa/d5b/f82 [3266058,120091] 0 2024-09-17T04:21:21.854 INFO:tasks.workunit.client.0.smithi088.stdout:1/905: chown d0/d1/df/d20/ddf/faf 771691 1 2024-09-17T04:21:21.854 INFO:tasks.workunit.client.0.smithi088.stdout:7/873: dread d2/d4/d7/f34 [0,4194304] 0 2024-09-17T04:21:21.860 INFO:tasks.workunit.client.0.smithi088.stdout:2/854: dwrite d0/d1/d2d/d33/fa8 [0,4194304] 0 2024-09-17T04:21:21.863 INFO:tasks.workunit.client.0.smithi088.stdout:3/904: link d0/c60 d0/d13/d58/dfd/c11d 0 2024-09-17T04:21:21.864 INFO:tasks.workunit.client.0.smithi088.stdout:3/905: stat d0/d13/d1b/d29/d2b/d8b/fed 0 2024-09-17T04:21:21.868 INFO:tasks.workunit.client.0.smithi088.stdout:1/906: write d0/d1/df/d85/da3/df6/f99 [990460,101866] 0 2024-09-17T04:21:21.870 INFO:tasks.workunit.client.0.smithi088.stdout:9/942: mkdir d2/d2b/d2e/dbb/d104/d72/d136/d144 0 2024-09-17T04:21:21.872 INFO:tasks.workunit.client.0.smithi088.stdout:3/906: mknod d0/d13/d1b/d29/d30/d35/d65/c11e 0 2024-09-17T04:21:21.874 INFO:tasks.workunit.client.0.smithi088.stdout:7/874: link d2/d1d/d2e/db0/d23/d45/l99 d2/d96/dc2/l10d 0 2024-09-17T04:21:21.874 INFO:tasks.workunit.client.0.smithi088.stdout:8/777: dwrite d7/d29/f2e [0,4194304] 0 2024-09-17T04:21:21.877 INFO:tasks.workunit.client.0.smithi088.stdout:6/955: dwrite d14/d44/d45/d6b/d16/f51 [0,4194304] 0 2024-09-17T04:21:21.877 INFO:tasks.workunit.client.0.smithi088.stdout:2/855: getdents d0/d1/d2d/d77 0 2024-09-17T04:21:21.880 INFO:tasks.workunit.client.0.smithi088.stdout:7/875: readlink d2/d4/d7/lf9 0 2024-09-17T04:21:21.881 INFO:tasks.workunit.client.0.smithi088.stdout:5/756: dread d2/d31/d33/fa [0,4194304] 0 2024-09-17T04:21:21.882 INFO:tasks.workunit.client.0.smithi088.stdout:8/778: mknod d7/d29/d2a/d38/d3d/da0/da8/c101 0 2024-09-17T04:21:21.883 INFO:tasks.workunit.client.0.smithi088.stdout:7/876: write d2/d4/d7/d46/d67/f106 [47830,48363] 0 2024-09-17T04:21:21.883 INFO:tasks.workunit.client.0.smithi088.stdout:1/907: dread d0/d1/d16/d2a/d9c/dc8/f116 [0,4194304] 0 2024-09-17T04:21:21.883 INFO:tasks.workunit.client.0.smithi088.stdout:8/779: stat d7/dd/f56 0 2024-09-17T04:21:21.884 INFO:tasks.workunit.client.0.smithi088.stdout:7/877: dread - d2/d96/df2/ff5 zero size 2024-09-17T04:21:21.888 INFO:tasks.workunit.client.0.smithi088.stdout:6/956: stat d14/d44/d45/d6b/d29/dac/d11a/l13a 0 2024-09-17T04:21:21.889 INFO:tasks.workunit.client.0.smithi088.stdout:0/638: write db/d67/f99 [204765,21960] 0 2024-09-17T04:21:21.889 INFO:tasks.workunit.client.0.smithi088.stdout:6/957: fdatasync d14/d44/d94/fd8 0 2024-09-17T04:21:21.890 INFO:tasks.workunit.client.0.smithi088.stdout:9/943: truncate d2/dd/d14/d8b/d35/fcb 205162 0 2024-09-17T04:21:21.891 INFO:tasks.workunit.client.0.smithi088.stdout:7/878: read d2/f21 [941222,102822] 0 2024-09-17T04:21:21.893 INFO:tasks.workunit.client.0.smithi088.stdout:1/908: creat d0/d1/d16/d35/dc5/f121 x:0 0 0 2024-09-17T04:21:21.895 INFO:tasks.workunit.client.0.smithi088.stdout:8/780: creat d7/d29/d2a/d3a/f102 x:0 0 0 2024-09-17T04:21:21.896 INFO:tasks.workunit.client.0.smithi088.stdout:2/856: mkdir d0/d1/d103 0 2024-09-17T04:21:21.896 INFO:tasks.workunit.client.0.smithi088.stdout:3/907: dread d0/d54/fd1 [0,4194304] 0 2024-09-17T04:21:21.897 INFO:tasks.workunit.client.0.smithi088.stdout:0/639: mknod db/d1b/d36/d47/cdf 0 2024-09-17T04:21:21.899 INFO:tasks.workunit.client.0.smithi088.stdout:6/958: unlink d14/d44/dad/dc0/f108 0 2024-09-17T04:21:21.900 INFO:tasks.workunit.client.0.smithi088.stdout:6/959: chown d14/d44/d45/d6b/d29/d122/c145 2668 1 2024-09-17T04:21:21.900 INFO:tasks.workunit.client.0.smithi088.stdout:9/944: rename d2/d2b/d2e/dbb/d104/d5c/dbc/lb1 to d2/d16/dd7/l145 0 2024-09-17T04:21:21.902 INFO:tasks.workunit.client.0.smithi088.stdout:7/879: mknod d2/d1d/d2e/db0/d23/d97/dbb/c10e 0 2024-09-17T04:21:21.907 INFO:tasks.workunit.client.0.smithi088.stdout:6/960: dread - d14/d44/d116/d141/d140/d52/fe9 zero size 2024-09-17T04:21:21.910 INFO:tasks.workunit.client.0.smithi088.stdout:1/909: dread d0/d13/f3f [0,4194304] 0 2024-09-17T04:21:21.910 INFO:tasks.workunit.client.0.smithi088.stdout:0/640: rename db/d1b/d36/d4a/d20/l34 to db/d3c/d4f/dd5/le0 0 2024-09-17T04:21:21.911 INFO:tasks.workunit.client.0.smithi088.stdout:4/734: sync 2024-09-17T04:21:21.911 INFO:tasks.workunit.client.0.smithi088.stdout:0/641: chown db/d1b/d36/d4a/d20 1904687 1 2024-09-17T04:21:21.912 INFO:tasks.workunit.client.0.smithi088.stdout:5/757: write d2/d31/d33/d20/d25/fc0 [757722,59503] 0 2024-09-17T04:21:21.912 INFO:tasks.workunit.client.0.smithi088.stdout:1/910: read d0/f94 [1458230,23337] 0 2024-09-17T04:21:21.913 INFO:tasks.workunit.client.0.smithi088.stdout:4/735: dread - d5/d32/ff2 zero size 2024-09-17T04:21:21.914 INFO:tasks.workunit.client.0.smithi088.stdout:0/642: chown db/d1b/d36/d4a/d6a/f74 0 1 2024-09-17T04:21:21.917 INFO:tasks.workunit.client.0.smithi088.stdout:0/643: read db/d1b/d39/f8d [3461530,120490] 0 2024-09-17T04:21:21.918 INFO:tasks.workunit.client.0.smithi088.stdout:3/908: creat d0/d13/d1b/d29/d2b/d11c/f11f x:0 0 0 2024-09-17T04:21:21.924 INFO:tasks.workunit.client.0.smithi088.stdout:7/880: rename d2/d4/d7/d46/d67/f106 to d2/d96/dbe/f10f 0 2024-09-17T04:21:21.926 INFO:tasks.workunit.client.0.smithi088.stdout:5/758: dread d2/f40 [0,4194304] 0 2024-09-17T04:21:21.927 INFO:tasks.workunit.client.0.smithi088.stdout:1/911: creat d0/d1/df/d63/f122 x:0 0 0 2024-09-17T04:21:21.928 INFO:tasks.workunit.client.0.smithi088.stdout:9/945: dwrite d2/dd/d14/d8b/d43/f55 [0,4194304] 0 2024-09-17T04:21:21.931 INFO:tasks.workunit.client.0.smithi088.stdout:3/909: chown d0/l32 25856 1 2024-09-17T04:21:21.934 INFO:tasks.workunit.client.0.smithi088.stdout:6/961: creat d14/d44/d116/d141/d140/d52/dcf/f14a x:0 0 0 2024-09-17T04:21:21.936 INFO:tasks.workunit.client.0.smithi088.stdout:7/881: dread - d2/d1d/d2e/f91 zero size 2024-09-17T04:21:21.938 INFO:tasks.workunit.client.0.smithi088.stdout:7/882: readlink d2/d1d/d2e/db0/l94 0 2024-09-17T04:21:21.938 INFO:tasks.workunit.client.0.smithi088.stdout:8/781: getdents d7/dd/d31/dca 0 2024-09-17T04:21:21.940 INFO:tasks.workunit.client.0.smithi088.stdout:2/857: getdents d0/d1/d2d/d33/d4b/d24/d3b/d26 0 2024-09-17T04:21:21.942 INFO:tasks.workunit.client.0.smithi088.stdout:2/858: write d0/d1/d2d/d33/d4b/d6d/d94/da5/ffb [1714970,25738] 0 2024-09-17T04:21:21.945 INFO:tasks.workunit.client.0.smithi088.stdout:1/912: mknod d0/d1/df/d20/ddf/c123 0 2024-09-17T04:21:21.946 INFO:tasks.workunit.client.0.smithi088.stdout:1/913: write d0/d1/d16/d2a/fd1 [32600,113033] 0 2024-09-17T04:21:21.947 INFO:tasks.workunit.client.0.smithi088.stdout:4/736: creat d5/d32/d6b/dd2/ff5 x:0 0 0 2024-09-17T04:21:21.954 INFO:tasks.workunit.client.0.smithi088.stdout:8/782: creat d7/d29/d2a/d38/d42/f103 x:0 0 0 2024-09-17T04:21:21.956 INFO:tasks.workunit.client.0.smithi088.stdout:2/859: unlink d0/d1/d2d/d33/fa8 0 2024-09-17T04:21:21.957 INFO:tasks.workunit.client.0.smithi088.stdout:5/759: dread d2/d31/d33/d20/d30/d51/d5e/d6b/fa0 [0,4194304] 0 2024-09-17T04:21:21.957 INFO:tasks.workunit.client.0.smithi088.stdout:1/914: mknod d0/d1/df/d63/c124 0 2024-09-17T04:21:21.960 INFO:tasks.workunit.client.0.smithi088.stdout:9/946: dwrite d2/dd/d14/d8b/d43/d51/f110 [0,4194304] 0 2024-09-17T04:21:21.960 INFO:tasks.workunit.client.0.smithi088.stdout:6/962: creat d14/d44/d94/db9/dc8/df7/df1/f14b x:0 0 0 2024-09-17T04:21:21.962 INFO:tasks.workunit.client.0.smithi088.stdout:6/963: truncate d14/d44/d94/db9/fd0 453468 0 2024-09-17T04:21:21.963 INFO:tasks.workunit.client.0.smithi088.stdout:7/883: mknod d2/d1d/d2e/db0/d23/d45/d62/d82/c110 0 2024-09-17T04:21:21.968 INFO:tasks.workunit.client.0.smithi088.stdout:8/783: rename d7/dd/d6f/db6 to d7/dd/d31/d47/dc6/d104 0 2024-09-17T04:21:21.969 INFO:tasks.workunit.client.0.smithi088.stdout:4/737: dread d5/d3f/d71/d8b/d68/da4/d5e/d83/fc3 [0,4194304] 0 2024-09-17T04:21:21.973 INFO:tasks.workunit.client.0.smithi088.stdout:5/760: chown d2/d31/d33/l24 4444782 1 2024-09-17T04:21:21.974 INFO:tasks.workunit.client.0.smithi088.stdout:0/644: getdents db/d3c/d4f/d9f/dc4 0 2024-09-17T04:21:21.975 INFO:tasks.workunit.client.0.smithi088.stdout:0/645: read - db/d3c/d4f/d59/fd7 zero size 2024-09-17T04:21:21.977 INFO:tasks.workunit.client.0.smithi088.stdout:1/915: fdatasync d0/d1/d16/d35/f50 0 2024-09-17T04:21:21.978 INFO:tasks.workunit.client.0.smithi088.stdout:2/860: mknod d0/d1/d2d/d33/d4b/d24/d92/c104 0 2024-09-17T04:21:21.979 INFO:tasks.workunit.client.0.smithi088.stdout:6/964: dread d14/d44/d45/d6b/d16/f8b [4194304,4194304] 0 2024-09-17T04:21:21.980 INFO:tasks.workunit.client.0.smithi088.stdout:6/965: write d14/d44/f8a [2826488,26356] 0 2024-09-17T04:21:21.980 INFO:tasks.workunit.client.0.smithi088.stdout:2/861: readlink d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/d7c/l81 0 2024-09-17T04:21:21.982 INFO:tasks.workunit.client.0.smithi088.stdout:6/966: readlink le 0 2024-09-17T04:21:21.982 INFO:tasks.workunit.client.0.smithi088.stdout:9/947: mkdir d2/d2b/d2e/dbb/d104/d146 0 2024-09-17T04:21:21.982 INFO:tasks.workunit.client.0.smithi088.stdout:9/948: read - d2/d2b/d2e/dbb/f134 zero size 2024-09-17T04:21:21.983 INFO:tasks.workunit.client.0.smithi088.stdout:7/884: symlink d2/d96/dc2/l111 0 2024-09-17T04:21:21.986 INFO:tasks.workunit.client.0.smithi088.stdout:8/784: write d7/d29/d2a/f4a [100596,88105] 0 2024-09-17T04:21:21.987 INFO:tasks.workunit.client.0.smithi088.stdout:8/785: readlink d7/dd/d31/d47/d55/d57/l69 0 2024-09-17T04:21:21.989 INFO:tasks.workunit.client.0.smithi088.stdout:3/910: getdents d0/d13/d1b/d29/d56/d85 0 2024-09-17T04:21:22.014 INFO:tasks.workunit.client.0.smithi088.stdout:0/646: symlink db/d3c/d4f/le1 0 2024-09-17T04:21:22.014 INFO:tasks.workunit.client.0.smithi088.stdout:5/761: truncate d2/d31/d33/d20/d30/d51/d5e/d6b/db5/fbf 440932 0 2024-09-17T04:21:22.016 INFO:tasks.workunit.client.0.smithi088.stdout:9/949: unlink d2/d2b/d2e/f8a 0 2024-09-17T04:21:22.016 INFO:tasks.workunit.client.0.smithi088.stdout:4/738: write d5/fa1 [1016856,14532] 0 2024-09-17T04:21:22.019 INFO:tasks.workunit.client.0.smithi088.stdout:5/762: dread - d2/d31/d33/d20/d47/de0/da5/fec zero size 2024-09-17T04:21:22.020 INFO:tasks.workunit.client.0.smithi088.stdout:1/916: link d0/d1/df/d20/ddf/fd9 d0/d1/df/d85/da3/df6/daa/d5b/d87/f125 0 2024-09-17T04:21:22.022 INFO:tasks.workunit.client.0.smithi088.stdout:3/911: dwrite d0/d13/d58/fb1 [0,4194304] 0 2024-09-17T04:21:22.023 INFO:tasks.workunit.client.0.smithi088.stdout:1/917: write d0/de3/df5/f10a [81630,24247] 0 2024-09-17T04:21:22.024 INFO:tasks.workunit.client.0.smithi088.stdout:0/647: mkdir db/d67/de2 0 2024-09-17T04:21:22.024 INFO:tasks.workunit.client.0.smithi088.stdout:9/950: truncate d2/dd/d14/d2a/d76/d98/db3/fc9 614649 0 2024-09-17T04:21:22.026 INFO:tasks.workunit.client.0.smithi088.stdout:1/918: write d0/d1/df/d85/da3/df6/daa/f11c [691873,124519] 0 2024-09-17T04:21:22.026 INFO:tasks.workunit.client.0.smithi088.stdout:9/951: readlink d2/dd/d14/d8b/d35/l3a 0 2024-09-17T04:21:22.028 INFO:tasks.workunit.client.0.smithi088.stdout:5/763: symlink d2/d31/d33/d20/d47/de0/lf7 0 2024-09-17T04:21:22.030 INFO:tasks.workunit.client.0.smithi088.stdout:8/786: link d7/dd/d31/d47/dc6/c100 d7/d29/d2a/d38/daf/c105 0 2024-09-17T04:21:22.031 INFO:tasks.workunit.client.0.smithi088.stdout:0/648: mknod db/d1b/d36/d47/ce3 0 2024-09-17T04:21:22.033 INFO:tasks.workunit.client.0.smithi088.stdout:0/649: write db/d67/f99 [1124774,69289] 0 2024-09-17T04:21:22.034 INFO:tasks.workunit.client.0.smithi088.stdout:1/919: creat d0/d1/d16/d2a/f126 x:0 0 0 2024-09-17T04:21:22.035 INFO:tasks.workunit.client.0.smithi088.stdout:4/739: truncate d5/d3d/f9f 183815 0 2024-09-17T04:21:22.037 INFO:tasks.workunit.client.0.smithi088.stdout:9/952: creat d2/dd/d14/d8b/d43/d51/f147 x:0 0 0 2024-09-17T04:21:22.037 INFO:tasks.workunit.client.0.smithi088.stdout:4/740: dread - d5/d3f/fdb zero size 2024-09-17T04:21:22.037 INFO:tasks.workunit.client.0.smithi088.stdout:3/912: mknod d0/d13/d1b/d29/c120 0 2024-09-17T04:21:22.038 INFO:tasks.workunit.client.0.smithi088.stdout:3/913: dread - d0/d54/dda/f108 zero size 2024-09-17T04:21:22.038 INFO:tasks.workunit.client.0.smithi088.stdout:8/787: creat d7/d29/d2a/d38/d3d/d63/db2/f106 x:0 0 0 2024-09-17T04:21:22.040 INFO:tasks.workunit.client.0.smithi088.stdout:6/967: link d14/dce/l10d d14/d44/d94/db9/dc8/df7/df1/l14c 0 2024-09-17T04:21:22.041 INFO:tasks.workunit.client.0.smithi088.stdout:3/914: write d0/d13/d1b/d29/d30/ff5 [539648,72447] 0 2024-09-17T04:21:22.041 INFO:tasks.workunit.client.0.smithi088.stdout:0/650: dread - db/d1b/d36/d4a/fb6 zero size 2024-09-17T04:21:22.043 INFO:tasks.workunit.client.0.smithi088.stdout:1/920: chown d0/cc1 901 1 2024-09-17T04:21:22.044 INFO:tasks.workunit.client.0.smithi088.stdout:3/915: fsync d0/d13/d1b/fe2 0 2024-09-17T04:21:22.048 INFO:tasks.workunit.client.0.smithi088.stdout:8/788: creat d7/dd/d31/d47/d55/d57/d6b/ddb/f107 x:0 0 0 2024-09-17T04:21:22.051 INFO:tasks.workunit.client.0.smithi088.stdout:1/921: creat d0/d1/df/d20/ddf/f127 x:0 0 0 2024-09-17T04:21:22.051 INFO:tasks.workunit.client.0.smithi088.stdout:6/968: dwrite d14/f56 [0,4194304] 0 2024-09-17T04:21:22.052 INFO:tasks.workunit.client.0.smithi088.stdout:3/916: mknod d0/d13/d1b/d29/d30/d35/d65/c121 0 2024-09-17T04:21:22.054 INFO:tasks.workunit.client.0.smithi088.stdout:4/741: getdents d5/d3f/d71/dd8 0 2024-09-17T04:21:22.056 INFO:tasks.workunit.client.0.smithi088.stdout:7/885: dread d2/d1d/d2e/db0/d23/d45/d62/f77 [0,4194304] 0 2024-09-17T04:21:22.057 INFO:tasks.workunit.client.0.smithi088.stdout:5/764: dread d2/d31/d33/d20/d30/d51/d5e/f7a [0,4194304] 0 2024-09-17T04:21:22.059 INFO:tasks.workunit.client.0.smithi088.stdout:8/789: fdatasync d7/dd/d31/d47/d55/d57/f84 0 2024-09-17T04:21:22.060 INFO:tasks.workunit.client.0.smithi088.stdout:6/969: symlink d14/d44/l14d 0 2024-09-17T04:21:22.060 INFO:tasks.workunit.client.0.smithi088.stdout:8/790: chown d7/dd/d6f/cb1 1 1 2024-09-17T04:21:22.062 INFO:tasks.workunit.client.0.smithi088.stdout:6/970: write d14/dce/dfe/f82 [4864235,36931] 0 2024-09-17T04:21:22.062 INFO:tasks.workunit.client.0.smithi088.stdout:3/917: fdatasync d0/d13/d4d/fc1 0 2024-09-17T04:21:22.063 INFO:tasks.workunit.client.0.smithi088.stdout:9/953: dread d2/d2b/d2e/dbb/d104/d72/d74/fa0 [0,4194304] 0 2024-09-17T04:21:22.065 INFO:tasks.workunit.client.0.smithi088.stdout:3/918: dread - d0/d13/d58/d5e/dc6/f11a zero size 2024-09-17T04:21:22.066 INFO:tasks.workunit.client.0.smithi088.stdout:6/971: truncate d14/d44/d45/d6b/d29/f5f 4622220 0 2024-09-17T04:21:22.066 INFO:tasks.workunit.client.0.smithi088.stdout:7/886: creat d2/d1d/f112 x:0 0 0 2024-09-17T04:21:22.070 INFO:tasks.workunit.client.0.smithi088.stdout:1/922: truncate d0/d13/d84/d5d/f65 942961 0 2024-09-17T04:21:22.071 INFO:tasks.workunit.client.0.smithi088.stdout:5/765: dread - d2/d31/d33/d20/d30/d51/d5e/d6b/db5/fce zero size 2024-09-17T04:21:22.072 INFO:tasks.workunit.client.0.smithi088.stdout:5/766: chown d2/d31/d33/d20/d30/d51/fe2 1876168246 1 2024-09-17T04:21:22.073 INFO:tasks.workunit.client.0.smithi088.stdout:8/791: unlink d7/dd/d31/f70 0 2024-09-17T04:21:22.077 INFO:tasks.workunit.client.0.smithi088.stdout:9/954: rmdir d2/dd/d14/d8b/d35/d94 39 2024-09-17T04:21:22.077 INFO:tasks.workunit.client.0.smithi088.stdout:0/651: write db/f14 [5997429,39687] 0 2024-09-17T04:21:22.078 INFO:tasks.workunit.client.0.smithi088.stdout:9/955: chown d2/d16/fa8 14482398 1 2024-09-17T04:21:22.084 INFO:tasks.workunit.client.0.smithi088.stdout:8/792: fsync d7/dd/d31/f58 0 2024-09-17T04:21:22.087 INFO:tasks.workunit.client.0.smithi088.stdout:4/742: write d5/d3f/f41 [1586201,20992] 0 2024-09-17T04:21:22.090 INFO:tasks.workunit.client.0.smithi088.stdout:4/743: chown d5/d3f/d71/d8b/d68/da4/d5e/fc6 510 1 2024-09-17T04:21:22.096 INFO:tasks.workunit.client.0.smithi088.stdout:6/972: dwrite d14/d44/d116/d141/d140/d52/d90/f115 [0,4194304] 0 2024-09-17T04:21:22.097 INFO:tasks.workunit.client.0.smithi088.stdout:0/652: dwrite db/d1b/d39/f8d [0,4194304] 0 2024-09-17T04:21:22.098 INFO:tasks.workunit.client.0.smithi088.stdout:5/767: dread d2/d31/d33/d20/d25/d2c/f50 [0,4194304] 0 2024-09-17T04:21:22.099 INFO:tasks.workunit.client.0.smithi088.stdout:7/887: rename d2/d1d/d2e/db0/d23/d45/l99 to d2/d1d/d2e/db0/d23/d97/dbb/dcf/l113 0 2024-09-17T04:21:22.100 INFO:tasks.workunit.client.0.smithi088.stdout:7/888: readlink d2/d1d/d2e/l4c 0 2024-09-17T04:21:22.100 INFO:tasks.workunit.client.0.smithi088.stdout:9/956: write d2/d2b/d2e/dbb/d104/f103 [375901,74333] 0 2024-09-17T04:21:22.101 INFO:tasks.workunit.client.0.smithi088.stdout:9/957: dread - d2/d16/f10f zero size 2024-09-17T04:21:22.102 INFO:tasks.workunit.client.0.smithi088.stdout:8/793: symlink d7/dd/d31/d47/d55/d57/d6b/l108 0 2024-09-17T04:21:22.104 INFO:tasks.workunit.client.0.smithi088.stdout:3/919: creat d0/d13/d1b/d29/f122 x:0 0 0 2024-09-17T04:21:22.106 INFO:tasks.workunit.client.0.smithi088.stdout:3/920: write d0/d13/d1b/d29/f122 [416275,112959] 0 2024-09-17T04:21:22.108 INFO:tasks.workunit.client.0.smithi088.stdout:4/744: unlink d5/d3f/d71/d8b/d68/l8f 0 2024-09-17T04:21:22.108 INFO:tasks.workunit.client.0.smithi088.stdout:0/653: readlink db/lc6 0 2024-09-17T04:21:22.110 INFO:tasks.workunit.client.0.smithi088.stdout:6/973: unlink d14/d44/caa 0 2024-09-17T04:21:22.114 INFO:tasks.workunit.client.0.smithi088.stdout:7/889: mknod d2/d1d/d2e/db0/d23/d45/d85/c114 0 2024-09-17T04:21:22.114 INFO:tasks.workunit.client.0.smithi088.stdout:9/958: read - d2/dd/d14/d8b/d35/da5/fff zero size 2024-09-17T04:21:22.116 INFO:tasks.workunit.client.0.smithi088.stdout:4/745: rmdir d5/d3f/d71/d8b/d68/dab 39 2024-09-17T04:21:22.117 INFO:tasks.workunit.client.0.smithi088.stdout:0/654: rmdir db/d3c/d4f/d66 39 2024-09-17T04:21:22.120 INFO:tasks.workunit.client.0.smithi088.stdout:4/746: mknod d5/d3d/d73/cf6 0 2024-09-17T04:21:22.122 INFO:tasks.workunit.client.0.smithi088.stdout:1/923: rename d0/de3/df5 to d0/d1/df/d85/da3/df6/daa/d5b/d128 0 2024-09-17T04:21:22.122 INFO:tasks.workunit.client.0.smithi088.stdout:9/959: dwrite d2/d16/ddd/d105/f13d [0,4194304] 0 2024-09-17T04:21:22.129 INFO:tasks.workunit.client.0.smithi088.stdout:5/768: mknod d2/d31/d33/d20/d30/d9f/da4/cf8 0 2024-09-17T04:21:22.132 INFO:tasks.workunit.client.0.smithi088.stdout:0/655: unlink db/d1b/d39/f7d 0 2024-09-17T04:21:22.134 INFO:tasks.workunit.client.0.smithi088.stdout:3/921: link d0/d13/f28 d0/d13/d58/dd7/dd4/f123 0 2024-09-17T04:21:22.136 INFO:tasks.workunit.client.0.smithi088.stdout:3/922: truncate d0/d13/f24 4400475 0 2024-09-17T04:21:22.137 INFO:tasks.workunit.client.0.smithi088.stdout:4/747: symlink d5/d72/lf7 0 2024-09-17T04:21:22.142 INFO:tasks.workunit.client.0.smithi088.stdout:6/974: rename d14/d44/d116/d141/d140/fb3 to d14/dce/dfe/f14e 0 2024-09-17T04:21:22.145 INFO:tasks.workunit.client.0.smithi088.stdout:9/960: mkdir d2/dd/d14/d8b/d35/d114/d148 0 2024-09-17T04:21:22.146 INFO:tasks.workunit.client.0.smithi088.stdout:9/961: chown d2/d2b/d2e/dbb/d104/d72/d74/la3 165553975 1 2024-09-17T04:21:22.148 INFO:tasks.workunit.client.0.smithi088.stdout:5/769: creat d2/d31/d33/d20/d25/d2c/d8a/dc6/ff9 x:0 0 0 2024-09-17T04:21:22.150 INFO:tasks.workunit.client.0.smithi088.stdout:0/656: chown db/f10 29297951 1 2024-09-17T04:21:22.150 INFO:tasks.workunit.client.0.smithi088.stdout:3/923: stat d0/l18 0 2024-09-17T04:21:22.151 INFO:tasks.workunit.client.0.smithi088.stdout:3/924: stat d0/d13/d1b/d29/l2e 0 2024-09-17T04:21:22.155 INFO:tasks.workunit.client.0.smithi088.stdout:6/975: mknod d14/d44/d45/d6b/d29/dac/c14f 0 2024-09-17T04:21:22.159 INFO:tasks.workunit.client.0.smithi088.stdout:4/748: dwrite d5/d3f/d71/d8b/d68/dab/fb2 [0,4194304] 0 2024-09-17T04:21:22.160 INFO:tasks.workunit.client.0.smithi088.stdout:4/749: chown d5/d3f/d71/d8b/d68/da4/d5e/d83/fbc 2 1 2024-09-17T04:21:22.166 INFO:tasks.workunit.client.0.smithi088.stdout:3/925: symlink d0/l124 0 2024-09-17T04:21:22.169 INFO:tasks.workunit.client.0.smithi088.stdout:6/976: truncate d14/d44/d45/d6b/d29/fab 2614971 0 2024-09-17T04:21:22.172 INFO:tasks.workunit.client.0.smithi088.stdout:1/924: getdents d0/d1/de7/d103 0 2024-09-17T04:21:22.172 INFO:tasks.workunit.client.0.smithi088.stdout:4/750: rmdir d5/d3f/d71/d8b/d68 39 2024-09-17T04:21:22.175 INFO:tasks.workunit.client.0.smithi088.stdout:6/977: dwrite d14/d44/d45/d6b/d29/f5f [0,4194304] 0 2024-09-17T04:21:22.177 INFO:tasks.workunit.client.0.smithi088.stdout:3/926: creat d0/d13/d1b/d29/d30/d35/d65/f125 x:0 0 0 2024-09-17T04:21:22.178 INFO:tasks.workunit.client.0.smithi088.stdout:3/927: chown d0/d13/d1b/d29/d2b/d40/ldd 3 1 2024-09-17T04:21:22.182 INFO:tasks.workunit.client.0.smithi088.stdout:6/978: creat d14/d44/dad/f150 x:0 0 0 2024-09-17T04:21:22.184 INFO:tasks.workunit.client.0.smithi088.stdout:3/928: creat d0/d13/d1b/d29/d30/d35/dcb/f126 x:0 0 0 2024-09-17T04:21:22.184 INFO:tasks.workunit.client.0.smithi088.stdout:6/979: chown d14/d44/d94/db9/dc8/df7/c137 987 1 2024-09-17T04:21:22.185 INFO:tasks.workunit.client.0.smithi088.stdout:4/751: getdents d5/d3f/d71/dd8 0 2024-09-17T04:21:22.185 INFO:tasks.workunit.client.0.smithi088.stdout:3/929: fdatasync d0/d13/d58/d5e/dc6/dcd/f111 0 2024-09-17T04:21:22.188 INFO:tasks.workunit.client.0.smithi088.stdout:6/980: creat d14/d44/d116/d141/d140/f151 x:0 0 0 2024-09-17T04:21:22.190 INFO:tasks.workunit.client.0.smithi088.stdout:4/752: symlink d5/d3f/d71/lf8 0 2024-09-17T04:21:22.191 INFO:tasks.workunit.client.0.smithi088.stdout:5/770: dwrite d2/f38 [0,4194304] 0 2024-09-17T04:21:22.193 INFO:tasks.workunit.client.0.smithi088.stdout:3/930: mkdir d0/d13/d127 0 2024-09-17T04:21:22.193 INFO:tasks.workunit.client.0.smithi088.stdout:6/981: rmdir d14/d44/d45 39 2024-09-17T04:21:22.194 INFO:tasks.workunit.client.0.smithi088.stdout:6/982: stat d14/d44/dad/dc0/l12e 0 2024-09-17T04:21:22.195 INFO:tasks.workunit.client.0.smithi088.stdout:4/753: creat d5/dcd/ff9 x:0 0 0 2024-09-17T04:21:22.196 INFO:tasks.workunit.client.0.smithi088.stdout:4/754: write d5/d3d/f80 [4194493,74150] 0 2024-09-17T04:21:22.197 INFO:tasks.workunit.client.0.smithi088.stdout:5/771: creat d2/d31/d33/d20/d47/de0/ffa x:0 0 0 2024-09-17T04:21:22.199 INFO:tasks.workunit.client.0.smithi088.stdout:0/657: write db/f6d [876328,80101] 0 2024-09-17T04:21:22.204 INFO:tasks.workunit.client.0.smithi088.stdout:4/755: truncate d5/d3f/d71/d8b/d68/da4/d5e/fc9 1227885 0 2024-09-17T04:21:22.204 INFO:tasks.workunit.client.0.smithi088.stdout:3/931: mkdir d0/d13/d128 0 2024-09-17T04:21:22.210 INFO:tasks.workunit.client.0.smithi088.stdout:3/932: creat d0/d13/d1b/d29/d30/dde/f129 x:0 0 0 2024-09-17T04:21:22.212 INFO:tasks.workunit.client.0.smithi088.stdout:4/756: dwrite d5/d3f/d71/dd8/fda [0,4194304] 0 2024-09-17T04:21:22.214 INFO:tasks.workunit.client.0.smithi088.stdout:5/772: rename d2/d31/d33/d20/d25/d2c/cc9 to d2/d31/d33/d20/d30/d9f/cfb 0 2024-09-17T04:21:22.215 INFO:tasks.workunit.client.0.smithi088.stdout:5/773: write d2/d31/d33/f54 [1974021,8711] 0 2024-09-17T04:21:22.216 INFO:tasks.workunit.client.0.smithi088.stdout:6/983: link d14/d44/d45/d6b/d29/f38 d14/d44/d94/f152 0 2024-09-17T04:21:22.219 INFO:tasks.workunit.client.0.smithi088.stdout:4/757: rmdir d5/d3f/d71/d8b/d75 39 2024-09-17T04:21:22.221 INFO:tasks.workunit.client.0.smithi088.stdout:1/925: write d0/d1/df/d20/ddf/fd9 [929003,14030] 0 2024-09-17T04:21:22.221 INFO:tasks.workunit.client.0.smithi088.stdout:0/658: link db/d1b/d39/d83/ccb db/d3c/d4f/ce4 0 2024-09-17T04:21:22.226 INFO:tasks.workunit.client.0.smithi088.stdout:3/933: creat d0/d13/d1b/d29/d30/d3c/dc9/d119/f12a x:0 0 0 2024-09-17T04:21:22.230 INFO:tasks.workunit.client.0.smithi088.stdout:1/926: truncate d0/d1/d16/d2a/f53 920044 0 2024-09-17T04:21:22.230 INFO:tasks.workunit.client.0.smithi088.stdout:3/934: stat d0/l4c 0 2024-09-17T04:21:22.235 INFO:tasks.workunit.client.0.smithi088.stdout:4/758: link d5/l12 d5/d3d/dee/lfa 0 2024-09-17T04:21:22.236 INFO:tasks.workunit.client.0.smithi088.stdout:4/759: write d5/dcd/ff9 [826607,6075] 0 2024-09-17T04:21:22.241 INFO:tasks.workunit.client.0.smithi088.stdout:0/659: getdents db/d3c/d4f/d66 0 2024-09-17T04:21:22.247 INFO:tasks.workunit.client.0.smithi088.stdout:0/660: mkdir db/d1b/d39/de5 0 2024-09-17T04:21:22.248 INFO:tasks.workunit.client.0.smithi088.stdout:0/661: fdatasync db/d1b/d39/f8d 0 2024-09-17T04:21:22.253 INFO:tasks.workunit.client.0.smithi088.stdout:0/662: creat db/d1b/fe6 x:0 0 0 2024-09-17T04:21:22.273 INFO:tasks.workunit.client.0.smithi088.stdout:6/984: dwrite d14/d44/d116/d141/d140/f49 [0,4194304] 0 2024-09-17T04:21:22.275 INFO:tasks.workunit.client.0.smithi088.stdout:6/985: chown d14/d44/dad/dc0/l12e 82719055 1 2024-09-17T04:21:22.276 INFO:tasks.workunit.client.0.smithi088.stdout:1/927: write d0/d13/d84/fc2 [203450,13701] 0 2024-09-17T04:21:22.277 INFO:tasks.workunit.client.0.smithi088.stdout:3/935: write d0/f1a [8380560,23541] 0 2024-09-17T04:21:22.280 INFO:tasks.workunit.client.0.smithi088.stdout:6/986: creat d14/d44/d45/d6b/d29/d12f/f153 x:0 0 0 2024-09-17T04:21:22.283 INFO:tasks.workunit.client.0.smithi088.stdout:1/928: readlink d0/d1/df/d85/lcc 0 2024-09-17T04:21:22.283 INFO:tasks.workunit.client.0.smithi088.stdout:4/760: dwrite d5/d32/f57 [0,4194304] 0 2024-09-17T04:21:22.287 INFO:tasks.workunit.client.0.smithi088.stdout:3/936: creat d0/d13/d1b/d29/d30/d3c/dc9/d119/f12b x:0 0 0 2024-09-17T04:21:22.289 INFO:tasks.workunit.client.0.smithi088.stdout:4/761: rmdir d5/d3f/d71/d99 39 2024-09-17T04:21:22.292 INFO:tasks.workunit.client.0.smithi088.stdout:4/762: chown d5/d72/lce 877792811 1 2024-09-17T04:21:22.296 INFO:tasks.workunit.client.0.smithi088.stdout:4/763: mknod d5/d72/cfb 0 2024-09-17T04:21:22.297 INFO:tasks.workunit.client.0.smithi088.stdout:0/663: write db/d3c/d4f/d9f/dc4/fcd [4535919,16197] 0 2024-09-17T04:21:22.299 INFO:tasks.workunit.client.0.smithi088.stdout:3/937: dwrite d0/d13/d1b/fe2 [0,4194304] 0 2024-09-17T04:21:22.302 INFO:tasks.workunit.client.0.smithi088.stdout:1/929: dwrite d0/d1/df/d20/f49 [0,4194304] 0 2024-09-17T04:21:22.304 INFO:tasks.workunit.client.0.smithi088.stdout:1/930: chown d0/d1/df/d85/lcc 27069 1 2024-09-17T04:21:22.305 INFO:tasks.workunit.client.0.smithi088.stdout:4/764: dread - d5/d3f/d71/d8b/d68/da4/d5e/fc0 zero size 2024-09-17T04:21:22.306 INFO:tasks.workunit.client.0.smithi088.stdout:6/987: write d14/d44/d116/d141/d140/d52/f64 [1815088,65516] 0 2024-09-17T04:21:22.308 INFO:tasks.workunit.client.0.smithi088.stdout:3/938: symlink d0/d13/d127/l12c 0 2024-09-17T04:21:22.308 INFO:tasks.workunit.client.0.smithi088.stdout:1/931: dread - d0/d1/d27/f104 zero size 2024-09-17T04:21:22.312 INFO:tasks.workunit.client.0.smithi088.stdout:4/765: chown d5/d3f/d71/d8b/c66 6793 1 2024-09-17T04:21:22.316 INFO:tasks.workunit.client.0.smithi088.stdout:0/664: dwrite db/d1b/d36/d4a/d6a/f68 [0,4194304] 0 2024-09-17T04:21:22.318 INFO:tasks.workunit.client.0.smithi088.stdout:4/766: creat d5/d3f/d71/d8b/d68/da4/d5e/d83/ffc x:0 0 0 2024-09-17T04:21:22.320 INFO:tasks.workunit.client.0.smithi088.stdout:0/665: unlink db/c3e 0 2024-09-17T04:21:22.322 INFO:tasks.workunit.client.0.smithi088.stdout:4/767: rmdir d5/d3f/d71/dd8 39 2024-09-17T04:21:22.331 INFO:tasks.workunit.client.0.smithi088.stdout:4/768: getdents d5/d3d 0 2024-09-17T04:21:22.333 INFO:tasks.workunit.client.0.smithi088.stdout:0/666: link db/ld6 db/d67/d7c/le7 0 2024-09-17T04:21:22.335 INFO:tasks.workunit.client.0.smithi088.stdout:1/932: dwrite d0/d13/fa2 [0,4194304] 0 2024-09-17T04:21:22.335 INFO:tasks.workunit.client.0.smithi088.stdout:6/988: dwrite d14/d44/d45/d6b/d29/f2d [0,4194304] 0 2024-09-17T04:21:22.337 INFO:tasks.workunit.client.0.smithi088.stdout:3/939: dwrite d0/d13/d1b/d29/d30/d3c/f51 [0,4194304] 0 2024-09-17T04:21:22.343 INFO:tasks.workunit.client.0.smithi088.stdout:6/989: write d14/d44/d94/db9/fe8 [3115751,98886] 0 2024-09-17T04:21:22.345 INFO:tasks.workunit.client.0.smithi088.stdout:4/769: creat d5/d3f/d71/d99/ffd x:0 0 0 2024-09-17T04:21:22.348 INFO:tasks.workunit.client.0.smithi088.stdout:1/933: rename d0/d1/d27/d108/f10e to d0/d1/df/d85/da3/df6/daa/d5b/d128/f129 0 2024-09-17T04:21:22.349 INFO:tasks.workunit.client.0.smithi088.stdout:6/990: read - d14/d44/d94/db9/dc8/fe3 zero size 2024-09-17T04:21:22.353 INFO:tasks.workunit.client.0.smithi088.stdout:4/770: mkdir d5/d3f/d71/d8b/d68/da4/d5e/d83/dfe 0 2024-09-17T04:21:22.358 INFO:tasks.workunit.client.0.smithi088.stdout:3/940: creat d0/d13/f12d x:0 0 0 2024-09-17T04:21:22.358 INFO:tasks.workunit.client.0.smithi088.stdout:4/771: symlink d5/d3f/d71/d99/lff 0 2024-09-17T04:21:22.363 INFO:tasks.workunit.client.0.smithi088.stdout:3/941: creat d0/d13/d1b/d29/d2b/d50/f12e x:0 0 0 2024-09-17T04:21:22.366 INFO:tasks.workunit.client.0.smithi088.stdout:4/772: dwrite d5/fb [0,4194304] 0 2024-09-17T04:21:22.366 INFO:tasks.workunit.client.0.smithi088.stdout:0/667: dwrite db/f10 [0,4194304] 0 2024-09-17T04:21:22.371 INFO:tasks.workunit.client.0.smithi088.stdout:0/668: creat db/d1b/d36/d47/db9/fe8 x:0 0 0 2024-09-17T04:21:22.373 INFO:tasks.workunit.client.0.smithi088.stdout:0/669: fdatasync db/d1b/d36/d47/db9/fcf 0 2024-09-17T04:21:22.373 INFO:tasks.workunit.client.0.smithi088.stdout:6/991: write d14/d44/d45/d4d/d97/fa1 [186702,129955] 0 2024-09-17T04:21:22.375 INFO:tasks.workunit.client.0.smithi088.stdout:3/942: dread d0/d13/d1b/d29/d30/d35/d65/d10b/fbf [0,4194304] 0 2024-09-17T04:21:22.376 INFO:tasks.workunit.client.0.smithi088.stdout:1/934: dwrite d0/f4f [0,4194304] 0 2024-09-17T04:21:22.380 INFO:tasks.workunit.client.0.smithi088.stdout:6/992: write d14/d44/d116/d141/d140/f8d [2281725,61149] 0 2024-09-17T04:21:22.380 INFO:tasks.workunit.client.0.smithi088.stdout:0/670: symlink db/d1b/d36/d47/le9 0 2024-09-17T04:21:22.381 INFO:tasks.workunit.client.0.smithi088.stdout:3/943: mknod d0/d13/d58/d5a/d63/c12f 0 2024-09-17T04:21:22.383 INFO:tasks.workunit.client.0.smithi088.stdout:0/671: unlink db/d1b/d36/d47/ce3 0 2024-09-17T04:21:22.385 INFO:tasks.workunit.client.0.smithi088.stdout:3/944: dread d0/d54/fb7 [0,4194304] 0 2024-09-17T04:21:22.385 INFO:tasks.workunit.client.0.smithi088.stdout:1/935: creat d0/d1/df/dbe/d105/f12a x:0 0 0 2024-09-17T04:21:22.386 INFO:tasks.workunit.client.0.smithi088.stdout:0/672: mknod db/d3c/d4f/d66/d82/cea 0 2024-09-17T04:21:22.387 INFO:tasks.workunit.client.0.smithi088.stdout:6/993: truncate d14/d44/d45/d6b/d16/f30 2870424 0 2024-09-17T04:21:22.388 INFO:tasks.workunit.client.0.smithi088.stdout:1/936: chown d0/f3b 94200 1 2024-09-17T04:21:22.389 INFO:tasks.workunit.client.0.smithi088.stdout:0/673: truncate db/d3c/d4f/d59/fd7 406872 0 2024-09-17T04:21:22.390 INFO:tasks.workunit.client.0.smithi088.stdout:6/994: mknod d14/d2f/c154 0 2024-09-17T04:21:22.391 INFO:tasks.workunit.client.0.smithi088.stdout:1/937: readlink d0/d1/d16/d35/dc5/de2/le4 0 2024-09-17T04:21:22.392 INFO:tasks.workunit.client.0.smithi088.stdout:0/674: chown db/d1b/d39/l45 262723071 1 2024-09-17T04:21:22.392 INFO:tasks.workunit.client.0.smithi088.stdout:3/945: truncate d0/d13/d58/dd7/dd4/f123 2013349 0 2024-09-17T04:21:22.394 INFO:tasks.workunit.client.0.smithi088.stdout:4/773: dread d5/d3d/f7a [0,4194304] 0 2024-09-17T04:21:22.394 INFO:tasks.workunit.client.0.smithi088.stdout:1/938: mknod d0/d1/de7/d103/c12b 0 2024-09-17T04:21:22.398 INFO:tasks.workunit.client.0.smithi088.stdout:4/774: mknod d5/d3f/d71/d8b/d68/c100 0 2024-09-17T04:21:22.399 INFO:tasks.workunit.client.0.smithi088.stdout:0/675: rename db/d3c/d4f/d9f/lb7 to db/d1b/d36/leb 0 2024-09-17T04:21:22.400 INFO:tasks.workunit.client.0.smithi088.stdout:4/775: write d5/d3f/d71/d8b/d68/da4/d5e/fb5 [4078717,25547] 0 2024-09-17T04:21:22.400 INFO:tasks.workunit.client.0.smithi088.stdout:1/939: dread d0/d1/df/d85/da3/df6/daa/d5b/d87/f10c [0,4194304] 0 2024-09-17T04:21:22.403 INFO:tasks.workunit.client.0.smithi088.stdout:0/676: dread db/d3c/d4f/d59/fd7 [0,4194304] 0 2024-09-17T04:21:22.407 INFO:tasks.workunit.client.0.smithi088.stdout:1/940: mkdir d0/d1/df/d20/dbd/d12c 0 2024-09-17T04:21:22.416 INFO:tasks.workunit.client.0.smithi088.stdout:0/677: creat db/d1b/d36/d4a/dd3/fec x:0 0 0 2024-09-17T04:21:22.418 INFO:tasks.workunit.client.0.smithi088.stdout:4/776: dread d5/d32/f90 [0,4194304] 0 2024-09-17T04:21:22.422 INFO:tasks.workunit.client.0.smithi088.stdout:6/995: dread d14/d44/d116/d141/d140/fa4 [0,4194304] 0 2024-09-17T04:21:22.423 INFO:tasks.workunit.client.0.smithi088.stdout:0/678: truncate db/d3c/d4f/fa0 810498 0 2024-09-17T04:21:22.425 INFO:tasks.workunit.client.0.smithi088.stdout:3/946: dwrite d0/d54/fa9 [0,4194304] 0 2024-09-17T04:21:22.427 INFO:tasks.workunit.client.0.smithi088.stdout:6/996: fdatasync d14/d44/d45/d6b/d29/d3e/f37 0 2024-09-17T04:21:22.429 INFO:tasks.workunit.client.0.smithi088.stdout:0/679: mkdir db/d1b/d39/de5/ded 0 2024-09-17T04:21:22.430 INFO:tasks.workunit.client.0.smithi088.stdout:1/941: write d0/d13/d84/f71 [1945653,117405] 0 2024-09-17T04:21:22.430 INFO:tasks.workunit.client.0.smithi088.stdout:0/680: chown db/f10 0 1 2024-09-17T04:21:22.436 INFO:tasks.workunit.client.0.smithi088.stdout:0/681: stat db/fc 0 2024-09-17T04:21:22.436 INFO:tasks.workunit.client.0.smithi088.stdout:4/777: dwrite d5/f1a [0,4194304] 0 2024-09-17T04:21:22.438 INFO:tasks.workunit.client.0.smithi088.stdout:4/778: write d5/d3f/d71/d99/ffd [354115,108439] 0 2024-09-17T04:21:22.440 INFO:tasks.workunit.client.0.smithi088.stdout:3/947: write d0/d13/d1b/d29/d2b/d50/fb4 [1226766,103801] 0 2024-09-17T04:21:22.450 INFO:tasks.workunit.client.0.smithi088.stdout:1/942: creat d0/d1/d16/f12d x:0 0 0 2024-09-17T04:21:22.451 INFO:tasks.workunit.client.0.smithi088.stdout:0/682: mknod db/d1b/d36/d4a/cee 0 2024-09-17T04:21:22.452 INFO:tasks.workunit.client.0.smithi088.stdout:0/683: stat db/d1b/fe6 0 2024-09-17T04:21:22.454 INFO:tasks.workunit.client.0.smithi088.stdout:3/948: mkdir d0/d13/d1b/d29/d2b/d130 0 2024-09-17T04:21:22.456 INFO:tasks.workunit.client.0.smithi088.stdout:4/779: creat d5/d3f/d71/f101 x:0 0 0 2024-09-17T04:21:22.458 INFO:tasks.workunit.client.0.smithi088.stdout:3/949: fdatasync d0/d13/d58/d5a/d63/d80/f118 0 2024-09-17T04:21:22.459 INFO:tasks.workunit.client.0.smithi088.stdout:0/684: link db/d3c/d4f/d66/cb4 db/d1b/d36/d4a/d20/cef 0 2024-09-17T04:21:22.459 INFO:tasks.workunit.client.0.smithi088.stdout:6/997: dwrite d14/dce/dfe/f14e [0,4194304] 0 2024-09-17T04:21:22.465 INFO:tasks.workunit.client.0.smithi088.stdout:3/950: mkdir d0/d13/d1b/d29/d30/d81/de0/d131 0 2024-09-17T04:21:22.469 INFO:tasks.workunit.client.0.smithi088.stdout:4/780: symlink d5/d3f/d71/d8b/d68/da4/l102 0 2024-09-17T04:21:22.470 INFO:tasks.workunit.client.0.smithi088.stdout:0/685: creat db/d1b/d36/d47/db9/dda/ff0 x:0 0 0 2024-09-17T04:21:22.472 INFO:tasks.workunit.client.0.smithi088.stdout:6/998: link d14/d44/d94/db9/ldb d14/d44/d45/d6b/d29/d3e/d149/l155 0 2024-09-17T04:21:22.473 INFO:tasks.workunit.client.0.smithi088.stdout:3/951: rename d0/d13/d1b/d29/d56/f71 to d0/d13/d1b/d29/d56/f132 0 2024-09-17T04:21:22.474 INFO:tasks.workunit.client.0.smithi088.stdout:3/952: stat d0/d13/d1b/d29/cd2 0 2024-09-17T04:21:22.475 INFO:tasks.workunit.client.0.smithi088.stdout:0/686: creat db/d3c/d4f/d59/ff1 x:0 0 0 2024-09-17T04:21:22.480 INFO:tasks.workunit.client.0.smithi088.stdout:6/999: dwrite d14/d44/d116/d141/d140/d52/dcf/fd2 [0,4194304] 0 2024-09-17T04:21:22.484 INFO:tasks.workunit.client.0.smithi088.stdout:3/953: dread d0/d13/d1b/d29/d30/d3c/d5c/f89 [0,4194304] 0 2024-09-17T04:21:22.487 INFO:tasks.workunit.client.0.smithi088.stdout:4/781: dwrite d5/d3d/f6d [0,4194304] 0 2024-09-17T04:21:22.487 INFO:tasks.workunit.client.0.smithi088.stdout:3/954: rmdir d0/d13/d1b/d29/d30/d3c 39 2024-09-17T04:21:22.493 INFO:tasks.workunit.client.0.smithi088.stdout:3/955: unlink d0/d13/d1b/d29/f122 0 2024-09-17T04:21:22.495 INFO:tasks.workunit.client.0.smithi088.stdout:0/687: write db/d3c/d4f/fa0 [463349,79048] 0 2024-09-17T04:21:22.495 INFO:tasks.workunit.client.0.smithi088.stdout:4/782: creat d5/d3f/d71/d8b/d68/dab/dbb/f103 x:0 0 0 2024-09-17T04:21:22.496 INFO:tasks.workunit.client.0.smithi088.stdout:3/956: write d0/d13/d1b/d29/d2b/d50/f91 [4730664,65424] 0 2024-09-17T04:21:22.508 INFO:tasks.workunit.client.0.smithi088.stdout:4/783: dread d5/d3f/d71/d8b/fe6 [0,4194304] 0 2024-09-17T04:21:22.511 INFO:tasks.workunit.client.0.smithi088.stdout:4/784: rmdir d5/d3f/d71/d8b/d68/da4/d5e/d83/dfe 0 2024-09-17T04:21:22.511 INFO:tasks.workunit.client.0.smithi088.stdout:4/785: readlink d5/l45 0 2024-09-17T04:21:22.512 INFO:tasks.workunit.client.0.smithi088.stdout:4/786: fsync d5/f4e 0 2024-09-17T04:21:22.514 INFO:tasks.workunit.client.0.smithi088.stdout:4/787: rename d5/d72/cc7 to d5/dcd/c104 0 2024-09-17T04:21:22.519 INFO:tasks.workunit.client.0.smithi088.stdout:3/957: write d0/d54/fb7 [1219289,40931] 0 2024-09-17T04:21:22.521 INFO:tasks.workunit.client.0.smithi088.stdout:0/688: dread f0 [0,4194304] 0 2024-09-17T04:21:22.524 INFO:tasks.workunit.client.0.smithi088.stdout:0/689: mkdir db/d67/d7c/df2 0 2024-09-17T04:21:22.529 INFO:tasks.workunit.client.0.smithi088.stdout:3/958: link d0/d13/l19 d0/d13/d1b/d29/d2b/d8b/l133 0 2024-09-17T04:21:22.529 INFO:tasks.workunit.client.0.smithi088.stdout:4/788: dwrite d5/d3d/f9f [0,4194304] 0 2024-09-17T04:21:22.533 INFO:tasks.workunit.client.0.smithi088.stdout:0/690: link db/d1b/d39/fd0 db/ff3 0 2024-09-17T04:21:22.534 INFO:tasks.workunit.client.0.smithi088.stdout:4/789: unlink d5/d32/l5b 0 2024-09-17T04:21:22.539 INFO:tasks.workunit.client.0.smithi088.stdout:0/691: dwrite db/d1b/d36/d4a/d20/fa3 [0,4194304] 0 2024-09-17T04:21:22.540 INFO:tasks.workunit.client.0.smithi088.stdout:0/692: stat db/d3c/d4f/d59/da4/dc8 0 2024-09-17T04:21:22.542 INFO:tasks.workunit.client.0.smithi088.stdout:3/959: mknod d0/d13/d1b/d29/c134 0 2024-09-17T04:21:22.544 INFO:tasks.workunit.client.0.smithi088.stdout:4/790: mknod d5/d3f/c105 0 2024-09-17T04:21:22.545 INFO:tasks.workunit.client.0.smithi088.stdout:0/693: dread - db/d67/f79 zero size 2024-09-17T04:21:22.546 INFO:tasks.workunit.client.0.smithi088.stdout:3/960: unlink d0/d13/d58/d5e/d10f/f114 0 2024-09-17T04:21:22.550 INFO:tasks.workunit.client.0.smithi088.stdout:4/791: dread - d5/d3f/d71/d8b/d75/f96 zero size 2024-09-17T04:21:22.553 INFO:tasks.workunit.client.0.smithi088.stdout:0/694: symlink db/d67/d7c/dae/lf4 0 2024-09-17T04:21:22.553 INFO:tasks.workunit.client.0.smithi088.stdout:0/695: read - db/d1b/d36/d47/db9/fcf zero size 2024-09-17T04:21:22.554 INFO:tasks.workunit.client.0.smithi088.stdout:3/961: symlink d0/d13/d128/l135 0 2024-09-17T04:21:22.555 INFO:tasks.workunit.client.0.smithi088.stdout:3/962: dread - d0/d54/d55/f7b zero size 2024-09-17T04:21:22.558 INFO:tasks.workunit.client.0.smithi088.stdout:4/792: rename d5/d3f/d71/d8b/d68/da4/d5e/f61 to d5/d3f/d71/d8b/d75/dd0/f106 0 2024-09-17T04:21:22.559 INFO:tasks.workunit.client.0.smithi088.stdout:0/696: mkdir db/d1b/d36/d4a/dd3/df5 0 2024-09-17T04:21:22.561 INFO:tasks.workunit.client.0.smithi088.stdout:3/963: mknod d0/d13/d58/d5a/d63/d80/c136 0 2024-09-17T04:21:22.563 INFO:tasks.workunit.client.0.smithi088.stdout:4/793: chown d5/l24 0 1 2024-09-17T04:21:22.564 INFO:tasks.workunit.client.0.smithi088.stdout:3/964: chown d0/d13/d1b/d29/d30/d3c/lac 14 1 2024-09-17T04:21:22.565 INFO:tasks.workunit.client.0.smithi088.stdout:0/697: creat db/d67/de2/ff6 x:0 0 0 2024-09-17T04:21:22.565 INFO:tasks.workunit.client.0.smithi088.stdout:3/965: chown d0/d13/d1b/d29/d30/l110 9447 1 2024-09-17T04:21:22.567 INFO:tasks.workunit.client.0.smithi088.stdout:0/698: creat db/d1b/d36/d47/db9/ff7 x:0 0 0 2024-09-17T04:21:22.570 INFO:tasks.workunit.client.0.smithi088.stdout:0/699: creat db/d1b/ff8 x:0 0 0 2024-09-17T04:21:22.571 INFO:tasks.workunit.client.0.smithi088.stdout:3/966: truncate d0/d13/d58/d5a/d63/d80/f9c 180131 0 2024-09-17T04:21:22.578 INFO:tasks.workunit.client.0.smithi088.stdout:3/967: rmdir d0/d13/d58/d5e/dc6/dcd 39 2024-09-17T04:21:22.578 INFO:tasks.workunit.client.0.smithi088.stdout:0/700: getdents db/d3c/d4f/d9f/dc4 0 2024-09-17T04:21:22.579 INFO:tasks.workunit.client.0.smithi088.stdout:0/701: stat db/d1b/d36/d4a/d20/f8e 0 2024-09-17T04:21:22.584 INFO:tasks.workunit.client.0.smithi088.stdout:4/794: dwrite d5/d32/f44 [0,4194304] 0 2024-09-17T04:21:22.612 INFO:tasks.workunit.client.0.smithi088.stdout:0/702: rename db/d3c/d4f to db/d1b/d36/df9 0 2024-09-17T04:21:22.629 INFO:tasks.workunit.client.0.smithi088.stdout:3/968: write d0/d13/d1b/d29/d56/d85/fdc [325429,83843] 0 2024-09-17T04:21:22.632 INFO:tasks.workunit.client.0.smithi088.stdout:3/969: read d0/d13/d1b/f27 [1669962,37707] 0 2024-09-17T04:21:22.635 INFO:tasks.workunit.client.0.smithi088.stdout:3/970: truncate d0/d13/fce 938012 0 2024-09-17T04:21:22.637 INFO:tasks.workunit.client.0.smithi088.stdout:4/795: dwrite d5/d3f/d71/d8b/d68/da4/d5e/d83/fbc [0,4194304] 0 2024-09-17T04:21:22.642 INFO:tasks.workunit.client.0.smithi088.stdout:0/703: dwrite db/f72 [0,4194304] 0 2024-09-17T04:21:22.645 INFO:tasks.workunit.client.0.smithi088.stdout:0/704: readlink db/db2/dc0/ld1 0 2024-09-17T04:21:22.646 INFO:tasks.workunit.client.0.smithi088.stdout:0/705: readlink db/d67/d7c/dae/lf4 0 2024-09-17T04:21:22.648 INFO:tasks.workunit.client.0.smithi088.stdout:3/971: write d0/d13/f9a [310131,83928] 0 2024-09-17T04:21:22.652 INFO:tasks.workunit.client.0.smithi088.stdout:4/796: creat d5/d3f/d71/d8b/d68/da4/d5e/f107 x:0 0 0 2024-09-17T04:21:22.652 INFO:tasks.workunit.client.0.smithi088.stdout:0/706: symlink db/d1b/d36/d4a/d6a/lfa 0 2024-09-17T04:21:22.652 INFO:tasks.workunit.client.0.smithi088.stdout:3/972: dread d0/d13/d1b/d29/d30/d35/d65/d10b/fbf [0,4194304] 0 2024-09-17T04:21:22.654 INFO:tasks.workunit.client.0.smithi088.stdout:4/797: read d5/f28 [1784697,15680] 0 2024-09-17T04:21:22.656 INFO:tasks.workunit.client.0.smithi088.stdout:4/798: fsync d5/d3d/d73/fcb 0 2024-09-17T04:21:22.662 INFO:tasks.workunit.client.0.smithi088.stdout:4/799: link d5/d3f/d71/d8b/d68/fb9 d5/d3f/d71/d8b/d75/dd0/f108 0 2024-09-17T04:21:22.663 INFO:tasks.workunit.client.0.smithi088.stdout:3/973: write d0/d54/f7f [1293093,55577] 0 2024-09-17T04:21:22.664 INFO:tasks.workunit.client.0.smithi088.stdout:3/974: dread - d0/d13/d58/f104 zero size 2024-09-17T04:21:22.665 INFO:tasks.workunit.client.0.smithi088.stdout:3/975: readlink d0/d13/d58/d5e/l6f 0 2024-09-17T04:21:22.666 INFO:tasks.workunit.client.0.smithi088.stdout:4/800: rename d5/dcd to d5/d32/d6b/dd2/d109 0 2024-09-17T04:21:22.667 INFO:tasks.workunit.client.0.smithi088.stdout:3/976: mknod d0/d54/dda/c137 0 2024-09-17T04:21:22.669 INFO:tasks.workunit.client.0.smithi088.stdout:0/707: dread db/d1b/f2b [0,4194304] 0 2024-09-17T04:21:22.669 INFO:tasks.workunit.client.0.smithi088.stdout:4/801: creat d5/d3f/d71/d8b/d75/dd0/f10a x:0 0 0 2024-09-17T04:21:22.670 INFO:tasks.workunit.client.0.smithi088.stdout:0/708: readlink db/ld6 0 2024-09-17T04:21:22.671 INFO:tasks.workunit.client.0.smithi088.stdout:4/802: dread - d5/d3f/d71/d8b/d68/da4/d5e/fc0 zero size 2024-09-17T04:21:22.672 INFO:tasks.workunit.client.0.smithi088.stdout:3/977: creat d0/d13/f138 x:0 0 0 2024-09-17T04:21:22.674 INFO:tasks.workunit.client.0.smithi088.stdout:3/978: mkdir d0/d13/d1b/d29/d30/d35/dcb/d139 0 2024-09-17T04:21:22.675 INFO:tasks.workunit.client.0.smithi088.stdout:0/709: dread db/d1b/d36/d4a/d20/fa3 [0,4194304] 0 2024-09-17T04:21:22.676 INFO:tasks.workunit.client.0.smithi088.stdout:3/979: chown d0/d13/d1b/d29/d30/d3c/f87 253375507 1 2024-09-17T04:21:22.679 INFO:tasks.workunit.client.0.smithi088.stdout:0/710: dread db/d1b/d39/f80 [0,4194304] 0 2024-09-17T04:21:22.680 INFO:tasks.workunit.client.0.smithi088.stdout:0/711: truncate db/d1b/d36/d4a/d6a/f74 4732052 0 2024-09-17T04:21:22.681 INFO:tasks.workunit.client.0.smithi088.stdout:3/980: mkdir d0/d13/d58/d5a/d63/d80/d13a 0 2024-09-17T04:21:22.689 INFO:tasks.workunit.client.0.smithi088.stdout:4/803: write d5/d3d/f42 [1455423,37214] 0 2024-09-17T04:21:22.690 INFO:tasks.workunit.client.0.smithi088.stdout:4/804: chown d5/d32/d6b/f86 80 1 2024-09-17T04:21:22.692 INFO:tasks.workunit.client.0.smithi088.stdout:4/805: symlink d5/d3f/d71/d8b/d68/da4/l10b 0 2024-09-17T04:21:22.694 INFO:tasks.workunit.client.0.smithi088.stdout:4/806: truncate d5/d3f/d71/d8b/d68/da4/d5e/f107 111465 0 2024-09-17T04:21:22.695 INFO:tasks.workunit.client.0.smithi088.stdout:4/807: chown d5/d3f/d71/d8b/d68/da4/d5e/f8d 8 1 2024-09-17T04:21:22.696 INFO:tasks.workunit.client.0.smithi088.stdout:4/808: dread - d5/d32/d6b/dd2/d109/fe5 zero size 2024-09-17T04:21:22.697 INFO:tasks.workunit.client.0.smithi088.stdout:3/981: dread d0/d13/d1b/d29/d30/d35/d65/fa7 [0,4194304] 0 2024-09-17T04:21:22.700 INFO:tasks.workunit.client.0.smithi088.stdout:3/982: rename d0/d13/d1b/d29/d30/d35/f3d to d0/dae/de5/f13b 0 2024-09-17T04:21:22.702 INFO:tasks.workunit.client.0.smithi088.stdout:4/809: truncate d5/d3f/d71/d8b/d75/dd0/f108 16012 0 2024-09-17T04:21:22.703 INFO:tasks.workunit.client.0.smithi088.stdout:3/983: mkdir d0/d13/d58/dfd/d13c 0 2024-09-17T04:21:22.703 INFO:tasks.workunit.client.0.smithi088.stdout:3/984: readlink d0/l124 0 2024-09-17T04:21:22.704 INFO:tasks.workunit.client.0.smithi088.stdout:4/810: mkdir d5/d32/d6b/dd2/d109/d10c 0 2024-09-17T04:21:22.704 INFO:tasks.workunit.client.0.smithi088.stdout:3/985: write d0/f1a [7326864,80798] 0 2024-09-17T04:21:22.707 INFO:tasks.workunit.client.0.smithi088.stdout:3/986: creat d0/d13/d1b/d29/d30/d35/dcb/f13d x:0 0 0 2024-09-17T04:21:22.714 INFO:tasks.workunit.client.0.smithi088.stdout:3/987: dwrite d0/d54/fa9 [4194304,4194304] 0 2024-09-17T04:21:22.721 INFO:tasks.workunit.client.0.smithi088.stdout:3/988: dread d0/d13/d58/d5e/fb5 [4194304,4194304] 0 2024-09-17T04:21:22.724 INFO:tasks.workunit.client.0.smithi088.stdout:3/989: dread d0/d13/d1b/d29/d30/d3c/d5c/f89 [0,4194304] 0 2024-09-17T04:21:22.730 INFO:tasks.workunit.client.0.smithi088.stdout:4/811: truncate d5/d3f/d71/dd8/fda 2738393 0 2024-09-17T04:21:22.732 INFO:tasks.workunit.client.0.smithi088.stdout:3/990: dwrite d0/d13/d1b/d29/d30/d3c/f87 [0,4194304] 0 2024-09-17T04:21:22.736 INFO:tasks.workunit.client.0.smithi088.stdout:4/812: rename d5/d3f/d71/d8b/d68/dab/fb2 to d5/d3f/d71/d8b/d68/da4/d5e/d83/f10d 0 2024-09-17T04:21:22.737 INFO:tasks.workunit.client.0.smithi088.stdout:3/991: symlink d0/d13/d58/d5e/l13e 0 2024-09-17T04:21:22.738 INFO:tasks.workunit.client.0.smithi088.stdout:3/992: write d0/d13/d1b/d29/d30/d35/dcb/f13d [992331,59851] 0 2024-09-17T04:21:22.740 INFO:tasks.workunit.client.0.smithi088.stdout:4/813: creat d5/d3f/d71/f10e x:0 0 0 2024-09-17T04:21:22.741 INFO:tasks.workunit.client.0.smithi088.stdout:3/993: creat d0/dae/de5/f13f x:0 0 0 2024-09-17T04:21:22.742 INFO:tasks.workunit.client.0.smithi088.stdout:4/814: truncate d5/d32/d6b/f7b 826046 0 2024-09-17T04:21:22.744 INFO:tasks.workunit.client.0.smithi088.stdout:4/815: write d5/d3d/f6d [4608802,32507] 0 2024-09-17T04:21:22.747 INFO:tasks.workunit.client.0.smithi088.stdout:4/816: creat d5/d3d/d73/de7/f10f x:0 0 0 2024-09-17T04:21:22.749 INFO:tasks.workunit.client.0.smithi088.stdout:4/817: write d5/d32/d6b/f86 [4188351,42086] 0 2024-09-17T04:21:22.751 INFO:tasks.workunit.client.0.smithi088.stdout:4/818: creat d5/d3d/d73/f110 x:0 0 0 2024-09-17T04:21:22.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:22 smithi088 ceph-mon[27811]: pgmap v32: 65 pgs: 65 active+clean; 3.2 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 89 MiB/s rd, 184 MiB/s wr, 487 op/s 2024-09-17T04:21:22.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:22 smithi134 ceph-mon[35201]: pgmap v32: 65 pgs: 65 active+clean; 3.2 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 89 MiB/s rd, 184 MiB/s wr, 487 op/s 2024-09-17T04:21:22.931 INFO:tasks.workunit.client.0.smithi088.stdout:2/862: sync 2024-09-17T04:21:22.933 INFO:tasks.workunit.client.0.smithi088.stdout:2/863: truncate d0/d1/d2d/f75 3777596 0 2024-09-17T04:21:22.942 INFO:tasks.workunit.client.0.smithi088.stdout:2/864: write d0/d1/d2d/fd3 [731502,70952] 0 2024-09-17T04:21:22.948 INFO:tasks.workunit.client.0.smithi088.stdout:2/865: creat d0/d1/d2d/d33/d4b/d24/d3b/f105 x:0 0 0 2024-09-17T04:21:22.951 INFO:tasks.workunit.client.0.smithi088.stdout:2/866: link d0/l68 d0/l106 0 2024-09-17T04:21:22.952 INFO:tasks.workunit.client.0.smithi088.stdout:2/867: write d0/d1/d2d/d33/d80/ff9 [460961,125460] 0 2024-09-17T04:21:23.030 INFO:tasks.workunit.client.0.smithi088.stdout:2/868: dread d0/d1/d2d/d33/d4b/d24/d3b/fcd [0,4194304] 0 2024-09-17T04:21:23.031 INFO:tasks.workunit.client.0.smithi088.stdout:2/869: chown d0/d1/d2d/d33/d4b/d24/d3b/f54 5 1 2024-09-17T04:21:23.033 INFO:tasks.workunit.client.0.smithi088.stdout:2/870: read d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/d9a/fa7 [618811,36493] 0 2024-09-17T04:21:23.035 INFO:tasks.workunit.client.0.smithi088.stdout:2/871: fdatasync d0/d1/d2d/d33/d4b/d24/d89/fd0 0 2024-09-17T04:21:23.037 INFO:tasks.workunit.client.0.smithi088.stdout:2/872: read d0/d1/f2 [1721404,88515] 0 2024-09-17T04:21:23.039 INFO:tasks.workunit.client.0.smithi088.stdout:2/873: symlink d0/d1/d2d/d33/d85/l107 0 2024-09-17T04:21:23.041 INFO:tasks.workunit.client.0.smithi088.stdout:2/874: symlink d0/d13/dd1/de8/l108 0 2024-09-17T04:21:23.043 INFO:tasks.workunit.client.0.smithi088.stdout:2/875: chown d0/d1/d2d/d33/d4b/d6d/fa4 3 1 2024-09-17T04:21:23.045 INFO:tasks.workunit.client.0.smithi088.stdout:2/876: mknod d0/d1/d2d/d33/d4b/d6d/c109 0 2024-09-17T04:21:23.059 INFO:tasks.workunit.client.0.smithi088.stdout:2/877: dread d0/d1/d2d/d33/d4b/d24/d3b/d26/feb [0,4194304] 0 2024-09-17T04:21:23.066 INFO:tasks.workunit.client.0.smithi088.stdout:2/878: dwrite d0/d1/d2d/d33/d4b/d24/d3b/f105 [0,4194304] 0 2024-09-17T04:21:23.069 INFO:tasks.workunit.client.0.smithi088.stdout:2/879: symlink d0/d1/d2d/d33/d4b/d6d/d94/da5/l10a 0 2024-09-17T04:21:23.072 INFO:tasks.workunit.client.0.smithi088.stdout:2/880: mkdir d0/d1/d2d/d33/d4b/d24/d4d/d10b 0 2024-09-17T04:21:23.073 INFO:tasks.workunit.client.0.smithi088.stdout:2/881: chown d0/d1/d2d/d33/d4b/d24/f86 64254 1 2024-09-17T04:21:23.075 INFO:tasks.workunit.client.0.smithi088.stdout:2/882: rmdir d0/d1/d2d/d33/d4b/d24/d92 39 2024-09-17T04:21:23.089 INFO:tasks.workunit.client.0.smithi088.stdout:2/883: dwrite d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/d9a/fa7 [0,4194304] 0 2024-09-17T04:21:23.100 INFO:tasks.workunit.client.0.smithi088.stdout:2/884: dwrite d0/d1/d2d/d33/f6f [0,4194304] 0 2024-09-17T04:21:23.108 INFO:tasks.workunit.client.0.smithi088.stdout:2/885: dwrite d0/d1/d2d/d33/d4b/d24/d3b/f101 [0,4194304] 0 2024-09-17T04:21:23.111 INFO:tasks.workunit.client.0.smithi088.stdout:2/886: write d0/d1/d2d/d33/f38 [1637340,53900] 0 2024-09-17T04:21:23.124 INFO:tasks.workunit.client.0.smithi088.stdout:2/887: truncate d0/d1/d2d/d33/f38 4302505 0 2024-09-17T04:21:23.126 INFO:tasks.workunit.client.0.smithi088.stdout:2/888: getdents d0/d1/d2d/d77 0 2024-09-17T04:21:23.130 INFO:tasks.workunit.client.0.smithi088.stdout:2/889: dread d0/d1/d2d/d33/d4b/d24/d3b/f101 [0,4194304] 0 2024-09-17T04:21:23.140 INFO:tasks.workunit.client.0.smithi088.stdout:2/890: creat d0/d1/d2d/d33/d4b/d24/d3b/f10c x:0 0 0 2024-09-17T04:21:23.150 INFO:tasks.workunit.client.0.smithi088.stdout:2/891: write d0/d1/d2d/d33/d4b/d24/d3b/d22/dba/dc6/fe2 [710063,32754] 0 2024-09-17T04:21:23.150 INFO:tasks.workunit.client.0.smithi088.stdout:2/892: stat d0/d13/fec 0 2024-09-17T04:21:23.193 INFO:tasks.workunit.client.0.smithi088.stdout:8/794: sync 2024-09-17T04:21:23.196 INFO:tasks.workunit.client.0.smithi088.stdout:2/893: write d0/d1/f11 [7195957,95726] 0 2024-09-17T04:21:23.200 INFO:tasks.workunit.client.0.smithi088.stdout:2/894: creat d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/d7c/dfc/f10d x:0 0 0 2024-09-17T04:21:23.214 INFO:tasks.workunit.client.0.smithi088.stdout:8/795: dread d7/d7f/f8b [0,4194304] 0 2024-09-17T04:21:23.219 INFO:tasks.workunit.client.0.smithi088.stdout:2/895: write d0/d1/d2d/d33/d4b/d24/d3b/d22/dba/fdd [778094,87843] 0 2024-09-17T04:21:23.226 INFO:tasks.workunit.client.0.smithi088.stdout:2/896: getdents d0/d1/d2d/d33/d4b/d6d 0 2024-09-17T04:21:23.243 INFO:tasks.workunit.client.0.smithi088.stdout:2/897: dwrite d0/d1/fc9 [0,4194304] 0 2024-09-17T04:21:23.255 INFO:tasks.workunit.client.0.smithi088.stdout:2/898: dwrite d0/d1/d2d/d33/d4b/f8b [0,4194304] 0 2024-09-17T04:21:23.274 INFO:tasks.workunit.client.0.smithi088.stdout:2/899: fsync d0/d1/d2d/d33/d4b/f8b 0 2024-09-17T04:21:23.278 INFO:tasks.workunit.client.0.smithi088.stdout:2/900: creat d0/d1/d2d/d33/d4b/d24/d4d/f10e x:0 0 0 2024-09-17T04:21:23.290 INFO:tasks.workunit.client.0.smithi088.stdout:2/901: dwrite d0/d1/d2d/d33/d4b/f2e [0,4194304] 0 2024-09-17T04:21:23.310 INFO:tasks.workunit.client.0.smithi088.stdout:2/902: dread d0/f5d [0,4194304] 0 2024-09-17T04:21:23.312 INFO:tasks.workunit.client.0.smithi088.stdout:2/903: symlink d0/d1/d2d/dbd/l10f 0 2024-09-17T04:21:23.316 INFO:tasks.workunit.client.0.smithi088.stdout:2/904: creat d0/d1/d2d/d33/d80/f110 x:0 0 0 2024-09-17T04:21:23.317 INFO:tasks.workunit.client.0.smithi088.stdout:2/905: write d0/d1/d2d/d33/d4b/f8b [4493085,88149] 0 2024-09-17T04:21:23.320 INFO:tasks.workunit.client.0.smithi088.stdout:2/906: mknod d0/d1/d2d/d77/c111 0 2024-09-17T04:21:23.331 INFO:tasks.workunit.client.0.smithi088.stdout:2/907: dread d0/fd [0,4194304] 0 2024-09-17T04:21:23.341 INFO:tasks.workunit.client.0.smithi088.stdout:2/908: dwrite d0/d1/d2d/d33/d4b/d6d/fa4 [0,4194304] 0 2024-09-17T04:21:23.349 INFO:tasks.workunit.client.0.smithi088.stdout:2/909: truncate d0/d1/d2d/d33/d4b/d6d/d94/fce 2972120 0 2024-09-17T04:21:23.369 INFO:tasks.workunit.client.0.smithi088.stdout:2/910: dread d0/d13/fec [0,4194304] 0 2024-09-17T04:21:23.372 INFO:tasks.workunit.client.0.smithi088.stdout:2/911: symlink d0/d1/d2d/d33/d4b/d24/d89/l112 0 2024-09-17T04:21:23.374 INFO:tasks.workunit.client.0.smithi088.stdout:2/912: read d0/d1/d2d/d33/d4b/d24/d3b/d22/dba/fc2 [2877084,6617] 0 2024-09-17T04:21:23.376 INFO:tasks.workunit.client.0.smithi088.stdout:2/913: mknod d0/d1/d2d/d33/d85/c113 0 2024-09-17T04:21:23.378 INFO:tasks.workunit.client.0.smithi088.stdout:2/914: mkdir d0/d114 0 2024-09-17T04:21:23.382 INFO:tasks.workunit.client.0.smithi088.stdout:2/915: mknod d0/d1/d2d/d33/d4b/c115 0 2024-09-17T04:21:23.382 INFO:tasks.workunit.client.0.smithi088.stdout:2/916: read d0/f5d [2230511,22102] 0 2024-09-17T04:21:23.385 INFO:tasks.workunit.client.0.smithi088.stdout:2/917: mknod d0/d1/d2d/d33/c116 0 2024-09-17T04:21:23.386 INFO:tasks.workunit.client.0.smithi088.stdout:2/918: fsync d0/d1/d2d/d33/d4b/d6d/d94/fb1 0 2024-09-17T04:21:23.388 INFO:tasks.workunit.client.0.smithi088.stdout:2/919: creat d0/d1/dc5/dd5/f117 x:0 0 0 2024-09-17T04:21:23.389 INFO:tasks.workunit.client.0.smithi088.stdout:2/920: read d0/d1/f3 [6707922,10738] 0 2024-09-17T04:21:23.394 INFO:tasks.workunit.client.0.smithi088.stdout:2/921: dwrite d0/d1/d2d/d33/d4b/d6d/fa4 [0,4194304] 0 2024-09-17T04:21:23.396 INFO:tasks.workunit.client.0.smithi088.stdout:2/922: stat d0/d1/d2d/d33/d4b/d6d 0 2024-09-17T04:21:23.400 INFO:tasks.workunit.client.0.smithi088.stdout:7/890: sync 2024-09-17T04:21:23.401 INFO:tasks.workunit.client.0.smithi088.stdout:2/923: fsync d0/d1/d2d/d33/d4b/d24/f51 0 2024-09-17T04:21:23.401 INFO:tasks.workunit.client.0.smithi088.stdout:2/924: chown d0/d1/d2d/fd3 106263 1 2024-09-17T04:21:23.402 INFO:tasks.workunit.client.0.smithi088.stdout:2/925: chown d0/d1/d2d/d33/d4b/d6d/d94/da5/l10a 43782 1 2024-09-17T04:21:23.403 INFO:tasks.workunit.client.0.smithi088.stdout:7/891: creat d2/d79/f115 x:0 0 0 2024-09-17T04:21:23.405 INFO:tasks.workunit.client.0.smithi088.stdout:2/926: creat d0/d1/d2d/dbd/f118 x:0 0 0 2024-09-17T04:21:23.407 INFO:tasks.workunit.client.0.smithi088.stdout:7/892: unlink d2/d1d/d2e/db0/d23/d97/dbb/dcf/ffb 0 2024-09-17T04:21:23.408 INFO:tasks.workunit.client.0.smithi088.stdout:2/927: creat d0/d1/d2d/d33/d4b/d24/d3b/d22/dba/dc6/f119 x:0 0 0 2024-09-17T04:21:23.409 INFO:tasks.workunit.client.0.smithi088.stdout:7/893: symlink d2/d79/db3/l116 0 2024-09-17T04:21:23.411 INFO:tasks.workunit.client.0.smithi088.stdout:7/894: creat d2/d1d/f117 x:0 0 0 2024-09-17T04:21:23.412 INFO:tasks.workunit.client.0.smithi088.stdout:2/928: symlink d0/d1/d2d/d33/d4b/d6d/d94/l11a 0 2024-09-17T04:21:23.412 INFO:tasks.workunit.client.0.smithi088.stdout:7/895: chown d2/d4/d7/l83 18 1 2024-09-17T04:21:23.413 INFO:tasks.workunit.client.0.smithi088.stdout:7/896: dread - d2/d1d/d2e/db0/d23/d45/d6d/f10a zero size 2024-09-17T04:21:23.414 INFO:tasks.workunit.client.0.smithi088.stdout:7/897: stat d2/d1d/d2e/db0/d23/d97/dbb/ce4 0 2024-09-17T04:21:23.416 INFO:tasks.workunit.client.0.smithi088.stdout:2/929: rename d0/l106 to d0/d1/d2d/d33/d4b/d24/d89/l11b 0 2024-09-17T04:21:23.417 INFO:tasks.workunit.client.0.smithi088.stdout:2/930: chown d0/d1/d2d/d33/d4b/d24/d3b/d26/f8d 1383192 1 2024-09-17T04:21:23.419 INFO:tasks.workunit.client.0.smithi088.stdout:7/898: creat d2/f118 x:0 0 0 2024-09-17T04:21:23.420 INFO:tasks.workunit.client.0.smithi088.stdout:2/931: symlink d0/d13/dd1/de8/l11c 0 2024-09-17T04:21:23.422 INFO:tasks.workunit.client.0.smithi088.stdout:2/932: mkdir d0/d1/d2d/d33/d4b/d24/d4d/d11d 0 2024-09-17T04:21:23.427 INFO:tasks.workunit.client.0.smithi088.stdout:2/933: dread d0/d13/f97 [0,4194304] 0 2024-09-17T04:21:23.434 INFO:tasks.workunit.client.0.smithi088.stdout:7/899: dwrite d2/d4/f69 [0,4194304] 0 2024-09-17T04:21:23.436 INFO:tasks.workunit.client.0.smithi088.stdout:2/934: getdents d0/d1/d2d/d33/d85 0 2024-09-17T04:21:23.436 INFO:tasks.workunit.client.0.smithi088.stdout:2/935: chown d0/d1/d2d/d33/d4b/d24/d4d 158626 1 2024-09-17T04:21:23.438 INFO:tasks.workunit.client.0.smithi088.stdout:2/936: write d0/d1/d2d/d33/d4b/f8b [1746401,37142] 0 2024-09-17T04:21:23.438 INFO:tasks.workunit.client.0.smithi088.stdout:7/900: creat d2/d4/d7/d46/f119 x:0 0 0 2024-09-17T04:21:23.445 INFO:tasks.workunit.client.0.smithi088.stdout:7/901: getdents d2/d1d/d2e/db0/d23/d45/d62/d82 0 2024-09-17T04:21:23.447 INFO:tasks.workunit.client.0.smithi088.stdout:7/902: creat d2/d79/db3/f11a x:0 0 0 2024-09-17T04:21:23.450 INFO:tasks.workunit.client.0.smithi088.stdout:7/903: mkdir d2/d1d/d2e/db0/d23/d97/dbb/dcf/d11b 0 2024-09-17T04:21:23.453 INFO:tasks.workunit.client.0.smithi088.stdout:2/937: write d0/d1/d2d/d33/d4b/d6d/d94/fce [3474684,63962] 0 2024-09-17T04:21:23.454 INFO:tasks.workunit.client.0.smithi088.stdout:2/938: chown d0/d1/d2d/d33/d4b/d24/d3b/d26/feb 890992397 1 2024-09-17T04:21:23.463 INFO:tasks.workunit.client.0.smithi088.stdout:7/904: dwrite d2/d4/d7/d20/f6b [0,4194304] 0 2024-09-17T04:21:23.466 INFO:tasks.workunit.client.0.smithi088.stdout:2/939: truncate d0/d1/d2d/d33/d4b/d6d/d94/da5/f100 6094684 0 2024-09-17T04:21:23.467 INFO:tasks.workunit.client.0.smithi088.stdout:7/905: mknod d2/d79/c11c 0 2024-09-17T04:21:23.487 INFO:tasks.workunit.client.0.smithi088.stdout:2/940: write d0/d1/d2d/d33/d4b/d24/d89/fd0 [306032,29026] 0 2024-09-17T04:21:23.489 INFO:tasks.workunit.client.0.smithi088.stdout:2/941: creat d0/d1/d2d/dbd/f11e x:0 0 0 2024-09-17T04:21:23.493 INFO:tasks.workunit.client.0.smithi088.stdout:2/942: link d0/d1/d2d/f3a d0/d1/d2d/d33/d4b/d24/d4d/d11d/f11f 0 2024-09-17T04:21:23.495 INFO:tasks.workunit.client.0.smithi088.stdout:2/943: rmdir d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/d7c/dfc 39 2024-09-17T04:21:23.496 INFO:tasks.workunit.client.0.smithi088.stdout:2/944: write d0/d1/fc9 [677810,47306] 0 2024-09-17T04:21:23.507 INFO:tasks.workunit.client.0.smithi088.stdout:2/945: truncate d0/d1/d2d/d33/d4b/f8b 4444895 0 2024-09-17T04:21:23.509 INFO:tasks.workunit.client.0.smithi088.stdout:2/946: mkdir d0/d13/dd1/d120 0 2024-09-17T04:21:23.518 INFO:tasks.workunit.client.0.smithi088.stdout:2/947: link d0/d1/d2d/d33/d4b/d24/d3b/d22/dba/dc6/fe2 d0/d1/d2d/d33/d4b/d6d/f121 0 2024-09-17T04:21:23.518 INFO:tasks.workunit.client.0.smithi088.stdout:2/948: chown d0/d1/cf 5 1 2024-09-17T04:21:23.530 INFO:tasks.workunit.client.0.smithi088.stdout:2/949: write d0/d1/d2d/d33/d4b/d24/d3b/f8f [2065344,4004] 0 2024-09-17T04:21:23.538 INFO:tasks.workunit.client.0.smithi088.stdout:2/950: symlink d0/d1/d2d/d33/d80/l122 0 2024-09-17T04:21:23.539 INFO:tasks.workunit.client.0.smithi088.stdout:2/951: dread - d0/d1/d2d/d33/d4b/d24/fdf zero size 2024-09-17T04:21:23.543 INFO:tasks.workunit.client.0.smithi088.stdout:2/952: dread d0/d1/d2d/d33/d65/fdc [0,4194304] 0 2024-09-17T04:21:23.543 INFO:tasks.workunit.client.0.smithi088.stdout:2/953: chown d0/d1/fc9 8386923 1 2024-09-17T04:21:23.545 INFO:tasks.workunit.client.0.smithi088.stdout:2/954: write d0/d1/d2d/d33/d4b/d24/d3b/fb9 [318309,63564] 0 2024-09-17T04:21:23.548 INFO:tasks.workunit.client.0.smithi088.stdout:2/955: symlink d0/d1/d2d/d33/d80/l123 0 2024-09-17T04:21:23.550 INFO:tasks.workunit.client.0.smithi088.stdout:2/956: symlink d0/d1/d2d/d33/d65/l124 0 2024-09-17T04:21:23.556 INFO:tasks.workunit.client.0.smithi088.stdout:2/957: truncate d0/d1/d2d/d33/d4b/d6d/f88 862588 0 2024-09-17T04:21:23.557 INFO:tasks.workunit.client.0.smithi088.stdout:2/958: readlink d0/d1/d2d/d33/d65/l124 0 2024-09-17T04:21:23.559 INFO:tasks.workunit.client.0.smithi088.stdout:2/959: fdatasync d0/d1/d2d/d33/d4b/d24/d3b/fb7 0 2024-09-17T04:21:23.561 INFO:tasks.workunit.client.0.smithi088.stdout:2/960: mkdir d0/d1/d2d/d33/d65/d125 0 2024-09-17T04:21:23.574 INFO:tasks.workunit.client.0.smithi088.stdout:2/961: dwrite d0/d1/d2d/d33/d4b/d24/d92/fac [0,4194304] 0 2024-09-17T04:21:23.583 INFO:tasks.workunit.client.0.smithi088.stdout:2/962: creat d0/d1/d2d/d33/d4b/d24/d92/dd9/f126 x:0 0 0 2024-09-17T04:21:23.587 INFO:tasks.workunit.client.0.smithi088.stdout:2/963: dread d0/d1/d2d/d33/d4b/d24/d92/fb5 [0,4194304] 0 2024-09-17T04:21:23.655 INFO:tasks.workunit.client.0.smithi088.stdout:2/964: dwrite d0/d1/d2d/d33/d4b/d24/d3b/fcd [0,4194304] 0 2024-09-17T04:21:23.657 INFO:tasks.workunit.client.0.smithi088.stdout:2/965: fsync d0/d1/d2d/d33/d4b/d6d/d94/fb1 0 2024-09-17T04:21:23.661 INFO:tasks.workunit.client.0.smithi088.stdout:2/966: creat d0/d1/d2d/d33/d4b/d6d/d94/da5/f127 x:0 0 0 2024-09-17T04:21:23.662 INFO:tasks.workunit.client.0.smithi088.stdout:2/967: chown d0/d13/dd1/d120 81 1 2024-09-17T04:21:23.662 INFO:tasks.workunit.client.0.smithi088.stdout:2/968: write d0/d1/f1e [856474,99012] 0 2024-09-17T04:21:23.665 INFO:tasks.workunit.client.0.smithi088.stdout:2/969: creat d0/d1/d2d/dbd/f128 x:0 0 0 2024-09-17T04:21:23.667 INFO:tasks.workunit.client.0.smithi088.stdout:2/970: mkdir d0/d1/d2d/d33/d4b/d24/d3b/d22/d129 0 2024-09-17T04:21:23.679 INFO:tasks.workunit.client.0.smithi088.stdout:2/971: write d0/d1/d2d/d33/d65/fdc [107258,50295] 0 2024-09-17T04:21:23.682 INFO:tasks.workunit.client.0.smithi088.stdout:2/972: write d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/f5b [674687,59733] 0 2024-09-17T04:21:23.682 INFO:tasks.workunit.client.0.smithi088.stdout:2/973: chown d0/d1/fb 1877223810 1 2024-09-17T04:21:23.689 INFO:tasks.workunit.client.0.smithi088.stdout:9/962: sync 2024-09-17T04:21:23.689 INFO:tasks.workunit.client.0.smithi088.stdout:2/974: dwrite d0/d1/d2d/d33/d4b/d6d/d94/fd2 [0,4194304] 0 2024-09-17T04:21:23.690 INFO:tasks.workunit.client.0.smithi088.stdout:9/963: chown d2/dd/d14/d2a/d76/d98/db3/l137 3437625 1 2024-09-17T04:21:23.692 INFO:tasks.workunit.client.0.smithi088.stdout:2/975: symlink d0/d13/dd1/de8/l12a 0 2024-09-17T04:21:23.694 INFO:tasks.workunit.client.0.smithi088.stdout:2/976: stat d0/d1/d2d/d33/d4b/d24/d3b/d22/dba/dc6/f119 0 2024-09-17T04:21:23.694 INFO:tasks.workunit.client.0.smithi088.stdout:9/964: dread d2/dd/d14/d8b/d35/fcb [0,4194304] 0 2024-09-17T04:21:23.695 INFO:tasks.workunit.client.0.smithi088.stdout:9/965: readlink d2/dd/d14/d2a/d76/d98/db3/l137 0 2024-09-17T04:21:23.698 INFO:tasks.workunit.client.0.smithi088.stdout:9/966: truncate d2/dd/d14/d8b/d43/d51/f71 3396246 0 2024-09-17T04:21:23.704 INFO:tasks.workunit.client.0.smithi088.stdout:9/967: creat d2/dd/d14/d2a/d76/d98/d142/f149 x:0 0 0 2024-09-17T04:21:23.705 INFO:tasks.workunit.client.0.smithi088.stdout:2/977: link d0/d1/d2d/d33/d4b/d24/c6e d0/d1/c12b 0 2024-09-17T04:21:23.711 INFO:tasks.workunit.client.0.smithi088.stdout:2/978: dwrite d0/d1/d2d/d33/d80/f4c [4194304,4194304] 0 2024-09-17T04:21:23.718 INFO:tasks.workunit.client.0.smithi088.stdout:2/979: symlink d0/d1/d2d/d33/d4b/d24/d3b/d22/d129/l12c 0 2024-09-17T04:21:23.723 INFO:tasks.workunit.client.0.smithi088.stdout:9/968: dwrite d2/dd/fe [0,4194304] 0 2024-09-17T04:21:23.724 INFO:tasks.workunit.client.0.smithi088.stdout:2/980: dread d0/d13/dd1/ffe [0,4194304] 0 2024-09-17T04:21:23.726 INFO:tasks.workunit.client.0.smithi088.stdout:9/969: mknod d2/d16/d116/c14a 0 2024-09-17T04:21:23.727 INFO:tasks.workunit.client.0.smithi088.stdout:9/970: chown d2/dd/d14/d8b/d43/c11a 4 1 2024-09-17T04:21:23.729 INFO:tasks.workunit.client.0.smithi088.stdout:2/981: truncate d0/d1/d2d/d33/d4b/d24/f86 4726380 0 2024-09-17T04:21:23.732 INFO:tasks.workunit.client.0.smithi088.stdout:9/971: creat d2/d16/f14b x:0 0 0 2024-09-17T04:21:23.738 INFO:tasks.workunit.client.0.smithi088.stdout:9/972: creat d2/dd/d14/d8b/d35/d94/dfc/f14c x:0 0 0 2024-09-17T04:21:23.740 INFO:tasks.workunit.client.0.smithi088.stdout:9/973: truncate d2/dd/d14/d8b/d35/fda 762042 0 2024-09-17T04:21:23.746 INFO:tasks.workunit.client.0.smithi088.stdout:2/982: dread d0/d1/d2d/f6a [0,4194304] 0 2024-09-17T04:21:23.747 INFO:tasks.workunit.client.0.smithi088.stdout:9/974: dwrite d2/d16/f10f [0,4194304] 0 2024-09-17T04:21:23.752 INFO:tasks.workunit.client.0.smithi088.stdout:9/975: mknod d2/dd/d14/d2a/d8f/c14d 0 2024-09-17T04:21:23.754 INFO:tasks.workunit.client.0.smithi088.stdout:2/983: mkdir d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/d12d 0 2024-09-17T04:21:23.756 INFO:tasks.workunit.client.0.smithi088.stdout:9/976: mknod d2/d16/ddd/c14e 0 2024-09-17T04:21:23.760 INFO:tasks.workunit.client.0.smithi088.stdout:2/984: truncate d0/d1/d2d/d33/d4b/d24/d3b/f54 5042445 0 2024-09-17T04:21:23.764 INFO:tasks.workunit.client.0.smithi088.stdout:2/985: rename d0/d1/d2d/d33/d4b/d24/d4d/d11d to d0/d1/d2d/d33/d4b/d24/d3b/d22/d129/d12e 0 2024-09-17T04:21:23.765 INFO:tasks.workunit.client.0.smithi088.stdout:2/986: chown d0/d1/d2d/d33/d4b/d6d/f121 30385 1 2024-09-17T04:21:23.767 INFO:tasks.workunit.client.0.smithi088.stdout:2/987: unlink d0/ca 0 2024-09-17T04:21:23.769 INFO:tasks.workunit.client.0.smithi088.stdout:2/988: mknod d0/d13/c12f 0 2024-09-17T04:21:23.770 INFO:tasks.workunit.client.0.smithi088.stdout:2/989: readlink d0/d1/d2d/d33/d4b/d24/d92/l96 0 2024-09-17T04:21:23.777 INFO:tasks.workunit.client.0.smithi088.stdout:9/977: dread d2/d16/fa8 [0,4194304] 0 2024-09-17T04:21:23.778 INFO:tasks.workunit.client.0.smithi088.stdout:9/978: read - d2/d2b/d58/f13f zero size 2024-09-17T04:21:23.783 INFO:tasks.workunit.client.0.smithi088.stdout:9/979: dwrite d2/dd/d11/f25 [0,4194304] 0 2024-09-17T04:21:23.784 INFO:tasks.workunit.client.0.smithi088.stdout:9/980: write d2/d16/f10f [3975471,98193] 0 2024-09-17T04:21:23.785 INFO:tasks.workunit.client.0.smithi088.stdout:9/981: dread - d2/d2b/d58/f13c zero size 2024-09-17T04:21:23.789 INFO:tasks.workunit.client.0.smithi088.stdout:2/990: dread d0/d1/d2d/d33/d85/fa0 [0,4194304] 0 2024-09-17T04:21:23.791 INFO:tasks.workunit.client.0.smithi088.stdout:2/991: mkdir d0/d13/d130 0 2024-09-17T04:21:23.792 INFO:tasks.workunit.client.0.smithi088.stdout:2/992: write d0/d1/d2d/d33/d4b/d24/d3b/f8f [3097207,7811] 0 2024-09-17T04:21:23.798 INFO:tasks.workunit.client.0.smithi088.stdout:2/993: dwrite d0/d1/d2d/d33/d4b/f2e [0,4194304] 0 2024-09-17T04:21:23.808 INFO:tasks.workunit.client.0.smithi088.stdout:2/994: dwrite d0/d13/dd1/def/ff5 [0,4194304] 0 2024-09-17T04:21:23.813 INFO:tasks.workunit.client.0.smithi088.stdout:2/995: chown d0/d1/d2d/d33/d4b/d24/d4d/lad 83 1 2024-09-17T04:21:23.813 INFO:tasks.workunit.client.0.smithi088.stdout:2/996: write d0/d1/d2d/d33/f82 [2993797,62266] 0 2024-09-17T04:21:23.816 INFO:tasks.workunit.client.0.smithi088.stdout:2/997: chown d0/d1/d2d/d33/d4b/d24/d3b/d22/d4f/d7c/dfc 18030385 1 2024-09-17T04:21:23.817 INFO:tasks.workunit.client.0.smithi088.stdout:2/998: write d0/d1/d2d/d33/d4b/d24/d3b/f10c [547737,79334] 0 2024-09-17T04:21:23.824 INFO:tasks.workunit.client.0.smithi088.stdout:2/999: dwrite d0/d1/d2d/d33/d4b/d24/d92/f9c [0,4194304] 0 2024-09-17T04:21:24.042 INFO:tasks.workunit.client.0.smithi088.stdout:5/774: sync 2024-09-17T04:21:24.043 INFO:tasks.workunit.client.0.smithi088.stdout:5/775: rmdir d2/d31/d33/d20/d47 39 2024-09-17T04:21:24.045 INFO:tasks.workunit.client.0.smithi088.stdout:5/776: mkdir d2/d31/d33/d20/d25/d2c/d8a/db2/dfc 0 2024-09-17T04:21:24.048 INFO:tasks.workunit.client.0.smithi088.stdout:5/777: mknod d2/d31/d33/cfd 0 2024-09-17T04:21:24.050 INFO:tasks.workunit.client.0.smithi088.stdout:5/778: mkdir d2/d31/d33/d20/d47/dfe 0 2024-09-17T04:21:24.052 INFO:tasks.workunit.client.0.smithi088.stdout:5/779: truncate d2/d31/d33/d20/d30/d51/d5e/d6b/f7d 276591 0 2024-09-17T04:21:24.053 INFO:tasks.workunit.client.0.smithi088.stdout:5/780: chown d2/d31/d33/d20/d25/d2c/d8a/db2/ldc 0 1 2024-09-17T04:21:24.055 INFO:tasks.workunit.client.0.smithi088.stdout:5/781: symlink d2/d31/d33/d20/d8b/lff 0 2024-09-17T04:21:24.057 INFO:tasks.workunit.client.0.smithi088.stdout:5/782: mknod d2/d31/d33/d20/d25/d49/c100 0 2024-09-17T04:21:24.059 INFO:tasks.workunit.client.0.smithi088.stdout:5/783: truncate d2/d31/f77 485831 0 2024-09-17T04:21:24.060 INFO:tasks.workunit.client.0.smithi088.stdout:5/784: write d2/d31/d33/d20/d47/de0/ffa [605749,111708] 0 2024-09-17T04:21:24.063 INFO:tasks.workunit.client.0.smithi088.stdout:5/785: creat d2/d31/d33/d20/f101 x:0 0 0 2024-09-17T04:21:24.065 INFO:tasks.workunit.client.0.smithi088.stdout:5/786: chown d2/c4f 41 1 2024-09-17T04:21:24.067 INFO:tasks.workunit.client.0.smithi088.stdout:5/787: creat d2/d31/d33/d20/dd9/f102 x:0 0 0 2024-09-17T04:21:24.072 INFO:tasks.workunit.client.0.smithi088.stdout:5/788: dread d2/d31/d33/d20/f84 [0,4194304] 0 2024-09-17T04:21:24.076 INFO:tasks.workunit.client.0.smithi088.stdout:5/789: creat d2/d31/d33/d20/d30/d9f/da4/f103 x:0 0 0 2024-09-17T04:21:24.076 INFO:tasks.workunit.client.0.smithi088.stdout:5/790: chown d2 28 1 2024-09-17T04:21:24.078 INFO:tasks.workunit.client.0.smithi088.stdout:5/791: mknod d2/d31/d33/d20/d25/d2c/d8a/db2/dc3/c104 0 2024-09-17T04:21:24.096 INFO:tasks.workunit.client.0.smithi088.stdout:5/792: dwrite d2/d31/d33/d20/d47/de0/da5/fcb [0,4194304] 0 2024-09-17T04:21:24.103 INFO:tasks.workunit.client.0.smithi088.stdout:5/793: write d2/d31/d33/d20/d30/d9f/da4/fa7 [707261,102110] 0 2024-09-17T04:21:24.108 INFO:tasks.workunit.client.0.smithi088.stdout:5/794: write d2/d31/d33/d20/d25/d49/f64 [1753379,49083] 0 2024-09-17T04:21:24.111 INFO:tasks.workunit.client.0.smithi088.stdout:5/795: mkdir d2/d105 0 2024-09-17T04:21:24.112 INFO:tasks.workunit.client.0.smithi088.stdout:5/796: fdatasync d2/f90 0 2024-09-17T04:21:24.116 INFO:tasks.workunit.client.0.smithi088.stdout:5/797: symlink d2/d31/d33/d20/d30/dea/l106 0 2024-09-17T04:21:24.120 INFO:tasks.workunit.client.0.smithi088.stdout:5/798: getdents d2/d31 0 2024-09-17T04:21:24.122 INFO:tasks.workunit.client.0.smithi088.stdout:5/799: creat d2/d31/d33/d20/d47/de0/f107 x:0 0 0 2024-09-17T04:21:24.122 INFO:tasks.workunit.client.0.smithi088.stdout:5/800: chown d2/d31/d33/d20/d47/fc4 208 1 2024-09-17T04:21:24.125 INFO:tasks.workunit.client.0.smithi088.stdout:5/801: mkdir d2/d31/d108 0 2024-09-17T04:21:24.135 INFO:tasks.workunit.client.0.smithi088.stdout:5/802: dread d2/d31/d33/fb4 [0,4194304] 0 2024-09-17T04:21:24.143 INFO:tasks.workunit.client.0.smithi088.stdout:5/803: getdents d2/d31/dd5 0 2024-09-17T04:21:24.155 INFO:tasks.workunit.client.0.smithi088.stdout:5/804: dwrite d2/d31/d33/d20/d25/d49/f60 [0,4194304] 0 2024-09-17T04:21:24.159 INFO:tasks.workunit.client.0.smithi088.stdout:5/805: truncate d2/d31/d33/d20/d25/d2c/fe7 4325638 0 2024-09-17T04:21:24.162 INFO:tasks.workunit.client.0.smithi088.stdout:5/806: truncate d2/d31/d33/f58 2427407 0 2024-09-17T04:21:24.236 INFO:tasks.workunit.client.0.smithi088.stdout:5/807: dread d2/f10 [4194304,4194304] 0 2024-09-17T04:21:24.391 INFO:tasks.workunit.client.0.smithi088.stdout:1/943: sync 2024-09-17T04:21:24.392 INFO:tasks.workunit.client.0.smithi088.stdout:5/808: sync 2024-09-17T04:21:24.392 INFO:tasks.workunit.client.0.smithi088.stdout:8/796: sync 2024-09-17T04:21:24.392 INFO:tasks.workunit.client.0.smithi088.stdout:0/712: sync 2024-09-17T04:21:24.392 INFO:tasks.workunit.client.0.smithi088.stdout:3/994: sync 2024-09-17T04:21:24.392 INFO:tasks.workunit.client.0.smithi088.stdout:7/906: sync 2024-09-17T04:21:24.392 INFO:tasks.workunit.client.0.smithi088.stdout:9/982: sync 2024-09-17T04:21:24.392 INFO:tasks.workunit.client.0.smithi088.stdout:4/819: sync 2024-09-17T04:21:24.393 INFO:tasks.workunit.client.0.smithi088.stdout:1/944: readlink d0/de3/ld7 0 2024-09-17T04:21:24.395 INFO:tasks.workunit.client.0.smithi088.stdout:0/713: chown db/d1b/d39/f5c 29 1 2024-09-17T04:21:24.395 INFO:tasks.workunit.client.0.smithi088.stdout:9/983: mknod d2/dd/d14/d131/c14f 0 2024-09-17T04:21:24.398 INFO:tasks.workunit.client.0.smithi088.stdout:3/995: mkdir d0/d13/d1b/d29/d30/dde/d140 0 2024-09-17T04:21:24.398 INFO:tasks.workunit.client.0.smithi088.stdout:8/797: dread d7/d7f/f8b [0,4194304] 0 2024-09-17T04:21:24.400 INFO:tasks.workunit.client.0.smithi088.stdout:7/907: dread d2/d4/d7/d46/d67/dd6/fe0 [0,4194304] 0 2024-09-17T04:21:24.401 INFO:tasks.workunit.client.0.smithi088.stdout:1/945: symlink d0/d1/d16/d35/dc5/de2/l12e 0 2024-09-17T04:21:24.403 INFO:tasks.workunit.client.0.smithi088.stdout:1/946: read - d0/d1/d16/d2a/f126 zero size 2024-09-17T04:21:24.403 INFO:tasks.workunit.client.0.smithi088.stdout:0/714: symlink db/d1b/d36/d47/db9/lfb 0 2024-09-17T04:21:24.404 INFO:tasks.workunit.client.0.smithi088.stdout:9/984: dwrite d2/dd/d14/d8b/d35/d94/dfc/f139 [0,4194304] 0 2024-09-17T04:21:24.405 INFO:tasks.workunit.client.0.smithi088.stdout:3/996: fsync d0/feb 0 2024-09-17T04:21:24.407 INFO:tasks.workunit.client.0.smithi088.stdout:9/985: dread - d2/dd/d14/d2a/d8f/d99/f13e zero size 2024-09-17T04:21:24.407 INFO:tasks.workunit.client.0.smithi088.stdout:4/820: creat d5/d3f/d71/d8b/d68/dab/deb/f111 x:0 0 0 2024-09-17T04:21:24.408 INFO:tasks.workunit.client.0.smithi088.stdout:4/821: read - d5/d32/d6b/dd2/d109/fe5 zero size 2024-09-17T04:21:24.409 INFO:tasks.workunit.client.0.smithi088.stdout:5/809: creat d2/d31/d33/d20/d25/d2c/d8a/db2/dfc/f109 x:0 0 0 2024-09-17T04:21:24.410 INFO:tasks.workunit.client.0.smithi088.stdout:4/822: chown d5/lf3 1765899 1 2024-09-17T04:21:24.411 INFO:tasks.workunit.client.0.smithi088.stdout:8/798: creat d7/dd/d31/dca/de6/f109 x:0 0 0 2024-09-17T04:21:24.414 INFO:tasks.workunit.client.0.smithi088.stdout:4/823: read d5/d3f/d71/d8b/d68/da4/d5e/fc9 [1179660,52671] 0 2024-09-17T04:21:24.416 INFO:tasks.workunit.client.0.smithi088.stdout:4/824: chown d5/d32/d6b/dd2/d109/ccf 30 1 2024-09-17T04:21:24.417 INFO:tasks.workunit.client.0.smithi088.stdout:3/997: truncate d0/d13/d58/d5a/d63/fbb 3121389 0 2024-09-17T04:21:24.425 INFO:tasks.workunit.client.0.smithi088.stdout:5/810: chown d2/d31/d33/cd4 86609 1 2024-09-17T04:21:24.425 INFO:tasks.workunit.client.0.smithi088.stdout:7/908: truncate d2/d4/f18 3789017 0 2024-09-17T04:21:24.425 INFO:tasks.workunit.client.0.smithi088.stdout:0/715: dread db/d1b/d36/df9/d9f/fd4 [0,4194304] 0 2024-09-17T04:21:24.428 INFO:tasks.workunit.client.0.smithi088.stdout:1/947: dread d0/d1/d16/d2a/fd1 [0,4194304] 0 2024-09-17T04:21:24.428 INFO:tasks.workunit.client.0.smithi088.stdout:7/909: creat d2/d96/df2/f11d x:0 0 0 2024-09-17T04:21:24.430 INFO:tasks.workunit.client.0.smithi088.stdout:4/825: dread d5/d3f/d71/d8b/d68/da4/d5e/f6a [0,4194304] 0 2024-09-17T04:21:24.431 INFO:tasks.workunit.client.0.smithi088.stdout:8/799: mkdir d7/d29/d2a/d10a 0 2024-09-17T04:21:24.433 INFO:tasks.workunit.client.0.smithi088.stdout:0/716: creat db/d1b/d36/df9/d9f/dc4/ffc x:0 0 0 2024-09-17T04:21:24.436 INFO:tasks.workunit.client.0.smithi088.stdout:9/986: dread d2/f3 [0,4194304] 0 2024-09-17T04:21:24.437 INFO:tasks.workunit.client.0.smithi088.stdout:8/800: fsync d7/d29/d2a/f2b 0 2024-09-17T04:21:24.440 INFO:tasks.workunit.client.0.smithi088.stdout:4/826: rename d5/d3f/d71/d8b/d75/dd0/f10a to d5/d32/d6b/dd2/d109/f112 0 2024-09-17T04:21:24.441 INFO:tasks.workunit.client.0.smithi088.stdout:4/827: truncate d5/d3f/d71/f101 240071 0 2024-09-17T04:21:24.441 INFO:tasks.workunit.client.0.smithi088.stdout:3/998: write d0/d13/f22 [2338313,124700] 0 2024-09-17T04:21:24.443 INFO:tasks.workunit.client.0.smithi088.stdout:9/987: read - d2/db8/d115/f12d zero size 2024-09-17T04:21:24.445 INFO:tasks.workunit.client.0.smithi088.stdout:0/717: mkdir db/d1b/d36/df9/d59/da4/dc8/dfd 0 2024-09-17T04:21:24.445 INFO:tasks.workunit.client.0.smithi088.stdout:5/811: write d2/d31/d33/d20/d30/f91 [94901,10436] 0 2024-09-17T04:21:24.451 INFO:tasks.workunit.client.0.smithi088.stdout:9/988: dwrite d2/dd/d14/d2a/d76/d98/fcc [4194304,4194304] 0 2024-09-17T04:21:24.453 INFO:tasks.workunit.client.0.smithi088.stdout:7/910: dread d2/d1d/d2e/db0/d23/f2f [0,4194304] 0 2024-09-17T04:21:24.454 INFO:tasks.workunit.client.0.smithi088.stdout:9/989: fdatasync d2/d2b/d2e/dbb/d104/d72/d74/fae 0 2024-09-17T04:21:24.465 INFO:tasks.workunit.client.0.smithi088.stdout:4/828: write d5/d3f/d71/d8b/d68/fa5 [1928283,22817] 0 2024-09-17T04:21:24.468 INFO:tasks.workunit.client.0.smithi088.stdout:8/801: dread d7/dd/d31/f58 [0,4194304] 0 2024-09-17T04:21:24.474 INFO:tasks.workunit.client.0.smithi088.stdout:0/718: dwrite db/fc [0,4194304] 0 2024-09-17T04:21:24.475 INFO:tasks.workunit.client.0.smithi088.stdout:3/999: dread d0/d13/d1b/d29/d30/d35/f66 [0,4194304] 0 2024-09-17T04:21:24.476 INFO:tasks.workunit.client.0.smithi088.stdout:7/911: rename d2/d4/d9b to d2/d1d/d2e/db0/d23/d97/dbb/dcf/d11b/d11e 0 2024-09-17T04:21:24.476 INFO:tasks.workunit.client.0.smithi088.stdout:4/829: mkdir d5/d3f/d71/d8b/d68/da4/d5e/d113 0 2024-09-17T04:21:24.478 INFO:tasks.workunit.client.0.smithi088.stdout:4/830: fdatasync d5/d32/d6b/dd2/ff5 0 2024-09-17T04:21:24.479 INFO:tasks.workunit.client.0.smithi088.stdout:8/802: link d7/dd/d31/d47/dc6/d104/ff7 d7/d29/d2a/d3a/f10b 0 2024-09-17T04:21:24.480 INFO:tasks.workunit.client.0.smithi088.stdout:5/812: dread d2/fc5 [0,4194304] 0 2024-09-17T04:21:24.482 INFO:tasks.workunit.client.0.smithi088.stdout:0/719: creat db/d1b/d36/d47/db9/dda/ffe x:0 0 0 2024-09-17T04:21:24.484 INFO:tasks.workunit.client.0.smithi088.stdout:9/990: rename d2/dd/d14/d2a/d8f to d2/dd/d14/d8b/d35/d114/d148/d150 0 2024-09-17T04:21:24.486 INFO:tasks.workunit.client.0.smithi088.stdout:7/912: unlink d2/d4/d7/d46/da3/lad 0 2024-09-17T04:21:24.488 INFO:tasks.workunit.client.0.smithi088.stdout:9/991: dread d2/d16/f10f [0,4194304] 0 2024-09-17T04:21:24.489 INFO:tasks.workunit.client.0.smithi088.stdout:5/813: mkdir d2/d31/d33/d20/d30/d51/d5e/d6b/d10a 0 2024-09-17T04:21:24.491 INFO:tasks.workunit.client.0.smithi088.stdout:7/913: dread d2/d4/d7/d20/f6b [0,4194304] 0 2024-09-17T04:21:24.494 INFO:tasks.workunit.client.0.smithi088.stdout:8/803: dread d7/d29/d2a/d38/f44 [0,4194304] 0 2024-09-17T04:21:24.497 INFO:tasks.workunit.client.0.smithi088.stdout:9/992: truncate d2/f3 3320060 0 2024-09-17T04:21:24.499 INFO:tasks.workunit.client.0.smithi088.stdout:5/814: dread d2/d31/d33/d20/d30/d51/d5e/d6b/f95 [0,4194304] 0 2024-09-17T04:21:24.505 INFO:tasks.workunit.client.0.smithi088.stdout:8/804: rename d7/dd/d6f/la3 to d7/d29/d2a/d75/l10c 0 2024-09-17T04:21:24.508 INFO:tasks.workunit.client.0.smithi088.stdout:4/831: truncate d5/fb 246646 0 2024-09-17T04:21:24.510 INFO:tasks.workunit.client.0.smithi088.stdout:0/720: dwrite db/d1b/d36/df9/d66/fab [0,4194304] 0 2024-09-17T04:21:24.517 INFO:tasks.workunit.client.0.smithi088.stdout:8/805: unlink d7/d29/d2a/d38/d3d/f49 0 2024-09-17T04:21:24.520 INFO:tasks.workunit.client.0.smithi088.stdout:7/914: dwrite d2/d1d/d2e/db0/fd9 [0,4194304] 0 2024-09-17T04:21:24.520 INFO:tasks.workunit.client.0.smithi088.stdout:7/915: chown d2/d79/c95 99495802 1 2024-09-17T04:21:24.523 INFO:tasks.workunit.client.0.smithi088.stdout:9/993: rename d2/dd/d14/d2a/d76/fbd to d2/dd/d14/d2a/f151 0 2024-09-17T04:21:24.527 INFO:tasks.workunit.client.0.smithi088.stdout:8/806: fsync d7/dd/d31/f36 0 2024-09-17T04:21:24.531 INFO:tasks.workunit.client.0.smithi088.stdout:4/832: unlink d5/d3f/f39 0 2024-09-17T04:21:24.536 INFO:tasks.workunit.client.0.smithi088.stdout:9/994: unlink d2/dd/d14/d2a/d76/d98/d142/f149 0 2024-09-17T04:21:24.540 INFO:tasks.workunit.client.0.smithi088.stdout:4/833: truncate d5/d3f/d71/d8b/fe6 754977 0 2024-09-17T04:21:24.544 INFO:tasks.workunit.client.0.smithi088.stdout:5/815: getdents d2/d31/d33/d20/d30/d9f/da4/dbe 0 2024-09-17T04:21:24.545 INFO:tasks.workunit.client.0.smithi088.stdout:0/721: link db/d1b/d36/d4a/d6a/faa db/d1b/d36/d4a/fff 0 2024-09-17T04:21:24.548 INFO:tasks.workunit.client.0.smithi088.stdout:8/807: rename d7/d29/d2a/d38/daf to d7/d10d 0 2024-09-17T04:21:24.550 INFO:tasks.workunit.client.0.smithi088.stdout:7/916: getdents d2/d79 0 2024-09-17T04:21:24.551 INFO:tasks.workunit.client.0.smithi088.stdout:5/816: fsync d2/d31/f45 0 2024-09-17T04:21:24.554 INFO:tasks.workunit.client.0.smithi088.stdout:0/722: mkdir db/d1b/d36/df9/d59/da4/d100 0 2024-09-17T04:21:24.556 INFO:tasks.workunit.client.0.smithi088.stdout:9/995: link d2/d2b/d2e/dbb/d104/db5/lf9 d2/dd/d14/d8b/d35/d114/d148/d150/d99/l152 0 2024-09-17T04:21:24.558 INFO:tasks.workunit.client.0.smithi088.stdout:8/808: unlink d7/d29/d2a/d3a/f102 0 2024-09-17T04:21:24.560 INFO:tasks.workunit.client.0.smithi088.stdout:4/834: write d5/d3f/d71/d99/fa6 [4208453,32009] 0 2024-09-17T04:21:24.561 INFO:tasks.workunit.client.0.smithi088.stdout:5/817: creat d2/d31/d33/d20/d47/de0/f10b x:0 0 0 2024-09-17T04:21:24.562 INFO:tasks.workunit.client.0.smithi088.stdout:5/818: dread - d2/d31/d33/d20/dd9/f102 zero size 2024-09-17T04:21:24.565 INFO:tasks.workunit.client.0.smithi088.stdout:9/996: dread d2/dd/d14/d8b/d43/fd1 [0,4194304] 0 2024-09-17T04:21:24.565 INFO:tasks.workunit.client.0.smithi088.stdout:5/819: dread d2/d31/f67 [4194304,4194304] 0 2024-09-17T04:21:24.569 INFO:tasks.workunit.client.0.smithi088.stdout:8/809: mknod d7/d7f/c10e 0 2024-09-17T04:21:24.569 INFO:tasks.workunit.client.0.smithi088.stdout:7/917: write d2/f21 [2455513,125270] 0 2024-09-17T04:21:24.575 INFO:tasks.workunit.client.0.smithi088.stdout:0/723: rename db/d1b/d36/df9/cb1 to db/d1b/d39/c101 0 2024-09-17T04:21:24.576 INFO:tasks.workunit.client.0.smithi088.stdout:7/918: dwrite d2/d1d/d2e/db0/d23/d45/d62/f9e [0,4194304] 0 2024-09-17T04:21:24.579 INFO:tasks.workunit.client.0.smithi088.stdout:5/820: mkdir d2/d31/d33/d20/d30/d9f/da4/d10c 0 2024-09-17T04:21:24.580 INFO:tasks.workunit.client.0.smithi088.stdout:1/948: sync 2024-09-17T04:21:24.581 INFO:tasks.workunit.client.0.smithi088.stdout:4/835: rename d5/d3f/d71/l7f to d5/d3d/dee/l114 0 2024-09-17T04:21:24.583 INFO:tasks.workunit.client.0.smithi088.stdout:7/919: symlink d2/d1d/d2e/db0/d23/d97/l11f 0 2024-09-17T04:21:24.583 INFO:tasks.workunit.client.0.smithi088.stdout:1/949: chown d0/d1/f61 445967 1 2024-09-17T04:21:24.588 INFO:tasks.workunit.client.0.smithi088.stdout:0/724: rename db/d1b/fe6 to db/d67/d7c/dae/f102 0 2024-09-17T04:21:24.588 INFO:tasks.workunit.client.0.smithi088.stdout:7/920: readlink d2/d4/d7/l83 0 2024-09-17T04:21:24.588 INFO:tasks.workunit.client.0.smithi088.stdout:1/950: chown d0/d1/df/d63/d91 790 1 2024-09-17T04:21:24.589 INFO:tasks.workunit.client.0.smithi088.stdout:7/921: chown d2/d4 28 1 2024-09-17T04:21:24.590 INFO:tasks.workunit.client.0.smithi088.stdout:9/997: dread d2/dd/d14/d8b/d43/d51/f9d [0,4194304] 0 2024-09-17T04:21:24.590 INFO:tasks.workunit.client.0.smithi088.stdout:1/951: chown d0/d1/d16/d2a/f9b 4212099 1 2024-09-17T04:21:24.610 INFO:tasks.workunit.client.0.smithi088.stdout:4/836: dread d5/d32/d6b/f86 [0,4194304] 0 2024-09-17T04:21:24.610 INFO:tasks.workunit.client.0.smithi088.stdout:7/922: dread d2/d1d/d2e/db0/f5a [0,4194304] 0 2024-09-17T04:21:24.624 INFO:tasks.workunit.client.0.smithi088.stdout:8/810: getdents d7/d29/d2a/d3a/d79 0 2024-09-17T04:21:24.624 INFO:tasks.workunit.client.0.smithi088.stdout:1/952: rmdir d0/d1/df/d63/d91 39 2024-09-17T04:21:24.625 INFO:tasks.workunit.client.0.smithi088.stdout:8/811: read d7/dd/d31/d47/d55/d57/f71 [3859258,129787] 0 2024-09-17T04:21:24.626 INFO:tasks.workunit.client.0.smithi088.stdout:9/998: creat d2/d2b/d2e/dbb/d104/d72/d136/f153 x:0 0 0 2024-09-17T04:21:24.627 INFO:tasks.workunit.client.0.smithi088.stdout:4/837: creat d5/d32/d6b/dd2/d109/f115 x:0 0 0 2024-09-17T04:21:24.628 INFO:tasks.workunit.client.0.smithi088.stdout:4/838: stat d5/d3f/d71/d8b 0 2024-09-17T04:21:24.629 INFO:tasks.workunit.client.0.smithi088.stdout:7/923: mkdir d2/d1d/d2e/db0/d23/d45/d6d/d120 0 2024-09-17T04:21:24.630 INFO:tasks.workunit.client.0.smithi088.stdout:0/725: mknod db/d1b/d36/d4a/dd3/df5/c103 0 2024-09-17T04:21:24.631 INFO:tasks.workunit.client.0.smithi088.stdout:0/726: dread - db/d1b/d36/d4a/d20/fca zero size 2024-09-17T04:21:24.632 INFO:tasks.workunit.client.0.smithi088.stdout:0/727: write db/d67/f99 [54477,92498] 0 2024-09-17T04:21:24.632 INFO:tasks.workunit.client.0.smithi088.stdout:1/953: creat d0/d1/df/d85/f12f x:0 0 0 2024-09-17T04:21:24.634 INFO:tasks.workunit.client.0.smithi088.stdout:1/954: dread d0/d1/d16/d35/fd8 [0,4194304] 0 2024-09-17T04:21:24.635 INFO:tasks.workunit.client.0.smithi088.stdout:8/812: symlink d7/dd/d31/d47/dc6/d104/l10f 0 2024-09-17T04:21:24.636 INFO:tasks.workunit.client.0.smithi088.stdout:4/839: creat d5/d32/d6b/dd2/f116 x:0 0 0 2024-09-17T04:21:24.637 INFO:tasks.workunit.client.0.smithi088.stdout:0/728: creat db/d1b/d36/d47/db9/dda/f104 x:0 0 0 2024-09-17T04:21:24.640 INFO:tasks.workunit.client.0.smithi088.stdout:8/813: creat d7/dd/d31/f110 x:0 0 0 2024-09-17T04:21:24.643 INFO:tasks.workunit.client.0.smithi088.stdout:0/729: creat db/d1b/d36/df9/d9f/f105 x:0 0 0 2024-09-17T04:21:24.644 INFO:tasks.workunit.client.0.smithi088.stdout:4/840: dread d5/d3f/d71/d8b/fe6 [0,4194304] 0 2024-09-17T04:21:24.644 INFO:tasks.workunit.client.0.smithi088.stdout:8/814: mkdir d7/d29/d2a/d38/d3d/d63/d97/d111 0 2024-09-17T04:21:24.645 INFO:tasks.workunit.client.0.smithi088.stdout:4/841: read d5/d3f/d71/d8b/d68/da4/d5e/f6a [975581,95763] 0 2024-09-17T04:21:24.646 INFO:tasks.workunit.client.0.smithi088.stdout:1/955: creat d0/d13/d84/f130 x:0 0 0 2024-09-17T04:21:24.649 INFO:tasks.workunit.client.0.smithi088.stdout:4/842: stat d5/d3f/c37 0 2024-09-17T04:21:24.650 INFO:tasks.workunit.client.0.smithi088.stdout:8/815: dwrite d7/d29/f2e [0,4194304] 0 2024-09-17T04:21:24.655 INFO:tasks.workunit.client.0.smithi088.stdout:8/816: mknod d7/dd/d31/dca/de6/c112 0 2024-09-17T04:21:24.657 INFO:tasks.workunit.client.0.smithi088.stdout:8/817: chown d7/d29/d2a/d3a/fc9 121 1 2024-09-17T04:21:24.657 INFO:tasks.workunit.client.0.smithi088.stdout:4/843: dwrite d5/d32/d6b/dd2/f116 [0,4194304] 0 2024-09-17T04:21:24.658 INFO:tasks.workunit.client.0.smithi088.stdout:8/818: stat d7/d29/d2a/d38/df8 0 2024-09-17T04:21:24.661 INFO:tasks.workunit.client.0.smithi088.stdout:1/956: getdents d0/d1/d16/d2a/d9c/dc8 0 2024-09-17T04:21:24.662 INFO:tasks.workunit.client.0.smithi088.stdout:4/844: dread - d5/d3f/d71/d8b/d68/da4/d5e/fe2 zero size 2024-09-17T04:21:24.664 INFO:tasks.workunit.client.0.smithi088.stdout:1/957: mknod d0/d1/df/dbe/d105/c131 0 2024-09-17T04:21:24.665 INFO:tasks.workunit.client.0.smithi088.stdout:4/845: rmdir d5/d3f/d71/d8b/d68 39 2024-09-17T04:21:24.666 INFO:tasks.workunit.client.0.smithi088.stdout:1/958: rmdir d0/d1/d27 39 2024-09-17T04:21:24.667 INFO:tasks.workunit.client.0.smithi088.stdout:4/846: symlink d5/d3f/d71/d8b/d75/l117 0 2024-09-17T04:21:24.670 INFO:tasks.workunit.client.0.smithi088.stdout:4/847: mkdir d5/d32/d6b/dd2/d109/d118 0 2024-09-17T04:21:24.673 INFO:tasks.workunit.client.0.smithi088.stdout:4/848: creat d5/d3d/f119 x:0 0 0 2024-09-17T04:21:24.674 INFO:tasks.workunit.client.0.smithi088.stdout:4/849: chown d5/d3f/d71/d99/lff 272685327 1 2024-09-17T04:21:24.676 INFO:tasks.workunit.client.0.smithi088.stdout:4/850: creat d5/d32/d6b/dd2/d109/d10c/f11a x:0 0 0 2024-09-17T04:21:24.677 INFO:tasks.workunit.client.0.smithi088.stdout:9/999: write d2/f7 [1940648,50541] 0 2024-09-17T04:21:24.679 INFO:tasks.workunit.client.0.smithi088.stdout:4/851: unlink d5/d32/d6b/dd2/ff5 0 2024-09-17T04:21:24.682 INFO:tasks.workunit.client.0.smithi088.stdout:4/852: getdents d5/d3f/d71/dd8 0 2024-09-17T04:21:24.684 INFO:tasks.workunit.client.0.smithi088.stdout:4/853: chown d5/d3f/d71/d8b/d68/da4/d5e/d83/f87 1 1 2024-09-17T04:21:24.685 INFO:tasks.workunit.client.0.smithi088.stdout:0/730: write db/fbb [870969,22398] 0 2024-09-17T04:21:24.692 INFO:tasks.workunit.client.0.smithi088.stdout:8/819: dwrite d7/dd/d31/f58 [0,4194304] 0 2024-09-17T04:21:24.697 INFO:tasks.workunit.client.0.smithi088.stdout:1/959: dread d0/d1/df/f3e [0,4194304] 0 2024-09-17T04:21:24.697 INFO:tasks.workunit.client.0.smithi088.stdout:4/854: chown d5/d3d/dee/l114 889655533 1 2024-09-17T04:21:24.701 INFO:tasks.workunit.client.0.smithi088.stdout:1/960: creat d0/d1/de7/d103/f132 x:0 0 0 2024-09-17T04:21:24.701 INFO:tasks.workunit.client.0.smithi088.stdout:8/820: dwrite d7/d29/d2a/f4a [0,4194304] 0 2024-09-17T04:21:24.705 INFO:tasks.workunit.client.0.smithi088.stdout:1/961: creat d0/d1/d16/dae/f133 x:0 0 0 2024-09-17T04:21:24.710 INFO:tasks.workunit.client.0.smithi088.stdout:0/731: dwrite db/d1b/d36/d4a/fb6 [0,4194304] 0 2024-09-17T04:21:24.711 INFO:tasks.workunit.client.0.smithi088.stdout:4/855: dread d5/d3f/d71/d8b/d68/fa5 [0,4194304] 0 2024-09-17T04:21:24.711 INFO:tasks.workunit.client.0.smithi088.stdout:8/821: fdatasync d7/dd/d31/d47/dc6/fd4 0 2024-09-17T04:21:24.711 INFO:tasks.workunit.client.0.smithi088.stdout:0/732: symlink db/d3c/l106 0 2024-09-17T04:21:24.711 INFO:tasks.workunit.client.0.smithi088.stdout:1/962: symlink d0/d1/d16/dae/l134 0 2024-09-17T04:21:24.713 INFO:tasks.workunit.client.0.smithi088.stdout:4/856: mkdir d5/d32/d6b/d11b 0 2024-09-17T04:21:24.719 INFO:tasks.workunit.client.0.smithi088.stdout:0/733: dwrite db/d1b/d36/d47/db9/dda/f104 [0,4194304] 0 2024-09-17T04:21:24.723 INFO:tasks.workunit.client.0.smithi088.stdout:4/857: rmdir d5/d3f/d71/d8b/d75/dd0 39 2024-09-17T04:21:24.726 INFO:tasks.workunit.client.0.smithi088.stdout:0/734: fsync db/d1b/d36/d4a/d20/fa3 0 2024-09-17T04:21:24.727 INFO:tasks.workunit.client.0.smithi088.stdout:1/963: dwrite d0/f4 [4194304,4194304] 0 2024-09-17T04:21:24.728 INFO:tasks.workunit.client.0.smithi088.stdout:0/735: dread - db/d67/de2/ff6 zero size 2024-09-17T04:21:24.729 INFO:tasks.workunit.client.0.smithi088.stdout:8/822: write d7/d29/d2a/d38/d42/f5b [4087874,5772] 0 2024-09-17T04:21:24.732 INFO:tasks.workunit.client.0.smithi088.stdout:1/964: write d0/d1/d27/f104 [1046883,117206] 0 2024-09-17T04:21:24.736 INFO:tasks.workunit.client.0.smithi088.stdout:4/858: dwrite d5/d32/d6b/dd2/f116 [4194304,4194304] 0 2024-09-17T04:21:24.737 INFO:tasks.workunit.client.0.smithi088.stdout:4/859: truncate d5/d3f/fdb 331676 0 2024-09-17T04:21:24.738 INFO:tasks.workunit.client.0.smithi088.stdout:1/965: symlink d0/d1/df/d85/da3/df6/ded/l135 0 2024-09-17T04:21:24.742 INFO:tasks.workunit.client.0.smithi088.stdout:4/860: chown d5/d3f/d71/dd8/fda 1 1 2024-09-17T04:21:24.743 INFO:tasks.workunit.client.0.smithi088.stdout:0/736: creat db/d1b/d36/f107 x:0 0 0 2024-09-17T04:21:24.744 INFO:tasks.workunit.client.0.smithi088.stdout:4/861: chown d5/d3f/d71/d99/fe0 2085895 1 2024-09-17T04:21:24.748 INFO:tasks.workunit.client.0.smithi088.stdout:0/737: symlink db/d1b/l108 0 2024-09-17T04:21:24.752 INFO:tasks.workunit.client.0.smithi088.stdout:8/823: dwrite f6 [0,4194304] 0 2024-09-17T04:21:24.755 INFO:tasks.workunit.client.0.smithi088.stdout:0/738: unlink db/d1b/d36/d4a/d6a/lfa 0 2024-09-17T04:21:24.756 INFO:tasks.workunit.client.0.smithi088.stdout:0/739: dread - db/d1b/d36/df9/d59/f65 zero size 2024-09-17T04:21:24.757 INFO:tasks.workunit.client.0.smithi088.stdout:8/824: creat d7/d29/d2a/d38/d3d/d63/d97/f113 x:0 0 0 2024-09-17T04:21:24.760 INFO:tasks.workunit.client.0.smithi088.stdout:4/862: dread d5/d3f/d71/dd8/fda [0,4194304] 0 2024-09-17T04:21:24.760 INFO:tasks.workunit.client.0.smithi088.stdout:8/825: mknod d7/d29/d2a/d38/d3d/da0/da8/c114 0 2024-09-17T04:21:24.762 INFO:tasks.workunit.client.0.smithi088.stdout:4/863: unlink d5/d3f/d71/d8b/c66 0 2024-09-17T04:21:24.763 INFO:tasks.workunit.client.0.smithi088.stdout:1/966: dread d0/d1/de7/fea [0,4194304] 0 2024-09-17T04:21:24.764 INFO:tasks.workunit.client.0.smithi088.stdout:8/826: dread - d7/d29/d2a/d38/d3d/da0/da8/fe8 zero size 2024-09-17T04:21:24.764 INFO:tasks.workunit.client.0.smithi088.stdout:4/864: dread - d5/d32/d6b/dd2/d109/f112 zero size 2024-09-17T04:21:24.766 INFO:tasks.workunit.client.0.smithi088.stdout:1/967: creat d0/d1/df/d85/da3/df6/ded/f136 x:0 0 0 2024-09-17T04:21:24.828 INFO:tasks.workunit.client.0.smithi088.stdout:4/865: creat d5/d3f/d71/d8b/d75/f11c x:0 0 0 2024-09-17T04:21:24.858 INFO:tasks.workunit.client.0.smithi088.stdout:4/866: creat d5/d3f/d71/d8b/d68/dab/f11d x:0 0 0 2024-09-17T04:21:24.862 INFO:tasks.workunit.client.0.smithi088.stdout:4/867: mkdir d5/d11e 0 2024-09-17T04:21:24.864 INFO:tasks.workunit.client.0.smithi088.stdout:4/868: unlink d5/d3f/d71/d8b/d68/dab/dbb/f103 0 2024-09-17T04:21:24.866 INFO:tasks.workunit.client.0.smithi088.stdout:1/968: write d0/de3/fc9 [249303,38007] 0 2024-09-17T04:21:24.871 INFO:tasks.workunit.client.0.smithi088.stdout:1/969: dread d0/d1/df/d63/f76 [0,4194304] 0 2024-09-17T04:21:24.872 INFO:tasks.workunit.client.0.smithi088.stdout:8/827: dwrite d7/dd/d31/d47/d55/fdf [0,4194304] 0 2024-09-17T04:21:24.874 INFO:tasks.workunit.client.0.smithi088.stdout:8/828: fsync d7/d29/d2a/d38/d42/f5b 0 2024-09-17T04:21:24.877 INFO:tasks.workunit.client.0.smithi088.stdout:8/829: creat d7/d7f/f115 x:0 0 0 2024-09-17T04:21:24.878 INFO:tasks.workunit.client.0.smithi088.stdout:1/970: dwrite d0/d1/d16/dae/f133 [0,4194304] 0 2024-09-17T04:21:24.886 INFO:tasks.workunit.client.0.smithi088.stdout:1/971: dwrite d0/d1/d16/dae/f133 [0,4194304] 0 2024-09-17T04:21:24.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:24 smithi088 ceph-mon[27811]: pgmap v33: 65 pgs: 65 active+clean; 3.2 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 49 MiB/s rd, 100 MiB/s wr, 289 op/s 2024-09-17T04:21:24.888 INFO:tasks.workunit.client.0.smithi088.stdout:1/972: rmdir d0/d1/df 39 2024-09-17T04:21:24.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:24 smithi134 ceph-mon[35201]: pgmap v33: 65 pgs: 65 active+clean; 3.2 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 49 MiB/s rd, 100 MiB/s wr, 289 op/s 2024-09-17T04:21:24.896 INFO:tasks.workunit.client.0.smithi088.stdout:1/973: dwrite d0/d1/df/d20/f49 [0,4194304] 0 2024-09-17T04:21:24.901 INFO:tasks.workunit.client.0.smithi088.stdout:1/974: fdatasync d0/d1/df/d20/dbd/fca 0 2024-09-17T04:21:24.907 INFO:tasks.workunit.client.0.smithi088.stdout:1/975: dwrite d0/d1/d16/d2a/f79 [0,4194304] 0 2024-09-17T04:21:24.908 INFO:tasks.workunit.client.0.smithi088.stdout:1/976: chown d0/d13/f1b 5272307 1 2024-09-17T04:21:24.909 INFO:tasks.workunit.client.0.smithi088.stdout:1/977: stat d0/d13/d84/dcd 0 2024-09-17T04:21:24.912 INFO:tasks.workunit.client.0.smithi088.stdout:1/978: truncate d0/d1/d16/d2a/d9c/dc8/f116 743380 0 2024-09-17T04:21:24.914 INFO:tasks.workunit.client.0.smithi088.stdout:1/979: truncate d0/d1/d16/d35/f50 840944 0 2024-09-17T04:21:24.917 INFO:tasks.workunit.client.0.smithi088.stdout:1/980: symlink d0/d1/df/d20/dbd/l137 0 2024-09-17T04:21:24.922 INFO:tasks.workunit.client.0.smithi088.stdout:1/981: link d0/d13/d84/d5d/f72 d0/d1/df/d85/da3/df6/daa/d5b/d87/f138 0 2024-09-17T04:21:25.326 INFO:tasks.workunit.client.0.smithi088.stdout:7/924: sync 2024-09-17T04:21:25.327 INFO:tasks.workunit.client.0.smithi088.stdout:5/821: sync 2024-09-17T04:21:25.330 INFO:tasks.workunit.client.0.smithi088.stdout:5/822: truncate d2/d31/d33/d20/d30/d51/d5e/d6b/f95 737386 0 2024-09-17T04:21:25.332 INFO:tasks.workunit.client.0.smithi088.stdout:7/925: symlink d2/d4/d7/d46/d67/de8/l121 0 2024-09-17T04:21:25.338 INFO:tasks.workunit.client.0.smithi088.stdout:5/823: link d2/d31/d33/d20/d47/f87 d2/da9/db8/f10d 0 2024-09-17T04:21:25.340 INFO:tasks.workunit.client.0.smithi088.stdout:7/926: link d2/d1d/d2e/db0/d23/d97/dbb/ce4 d2/d4/d7/d46/da3/dd1/c122 0 2024-09-17T04:21:25.341 INFO:tasks.workunit.client.0.smithi088.stdout:7/927: dread - d2/d4/d7/d20/f90 zero size 2024-09-17T04:21:25.344 INFO:tasks.workunit.client.0.smithi088.stdout:5/824: rename d2/d31/d33/d20/d30/d51/d5e/d6b/db5 to d2/d31/d33/d20/d25/d2c/d8a/db2/dc3/d10e 0 2024-09-17T04:21:25.347 INFO:tasks.workunit.client.0.smithi088.stdout:5/825: truncate d2/d31/d33/d20/d25/d49/f8d 205785 0 2024-09-17T04:21:25.351 INFO:tasks.workunit.client.0.smithi088.stdout:5/826: creat d2/d31/d33/d20/dd9/f10f x:0 0 0 2024-09-17T04:21:25.357 INFO:tasks.workunit.client.0.smithi088.stdout:5/827: mkdir d2/d110 0 2024-09-17T04:21:25.363 INFO:tasks.workunit.client.0.smithi088.stdout:7/928: dwrite d2/d4/f18 [0,4194304] 0 2024-09-17T04:21:25.365 INFO:tasks.workunit.client.0.smithi088.stdout:5/828: write d2/d31/d33/d20/d47/f85 [3045015,62900] 0 2024-09-17T04:21:25.367 INFO:tasks.workunit.client.0.smithi088.stdout:7/929: unlink d2/cb 0 2024-09-17T04:21:25.373 INFO:tasks.workunit.client.0.smithi088.stdout:5/829: link d2/d31/d33/d20/d30/d51/d5e/d6b/f99 d2/d31/d33/d20/d30/d9f/da4/d10c/f111 0 2024-09-17T04:21:25.374 INFO:tasks.workunit.client.0.smithi088.stdout:7/930: rename d2/d96/dc2/fca to d2/d4/d7/d46/f123 0 2024-09-17T04:21:25.376 INFO:tasks.workunit.client.0.smithi088.stdout:5/830: rename d2/d31/d33/d20/d25/f57 to d2/d31/d33/d20/d30/dea/f112 0 2024-09-17T04:21:25.377 INFO:tasks.workunit.client.0.smithi088.stdout:7/931: rmdir d2/d96/db9 39 2024-09-17T04:21:25.379 INFO:tasks.workunit.client.0.smithi088.stdout:7/932: mkdir d2/d79/db3/d124 0 2024-09-17T04:21:25.380 INFO:tasks.workunit.client.0.smithi088.stdout:7/933: fsync d2/d79/f115 0 2024-09-17T04:21:25.381 INFO:tasks.workunit.client.0.smithi088.stdout:5/831: dread d2/d31/d33/d20/d8b/fab [0,4194304] 0 2024-09-17T04:21:25.382 INFO:tasks.workunit.client.0.smithi088.stdout:7/934: symlink d2/d4/d7/d46/da3/dd1/l125 0 2024-09-17T04:21:25.384 INFO:tasks.workunit.client.0.smithi088.stdout:5/832: creat d2/d31/d33/d20/d30/d9f/da4/dbe/f113 x:0 0 0 2024-09-17T04:21:25.386 INFO:tasks.workunit.client.0.smithi088.stdout:5/833: creat d2/d31/d33/d20/d47/de0/f114 x:0 0 0 2024-09-17T04:21:25.388 INFO:tasks.workunit.client.0.smithi088.stdout:5/834: mknod d2/d31/d33/d20/d25/d49/c115 0 2024-09-17T04:21:25.394 INFO:tasks.workunit.client.0.smithi088.stdout:4/869: sync 2024-09-17T04:21:25.395 INFO:tasks.workunit.client.0.smithi088.stdout:0/740: sync 2024-09-17T04:21:25.395 INFO:tasks.workunit.client.0.smithi088.stdout:1/982: sync 2024-09-17T04:21:25.395 INFO:tasks.workunit.client.0.smithi088.stdout:8/830: sync 2024-09-17T04:21:25.396 INFO:tasks.workunit.client.0.smithi088.stdout:5/835: dwrite d2/d31/d33/d20/d25/d2c/f72 [4194304,4194304] 0 2024-09-17T04:21:25.401 INFO:tasks.workunit.client.0.smithi088.stdout:7/935: dread d2/fb4 [0,4194304] 0 2024-09-17T04:21:25.406 INFO:tasks.workunit.client.0.smithi088.stdout:0/741: dwrite db/d1b/d39/f3a [4194304,4194304] 0 2024-09-17T04:21:25.408 INFO:tasks.workunit.client.0.smithi088.stdout:5/836: dwrite d2/d31/d33/d20/d25/d49/f5f [0,4194304] 0 2024-09-17T04:21:25.413 INFO:tasks.workunit.client.0.smithi088.stdout:5/837: creat d2/f116 x:0 0 0 2024-09-17T04:21:25.414 INFO:tasks.workunit.client.0.smithi088.stdout:5/838: chown d2/d31/d33/d20/d25/d49/f60 757797 1 2024-09-17T04:21:25.422 INFO:tasks.workunit.client.0.smithi088.stdout:5/839: dwrite d2/d31/d33/d20/d30/d51/d5e/d6b/f75 [0,4194304] 0 2024-09-17T04:21:25.424 INFO:tasks.workunit.client.0.smithi088.stdout:8/831: dread d7/dd/d31/dca/de6/ff1 [4194304,4194304] 0 2024-09-17T04:21:25.427 INFO:tasks.workunit.client.0.smithi088.stdout:0/742: dread db/d1b/d36/d4a/f40 [0,4194304] 0 2024-09-17T04:21:25.428 INFO:tasks.workunit.client.0.smithi088.stdout:0/743: stat db/d1b/d36/d4a/d6a/cbf 0 2024-09-17T04:21:25.436 INFO:tasks.workunit.client.0.smithi088.stdout:1/983: dread d0/d1/df/d63/ff7 [0,4194304] 0 2024-09-17T04:21:25.436 INFO:tasks.workunit.client.0.smithi088.stdout:1/984: chown d0/d1/d16/d2a/d9c 12184762 1 2024-09-17T04:21:25.453 INFO:tasks.workunit.client.0.smithi088.stdout:0/744: symlink db/d67/d7c/l109 0 2024-09-17T04:21:25.453 INFO:tasks.workunit.client.0.smithi088.stdout:1/985: mknod d0/d1/df/d85/c139 0 2024-09-17T04:21:25.453 INFO:tasks.workunit.client.0.smithi088.stdout:0/745: creat db/d1b/d36/d4a/d20/f10a x:0 0 0 2024-09-17T04:21:25.455 INFO:tasks.workunit.client.0.smithi088.stdout:1/986: dread d0/d1/d16/d2a/f79 [0,4194304] 0 2024-09-17T04:21:25.459 INFO:tasks.workunit.client.0.smithi088.stdout:5/840: getdents d2/d31/d33 0 2024-09-17T04:21:25.460 INFO:tasks.workunit.client.0.smithi088.stdout:1/987: symlink d0/d13/d84/l13a 0 2024-09-17T04:21:25.460 INFO:tasks.workunit.client.0.smithi088.stdout:4/870: write d5/d3f/d71/d8b/d68/fb9 [494653,76000] 0 2024-09-17T04:21:25.464 INFO:tasks.workunit.client.0.smithi088.stdout:1/988: read - d0/d1/d16/d35/ff2 zero size 2024-09-17T04:21:25.466 INFO:tasks.workunit.client.0.smithi088.stdout:5/841: mkdir d2/d105/d117 0 2024-09-17T04:21:25.470 INFO:tasks.workunit.client.0.smithi088.stdout:4/871: creat d5/d3f/d71/d8b/d68/da4/d5e/d83/f11f x:0 0 0 2024-09-17T04:21:25.473 INFO:tasks.workunit.client.0.smithi088.stdout:0/746: dread db/d1b/d36/df9/f75 [0,4194304] 0 2024-09-17T04:21:25.479 INFO:tasks.workunit.client.0.smithi088.stdout:0/747: stat db/f13 0 2024-09-17T04:21:25.481 INFO:tasks.workunit.client.0.smithi088.stdout:5/842: dread d2/f10 [0,4194304] 0 2024-09-17T04:21:25.486 INFO:tasks.workunit.client.0.smithi088.stdout:1/989: getdents d0/d1/df/dbe/d105 0 2024-09-17T04:21:25.489 INFO:tasks.workunit.client.0.smithi088.stdout:0/748: mknod db/d1b/d36/d47/db9/c10b 0 2024-09-17T04:21:25.495 INFO:tasks.workunit.client.0.smithi088.stdout:0/749: stat db/c21 0 2024-09-17T04:21:25.496 INFO:tasks.workunit.client.0.smithi088.stdout:0/750: dread - db/d1b/d36/f107 zero size 2024-09-17T04:21:25.506 INFO:tasks.workunit.client.0.smithi088.stdout:8/832: dread d7/d29/d2a/d3a/f3e [0,4194304] 0 2024-09-17T04:21:25.506 INFO:tasks.workunit.client.0.smithi088.stdout:8/833: read - d7/d29/daa/ff5 zero size 2024-09-17T04:21:25.507 INFO:tasks.workunit.client.0.smithi088.stdout:8/834: chown f6 6869460 1 2024-09-17T04:21:25.511 INFO:tasks.workunit.client.0.smithi088.stdout:8/835: mkdir d7/d29/d2a/d38/d3d/d63/db2/d116 0 2024-09-17T04:21:25.513 INFO:tasks.workunit.client.0.smithi088.stdout:8/836: mkdir d7/d29/d2a/d38/d42/d117 0 2024-09-17T04:21:25.514 INFO:tasks.workunit.client.0.smithi088.stdout:8/837: rmdir d7/d29/d2a/d3a 39 2024-09-17T04:21:25.517 INFO:tasks.workunit.client.0.smithi088.stdout:8/838: fdatasync d7/d29/d2a/d38/d3d/d63/fee 0 2024-09-17T04:21:25.537 INFO:tasks.workunit.client.0.smithi088.stdout:8/839: dread d7/fbc [0,4194304] 0 2024-09-17T04:21:25.540 INFO:tasks.workunit.client.0.smithi088.stdout:8/840: creat d7/d29/d2a/d38/d3d/d63/f118 x:0 0 0 2024-09-17T04:21:25.541 INFO:tasks.workunit.client.0.smithi088.stdout:4/872: truncate d5/d32/f57 4081447 0 2024-09-17T04:21:25.545 INFO:tasks.workunit.client.0.smithi088.stdout:4/873: symlink d5/d3f/d71/d8b/d68/l120 0 2024-09-17T04:21:25.545 INFO:tasks.workunit.client.0.smithi088.stdout:4/874: dread - d5/d3f/d71/f10e zero size 2024-09-17T04:21:25.549 INFO:tasks.workunit.client.0.smithi088.stdout:5/843: write d2/d31/d33/d20/d30/f7b [1073808,11781] 0 2024-09-17T04:21:25.550 INFO:tasks.workunit.client.0.smithi088.stdout:5/844: chown d2/d31/d33/d20/d30/f7b 21 1 2024-09-17T04:21:25.551 INFO:tasks.workunit.client.0.smithi088.stdout:4/875: link d5/d3f/d71/d8b/d68/da4/d5e/d83/f10d d5/d3d/dee/f121 0 2024-09-17T04:21:25.555 INFO:tasks.workunit.client.0.smithi088.stdout:0/751: write db/d1b/d36/d4a/d20/f7a [230297,124933] 0 2024-09-17T04:21:25.556 INFO:tasks.workunit.client.0.smithi088.stdout:5/845: link d2/d31/d33/d20/d25/l43 d2/d31/d33/d20/d25/d2c/df0/l118 0 2024-09-17T04:21:25.556 INFO:tasks.workunit.client.0.smithi088.stdout:0/752: write db/d67/f99 [1710725,79747] 0 2024-09-17T04:21:25.558 INFO:tasks.workunit.client.0.smithi088.stdout:0/753: write db/f6d [581643,9124] 0 2024-09-17T04:21:25.558 INFO:tasks.workunit.client.0.smithi088.stdout:0/754: chown db/f6d 312237349 1 2024-09-17T04:21:25.563 INFO:tasks.workunit.client.0.smithi088.stdout:8/841: mkdir d7/d29/d119 0 2024-09-17T04:21:25.565 INFO:tasks.workunit.client.0.smithi088.stdout:5/846: dread d2/d31/d33/d20/d30/d51/d5e/d6b/f99 [0,4194304] 0 2024-09-17T04:21:25.566 INFO:tasks.workunit.client.0.smithi088.stdout:0/755: symlink db/d1b/d36/d4a/l10c 0 2024-09-17T04:21:25.567 INFO:tasks.workunit.client.0.smithi088.stdout:8/842: unlink d7/d29/d2a/d38/la7 0 2024-09-17T04:21:25.573 INFO:tasks.workunit.client.0.smithi088.stdout:5/847: symlink d2/d31/d33/d20/l119 0 2024-09-17T04:21:25.574 INFO:tasks.workunit.client.0.smithi088.stdout:5/848: stat d2/d31/d33/d20/d30/d51/d5e/d6b/fa0 0 2024-09-17T04:21:25.581 INFO:tasks.workunit.client.0.smithi088.stdout:5/849: dwrite d2/d31/d33/d20/d25/d49/f60 [0,4194304] 0 2024-09-17T04:21:25.582 INFO:tasks.workunit.client.0.smithi088.stdout:1/990: rename d0/d1/df/dbe to d0/d1/d16/d35/d13b 0 2024-09-17T04:21:25.583 INFO:tasks.workunit.client.0.smithi088.stdout:5/850: readlink d2/d31/d33/d20/d47/de0/da5/lc1 0 2024-09-17T04:21:25.585 INFO:tasks.workunit.client.0.smithi088.stdout:0/756: dread db/f4d [0,4194304] 0 2024-09-17T04:21:25.586 INFO:tasks.workunit.client.0.smithi088.stdout:0/757: write db/d67/d7c/fb0 [800238,92239] 0 2024-09-17T04:21:25.599 INFO:tasks.workunit.client.0.smithi088.stdout:4/876: rename d5/d3f/d71/d8b/d75 to d5/d32/d6b/dd2/d109/d118/d122 0 2024-09-17T04:21:25.614 INFO:tasks.workunit.client.0.smithi088.stdout:8/843: write d7/d29/d2a/d3a/fe3 [1483122,114933] 0 2024-09-17T04:21:25.636 INFO:tasks.workunit.client.0.smithi088.stdout:1/991: creat d0/d1/d16/d2a/d9c/f13c x:0 0 0 2024-09-17T04:21:25.637 INFO:tasks.workunit.client.0.smithi088.stdout:5/851: rename d2/d31/d33/d20/d47/de0/f107 to d2/d31/d33/d20/d47/dfe/f11a 0 2024-09-17T04:21:25.640 INFO:tasks.workunit.client.0.smithi088.stdout:4/877: creat d5/d3f/d71/dd8/f123 x:0 0 0 2024-09-17T04:21:25.640 INFO:tasks.workunit.client.0.smithi088.stdout:4/878: chown d5/d32/c3c 90738764 1 2024-09-17T04:21:25.641 INFO:tasks.workunit.client.0.smithi088.stdout:8/844: unlink d7/dd/d31/d47/d55/fad 0 2024-09-17T04:21:25.641 INFO:tasks.workunit.client.0.smithi088.stdout:4/879: stat d5/d3f/d71/d8b/d68/dab/f11d 0 2024-09-17T04:21:25.642 INFO:tasks.workunit.client.0.smithi088.stdout:4/880: chown d5/d32/c34 53247 1 2024-09-17T04:21:25.643 INFO:tasks.workunit.client.0.smithi088.stdout:4/881: chown d5/d3f/d71/d8b/d68/dab/dbb/lbd 60213 1 2024-09-17T04:21:25.643 INFO:tasks.workunit.client.0.smithi088.stdout:4/882: readlink d5/l1c 0 2024-09-17T04:21:25.644 INFO:tasks.workunit.client.0.smithi088.stdout:7/936: sync 2024-09-17T04:21:25.644 INFO:tasks.workunit.client.0.smithi088.stdout:1/992: creat d0/d1/d16/d35/dc5/f13d x:0 0 0 2024-09-17T04:21:25.645 INFO:tasks.workunit.client.0.smithi088.stdout:7/937: stat d2/d1d/d2e/db0/f5a 0 2024-09-17T04:21:25.645 INFO:tasks.workunit.client.0.smithi088.stdout:0/758: rename db/d1b/d36/d47/l46 to db/d1b/d36/df9/d66/l10d 0 2024-09-17T04:21:25.647 INFO:tasks.workunit.client.0.smithi088.stdout:5/852: mkdir d2/d31/d33/d20/d47/de0/da5/d11b 0 2024-09-17T04:21:25.648 INFO:tasks.workunit.client.0.smithi088.stdout:8/845: symlink d7/d10d/l11a 0 2024-09-17T04:21:25.648 INFO:tasks.workunit.client.0.smithi088.stdout:5/853: chown d2/d31/d33/d20/d25/d2c/d8a/dc6/ff9 2106282394 1 2024-09-17T04:21:25.649 INFO:tasks.workunit.client.0.smithi088.stdout:4/883: unlink d5/d72/lce 0 2024-09-17T04:21:25.650 INFO:tasks.workunit.client.0.smithi088.stdout:5/854: dread - d2/d31/d33/d20/d25/d2c/d8a/db2/dfc/f109 zero size 2024-09-17T04:21:25.650 INFO:tasks.workunit.client.0.smithi088.stdout:1/993: mkdir d0/d1/df/d85/da3/df6/daa/d13e 0 2024-09-17T04:21:25.656 INFO:tasks.workunit.client.0.smithi088.stdout:7/938: symlink d2/d1d/d2e/db0/d23/d97/dbb/dcf/d11b/d11e/l126 0 2024-09-17T04:21:25.657 INFO:tasks.workunit.client.0.smithi088.stdout:8/846: creat d7/dd/d31/d47/dc6/d104/f11b x:0 0 0 2024-09-17T04:21:25.657 INFO:tasks.workunit.client.0.smithi088.stdout:4/884: creat d5/d3f/d71/d8b/d68/dab/dbb/f124 x:0 0 0 2024-09-17T04:21:25.657 INFO:tasks.workunit.client.0.smithi088.stdout:5/855: dwrite d2/d31/d33/d20/d25/fc0 [0,4194304] 0 2024-09-17T04:21:25.658 INFO:tasks.workunit.client.0.smithi088.stdout:7/939: chown d2/d1d/d2e/db0/d23/d97/dbb/dcf/d11b/d11e/c102 14084489 1 2024-09-17T04:21:25.658 INFO:tasks.workunit.client.0.smithi088.stdout:0/759: fsync db/d1b/d36/d4a/fff 0 2024-09-17T04:21:25.661 INFO:tasks.workunit.client.0.smithi088.stdout:1/994: link d0/d1/df/d85/da3/df6/daa/d5b/d128/f10a d0/d1/df/d85/da3/f13f 0 2024-09-17T04:21:25.662 INFO:tasks.workunit.client.0.smithi088.stdout:8/847: read d7/d29/d2a/d75/f7a [2285732,92204] 0 2024-09-17T04:21:25.662 INFO:tasks.workunit.client.0.smithi088.stdout:7/940: truncate d2/d79/db3/f11a 696626 0 2024-09-17T04:21:25.662 INFO:tasks.workunit.client.0.smithi088.stdout:4/885: read d5/d3f/d71/d8b/d68/da4/d5e/d83/fbc [705930,56319] 0 2024-09-17T04:21:25.664 INFO:tasks.workunit.client.0.smithi088.stdout:5/856: truncate d2/d31/d33/d20/d47/de0/f114 166217 0 2024-09-17T04:21:25.665 INFO:tasks.workunit.client.0.smithi088.stdout:0/760: chown db/d1b/d36/d4a/d20/cef 1 1 2024-09-17T04:21:25.668 INFO:tasks.workunit.client.0.smithi088.stdout:8/848: creat d7/dd/d31/d47/dc6/f11c x:0 0 0 2024-09-17T04:21:25.671 INFO:tasks.workunit.client.0.smithi088.stdout:7/941: creat d2/d4/d7/d46/d67/dd6/f127 x:0 0 0 2024-09-17T04:21:25.671 INFO:tasks.workunit.client.0.smithi088.stdout:0/761: truncate db/d1b/d36/df9/d9f/fd4 4275473 0 2024-09-17T04:21:25.675 INFO:tasks.workunit.client.0.smithi088.stdout:5/857: unlink d2/d31/d33/d20/d30/fb9 0 2024-09-17T04:21:25.675 INFO:tasks.workunit.client.0.smithi088.stdout:7/942: readlink d2/d4/d7/d46/da3/lbf 0 2024-09-17T04:21:25.675 INFO:tasks.workunit.client.0.smithi088.stdout:1/995: dwrite d0/d1/df/d85/da3/df6/daa/d5b/f82 [0,4194304] 0 2024-09-17T04:21:25.675 INFO:tasks.workunit.client.0.smithi088.stdout:4/886: dwrite d5/d3f/fdb [0,4194304] 0 2024-09-17T04:21:25.683 INFO:tasks.workunit.client.0.smithi088.stdout:4/887: chown d5/d32/c4c 10613847 1 2024-09-17T04:21:25.684 INFO:tasks.workunit.client.0.smithi088.stdout:4/888: chown d5/f1a 189157032 1 2024-09-17T04:21:25.686 INFO:tasks.workunit.client.0.smithi088.stdout:5/858: chown d2/d31/d33/d20/l35 174696 1 2024-09-17T04:21:25.686 INFO:tasks.workunit.client.0.smithi088.stdout:0/762: dread db/d67/f99 [0,4194304] 0 2024-09-17T04:21:25.686 INFO:tasks.workunit.client.0.smithi088.stdout:1/996: dread - d0/d1/df/d63/fff zero size 2024-09-17T04:21:25.690 INFO:tasks.workunit.client.0.smithi088.stdout:7/943: rename d2/d1d/d2e/db0/d23/d45/d62/c7c to d2/d1d/d2e/db0/d23/d45/d62/d82/c128 0 2024-09-17T04:21:25.692 INFO:tasks.workunit.client.0.smithi088.stdout:0/763: rmdir db/d1b/d39 39 2024-09-17T04:21:25.694 INFO:tasks.workunit.client.0.smithi088.stdout:1/997: rename d0/d1/df/d85/da3/df6/d9e/fdc to d0/d1/df/d20/ddf/f140 0 2024-09-17T04:21:25.702 INFO:tasks.workunit.client.0.smithi088.stdout:5/859: creat d2/d31/d33/d20/d30/d51/f11c x:0 0 0 2024-09-17T04:21:25.706 INFO:tasks.workunit.client.0.smithi088.stdout:1/998: creat d0/d1/df/d20/dbd/d12c/f141 x:0 0 0 2024-09-17T04:21:25.707 INFO:tasks.workunit.client.0.smithi088.stdout:0/764: creat db/d1b/f10e x:0 0 0 2024-09-17T04:21:25.708 INFO:tasks.workunit.client.0.smithi088.stdout:0/765: write db/d1b/d36/f107 [786037,46583] 0 2024-09-17T04:21:25.709 INFO:tasks.workunit.client.0.smithi088.stdout:5/860: mkdir d2/d31/d33/d20/d25/d2c/d8a/db2/d11d 0 2024-09-17T04:21:25.709 INFO:tasks.workunit.client.0.smithi088.stdout:0/766: chown db/d1b/d36/df9/c94 60388 1 2024-09-17T04:21:25.712 INFO:tasks.workunit.client.0.smithi088.stdout:1/999: mknod d0/d1/df/d20/dbd/c142 0 2024-09-17T04:21:25.718 INFO:tasks.workunit.client.0.smithi088.stdout:0/767: dwrite db/d67/de2/ff6 [0,4194304] 0 2024-09-17T04:21:25.719 INFO:tasks.workunit.client.0.smithi088.stdout:5/861: dwrite d2/d31/d33/d20/d30/d51/d5e/f78 [0,4194304] 0 2024-09-17T04:21:25.723 INFO:tasks.workunit.client.0.smithi088.stdout:0/768: fdatasync db/d1b/d36/d4a/d6a/f74 0 2024-09-17T04:21:25.725 INFO:tasks.workunit.client.0.smithi088.stdout:0/769: write db/d1b/d36/df9/d59/ff1 [963891,92961] 0 2024-09-17T04:21:25.728 INFO:tasks.workunit.client.0.smithi088.stdout:5/862: rename d2/d31/d33/d20/d30/d51/d5e/d6b/f75 to d2/d31/d33/d20/d25/d2c/d8a/dc6/f11e 0 2024-09-17T04:21:25.728 INFO:tasks.workunit.client.0.smithi088.stdout:8/849: write d7/f51 [819740,36290] 0 2024-09-17T04:21:25.733 INFO:tasks.workunit.client.0.smithi088.stdout:0/770: getdents db/d1b/d39/de5/ded 0 2024-09-17T04:21:25.735 INFO:tasks.workunit.client.0.smithi088.stdout:8/850: truncate d7/dd/d6f/fda 93717 0 2024-09-17T04:21:25.735 INFO:tasks.workunit.client.0.smithi088.stdout:5/863: dread d2/d31/f67 [0,4194304] 0 2024-09-17T04:21:25.737 INFO:tasks.workunit.client.0.smithi088.stdout:4/889: write d5/d32/d6b/f7b [1273541,71558] 0 2024-09-17T04:21:25.745 INFO:tasks.workunit.client.0.smithi088.stdout:7/944: dwrite d2/d1d/d2e/db0/f24 [0,4194304] 0 2024-09-17T04:21:25.747 INFO:tasks.workunit.client.0.smithi088.stdout:0/771: creat db/d1b/d36/d4a/f10f x:0 0 0 2024-09-17T04:21:25.749 INFO:tasks.workunit.client.0.smithi088.stdout:5/864: mkdir d2/d31/d33/d20/d30/d9f/d11f 0 2024-09-17T04:21:25.755 INFO:tasks.workunit.client.0.smithi088.stdout:7/945: stat d2/d4/f28 0 2024-09-17T04:21:25.759 INFO:tasks.workunit.client.0.smithi088.stdout:0/772: readlink db/d1b/d36/d47/lb8 0 2024-09-17T04:21:25.766 INFO:tasks.workunit.client.0.smithi088.stdout:0/773: truncate db/d1b/d36/df9/d59/f65 569913 0 2024-09-17T04:21:25.767 INFO:tasks.workunit.client.0.smithi088.stdout:8/851: dwrite d7/dd/d31/d47/d55/f61 [0,4194304] 0 2024-09-17T04:21:25.770 INFO:tasks.workunit.client.0.smithi088.stdout:0/774: chown db/db2/dc0/f9b 498 1 2024-09-17T04:21:25.770 INFO:tasks.workunit.client.0.smithi088.stdout:5/865: write d2/d31/d33/d20/d47/fc4 [1252682,120409] 0 2024-09-17T04:21:25.771 INFO:tasks.workunit.client.0.smithi088.stdout:0/775: write db/d1b/d36/df9/d59/ff1 [1956710,24914] 0 2024-09-17T04:21:25.775 INFO:tasks.workunit.client.0.smithi088.stdout:7/946: write d2/d1d/d2e/db0/d23/d97/dbb/dcf/fde [1988422,95113] 0 2024-09-17T04:21:25.775 INFO:tasks.workunit.client.0.smithi088.stdout:5/866: dread - d2/d31/d33/d20/f101 zero size 2024-09-17T04:21:25.776 INFO:tasks.workunit.client.0.smithi088.stdout:8/852: write d7/dd/d31/d47/d55/d57/f84 [546676,45496] 0 2024-09-17T04:21:25.779 INFO:tasks.workunit.client.0.smithi088.stdout:0/776: dread db/d1b/d36/df9/d59/ff1 [0,4194304] 0 2024-09-17T04:21:25.780 INFO:tasks.workunit.client.0.smithi088.stdout:7/947: symlink d2/d79/db3/l129 0 2024-09-17T04:21:25.781 INFO:tasks.workunit.client.0.smithi088.stdout:0/777: write db/f10 [590570,81535] 0 2024-09-17T04:21:25.782 INFO:tasks.workunit.client.0.smithi088.stdout:8/853: dread d7/fbc [0,4194304] 0 2024-09-17T04:21:25.785 INFO:tasks.workunit.client.0.smithi088.stdout:0/778: creat db/d1b/d39/de5/f110 x:0 0 0 2024-09-17T04:21:25.786 INFO:tasks.workunit.client.0.smithi088.stdout:5/867: creat d2/d31/d33/d20/d30/d51/f120 x:0 0 0 2024-09-17T04:21:25.790 INFO:tasks.workunit.client.0.smithi088.stdout:5/868: creat d2/d31/d33/d20/d25/d2c/df0/f121 x:0 0 0 2024-09-17T04:21:25.793 INFO:tasks.workunit.client.0.smithi088.stdout:5/869: fdatasync d2/d31/d33/f37 0 2024-09-17T04:21:25.795 INFO:tasks.workunit.client.0.smithi088.stdout:7/948: write d2/d96/fac [199144,20667] 0 2024-09-17T04:21:25.800 INFO:tasks.workunit.client.0.smithi088.stdout:0/779: link db/d1b/d36/df9/d66/d82/cea db/d1b/d36/d47/db9/c111 0 2024-09-17T04:21:25.801 INFO:tasks.workunit.client.0.smithi088.stdout:0/780: read - db/d1b/d36/d47/db9/fe8 zero size 2024-09-17T04:21:25.803 INFO:tasks.workunit.client.0.smithi088.stdout:0/781: rmdir db/d1b/d36/df9/d9f 39 2024-09-17T04:21:25.805 INFO:tasks.workunit.client.0.smithi088.stdout:5/870: rename d2/d31/d33/d20/d8b/ff6 to d2/f122 0 2024-09-17T04:21:25.806 INFO:tasks.workunit.client.0.smithi088.stdout:7/949: link d2/d4/d7/l83 d2/d4/d7/d46/da3/l12a 0 2024-09-17T04:21:25.808 INFO:tasks.workunit.client.0.smithi088.stdout:0/782: symlink db/db2/dc0/l112 0 2024-09-17T04:21:25.809 INFO:tasks.workunit.client.0.smithi088.stdout:5/871: write d2/d31/d33/d20/d25/f41 [2129723,98476] 0 2024-09-17T04:21:25.813 INFO:tasks.workunit.client.0.smithi088.stdout:7/950: rename d2/d1d/d2e/db0/d23/d45/d62/f70 to d2/d1d/d2e/db0/d23/d97/dbb/dcf/f12b 0 2024-09-17T04:21:25.815 INFO:tasks.workunit.client.0.smithi088.stdout:0/783: link db/d1b/d36/df9/d59/ff1 db/d67/d7c/f113 0 2024-09-17T04:21:25.817 INFO:tasks.workunit.client.0.smithi088.stdout:5/872: rename d2/d31/d33/d20/d30/d9f/cad to d2/d31/d33/c123 0 2024-09-17T04:21:25.820 INFO:tasks.workunit.client.0.smithi088.stdout:0/784: symlink db/d1b/d36/df9/d59/da4/dc8/l114 0 2024-09-17T04:21:25.823 INFO:tasks.workunit.client.0.smithi088.stdout:0/785: getdents db/d1b/d39/de5/ded 0 2024-09-17T04:21:25.825 INFO:tasks.workunit.client.0.smithi088.stdout:0/786: creat db/d1b/d36/d4a/dd3/df5/f115 x:0 0 0 2024-09-17T04:21:25.827 INFO:tasks.workunit.client.0.smithi088.stdout:0/787: mkdir db/d3c/d116 0 2024-09-17T04:21:25.827 INFO:tasks.workunit.client.0.smithi088.stdout:0/788: stat db/d1b/d39/de5/ded 0 2024-09-17T04:21:25.828 INFO:tasks.workunit.client.0.smithi088.stdout:0/789: chown db/d1b 2 1 2024-09-17T04:21:25.840 INFO:tasks.workunit.client.0.smithi088.stdout:7/951: dwrite d2/d4/d7/fa [0,4194304] 0 2024-09-17T04:21:25.840 INFO:tasks.workunit.client.0.smithi088.stdout:5/873: unlink d2/d31/d33/ce1 0 2024-09-17T04:21:25.846 INFO:tasks.workunit.client.0.smithi088.stdout:5/874: read d2/d31/d33/d20/d8b/fab [449335,92652] 0 2024-09-17T04:21:25.846 INFO:tasks.workunit.client.0.smithi088.stdout:7/952: rename d2/d4/d7/l5b to d2/d8d/l12c 0 2024-09-17T04:21:25.851 INFO:tasks.workunit.client.0.smithi088.stdout:0/790: dwrite db/f9d [0,4194304] 0 2024-09-17T04:21:25.853 INFO:tasks.workunit.client.0.smithi088.stdout:0/791: readlink db/d67/d7c/dae/lf4 0 2024-09-17T04:21:25.853 INFO:tasks.workunit.client.0.smithi088.stdout:5/875: rename d2/l2b to d2/d31/d33/d20/d25/d2c/l124 0 2024-09-17T04:21:25.856 INFO:tasks.workunit.client.0.smithi088.stdout:7/953: symlink d2/d1d/d2e/db0/d23/d97/dbb/dcf/d11b/l12d 0 2024-09-17T04:21:25.863 INFO:tasks.workunit.client.0.smithi088.stdout:0/792: dread db/d1b/d36/d47/db9/fc5 [0,4194304] 0 2024-09-17T04:21:25.864 INFO:tasks.workunit.client.0.smithi088.stdout:0/793: readlink db/d1b/d36/d47/l42 0 2024-09-17T04:21:25.865 INFO:tasks.workunit.client.0.smithi088.stdout:0/794: chown db/d1b/d36/df9/d66/f71 63393 1 2024-09-17T04:21:25.867 INFO:tasks.workunit.client.0.smithi088.stdout:7/954: write d2/d1d/d2e/fa0 [4389880,83581] 0 2024-09-17T04:21:25.868 INFO:tasks.workunit.client.0.smithi088.stdout:0/795: creat db/d3c/d116/f117 x:0 0 0 2024-09-17T04:21:25.873 INFO:tasks.workunit.client.0.smithi088.stdout:0/796: write db/d1b/d36/df9/d9f/f105 [945229,97373] 0 2024-09-17T04:21:25.875 INFO:tasks.workunit.client.0.smithi088.stdout:7/955: dwrite d2/d1d/d2e/db0/f24 [0,4194304] 0 2024-09-17T04:21:25.878 INFO:tasks.workunit.client.0.smithi088.stdout:0/797: rename db/fbb to db/d3c/f118 0 2024-09-17T04:21:25.878 INFO:tasks.workunit.client.0.smithi088.stdout:5/876: dread d2/d31/d33/d20/d30/d51/fa1 [0,4194304] 0 2024-09-17T04:21:25.879 INFO:tasks.workunit.client.0.smithi088.stdout:0/798: chown db/f72 0 1 2024-09-17T04:21:25.882 INFO:tasks.workunit.client.0.smithi088.stdout:0/799: chown db/d1b/d36/c85 0 1 2024-09-17T04:21:25.883 INFO:tasks.workunit.client.0.smithi088.stdout:0/800: truncate db/d1b/d36/d47/db9/ff7 929772 0 2024-09-17T04:21:25.903 INFO:tasks.workunit.client.0.smithi088.stdout:5/877: dwrite d2/d31/d33/d20/d25/d49/f9a [0,4194304] 0 2024-09-17T04:21:25.904 INFO:tasks.workunit.client.0.smithi088.stdout:7/956: dwrite d2/d8d/f9d [0,4194304] 0 2024-09-17T04:21:25.905 INFO:tasks.workunit.client.0.smithi088.stdout:7/957: write d2/d8d/f9d [833742,88533] 0 2024-09-17T04:21:25.912 INFO:tasks.workunit.client.0.smithi088.stdout:5/878: getdents d2/d110 0 2024-09-17T04:21:25.913 INFO:tasks.workunit.client.0.smithi088.stdout:5/879: chown d2/d31/l5d 1309726 1 2024-09-17T04:21:25.924 INFO:tasks.workunit.client.0.smithi088.stdout:7/958: read d2/d1d/d2e/db0/f3b [8428650,26868] 0 2024-09-17T04:21:25.925 INFO:tasks.workunit.client.0.smithi088.stdout:0/801: dread db/d1b/d36/df9/d66/f70 [0,4194304] 0 2024-09-17T04:21:25.926 INFO:tasks.workunit.client.0.smithi088.stdout:7/959: write d2/d1d/d2e/db0/d23/d45/d6d/f107 [674163,68021] 0 2024-09-17T04:21:25.929 INFO:tasks.workunit.client.0.smithi088.stdout:7/960: truncate d2/f60 2110516 0 2024-09-17T04:21:25.932 INFO:tasks.workunit.client.0.smithi088.stdout:5/880: truncate d2/d31/d33/d20/d30/d9f/da4/fa7 667494 0 2024-09-17T04:21:25.940 INFO:tasks.workunit.client.0.smithi088.stdout:0/802: truncate db/d1b/d36/d47/db9/dda/f104 2440855 0 2024-09-17T04:21:25.941 INFO:tasks.workunit.client.0.smithi088.stdout:5/881: truncate d2/d31/d33/d20/d30/d51/d5e/d6b/ff2 525522 0 2024-09-17T04:21:25.942 INFO:tasks.workunit.client.0.smithi088.stdout:7/961: link d2/d79/db3/f11a d2/d4/d7/d46/d67/f12e 0 2024-09-17T04:21:25.945 INFO:tasks.workunit.client.0.smithi088.stdout:5/882: creat d2/d31/d33/d20/d25/d2c/d8a/db2/f125 x:0 0 0 2024-09-17T04:21:25.948 INFO:tasks.workunit.client.0.smithi088.stdout:7/962: fdatasync d2/d1d/d2e/db0/f5e 0 2024-09-17T04:21:25.948 INFO:tasks.workunit.client.0.smithi088.stdout:0/803: dwrite db/d1b/d36/d47/db9/dda/ff0 [0,4194304] 0 2024-09-17T04:21:25.951 INFO:tasks.workunit.client.0.smithi088.stdout:0/804: dread db/d1b/d36/d47/db9/fc5 [0,4194304] 0 2024-09-17T04:21:25.951 INFO:tasks.workunit.client.0.smithi088.stdout:5/883: dread d2/d31/d33/d20/d25/f41 [4194304,4194304] 0 2024-09-17T04:21:25.960 INFO:tasks.workunit.client.0.smithi088.stdout:5/884: readlink d2/d31/d33/d20/d30/d51/d5e/le8 0 2024-09-17T04:21:25.962 INFO:tasks.workunit.client.0.smithi088.stdout:7/963: creat d2/f12f x:0 0 0 2024-09-17T04:21:25.963 INFO:tasks.workunit.client.0.smithi088.stdout:7/964: chown d2/f1b 2096 1 2024-09-17T04:21:25.965 INFO:tasks.workunit.client.0.smithi088.stdout:7/965: rmdir d2/d1d/d2e/db0/d23/d97/dbb/dcf/d11b 39 2024-09-17T04:21:25.967 INFO:tasks.workunit.client.0.smithi088.stdout:5/885: creat d2/d31/d108/f126 x:0 0 0 2024-09-17T04:21:25.968 INFO:tasks.workunit.client.0.smithi088.stdout:5/886: stat d2/d31/d33/d20/d25/f41 0 2024-09-17T04:21:25.971 INFO:tasks.workunit.client.0.smithi088.stdout:0/805: write db/d67/d7c/f113 [1316996,130540] 0 2024-09-17T04:21:25.979 INFO:tasks.workunit.client.0.smithi088.stdout:0/806: creat db/d1b/f119 x:0 0 0 2024-09-17T04:21:25.982 INFO:tasks.workunit.client.0.smithi088.stdout:7/966: dread d2/d4/d7/d46/d67/f72 [0,4194304] 0 2024-09-17T04:21:25.982 INFO:tasks.workunit.client.0.smithi088.stdout:0/807: chown db/d67/f79 7217 1 2024-09-17T04:21:25.983 INFO:tasks.workunit.client.0.smithi088.stdout:5/887: dwrite d2/d31/f77 [0,4194304] 0 2024-09-17T04:21:25.984 INFO:tasks.workunit.client.0.smithi088.stdout:0/808: readlink db/d1b/d39/l45 0 2024-09-17T04:21:25.988 INFO:tasks.workunit.client.0.smithi088.stdout:5/888: dread d2/d31/d33/d20/d47/f8e [4194304,4194304] 0 2024-09-17T04:21:25.999 INFO:tasks.workunit.client.0.smithi088.stdout:5/889: dwrite d2/d31/d33/d20/d30/dea/f112 [0,4194304] 0 2024-09-17T04:21:26.000 INFO:tasks.workunit.client.0.smithi088.stdout:7/967: dread d2/d1d/ff6 [0,4194304] 0 2024-09-17T04:21:26.000 INFO:tasks.workunit.client.0.smithi088.stdout:0/809: dwrite db/d1b/d36/fb5 [0,4194304] 0 2024-09-17T04:21:26.001 INFO:tasks.workunit.client.0.smithi088.stdout:5/890: stat d2/d31/d33/d20/d25/d2c/d8a/db2/ld0 0 2024-09-17T04:21:26.005 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:25 smithi134 ceph-mon[35201]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:21:26.044 INFO:tasks.workunit.client.0.smithi088.stdout:0/810: rename db/d1b/d36/f9c to db/d1b/d36/d4a/d6a/f11a 0 2024-09-17T04:21:26.046 INFO:tasks.workunit.client.0.smithi088.stdout:5/891: rmdir d2/d31/d33/d20/d30/d51/d5e/d6b/d10a 0 2024-09-17T04:21:26.049 INFO:tasks.workunit.client.0.smithi088.stdout:5/892: rename d2/d31/d33/d20/d25/d2c/f72 to d2/da9/f127 0 2024-09-17T04:21:26.050 INFO:tasks.workunit.client.0.smithi088.stdout:5/893: chown d2/c19 253 1 2024-09-17T04:21:26.055 INFO:tasks.workunit.client.0.smithi088.stdout:0/811: write db/d1b/d36/df9/d66/f88 [684749,104014] 0 2024-09-17T04:21:26.056 INFO:tasks.workunit.client.0.smithi088.stdout:5/894: creat d2/d31/d33/d20/d30/d9f/d11f/f128 x:0 0 0 2024-09-17T04:21:26.056 INFO:tasks.workunit.client.0.smithi088.stdout:0/812: readlink db/d1b/d39/l8a 0 2024-09-17T04:21:26.058 INFO:tasks.workunit.client.0.smithi088.stdout:0/813: creat db/d1b/d36/df9/dd5/f11b x:0 0 0 2024-09-17T04:21:26.060 INFO:tasks.workunit.client.0.smithi088.stdout:5/895: creat d2/d31/d33/d20/d30/d9f/da4/d10c/f129 x:0 0 0 2024-09-17T04:21:26.069 INFO:tasks.workunit.client.0.smithi088.stdout:5/896: dwrite d2/d31/d33/d20/d30/d51/d5e/d6b/fa0 [0,4194304] 0 2024-09-17T04:21:26.069 INFO:tasks.workunit.client.0.smithi088.stdout:5/897: fsync d2/d31/d33/d20/d30/d51/d5e/f78 0 2024-09-17T04:21:26.069 INFO:tasks.workunit.client.0.smithi088.stdout:0/814: write db/d1b/d36/df9/d9f/faf [400568,128411] 0 2024-09-17T04:21:26.071 INFO:tasks.workunit.client.0.smithi088.stdout:5/898: fsync d2/d31/d33/d20/d47/de0/f114 0 2024-09-17T04:21:26.076 INFO:tasks.workunit.client.0.smithi088.stdout:5/899: symlink d2/d31/d33/d20/d25/d2c/df0/l12a 0 2024-09-17T04:21:26.082 INFO:tasks.workunit.client.0.smithi088.stdout:5/900: link d2/d31/d33/d20/d30/f4e d2/d31/d33/d20/d25/d2c/d8a/db2/dc3/f12b 0 2024-09-17T04:21:26.083 INFO:tasks.workunit.client.0.smithi088.stdout:5/901: stat d2/d31/l5d 0 2024-09-17T04:21:26.084 INFO:tasks.workunit.client.0.smithi088.stdout:0/815: dwrite db/ff3 [0,4194304] 0 2024-09-17T04:21:26.086 INFO:tasks.workunit.client.0.smithi088.stdout:0/816: write db/d1b/d36/d4a/d20/f7a [854229,11766] 0 2024-09-17T04:21:26.090 INFO:tasks.workunit.client.0.smithi088.stdout:0/817: rename db/d1b/d36/d47 to db/d67/d7c/dae/d11c 0 2024-09-17T04:21:26.091 INFO:tasks.workunit.client.0.smithi088.stdout:5/902: dwrite d2/f40 [0,4194304] 0 2024-09-17T04:21:26.095 INFO:tasks.workunit.client.0.smithi088.stdout:0/818: write db/f12 [365900,50060] 0 2024-09-17T04:21:26.096 INFO:tasks.workunit.client.0.smithi088.stdout:5/903: creat d2/d31/d33/d20/d30/dea/f12c x:0 0 0 2024-09-17T04:21:26.100 INFO:tasks.workunit.client.0.smithi088.stdout:0/819: truncate db/d1b/d39/f80 1094547 0 2024-09-17T04:21:26.116 INFO:tasks.workunit.client.0.smithi088.stdout:5/904: dwrite d2/d31/d33/d20/d25/d2c/d8a/fc2 [0,4194304] 0 2024-09-17T04:21:26.118 INFO:tasks.workunit.client.0.smithi088.stdout:0/820: dwrite db/d1b/d36/df9/d59/f65 [0,4194304] 0 2024-09-17T04:21:26.124 INFO:tasks.workunit.client.0.smithi088.stdout:5/905: rename d2/d31/d33/d20/d25/d49/f5f to d2/d31/d33/d20/d47/dfe/f12d 0 2024-09-17T04:21:26.127 INFO:tasks.workunit.client.0.smithi088.stdout:0/821: dwrite db/d1b/ff8 [0,4194304] 0 2024-09-17T04:21:26.127 INFO:tasks.workunit.client.0.smithi088.stdout:5/906: read d2/d31/d33/d20/d30/d51/d5e/d6b/f99 [352917,116796] 0 2024-09-17T04:21:26.130 INFO:tasks.workunit.client.0.smithi088.stdout:5/907: stat d2/d31/d33/la8 0 2024-09-17T04:21:26.133 INFO:tasks.workunit.client.0.smithi088.stdout:5/908: mknod d2/d31/dd5/c12e 0 2024-09-17T04:21:26.134 INFO:tasks.workunit.client.0.smithi088.stdout:0/822: link db/d67/d7c/dae/lf4 db/db2/l11d 0 2024-09-17T04:21:26.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:25 smithi088 ceph-mon[27811]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:21:26.139 INFO:tasks.workunit.client.0.smithi088.stdout:0/823: rename db/d3c/c97 to db/d1b/d39/de5/c11e 0 2024-09-17T04:21:26.141 INFO:tasks.workunit.client.0.smithi088.stdout:0/824: truncate db/d67/f79 315626 0 2024-09-17T04:21:26.142 INFO:tasks.workunit.client.0.smithi088.stdout:0/825: chown db/d67/d7c/dae/d11c/db9/dda 8 1 2024-09-17T04:21:26.144 INFO:tasks.workunit.client.0.smithi088.stdout:0/826: rmdir db/d1b/d39/d83 39 2024-09-17T04:21:26.157 INFO:tasks.workunit.client.0.smithi088.stdout:0/827: link db/d1b/d39/d83/c98 db/d1b/d36/d4a/dd3/c11f 0 2024-09-17T04:21:26.159 INFO:tasks.workunit.client.0.smithi088.stdout:0/828: fsync db/d67/d7c/dae/d11c/db9/ff7 0 2024-09-17T04:21:26.165 INFO:tasks.workunit.client.0.smithi088.stdout:0/829: dread db/d67/d7c/dae/d11c/db9/dda/ff0 [0,4194304] 0 2024-09-17T04:21:26.166 INFO:tasks.workunit.client.0.smithi088.stdout:5/909: dwrite d2/d31/d33/d20/d25/d2c/d8a/db2/dc3/d10e/fce [0,4194304] 0 2024-09-17T04:21:26.170 INFO:tasks.workunit.client.0.smithi088.stdout:5/910: fsync d2/d31/d33/f1f 0 2024-09-17T04:21:26.174 INFO:tasks.workunit.client.0.smithi088.stdout:5/911: dread - d2/d31/d33/d20/d30/d51/d5e/fbb zero size 2024-09-17T04:21:26.177 INFO:tasks.workunit.client.0.smithi088.stdout:5/912: symlink d2/d110/l12f 0 2024-09-17T04:21:26.182 INFO:tasks.workunit.client.0.smithi088.stdout:5/913: rename d2/d31/d33/d20/d30/d51/fa1 to d2/f130 0 2024-09-17T04:21:26.184 INFO:tasks.workunit.client.0.smithi088.stdout:5/914: mknod d2/d31/d33/d20/d30/d9f/d11f/c131 0 2024-09-17T04:21:26.187 INFO:tasks.workunit.client.0.smithi088.stdout:5/915: creat d2/d31/d33/d20/d30/d51/f132 x:0 0 0 2024-09-17T04:21:26.191 INFO:tasks.workunit.client.0.smithi088.stdout:5/916: dread d2/d31/d33/d20/d47/de0/ffa [0,4194304] 0 2024-09-17T04:21:26.195 INFO:tasks.workunit.client.0.smithi088.stdout:5/917: dread d2/d31/d33/d20/d30/dea/f112 [0,4194304] 0 2024-09-17T04:21:26.197 INFO:tasks.workunit.client.0.smithi088.stdout:5/918: symlink d2/da9/l133 0 2024-09-17T04:21:26.200 INFO:tasks.workunit.client.0.smithi088.stdout:5/919: creat d2/d31/d33/f134 x:0 0 0 2024-09-17T04:21:26.203 INFO:tasks.workunit.client.0.smithi088.stdout:5/920: dread d2/da9/f127 [4194304,4194304] 0 2024-09-17T04:21:26.205 INFO:tasks.workunit.client.0.smithi088.stdout:5/921: truncate d2/d31/d33/d20/d47/de0/f10b 579866 0 2024-09-17T04:21:26.209 INFO:tasks.workunit.client.0.smithi088.stdout:5/922: symlink d2/d31/d33/d20/d30/d51/d5e/l135 0 2024-09-17T04:21:26.209 INFO:tasks.workunit.client.0.smithi088.stdout:5/923: chown d2/d31/ldf 530521 1 2024-09-17T04:21:26.215 INFO:tasks.workunit.client.0.smithi088.stdout:5/924: creat d2/d31/d33/d20/d25/d49/f136 x:0 0 0 2024-09-17T04:21:26.216 INFO:tasks.workunit.client.0.smithi088.stdout:5/925: stat d2/d31/l5d 0 2024-09-17T04:21:26.220 INFO:tasks.workunit.client.0.smithi088.stdout:5/926: mknod d2/d31/d33/d20/d47/de0/da5/d11b/c137 0 2024-09-17T04:21:26.224 INFO:tasks.workunit.client.0.smithi088.stdout:5/927: unlink d2/d31/d33/d20/l119 0 2024-09-17T04:21:26.225 INFO:tasks.workunit.client.0.smithi088.stdout:5/928: readlink d2/d31/d33/d20/d25/d49/ldb 0 2024-09-17T04:21:26.232 INFO:tasks.workunit.client.0.smithi088.stdout:5/929: dwrite d2/d31/f77 [4194304,4194304] 0 2024-09-17T04:21:26.243 INFO:tasks.workunit.client.0.smithi088.stdout:5/930: dread d2/d31/d33/d20/f84 [0,4194304] 0 2024-09-17T04:21:26.250 INFO:tasks.workunit.client.0.smithi088.stdout:5/931: symlink d2/d31/l138 0 2024-09-17T04:21:26.254 INFO:tasks.workunit.client.0.smithi088.stdout:5/932: dread d2/d31/d33/d20/d47/dfe/f12d [0,4194304] 0 2024-09-17T04:21:26.270 INFO:tasks.workunit.client.0.smithi088.stdout:5/933: dwrite d2/d31/d33/d20/d30/d9f/da4/fa7 [0,4194304] 0 2024-09-17T04:21:26.276 INFO:tasks.workunit.client.0.smithi088.stdout:5/934: dread - d2/d31/d33/d20/d30/d51/fef zero size 2024-09-17T04:21:26.279 INFO:tasks.workunit.client.0.smithi088.stdout:5/935: rename d2/d31/d33/d20/d30/d9f/da4/dbe/cc7 to d2/d110/c139 0 2024-09-17T04:21:26.280 INFO:tasks.workunit.client.0.smithi088.stdout:5/936: dread - d2/da9/db8/fd6 zero size 2024-09-17T04:21:26.299 INFO:tasks.workunit.client.0.smithi088.stdout:5/937: dwrite d2/d31/faa [0,4194304] 0 2024-09-17T04:21:26.302 INFO:tasks.workunit.client.0.smithi088.stdout:5/938: write d2/d31/d33/f54 [2386508,98037] 0 2024-09-17T04:21:26.303 INFO:tasks.workunit.client.0.smithi088.stdout:5/939: chown d2/d31/d33/d20/d25/d2c/c80 865084 1 2024-09-17T04:21:26.303 INFO:tasks.workunit.client.0.smithi088.stdout:5/940: write d2/f38 [4464323,75751] 0 2024-09-17T04:21:26.305 INFO:tasks.workunit.client.0.smithi088.stdout:5/941: chown d2/d31/d33/d20/d8b/lff 1890420 1 2024-09-17T04:21:26.310 INFO:tasks.workunit.client.0.smithi088.stdout:5/942: creat d2/d31/d33/f13a x:0 0 0 2024-09-17T04:21:26.311 INFO:tasks.workunit.client.0.smithi088.stdout:5/943: dread - d2/d31/d108/f126 zero size 2024-09-17T04:21:26.314 INFO:tasks.workunit.client.0.smithi088.stdout:5/944: creat d2/d31/d33/d20/d25/f13b x:0 0 0 2024-09-17T04:21:26.316 INFO:tasks.workunit.client.0.smithi088.stdout:5/945: rename d2/d31/faa to d2/d31/d33/d20/d30/f13c 0 2024-09-17T04:21:26.318 INFO:tasks.workunit.client.0.smithi088.stdout:5/946: read d2/da9/db8/f10d [625917,82694] 0 2024-09-17T04:21:26.320 INFO:tasks.workunit.client.0.smithi088.stdout:5/947: truncate d2/d31/d33/d20/d30/d9f/da4/d10c/f129 436164 0 2024-09-17T04:21:26.323 INFO:tasks.workunit.client.0.smithi088.stdout:5/948: mkdir d2/d31/d33/d20/d25/d2c/df0/d13d 0 2024-09-17T04:21:26.327 INFO:tasks.workunit.client.0.smithi088.stdout:5/949: rename d2/d31/d33/d20/d25/d2c/d8a/db2/dc3 to d2/d31/d33/d20/d25/d2c/d8a/d13e 0 2024-09-17T04:21:26.329 INFO:tasks.workunit.client.0.smithi088.stdout:5/950: creat d2/d31/d33/d20/d25/d2c/d8a/dc6/f13f x:0 0 0 2024-09-17T04:21:26.332 INFO:tasks.workunit.client.0.smithi088.stdout:5/951: unlink d2/d31/d33/f37 0 2024-09-17T04:21:26.334 INFO:tasks.workunit.client.0.smithi088.stdout:5/952: symlink d2/d31/d33/l140 0 2024-09-17T04:21:26.335 INFO:tasks.workunit.client.0.smithi088.stdout:5/953: write d2/d31/d33/d20/f101 [68495,51901] 0 2024-09-17T04:21:26.337 INFO:tasks.workunit.client.0.smithi088.stdout:5/954: dread d2/d31/d33/d20/d47/f87 [0,4194304] 0 2024-09-17T04:21:26.339 INFO:tasks.workunit.client.0.smithi088.stdout:5/955: mkdir d2/d31/d33/d20/dd9/d141 0 2024-09-17T04:21:26.340 INFO:tasks.workunit.client.0.smithi088.stdout:5/956: write d2/d31/d33/d20/d47/f8e [7079211,32041] 0 2024-09-17T04:21:26.343 INFO:tasks.workunit.client.0.smithi088.stdout:5/957: chown d2/l17 25 1 2024-09-17T04:21:26.346 INFO:tasks.workunit.client.0.smithi088.stdout:5/958: creat d2/d31/d33/d20/d25/f142 x:0 0 0 2024-09-17T04:21:26.348 INFO:tasks.workunit.client.0.smithi088.stdout:5/959: truncate d2/f1d 1981716 0 2024-09-17T04:21:26.422 INFO:tasks.workunit.client.0.smithi088.stdout:8/854: sync 2024-09-17T04:21:26.422 INFO:tasks.workunit.client.0.smithi088.stdout:4/890: sync 2024-09-17T04:21:26.427 INFO:tasks.workunit.client.0.smithi088.stdout:8/855: creat d7/d29/d2a/d10a/f11d x:0 0 0 2024-09-17T04:21:26.431 INFO:tasks.workunit.client.0.smithi088.stdout:4/891: write d5/d32/d6b/dd2/d109/d118/d122/dd0/f106 [931499,77012] 0 2024-09-17T04:21:26.433 INFO:tasks.workunit.client.0.smithi088.stdout:4/892: dread - d5/d32/d6b/dd2/d109/fde zero size 2024-09-17T04:21:26.441 INFO:tasks.workunit.client.0.smithi088.stdout:8/856: dread d7/dd/d31/f76 [0,4194304] 0 2024-09-17T04:21:26.443 INFO:tasks.workunit.client.0.smithi088.stdout:8/857: symlink d7/d29/d2a/d38/d42/d117/l11e 0 2024-09-17T04:21:26.445 INFO:tasks.workunit.client.0.smithi088.stdout:4/893: dwrite d5/f28 [0,4194304] 0 2024-09-17T04:21:26.450 INFO:tasks.workunit.client.0.smithi088.stdout:4/894: creat d5/d11e/f125 x:0 0 0 2024-09-17T04:21:26.450 INFO:tasks.workunit.client.0.smithi088.stdout:8/858: dwrite f6 [0,4194304] 0 2024-09-17T04:21:26.451 INFO:tasks.workunit.client.0.smithi088.stdout:4/895: fsync d5/d3f/d71/d99/fa6 0 2024-09-17T04:21:26.458 INFO:tasks.workunit.client.0.smithi088.stdout:4/896: creat d5/d3f/d71/f126 x:0 0 0 2024-09-17T04:21:26.459 INFO:tasks.workunit.client.0.smithi088.stdout:4/897: write d5/d3f/d71/d99/fa6 [4032797,62247] 0 2024-09-17T04:21:26.465 INFO:tasks.workunit.client.0.smithi088.stdout:8/859: write d7/dd/d31/fb5 [5170724,6001] 0 2024-09-17T04:21:26.469 INFO:tasks.workunit.client.0.smithi088.stdout:8/860: rename d7/d29/d2a/d3a to d7/d11f 0 2024-09-17T04:21:26.470 INFO:tasks.workunit.client.0.smithi088.stdout:8/861: stat d7/d29/d2a/d38/d3d/d63/db7 0 2024-09-17T04:21:26.470 INFO:tasks.workunit.client.0.smithi088.stdout:8/862: chown d7/d29/d2a/d38/d3d/d63/db7 17947854 1 2024-09-17T04:21:26.474 INFO:tasks.workunit.client.0.smithi088.stdout:8/863: link d7/d7f/c10e d7/dd/d6f/c120 0 2024-09-17T04:21:26.477 INFO:tasks.workunit.client.0.smithi088.stdout:8/864: creat d7/dd/d31/d47/d55/d57/d6b/ddb/f121 x:0 0 0 2024-09-17T04:21:26.481 INFO:tasks.workunit.client.0.smithi088.stdout:4/898: dwrite d5/d3f/d71/f91 [0,4194304] 0 2024-09-17T04:21:26.482 INFO:tasks.workunit.client.0.smithi088.stdout:8/865: mknod d7/d29/d2a/d38/d3d/da0/da8/c122 0 2024-09-17T04:21:26.483 INFO:tasks.workunit.client.0.smithi088.stdout:4/899: truncate d5/d3f/d71/d8b/d68/da4/d5e/f6a 2036119 0 2024-09-17T04:21:26.489 INFO:tasks.workunit.client.0.smithi088.stdout:4/900: dwrite d5/d3f/fdb [0,4194304] 0 2024-09-17T04:21:26.492 INFO:tasks.workunit.client.0.smithi088.stdout:4/901: creat d5/d72/f127 x:0 0 0 2024-09-17T04:21:26.503 INFO:tasks.workunit.client.0.smithi088.stdout:4/902: write d5/d3f/d71/dd8/fda [1280045,64922] 0 2024-09-17T04:21:26.505 INFO:tasks.workunit.client.0.smithi088.stdout:4/903: rmdir d5/d3f/d71/dd8 39 2024-09-17T04:21:26.510 INFO:tasks.workunit.client.0.smithi088.stdout:4/904: dwrite d5/d3d/dee/f121 [0,4194304] 0 2024-09-17T04:21:26.519 INFO:tasks.workunit.client.0.smithi088.stdout:4/905: write d5/d32/f57 [4428523,24887] 0 2024-09-17T04:21:26.523 INFO:tasks.workunit.client.0.smithi088.stdout:0/830: sync 2024-09-17T04:21:26.524 INFO:tasks.workunit.client.0.smithi088.stdout:7/968: sync 2024-09-17T04:21:26.525 INFO:tasks.workunit.client.0.smithi088.stdout:0/831: dread db/f12 [0,4194304] 0 2024-09-17T04:21:26.527 INFO:tasks.workunit.client.0.smithi088.stdout:4/906: dread d5/d3f/d71/d8b/d68/fa5 [0,4194304] 0 2024-09-17T04:21:26.527 INFO:tasks.workunit.client.0.smithi088.stdout:7/969: read d2/d1d/d2e/db0/d23/f35 [3112893,61368] 0 2024-09-17T04:21:26.528 INFO:tasks.workunit.client.0.smithi088.stdout:0/832: symlink db/d1b/d36/d4a/dd3/l120 0 2024-09-17T04:21:26.530 INFO:tasks.workunit.client.0.smithi088.stdout:7/970: symlink d2/d1d/l130 0 2024-09-17T04:21:26.533 INFO:tasks.workunit.client.0.smithi088.stdout:0/833: mkdir db/db2/dc0/d121 0 2024-09-17T04:21:26.533 INFO:tasks.workunit.client.0.smithi088.stdout:0/834: chown db/d1b/d36/d4a/dd3/l120 226986589 1 2024-09-17T04:21:26.533 INFO:tasks.workunit.client.0.smithi088.stdout:4/907: truncate d5/d3f/d71/d8b/d68/da4/d5e/d83/fbc 4862769 0 2024-09-17T04:21:26.539 INFO:tasks.workunit.client.0.smithi088.stdout:4/908: fsync d5/d3f/d71/d8b/d68/da4/d5e/fc6 0 2024-09-17T04:21:26.541 INFO:tasks.workunit.client.0.smithi088.stdout:0/835: creat db/d1b/d36/df9/d59/da4/d100/f122 x:0 0 0 2024-09-17T04:21:26.545 INFO:tasks.workunit.client.0.smithi088.stdout:0/836: creat db/d3c/d116/f123 x:0 0 0 2024-09-17T04:21:26.547 INFO:tasks.workunit.client.0.smithi088.stdout:7/971: link d2/d4/d7/f61 d2/d4/d7/f131 0 2024-09-17T04:21:26.551 INFO:tasks.workunit.client.0.smithi088.stdout:7/972: mknod d2/d96/df2/c132 0 2024-09-17T04:21:26.552 INFO:tasks.workunit.client.0.smithi088.stdout:4/909: write d5/d3f/d71/ff0 [802531,106058] 0 2024-09-17T04:21:26.553 INFO:tasks.workunit.client.0.smithi088.stdout:0/837: creat db/d1b/d36/f124 x:0 0 0 2024-09-17T04:21:26.554 INFO:tasks.workunit.client.0.smithi088.stdout:7/973: mkdir d2/d1d/d2e/db0/d23/d45/d62/d82/d133 0 2024-09-17T04:21:26.556 INFO:tasks.workunit.client.0.smithi088.stdout:0/838: chown db/d1b/d36/d4a/d20/cba 206211 1 2024-09-17T04:21:26.556 INFO:tasks.workunit.client.0.smithi088.stdout:4/910: symlink d5/d32/l128 0 2024-09-17T04:21:26.558 INFO:tasks.workunit.client.0.smithi088.stdout:4/911: dread d5/d3f/d71/f101 [0,4194304] 0 2024-09-17T04:21:26.560 INFO:tasks.workunit.client.0.smithi088.stdout:7/974: symlink d2/d1d/d2e/db0/d23/d45/d6d/d120/l134 0 2024-09-17T04:21:26.563 INFO:tasks.workunit.client.0.smithi088.stdout:0/839: dwrite db/ff3 [4194304,4194304] 0 2024-09-17T04:21:26.564 INFO:tasks.workunit.client.0.smithi088.stdout:0/840: stat db/d1b/f87 0 2024-09-17T04:21:26.566 INFO:tasks.workunit.client.0.smithi088.stdout:0/841: fdatasync db/d1b/d36/f107 0 2024-09-17T04:21:26.568 INFO:tasks.workunit.client.0.smithi088.stdout:7/975: dwrite d2/d8d/f9d [0,4194304] 0 2024-09-17T04:21:26.570 INFO:tasks.workunit.client.0.smithi088.stdout:4/912: mknod d5/c129 0 2024-09-17T04:21:26.571 INFO:tasks.workunit.client.0.smithi088.stdout:0/842: rmdir db/d67 39 2024-09-17T04:21:26.572 INFO:tasks.workunit.client.0.smithi088.stdout:7/976: symlink d2/d4/d7/d20/l135 0 2024-09-17T04:21:26.573 INFO:tasks.workunit.client.0.smithi088.stdout:0/843: write db/ff3 [24682,54433] 0 2024-09-17T04:21:26.573 INFO:tasks.workunit.client.0.smithi088.stdout:4/913: mknod d5/d11e/c12a 0 2024-09-17T04:21:26.577 INFO:tasks.workunit.client.0.smithi088.stdout:0/844: creat db/db2/dc0/d121/f125 x:0 0 0 2024-09-17T04:21:26.581 INFO:tasks.workunit.client.0.smithi088.stdout:4/914: getdents d5/d3f/d71/d8b/d68/da4 0 2024-09-17T04:21:26.583 INFO:tasks.workunit.client.0.smithi088.stdout:0/845: mknod db/d67/d7c/dae/d11c/db9/c126 0 2024-09-17T04:21:26.586 INFO:tasks.workunit.client.0.smithi088.stdout:0/846: rmdir db/d67 39 2024-09-17T04:21:26.588 INFO:tasks.workunit.client.0.smithi088.stdout:4/915: symlink d5/d3f/d71/l12b 0 2024-09-17T04:21:26.589 INFO:tasks.workunit.client.0.smithi088.stdout:4/916: chown d5/d32/c34 33 1 2024-09-17T04:21:26.590 INFO:tasks.workunit.client.0.smithi088.stdout:0/847: unlink db/d1b/d36/df9/d66/d82/c8f 0 2024-09-17T04:21:26.595 INFO:tasks.workunit.client.0.smithi088.stdout:4/917: stat d5/d3f/d71/d8b/d68/da4/d5e 0 2024-09-17T04:21:26.595 INFO:tasks.workunit.client.0.smithi088.stdout:7/977: write d2/d4/d7/f7b [967705,17323] 0 2024-09-17T04:21:26.597 INFO:tasks.workunit.client.0.smithi088.stdout:4/918: fdatasync d5/d3f/d71/d8b/d68/dab/dbb/f124 0 2024-09-17T04:21:26.679 INFO:tasks.workunit.client.0.smithi088.stdout:4/919: rename d5/d72 to d5/d3f/d71/d8b/d68/da4/d5e/d83/d12c 0 2024-09-17T04:21:26.680 INFO:tasks.workunit.client.0.smithi088.stdout:0/848: creat db/d67/d7c/dae/d11c/f127 x:0 0 0 2024-09-17T04:21:26.682 INFO:tasks.workunit.client.0.smithi088.stdout:0/849: mknod db/d67/d7c/dae/d11c/db9/dda/c128 0 2024-09-17T04:21:26.684 INFO:tasks.workunit.client.0.smithi088.stdout:0/850: symlink db/d1b/d36/df9/d66/d82/l129 0 2024-09-17T04:21:26.688 INFO:tasks.workunit.client.0.smithi088.stdout:0/851: symlink db/d67/d7c/dae/l12a 0 2024-09-17T04:21:26.691 INFO:tasks.workunit.client.0.smithi088.stdout:0/852: link db/d1b/d36/df9/d59/fd7 db/d1b/d36/d4a/d20/f12b 0 2024-09-17T04:21:26.692 INFO:tasks.workunit.client.0.smithi088.stdout:0/853: write db/d1b/d39/de5/f110 [306157,49807] 0 2024-09-17T04:21:26.694 INFO:tasks.workunit.client.0.smithi088.stdout:0/854: mkdir db/d3c/d12c 0 2024-09-17T04:21:26.697 INFO:tasks.workunit.client.0.smithi088.stdout:0/855: rename db/d67/d7c/df2 to db/d1b/d39/de5/ded/d12d 0 2024-09-17T04:21:26.701 INFO:tasks.workunit.client.0.smithi088.stdout:0/856: mkdir db/d67/d7c/dae/d12e 0 2024-09-17T04:21:26.701 INFO:tasks.workunit.client.0.smithi088.stdout:7/978: write d2/d1d/d2e/db0/d23/d45/d6d/fba [535618,17647] 0 2024-09-17T04:21:26.707 INFO:tasks.workunit.client.0.smithi088.stdout:0/857: dwrite db/d1b/ff8 [0,4194304] 0 2024-09-17T04:21:26.708 INFO:tasks.workunit.client.0.smithi088.stdout:7/979: symlink d2/d1d/d2e/db0/d23/d45/d62/l136 0 2024-09-17T04:21:26.711 INFO:tasks.workunit.client.0.smithi088.stdout:0/858: mkdir db/d67/de2/d12f 0 2024-09-17T04:21:26.712 INFO:tasks.workunit.client.0.smithi088.stdout:0/859: chown db/d67/d7c/dae/d11c/db9/dda 4717 1 2024-09-17T04:21:26.715 INFO:tasks.workunit.client.0.smithi088.stdout:0/860: symlink db/d1b/d36/d4a/l130 0 2024-09-17T04:21:26.716 INFO:tasks.workunit.client.0.smithi088.stdout:0/861: chown db/d1b/d36/df9/d59/cbc 78 1 2024-09-17T04:21:26.718 INFO:tasks.workunit.client.0.smithi088.stdout:7/980: write d2/d96/dc2/fce [472689,120331] 0 2024-09-17T04:21:26.723 INFO:tasks.workunit.client.0.smithi088.stdout:7/981: unlink d2/d1d/d2e/db0/f80 0 2024-09-17T04:21:26.728 INFO:tasks.workunit.client.0.smithi088.stdout:7/982: dwrite d2/d96/fac [0,4194304] 0 2024-09-17T04:21:26.731 INFO:tasks.workunit.client.0.smithi088.stdout:0/862: write db/d1b/d36/d4a/d6a/f26 [774000,34223] 0 2024-09-17T04:21:26.732 INFO:tasks.workunit.client.0.smithi088.stdout:0/863: write db/d1b/d36/df9/d59/da4/d100/f122 [309184,15343] 0 2024-09-17T04:21:26.741 INFO:tasks.workunit.client.0.smithi088.stdout:0/864: dwrite db/d1b/d36/d4a/d6a/faa [0,4194304] 0 2024-09-17T04:21:26.747 INFO:tasks.workunit.client.0.smithi088.stdout:0/865: creat db/d67/de2/d12f/f131 x:0 0 0 2024-09-17T04:21:26.756 INFO:tasks.workunit.client.0.smithi088.stdout:0/866: write db/d67/d7c/dae/d11c/f30 [5829024,44995] 0 2024-09-17T04:21:26.757 INFO:tasks.workunit.client.0.smithi088.stdout:0/867: fsync db/d67/f99 0 2024-09-17T04:21:26.765 INFO:tasks.workunit.client.0.smithi088.stdout:0/868: write db/d67/f79 [386730,119217] 0 2024-09-17T04:21:26.765 INFO:tasks.workunit.client.0.smithi088.stdout:0/869: chown db/d1b/f89 479122 1 2024-09-17T04:21:26.767 INFO:tasks.workunit.client.0.smithi088.stdout:0/870: symlink db/d1b/d39/de5/ded/l132 0 2024-09-17T04:21:26.770 INFO:tasks.workunit.client.0.smithi088.stdout:0/871: mkdir db/d67/d133 0 2024-09-17T04:21:27.105 INFO:tasks.workunit.client.0.smithi088.stdout:5/960: sync 2024-09-17T04:21:27.115 INFO:tasks.workunit.client.0.smithi088.stdout:5/961: dwrite d2/d31/d33/d20/d30/d51/d5e/fbb [0,4194304] 0 2024-09-17T04:21:27.116 INFO:tasks.workunit.client.0.smithi088.stdout:5/962: chown d2/d31/d33/d20/d30/d51/d5e/d6b/ca6 45 1 2024-09-17T04:21:27.129 INFO:tasks.workunit.client.0.smithi088.stdout:5/963: dwrite d2/d31/d33/d20/f84 [0,4194304] 0 2024-09-17T04:21:27.136 INFO:tasks.workunit.client.0.smithi088.stdout:5/964: rename d2/d110/l12f to d2/d31/d33/d20/d30/d9f/l143 0 2024-09-17T04:21:27.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:26 smithi088 ceph-mon[27811]: pgmap v34: 65 pgs: 65 active+clean; 2.9 GiB data, 8.7 GiB used, 528 GiB / 536 GiB avail; 71 MiB/s rd, 145 MiB/s wr, 430 op/s 2024-09-17T04:21:27.139 INFO:tasks.workunit.client.0.smithi088.stdout:5/965: creat d2/d31/d33/d20/d47/dfe/f144 x:0 0 0 2024-09-17T04:21:27.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:26 smithi134 ceph-mon[35201]: pgmap v34: 65 pgs: 65 active+clean; 2.9 GiB data, 8.7 GiB used, 528 GiB / 536 GiB avail; 71 MiB/s rd, 145 MiB/s wr, 430 op/s 2024-09-17T04:21:27.146 INFO:tasks.workunit.client.0.smithi088.stdout:5/966: dwrite d2/d31/d33/d20/d47/fc4 [0,4194304] 0 2024-09-17T04:21:27.149 INFO:tasks.workunit.client.0.smithi088.stdout:5/967: rename d2/d31/d33/d20/d25/d2c/f52 to d2/d105/f145 0 2024-09-17T04:21:27.171 INFO:tasks.workunit.client.0.smithi088.stdout:5/968: dread d2/d31/d33/d20/d30/f4e [0,4194304] 0 2024-09-17T04:21:27.172 INFO:tasks.workunit.client.0.smithi088.stdout:5/969: creat d2/da9/f146 x:0 0 0 2024-09-17T04:21:27.175 INFO:tasks.workunit.client.0.smithi088.stdout:5/970: symlink d2/d31/d33/d20/d25/d49/l147 0 2024-09-17T04:21:27.180 INFO:tasks.workunit.client.0.smithi088.stdout:5/971: creat d2/d31/dd5/f148 x:0 0 0 2024-09-17T04:21:27.182 INFO:tasks.workunit.client.0.smithi088.stdout:5/972: truncate d2/d31/d33/d20/d25/f13b 1405 0 2024-09-17T04:21:27.183 INFO:tasks.workunit.client.0.smithi088.stdout:5/973: readlink d2/d31/d33/d20/d8b/lff 0 2024-09-17T04:21:27.216 INFO:tasks.workunit.client.0.smithi088.stdout:5/974: write d2/da9/db8/fd6 [719511,6377] 0 2024-09-17T04:21:27.219 INFO:tasks.workunit.client.0.smithi088.stdout:5/975: dread d2/d31/d33/d20/d30/d9f/da4/d10c/f111 [0,4194304] 0 2024-09-17T04:21:27.223 INFO:tasks.workunit.client.0.smithi088.stdout:5/976: symlink d2/d31/d33/d20/d25/d2c/d8a/d13e/l149 0 2024-09-17T04:21:27.226 INFO:tasks.workunit.client.0.smithi088.stdout:5/977: write d2/d31/d33/d20/d25/d2c/d8a/dc6/f11e [4219950,49134] 0 2024-09-17T04:21:27.230 INFO:tasks.workunit.client.0.smithi088.stdout:5/978: dread d2/d31/d33/d20/d30/d51/d5e/d6b/ff2 [0,4194304] 0 2024-09-17T04:21:27.231 INFO:tasks.workunit.client.0.smithi088.stdout:5/979: truncate d2/da9/f146 302161 0 2024-09-17T04:21:27.235 INFO:tasks.workunit.client.0.smithi088.stdout:5/980: creat d2/d31/d33/d20/d47/de0/da5/f14a x:0 0 0 2024-09-17T04:21:27.236 INFO:tasks.workunit.client.0.smithi088.stdout:5/981: chown d2/d31/d33/d20/d25/d2c/c80 0 1 2024-09-17T04:21:27.241 INFO:tasks.workunit.client.0.smithi088.stdout:5/982: rename d2/d31/d33/d20/d25/d2c/d8a/db2/ld1 to d2/d31/d33/d20/d30/d51/d5e/l14b 0 2024-09-17T04:21:27.245 INFO:tasks.workunit.client.0.smithi088.stdout:5/983: truncate d2/d31/d33/d20/d30/d51/d5e/d6b/fe6 869550 0 2024-09-17T04:21:27.247 INFO:tasks.workunit.client.0.smithi088.stdout:5/984: creat d2/d31/d33/d20/d25/d2c/d8a/d13e/f14c x:0 0 0 2024-09-17T04:21:27.253 INFO:tasks.workunit.client.0.smithi088.stdout:5/985: dwrite d2/d31/d33/f6f [0,4194304] 0 2024-09-17T04:21:27.256 INFO:tasks.workunit.client.0.smithi088.stdout:5/986: creat d2/d31/d33/d20/d30/d9f/da4/d10c/f14d x:0 0 0 2024-09-17T04:21:27.260 INFO:tasks.workunit.client.0.smithi088.stdout:5/987: rename d2/d31/d33/d20/d25/d2c/c80 to d2/d31/d33/d20/d47/de0/c14e 0 2024-09-17T04:21:27.262 INFO:tasks.workunit.client.0.smithi088.stdout:5/988: mkdir d2/d31/d33/d20/d30/dea/d14f 0 2024-09-17T04:21:27.268 INFO:tasks.workunit.client.0.smithi088.stdout:5/989: dwrite d2/d31/d33/d20/d47/de0/da5/f14a [0,4194304] 0 2024-09-17T04:21:27.269 INFO:tasks.workunit.client.0.smithi088.stdout:5/990: fdatasync d2/d31/d33/d20/d25/d2c/d8a/d13e/d10e/fbf 0 2024-09-17T04:21:27.272 INFO:tasks.workunit.client.0.smithi088.stdout:5/991: creat d2/d31/d33/d20/d47/de0/f150 x:0 0 0 2024-09-17T04:21:27.274 INFO:tasks.workunit.client.0.smithi088.stdout:5/992: mkdir d2/d105/d117/d151 0 2024-09-17T04:21:27.275 INFO:tasks.workunit.client.0.smithi088.stdout:5/993: readlink d2/d31/d33/la8 0 2024-09-17T04:21:27.276 INFO:tasks.workunit.client.0.smithi088.stdout:5/994: readlink d2/d31/d33/d20/d25/d2c/d8a/db2/ld0 0 2024-09-17T04:21:27.282 INFO:tasks.workunit.client.0.smithi088.stdout:5/995: rmdir d2/d31/d33/d20/d25/d2c/df0/d13d 0 2024-09-17T04:21:27.284 INFO:tasks.workunit.client.0.smithi088.stdout:5/996: rmdir d2/d31/d33/d20/d25/d2c/d8a/d13e/d10e 39 2024-09-17T04:21:27.284 INFO:tasks.workunit.client.0.smithi088.stdout:5/997: write d2/d31/d33/f13a [551375,69759] 0 2024-09-17T04:21:27.285 INFO:tasks.workunit.client.0.smithi088.stdout:5/998: write d2/d31/d33/d20/d25/d49/ff3 [3919998,43034] 0 2024-09-17T04:21:27.292 INFO:tasks.workunit.client.0.smithi088.stdout:5/999: rename d2/d31/d33/d20/d25/d2c/d8a/d13e/d10e/fce to d2/d31/d33/d20/d25/d49/f152 0 2024-09-17T04:21:27.371 INFO:tasks.workunit.client.0.smithi088.stdout:8/866: sync 2024-09-17T04:21:27.381 INFO:tasks.workunit.client.0.smithi088.stdout:8/867: dwrite d7/d29/d2a/d38/d3d/d63/d97/fd9 [0,4194304] 0 2024-09-17T04:21:27.385 INFO:tasks.workunit.client.0.smithi088.stdout:8/868: rename d7/d29/d2a/d38/d3d/da0/ld0 to d7/d29/d2a/d38/d3d/l123 0 2024-09-17T04:21:27.387 INFO:tasks.workunit.client.0.smithi088.stdout:8/869: dread - d7/d29/f5c zero size 2024-09-17T04:21:27.389 INFO:tasks.workunit.client.0.smithi088.stdout:8/870: getdents d7/d29/d119 0 2024-09-17T04:21:27.400 INFO:tasks.workunit.client.0.smithi088.stdout:0/872: sync 2024-09-17T04:21:27.400 INFO:tasks.workunit.client.0.smithi088.stdout:7/983: sync 2024-09-17T04:21:27.400 INFO:tasks.workunit.client.0.smithi088.stdout:4/920: sync 2024-09-17T04:21:27.401 INFO:tasks.workunit.client.0.smithi088.stdout:8/871: dwrite d7/dd/d6f/f8d [0,4194304] 0 2024-09-17T04:21:27.402 INFO:tasks.workunit.client.0.smithi088.stdout:4/921: rmdir d5/d32 39 2024-09-17T04:21:27.403 INFO:tasks.workunit.client.0.smithi088.stdout:8/872: chown d7/dd/d31/d47/d55/fdf 4079212 1 2024-09-17T04:21:27.406 INFO:tasks.workunit.client.0.smithi088.stdout:0/873: symlink db/d1b/d36/df9/d59/l134 0 2024-09-17T04:21:27.408 INFO:tasks.workunit.client.0.smithi088.stdout:7/984: truncate d2/d1d/d2e/db0/f30 3630 0 2024-09-17T04:21:27.411 INFO:tasks.workunit.client.0.smithi088.stdout:4/922: dwrite d5/fa1 [0,4194304] 0 2024-09-17T04:21:27.411 INFO:tasks.workunit.client.0.smithi088.stdout:0/874: rename db/d67/d7c/le7 to db/db2/dc0/l135 0 2024-09-17T04:21:27.413 INFO:tasks.workunit.client.0.smithi088.stdout:7/985: dread d2/d96/dbe/f10f [0,4194304] 0 2024-09-17T04:21:27.414 INFO:tasks.workunit.client.0.smithi088.stdout:8/873: symlink d7/d29/d2a/d38/d3d/d63/d97/d111/l124 0 2024-09-17T04:21:27.417 INFO:tasks.workunit.client.0.smithi088.stdout:4/923: dread - d5/d3d/d73/f110 zero size 2024-09-17T04:21:27.423 INFO:tasks.workunit.client.0.smithi088.stdout:4/924: mkdir d5/d3f/d71/d8b/d68/da4/d5e/d83/d12d 0 2024-09-17T04:21:27.424 INFO:tasks.workunit.client.0.smithi088.stdout:4/925: fsync d5/d3f/d71/d8b/d68/dab/deb/f111 0 2024-09-17T04:21:27.426 INFO:tasks.workunit.client.0.smithi088.stdout:4/926: truncate d5/f2d 3663494 0 2024-09-17T04:21:27.427 INFO:tasks.workunit.client.0.smithi088.stdout:8/874: getdents d7/dd/d31/d47/d55/d57 0 2024-09-17T04:21:27.428 INFO:tasks.workunit.client.0.smithi088.stdout:4/927: write d5/d3f/d71/d99/fa6 [4027945,125464] 0 2024-09-17T04:21:27.428 INFO:tasks.workunit.client.0.smithi088.stdout:8/875: dread - d7/d29/daa/ff5 zero size 2024-09-17T04:21:27.429 INFO:tasks.workunit.client.0.smithi088.stdout:8/876: chown d7/dd/ca6 1680 1 2024-09-17T04:21:27.431 INFO:tasks.workunit.client.0.smithi088.stdout:8/877: mkdir d7/d125 0 2024-09-17T04:21:27.432 INFO:tasks.workunit.client.0.smithi088.stdout:4/928: creat d5/d3f/d71/f12e x:0 0 0 2024-09-17T04:21:27.433 INFO:tasks.workunit.client.0.smithi088.stdout:8/878: getdents d7/d29/d2a/d10a 0 2024-09-17T04:21:27.438 INFO:tasks.workunit.client.0.smithi088.stdout:7/986: write d2/d4/d7/d46/fe2 [1438230,13366] 0 2024-09-17T04:21:27.438 INFO:tasks.workunit.client.0.smithi088.stdout:8/879: getdents d7/d29/d2a/d38/d3d/d63/db7 0 2024-09-17T04:21:27.440 INFO:tasks.workunit.client.0.smithi088.stdout:7/987: truncate d2/d4/f33 4541303 0 2024-09-17T04:21:27.452 INFO:tasks.workunit.client.0.smithi088.stdout:8/880: dread d7/dd/d31/f36 [8388608,4194304] 0 2024-09-17T04:21:27.455 INFO:tasks.workunit.client.0.smithi088.stdout:8/881: read - d7/fdd zero size 2024-09-17T04:21:27.457 INFO:tasks.workunit.client.0.smithi088.stdout:7/988: dwrite d2/d1d/d2e/db0/f5e [8388608,4194304] 0 2024-09-17T04:21:27.459 INFO:tasks.workunit.client.0.smithi088.stdout:8/882: creat d7/d29/d2a/d10a/f126 x:0 0 0 2024-09-17T04:21:27.463 INFO:tasks.workunit.client.0.smithi088.stdout:8/883: symlink d7/d29/d2a/d75/l127 0 2024-09-17T04:21:27.471 INFO:tasks.workunit.client.0.smithi088.stdout:7/989: dread d2/d1d/d2e/db0/d23/d45/d62/fcb [0,4194304] 0 2024-09-17T04:21:27.472 INFO:tasks.workunit.client.0.smithi088.stdout:7/990: write d2/d4/f33 [664876,3564] 0 2024-09-17T04:21:27.474 INFO:tasks.workunit.client.0.smithi088.stdout:8/884: write d7/d11f/f10b [930611,84141] 0 2024-09-17T04:21:27.479 INFO:tasks.workunit.client.0.smithi088.stdout:8/885: symlink d7/d11f/l128 0 2024-09-17T04:21:27.481 INFO:tasks.workunit.client.0.smithi088.stdout:8/886: mkdir d7/d29/daa/d129 0 2024-09-17T04:21:27.482 INFO:tasks.workunit.client.0.smithi088.stdout:8/887: chown d7/d29/d2a/d38/d3d/da0/da8/c101 45411 1 2024-09-17T04:21:27.486 INFO:tasks.workunit.client.0.smithi088.stdout:7/991: dwrite d2/f60 [0,4194304] 0 2024-09-17T04:21:27.487 INFO:tasks.workunit.client.0.smithi088.stdout:8/888: creat d7/dd/d31/d47/d55/d57/f12a x:0 0 0 2024-09-17T04:21:27.488 INFO:tasks.workunit.client.0.smithi088.stdout:7/992: fsync d2/d1d/f58 0 2024-09-17T04:21:27.490 INFO:tasks.workunit.client.0.smithi088.stdout:8/889: mkdir d7/dd/d31/dca/d12b 0 2024-09-17T04:21:27.496 INFO:tasks.workunit.client.0.smithi088.stdout:7/993: dwrite d2/d1d/d2e/db0/d23/d45/d6d/f10a [0,4194304] 0 2024-09-17T04:21:27.499 INFO:tasks.workunit.client.0.smithi088.stdout:8/890: mkdir d7/d29/d2a/d38/d3d/d63/d97/d111/d12c 0 2024-09-17T04:21:27.499 INFO:tasks.workunit.client.0.smithi088.stdout:7/994: rmdir d2/d8d 39 2024-09-17T04:21:27.500 INFO:tasks.workunit.client.0.smithi088.stdout:8/891: symlink d7/d11f/d79/l12d 0 2024-09-17T04:21:27.519 INFO:tasks.workunit.client.0.smithi088.stdout:7/995: dwrite d2/d79/f7a [0,4194304] 0 2024-09-17T04:21:27.519 INFO:tasks.workunit.client.0.smithi088.stdout:8/892: dwrite d7/d29/d2a/d38/f9c [0,4194304] 0 2024-09-17T04:21:27.522 INFO:tasks.workunit.client.0.smithi088.stdout:7/996: read d2/d96/dc2/fce [1660497,127211] 0 2024-09-17T04:21:27.523 INFO:tasks.workunit.client.0.smithi088.stdout:7/997: chown d2/d96/dbe/fc8 87482567 1 2024-09-17T04:21:27.528 INFO:tasks.workunit.client.0.smithi088.stdout:7/998: mkdir d2/d1d/d2e/db0/d23/d45/d62/d82/d133/d137 0 2024-09-17T04:21:27.530 INFO:tasks.workunit.client.0.smithi088.stdout:7/999: write d2/f21 [4238204,125617] 0 2024-09-17T04:21:27.541 INFO:tasks.workunit.client.0.smithi088.stdout:8/893: dwrite d7/dd/d31/d47/dc6/fd4 [0,4194304] 0 2024-09-17T04:21:27.542 INFO:tasks.workunit.client.0.smithi088.stdout:8/894: stat d7/d29/daa/d129 0 2024-09-17T04:21:27.552 INFO:tasks.workunit.client.0.smithi088.stdout:8/895: write d7/d29/d2a/d38/d3d/da0/da8/fe8 [921431,83505] 0 2024-09-17T04:21:27.825 INFO:tasks.workunit.client.0.smithi088.stdout:0/875: sync 2024-09-17T04:21:27.825 INFO:tasks.workunit.client.0.smithi088.stdout:8/896: sync 2024-09-17T04:21:27.826 INFO:tasks.workunit.client.0.smithi088.stdout:4/929: sync 2024-09-17T04:21:27.828 INFO:tasks.workunit.client.0.smithi088.stdout:4/930: symlink d5/d3f/d71/d8b/d68/da4/d5e/d113/l12f 0 2024-09-17T04:21:27.830 INFO:tasks.workunit.client.0.smithi088.stdout:8/897: truncate d7/d29/d2a/d38/d3d/da0/da8/fae 939654 0 2024-09-17T04:21:27.832 INFO:tasks.workunit.client.0.smithi088.stdout:0/876: dwrite db/d1b/d36/d4a/d20/fa3 [4194304,4194304] 0 2024-09-17T04:21:27.836 INFO:tasks.workunit.client.0.smithi088.stdout:0/877: dread db/d1b/d36/df9/d66/fb3 [0,4194304] 0 2024-09-17T04:21:27.838 INFO:tasks.workunit.client.0.smithi088.stdout:4/931: dwrite d5/d32/d6b/f86 [0,4194304] 0 2024-09-17T04:21:27.839 INFO:tasks.workunit.client.0.smithi088.stdout:0/878: read db/d1b/d36/df9/d59/da4/d100/f122 [259488,9747] 0 2024-09-17T04:21:27.840 INFO:tasks.workunit.client.0.smithi088.stdout:0/879: fdatasync db/d1b/d36/df9/d66/f88 0 2024-09-17T04:21:27.841 INFO:tasks.workunit.client.0.smithi088.stdout:0/880: chown db/f12 62759 1 2024-09-17T04:21:27.842 INFO:tasks.workunit.client.0.smithi088.stdout:0/881: fdatasync db/d67/d7c/dae/d11c/f30 0 2024-09-17T04:21:27.843 INFO:tasks.workunit.client.0.smithi088.stdout:4/932: creat d5/d3f/d71/d8b/d68/dab/f130 x:0 0 0 2024-09-17T04:21:27.852 INFO:tasks.workunit.client.0.smithi088.stdout:8/898: write d7/d29/d2a/f35 [415324,63081] 0 2024-09-17T04:21:27.855 INFO:tasks.workunit.client.0.smithi088.stdout:0/882: rename db/d1b/d36/df9/d66/d82/l9e to db/d1b/d39/l136 0 2024-09-17T04:21:27.855 INFO:tasks.workunit.client.0.smithi088.stdout:0/883: chown db 11458404 1 2024-09-17T04:21:27.856 INFO:tasks.workunit.client.0.smithi088.stdout:8/899: mkdir d7/d29/d2a/d38/d3d/da0/da8/d12e 0 2024-09-17T04:21:27.859 INFO:tasks.workunit.client.0.smithi088.stdout:0/884: creat db/d1b/d39/de5/ded/f137 x:0 0 0 2024-09-17T04:21:27.860 INFO:tasks.workunit.client.0.smithi088.stdout:0/885: fsync db/d67/d7c/dae/d11c/f30 0 2024-09-17T04:21:27.860 INFO:tasks.workunit.client.0.smithi088.stdout:8/900: readlink d7/d29/d2a/d75/lb4 0 2024-09-17T04:21:27.863 INFO:tasks.workunit.client.0.smithi088.stdout:0/886: truncate db/d1b/d36/df9/d59/da4/d100/f122 305888 0 2024-09-17T04:21:27.866 INFO:tasks.workunit.client.0.smithi088.stdout:4/933: dwrite d5/d3f/d71/d99/ffd [0,4194304] 0 2024-09-17T04:21:27.870 INFO:tasks.workunit.client.0.smithi088.stdout:0/887: fsync db/d1b/d39/f3d 0 2024-09-17T04:21:27.871 INFO:tasks.workunit.client.0.smithi088.stdout:4/934: fdatasync d5/d3f/fd3 0 2024-09-17T04:21:27.892 INFO:tasks.workunit.client.0.smithi088.stdout:4/935: dread d5/d3f/d71/d8b/d68/da4/d5e/fb5 [0,4194304] 0 2024-09-17T04:21:27.893 INFO:tasks.workunit.client.0.smithi088.stdout:0/888: dread db/d1b/d36/d4a/d20/fa3 [0,4194304] 0 2024-09-17T04:21:27.894 INFO:tasks.workunit.client.0.smithi088.stdout:4/936: write d5/d32/d6b/dd2/d109/d118/d122/dd0/f108 [1435913,7860] 0 2024-09-17T04:21:27.894 INFO:tasks.workunit.client.0.smithi088.stdout:0/889: dread - db/d1b/d36/f124 zero size 2024-09-17T04:21:27.896 INFO:tasks.workunit.client.0.smithi088.stdout:0/890: write db/d1b/d36/df9/d66/f88 [664271,48153] 0 2024-09-17T04:21:27.907 INFO:tasks.workunit.client.0.smithi088.stdout:4/937: dwrite d5/d3d/f47 [0,4194304] 0 2024-09-17T04:21:27.930 INFO:tasks.workunit.client.0.smithi088.stdout:4/938: dread d5/d3d/f80 [0,4194304] 0 2024-09-17T04:21:27.937 INFO:tasks.workunit.client.0.smithi088.stdout:4/939: truncate d5/d3f/d71/d8b/d68/da4/d5e/f107 37966 0 2024-09-17T04:21:27.946 INFO:tasks.workunit.client.0.smithi088.stdout:4/940: write d5/f2d [2908607,107307] 0 2024-09-17T04:21:27.951 INFO:tasks.workunit.client.0.smithi088.stdout:4/941: creat d5/d3f/d71/d8b/d68/da4/d5e/f131 x:0 0 0 2024-09-17T04:21:27.952 INFO:tasks.workunit.client.0.smithi088.stdout:4/942: dread - d5/d32/d6b/dd2/d109/d118/d122/f11c zero size 2024-09-17T04:21:27.953 INFO:tasks.workunit.client.0.smithi088.stdout:4/943: write d5/d32/d6b/dd2/d109/d10c/f11a [551760,16311] 0 2024-09-17T04:21:27.957 INFO:tasks.workunit.client.0.smithi088.stdout:4/944: dread d5/d3d/f47 [0,4194304] 0 2024-09-17T04:21:27.957 INFO:tasks.workunit.client.0.smithi088.stdout:4/945: chown d5/d3f/d71/l12b 2739510 1 2024-09-17T04:21:27.964 INFO:tasks.workunit.client.0.smithi088.stdout:4/946: link d5/d3d/d73/cf6 d5/d32/d6b/c132 0 2024-09-17T04:21:27.967 INFO:tasks.workunit.client.0.smithi088.stdout:4/947: unlink d5/d3f/d71/d8b/d68/dab/dbb/lbd 0 2024-09-17T04:21:27.968 INFO:tasks.workunit.client.0.smithi088.stdout:4/948: chown d5/d32/d6b/ldf 130 1 2024-09-17T04:21:27.969 INFO:tasks.workunit.client.0.smithi088.stdout:4/949: chown d5/d3f/d71/d8b/d68/da4/l102 4634855 1 2024-09-17T04:21:27.972 INFO:tasks.workunit.client.0.smithi088.stdout:4/950: creat d5/d32/d6b/dd2/d109/f133 x:0 0 0 2024-09-17T04:21:27.973 INFO:tasks.workunit.client.0.smithi088.stdout:4/951: chown d5/c5c 741044713 1 2024-09-17T04:21:27.976 INFO:tasks.workunit.client.0.smithi088.stdout:4/952: rename d5/d3f/d71/dd8/f123 to d5/d11e/f134 0 2024-09-17T04:21:27.979 INFO:tasks.workunit.client.0.smithi088.stdout:4/953: read - d5/d3d/d73/fcb zero size 2024-09-17T04:21:28.227 INFO:tasks.workunit.client.0.smithi088.stdout:0/891: sync 2024-09-17T04:21:28.228 INFO:tasks.workunit.client.0.smithi088.stdout:4/954: sync 2024-09-17T04:21:28.228 INFO:tasks.workunit.client.0.smithi088.stdout:8/901: sync 2024-09-17T04:21:28.230 INFO:tasks.workunit.client.0.smithi088.stdout:4/955: mknod d5/d3d/d73/c135 0 2024-09-17T04:21:28.231 INFO:tasks.workunit.client.0.smithi088.stdout:0/892: dread - db/d67/d7c/dae/d11c/fc9 zero size 2024-09-17T04:21:28.236 INFO:tasks.workunit.client.0.smithi088.stdout:0/893: creat db/d1b/d39/d83/f138 x:0 0 0 2024-09-17T04:21:28.239 INFO:tasks.workunit.client.0.smithi088.stdout:8/902: rmdir d7/dd/d31/dca/d12b 0 2024-09-17T04:21:28.245 INFO:tasks.workunit.client.0.smithi088.stdout:4/956: dwrite d5/d32/d6b/f9c [0,4194304] 0 2024-09-17T04:21:28.246 INFO:tasks.workunit.client.0.smithi088.stdout:4/957: chown d5/d32/f79 2437796 1 2024-09-17T04:21:28.250 INFO:tasks.workunit.client.0.smithi088.stdout:0/894: write db/d1b/d39/f80 [313794,11139] 0 2024-09-17T04:21:28.255 INFO:tasks.workunit.client.0.smithi088.stdout:0/895: creat db/d1b/d36/df9/d59/f139 x:0 0 0 2024-09-17T04:21:28.258 INFO:tasks.workunit.client.0.smithi088.stdout:0/896: truncate db/d1b/d36/d4a/d20/f12b 1227265 0 2024-09-17T04:21:28.259 INFO:tasks.workunit.client.0.smithi088.stdout:0/897: chown db/d1b/d36/df9/d9f/ca5 1 1 2024-09-17T04:21:28.260 INFO:tasks.workunit.client.0.smithi088.stdout:0/898: dread - db/d67/d7c/dae/d11c/db9/dda/ffe zero size 2024-09-17T04:21:28.262 INFO:tasks.workunit.client.0.smithi088.stdout:0/899: mkdir db/d13a 0 2024-09-17T04:21:28.266 INFO:tasks.workunit.client.0.smithi088.stdout:0/900: symlink db/d1b/d36/d4a/l13b 0 2024-09-17T04:21:28.273 INFO:tasks.workunit.client.0.smithi088.stdout:0/901: creat db/d67/d133/f13c x:0 0 0 2024-09-17T04:21:28.274 INFO:tasks.workunit.client.0.smithi088.stdout:0/902: truncate db/d1b/d36/df9/dd5/f11b 640250 0 2024-09-17T04:21:28.277 INFO:tasks.workunit.client.0.smithi088.stdout:0/903: link db/d1b/d36/df9/d59/f65 db/db2/dc0/d121/f13d 0 2024-09-17T04:21:28.281 INFO:tasks.workunit.client.0.smithi088.stdout:0/904: getdents db/db2 0 2024-09-17T04:21:28.282 INFO:tasks.workunit.client.0.smithi088.stdout:0/905: rmdir db/d1b/d36/df9/d9f/dc4 39 2024-09-17T04:21:28.283 INFO:tasks.workunit.client.0.smithi088.stdout:0/906: read db/d1b/d36/d4a/d20/f7a [244530,1304] 0 2024-09-17T04:21:28.285 INFO:tasks.workunit.client.0.smithi088.stdout:0/907: creat db/d67/d7c/dae/d11c/db9/f13e x:0 0 0 2024-09-17T04:21:28.305 INFO:tasks.workunit.client.0.smithi088.stdout:0/908: write db/d1b/d36/df9/d66/f70 [1200854,95263] 0 2024-09-17T04:21:28.306 INFO:tasks.workunit.client.0.smithi088.stdout:0/909: write db/d67/d7c/dae/d11c/db9/fe8 [387319,107891] 0 2024-09-17T04:21:28.310 INFO:tasks.workunit.client.0.smithi088.stdout:0/910: rename db/d1b/l108 to db/d3c/d116/l13f 0 2024-09-17T04:21:28.311 INFO:tasks.workunit.client.0.smithi088.stdout:0/911: dread - db/d67/d7c/dae/d11c/db9/f13e zero size 2024-09-17T04:21:28.314 INFO:tasks.workunit.client.0.smithi088.stdout:0/912: mkdir db/d1b/d36/df9/dd5/d140 0 2024-09-17T04:21:28.319 INFO:tasks.workunit.client.0.smithi088.stdout:0/913: rename db/d67/d7c/dae/d11c/db9/c111 to db/d67/d7c/dae/d11c/c141 0 2024-09-17T04:21:28.322 INFO:tasks.workunit.client.0.smithi088.stdout:0/914: creat db/d1b/d36/df9/d59/da4/d100/f142 x:0 0 0 2024-09-17T04:21:28.328 INFO:tasks.workunit.client.0.smithi088.stdout:0/915: rename db/d1b/d36/d4a/d6a/c93 to db/db2/c143 0 2024-09-17T04:21:28.336 INFO:tasks.workunit.client.0.smithi088.stdout:0/916: dread db/d67/d7c/dae/d11c/db9/dda/f104 [0,4194304] 0 2024-09-17T04:21:28.342 INFO:tasks.workunit.client.0.smithi088.stdout:0/917: link db/d1b/d36/d4a/d20/f12b db/d1b/d36/d4a/dd3/f144 0 2024-09-17T04:21:28.344 INFO:tasks.workunit.client.0.smithi088.stdout:0/918: creat db/d1b/d36/df9/dd5/d140/f145 x:0 0 0 2024-09-17T04:21:28.345 INFO:tasks.workunit.client.0.smithi088.stdout:0/919: rmdir db/d1b/d36/d4a 39 2024-09-17T04:21:28.685 INFO:tasks.workunit.client.0.smithi088.stdout:8/903: sync 2024-09-17T04:21:28.687 INFO:tasks.workunit.client.0.smithi088.stdout:8/904: fsync d7/dd/d31/d47/d55/f99 0 2024-09-17T04:21:28.693 INFO:tasks.workunit.client.0.smithi088.stdout:8/905: truncate d7/dd/d31/dca/de6/ff1 2985593 0 2024-09-17T04:21:28.695 INFO:tasks.workunit.client.0.smithi088.stdout:8/906: creat d7/d29/daa/d129/f12f x:0 0 0 2024-09-17T04:21:28.699 INFO:tasks.workunit.client.0.smithi088.stdout:8/907: dread d7/d29/d2a/d38/d3d/d63/d97/fd9 [0,4194304] 0 2024-09-17T04:21:28.714 INFO:tasks.workunit.client.0.smithi088.stdout:8/908: dread d7/f8 [0,4194304] 0 2024-09-17T04:21:28.716 INFO:tasks.workunit.client.0.smithi088.stdout:8/909: mkdir d7/dd/d31/dca/de6/d130 0 2024-09-17T04:21:28.718 INFO:tasks.workunit.client.0.smithi088.stdout:8/910: creat d7/d29/d2a/d38/d3d/d63/d97/d111/f131 x:0 0 0 2024-09-17T04:21:28.858 INFO:tasks.workunit.client.0.smithi088.stdout:4/958: sync 2024-09-17T04:21:28.858 INFO:tasks.workunit.client.0.smithi088.stdout:0/920: sync 2024-09-17T04:21:28.861 INFO:tasks.workunit.client.0.smithi088.stdout:0/921: fsync db/f4c 0 2024-09-17T04:21:28.862 INFO:tasks.workunit.client.0.smithi088.stdout:0/922: stat db/d1b/d36/df9/d66/d82/c92 0 2024-09-17T04:21:28.862 INFO:tasks.workunit.client.0.smithi088.stdout:4/959: rename d5/d3f/c105 to d5/d3f/d71/d8b/d68/da4/d5e/d83/c136 0 2024-09-17T04:21:28.866 INFO:tasks.workunit.client.0.smithi088.stdout:0/923: symlink db/db2/dc0/d121/l146 0 2024-09-17T04:21:28.867 INFO:tasks.workunit.client.0.smithi088.stdout:0/924: write db/d1b/d36/df9/d66/fab [4199548,96383] 0 2024-09-17T04:21:28.869 INFO:tasks.workunit.client.0.smithi088.stdout:0/925: truncate db/d1b/d36/df9/d59/f139 220941 0 2024-09-17T04:21:28.870 INFO:tasks.workunit.client.0.smithi088.stdout:4/960: fsync d5/d3f/d71/d8b/d68/da4/d5e/fb5 0 2024-09-17T04:21:28.877 INFO:tasks.workunit.client.0.smithi088.stdout:4/961: dwrite d5/d32/d6b/dd2/d109/fe5 [0,4194304] 0 2024-09-17T04:21:28.877 INFO:tasks.workunit.client.0.smithi088.stdout:4/962: readlink d5/l19 0 2024-09-17T04:21:28.881 INFO:tasks.workunit.client.0.smithi088.stdout:4/963: mkdir d5/d3d/d137 0 2024-09-17T04:21:28.887 INFO:tasks.workunit.client.0.smithi088.stdout:4/964: dwrite d5/d3f/d71/f126 [0,4194304] 0 2024-09-17T04:21:28.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:28 smithi088 ceph-mon[27811]: pgmap v35: 65 pgs: 65 active+clean; 2.9 GiB data, 8.7 GiB used, 528 GiB / 536 GiB avail; 47 MiB/s rd, 99 MiB/s wr, 283 op/s 2024-09-17T04:21:28.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:28 smithi134 ceph-mon[35201]: pgmap v35: 65 pgs: 65 active+clean; 2.9 GiB data, 8.7 GiB used, 528 GiB / 536 GiB avail; 47 MiB/s rd, 99 MiB/s wr, 283 op/s 2024-09-17T04:21:28.896 INFO:tasks.workunit.client.0.smithi088.stdout:0/926: dwrite f0 [0,4194304] 0 2024-09-17T04:21:28.898 INFO:tasks.workunit.client.0.smithi088.stdout:4/965: creat d5/d32/d6b/dd2/d109/d118/d122/f138 x:0 0 0 2024-09-17T04:21:28.901 INFO:tasks.workunit.client.0.smithi088.stdout:8/911: sync 2024-09-17T04:21:28.902 INFO:tasks.workunit.client.0.smithi088.stdout:0/927: link db/d67/d7c/dae/d11c/f30 db/db2/f147 0 2024-09-17T04:21:28.902 INFO:tasks.workunit.client.0.smithi088.stdout:8/912: dread - d7/d7f/f115 zero size 2024-09-17T04:21:28.902 INFO:tasks.workunit.client.0.smithi088.stdout:4/966: mknod d5/d3d/dee/c139 0 2024-09-17T04:21:28.904 INFO:tasks.workunit.client.0.smithi088.stdout:0/928: readlink db/d1b/d36/df9/d59/da4/dc8/l114 0 2024-09-17T04:21:28.905 INFO:tasks.workunit.client.0.smithi088.stdout:0/929: write db/d1b/d39/fd0 [580883,32664] 0 2024-09-17T04:21:28.910 INFO:tasks.workunit.client.0.smithi088.stdout:8/913: write d7/dd/d31/f3b [260612,96020] 0 2024-09-17T04:21:28.911 INFO:tasks.workunit.client.0.smithi088.stdout:4/967: rename d5/d3f/f3b to d5/d3f/d71/d8b/d68/da4/f13a 0 2024-09-17T04:21:28.912 INFO:tasks.workunit.client.0.smithi088.stdout:4/968: chown d5/d3f/d71/dd8/fda 6 1 2024-09-17T04:21:28.913 INFO:tasks.workunit.client.0.smithi088.stdout:4/969: chown d5/d3d/dee/f121 123 1 2024-09-17T04:21:28.913 INFO:tasks.workunit.client.0.smithi088.stdout:8/914: symlink d7/dd/d31/dca/de6/l132 0 2024-09-17T04:21:28.913 INFO:tasks.workunit.client.0.smithi088.stdout:8/915: readlink d7/d11f/l128 0 2024-09-17T04:21:28.914 INFO:tasks.workunit.client.0.smithi088.stdout:8/916: chown d7/d29/d2a/lbd 327155 1 2024-09-17T04:21:28.914 INFO:tasks.workunit.client.0.smithi088.stdout:0/930: rename db/db2/dc0/l112 to db/d1b/d36/df9/d59/da4/l148 0 2024-09-17T04:21:28.919 INFO:tasks.workunit.client.0.smithi088.stdout:0/931: mknod db/d1b/d36/df9/d59/da4/c149 0 2024-09-17T04:21:28.922 INFO:tasks.workunit.client.0.smithi088.stdout:8/917: rename d7/d29/d2a/d38/d42/c90 to d7/dd/d31/dca/c133 0 2024-09-17T04:21:28.922 INFO:tasks.workunit.client.0.smithi088.stdout:8/918: stat d7/d29/d2a/d38/d42 0 2024-09-17T04:21:28.923 INFO:tasks.workunit.client.0.smithi088.stdout:0/932: dread - db/d1b/d36/d4a/fa2 zero size 2024-09-17T04:21:28.924 INFO:tasks.workunit.client.0.smithi088.stdout:4/970: getdents d5/d3d/d73/de7 0 2024-09-17T04:21:28.925 INFO:tasks.workunit.client.0.smithi088.stdout:0/933: read db/d1b/d39/f5c [1979012,3927] 0 2024-09-17T04:21:28.927 INFO:tasks.workunit.client.0.smithi088.stdout:0/934: symlink db/d3c/l14a 0 2024-09-17T04:21:28.927 INFO:tasks.workunit.client.0.smithi088.stdout:8/919: rmdir d7/dd/d31/d47/d55/d57/d6b/ddb 39 2024-09-17T04:21:28.929 INFO:tasks.workunit.client.0.smithi088.stdout:4/971: truncate d5/d3f/d71/d8b/d68/dab/dbb/fc8 581771 0 2024-09-17T04:21:28.931 INFO:tasks.workunit.client.0.smithi088.stdout:8/920: mkdir d7/d29/d2a/d38/d3d/d63/db7/d134 0 2024-09-17T04:21:28.932 INFO:tasks.workunit.client.0.smithi088.stdout:8/921: stat d7/dd/d6f/fb9 0 2024-09-17T04:21:28.933 INFO:tasks.workunit.client.0.smithi088.stdout:0/935: dwrite db/d1b/d36/df9/d9f/fd4 [0,4194304] 0 2024-09-17T04:21:28.933 INFO:tasks.workunit.client.0.smithi088.stdout:4/972: mkdir d5/d32/d13b 0 2024-09-17T04:21:28.933 INFO:tasks.workunit.client.0.smithi088.stdout:8/922: stat d7/d29/d2a/d75 0 2024-09-17T04:21:28.935 INFO:tasks.workunit.client.0.smithi088.stdout:0/936: truncate db/f13 194763 0 2024-09-17T04:21:28.940 INFO:tasks.workunit.client.0.smithi088.stdout:8/923: creat d7/d29/d2a/d38/d3d/d63/d97/f135 x:0 0 0 2024-09-17T04:21:28.941 INFO:tasks.workunit.client.0.smithi088.stdout:0/937: mknod db/d1b/d36/df9/d59/c14b 0 2024-09-17T04:21:28.945 INFO:tasks.workunit.client.0.smithi088.stdout:8/924: rmdir d7/dd/d31/d47/d55/d57/d6b 39 2024-09-17T04:21:28.948 INFO:tasks.workunit.client.0.smithi088.stdout:0/938: truncate db/f72 110519 0 2024-09-17T04:21:28.956 INFO:tasks.workunit.client.0.smithi088.stdout:0/939: fsync db/f53 0 2024-09-17T04:21:28.957 INFO:tasks.workunit.client.0.smithi088.stdout:0/940: fdatasync db/d67/d7c/f113 0 2024-09-17T04:21:28.961 INFO:tasks.workunit.client.0.smithi088.stdout:4/973: dwrite d5/d32/d6b/fd4 [0,4194304] 0 2024-09-17T04:21:28.966 INFO:tasks.workunit.client.0.smithi088.stdout:4/974: rmdir d5/d3f/d71/d8b/d68 39 2024-09-17T04:21:28.968 INFO:tasks.workunit.client.0.smithi088.stdout:0/941: creat db/f14c x:0 0 0 2024-09-17T04:21:28.969 INFO:tasks.workunit.client.0.smithi088.stdout:8/925: dread d7/d11f/d79/f81 [0,4194304] 0 2024-09-17T04:21:28.976 INFO:tasks.workunit.client.0.smithi088.stdout:8/926: mkdir d7/dd/d31/d47/dc6/d104/d136 0 2024-09-17T04:21:28.982 INFO:tasks.workunit.client.0.smithi088.stdout:0/942: write db/db2/dc0/f9b [817779,1825] 0 2024-09-17T04:21:28.982 INFO:tasks.workunit.client.0.smithi088.stdout:8/927: mknod d7/dd/d31/d47/dc6/d104/c137 0 2024-09-17T04:21:28.985 INFO:tasks.workunit.client.0.smithi088.stdout:4/975: symlink d5/d3f/d71/d8b/d68/da4/l13c 0 2024-09-17T04:21:28.993 INFO:tasks.workunit.client.0.smithi088.stdout:4/976: chown d5/d3f/d71/d8b/d68/da4/l102 4173053 1 2024-09-17T04:21:28.997 INFO:tasks.workunit.client.0.smithi088.stdout:4/977: creat d5/d3f/d71/dd8/f13d x:0 0 0 2024-09-17T04:21:28.997 INFO:tasks.workunit.client.0.smithi088.stdout:0/943: dwrite db/d67/d7c/dae/d11c/db9/dda/f104 [0,4194304] 0 2024-09-17T04:21:28.999 INFO:tasks.workunit.client.0.smithi088.stdout:0/944: truncate db/d1b/f10e 714926 0 2024-09-17T04:21:29.000 INFO:tasks.workunit.client.0.smithi088.stdout:4/978: stat d5/l12 0 2024-09-17T04:21:29.002 INFO:tasks.workunit.client.0.smithi088.stdout:8/928: dread d7/d29/d2a/f2b [0,4194304] 0 2024-09-17T04:21:29.008 INFO:tasks.workunit.client.0.smithi088.stdout:8/929: rename d7/dd/d31/dca/de6/c112 to d7/dd/d31/d47/dc6/d104/d136/c138 0 2024-09-17T04:21:29.010 INFO:tasks.workunit.client.0.smithi088.stdout:4/979: link d5/d3f/c37 d5/d3f/d71/d8b/d68/dab/c13e 0 2024-09-17T04:21:29.011 INFO:tasks.workunit.client.0.smithi088.stdout:8/930: fsync d7/dd/f28 0 2024-09-17T04:21:29.012 INFO:tasks.workunit.client.0.smithi088.stdout:8/931: chown d7/d29/d2a/d38/d3d/da0 93 1 2024-09-17T04:21:29.016 INFO:tasks.workunit.client.0.smithi088.stdout:4/980: dwrite d5/d3d/dee/f121 [4194304,4194304] 0 2024-09-17T04:21:29.022 INFO:tasks.workunit.client.0.smithi088.stdout:4/981: creat d5/d3f/d71/d8b/d68/da4/d5e/d83/d12d/f13f x:0 0 0 2024-09-17T04:21:29.029 INFO:tasks.workunit.client.0.smithi088.stdout:4/982: rename d5/d3d/d73/cf6 to d5/d3f/d71/d8b/d68/dab/dbb/c140 0 2024-09-17T04:21:29.029 INFO:tasks.workunit.client.0.smithi088.stdout:8/932: dwrite d7/dd/d31/f6d [0,4194304] 0 2024-09-17T04:21:29.030 INFO:tasks.workunit.client.0.smithi088.stdout:4/983: stat d5/d3d/d73/ld7 0 2024-09-17T04:21:29.033 INFO:tasks.workunit.client.0.smithi088.stdout:4/984: mknod d5/d3f/d71/dd8/c141 0 2024-09-17T04:21:29.034 INFO:tasks.workunit.client.0.smithi088.stdout:4/985: chown d5/d3f/d71/dd8/c141 252 1 2024-09-17T04:21:29.037 INFO:tasks.workunit.client.0.smithi088.stdout:4/986: mkdir d5/d3f/d71/d8b/d68/da4/d5e/d83/d12c/d142 0 2024-09-17T04:21:29.040 INFO:tasks.workunit.client.0.smithi088.stdout:4/987: mknod d5/d3d/d73/de7/c143 0 2024-09-17T04:21:29.043 INFO:tasks.workunit.client.0.smithi088.stdout:8/933: dwrite d7/d29/d2a/d38/d3d/da0/da8/fae [0,4194304] 0 2024-09-17T04:21:29.047 INFO:tasks.workunit.client.0.smithi088.stdout:8/934: symlink d7/d29/d119/l139 0 2024-09-17T04:21:29.048 INFO:tasks.workunit.client.0.smithi088.stdout:4/988: dread d5/d3f/d71/d8b/d68/da4/d5e/d83/fef [0,4194304] 0 2024-09-17T04:21:29.048 INFO:tasks.workunit.client.0.smithi088.stdout:4/989: stat d5/d3d/dee 0 2024-09-17T04:21:29.060 INFO:tasks.workunit.client.0.smithi088.stdout:8/935: dwrite d7/fdd [0,4194304] 0 2024-09-17T04:21:29.061 INFO:tasks.workunit.client.0.smithi088.stdout:8/936: dread - d7/d29/d2a/d10a/f126 zero size 2024-09-17T04:21:29.065 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-17T04:21:29.065 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-09-17T04:21:29.069 INFO:tasks.workunit.client.0.smithi088.stdout:8/937: write d7/dd/d31/d47/d55/d57/f12a [3704,84316] 0 2024-09-17T04:21:29.070 INFO:tasks.workunit.client.0.smithi088.stdout:8/938: rmdir d7/d10d 39 2024-09-17T04:21:29.071 INFO:tasks.workunit.client.0.smithi088.stdout:8/939: fsync d7/dd/d31/d47/d55/fdf 0 2024-09-17T04:21:29.073 INFO:tasks.workunit.client.0.smithi088.stdout:8/940: creat d7/d29/d2a/d38/d42/d117/f13a x:0 0 0 2024-09-17T04:21:29.074 INFO:tasks.workunit.client.0.smithi088.stdout:8/941: fdatasync d7/dd/d31/d47/dc6/f11c 0 2024-09-17T04:21:29.075 INFO:tasks.workunit.client.0.smithi088.stdout:4/990: dread d5/f4b [0,4194304] 0 2024-09-17T04:21:29.077 INFO:tasks.workunit.client.0.smithi088.stdout:4/991: mkdir d5/d11e/d144 0 2024-09-17T04:21:29.078 INFO:tasks.workunit.client.0.smithi088.stdout:4/992: truncate d5/d3f/d71/d8b/d68/dab/deb/f111 889918 0 2024-09-17T04:21:29.080 INFO:tasks.workunit.client.0.smithi088.stdout:4/993: mknod d5/d32/c145 0 2024-09-17T04:21:29.083 INFO:tasks.workunit.client.0.smithi088.stdout:4/994: mknod d5/d3f/d71/d8b/d68/da4/d5e/d83/d12c/d142/c146 0 2024-09-17T04:21:29.083 INFO:tasks.workunit.client.0.smithi088.stdout:8/942: truncate d7/d29/d2a/d38/f9c 3873665 0 2024-09-17T04:21:29.084 INFO:tasks.workunit.client.0.smithi088.stdout:4/995: dread - d5/d3f/d71/d8b/d68/da4/f8a zero size 2024-09-17T04:21:29.086 INFO:tasks.workunit.client.0.smithi088.stdout:8/943: unlink d7/d29/d2a/d38/d3d/ca4 0 2024-09-17T04:21:29.086 INFO:tasks.workunit.client.0.smithi088.stdout:4/996: truncate d5/f1a 2861711 0 2024-09-17T04:21:29.087 INFO:tasks.workunit.client.0.smithi088.stdout:8/944: fdatasync d7/d29/d2a/d38/d42/f5b 0 2024-09-17T04:21:29.088 INFO:tasks.workunit.client.0.smithi088.stdout:4/997: fsync d5/d3f/d71/d8b/d68/da4/d5e/fc0 0 2024-09-17T04:21:29.095 INFO:tasks.workunit.client.0.smithi088.stdout:8/945: dwrite d7/dd/d31/d47/dc6/d104/ff7 [0,4194304] 0 2024-09-17T04:21:29.099 INFO:tasks.workunit.client.0.smithi088.stdout:4/998: dwrite d5/d3f/d71/d8b/d68/fa5 [0,4194304] 0 2024-09-17T04:21:29.102 INFO:tasks.workunit.client.0.smithi088.stdout:8/946: link d7/d29/d2a/d38/f44 d7/d29/daa/d129/f13b 0 2024-09-17T04:21:29.104 INFO:tasks.workunit.client.0.smithi088.stdout:8/947: fsync d7/d29/d2a/d38/d3d/d63/d97/f113 0 2024-09-17T04:21:29.106 INFO:tasks.workunit.client.0.smithi088.stdout:4/999: link d5/d3d/d73/c7d d5/d3d/d73/c147 0 2024-09-17T04:21:29.106 INFO:tasks.workunit.client.0.smithi088.stdout:8/948: write d7/dd/d31/f6d [2976460,58753] 0 2024-09-17T04:21:29.108 INFO:tasks.workunit.client.0.smithi088.stdout:8/949: stat d7/d29/d2a/d38/d42/d117/f13a 0 2024-09-17T04:21:29.109 INFO:tasks.workunit.client.0.smithi088.stdout:8/950: mkdir d7/d29/daa/d13c 0 2024-09-17T04:21:29.111 INFO:tasks.workunit.client.0.smithi088.stdout:8/951: mknod d7/dd/d31/d47/dc6/d104/c13d 0 2024-09-17T04:21:29.113 INFO:tasks.workunit.client.0.smithi088.stdout:8/952: creat d7/dd/d31/d47/dc6/f13e x:0 0 0 2024-09-17T04:21:29.115 INFO:tasks.workunit.client.0.smithi088.stdout:8/953: creat d7/dd/d31/d47/dc6/d104/f13f x:0 0 0 2024-09-17T04:21:29.119 INFO:tasks.workunit.client.0.smithi088.stdout:8/954: link d7/d29/d2a/d38/f7d d7/d29/daa/f140 0 2024-09-17T04:21:29.121 INFO:tasks.workunit.client.0.smithi088.stdout:8/955: rmdir d7/d29/d2a/d38/d3d/d63/db7 39 2024-09-17T04:21:29.123 INFO:tasks.workunit.client.0.smithi088.stdout:8/956: read f2 [914004,123577] 0 2024-09-17T04:21:29.125 INFO:tasks.workunit.client.0.smithi088.stdout:8/957: creat d7/d29/f141 x:0 0 0 2024-09-17T04:21:29.128 INFO:tasks.workunit.client.0.smithi088.stdout:8/958: truncate d7/dd/d31/dca/fff 883231 0 2024-09-17T04:21:29.353 INFO:tasks.workunit.client.0.smithi088.stdout:0/945: sync 2024-09-17T04:21:29.356 INFO:tasks.workunit.client.0.smithi088.stdout:0/946: link db/f12 db/d1b/f14d 0 2024-09-17T04:21:29.357 INFO:tasks.workunit.client.0.smithi088.stdout:0/947: chown db/d67/d7c/f113 6883 1 2024-09-17T04:21:29.358 INFO:tasks.workunit.client.0.smithi088.stdout:0/948: rmdir db/d1b/d36/d4a/d20 39 2024-09-17T04:21:29.362 INFO:tasks.workunit.client.0.smithi088.stdout:0/949: link db/d1b/d36/d4a/l9a db/d1b/d39/de5/ded/l14e 0 2024-09-17T04:21:29.364 INFO:tasks.workunit.client.0.smithi088.stdout:0/950: creat db/d67/d7c/dae/d12e/f14f x:0 0 0 2024-09-17T04:21:29.373 INFO:tasks.workunit.client.0.smithi088.stdout:0/951: dread db/d1b/d36/df9/d66/f70 [0,4194304] 0 2024-09-17T04:21:29.375 INFO:tasks.workunit.client.0.smithi088.stdout:0/952: rmdir db/d1b/d39/d83 39 2024-09-17T04:21:29.379 INFO:tasks.workunit.client.0.smithi088.stdout:0/953: rename db/d1b/d36/df9/d59/cbc to db/d1b/d36/d4a/d20/c150 0 2024-09-17T04:21:29.381 INFO:tasks.workunit.client.0.smithi088.stdout:0/954: mknod db/d67/d7c/c151 0 2024-09-17T04:21:29.384 INFO:tasks.workunit.client.0.smithi088.stdout:0/955: link db/f12 db/db2/dc0/f152 0 2024-09-17T04:21:29.394 INFO:tasks.workunit.client.0.smithi088.stdout:0/956: write db/db2/dc0/d121/f13d [5085650,6975] 0 2024-09-17T04:21:29.406 INFO:tasks.workunit.client.0.smithi088.stdout:0/957: dread db/f9d [0,4194304] 0 2024-09-17T04:21:29.409 INFO:tasks.workunit.client.0.smithi088.stdout:0/958: creat db/d1b/d36/d4a/dd3/df5/f153 x:0 0 0 2024-09-17T04:21:29.411 INFO:tasks.workunit.client.0.smithi088.stdout:0/959: symlink db/d3c/d12c/l154 0 2024-09-17T04:21:29.414 INFO:tasks.workunit.client.0.smithi088.stdout:0/960: dread db/d1b/d39/f8d [4194304,4194304] 0 2024-09-17T04:21:29.417 INFO:tasks.workunit.client.0.smithi088.stdout:0/961: mknod db/d1b/d36/df9/c155 0 2024-09-17T04:21:29.418 INFO:tasks.workunit.client.0.smithi088.stdout:0/962: write db/d1b/d36/df9/dd5/d140/f145 [230404,128686] 0 2024-09-17T04:21:29.428 INFO:tasks.workunit.client.0.smithi088.stdout:0/963: write db/d1b/d36/df9/d9f/dc4/fcd [5564095,93358] 0 2024-09-17T04:21:29.435 INFO:tasks.workunit.client.0.smithi088.stdout:0/964: link db/d67/d7c/dae/d11c/lb8 db/d1b/d36/l156 0 2024-09-17T04:21:29.441 INFO:tasks.workunit.client.0.smithi088.stdout:0/965: dwrite db/d1b/d36/d4a/d20/fca [0,4194304] 0 2024-09-17T04:21:29.442 INFO:tasks.workunit.client.0.smithi088.stdout:0/966: chown db/d1b/d36/d4a/d6a 37 1 2024-09-17T04:21:29.445 INFO:tasks.workunit.client.0.smithi088.stdout:8/959: sync 2024-09-17T04:21:29.445 INFO:tasks.workunit.client.0.smithi088.stdout:0/967: stat db/d1b/c5d 0 2024-09-17T04:21:29.453 INFO:tasks.workunit.client.0.smithi088.stdout:0/968: rename db/d67/d7c/dae/d11c/db9/lfb to db/d1b/l157 0 2024-09-17T04:21:29.456 INFO:tasks.workunit.client.0.smithi088.stdout:8/960: dwrite d7/dd/d31/d47/d55/d57/d6b/ddb/f121 [0,4194304] 0 2024-09-17T04:21:29.457 INFO:tasks.workunit.client.0.smithi088.stdout:0/969: truncate db/f2a 1215301 0 2024-09-17T04:21:29.458 INFO:tasks.workunit.client.0.smithi088.stdout:0/970: chown db/d1b/d36/df9/d66 1824033352 1 2024-09-17T04:21:29.459 INFO:tasks.workunit.client.0.smithi088.stdout:8/961: chown d7/dd/d31/d47/dc6/cc7 1 1 2024-09-17T04:21:29.460 INFO:tasks.workunit.client.0.smithi088.stdout:0/971: stat db/db2/dc0/f152 0 2024-09-17T04:21:29.465 INFO:tasks.workunit.client.0.smithi088.stdout:0/972: unlink db/d1b/d36/df9/fa0 0 2024-09-17T04:21:29.469 INFO:tasks.workunit.client.0.smithi088.stdout:0/973: mkdir db/d1b/d36/df9/d59/da4/dc8/d158 0 2024-09-17T04:21:29.470 INFO:tasks.workunit.client.0.smithi088.stdout:8/962: link d7/d29/d2a/d75/c8a d7/d29/d2a/d38/df8/dfb/c142 0 2024-09-17T04:21:29.470 INFO:tasks.workunit.client.0.smithi088.stdout:0/974: stat db/d1b/d36/df9/d59/l134 0 2024-09-17T04:21:29.472 INFO:tasks.workunit.client.0.smithi088.stdout:0/975: mkdir db/d1b/d36/d4a/d20/d159 0 2024-09-17T04:21:29.475 INFO:tasks.workunit.client.0.smithi088.stdout:0/976: rename db/d1b/d36/d4a/d6a/cc3 to db/d1b/d36/df9/d66/c15a 0 2024-09-17T04:21:29.475 INFO:tasks.workunit.client.0.smithi088.stdout:0/977: dread - db/d1b/f119 zero size 2024-09-17T04:21:29.478 INFO:tasks.workunit.client.0.smithi088.stdout:0/978: mkdir db/d67/de2/d12f/d15b 0 2024-09-17T04:21:29.481 INFO:tasks.workunit.client.0.smithi088.stdout:0/979: write db/f4d [970877,36355] 0 2024-09-17T04:21:29.484 INFO:tasks.workunit.client.0.smithi088.stdout:0/980: creat db/d3c/f15c x:0 0 0 2024-09-17T04:21:29.488 INFO:tasks.workunit.client.0.smithi088.stdout:8/963: dwrite d7/dd/d31/dca/de6/ff1 [0,4194304] 0 2024-09-17T04:21:29.489 INFO:tasks.workunit.client.0.smithi088.stdout:0/981: dread db/d1b/d36/df9/d66/f70 [0,4194304] 0 2024-09-17T04:21:29.492 INFO:tasks.workunit.client.0.smithi088.stdout:8/964: write d7/d7f/f8b [4622565,130210] 0 2024-09-17T04:21:29.492 INFO:tasks.workunit.client.0.smithi088.stdout:0/982: creat db/d1b/d36/d4a/dd3/df5/f15d x:0 0 0 2024-09-17T04:21:29.496 INFO:tasks.workunit.client.0.smithi088.stdout:8/965: rename d7/d29/f5c to d7/d7f/f143 0 2024-09-17T04:21:29.503 INFO:tasks.workunit.client.0.smithi088.stdout:0/983: write db/d1b/d39/f5c [819681,6570] 0 2024-09-17T04:21:29.504 INFO:tasks.workunit.client.0.smithi088.stdout:0/984: chown db/db2/dc0/f152 64134988 1 2024-09-17T04:21:29.506 INFO:tasks.workunit.client.0.smithi088.stdout:0/985: symlink db/d1b/d36/d4a/l15e 0 2024-09-17T04:21:29.508 INFO:tasks.workunit.client.0.smithi088.stdout:0/986: truncate db/d67/d7c/dae/f102 197595 0 2024-09-17T04:21:29.511 INFO:tasks.workunit.client.0.smithi088.stdout:0/987: creat db/d1b/d36/d4a/d20/f15f x:0 0 0 2024-09-17T04:21:29.514 INFO:tasks.workunit.client.0.smithi088.stdout:8/966: dread f2 [4194304,4194304] 0 2024-09-17T04:21:29.515 INFO:tasks.workunit.client.0.smithi088.stdout:8/967: readlink d7/d29/l50 0 2024-09-17T04:21:29.518 INFO:tasks.workunit.client.0.smithi088.stdout:8/968: truncate d7/dd/d31/d47/d55/f99 797568 0 2024-09-17T04:21:29.520 INFO:tasks.workunit.client.0.smithi088.stdout:8/969: creat d7/dd/d62/f144 x:0 0 0 2024-09-17T04:21:29.523 INFO:tasks.workunit.client.0.smithi088.stdout:8/970: unlink d7/dd/d31/d47/d55/d57/d6b/ddb/f121 0 2024-09-17T04:21:29.525 INFO:tasks.workunit.client.0.smithi088.stdout:0/988: dread db/d1b/d36/d4a/d6a/f11a [0,4194304] 0 2024-09-17T04:21:29.535 INFO:tasks.workunit.client.0.smithi088.stdout:8/971: dwrite d7/d29/d2a/d38/d3d/da0/da8/fb8 [0,4194304] 0 2024-09-17T04:21:29.555 INFO:tasks.workunit.client.0.smithi088.stdout:8/972: dread d7/dd/d31/f58 [0,4194304] 0 2024-09-17T04:21:29.557 INFO:tasks.workunit.client.0.smithi088.stdout:8/973: mkdir d7/d29/daa/d13c/d145 0 2024-09-17T04:21:29.562 INFO:tasks.workunit.client.0.smithi088.stdout:8/974: creat d7/d29/d2a/d38/d42/d117/f146 x:0 0 0 2024-09-17T04:21:29.567 INFO:tasks.workunit.client.0.smithi088.stdout:8/975: write d7/d29/f6e [1277834,67139] 0 2024-09-17T04:21:29.569 INFO:tasks.workunit.client.0.smithi088.stdout:8/976: dread - d7/d7f/f143 zero size 2024-09-17T04:21:29.579 INFO:tasks.workunit.client.0.smithi088.stdout:8/977: dwrite d7/dd/d31/fd7 [0,4194304] 0 2024-09-17T04:21:29.584 INFO:tasks.workunit.client.0.smithi088.stdout:8/978: dwrite d7/dd/d31/fd7 [0,4194304] 0 2024-09-17T04:21:29.588 INFO:tasks.workunit.client.0.smithi088.stdout:8/979: unlink d7/d29/d2a/d38/d42/d117/f13a 0 2024-09-17T04:21:29.591 INFO:tasks.workunit.client.0.smithi088.stdout:8/980: truncate d7/d29/d2a/d38/d3d/d63/d97/d111/f131 354845 0 2024-09-17T04:21:29.595 INFO:tasks.workunit.client.0.smithi088.stdout:8/981: creat d7/dd/d31/d47/d55/d57/d6b/f147 x:0 0 0 2024-09-17T04:21:29.596 INFO:tasks.workunit.client.0.smithi088.stdout:8/982: write d7/d29/daa/ff5 [293687,42757] 0 2024-09-17T04:21:29.598 INFO:tasks.workunit.client.0.smithi088.stdout:8/983: mknod d7/d29/d2a/d10a/c148 0 2024-09-17T04:21:29.601 INFO:tasks.workunit.client.0.smithi088.stdout:8/984: creat d7/d29/d2a/d38/d3d/da0/da8/d12e/f149 x:0 0 0 2024-09-17T04:21:29.602 INFO:tasks.workunit.client.0.smithi088.stdout:8/985: truncate d7/d7f/f115 236101 0 2024-09-17T04:21:29.643 INFO:tasks.workunit.client.0.smithi088.stdout:8/986: truncate d7/d29/d2a/d38/d3d/d63/fee 908580 0 2024-09-17T04:21:29.643 INFO:tasks.workunit.client.0.smithi088.stdout:8/987: dread - d7/d7f/f143 zero size 2024-09-17T04:21:29.648 INFO:tasks.workunit.client.0.smithi088.stdout:8/988: dwrite d7/dd/d31/dca/de6/ff1 [0,4194304] 0 2024-09-17T04:21:29.672 INFO:tasks.workunit.client.0.smithi088.stdout:8/989: dwrite d7/d11f/d79/fe0 [0,4194304] 0 2024-09-17T04:21:29.678 INFO:tasks.workunit.client.0.smithi088.stdout:8/990: symlink d7/dd/d31/d47/d55/d57/d6b/l14a 0 2024-09-17T04:21:29.679 INFO:tasks.workunit.client.0.smithi088.stdout:8/991: mknod d7/d29/daa/d13c/d145/c14b 0 2024-09-17T04:21:29.683 INFO:tasks.workunit.client.0.smithi088.stdout:8/992: dread d7/d29/d2a/d38/d3d/d63/d97/fd9 [0,4194304] 0 2024-09-17T04:21:29.684 INFO:tasks.workunit.client.0.smithi088.stdout:8/993: write d7/d29/daa/d129/f12f [869563,126107] 0 2024-09-17T04:21:29.697 INFO:tasks.workunit.client.0.smithi088.stdout:8/994: dwrite d7/dd/d31/d47/d55/d57/fd5 [0,4194304] 0 2024-09-17T04:21:29.701 INFO:tasks.workunit.client.0.smithi088.stdout:8/995: creat d7/dd/d31/d47/d55/d57/d6b/ddb/f14c x:0 0 0 2024-09-17T04:21:29.705 INFO:tasks.workunit.client.0.smithi088.stdout:8/996: link d7/dd/d6f/fb9 d7/f14d 0 2024-09-17T04:21:29.708 INFO:tasks.workunit.client.0.smithi088.stdout:8/997: dread d7/d29/d2a/d38/d3d/d63/fee [0,4194304] 0 2024-09-17T04:21:29.713 INFO:tasks.workunit.client.0.smithi088.stdout:8/998: dwrite d7/dd/d62/f144 [0,4194304] 0 2024-09-17T04:21:29.719 INFO:tasks.workunit.client.0.smithi088.stdout:8/999: write d7/d29/f3c [1280056,9549] 0 2024-09-17T04:21:29.944 INFO:tasks.workunit.client.0.smithi088.stdout:0/989: sync 2024-09-17T04:21:29.945 INFO:tasks.workunit.client.0.smithi088.stdout:0/990: chown db/d67/d7c/dae/d11c/db9/dda 31677 1 2024-09-17T04:21:29.946 INFO:tasks.workunit.client.0.smithi088.stdout:0/991: chown db/db2/c143 580 1 2024-09-17T04:21:29.948 INFO:tasks.workunit.client.0.smithi088.stdout:0/992: unlink db/d1b/d39/fd0 0 2024-09-17T04:21:29.961 INFO:tasks.workunit.client.0.smithi088.stdout:0/993: truncate db/d1b/d36/fb5 1400607 0 2024-09-17T04:21:29.973 INFO:tasks.workunit.client.0.smithi088.stdout:0/994: write db/d1b/d36/d4a/d20/f12b [163507,10209] 0 2024-09-17T04:21:29.978 INFO:tasks.workunit.client.0.smithi088.stdout:0/995: truncate db/f4d 3161092 0 2024-09-17T04:21:29.980 INFO:tasks.workunit.client.0.smithi088.stdout:0/996: chown db/d1b/d36/d4a/dd3/c11f 38366558 1 2024-09-17T04:21:29.982 INFO:tasks.workunit.client.0.smithi088.stdout:0/997: creat db/d1b/d36/d4a/d20/f160 x:0 0 0 2024-09-17T04:21:29.983 INFO:tasks.workunit.client.0.smithi088.stdout:0/998: fdatasync db/d1b/d36/df9/d9f/f105 0 2024-09-17T04:21:29.989 INFO:tasks.workunit.client.0.smithi088.stdout:0/999: write db/d1b/d36/d4a/d20/f7a [313870,55633] 0 2024-09-17T04:21:29.993 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm -rf -- ./tmp.ueRy0Lz8k5 2024-09-17T04:21:30.817 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:30 smithi088 ceph-mon[27811]: pgmap v36: 65 pgs: 65 active+clean; 2.9 GiB data, 8.7 GiB used, 528 GiB / 536 GiB avail; 47 MiB/s rd, 99 MiB/s wr, 283 op/s 2024-09-17T04:21:30.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:30 smithi134 ceph-mon[35201]: pgmap v36: 65 pgs: 65 active+clean; 2.9 GiB data, 8.7 GiB used, 528 GiB / 536 GiB avail; 47 MiB/s rd, 99 MiB/s wr, 283 op/s 2024-09-17T04:21:32.627 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:32 smithi088 ceph-mon[27811]: pgmap v37: 65 pgs: 65 active+clean; 2.3 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 54 MiB/s rd, 121 MiB/s wr, 377 op/s 2024-09-17T04:21:32.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:32 smithi134 ceph-mon[35201]: pgmap v37: 65 pgs: 65 active+clean; 2.3 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 54 MiB/s rd, 121 MiB/s wr, 377 op/s 2024-09-17T04:21:33.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.568+0000 7f6ae434f640 1 -- 172.21.15.88:0/2926660593 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6adc104dc0 msgr2=0x7f6adc1071b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:33.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.568+0000 7f6ae434f640 1 --2- 172.21.15.88:0/2926660593 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6adc104dc0 0x7f6adc1071b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f6acc009880 tx=0x7f6acc02a4a0 comp rx=0 tx=0).stop 2024-09-17T04:21:33.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.568+0000 7f6ae434f640 1 -- 172.21.15.88:0/2926660593 shutdown_connections 2024-09-17T04:21:33.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.568+0000 7f6ae434f640 1 --2- 172.21.15.88:0/2926660593 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6adc104dc0 0x7f6adc1071b0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:33.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.568+0000 7f6ae434f640 1 --2- 172.21.15.88:0/2926660593 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6adc102490 0x7f6adc104880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:33.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.568+0000 7f6ae434f640 1 -- 172.21.15.88:0/2926660593 >> 172.21.15.88:0/2926660593 conn(0x7f6adc0fc010 msgr2=0x7f6adc0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:21:33.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.568+0000 7f6ae434f640 1 -- 172.21.15.88:0/2926660593 shutdown_connections 2024-09-17T04:21:33.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.568+0000 7f6ae434f640 1 -- 172.21.15.88:0/2926660593 wait complete. 2024-09-17T04:21:33.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.568+0000 7f6ae434f640 1 Processor -- start 2024-09-17T04:21:33.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.568+0000 7f6ae434f640 1 -- start start 2024-09-17T04:21:33.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.569+0000 7f6ae434f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6adc102490 0x7f6adc197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:21:33.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.569+0000 7f6ae20eb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6adc102490 0x7f6adc197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:21:33.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.569+0000 7f6ae20eb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6adc102490 0x7f6adc197500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35538/0 (socket says 172.21.15.88:35538) 2024-09-17T04:21:33.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.569+0000 7f6ae434f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6adc104dc0 0x7f6adc197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:21:33.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.569+0000 7f6ae20eb640 1 -- 172.21.15.88:0/4101986866 learned_addr learned my addr 172.21.15.88:0/4101986866 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:21:33.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.569+0000 7f6ae434f640 1 -- 172.21.15.88:0/4101986866 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f6adc10a7a0 con 0x7f6adc102490 2024-09-17T04:21:33.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.569+0000 7f6ae434f640 1 -- 172.21.15.88:0/4101986866 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6adc10a620 con 0x7f6adc104dc0 2024-09-17T04:21:33.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.569+0000 7f6ae20eb640 1 -- 172.21.15.88:0/4101986866 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6adc104dc0 msgr2=0x7f6adc197a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:33.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.569+0000 7f6ae20eb640 1 --2- 172.21.15.88:0/4101986866 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6adc104dc0 0x7f6adc197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:33.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.569+0000 7f6ae20eb640 1 -- 172.21.15.88:0/4101986866 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6adc1980c0 con 0x7f6adc102490 2024-09-17T04:21:33.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.569+0000 7f6ae20eb640 1 --2- 172.21.15.88:0/4101986866 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6adc102490 0x7f6adc197500 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f6ad800e970 tx=0x7f6ad800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:21:33.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.570+0000 7f6ad37fe640 1 -- 172.21.15.88:0/4101986866 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6ad800cac0 con 0x7f6adc102490 2024-09-17T04:21:33.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.570+0000 7f6ae434f640 1 -- 172.21.15.88:0/4101986866 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6adc19cb00 con 0x7f6adc102490 2024-09-17T04:21:33.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.570+0000 7f6ad37fe640 1 -- 172.21.15.88:0/4101986866 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6ad80054e0 con 0x7f6adc102490 2024-09-17T04:21:33.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.570+0000 7f6ad37fe640 1 -- 172.21.15.88:0/4101986866 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6ad8010430 con 0x7f6adc102490 2024-09-17T04:21:33.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.570+0000 7f6ae434f640 1 -- 172.21.15.88:0/4101986866 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6adc19d090 con 0x7f6adc102490 2024-09-17T04:21:33.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.571+0000 7f6ae434f640 1 -- 172.21.15.88:0/4101986866 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6adc102870 con 0x7f6adc102490 2024-09-17T04:21:33.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.572+0000 7f6ad37fe640 1 -- 172.21.15.88:0/4101986866 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f6ad8004f00 con 0x7f6adc102490 2024-09-17T04:21:33.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.572+0000 7f6ad37fe640 1 --2- 172.21.15.88:0/4101986866 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f6ac8074a80 0x7f6ac8076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:21:33.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.573+0000 7f6ad37fe640 1 -- 172.21.15.88:0/4101986866 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f6ad80969b0 con 0x7f6adc102490 2024-09-17T04:21:33.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.573+0000 7f6ae18ea640 1 --2- 172.21.15.88:0/4101986866 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f6ac8074a80 0x7f6ac8076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:21:33.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.573+0000 7f6ae18ea640 1 --2- 172.21.15.88:0/4101986866 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f6ac8074a80 0x7f6ac8076f40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6acc02a9c0 tx=0x7f6acc000bc0 comp rx=0 tx=0).ready entity=mgr.24431 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:21:33.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.577+0000 7f6ad37fe640 1 -- 172.21.15.88:0/4101986866 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f6ad8061f60 con 0x7f6adc102490 2024-09-17T04:21:33.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.854+0000 7f6ae434f640 1 -- 172.21.15.88:0/4101986866 --> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6adc105800 con 0x7f6ac8074a80 2024-09-17T04:21:33.855 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:33 smithi088 ceph-mon[27811]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:21:33.856 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:33 smithi088 ceph-mon[27811]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:21:33.856 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:33 smithi088 ceph-mon[27811]: Reconfiguring ceph-exporter.smithi134 (dependencies changed)... 2024-09-17T04:21:33.856 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:33 smithi088 ceph-mon[27811]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi134", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T04:21:33.856 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:33 smithi088 ceph-mon[27811]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi134", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T04:21:33.856 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:33 smithi088 ceph-mon[27811]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:21:33.856 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:33 smithi088 ceph-mon[27811]: Deploying daemon ceph-exporter.smithi134 on smithi134 2024-09-17T04:21:33.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.855+0000 7f6ad37fe640 1 -- 172.21.15.88:0/4101986866 <== mgr.24431 v2:172.21.15.134:6828/1122341233 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+318 (secure 0 0 0) 0x7f6adc105800 con 0x7f6ac8074a80 2024-09-17T04:21:33.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.858+0000 7f6ae434f640 1 -- 172.21.15.88:0/4101986866 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f6ac8074a80 msgr2=0x7f6ac8076f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:33.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.858+0000 7f6ae434f640 1 --2- 172.21.15.88:0/4101986866 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f6ac8074a80 0x7f6ac8076f40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6acc02a9c0 tx=0x7f6acc000bc0 comp rx=0 tx=0).stop 2024-09-17T04:21:33.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.858+0000 7f6ae434f640 1 -- 172.21.15.88:0/4101986866 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6adc102490 msgr2=0x7f6adc197500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:33.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.858+0000 7f6ae434f640 1 --2- 172.21.15.88:0/4101986866 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6adc102490 0x7f6adc197500 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f6ad800e970 tx=0x7f6ad800ed70 comp rx=0 tx=0).stop 2024-09-17T04:21:33.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.858+0000 7f6ae434f640 1 -- 172.21.15.88:0/4101986866 shutdown_connections 2024-09-17T04:21:33.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.858+0000 7f6ae434f640 1 --2- 172.21.15.88:0/4101986866 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f6ac8074a80 0x7f6ac8076f40 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:33.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.858+0000 7f6ae434f640 1 --2- 172.21.15.88:0/4101986866 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6adc104dc0 0x7f6adc197a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:33.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.858+0000 7f6ae434f640 1 --2- 172.21.15.88:0/4101986866 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6adc102490 0x7f6adc197500 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:33.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.858+0000 7f6ae434f640 1 -- 172.21.15.88:0/4101986866 >> 172.21.15.88:0/4101986866 conn(0x7f6adc0fc010 msgr2=0x7f6adc0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:21:33.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.858+0000 7f6ae434f640 1 -- 172.21.15.88:0/4101986866 shutdown_connections 2024-09-17T04:21:33.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.858+0000 7f6ae434f640 1 -- 172.21.15.88:0/4101986866 wait complete. 2024-09-17T04:21:33.870 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-09-17T04:21:33.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.965+0000 7f1406d3f640 1 -- 172.21.15.88:0/2206832757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1400101a60 msgr2=0x7f1400101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:33.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.965+0000 7f1406d3f640 1 --2- 172.21.15.88:0/2206832757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1400101a60 0x7f1400101ee0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f13ec009880 tx=0x7f13ec02a4a0 comp rx=0 tx=0).stop 2024-09-17T04:21:33.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.965+0000 7f1406d3f640 1 -- 172.21.15.88:0/2206832757 shutdown_connections 2024-09-17T04:21:33.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.965+0000 7f1406d3f640 1 --2- 172.21.15.88:0/2206832757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1400101a60 0x7f1400101ee0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:33.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.965+0000 7f1406d3f640 1 --2- 172.21.15.88:0/2206832757 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1400100860 0x7f1400100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:33.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.965+0000 7f1406d3f640 1 -- 172.21.15.88:0/2206832757 >> 172.21.15.88:0/2206832757 conn(0x7f14000fc010 msgr2=0x7f14000fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:21:33.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.965+0000 7f1406d3f640 1 -- 172.21.15.88:0/2206832757 shutdown_connections 2024-09-17T04:21:33.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.965+0000 7f1406d3f640 1 -- 172.21.15.88:0/2206832757 wait complete. 2024-09-17T04:21:33.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.966+0000 7f1406d3f640 1 Processor -- start 2024-09-17T04:21:33.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.966+0000 7f1406d3f640 1 -- start start 2024-09-17T04:21:33.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.966+0000 7f1406d3f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1400100860 0x7f140006a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:21:33.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.966+0000 7f1406d3f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1400101a60 0x7f140019c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:21:33.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.966+0000 7f1406d3f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f14001096a0 con 0x7f1400101a60 2024-09-17T04:21:33.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.966+0000 7f1406d3f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1400109520 con 0x7f1400100860 2024-09-17T04:21:33.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.967+0000 7f13fffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1400101a60 0x7f140019c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:21:33.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.967+0000 7f13fffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1400101a60 0x7f140019c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35560/0 (socket says 172.21.15.88:35560) 2024-09-17T04:21:33.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.967+0000 7f13fffff640 1 -- 172.21.15.88:0/2253695260 learned_addr learned my addr 172.21.15.88:0/2253695260 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:21:33.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.967+0000 7f1404adb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1400100860 0x7f140006a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:21:33.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.967+0000 7f13fffff640 1 -- 172.21.15.88:0/2253695260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1400100860 msgr2=0x7f140006a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:33.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.967+0000 7f13fffff640 1 --2- 172.21.15.88:0/2253695260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1400100860 0x7f140006a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:33.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.967+0000 7f13fffff640 1 -- 172.21.15.88:0/2253695260 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f140019c800 con 0x7f1400101a60 2024-09-17T04:21:33.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.967+0000 7f13fffff640 1 --2- 172.21.15.88:0/2253695260 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1400101a60 0x7f140019c240 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f13ec006010 tx=0x7f13ec004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:21:33.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.967+0000 7f13fdffb640 1 -- 172.21.15.88:0/2253695260 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f13ec03f070 con 0x7f1400101a60 2024-09-17T04:21:33.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.968+0000 7f1406d3f640 1 -- 172.21.15.88:0/2253695260 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f140019ca90 con 0x7f1400101a60 2024-09-17T04:21:33.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.968+0000 7f13fdffb640 1 -- 172.21.15.88:0/2253695260 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f13ec0049d0 con 0x7f1400101a60 2024-09-17T04:21:33.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.968+0000 7f13fdffb640 1 -- 172.21.15.88:0/2253695260 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f13ec035030 con 0x7f1400101a60 2024-09-17T04:21:33.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.968+0000 7f1406d3f640 1 -- 172.21.15.88:0/2253695260 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f140019cfc0 con 0x7f1400101a60 2024-09-17T04:21:33.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.969+0000 7f1406d3f640 1 -- 172.21.15.88:0/2253695260 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1400100c60 con 0x7f1400101a60 2024-09-17T04:21:33.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.970+0000 7f13fdffb640 1 -- 172.21.15.88:0/2253695260 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f13ec042070 con 0x7f1400101a60 2024-09-17T04:21:33.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.971+0000 7f13fdffb640 1 --2- 172.21.15.88:0/2253695260 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f13f0074a80 0x7f13f0076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:21:33.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.971+0000 7f13fdffb640 1 -- 172.21.15.88:0/2253695260 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f13ec0b7480 con 0x7f1400101a60 2024-09-17T04:21:33.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.971+0000 7f1404adb640 1 --2- 172.21.15.88:0/2253695260 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f13f0074a80 0x7f13f0076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:21:33.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.971+0000 7f1404adb640 1 --2- 172.21.15.88:0/2253695260 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f13f0074a80 0x7f13f0076f40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f14001018c0 tx=0x7f13f4005f90 comp rx=0 tx=0).ready entity=mgr.24431 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:21:33.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:33.975+0000 7f13fdffb640 1 -- 172.21.15.88:0/2253695260 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f13ec082a40 con 0x7f1400101a60 2024-09-17T04:21:34.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:33 smithi134 ceph-mon[35201]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:21:34.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:33 smithi134 ceph-mon[35201]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:21:34.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:33 smithi134 ceph-mon[35201]: Reconfiguring ceph-exporter.smithi134 (dependencies changed)... 2024-09-17T04:21:34.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:33 smithi134 ceph-mon[35201]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi134", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T04:21:34.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:33 smithi134 ceph-mon[35201]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi134", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T04:21:34.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:33 smithi134 ceph-mon[35201]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:21:34.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:33 smithi134 ceph-mon[35201]: Deploying daemon ceph-exporter.smithi134 on smithi134 2024-09-17T04:21:34.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.202+0000 7f1406d3f640 1 -- 172.21.15.88:0/2253695260 --> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f14000626f0 con 0x7f13f0074a80 2024-09-17T04:21:34.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.203+0000 7f13fdffb640 1 -- 172.21.15.88:0/2253695260 <== mgr.24431 v2:172.21.15.134:6828/1122341233 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+318 (secure 0 0 0) 0x7f14000626f0 con 0x7f13f0074a80 2024-09-17T04:21:34.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.206+0000 7f1406d3f640 1 -- 172.21.15.88:0/2253695260 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f13f0074a80 msgr2=0x7f13f0076f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:34.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.206+0000 7f1406d3f640 1 --2- 172.21.15.88:0/2253695260 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f13f0074a80 0x7f13f0076f40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f14001018c0 tx=0x7f13f4005f90 comp rx=0 tx=0).stop 2024-09-17T04:21:34.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.206+0000 7f1406d3f640 1 -- 172.21.15.88:0/2253695260 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1400101a60 msgr2=0x7f140019c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:34.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.206+0000 7f1406d3f640 1 --2- 172.21.15.88:0/2253695260 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1400101a60 0x7f140019c240 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f13ec006010 tx=0x7f13ec004570 comp rx=0 tx=0).stop 2024-09-17T04:21:34.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.206+0000 7f1406d3f640 1 -- 172.21.15.88:0/2253695260 shutdown_connections 2024-09-17T04:21:34.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.206+0000 7f1406d3f640 1 --2- 172.21.15.88:0/2253695260 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f13f0074a80 0x7f13f0076f40 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:34.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.206+0000 7f1406d3f640 1 --2- 172.21.15.88:0/2253695260 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1400101a60 0x7f140019c240 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:34.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.206+0000 7f1406d3f640 1 --2- 172.21.15.88:0/2253695260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1400100860 0x7f140006a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:34.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.206+0000 7f1406d3f640 1 -- 172.21.15.88:0/2253695260 >> 172.21.15.88:0/2253695260 conn(0x7f14000fc010 msgr2=0x7f1400104f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:21:34.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.206+0000 7f1406d3f640 1 -- 172.21.15.88:0/2253695260 shutdown_connections 2024-09-17T04:21:34.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.207+0000 7f1406d3f640 1 -- 172.21.15.88:0/2253695260 wait complete. 2024-09-17T04:21:34.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.309+0000 7f707823c640 1 -- 172.21.15.88:0/3798972861 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7070100860 msgr2=0x7f7070100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:34.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.309+0000 7f707823c640 1 --2- 172.21.15.88:0/3798972861 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7070100860 0x7f7070100c60 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f706c009880 tx=0x7f706c02a4a0 comp rx=0 tx=0).stop 2024-09-17T04:21:34.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.309+0000 7f707823c640 1 -- 172.21.15.88:0/3798972861 shutdown_connections 2024-09-17T04:21:34.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.309+0000 7f707823c640 1 --2- 172.21.15.88:0/3798972861 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7070101a60 0x7f7070101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:34.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.309+0000 7f707823c640 1 --2- 172.21.15.88:0/3798972861 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7070100860 0x7f7070100c60 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:34.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.309+0000 7f707823c640 1 -- 172.21.15.88:0/3798972861 >> 172.21.15.88:0/3798972861 conn(0x7f70700fc010 msgr2=0x7f70700fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:21:34.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.309+0000 7f707823c640 1 -- 172.21.15.88:0/3798972861 shutdown_connections 2024-09-17T04:21:34.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.309+0000 7f707823c640 1 -- 172.21.15.88:0/3798972861 wait complete. 2024-09-17T04:21:34.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.310+0000 7f707823c640 1 Processor -- start 2024-09-17T04:21:34.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.310+0000 7f707823c640 1 -- start start 2024-09-17T04:21:34.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.310+0000 7f707823c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7070100860 0x7f70701974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:21:34.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.310+0000 7f707823c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7070101a60 0x7f7070197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:21:34.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.310+0000 7f707823c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f7070109680 con 0x7f7070100860 2024-09-17T04:21:34.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.310+0000 7f707823c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7070109500 con 0x7f7070101a60 2024-09-17T04:21:34.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.310+0000 7f7075fd8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7070100860 0x7f70701974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:21:34.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.310+0000 7f7075fd8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7070100860 0x7f70701974c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35584/0 (socket says 172.21.15.88:35584) 2024-09-17T04:21:34.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.310+0000 7f70757d7640 1 --2- 172.21.15.88:0/1291173701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7070101a60 0x7f7070197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:21:34.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.310+0000 7f7075fd8640 1 -- 172.21.15.88:0/1291173701 learned_addr learned my addr 172.21.15.88:0/1291173701 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:21:34.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.311+0000 7f7075fd8640 1 -- 172.21.15.88:0/1291173701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7070101a60 msgr2=0x7f7070197a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:34.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.311+0000 7f7075fd8640 1 --2- 172.21.15.88:0/1291173701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7070101a60 0x7f7070197a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:34.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.311+0000 7f7075fd8640 1 -- 172.21.15.88:0/1291173701 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7070198080 con 0x7f7070100860 2024-09-17T04:21:34.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.311+0000 7f70757d7640 1 --2- 172.21.15.88:0/1291173701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7070101a60 0x7f7070197a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:21:34.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.311+0000 7f7075fd8640 1 --2- 172.21.15.88:0/1291173701 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7070100860 0x7f70701974c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f706c006010 tx=0x7f706c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:21:34.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.311+0000 7f7066ffd640 1 -- 172.21.15.88:0/1291173701 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f706c03f070 con 0x7f7070100860 2024-09-17T04:21:34.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.311+0000 7f7066ffd640 1 -- 172.21.15.88:0/1291173701 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f706c0049d0 con 0x7f7070100860 2024-09-17T04:21:34.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.311+0000 7f707823c640 1 -- 172.21.15.88:0/1291173701 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7070102c80 con 0x7f7070100860 2024-09-17T04:21:34.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.311+0000 7f7066ffd640 1 -- 172.21.15.88:0/1291173701 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f706c035030 con 0x7f7070100860 2024-09-17T04:21:34.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.311+0000 7f707823c640 1 -- 172.21.15.88:0/1291173701 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7070103210 con 0x7f7070100860 2024-09-17T04:21:34.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.312+0000 7f707823c640 1 -- 172.21.15.88:0/1291173701 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7070100c60 con 0x7f7070100860 2024-09-17T04:21:34.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.314+0000 7f7066ffd640 1 -- 172.21.15.88:0/1291173701 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f706c042070 con 0x7f7070100860 2024-09-17T04:21:34.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.314+0000 7f7066ffd640 1 --2- 172.21.15.88:0/1291173701 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f705c074a30 0x7f705c076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:21:34.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.315+0000 7f7066ffd640 1 -- 172.21.15.88:0/1291173701 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f706c0b6e00 con 0x7f7070100860 2024-09-17T04:21:34.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.315+0000 7f70757d7640 1 --2- 172.21.15.88:0/1291173701 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f705c074a30 0x7f705c076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:21:34.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.315+0000 7f70757d7640 1 --2- 172.21.15.88:0/1291173701 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f705c074a30 0x7f705c076ef0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7070198970 tx=0x7f7060012040 comp rx=0 tx=0).ready entity=mgr.24431 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:21:34.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.322+0000 7f7066ffd640 1 -- 172.21.15.88:0/1291173701 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f706c082330 con 0x7f7070100860 2024-09-17T04:21:34.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.589+0000 7f707823c640 1 -- 172.21.15.88:0/1291173701 --> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f707006ac00 con 0x7f705c074a30 2024-09-17T04:21:34.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.599+0000 7f7066ffd640 1 -- 172.21.15.88:0/1291173701 <== mgr.24431 v2:172.21.15.134:6828/1122341233 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f707006ac00 con 0x7f705c074a30 2024-09-17T04:21:34.600 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T04:21:34.600 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (7m) 52s ago 8m 25.7M - 0.25.0 c8568f914cd2 f2dbac7e939f 2024-09-17T04:21:34.600 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi088 smithi088 starting - - - - 2024-09-17T04:21:34.600 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi134 smithi134 running (8m) 60s ago 8m 5272k - 19.1.1-330-gc2ddf972 ebb0615149de 6c2b7072b682 2024-09-17T04:21:34.600 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (8m) 52s ago 8m 6903k - 19.1.1-330-gc2ddf972 ebb0615149de de17f5571330 2024-09-17T04:21:34.600 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi134 smithi134 running (8m) 60s ago 8m 6899k - 19.1.1-330-gc2ddf972 ebb0615149de 27f7ef172a1c 2024-09-17T04:21:34.600 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (6m) 52s ago 8m 78.3M - 9.4.12 2bacad6d85d8 a6cff57a23f9 2024-09-17T04:21:34.601 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.giqrgt smithi088 running (3m) 52s ago 3m 164M - 19.1.1-330-gc2ddf972 ebb0615149de f724660799a1 2024-09-17T04:21:34.601 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.lgavsv smithi088 running (3m) 52s ago 3m 13.3M - 19.1.1-330-gc2ddf972 ebb0615149de 6cc0fe8a6aa9 2024-09-17T04:21:34.601 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi134.ktuhce smithi134 running (3m) 60s ago 3m 12.3M - 19.1.1-330-gc2ddf972 ebb0615149de 7ff5b70ca9cb 2024-09-17T04:21:34.601 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi134.psnynp smithi134 running (3m) 60s ago 3m 164M - 19.1.1-330-gc2ddf972 ebb0615149de 5326974fa3dd 2024-09-17T04:21:34.601 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.wmndiv smithi088 *:9283,8765,8443 running (9m) 52s ago 9m 253M - 19.1.1-330-gc2ddf972 ebb0615149de 2067eec66468 2024-09-17T04:21:34.601 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi134.vwdxcb smithi134 *:8443,9283,8765 running (93s) 60s ago 7m 564M - 19.3.0-4989-gce1b342b 8e039cb7fe1e efa5f0c9df8c 2024-09-17T04:21:34.601 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (10m) 52s ago 10m 50.2M 2048M 19.1.1-330-gc2ddf972 ebb0615149de bbeb722f42bc 2024-09-17T04:21:34.601 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi134 smithi134 running (7m) 60s ago 7m 39.8M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 89de63fb6386 2024-09-17T04:21:34.601 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (8m) 52s ago 8m 16.5M - 1.5.0 0da6a335fe13 9ba03800993b 2024-09-17T04:21:34.601 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi134 smithi134 *:9100 running (7m) 60s ago 7m 17.2M - 1.5.0 0da6a335fe13 6deac483827f 2024-09-17T04:21:34.601 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (6m) 52s ago 6m 78.6M 1216M 19.1.1-330-gc2ddf972 ebb0615149de e309427ee12c 2024-09-17T04:21:34.601 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (6m) 52s ago 6m 93.2M 1216M 19.1.1-330-gc2ddf972 ebb0615149de cc68d92b3333 2024-09-17T04:21:34.601 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (5m) 52s ago 5m 78.6M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 1ba92f2bfce6 2024-09-17T04:21:34.601 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi134 running (5m) 60s ago 5m 93.1M 2240M 19.1.1-330-gc2ddf972 ebb0615149de ebd528c3ce1b 2024-09-17T04:21:34.602 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi134 running (4m) 60s ago 4m 80.9M 2240M 19.1.1-330-gc2ddf972 ebb0615149de eacc25537b3a 2024-09-17T04:21:34.602 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi134 running (4m) 60s ago 4m 84.7M 2240M 19.1.1-330-gc2ddf972 ebb0615149de bc1b434a92a8 2024-09-17T04:21:34.602 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 starting - - - - 2024-09-17T04:21:34.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.602+0000 7f707823c640 1 -- 172.21.15.88:0/1291173701 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f705c074a30 msgr2=0x7f705c076ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:34.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.602+0000 7f707823c640 1 --2- 172.21.15.88:0/1291173701 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f705c074a30 0x7f705c076ef0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7070198970 tx=0x7f7060012040 comp rx=0 tx=0).stop 2024-09-17T04:21:34.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.602+0000 7f707823c640 1 -- 172.21.15.88:0/1291173701 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7070100860 msgr2=0x7f70701974c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:34.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.602+0000 7f707823c640 1 --2- 172.21.15.88:0/1291173701 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7070100860 0x7f70701974c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f706c006010 tx=0x7f706c0045e0 comp rx=0 tx=0).stop 2024-09-17T04:21:34.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.602+0000 7f707823c640 1 -- 172.21.15.88:0/1291173701 shutdown_connections 2024-09-17T04:21:34.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.602+0000 7f707823c640 1 --2- 172.21.15.88:0/1291173701 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f705c074a30 0x7f705c076ef0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:34.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.602+0000 7f707823c640 1 --2- 172.21.15.88:0/1291173701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7070101a60 0x7f7070197a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:34.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.602+0000 7f707823c640 1 --2- 172.21.15.88:0/1291173701 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7070100860 0x7f70701974c0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:34.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.602+0000 7f707823c640 1 -- 172.21.15.88:0/1291173701 >> 172.21.15.88:0/1291173701 conn(0x7f70700fc010 msgr2=0x7f707006a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:21:34.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.602+0000 7f707823c640 1 -- 172.21.15.88:0/1291173701 shutdown_connections 2024-09-17T04:21:34.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.602+0000 7f707823c640 1 -- 172.21.15.88:0/1291173701 wait complete. 2024-09-17T04:21:34.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.698+0000 7f4a999ef640 1 -- 172.21.15.88:0/2094998158 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a94100860 msgr2=0x7f4a94100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:34.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.698+0000 7f4a999ef640 1 --2- 172.21.15.88:0/2094998158 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a94100860 0x7f4a94100c60 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4a84009c20 tx=0x7f4a8402a970 comp rx=0 tx=0).stop 2024-09-17T04:21:34.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.698+0000 7f4a999ef640 1 -- 172.21.15.88:0/2094998158 shutdown_connections 2024-09-17T04:21:34.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.698+0000 7f4a999ef640 1 --2- 172.21.15.88:0/2094998158 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a94101a60 0x7f4a94101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:34.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.698+0000 7f4a999ef640 1 --2- 172.21.15.88:0/2094998158 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a94100860 0x7f4a94100c60 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:34.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.698+0000 7f4a999ef640 1 -- 172.21.15.88:0/2094998158 >> 172.21.15.88:0/2094998158 conn(0x7f4a940fbff0 msgr2=0x7f4a940fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:21:34.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.698+0000 7f4a999ef640 1 -- 172.21.15.88:0/2094998158 shutdown_connections 2024-09-17T04:21:34.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.698+0000 7f4a999ef640 1 -- 172.21.15.88:0/2094998158 wait complete. 2024-09-17T04:21:34.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.699+0000 7f4a999ef640 1 Processor -- start 2024-09-17T04:21:34.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.699+0000 7f4a999ef640 1 -- start start 2024-09-17T04:21:34.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.699+0000 7f4a999ef640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a94100860 0x7f4a941974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:21:34.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.699+0000 7f4a999ef640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a94101a60 0x7f4a94197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:21:34.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.699+0000 7f4a999ef640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f4a941096a0 con 0x7f4a94100860 2024-09-17T04:21:34.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.699+0000 7f4a999ef640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4a94109520 con 0x7f4a94101a60 2024-09-17T04:21:34.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.699+0000 7f4a92ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a94100860 0x7f4a941974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:21:34.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.700+0000 7f4a92ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a94100860 0x7f4a941974c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35600/0 (socket says 172.21.15.88:35600) 2024-09-17T04:21:34.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.700+0000 7f4a92ffd640 1 -- 172.21.15.88:0/3425486865 learned_addr learned my addr 172.21.15.88:0/3425486865 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:21:34.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.700+0000 7f4a8a7fc640 1 --2- 172.21.15.88:0/3425486865 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a94101a60 0x7f4a94197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:21:34.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.700+0000 7f4a92ffd640 1 -- 172.21.15.88:0/3425486865 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a94101a60 msgr2=0x7f4a94197a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:34.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.700+0000 7f4a92ffd640 1 --2- 172.21.15.88:0/3425486865 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a94101a60 0x7f4a94197a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:34.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.700+0000 7f4a92ffd640 1 -- 172.21.15.88:0/3425486865 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a94198080 con 0x7f4a94100860 2024-09-17T04:21:34.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.700+0000 7f4a92ffd640 1 --2- 172.21.15.88:0/3425486865 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a94100860 0x7f4a941974c0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4a84009430 tx=0x7f4a8402f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:21:34.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.700+0000 7f4a989ed640 1 -- 172.21.15.88:0/3425486865 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4a84047070 con 0x7f4a94100860 2024-09-17T04:21:34.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.700+0000 7f4a989ed640 1 -- 172.21.15.88:0/3425486865 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4a84003e30 con 0x7f4a94100860 2024-09-17T04:21:34.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.700+0000 7f4a999ef640 1 -- 172.21.15.88:0/3425486865 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a9419ca60 con 0x7f4a94100860 2024-09-17T04:21:34.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.700+0000 7f4a989ed640 1 -- 172.21.15.88:0/3425486865 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4a84034070 con 0x7f4a94100860 2024-09-17T04:21:34.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.700+0000 7f4a999ef640 1 -- 172.21.15.88:0/3425486865 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a9419cff0 con 0x7f4a94100860 2024-09-17T04:21:34.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.702+0000 7f4a999ef640 1 -- 172.21.15.88:0/3425486865 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a94100c60 con 0x7f4a94100860 2024-09-17T04:21:34.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.702+0000 7f4a989ed640 1 -- 172.21.15.88:0/3425486865 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f4a8404a070 con 0x7f4a94100860 2024-09-17T04:21:34.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.703+0000 7f4a989ed640 1 --2- 172.21.15.88:0/3425486865 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f4a80074a80 0x7f4a80076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:21:34.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.703+0000 7f4a989ed640 1 -- 172.21.15.88:0/3425486865 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f4a840b7010 con 0x7f4a94100860 2024-09-17T04:21:34.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.703+0000 7f4a8a7fc640 1 --2- 172.21.15.88:0/3425486865 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f4a80074a80 0x7f4a80076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:21:34.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.704+0000 7f4a8a7fc640 1 --2- 172.21.15.88:0/3425486865 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f4a80074a80 0x7f4a80076f40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4a94198970 tx=0x7f4a7c005f90 comp rx=0 tx=0).ready entity=mgr.24431 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:21:34.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:34.710+0000 7f4a989ed640 1 -- 172.21.15.88:0/3425486865 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f4a8403f070 con 0x7f4a94100860 2024-09-17T04:21:34.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:34 smithi088 ceph-mon[27811]: from='client.14828 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:21:34.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:34 smithi088 ceph-mon[27811]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:21:34.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:34 smithi088 ceph-mon[27811]: pgmap v38: 65 pgs: 65 active+clean; 2.3 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 29 MiB/s rd, 67 MiB/s wr, 234 op/s 2024-09-17T04:21:34.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:34 smithi134 ceph-mon[35201]: from='client.14828 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:21:34.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:34 smithi134 ceph-mon[35201]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:21:34.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:34 smithi134 ceph-mon[35201]: pgmap v38: 65 pgs: 65 active+clean; 2.3 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 29 MiB/s rd, 67 MiB/s wr, 234 op/s 2024-09-17T04:21:35.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.041+0000 7f4a999ef640 1 -- 172.21.15.88:0/3425486865 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f4a9419d800 con 0x7f4a94100860 2024-09-17T04:21:35.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.041+0000 7f4a989ed640 1 -- 172.21.15.88:0/3425486865 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+841 (secure 0 0 0) 0x7f4a840825c0 con 0x7f4a94100860 2024-09-17T04:21:35.042 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-17T04:21:35.042 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-09-17T04:21:35.042 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T04:21:35.042 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:21:35.042 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-09-17T04:21:35.043 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 1, 2024-09-17T04:21:35.043 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 1 2024-09-17T04:21:35.043 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:21:35.043 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-09-17T04:21:35.043 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-17T04:21:35.043 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:21:35.043 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2024-09-17T04:21:35.043 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T04:21:35.043 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:21:35.043 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-09-17T04:21:35.043 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 13, 2024-09-17T04:21:35.043 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 1 2024-09-17T04:21:35.043 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-17T04:21:35.043 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-17T04:21:35.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.044+0000 7f4a999ef640 1 -- 172.21.15.88:0/3425486865 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f4a80074a80 msgr2=0x7f4a80076f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:35.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.044+0000 7f4a999ef640 1 --2- 172.21.15.88:0/3425486865 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f4a80074a80 0x7f4a80076f40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4a94198970 tx=0x7f4a7c005f90 comp rx=0 tx=0).stop 2024-09-17T04:21:35.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.044+0000 7f4a999ef640 1 -- 172.21.15.88:0/3425486865 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a94100860 msgr2=0x7f4a941974c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:35.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.044+0000 7f4a999ef640 1 --2- 172.21.15.88:0/3425486865 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a94100860 0x7f4a941974c0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4a84009430 tx=0x7f4a8402f5f0 comp rx=0 tx=0).stop 2024-09-17T04:21:35.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.044+0000 7f4a999ef640 1 -- 172.21.15.88:0/3425486865 shutdown_connections 2024-09-17T04:21:35.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.044+0000 7f4a999ef640 1 --2- 172.21.15.88:0/3425486865 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f4a80074a80 0x7f4a80076f40 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:35.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.044+0000 7f4a999ef640 1 --2- 172.21.15.88:0/3425486865 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a94101a60 0x7f4a94197a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:35.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.044+0000 7f4a999ef640 1 --2- 172.21.15.88:0/3425486865 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a94100860 0x7f4a941974c0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:35.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.044+0000 7f4a999ef640 1 -- 172.21.15.88:0/3425486865 >> 172.21.15.88:0/3425486865 conn(0x7f4a940fbff0 msgr2=0x7f4a9406a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:21:35.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.044+0000 7f4a999ef640 1 -- 172.21.15.88:0/3425486865 shutdown_connections 2024-09-17T04:21:35.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.044+0000 7f4a999ef640 1 -- 172.21.15.88:0/3425486865 wait complete. 2024-09-17T04:21:35.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.141+0000 7f55a8b78640 1 -- 172.21.15.88:0/3004912607 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55a41023f0 msgr2=0x7f55a41047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:35.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.141+0000 7f55a8b78640 1 --2- 172.21.15.88:0/3004912607 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55a41023f0 0x7f55a41047e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f55940098b0 tx=0x7f559402a4d0 comp rx=0 tx=0).stop 2024-09-17T04:21:35.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.141+0000 7f55a8b78640 1 -- 172.21.15.88:0/3004912607 shutdown_connections 2024-09-17T04:21:35.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.141+0000 7f55a8b78640 1 --2- 172.21.15.88:0/3004912607 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55a4104d20 0x7f55a4107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:35.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.141+0000 7f55a8b78640 1 --2- 172.21.15.88:0/3004912607 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55a41023f0 0x7f55a41047e0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:35.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.141+0000 7f55a8b78640 1 -- 172.21.15.88:0/3004912607 >> 172.21.15.88:0/3004912607 conn(0x7f55a40fbff0 msgr2=0x7f55a40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:21:35.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.141+0000 7f55a8b78640 1 -- 172.21.15.88:0/3004912607 shutdown_connections 2024-09-17T04:21:35.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.141+0000 7f55a8b78640 1 -- 172.21.15.88:0/3004912607 wait complete. 2024-09-17T04:21:35.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.142+0000 7f55a8b78640 1 Processor -- start 2024-09-17T04:21:35.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.142+0000 7f55a8b78640 1 -- start start 2024-09-17T04:21:35.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.143+0000 7f55a8b78640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55a41023f0 0x7f55a4101ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:21:35.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.143+0000 7f55a8b78640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55a4104d20 0x7f55a41003a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:21:35.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.143+0000 7f55a8b78640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f55a410a7c0 con 0x7f55a4104d20 2024-09-17T04:21:35.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.143+0000 7f55a8b78640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f55a410a640 con 0x7f55a41023f0 2024-09-17T04:21:35.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.143+0000 7f55a259c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55a41023f0 0x7f55a4101ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:21:35.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.143+0000 7f55a1d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55a4104d20 0x7f55a41003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:21:35.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.143+0000 7f55a259c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55a41023f0 0x7f55a4101ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.88:42792/0 (socket says 172.21.15.88:42792) 2024-09-17T04:21:35.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.143+0000 7f55a1d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55a4104d20 0x7f55a41003a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35610/0 (socket says 172.21.15.88:35610) 2024-09-17T04:21:35.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.143+0000 7f55a259c640 1 -- 172.21.15.88:0/2675920156 learned_addr learned my addr 172.21.15.88:0/2675920156 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:21:35.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.143+0000 7f55a259c640 1 -- 172.21.15.88:0/2675920156 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55a4104d20 msgr2=0x7f55a41003a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:35.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.143+0000 7f55a259c640 1 --2- 172.21.15.88:0/2675920156 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55a4104d20 0x7f55a41003a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:35.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.143+0000 7f55a259c640 1 -- 172.21.15.88:0/2675920156 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55a41008e0 con 0x7f55a41023f0 2024-09-17T04:21:35.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.143+0000 7f55a1d9b640 1 --2- 172.21.15.88:0/2675920156 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55a4104d20 0x7f55a41003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:21:35.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.143+0000 7f55a259c640 1 --2- 172.21.15.88:0/2675920156 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55a41023f0 0x7f55a4101ce0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f55940099d0 tx=0x7f55940045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:21:35.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.144+0000 7f55937fe640 1 -- 172.21.15.88:0/2675920156 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f559403f070 con 0x7f55a41023f0 2024-09-17T04:21:35.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.144+0000 7f55a8b78640 1 -- 172.21.15.88:0/2675920156 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55a4100b70 con 0x7f55a41023f0 2024-09-17T04:21:35.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.144+0000 7f55937fe640 1 -- 172.21.15.88:0/2675920156 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f55940049d0 con 0x7f55a41023f0 2024-09-17T04:21:35.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.144+0000 7f55937fe640 1 -- 172.21.15.88:0/2675920156 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5594035030 con 0x7f55a41023f0 2024-09-17T04:21:35.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.144+0000 7f55a8b78640 1 -- 172.21.15.88:0/2675920156 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55a41010a0 con 0x7f55a41023f0 2024-09-17T04:21:35.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.145+0000 7f55a8b78640 1 -- 172.21.15.88:0/2675920156 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55840052c0 con 0x7f55a41023f0 2024-09-17T04:21:35.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.146+0000 7f55937fe640 1 -- 172.21.15.88:0/2675920156 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f5594042070 con 0x7f55a41023f0 2024-09-17T04:21:35.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.146+0000 7f55937fe640 1 --2- 172.21.15.88:0/2675920156 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f558c074a80 0x7f558c076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:21:35.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.146+0000 7f55937fe640 1 -- 172.21.15.88:0/2675920156 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f55940b6d80 con 0x7f55a41023f0 2024-09-17T04:21:35.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.146+0000 7f55a1d9b640 1 --2- 172.21.15.88:0/2675920156 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f558c074a80 0x7f558c076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:21:35.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.147+0000 7f55a1d9b640 1 --2- 172.21.15.88:0/2675920156 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f558c074a80 0x7f558c076f40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f55a4101a60 tx=0x7f5598005f90 comp rx=0 tx=0).ready entity=mgr.24431 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:21:35.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.152+0000 7f55937fe640 1 -- 172.21.15.88:0/2675920156 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f5594082310 con 0x7f55a41023f0 2024-09-17T04:21:35.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.525+0000 7f55a8b78640 1 -- 172.21.15.88:0/2675920156 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f5584005880 con 0x7f55a41023f0 2024-09-17T04:21:35.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.525+0000 7f55937fe640 1 -- 172.21.15.88:0/2675920156 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) ==== 76+0+2045 (secure 0 0 0) 0x7f55940871c0 con 0x7f55a41023f0 2024-09-17T04:21:35.527 INFO:teuthology.orchestra.run.smithi088.stdout:e15 2024-09-17T04:21:35.527 INFO:teuthology.orchestra.run.smithi088.stdout:btime 2024-09-17T04:18:27:750910+0000 2024-09-17T04:21:35.527 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T04:21:35.527 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:21:35.527 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2024-09-17T04:21:35.527 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:21:35.527 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2024-09-17T04:21:35.527 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2024-09-17T04:21:35.527 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 15 2024-09-17T04:21:35.527 INFO:teuthology.orchestra.run.smithi088.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T04:21:35.527 INFO:teuthology.orchestra.run.smithi088.stdout:created 2024-09-17T04:18:10.480573+0000 2024-09-17T04:21:35.528 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2024-09-17T04:18:27.750896+0000 2024-09-17T04:21:35.528 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2024-09-17T04:21:35.528 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2024-09-17T04:21:35.528 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2024-09-17T04:21:35.528 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2024-09-17T04:21:35.528 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2024-09-17T04:21:35.528 INFO:teuthology.orchestra.run.smithi088.stdout:max_xattr_size 65536 2024-09-17T04:21:35.528 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2024-09-17T04:21:35.528 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2024-09-17T04:21:35.528 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 45 2024-09-17T04:21:35.528 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:21:35.528 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 1 2024-09-17T04:21:35.529 INFO:teuthology.orchestra.run.smithi088.stdout:in 0 2024-09-17T04:21:35.529 INFO:teuthology.orchestra.run.smithi088.stdout:up {0=14590} 2024-09-17T04:21:35.529 INFO:teuthology.orchestra.run.smithi088.stdout:failed 2024-09-17T04:21:35.529 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2024-09-17T04:21:35.529 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2024-09-17T04:21:35.529 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2024-09-17T04:21:35.529 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2024-09-17T04:21:35.529 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data enabled 2024-09-17T04:21:35.529 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2024-09-17T04:21:35.530 INFO:teuthology.orchestra.run.smithi088.stdout:bal_rank_mask -1 2024-09-17T04:21:35.530 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 1 2024-09-17T04:21:35.530 INFO:teuthology.orchestra.run.smithi088.stdout:qdb_cluster leader: 14590 members: 14590 2024-09-17T04:21:35.530 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.giqrgt{0:14590} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.88:6828/1714846518,v1:172.21.15.88:6829/1714846518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:21:35.530 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi134.psnynp{0:24321} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.134:6826/2137586894,v1:172.21.15.134:6827/2137586894] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:21:35.530 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:21:35.530 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:21:35.530 INFO:teuthology.orchestra.run.smithi088.stdout:Standby daemons: 2024-09-17T04:21:35.530 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:21:35.530 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi134.ktuhce{-1:24325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/967997022,v1:172.21.15.134:6825/967997022] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:21:35.530 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.lgavsv{-1:24329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/1425146180,v1:172.21.15.88:6827/1425146180] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:21:35.531 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 15 2024-09-17T04:21:35.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.529+0000 7f55a8b78640 1 -- 172.21.15.88:0/2675920156 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f558c074a80 msgr2=0x7f558c076f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:35.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.529+0000 7f55a8b78640 1 --2- 172.21.15.88:0/2675920156 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f558c074a80 0x7f558c076f40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f55a4101a60 tx=0x7f5598005f90 comp rx=0 tx=0).stop 2024-09-17T04:21:35.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.529+0000 7f55a8b78640 1 -- 172.21.15.88:0/2675920156 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55a41023f0 msgr2=0x7f55a4101ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:35.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.529+0000 7f55a8b78640 1 --2- 172.21.15.88:0/2675920156 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55a41023f0 0x7f55a4101ce0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f55940099d0 tx=0x7f55940045e0 comp rx=0 tx=0).stop 2024-09-17T04:21:35.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.529+0000 7f55a8b78640 1 -- 172.21.15.88:0/2675920156 shutdown_connections 2024-09-17T04:21:35.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.529+0000 7f55a8b78640 1 --2- 172.21.15.88:0/2675920156 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f558c074a80 0x7f558c076f40 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:35.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.529+0000 7f55a8b78640 1 --2- 172.21.15.88:0/2675920156 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55a4104d20 0x7f55a41003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:35.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.529+0000 7f55a8b78640 1 --2- 172.21.15.88:0/2675920156 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55a41023f0 0x7f55a4101ce0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:35.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.529+0000 7f55a8b78640 1 -- 172.21.15.88:0/2675920156 >> 172.21.15.88:0/2675920156 conn(0x7f55a40fbff0 msgr2=0x7f55a40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:21:35.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.530+0000 7f55a8b78640 1 -- 172.21.15.88:0/2675920156 shutdown_connections 2024-09-17T04:21:35.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.530+0000 7f55a8b78640 1 -- 172.21.15.88:0/2675920156 wait complete. 2024-09-17T04:21:35.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.639+0000 7f71dcf97640 1 -- 172.21.15.88:0/2934670480 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71d8104d40 msgr2=0x7f71d8107130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:35.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.639+0000 7f71dcf97640 1 --2- 172.21.15.88:0/2934670480 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71d8104d40 0x7f71d8107130 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f71cc0098b0 tx=0x7f71cc02a4d0 comp rx=0 tx=0).stop 2024-09-17T04:21:35.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.639+0000 7f71dcf97640 1 -- 172.21.15.88:0/2934670480 shutdown_connections 2024-09-17T04:21:35.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.639+0000 7f71dcf97640 1 --2- 172.21.15.88:0/2934670480 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71d8104d40 0x7f71d8107130 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:35.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.639+0000 7f71dcf97640 1 --2- 172.21.15.88:0/2934670480 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71d8102410 0x7f71d8104800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:35.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.639+0000 7f71dcf97640 1 -- 172.21.15.88:0/2934670480 >> 172.21.15.88:0/2934670480 conn(0x7f71d80fc030 msgr2=0x7f71d80fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:21:35.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.639+0000 7f71dcf97640 1 -- 172.21.15.88:0/2934670480 shutdown_connections 2024-09-17T04:21:35.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.639+0000 7f71dcf97640 1 -- 172.21.15.88:0/2934670480 wait complete. 2024-09-17T04:21:35.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.640+0000 7f71dcf97640 1 Processor -- start 2024-09-17T04:21:35.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.640+0000 7f71dcf97640 1 -- start start 2024-09-17T04:21:35.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.641+0000 7f71dcf97640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71d8102410 0x7f71d8197590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:21:35.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.641+0000 7f71dcf97640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71d8104d40 0x7f71d8197ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:21:35.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.641+0000 7f71dcf97640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f71d810a7b0 con 0x7f71d8102410 2024-09-17T04:21:35.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.641+0000 7f71dcf97640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f71d810a630 con 0x7f71d8104d40 2024-09-17T04:21:35.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.641+0000 7f71d659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71d8102410 0x7f71d8197590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:21:35.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.641+0000 7f71d659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71d8102410 0x7f71d8197590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35632/0 (socket says 172.21.15.88:35632) 2024-09-17T04:21:35.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.641+0000 7f71d659c640 1 -- 172.21.15.88:0/617220223 learned_addr learned my addr 172.21.15.88:0/617220223 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:21:35.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.641+0000 7f71d5d9b640 1 --2- 172.21.15.88:0/617220223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71d8104d40 0x7f71d8197ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:21:35.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.641+0000 7f71d659c640 1 -- 172.21.15.88:0/617220223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71d8104d40 msgr2=0x7f71d8197ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:35.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.641+0000 7f71d659c640 1 --2- 172.21.15.88:0/617220223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71d8104d40 0x7f71d8197ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:35.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.641+0000 7f71d659c640 1 -- 172.21.15.88:0/617220223 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71d8198150 con 0x7f71d8102410 2024-09-17T04:21:35.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.641+0000 7f71d659c640 1 --2- 172.21.15.88:0/617220223 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71d8102410 0x7f71d8197590 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f71c800e970 tx=0x7f71c800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:21:35.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.641+0000 7f71c77fe640 1 -- 172.21.15.88:0/617220223 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f71c800cac0 con 0x7f71d8102410 2024-09-17T04:21:35.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.642+0000 7f71c77fe640 1 -- 172.21.15.88:0/617220223 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f71c800cc60 con 0x7f71d8102410 2024-09-17T04:21:35.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.642+0000 7f71dcf97640 1 -- 172.21.15.88:0/617220223 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71d819cb90 con 0x7f71d8102410 2024-09-17T04:21:35.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.642+0000 7f71c77fe640 1 -- 172.21.15.88:0/617220223 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f71c8018720 con 0x7f71d8102410 2024-09-17T04:21:35.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.642+0000 7f71dcf97640 1 -- 172.21.15.88:0/617220223 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71d819d0f0 con 0x7f71d8102410 2024-09-17T04:21:35.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.643+0000 7f71dcf97640 1 -- 172.21.15.88:0/617220223 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71d81027f0 con 0x7f71d8102410 2024-09-17T04:21:35.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.643+0000 7f71c77fe640 1 -- 172.21.15.88:0/617220223 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f71c80189e0 con 0x7f71d8102410 2024-09-17T04:21:35.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.644+0000 7f71c77fe640 1 --2- 172.21.15.88:0/617220223 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f71c0074a80 0x7f71c0076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:21:35.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.644+0000 7f71d5d9b640 1 --2- 172.21.15.88:0/617220223 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f71c0074a80 0x7f71c0076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:21:35.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.644+0000 7f71c77fe640 1 -- 172.21.15.88:0/617220223 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f71c80968a0 con 0x7f71d8102410 2024-09-17T04:21:35.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.645+0000 7f71d5d9b640 1 --2- 172.21.15.88:0/617220223 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f71c0074a80 0x7f71c0076f40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f71cc009880 tx=0x7f71cc0058d0 comp rx=0 tx=0).ready entity=mgr.24431 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:21:35.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.650+0000 7f71c77fe640 1 -- 172.21.15.88:0/617220223 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f71c8061df0 con 0x7f71d8102410 2024-09-17T04:21:35.854 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:35 smithi134 ceph-mon[35201]: from='client.14836 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:21:35.854 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:35 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/3425486865' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T04:21:35.854 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:35 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/2675920156' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T04:21:35.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.927+0000 7f71dcf97640 1 -- 172.21.15.88:0/617220223 --> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f71d81057a0 con 0x7f71c0074a80 2024-09-17T04:21:35.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.928+0000 7f71c77fe640 1 -- 172.21.15.88:0/617220223 <== mgr.24431 v2:172.21.15.134:6828/1122341233 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+318 (secure 0 0 0) 0x7f71d81057a0 con 0x7f71c0074a80 2024-09-17T04:21:35.928 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-17T04:21:35.929 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f", 2024-09-17T04:21:35.929 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-09-17T04:21:35.929 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T04:21:35.929 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [], 2024-09-17T04:21:35.929 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "1/23 daemons upgraded", 2024-09-17T04:21:35.929 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "", 2024-09-17T04:21:35.930 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-09-17T04:21:35.930 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-17T04:21:35.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.930+0000 7f71dcf97640 1 -- 172.21.15.88:0/617220223 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f71c0074a80 msgr2=0x7f71c0076f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:35.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.930+0000 7f71dcf97640 1 --2- 172.21.15.88:0/617220223 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f71c0074a80 0x7f71c0076f40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f71cc009880 tx=0x7f71cc0058d0 comp rx=0 tx=0).stop 2024-09-17T04:21:35.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.930+0000 7f71dcf97640 1 -- 172.21.15.88:0/617220223 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71d8102410 msgr2=0x7f71d8197590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:35.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.930+0000 7f71dcf97640 1 --2- 172.21.15.88:0/617220223 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71d8102410 0x7f71d8197590 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f71c800e970 tx=0x7f71c800ee30 comp rx=0 tx=0).stop 2024-09-17T04:21:35.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.930+0000 7f71dcf97640 1 -- 172.21.15.88:0/617220223 shutdown_connections 2024-09-17T04:21:35.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.930+0000 7f71dcf97640 1 --2- 172.21.15.88:0/617220223 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f71c0074a80 0x7f71c0076f40 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:35.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.930+0000 7f71dcf97640 1 --2- 172.21.15.88:0/617220223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71d8104d40 0x7f71d8197ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:35.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.930+0000 7f71dcf97640 1 --2- 172.21.15.88:0/617220223 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71d8102410 0x7f71d8197590 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:35.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.930+0000 7f71dcf97640 1 -- 172.21.15.88:0/617220223 >> 172.21.15.88:0/617220223 conn(0x7f71d80fc030 msgr2=0x7f71d80fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:21:35.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.930+0000 7f71dcf97640 1 -- 172.21.15.88:0/617220223 shutdown_connections 2024-09-17T04:21:35.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:35.930+0000 7f71dcf97640 1 -- 172.21.15.88:0/617220223 wait complete. 2024-09-17T04:21:36.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:36.024+0000 7ffb83723640 1 -- 172.21.15.88:0/960913212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb7c102b70 msgr2=0x7ffb7c102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:36.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:36.024+0000 7ffb83723640 1 --2- 172.21.15.88:0/960913212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb7c102b70 0x7ffb7c102ff0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c009880 tx=0x7ffb6c02a4a0 comp rx=0 tx=0).stop 2024-09-17T04:21:36.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:36.024+0000 7ffb83723640 1 -- 172.21.15.88:0/960913212 shutdown_connections 2024-09-17T04:21:36.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:36.024+0000 7ffb83723640 1 --2- 172.21.15.88:0/960913212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb7c102b70 0x7ffb7c102ff0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:36.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:36.024+0000 7ffb83723640 1 --2- 172.21.15.88:0/960913212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb7c101970 0x7ffb7c101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:36.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:36.024+0000 7ffb83723640 1 -- 172.21.15.88:0/960913212 >> 172.21.15.88:0/960913212 conn(0x7ffb7c0fd140 msgr2=0x7ffb7c0ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:21:36.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:36.024+0000 7ffb83723640 1 -- 172.21.15.88:0/960913212 shutdown_connections 2024-09-17T04:21:36.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:36.024+0000 7ffb83723640 1 -- 172.21.15.88:0/960913212 wait complete. 2024-09-17T04:21:36.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:36.025+0000 7ffb83723640 1 Processor -- start 2024-09-17T04:21:36.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:36.025+0000 7ffb83723640 1 -- start start 2024-09-17T04:21:36.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:36.025+0000 7ffb83723640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb7c101970 0x7ffb7c1974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:21:36.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:36.025+0000 7ffb83723640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb7c102b70 0x7ffb7c197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:21:36.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:36.025+0000 7ffb83723640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ffb7c10a7b0 con 0x7ffb7c102b70 2024-09-17T04:21:36.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:36.025+0000 7ffb83723640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ffb7c10a630 con 0x7ffb7c101970 2024-09-17T04:21:36.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:36.025+0000 7ffb80cbe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb7c102b70 0x7ffb7c197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:21:36.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:36.025+0000 7ffb80cbe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb7c102b70 0x7ffb7c197a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35656/0 (socket says 172.21.15.88:35656) 2024-09-17T04:21:36.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:36.025+0000 7ffb80cbe640 1 -- 172.21.15.88:0/3481269293 learned_addr learned my addr 172.21.15.88:0/3481269293 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:21:36.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:36.025+0000 7ffb814bf640 1 --2- 172.21.15.88:0/3481269293 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb7c101970 0x7ffb7c1974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:21:36.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:36.026+0000 7ffb80cbe640 1 -- 172.21.15.88:0/3481269293 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb7c101970 msgr2=0x7ffb7c1974d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:36.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:36.026+0000 7ffb80cbe640 1 --2- 172.21.15.88:0/3481269293 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb7c101970 0x7ffb7c1974d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:36.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:36.026+0000 7ffb80cbe640 1 -- 172.21.15.88:0/3481269293 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb7c198090 con 0x7ffb7c102b70 2024-09-17T04:21:36.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:36.026+0000 7ffb80cbe640 1 --2- 172.21.15.88:0/3481269293 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb7c102b70 0x7ffb7c197a10 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c009230 tx=0x7ffb6c004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:21:36.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:36.026+0000 7ffb727fc640 1 -- 172.21.15.88:0/3481269293 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffb6c03f070 con 0x7ffb7c102b70 2024-09-17T04:21:36.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:36.026+0000 7ffb83723640 1 -- 172.21.15.88:0/3481269293 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb7c19ca70 con 0x7ffb7c102b70 2024-09-17T04:21:36.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:36.026+0000 7ffb727fc640 1 -- 172.21.15.88:0/3481269293 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ffb6c004a90 con 0x7ffb7c102b70 2024-09-17T04:21:36.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:36.026+0000 7ffb727fc640 1 -- 172.21.15.88:0/3481269293 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffb6c035030 con 0x7ffb7c102b70 2024-09-17T04:21:36.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:36.026+0000 7ffb83723640 1 -- 172.21.15.88:0/3481269293 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb7c19d000 con 0x7ffb7c102b70 2024-09-17T04:21:36.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:36.027+0000 7ffb83723640 1 -- 172.21.15.88:0/3481269293 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb7c101d70 con 0x7ffb7c102b70 2024-09-17T04:21:36.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:36.028+0000 7ffb727fc640 1 -- 172.21.15.88:0/3481269293 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7ffb6c042070 con 0x7ffb7c102b70 2024-09-17T04:21:36.028 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:35 smithi088 ceph-mon[27811]: from='client.14836 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:21:36.029 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:35 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/3425486865' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T04:21:36.029 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:35 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/2675920156' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T04:21:36.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:36.029+0000 7ffb727fc640 1 --2- 172.21.15.88:0/3481269293 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7ffb68074a80 0x7ffb68076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:21:36.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:36.029+0000 7ffb727fc640 1 -- 172.21.15.88:0/3481269293 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7ffb6c0b6d80 con 0x7ffb7c102b70 2024-09-17T04:21:36.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:36.029+0000 7ffb814bf640 1 --2- 172.21.15.88:0/3481269293 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7ffb68074a80 0x7ffb68076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:21:36.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:36.030+0000 7ffb814bf640 1 --2- 172.21.15.88:0/3481269293 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7ffb68074a80 0x7ffb68076f40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c1029d0 tx=0x7ffb78005f90 comp rx=0 tx=0).ready entity=mgr.24431 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:21:36.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:36.037+0000 7ffb727fc640 1 -- 172.21.15.88:0/3481269293 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7ffb6c082330 con 0x7ffb7c102b70 2024-09-17T04:21:36.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:36.443+0000 7ffb83723640 1 -- 172.21.15.88:0/3481269293 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7ffb7c062df0 con 0x7ffb7c102b70 2024-09-17T04:21:36.445 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T04:21:36.445 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T04:21:36.445 INFO:teuthology.orchestra.run.smithi088.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T04:21:36.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:36.445+0000 7ffb727fc640 1 -- 172.21.15.88:0/3481269293 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7ffb6c0871e0 con 0x7ffb7c102b70 2024-09-17T04:21:36.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:36.448+0000 7ffb83723640 1 -- 172.21.15.88:0/3481269293 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7ffb68074a80 msgr2=0x7ffb68076f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:36.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:36.448+0000 7ffb83723640 1 --2- 172.21.15.88:0/3481269293 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7ffb68074a80 0x7ffb68076f40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c1029d0 tx=0x7ffb78005f90 comp rx=0 tx=0).stop 2024-09-17T04:21:36.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:36.448+0000 7ffb83723640 1 -- 172.21.15.88:0/3481269293 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb7c102b70 msgr2=0x7ffb7c197a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:21:36.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:36.448+0000 7ffb83723640 1 --2- 172.21.15.88:0/3481269293 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb7c102b70 0x7ffb7c197a10 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c009230 tx=0x7ffb6c004570 comp rx=0 tx=0).stop 2024-09-17T04:21:36.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:36.448+0000 7ffb83723640 1 -- 172.21.15.88:0/3481269293 shutdown_connections 2024-09-17T04:21:36.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:36.448+0000 7ffb83723640 1 --2- 172.21.15.88:0/3481269293 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7ffb68074a80 0x7ffb68076f40 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:36.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:36.448+0000 7ffb83723640 1 --2- 172.21.15.88:0/3481269293 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb7c102b70 0x7ffb7c197a10 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:36.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:36.448+0000 7ffb83723640 1 --2- 172.21.15.88:0/3481269293 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb7c101970 0x7ffb7c1974d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:21:36.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:36.448+0000 7ffb83723640 1 -- 172.21.15.88:0/3481269293 >> 172.21.15.88:0/3481269293 conn(0x7ffb7c0fd140 msgr2=0x7ffb7c106000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:21:36.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:36.449+0000 7ffb83723640 1 -- 172.21.15.88:0/3481269293 shutdown_connections 2024-09-17T04:21:36.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:21:36.450+0000 7ffb83723640 1 -- 172.21.15.88:0/3481269293 wait complete. 2024-09-17T04:21:37.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:36 smithi088 ceph-mon[27811]: from='client.14848 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:21:37.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:36 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/3481269293' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T04:21:37.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:36 smithi088 ceph-mon[27811]: pgmap v39: 65 pgs: 65 active+clean; 1.8 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 30 MiB/s rd, 68 MiB/s wr, 299 op/s 2024-09-17T04:21:37.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:36 smithi134 ceph-mon[35201]: from='client.14848 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:21:37.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:36 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/3481269293' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T04:21:37.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:36 smithi134 ceph-mon[35201]: pgmap v39: 65 pgs: 65 active+clean; 1.8 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 30 MiB/s rd, 68 MiB/s wr, 299 op/s 2024-09-17T04:21:37.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:37 smithi088 ceph-mon[27811]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:21:37.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:37 smithi088 ceph-mon[27811]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:21:37.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:37 smithi088 ceph-mon[27811]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T04:21:37.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:37 smithi088 ceph-mon[27811]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T04:21:37.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:37 smithi088 ceph-mon[27811]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:21:37.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:37 smithi088 ceph-mon[27811]: Upgrade: Need to upgrade myself (mgr.smithi134.vwdxcb) 2024-09-17T04:21:37.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:37 smithi088 ceph-mon[27811]: Upgrade: Need to upgrade myself (mgr.smithi134.vwdxcb) 2024-09-17T04:21:38.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:37 smithi134 ceph-mon[35201]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:21:38.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:37 smithi134 ceph-mon[35201]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:21:38.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:37 smithi134 ceph-mon[35201]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T04:21:38.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:37 smithi134 ceph-mon[35201]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T04:21:38.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:37 smithi134 ceph-mon[35201]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:21:38.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:37 smithi134 ceph-mon[35201]: Upgrade: Need to upgrade myself (mgr.smithi134.vwdxcb) 2024-09-17T04:21:38.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:37 smithi134 ceph-mon[35201]: Upgrade: Need to upgrade myself (mgr.smithi134.vwdxcb) 2024-09-17T04:21:39.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:39 smithi088 ceph-mon[27811]: Upgrade: Updating mgr.smithi088.wmndiv 2024-09-17T04:21:39.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:39 smithi088 ceph-mon[27811]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:21:39.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:39 smithi088 ceph-mon[27811]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi088.wmndiv", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T04:21:39.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:39 smithi088 ceph-mon[27811]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi088.wmndiv", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T04:21:39.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:39 smithi088 ceph-mon[27811]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T04:21:39.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:39 smithi088 ceph-mon[27811]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:21:39.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:39 smithi088 ceph-mon[27811]: Deploying daemon mgr.smithi088.wmndiv on smithi088 2024-09-17T04:21:39.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:39 smithi088 ceph-mon[27811]: pgmap v40: 65 pgs: 65 active+clean; 1.8 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 8.2 MiB/s rd, 23 MiB/s wr, 158 op/s 2024-09-17T04:21:39.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:39 smithi134 ceph-mon[35201]: Upgrade: Updating mgr.smithi088.wmndiv 2024-09-17T04:21:39.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:39 smithi134 ceph-mon[35201]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:21:39.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:39 smithi134 ceph-mon[35201]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi088.wmndiv", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T04:21:39.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:39 smithi134 ceph-mon[35201]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi088.wmndiv", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T04:21:39.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:39 smithi134 ceph-mon[35201]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T04:21:39.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:39 smithi134 ceph-mon[35201]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:21:39.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:39 smithi134 ceph-mon[35201]: Deploying daemon mgr.smithi088.wmndiv on smithi088 2024-09-17T04:21:39.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:39 smithi134 ceph-mon[35201]: pgmap v40: 65 pgs: 65 active+clean; 1.8 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 8.2 MiB/s rd, 23 MiB/s wr, 158 op/s 2024-09-17T04:21:40.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:40 smithi088 ceph-mon[27811]: pgmap v41: 65 pgs: 65 active+clean; 1.8 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 8.2 MiB/s rd, 23 MiB/s wr, 158 op/s 2024-09-17T04:21:40.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:40 smithi134 ceph-mon[35201]: pgmap v41: 65 pgs: 65 active+clean; 1.8 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 8.2 MiB/s rd, 23 MiB/s wr, 158 op/s 2024-09-17T04:21:41.873 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:41 smithi088 ceph-mon[27811]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:21:41.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:41 smithi134 ceph-mon[35201]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:21:42.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:42 smithi088 ceph-mon[27811]: pgmap v42: 65 pgs: 65 active+clean; 1.2 GiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 9.0 MiB/s rd, 24 MiB/s wr, 217 op/s 2024-09-17T04:21:42.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:42 smithi088 ceph-mon[27811]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:21:42.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:42 smithi088 ceph-mon[27811]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:21:42.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:42 smithi088 ceph-mon[27811]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:21:42.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:42 smithi134 ceph-mon[35201]: pgmap v42: 65 pgs: 65 active+clean; 1.2 GiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 9.0 MiB/s rd, 24 MiB/s wr, 217 op/s 2024-09-17T04:21:42.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:42 smithi134 ceph-mon[35201]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:21:42.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:42 smithi134 ceph-mon[35201]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:21:42.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:42 smithi134 ceph-mon[35201]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:21:44.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:44 smithi134 ceph-mon[35201]: pgmap v43: 65 pgs: 65 active+clean; 1.2 GiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 123 op/s 2024-09-17T04:21:44.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:44 smithi088 ceph-mon[27811]: pgmap v43: 65 pgs: 65 active+clean; 1.2 GiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 123 op/s 2024-09-17T04:21:46.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:46 smithi088 ceph-mon[27811]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:21:46.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:46 smithi088 ceph-mon[27811]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:21:46.881 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:46 smithi134 ceph-mon[35201]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:21:46.881 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:46 smithi134 ceph-mon[35201]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:21:47.335 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-17T04:21:47.335 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-17T04:21:47.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:47 smithi088 ceph-mon[27811]: pgmap v44: 65 pgs: 65 active+clean; 767 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 178 op/s 2024-09-17T04:21:47.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:47 smithi134 ceph-mon[35201]: pgmap v44: 65 pgs: 65 active+clean; 767 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 178 op/s 2024-09-17T04:21:48.871 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:48 smithi134 ceph-mon[35201]: pgmap v45: 65 pgs: 65 active+clean; 767 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 113 op/s 2024-09-17T04:21:48.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:48 smithi088 ceph-mon[27811]: pgmap v45: 65 pgs: 65 active+clean; 767 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 113 op/s 2024-09-17T04:21:49.738 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:49 smithi088 ceph-mon[27811]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:21:49.739 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:49 smithi088 ceph-mon[27811]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:21:49.739 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:49 smithi088 ceph-mon[27811]: Standby manager daemon smithi088.wmndiv restarted 2024-09-17T04:21:49.739 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:49 smithi088 ceph-mon[27811]: Standby manager daemon smithi088.wmndiv started 2024-09-17T04:21:49.739 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:49 smithi088 ceph-mon[27811]: from='mgr.? 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi088.wmndiv/crt"}]: dispatch 2024-09-17T04:21:49.739 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:49 smithi088 ceph-mon[27811]: from='mgr.? 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T04:21:49.739 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:49 smithi088 ceph-mon[27811]: from='mgr.? 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi088.wmndiv/key"}]: dispatch 2024-09-17T04:21:49.995 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:49 smithi088 ceph-mon[27811]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:21:49.995 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:49 smithi088 ceph-mon[27811]: from='mgr.? 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T04:21:49.995 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:49 smithi088 ceph-mon[27811]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:21:50.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:49 smithi134 ceph-mon[35201]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:21:50.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:49 smithi134 ceph-mon[35201]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:21:50.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:49 smithi134 ceph-mon[35201]: Standby manager daemon smithi088.wmndiv restarted 2024-09-17T04:21:50.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:49 smithi134 ceph-mon[35201]: Standby manager daemon smithi088.wmndiv started 2024-09-17T04:21:50.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:49 smithi134 ceph-mon[35201]: from='mgr.? 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi088.wmndiv/crt"}]: dispatch 2024-09-17T04:21:50.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:49 smithi134 ceph-mon[35201]: from='mgr.? 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T04:21:50.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:49 smithi134 ceph-mon[35201]: from='mgr.? 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi088.wmndiv/key"}]: dispatch 2024-09-17T04:21:50.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:49 smithi134 ceph-mon[35201]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:21:50.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:49 smithi134 ceph-mon[35201]: from='mgr.? 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T04:21:50.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:49 smithi134 ceph-mon[35201]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:21:51.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:50 smithi088 ceph-mon[27811]: mgrmap e26: smithi134.vwdxcb(active, since 85s), standbys: smithi088.wmndiv 2024-09-17T04:21:51.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:50 smithi088 ceph-mon[27811]: pgmap v46: 65 pgs: 65 active+clean; 767 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 113 op/s 2024-09-17T04:21:51.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:50 smithi134 ceph-mon[35201]: mgrmap e26: smithi134.vwdxcb(active, since 85s), standbys: smithi088.wmndiv 2024-09-17T04:21:51.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:50 smithi134 ceph-mon[35201]: pgmap v46: 65 pgs: 65 active+clean; 767 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 113 op/s 2024-09-17T04:21:52.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:52 smithi088 ceph-mon[27811]: pgmap v47: 65 pgs: 65 active+clean; 289 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 165 op/s 2024-09-17T04:21:52.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:52 smithi134 ceph-mon[35201]: pgmap v47: 65 pgs: 65 active+clean; 289 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 165 op/s 2024-09-17T04:21:54.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:54 smithi088 ceph-mon[27811]: pgmap v48: 65 pgs: 65 active+clean; 289 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 107 op/s 2024-09-17T04:21:54.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:54 smithi134 ceph-mon[35201]: pgmap v48: 65 pgs: 65 active+clean; 289 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 107 op/s 2024-09-17T04:21:56.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:55 smithi088 ceph-mon[27811]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:21:56.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:55 smithi134 ceph-mon[35201]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:21:56.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:56 smithi088 ceph-mon[27811]: pgmap v49: 65 pgs: 65 active+clean; 288 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 157 op/s 2024-09-17T04:21:57.049 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:56 smithi134 ceph-mon[35201]: pgmap v49: 65 pgs: 65 active+clean; 288 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 157 op/s 2024-09-17T04:21:59.054 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:58 smithi088 ceph-mon[27811]: mgrmap e27: smithi134.vwdxcb(active, since 93s), standbys: smithi088.wmndiv 2024-09-17T04:21:59.054 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:21:58 smithi088 ceph-mon[27811]: pgmap v50: 65 pgs: 65 active+clean; 288 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 102 op/s 2024-09-17T04:21:59.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:58 smithi134 ceph-mon[35201]: mgrmap e27: smithi134.vwdxcb(active, since 93s), standbys: smithi088.wmndiv 2024-09-17T04:21:59.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:21:58 smithi134 ceph-mon[35201]: pgmap v50: 65 pgs: 65 active+clean; 288 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 102 op/s 2024-09-17T04:22:00.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:00 smithi088 ceph-mon[27811]: pgmap v51: 65 pgs: 65 active+clean; 288 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 102 op/s 2024-09-17T04:22:00.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:00 smithi134 ceph-mon[35201]: pgmap v51: 65 pgs: 65 active+clean; 288 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 102 op/s 2024-09-17T04:22:02.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:02 smithi088 ceph-mon[27811]: pgmap v52: 65 pgs: 65 active+clean; 294 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 145 op/s 2024-09-17T04:22:02.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:02 smithi134 ceph-mon[35201]: pgmap v52: 65 pgs: 65 active+clean; 294 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 145 op/s 2024-09-17T04:22:04.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:04 smithi088 ceph-mon[27811]: pgmap v53: 65 pgs: 65 active+clean; 294 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 93 op/s 2024-09-17T04:22:04.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:04 smithi134 ceph-mon[35201]: pgmap v53: 65 pgs: 65 active+clean; 294 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 93 op/s 2024-09-17T04:22:06.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:06.561+0000 7f4b694bf640 1 -- 172.21.15.88:0/1237975773 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b64100880 msgr2=0x7f4b64100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:06.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:06.561+0000 7f4b694bf640 1 --2- 172.21.15.88:0/1237975773 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b64100880 0x7f4b64100c80 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f4b54009880 tx=0x7f4b5402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:22:06.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:06.561+0000 7f4b694bf640 1 -- 172.21.15.88:0/1237975773 shutdown_connections 2024-09-17T04:22:06.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:06.561+0000 7f4b694bf640 1 --2- 172.21.15.88:0/1237975773 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b64101a80 0x7f4b64101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:06.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:06.561+0000 7f4b694bf640 1 --2- 172.21.15.88:0/1237975773 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b64100880 0x7f4b64100c80 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:06.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:06.561+0000 7f4b694bf640 1 -- 172.21.15.88:0/1237975773 >> 172.21.15.88:0/1237975773 conn(0x7f4b640fc010 msgr2=0x7f4b640fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:22:06.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:06.561+0000 7f4b694bf640 1 -- 172.21.15.88:0/1237975773 shutdown_connections 2024-09-17T04:22:06.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:06.561+0000 7f4b694bf640 1 -- 172.21.15.88:0/1237975773 wait complete. 2024-09-17T04:22:06.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:06.562+0000 7f4b694bf640 1 Processor -- start 2024-09-17T04:22:06.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:06.562+0000 7f4b694bf640 1 -- start start 2024-09-17T04:22:06.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:06.562+0000 7f4b694bf640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b64100880 0x7f4b64197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:22:06.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:06.562+0000 7f4b694bf640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b64101a80 0x7f4b64197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:22:06.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:06.562+0000 7f4b694bf640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f4b641096a0 con 0x7f4b64101a80 2024-09-17T04:22:06.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:06.562+0000 7f4b694bf640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4b64109520 con 0x7f4b64100880 2024-09-17T04:22:06.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:06.562+0000 7f4b627fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b64101a80 0x7f4b64197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:22:06.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:06.562+0000 7f4b627fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b64101a80 0x7f4b64197a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56530/0 (socket says 172.21.15.88:56530) 2024-09-17T04:22:06.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:06.562+0000 7f4b627fc640 1 -- 172.21.15.88:0/1107353758 learned_addr learned my addr 172.21.15.88:0/1107353758 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:22:06.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:06.562+0000 7f4b62ffd640 1 --2- 172.21.15.88:0/1107353758 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b64100880 0x7f4b64197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:22:06.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:06.563+0000 7f4b627fc640 1 -- 172.21.15.88:0/1107353758 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b64100880 msgr2=0x7f4b64197500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:06.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:06.563+0000 7f4b627fc640 1 --2- 172.21.15.88:0/1107353758 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b64100880 0x7f4b64197500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:06.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:06.563+0000 7f4b627fc640 1 -- 172.21.15.88:0/1107353758 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b641980c0 con 0x7f4b64101a80 2024-09-17T04:22:06.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:06.563+0000 7f4b62ffd640 1 --2- 172.21.15.88:0/1107353758 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b64100880 0x7f4b64197500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:22:06.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:06.563+0000 7f4b627fc640 1 --2- 172.21.15.88:0/1107353758 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b64101a80 0x7f4b64197a40 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f4b5800e970 tx=0x7f4b5800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:22:06.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:06.563+0000 7f4b4bfff640 1 -- 172.21.15.88:0/1107353758 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4b5800cac0 con 0x7f4b64101a80 2024-09-17T04:22:06.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:06.563+0000 7f4b4bfff640 1 -- 172.21.15.88:0/1107353758 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4b5800cc60 con 0x7f4b64101a80 2024-09-17T04:22:06.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:06.563+0000 7f4b4bfff640 1 -- 172.21.15.88:0/1107353758 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4b58018720 con 0x7f4b64101a80 2024-09-17T04:22:06.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:06.563+0000 7f4b694bf640 1 -- 172.21.15.88:0/1107353758 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b6419cb00 con 0x7f4b64101a80 2024-09-17T04:22:06.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:06.563+0000 7f4b694bf640 1 -- 172.21.15.88:0/1107353758 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b6419d090 con 0x7f4b64101a80 2024-09-17T04:22:06.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:06.564+0000 7f4b694bf640 1 -- 172.21.15.88:0/1107353758 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b64100c80 con 0x7f4b64101a80 2024-09-17T04:22:06.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:06.565+0000 7f4b4bfff640 1 -- 172.21.15.88:0/1107353758 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 27) ==== 103322+0+0 (secure 0 0 0) 0x7f4b58010430 con 0x7f4b64101a80 2024-09-17T04:22:06.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:06.566+0000 7f4b4bfff640 1 --2- 172.21.15.88:0/1107353758 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f4b4c07af30 0x7f4b4c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:22:06.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:06.566+0000 7f4b4bfff640 1 -- 172.21.15.88:0/1107353758 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f4b5809e490 con 0x7f4b64101a80 2024-09-17T04:22:06.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:06.566+0000 7f4b62ffd640 1 --2- 172.21.15.88:0/1107353758 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f4b4c07af30 0x7f4b4c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:22:06.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:06.567+0000 7f4b62ffd640 1 --2- 172.21.15.88:0/1107353758 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f4b4c07af30 0x7f4b4c07d3f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4b54009230 tx=0x7f4b540058d0 comp rx=0 tx=0).ready entity=mgr.24431 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:22:06.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:06.574+0000 7f4b4bfff640 1 -- 172.21.15.88:0/1107353758 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f4b58069be0 con 0x7f4b64101a80 2024-09-17T04:22:06.882 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:06.882+0000 7f4b694bf640 1 -- 172.21.15.88:0/1107353758 --> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f4b6406abd0 con 0x7f4b4c07af30 2024-09-17T04:22:06.882 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:06 smithi088 ceph-mon[27811]: pgmap v54: 65 pgs: 65 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 130 op/s 2024-09-17T04:22:06.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:06.884+0000 7f4b4bfff640 1 -- 172.21.15.88:0/1107353758 <== mgr.24431 v2:172.21.15.134:6828/1122341233 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+368 (secure 0 0 0) 0x7f4b6406abd0 con 0x7f4b4c07af30 2024-09-17T04:22:06.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:06.886+0000 7f4b694bf640 1 -- 172.21.15.88:0/1107353758 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f4b4c07af30 msgr2=0x7f4b4c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:06.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:06.886+0000 7f4b694bf640 1 --2- 172.21.15.88:0/1107353758 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f4b4c07af30 0x7f4b4c07d3f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4b54009230 tx=0x7f4b540058d0 comp rx=0 tx=0).stop 2024-09-17T04:22:06.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:06.886+0000 7f4b694bf640 1 -- 172.21.15.88:0/1107353758 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b64101a80 msgr2=0x7f4b64197a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:06.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:06.886+0000 7f4b694bf640 1 --2- 172.21.15.88:0/1107353758 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b64101a80 0x7f4b64197a40 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f4b5800e970 tx=0x7f4b5800ee30 comp rx=0 tx=0).stop 2024-09-17T04:22:06.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:06.886+0000 7f4b694bf640 1 -- 172.21.15.88:0/1107353758 shutdown_connections 2024-09-17T04:22:06.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:06.886+0000 7f4b694bf640 1 --2- 172.21.15.88:0/1107353758 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f4b4c07af30 0x7f4b4c07d3f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:06.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:06.886+0000 7f4b694bf640 1 --2- 172.21.15.88:0/1107353758 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b64101a80 0x7f4b64197a40 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:06.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:06.886+0000 7f4b694bf640 1 --2- 172.21.15.88:0/1107353758 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b64100880 0x7f4b64197500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:06.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:06.886+0000 7f4b694bf640 1 -- 172.21.15.88:0/1107353758 >> 172.21.15.88:0/1107353758 conn(0x7f4b640fc010 msgr2=0x7f4b6406a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:22:06.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:06.886+0000 7f4b694bf640 1 -- 172.21.15.88:0/1107353758 shutdown_connections 2024-09-17T04:22:06.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:06.886+0000 7f4b694bf640 1 -- 172.21.15.88:0/1107353758 wait complete. 2024-09-17T04:22:06.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:06 smithi134 ceph-mon[35201]: pgmap v54: 65 pgs: 65 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 130 op/s 2024-09-17T04:22:06.896 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-09-17T04:22:07.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.004+0000 7f53da80c640 1 -- 172.21.15.88:0/135624133 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53d40732a0 msgr2=0x7f53d4073680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:07.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.004+0000 7f53da80c640 1 --2- 172.21.15.88:0/135624133 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53d40732a0 0x7f53d4073680 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f53c4009880 tx=0x7f53c402a4b0 comp rx=0 tx=0).stop 2024-09-17T04:22:07.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.004+0000 7f53da80c640 1 -- 172.21.15.88:0/135624133 shutdown_connections 2024-09-17T04:22:07.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.004+0000 7f53da80c640 1 --2- 172.21.15.88:0/135624133 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53d41091f0 0x7f53d4109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:07.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.004+0000 7f53da80c640 1 --2- 172.21.15.88:0/135624133 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53d40732a0 0x7f53d4073680 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:07.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.004+0000 7f53da80c640 1 -- 172.21.15.88:0/135624133 >> 172.21.15.88:0/135624133 conn(0x7f53d406ea50 msgr2=0x7f53d4070e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:22:07.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.004+0000 7f53da80c640 1 -- 172.21.15.88:0/135624133 shutdown_connections 2024-09-17T04:22:07.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.004+0000 7f53da80c640 1 -- 172.21.15.88:0/135624133 wait complete. 2024-09-17T04:22:07.006 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.005+0000 7f53da80c640 1 Processor -- start 2024-09-17T04:22:07.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.005+0000 7f53da80c640 1 -- start start 2024-09-17T04:22:07.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.005+0000 7f53da80c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53d40732a0 0x7f53d41a62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:22:07.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.005+0000 7f53da80c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53d41091f0 0x7f53d41a6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:22:07.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.005+0000 7f53da80c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f53d41195b0 con 0x7f53d41091f0 2024-09-17T04:22:07.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.005+0000 7f53da80c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f53d4119430 con 0x7f53d40732a0 2024-09-17T04:22:07.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.006+0000 7f53d37fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53d41091f0 0x7f53d41a6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:22:07.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.006+0000 7f53d37fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53d41091f0 0x7f53d41a6820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56548/0 (socket says 172.21.15.88:56548) 2024-09-17T04:22:07.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.006+0000 7f53d37fe640 1 -- 172.21.15.88:0/4203230486 learned_addr learned my addr 172.21.15.88:0/4203230486 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:22:07.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.006+0000 7f53d3fff640 1 --2- 172.21.15.88:0/4203230486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53d40732a0 0x7f53d41a62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:22:07.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.006+0000 7f53d37fe640 1 -- 172.21.15.88:0/4203230486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53d40732a0 msgr2=0x7f53d41a62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:07.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.006+0000 7f53d37fe640 1 --2- 172.21.15.88:0/4203230486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53d40732a0 0x7f53d41a62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:07.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.006+0000 7f53d37fe640 1 -- 172.21.15.88:0/4203230486 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53d41a6ea0 con 0x7f53d41091f0 2024-09-17T04:22:07.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.006+0000 7f53d37fe640 1 --2- 172.21.15.88:0/4203230486 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53d41091f0 0x7f53d41a6820 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f53c800e970 tx=0x7f53c800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:22:07.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.007+0000 7f53d17fa640 1 -- 172.21.15.88:0/4203230486 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f53c800cac0 con 0x7f53d41091f0 2024-09-17T04:22:07.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.007+0000 7f53da80c640 1 -- 172.21.15.88:0/4203230486 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53d41ab8e0 con 0x7f53d41091f0 2024-09-17T04:22:07.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.007+0000 7f53d17fa640 1 -- 172.21.15.88:0/4203230486 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f53c800cc60 con 0x7f53d41091f0 2024-09-17T04:22:07.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.007+0000 7f53d17fa640 1 -- 172.21.15.88:0/4203230486 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f53c8018720 con 0x7f53d41091f0 2024-09-17T04:22:07.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.007+0000 7f53da80c640 1 -- 172.21.15.88:0/4203230486 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53d41abe70 con 0x7f53d41091f0 2024-09-17T04:22:07.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.008+0000 7f53da80c640 1 -- 172.21.15.88:0/4203230486 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53d4073680 con 0x7f53d41091f0 2024-09-17T04:22:07.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.009+0000 7f53d17fa640 1 -- 172.21.15.88:0/4203230486 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 27) ==== 103322+0+0 (secure 0 0 0) 0x7f53c8018a00 con 0x7f53d41091f0 2024-09-17T04:22:07.010 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.010+0000 7f53d17fa640 1 --2- 172.21.15.88:0/4203230486 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f53bc07b030 0x7f53bc07d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:22:07.010 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.010+0000 7f53d17fa640 1 -- 172.21.15.88:0/4203230486 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f53c809e410 con 0x7f53d41091f0 2024-09-17T04:22:07.010 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.010+0000 7f53d3fff640 1 --2- 172.21.15.88:0/4203230486 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f53bc07b030 0x7f53bc07d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:22:07.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.011+0000 7f53d3fff640 1 --2- 172.21.15.88:0/4203230486 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f53bc07b030 0x7f53bc07d4f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f53c402aa20 tx=0x7f53c402a9b0 comp rx=0 tx=0).ready entity=mgr.24431 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:22:07.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.018+0000 7f53d17fa640 1 -- 172.21.15.88:0/4203230486 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f53c8069b40 con 0x7f53d41091f0 2024-09-17T04:22:07.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.288+0000 7f53da80c640 1 -- 172.21.15.88:0/4203230486 --> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f53d410d7e0 con 0x7f53bc07b030 2024-09-17T04:22:07.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.290+0000 7f53d17fa640 1 -- 172.21.15.88:0/4203230486 <== mgr.24431 v2:172.21.15.134:6828/1122341233 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+368 (secure 0 0 0) 0x7f53d410d7e0 con 0x7f53bc07b030 2024-09-17T04:22:07.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.292+0000 7f53da80c640 1 -- 172.21.15.88:0/4203230486 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f53bc07b030 msgr2=0x7f53bc07d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:07.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.292+0000 7f53da80c640 1 --2- 172.21.15.88:0/4203230486 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f53bc07b030 0x7f53bc07d4f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f53c402aa20 tx=0x7f53c402a9b0 comp rx=0 tx=0).stop 2024-09-17T04:22:07.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.292+0000 7f53da80c640 1 -- 172.21.15.88:0/4203230486 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53d41091f0 msgr2=0x7f53d41a6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:07.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.292+0000 7f53da80c640 1 --2- 172.21.15.88:0/4203230486 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53d41091f0 0x7f53d41a6820 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f53c800e970 tx=0x7f53c800ee30 comp rx=0 tx=0).stop 2024-09-17T04:22:07.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.292+0000 7f53da80c640 1 -- 172.21.15.88:0/4203230486 shutdown_connections 2024-09-17T04:22:07.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.292+0000 7f53da80c640 1 --2- 172.21.15.88:0/4203230486 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f53bc07b030 0x7f53bc07d4f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:07.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.292+0000 7f53da80c640 1 --2- 172.21.15.88:0/4203230486 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53d41091f0 0x7f53d41a6820 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:07.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.292+0000 7f53da80c640 1 --2- 172.21.15.88:0/4203230486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53d40732a0 0x7f53d41a62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:07.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.292+0000 7f53da80c640 1 -- 172.21.15.88:0/4203230486 >> 172.21.15.88:0/4203230486 conn(0x7f53d406ea50 msgr2=0x7f53d4071d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:22:07.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.292+0000 7f53da80c640 1 -- 172.21.15.88:0/4203230486 shutdown_connections 2024-09-17T04:22:07.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.293+0000 7f53da80c640 1 -- 172.21.15.88:0/4203230486 wait complete. 2024-09-17T04:22:07.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.402+0000 7f6c5040c640 1 -- 172.21.15.88:0/4250717363 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c48100860 msgr2=0x7f6c48100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:07.402 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.402+0000 7f6c5040c640 1 --2- 172.21.15.88:0/4250717363 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c48100860 0x7f6c48100c60 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f6c44009880 tx=0x7f6c4402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:22:07.402 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.402+0000 7f6c5040c640 1 -- 172.21.15.88:0/4250717363 shutdown_connections 2024-09-17T04:22:07.402 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.402+0000 7f6c5040c640 1 --2- 172.21.15.88:0/4250717363 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c48101a60 0x7f6c48101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:07.402 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.402+0000 7f6c5040c640 1 --2- 172.21.15.88:0/4250717363 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c48100860 0x7f6c48100c60 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:07.402 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.402+0000 7f6c5040c640 1 -- 172.21.15.88:0/4250717363 >> 172.21.15.88:0/4250717363 conn(0x7f6c480fc010 msgr2=0x7f6c480fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:22:07.402 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.402+0000 7f6c5040c640 1 -- 172.21.15.88:0/4250717363 shutdown_connections 2024-09-17T04:22:07.402 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.402+0000 7f6c5040c640 1 -- 172.21.15.88:0/4250717363 wait complete. 2024-09-17T04:22:07.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.402+0000 7f6c5040c640 1 Processor -- start 2024-09-17T04:22:07.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.402+0000 7f6c5040c640 1 -- start start 2024-09-17T04:22:07.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.403+0000 7f6c5040c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c48100860 0x7f6c48197590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:22:07.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.403+0000 7f6c5040c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c48101a60 0x7f6c48197ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:22:07.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.403+0000 7f6c5040c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f6c481096a0 con 0x7f6c48100860 2024-09-17T04:22:07.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.403+0000 7f6c5040c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6c48109520 con 0x7f6c48101a60 2024-09-17T04:22:07.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.403+0000 7f6c4e1a8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c48100860 0x7f6c48197590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:22:07.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.403+0000 7f6c4e1a8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c48100860 0x7f6c48197590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56556/0 (socket says 172.21.15.88:56556) 2024-09-17T04:22:07.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.403+0000 7f6c4e1a8640 1 -- 172.21.15.88:0/2782187856 learned_addr learned my addr 172.21.15.88:0/2782187856 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:22:07.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.403+0000 7f6c4d9a7640 1 --2- 172.21.15.88:0/2782187856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c48101a60 0x7f6c48197ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:22:07.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.403+0000 7f6c4e1a8640 1 -- 172.21.15.88:0/2782187856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c48101a60 msgr2=0x7f6c48197ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:07.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.403+0000 7f6c4e1a8640 1 --2- 172.21.15.88:0/2782187856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c48101a60 0x7f6c48197ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:07.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.403+0000 7f6c4e1a8640 1 -- 172.21.15.88:0/2782187856 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c48198150 con 0x7f6c48100860 2024-09-17T04:22:07.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.403+0000 7f6c4d9a7640 1 --2- 172.21.15.88:0/2782187856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c48101a60 0x7f6c48197ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:22:07.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.403+0000 7f6c4e1a8640 1 --2- 172.21.15.88:0/2782187856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c48100860 0x7f6c48197590 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f6c440045e0 tx=0x7f6c44004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:22:07.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.404+0000 7f6c3f7fe640 1 -- 172.21.15.88:0/2782187856 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6c4403f070 con 0x7f6c48100860 2024-09-17T04:22:07.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.404+0000 7f6c3f7fe640 1 -- 172.21.15.88:0/2782187856 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6c44004a90 con 0x7f6c48100860 2024-09-17T04:22:07.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.404+0000 7f6c5040c640 1 -- 172.21.15.88:0/2782187856 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c4819cb30 con 0x7f6c48100860 2024-09-17T04:22:07.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.404+0000 7f6c3f7fe640 1 -- 172.21.15.88:0/2782187856 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6c44035030 con 0x7f6c48100860 2024-09-17T04:22:07.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.404+0000 7f6c5040c640 1 -- 172.21.15.88:0/2782187856 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c4819d0c0 con 0x7f6c48100860 2024-09-17T04:22:07.406 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.405+0000 7f6c5040c640 1 -- 172.21.15.88:0/2782187856 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c48100c60 con 0x7f6c48100860 2024-09-17T04:22:07.406 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.406+0000 7f6c3f7fe640 1 -- 172.21.15.88:0/2782187856 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 27) ==== 103322+0+0 (secure 0 0 0) 0x7f6c44042070 con 0x7f6c48100860 2024-09-17T04:22:07.406 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.406+0000 7f6c3f7fe640 1 --2- 172.21.15.88:0/2782187856 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f6c3407af80 0x7f6c3407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:22:07.406 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.406+0000 7f6c3f7fe640 1 -- 172.21.15.88:0/2782187856 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f6c440be800 con 0x7f6c48100860 2024-09-17T04:22:07.406 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.406+0000 7f6c4d9a7640 1 --2- 172.21.15.88:0/2782187856 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f6c3407af80 0x7f6c3407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:22:07.406 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.407+0000 7f6c4d9a7640 1 --2- 172.21.15.88:0/2782187856 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f6c3407af80 0x7f6c3407d440 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6c48198a40 tx=0x7f6c38005f90 comp rx=0 tx=0).ready entity=mgr.24431 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:22:07.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.411+0000 7f6c3f7fe640 1 -- 172.21.15.88:0/2782187856 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f6c44089fd0 con 0x7f6c48100860 2024-09-17T04:22:07.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.627+0000 7f6c5040c640 1 -- 172.21.15.88:0/2782187856 --> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f6c4806a440 con 0x7f6c3407af80 2024-09-17T04:22:07.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.638+0000 7f6c3f7fe640 1 -- 172.21.15.88:0/2782187856 <== mgr.24431 v2:172.21.15.134:6828/1122341233 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f6c4806a440 con 0x7f6c3407af80 2024-09-17T04:22:07.638 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T04:22:07.638 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (7m) 18s ago 9m 25.4M - 0.25.0 c8568f914cd2 f2dbac7e939f 2024-09-17T04:22:07.638 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi088 smithi088 running (60s) 18s ago 9m 8246k - 19.1.1-330-gc2ddf972 ebb0615149de 683e1826a1a5 2024-09-17T04:22:07.638 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi134 smithi134 running (31s) 22s ago 8m 7658k - 19.1.1-330-gc2ddf972 ebb0615149de 83afa4200c0e 2024-09-17T04:22:07.639 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (9m) 18s ago 9m 6903k - 19.1.1-330-gc2ddf972 ebb0615149de de17f5571330 2024-09-17T04:22:07.639 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi134 smithi134 running (8m) 22s ago 8m 6899k - 19.1.1-330-gc2ddf972 ebb0615149de 27f7ef172a1c 2024-09-17T04:22:07.639 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (7m) 18s ago 9m 80.5M - 9.4.12 2bacad6d85d8 a6cff57a23f9 2024-09-17T04:22:07.639 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.giqrgt smithi088 running (3m) 18s ago 3m 245M - 19.1.1-330-gc2ddf972 ebb0615149de f724660799a1 2024-09-17T04:22:07.639 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.lgavsv smithi088 running (3m) 18s ago 3m 14.0M - 19.1.1-330-gc2ddf972 ebb0615149de 6cc0fe8a6aa9 2024-09-17T04:22:07.639 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi134.ktuhce smithi134 running (3m) 22s ago 3m 13.7M - 19.1.1-330-gc2ddf972 ebb0615149de 7ff5b70ca9cb 2024-09-17T04:22:07.639 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi134.psnynp smithi134 running (3m) 22s ago 3m 276M - 19.1.1-330-gc2ddf972 ebb0615149de 5326974fa3dd 2024-09-17T04:22:07.639 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.wmndiv smithi088 *:8443,9283,8765 running (25s) 18s ago 10m 130M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 49eb47f7f14f 2024-09-17T04:22:07.639 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi134.vwdxcb smithi134 *:8443,9283,8765 running (2m) 22s ago 8m 576M - 19.3.0-4989-gce1b342b 8e039cb7fe1e efa5f0c9df8c 2024-09-17T04:22:07.639 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (10m) 18s ago 10m 51.1M 2048M 19.1.1-330-gc2ddf972 ebb0615149de bbeb722f42bc 2024-09-17T04:22:07.639 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi134 smithi134 running (8m) 22s ago 8m 41.2M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 89de63fb6386 2024-09-17T04:22:07.639 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (9m) 18s ago 9m 16.3M - 1.5.0 0da6a335fe13 9ba03800993b 2024-09-17T04:22:07.639 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi134 smithi134 *:9100 running (8m) 22s ago 8m 17.0M - 1.5.0 0da6a335fe13 6deac483827f 2024-09-17T04:22:07.639 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (7m) 18s ago 7m 174M 1216M 19.1.1-330-gc2ddf972 ebb0615149de e309427ee12c 2024-09-17T04:22:07.640 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (6m) 18s ago 6m 184M 1216M 19.1.1-330-gc2ddf972 ebb0615149de cc68d92b3333 2024-09-17T04:22:07.640 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (6m) 18s ago 6m 155M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 1ba92f2bfce6 2024-09-17T04:22:07.640 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi134 running (5m) 22s ago 5m 209M 2240M 19.1.1-330-gc2ddf972 ebb0615149de ebd528c3ce1b 2024-09-17T04:22:07.640 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi134 running (5m) 22s ago 5m 180M 2240M 19.1.1-330-gc2ddf972 ebb0615149de eacc25537b3a 2024-09-17T04:22:07.640 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi134 running (4m) 22s ago 4m 178M 2240M 19.1.1-330-gc2ddf972 ebb0615149de bc1b434a92a8 2024-09-17T04:22:07.640 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (35s) 18s ago 8m 41.5M - 2.43.0 a07b618ecd1d 4aa9c236625e 2024-09-17T04:22:07.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.641+0000 7f6c5040c640 1 -- 172.21.15.88:0/2782187856 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f6c3407af80 msgr2=0x7f6c3407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:07.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.641+0000 7f6c5040c640 1 --2- 172.21.15.88:0/2782187856 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f6c3407af80 0x7f6c3407d440 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6c48198a40 tx=0x7f6c38005f90 comp rx=0 tx=0).stop 2024-09-17T04:22:07.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.641+0000 7f6c5040c640 1 -- 172.21.15.88:0/2782187856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c48100860 msgr2=0x7f6c48197590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:07.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.641+0000 7f6c5040c640 1 --2- 172.21.15.88:0/2782187856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c48100860 0x7f6c48197590 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f6c440045e0 tx=0x7f6c44004610 comp rx=0 tx=0).stop 2024-09-17T04:22:07.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.641+0000 7f6c5040c640 1 -- 172.21.15.88:0/2782187856 shutdown_connections 2024-09-17T04:22:07.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.641+0000 7f6c5040c640 1 --2- 172.21.15.88:0/2782187856 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f6c3407af80 0x7f6c3407d440 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:07.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.641+0000 7f6c5040c640 1 --2- 172.21.15.88:0/2782187856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c48101a60 0x7f6c48197ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:07.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.641+0000 7f6c5040c640 1 --2- 172.21.15.88:0/2782187856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c48100860 0x7f6c48197590 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:07.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.641+0000 7f6c5040c640 1 -- 172.21.15.88:0/2782187856 >> 172.21.15.88:0/2782187856 conn(0x7f6c480fc010 msgr2=0x7f6c48069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:22:07.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.641+0000 7f6c5040c640 1 -- 172.21.15.88:0/2782187856 shutdown_connections 2024-09-17T04:22:07.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.641+0000 7f6c5040c640 1 -- 172.21.15.88:0/2782187856 wait complete. 2024-09-17T04:22:07.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.723+0000 7f0824870640 1 -- 172.21.15.88:0/2359991455 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0820102470 msgr2=0x7f0820104860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:07.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.723+0000 7f0824870640 1 --2- 172.21.15.88:0/2359991455 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0820102470 0x7f0820104860 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f0810009880 tx=0x7f081002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:22:07.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.723+0000 7f0824870640 1 -- 172.21.15.88:0/2359991455 shutdown_connections 2024-09-17T04:22:07.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.723+0000 7f0824870640 1 --2- 172.21.15.88:0/2359991455 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0820104da0 0x7f0820107190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:07.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.723+0000 7f0824870640 1 --2- 172.21.15.88:0/2359991455 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0820102470 0x7f0820104860 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:07.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.723+0000 7f0824870640 1 -- 172.21.15.88:0/2359991455 >> 172.21.15.88:0/2359991455 conn(0x7f08200fc010 msgr2=0x7f08200fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:22:07.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.723+0000 7f0824870640 1 -- 172.21.15.88:0/2359991455 shutdown_connections 2024-09-17T04:22:07.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.723+0000 7f0824870640 1 -- 172.21.15.88:0/2359991455 wait complete. 2024-09-17T04:22:07.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.724+0000 7f0824870640 1 Processor -- start 2024-09-17T04:22:07.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.724+0000 7f0824870640 1 -- start start 2024-09-17T04:22:07.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.724+0000 7f0824870640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0820102470 0x7f08201974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:22:07.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.724+0000 7f0824870640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0820104da0 0x7f0820197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:22:07.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.724+0000 7f0824870640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f082010a770 con 0x7f0820102470 2024-09-17T04:22:07.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.724+0000 7f0824870640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f082010a5f0 con 0x7f0820104da0 2024-09-17T04:22:07.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.725+0000 7f081e59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0820102470 0x7f08201974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:22:07.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.725+0000 7f081e59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0820102470 0x7f08201974c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56574/0 (socket says 172.21.15.88:56574) 2024-09-17T04:22:07.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.725+0000 7f081e59c640 1 -- 172.21.15.88:0/3436128995 learned_addr learned my addr 172.21.15.88:0/3436128995 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:22:07.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.725+0000 7f081dd9b640 1 --2- 172.21.15.88:0/3436128995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0820104da0 0x7f0820197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:22:07.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.725+0000 7f081e59c640 1 -- 172.21.15.88:0/3436128995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0820104da0 msgr2=0x7f0820197a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:07.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.725+0000 7f081e59c640 1 --2- 172.21.15.88:0/3436128995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0820104da0 0x7f0820197a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:07.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.725+0000 7f081e59c640 1 -- 172.21.15.88:0/3436128995 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0820198080 con 0x7f0820102470 2024-09-17T04:22:07.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.725+0000 7f081e59c640 1 --2- 172.21.15.88:0/3436128995 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0820102470 0x7f08201974c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f0810006010 tx=0x7f0810004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:22:07.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.725+0000 7f080f7fe640 1 -- 172.21.15.88:0/3436128995 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f081003f070 con 0x7f0820102470 2024-09-17T04:22:07.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.725+0000 7f0824870640 1 -- 172.21.15.88:0/3436128995 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f082019cac0 con 0x7f0820102470 2024-09-17T04:22:07.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.725+0000 7f080f7fe640 1 -- 172.21.15.88:0/3436128995 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f08100049d0 con 0x7f0820102470 2024-09-17T04:22:07.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.725+0000 7f080f7fe640 1 -- 172.21.15.88:0/3436128995 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0810035030 con 0x7f0820102470 2024-09-17T04:22:07.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.726+0000 7f0824870640 1 -- 172.21.15.88:0/3436128995 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f082019d050 con 0x7f0820102470 2024-09-17T04:22:07.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.727+0000 7f0824870640 1 -- 172.21.15.88:0/3436128995 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0820102850 con 0x7f0820102470 2024-09-17T04:22:07.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.728+0000 7f080f7fe640 1 -- 172.21.15.88:0/3436128995 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 27) ==== 103322+0+0 (secure 0 0 0) 0x7f0810042070 con 0x7f0820102470 2024-09-17T04:22:07.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.729+0000 7f080f7fe640 1 --2- 172.21.15.88:0/3436128995 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f080807af80 0x7f080807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:22:07.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.729+0000 7f080f7fe640 1 -- 172.21.15.88:0/3436128995 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f08100be960 con 0x7f0820102470 2024-09-17T04:22:07.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.729+0000 7f081dd9b640 1 --2- 172.21.15.88:0/3436128995 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f080807af80 0x7f080807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:22:07.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.729+0000 7f081dd9b640 1 --2- 172.21.15.88:0/3436128995 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f080807af80 0x7f080807d440 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0820198970 tx=0x7f0814005f90 comp rx=0 tx=0).ready entity=mgr.24431 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:22:07.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:07.733+0000 7f080f7fe640 1 -- 172.21.15.88:0/3436128995 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f081008a130 con 0x7f0820102470 2024-09-17T04:22:07.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:07 smithi088 ceph-mon[27811]: from='client.14862 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:22:07.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:07 smithi088 ceph-mon[27811]: from='client.14866 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:22:07.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:07 smithi134 ceph-mon[35201]: from='client.14862 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:22:07.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:07 smithi134 ceph-mon[35201]: from='client.14866 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:22:08.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.041+0000 7f0824870640 1 -- 172.21.15.88:0/3436128995 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f082019d960 con 0x7f0820102470 2024-09-17T04:22:08.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.041+0000 7f080f7fe640 1 -- 172.21.15.88:0/3436128995 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f081008efe0 con 0x7f0820102470 2024-09-17T04:22:08.042 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-17T04:22:08.042 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-09-17T04:22:08.042 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T04:22:08.042 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:22:08.042 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-09-17T04:22:08.042 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T04:22:08.042 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:22:08.042 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-09-17T04:22:08.042 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-17T04:22:08.043 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:22:08.043 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2024-09-17T04:22:08.043 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T04:22:08.043 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:22:08.043 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-09-17T04:22:08.043 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 12, 2024-09-17T04:22:08.043 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T04:22:08.043 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-17T04:22:08.043 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-17T04:22:08.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.045+0000 7f0824870640 1 -- 172.21.15.88:0/3436128995 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f080807af80 msgr2=0x7f080807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:08.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.045+0000 7f0824870640 1 --2- 172.21.15.88:0/3436128995 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f080807af80 0x7f080807d440 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0820198970 tx=0x7f0814005f90 comp rx=0 tx=0).stop 2024-09-17T04:22:08.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.045+0000 7f0824870640 1 -- 172.21.15.88:0/3436128995 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0820102470 msgr2=0x7f08201974c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:08.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.045+0000 7f0824870640 1 --2- 172.21.15.88:0/3436128995 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0820102470 0x7f08201974c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f0810006010 tx=0x7f0810004570 comp rx=0 tx=0).stop 2024-09-17T04:22:08.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.045+0000 7f0824870640 1 -- 172.21.15.88:0/3436128995 shutdown_connections 2024-09-17T04:22:08.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.045+0000 7f0824870640 1 --2- 172.21.15.88:0/3436128995 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7f080807af80 0x7f080807d440 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:08.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.045+0000 7f0824870640 1 --2- 172.21.15.88:0/3436128995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0820104da0 0x7f0820197a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:08.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.045+0000 7f0824870640 1 --2- 172.21.15.88:0/3436128995 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0820102470 0x7f08201974c0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:08.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.045+0000 7f0824870640 1 -- 172.21.15.88:0/3436128995 >> 172.21.15.88:0/3436128995 conn(0x7f08200fc010 msgr2=0x7f08200fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:22:08.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.045+0000 7f0824870640 1 -- 172.21.15.88:0/3436128995 shutdown_connections 2024-09-17T04:22:08.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.045+0000 7f0824870640 1 -- 172.21.15.88:0/3436128995 wait complete. 2024-09-17T04:22:08.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.165+0000 7fe15b6d0640 1 -- 172.21.15.88:0/3731914341 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe154103b80 msgr2=0x7fe154103f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:08.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.165+0000 7fe15b6d0640 1 --2- 172.21.15.88:0/3731914341 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe154103b80 0x7fe154103f80 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe150009880 tx=0x7fe15002a4d0 comp rx=0 tx=0).stop 2024-09-17T04:22:08.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.166+0000 7fe15b6d0640 1 -- 172.21.15.88:0/3731914341 shutdown_connections 2024-09-17T04:22:08.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.166+0000 7fe15b6d0640 1 --2- 172.21.15.88:0/3731914341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe154104d80 0x7fe154105200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:08.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.166+0000 7fe15b6d0640 1 --2- 172.21.15.88:0/3731914341 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe154103b80 0x7fe154103f80 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:08.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.166+0000 7fe15b6d0640 1 -- 172.21.15.88:0/3731914341 >> 172.21.15.88:0/3731914341 conn(0x7fe1540ff310 msgr2=0x7fe154101750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:22:08.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.166+0000 7fe15b6d0640 1 -- 172.21.15.88:0/3731914341 shutdown_connections 2024-09-17T04:22:08.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.166+0000 7fe15b6d0640 1 -- 172.21.15.88:0/3731914341 wait complete. 2024-09-17T04:22:08.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.167+0000 7fe15b6d0640 1 Processor -- start 2024-09-17T04:22:08.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.167+0000 7fe15b6d0640 1 -- start start 2024-09-17T04:22:08.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.167+0000 7fe15b6d0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe154103b80 0x7fe154110630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:22:08.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.167+0000 7fe15b6d0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe154104d80 0x7fe154110b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:22:08.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.167+0000 7fe15b6d0640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fe1540783c0 con 0x7fe154104d80 2024-09-17T04:22:08.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.167+0000 7fe15b6d0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe154078240 con 0x7fe154103b80 2024-09-17T04:22:08.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.167+0000 7fe158c6b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe154104d80 0x7fe154110b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:22:08.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.167+0000 7fe158c6b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe154104d80 0x7fe154110b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56590/0 (socket says 172.21.15.88:56590) 2024-09-17T04:22:08.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.167+0000 7fe158c6b640 1 -- 172.21.15.88:0/3697789640 learned_addr learned my addr 172.21.15.88:0/3697789640 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:22:08.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.167+0000 7fe15946c640 1 --2- 172.21.15.88:0/3697789640 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe154103b80 0x7fe154110630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:22:08.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.168+0000 7fe158c6b640 1 -- 172.21.15.88:0/3697789640 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe154103b80 msgr2=0x7fe154110630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:08.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.168+0000 7fe158c6b640 1 --2- 172.21.15.88:0/3697789640 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe154103b80 0x7fe154110630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:08.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.168+0000 7fe158c6b640 1 -- 172.21.15.88:0/3697789640 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1541111f0 con 0x7fe154104d80 2024-09-17T04:22:08.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.168+0000 7fe158c6b640 1 --2- 172.21.15.88:0/3697789640 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe154104d80 0x7fe154110b70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fe14400b420 tx=0x7fe14400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:22:08.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.168+0000 7fe14a7fc640 1 -- 172.21.15.88:0/3697789640 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe144011630 con 0x7fe154104d80 2024-09-17T04:22:08.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.168+0000 7fe15b6d0640 1 -- 172.21.15.88:0/3697789640 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe154111c10 con 0x7fe154104d80 2024-09-17T04:22:08.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.168+0000 7fe15b6d0640 1 -- 172.21.15.88:0/3697789640 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe154112220 con 0x7fe154104d80 2024-09-17T04:22:08.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.169+0000 7fe14a7fc640 1 -- 172.21.15.88:0/3697789640 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe144016070 con 0x7fe154104d80 2024-09-17T04:22:08.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.169+0000 7fe14a7fc640 1 -- 172.21.15.88:0/3697789640 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe14401bc10 con 0x7fe154104d80 2024-09-17T04:22:08.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.170+0000 7fe15b6d0640 1 -- 172.21.15.88:0/3697789640 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1380052c0 con 0x7fe154104d80 2024-09-17T04:22:08.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.172+0000 7fe14a7fc640 1 -- 172.21.15.88:0/3697789640 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 27) ==== 103322+0+0 (secure 0 0 0) 0x7fe1440117d0 con 0x7fe154104d80 2024-09-17T04:22:08.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.172+0000 7fe14a7fc640 1 --2- 172.21.15.88:0/3697789640 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7fe14007af40 0x7fe14007d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:22:08.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.173+0000 7fe14a7fc640 1 -- 172.21.15.88:0/3697789640 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7fe14409db40 con 0x7fe154104d80 2024-09-17T04:22:08.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.173+0000 7fe15946c640 1 --2- 172.21.15.88:0/3697789640 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7fe14007af40 0x7fe14007d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:22:08.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.174+0000 7fe15946c640 1 --2- 172.21.15.88:0/3697789640 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7fe14007af40 0x7fe14007d400 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe150006010 tx=0x7fe150009580 comp rx=0 tx=0).ready entity=mgr.24431 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:22:08.176 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.177+0000 7fe14a7fc640 1 -- 172.21.15.88:0/3697789640 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7fe144069310 con 0x7fe154104d80 2024-09-17T04:22:08.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.457+0000 7fe15b6d0640 1 -- 172.21.15.88:0/3697789640 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fe138005880 con 0x7fe154104d80 2024-09-17T04:22:08.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.458+0000 7fe14a7fc640 1 -- 172.21.15.88:0/3697789640 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) ==== 76+0+2045 (secure 0 0 0) 0x7fe14406e1c0 con 0x7fe154104d80 2024-09-17T04:22:08.458 INFO:teuthology.orchestra.run.smithi088.stdout:e15 2024-09-17T04:22:08.458 INFO:teuthology.orchestra.run.smithi088.stdout:btime 2024-09-17T04:18:27:750910+0000 2024-09-17T04:22:08.458 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T04:22:08.458 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:22:08.458 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2024-09-17T04:22:08.458 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:22:08.458 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2024-09-17T04:22:08.458 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2024-09-17T04:22:08.458 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 15 2024-09-17T04:22:08.459 INFO:teuthology.orchestra.run.smithi088.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T04:22:08.459 INFO:teuthology.orchestra.run.smithi088.stdout:created 2024-09-17T04:18:10.480573+0000 2024-09-17T04:22:08.459 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2024-09-17T04:18:27.750896+0000 2024-09-17T04:22:08.459 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2024-09-17T04:22:08.459 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2024-09-17T04:22:08.459 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2024-09-17T04:22:08.459 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2024-09-17T04:22:08.459 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2024-09-17T04:22:08.459 INFO:teuthology.orchestra.run.smithi088.stdout:max_xattr_size 65536 2024-09-17T04:22:08.459 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2024-09-17T04:22:08.459 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2024-09-17T04:22:08.459 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 45 2024-09-17T04:22:08.459 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:22:08.459 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 1 2024-09-17T04:22:08.460 INFO:teuthology.orchestra.run.smithi088.stdout:in 0 2024-09-17T04:22:08.460 INFO:teuthology.orchestra.run.smithi088.stdout:up {0=14590} 2024-09-17T04:22:08.460 INFO:teuthology.orchestra.run.smithi088.stdout:failed 2024-09-17T04:22:08.460 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2024-09-17T04:22:08.460 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2024-09-17T04:22:08.460 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2024-09-17T04:22:08.460 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2024-09-17T04:22:08.460 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data enabled 2024-09-17T04:22:08.460 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2024-09-17T04:22:08.460 INFO:teuthology.orchestra.run.smithi088.stdout:bal_rank_mask -1 2024-09-17T04:22:08.460 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 1 2024-09-17T04:22:08.460 INFO:teuthology.orchestra.run.smithi088.stdout:qdb_cluster leader: 14590 members: 14590 2024-09-17T04:22:08.460 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.giqrgt{0:14590} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.88:6828/1714846518,v1:172.21.15.88:6829/1714846518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:22:08.461 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi134.psnynp{0:24321} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.134:6826/2137586894,v1:172.21.15.134:6827/2137586894] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:22:08.461 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:22:08.461 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:22:08.461 INFO:teuthology.orchestra.run.smithi088.stdout:Standby daemons: 2024-09-17T04:22:08.461 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:22:08.461 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi134.ktuhce{-1:24325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/967997022,v1:172.21.15.134:6825/967997022] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:22:08.461 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.lgavsv{-1:24329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/1425146180,v1:172.21.15.88:6827/1425146180] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:22:08.461 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 15 2024-09-17T04:22:08.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.461+0000 7fe15b6d0640 1 -- 172.21.15.88:0/3697789640 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7fe14007af40 msgr2=0x7fe14007d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:08.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.461+0000 7fe15b6d0640 1 --2- 172.21.15.88:0/3697789640 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7fe14007af40 0x7fe14007d400 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe150006010 tx=0x7fe150009580 comp rx=0 tx=0).stop 2024-09-17T04:22:08.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.461+0000 7fe15b6d0640 1 -- 172.21.15.88:0/3697789640 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe154104d80 msgr2=0x7fe154110b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:08.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.461+0000 7fe15b6d0640 1 --2- 172.21.15.88:0/3697789640 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe154104d80 0x7fe154110b70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fe14400b420 tx=0x7fe14400b8e0 comp rx=0 tx=0).stop 2024-09-17T04:22:08.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.461+0000 7fe15b6d0640 1 -- 172.21.15.88:0/3697789640 shutdown_connections 2024-09-17T04:22:08.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.461+0000 7fe15b6d0640 1 --2- 172.21.15.88:0/3697789640 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7fe14007af40 0x7fe14007d400 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:08.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.461+0000 7fe15b6d0640 1 --2- 172.21.15.88:0/3697789640 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe154104d80 0x7fe154110b70 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:08.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.461+0000 7fe15b6d0640 1 --2- 172.21.15.88:0/3697789640 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe154103b80 0x7fe154110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:08.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.461+0000 7fe15b6d0640 1 -- 172.21.15.88:0/3697789640 >> 172.21.15.88:0/3697789640 conn(0x7fe1540ff310 msgr2=0x7fe1540fff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:22:08.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.461+0000 7fe15b6d0640 1 -- 172.21.15.88:0/3697789640 shutdown_connections 2024-09-17T04:22:08.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.461+0000 7fe15b6d0640 1 -- 172.21.15.88:0/3697789640 wait complete. 2024-09-17T04:22:08.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.563+0000 7fba9fcd1640 1 -- 172.21.15.88:0/4085434646 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba98100b80 msgr2=0x7fba98100fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:08.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.563+0000 7fba9fcd1640 1 --2- 172.21.15.88:0/4085434646 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba98100b80 0x7fba98100fe0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fba88009880 tx=0x7fba8802a4a0 comp rx=0 tx=0).stop 2024-09-17T04:22:08.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.563+0000 7fba9fcd1640 1 -- 172.21.15.88:0/4085434646 shutdown_connections 2024-09-17T04:22:08.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.563+0000 7fba9fcd1640 1 --2- 172.21.15.88:0/4085434646 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba98100b80 0x7fba98100fe0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:08.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.563+0000 7fba9fcd1640 1 --2- 172.21.15.88:0/4085434646 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba98100240 0x7fba98100640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:08.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.563+0000 7fba9fcd1640 1 -- 172.21.15.88:0/4085434646 >> 172.21.15.88:0/4085434646 conn(0x7fba980fc010 msgr2=0x7fba980fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:22:08.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.563+0000 7fba9fcd1640 1 -- 172.21.15.88:0/4085434646 shutdown_connections 2024-09-17T04:22:08.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.563+0000 7fba9fcd1640 1 -- 172.21.15.88:0/4085434646 wait complete. 2024-09-17T04:22:08.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.564+0000 7fba9fcd1640 1 Processor -- start 2024-09-17T04:22:08.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.565+0000 7fba9fcd1640 1 -- start start 2024-09-17T04:22:08.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.565+0000 7fba9fcd1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba98100240 0x7fba98105d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:22:08.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.565+0000 7fba9fcd1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba98100b80 0x7fba98106290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:22:08.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.565+0000 7fba9fcd1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fba9810c990 con 0x7fba98100240 2024-09-17T04:22:08.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.565+0000 7fba9fcd1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fba9810c810 con 0x7fba98100b80 2024-09-17T04:22:08.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.565+0000 7fba9da6d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba98100240 0x7fba98105d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:22:08.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.565+0000 7fba9da6d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba98100240 0x7fba98105d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56602/0 (socket says 172.21.15.88:56602) 2024-09-17T04:22:08.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.565+0000 7fba9da6d640 1 -- 172.21.15.88:0/2117150345 learned_addr learned my addr 172.21.15.88:0/2117150345 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:22:08.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.565+0000 7fba9d26c640 1 --2- 172.21.15.88:0/2117150345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba98100b80 0x7fba98106290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:22:08.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.565+0000 7fba9da6d640 1 -- 172.21.15.88:0/2117150345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba98100b80 msgr2=0x7fba98106290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:08.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.565+0000 7fba9da6d640 1 --2- 172.21.15.88:0/2117150345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba98100b80 0x7fba98106290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:08.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.565+0000 7fba9da6d640 1 -- 172.21.15.88:0/2117150345 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba981028d0 con 0x7fba98100240 2024-09-17T04:22:08.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.565+0000 7fba9da6d640 1 --2- 172.21.15.88:0/2117150345 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba98100240 0x7fba98105d50 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fba9400e970 tx=0x7fba9400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:22:08.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.566+0000 7fba8effd640 1 -- 172.21.15.88:0/2117150345 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fba9400cac0 con 0x7fba98100240 2024-09-17T04:22:08.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.566+0000 7fba9fcd1640 1 -- 172.21.15.88:0/2117150345 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba98102bc0 con 0x7fba98100240 2024-09-17T04:22:08.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.566+0000 7fba8effd640 1 -- 172.21.15.88:0/2117150345 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fba940054e0 con 0x7fba98100240 2024-09-17T04:22:08.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.566+0000 7fba9fcd1640 1 -- 172.21.15.88:0/2117150345 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba98103120 con 0x7fba98100240 2024-09-17T04:22:08.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.566+0000 7fba8effd640 1 -- 172.21.15.88:0/2117150345 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fba94010430 con 0x7fba98100240 2024-09-17T04:22:08.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.567+0000 7fba9fcd1640 1 -- 172.21.15.88:0/2117150345 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba98103490 con 0x7fba98100240 2024-09-17T04:22:08.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.568+0000 7fba8effd640 1 -- 172.21.15.88:0/2117150345 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 27) ==== 103322+0+0 (secure 0 0 0) 0x7fba94004f00 con 0x7fba98100240 2024-09-17T04:22:08.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.568+0000 7fba8effd640 1 --2- 172.21.15.88:0/2117150345 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7fba8407af30 0x7fba8407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:22:08.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.569+0000 7fba8effd640 1 -- 172.21.15.88:0/2117150345 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7fba9409e550 con 0x7fba98100240 2024-09-17T04:22:08.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.569+0000 7fba9d26c640 1 --2- 172.21.15.88:0/2117150345 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7fba8407af30 0x7fba8407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:22:08.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.569+0000 7fba9d26c640 1 --2- 172.21.15.88:0/2117150345 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7fba8407af30 0x7fba8407d3f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fba88000c00 tx=0x7fba880058d0 comp rx=0 tx=0).ready entity=mgr.24431 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:22:08.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.573+0000 7fba8effd640 1 -- 172.21.15.88:0/2117150345 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7fba94069ca0 con 0x7fba98100240 2024-09-17T04:22:08.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.817+0000 7fba9fcd1640 1 -- 172.21.15.88:0/2117150345 --> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fba9802d9f0 con 0x7fba8407af30 2024-09-17T04:22:08.817 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:08 smithi088 ceph-mon[27811]: from='client.14870 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:22:08.817 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:08 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/3436128995' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T04:22:08.817 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:08 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/3697789640' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T04:22:08.817 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:08 smithi088 ceph-mon[27811]: pgmap v55: 65 pgs: 65 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 79 op/s 2024-09-17T04:22:08.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.818+0000 7fba8effd640 1 -- 172.21.15.88:0/2117150345 <== mgr.24431 v2:172.21.15.134:6828/1122341233 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+368 (secure 0 0 0) 0x7fba9802d9f0 con 0x7fba8407af30 2024-09-17T04:22:08.818 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-17T04:22:08.818 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f", 2024-09-17T04:22:08.818 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-09-17T04:22:08.818 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T04:22:08.818 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [ 2024-09-17T04:22:08.818 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr" 2024-09-17T04:22:08.818 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-17T04:22:08.818 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "2/23 daemons upgraded", 2024-09-17T04:22:08.819 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading mgr daemons", 2024-09-17T04:22:08.819 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-09-17T04:22:08.819 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-17T04:22:08.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.820+0000 7fba9fcd1640 1 -- 172.21.15.88:0/2117150345 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7fba8407af30 msgr2=0x7fba8407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:08.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.820+0000 7fba9fcd1640 1 --2- 172.21.15.88:0/2117150345 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7fba8407af30 0x7fba8407d3f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fba88000c00 tx=0x7fba880058d0 comp rx=0 tx=0).stop 2024-09-17T04:22:08.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.820+0000 7fba9fcd1640 1 -- 172.21.15.88:0/2117150345 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba98100240 msgr2=0x7fba98105d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:08.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.820+0000 7fba9fcd1640 1 --2- 172.21.15.88:0/2117150345 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba98100240 0x7fba98105d50 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fba9400e970 tx=0x7fba9400ed70 comp rx=0 tx=0).stop 2024-09-17T04:22:08.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.820+0000 7fba9fcd1640 1 -- 172.21.15.88:0/2117150345 shutdown_connections 2024-09-17T04:22:08.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.820+0000 7fba9fcd1640 1 --2- 172.21.15.88:0/2117150345 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7fba8407af30 0x7fba8407d3f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:08.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.820+0000 7fba9fcd1640 1 --2- 172.21.15.88:0/2117150345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba98100b80 0x7fba98106290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:08.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.820+0000 7fba9fcd1640 1 --2- 172.21.15.88:0/2117150345 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba98100240 0x7fba98105d50 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:08.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.820+0000 7fba9fcd1640 1 -- 172.21.15.88:0/2117150345 >> 172.21.15.88:0/2117150345 conn(0x7fba980fc010 msgr2=0x7fba98108b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:22:08.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.820+0000 7fba9fcd1640 1 -- 172.21.15.88:0/2117150345 shutdown_connections 2024-09-17T04:22:08.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.820+0000 7fba9fcd1640 1 -- 172.21.15.88:0/2117150345 wait complete. 2024-09-17T04:22:08.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:08 smithi134 ceph-mon[35201]: from='client.14870 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:22:08.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:08 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/3436128995' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T04:22:08.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:08 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/3697789640' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T04:22:08.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:08 smithi134 ceph-mon[35201]: pgmap v55: 65 pgs: 65 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 79 op/s 2024-09-17T04:22:08.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.911+0000 7fa1d450a640 1 -- 172.21.15.88:0/3666967555 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1cc102b60 msgr2=0x7fa1cc102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:08.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.911+0000 7fa1d450a640 1 --2- 172.21.15.88:0/3666967555 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1cc102b60 0x7fa1cc102fe0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc009880 tx=0x7fa1bc02a4a0 comp rx=0 tx=0).stop 2024-09-17T04:22:08.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.911+0000 7fa1d450a640 1 -- 172.21.15.88:0/3666967555 shutdown_connections 2024-09-17T04:22:08.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.911+0000 7fa1d450a640 1 --2- 172.21.15.88:0/3666967555 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1cc102b60 0x7fa1cc102fe0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:08.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.911+0000 7fa1d450a640 1 --2- 172.21.15.88:0/3666967555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1cc101960 0x7fa1cc101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:08.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.911+0000 7fa1d450a640 1 -- 172.21.15.88:0/3666967555 >> 172.21.15.88:0/3666967555 conn(0x7fa1cc0fd110 msgr2=0x7fa1cc0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:22:08.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.911+0000 7fa1d450a640 1 -- 172.21.15.88:0/3666967555 shutdown_connections 2024-09-17T04:22:08.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.911+0000 7fa1d450a640 1 -- 172.21.15.88:0/3666967555 wait complete. 2024-09-17T04:22:08.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.912+0000 7fa1d450a640 1 Processor -- start 2024-09-17T04:22:08.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.912+0000 7fa1d450a640 1 -- start start 2024-09-17T04:22:08.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.912+0000 7fa1d450a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1cc101960 0x7fa1cc199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:22:08.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.912+0000 7fa1d450a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1cc102b60 0x7fa1cc199bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:22:08.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.912+0000 7fa1d450a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa1cc10a780 con 0x7fa1cc102b60 2024-09-17T04:22:08.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.912+0000 7fa1d450a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa1cc10a600 con 0x7fa1cc101960 2024-09-17T04:22:08.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.913+0000 7fa1d1aa5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1cc102b60 0x7fa1cc199bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:22:08.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.913+0000 7fa1d1aa5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1cc102b60 0x7fa1cc199bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56612/0 (socket says 172.21.15.88:56612) 2024-09-17T04:22:08.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.913+0000 7fa1d1aa5640 1 -- 172.21.15.88:0/1305009197 learned_addr learned my addr 172.21.15.88:0/1305009197 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:22:08.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.913+0000 7fa1d22a6640 1 --2- 172.21.15.88:0/1305009197 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1cc101960 0x7fa1cc199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:22:08.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.913+0000 7fa1d1aa5640 1 -- 172.21.15.88:0/1305009197 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1cc101960 msgr2=0x7fa1cc199690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:08.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.913+0000 7fa1d1aa5640 1 --2- 172.21.15.88:0/1305009197 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1cc101960 0x7fa1cc199690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:08.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.913+0000 7fa1d1aa5640 1 -- 172.21.15.88:0/1305009197 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1cc19a250 con 0x7fa1cc102b60 2024-09-17T04:22:08.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.913+0000 7fa1d1aa5640 1 --2- 172.21.15.88:0/1305009197 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1cc102b60 0x7fa1cc199bd0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc006010 tx=0x7fa1bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:22:08.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.913+0000 7fa1c37fe640 1 -- 172.21.15.88:0/1305009197 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa1bc03f070 con 0x7fa1cc102b60 2024-09-17T04:22:08.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.913+0000 7fa1c37fe640 1 -- 172.21.15.88:0/1305009197 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa1bc004ac0 con 0x7fa1cc102b60 2024-09-17T04:22:08.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.913+0000 7fa1d450a640 1 -- 172.21.15.88:0/1305009197 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1cc19ec30 con 0x7fa1cc102b60 2024-09-17T04:22:08.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.913+0000 7fa1c37fe640 1 -- 172.21.15.88:0/1305009197 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa1bc035030 con 0x7fa1cc102b60 2024-09-17T04:22:08.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.914+0000 7fa1d450a640 1 -- 172.21.15.88:0/1305009197 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1cc19f1c0 con 0x7fa1cc102b60 2024-09-17T04:22:08.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.915+0000 7fa1d450a640 1 -- 172.21.15.88:0/1305009197 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1cc101d60 con 0x7fa1cc102b60 2024-09-17T04:22:08.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.916+0000 7fa1c37fe640 1 -- 172.21.15.88:0/1305009197 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 27) ==== 103322+0+0 (secure 0 0 0) 0x7fa1bc042070 con 0x7fa1cc102b60 2024-09-17T04:22:08.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.916+0000 7fa1c37fe640 1 --2- 172.21.15.88:0/1305009197 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7fa1b807af80 0x7fa1b807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:22:08.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.916+0000 7fa1c37fe640 1 -- 172.21.15.88:0/1305009197 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7fa1bc0be8d0 con 0x7fa1cc102b60 2024-09-17T04:22:08.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.916+0000 7fa1d22a6640 1 --2- 172.21.15.88:0/1305009197 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7fa1b807af80 0x7fa1b807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:22:08.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.917+0000 7fa1d22a6640 1 --2- 172.21.15.88:0/1305009197 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7fa1b807af80 0x7fa1b807d440 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc1029c0 tx=0x7fa1c8009720 comp rx=0 tx=0).ready entity=mgr.24431 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:22:08.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:08.921+0000 7fa1c37fe640 1 -- 172.21.15.88:0/1305009197 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7fa1bc08a0a0 con 0x7fa1cc102b60 2024-09-17T04:22:09.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:09.301+0000 7fa1d450a640 1 -- 172.21.15.88:0/1305009197 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fa1cc106e90 con 0x7fa1cc102b60 2024-09-17T04:22:09.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:09.301+0000 7fa1c37fe640 1 -- 172.21.15.88:0/1305009197 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7fa1bc08ef50 con 0x7fa1cc102b60 2024-09-17T04:22:09.301 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T04:22:09.301 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T04:22:09.302 INFO:teuthology.orchestra.run.smithi088.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T04:22:09.304 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:09.304+0000 7fa1d450a640 1 -- 172.21.15.88:0/1305009197 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7fa1b807af80 msgr2=0x7fa1b807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:09.304 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:09.304+0000 7fa1d450a640 1 --2- 172.21.15.88:0/1305009197 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7fa1b807af80 0x7fa1b807d440 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc1029c0 tx=0x7fa1c8009720 comp rx=0 tx=0).stop 2024-09-17T04:22:09.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:09.304+0000 7fa1d450a640 1 -- 172.21.15.88:0/1305009197 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1cc102b60 msgr2=0x7fa1cc199bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:09.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:09.304+0000 7fa1d450a640 1 --2- 172.21.15.88:0/1305009197 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1cc102b60 0x7fa1cc199bd0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc006010 tx=0x7fa1bc0046c0 comp rx=0 tx=0).stop 2024-09-17T04:22:09.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:09.304+0000 7fa1d450a640 1 -- 172.21.15.88:0/1305009197 shutdown_connections 2024-09-17T04:22:09.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:09.305+0000 7fa1d450a640 1 --2- 172.21.15.88:0/1305009197 >> [v2:172.21.15.134:6828/1122341233,v1:172.21.15.134:6829/1122341233] conn(0x7fa1b807af80 0x7fa1b807d440 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:09.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:09.305+0000 7fa1d450a640 1 --2- 172.21.15.88:0/1305009197 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1cc102b60 0x7fa1cc199bd0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:09.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:09.305+0000 7fa1d450a640 1 --2- 172.21.15.88:0/1305009197 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1cc101960 0x7fa1cc199690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:09.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:09.305+0000 7fa1d450a640 1 -- 172.21.15.88:0/1305009197 >> 172.21.15.88:0/1305009197 conn(0x7fa1cc0fd110 msgr2=0x7fa1cc104060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:22:09.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:09.305+0000 7fa1d450a640 1 -- 172.21.15.88:0/1305009197 shutdown_connections 2024-09-17T04:22:09.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:09.305+0000 7fa1d450a640 1 -- 172.21.15.88:0/1305009197 wait complete. 2024-09-17T04:22:09.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:09 smithi088 ceph-mon[27811]: from='client.14882 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:22:09.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:09 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/1305009197' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T04:22:09.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:09 smithi134 ceph-mon[35201]: from='client.14882 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:22:09.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:09 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/1305009197' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T04:22:11.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:11 smithi088 ceph-mon[27811]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:22:11.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:11 smithi088 ceph-mon[27811]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:22:11.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:11 smithi088 ceph-mon[27811]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:22:11.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:11 smithi088 ceph-mon[27811]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:22:11.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:11 smithi088 ceph-mon[27811]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:22:11.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:11 smithi088 ceph-mon[27811]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:22:11.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:11 smithi088 ceph-mon[27811]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "mgr fail", "who": "smithi134.vwdxcb"}]: dispatch 2024-09-17T04:22:11.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:11 smithi088 ceph-mon[27811]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "mgr fail", "who": "smithi134.vwdxcb"}]: dispatch 2024-09-17T04:22:11.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:11 smithi088 ceph-mon[27811]: Activating manager daemon smithi088.wmndiv 2024-09-17T04:22:11.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:11 smithi088 ceph-mon[27811]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' cmd='[{"prefix": "mgr fail", "who": "smithi134.vwdxcb"}]': finished 2024-09-17T04:22:11.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:11 smithi088 ceph-mon[27811]: osdmap e47: 6 total, 6 up, 6 in 2024-09-17T04:22:11.390 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:11 smithi088 ceph-mon[27811]: mgrmap e28: smithi088.wmndiv(active, starting, since 0.00750077s) 2024-09-17T04:22:11.390 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:11 smithi088 ceph-mon[27811]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2024-09-17T04:22:11.390 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:11 smithi088 ceph-mon[27811]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-09-17T04:22:11.390 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:11 smithi088 ceph-mon[27811]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.giqrgt"}]: dispatch 2024-09-17T04:22:11.390 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:11 smithi088 ceph-mon[27811]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.psnynp"}]: dispatch 2024-09-17T04:22:11.390 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:11 smithi088 ceph-mon[27811]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.ktuhce"}]: dispatch 2024-09-17T04:22:11.390 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:11 smithi088 ceph-mon[27811]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.lgavsv"}]: dispatch 2024-09-17T04:22:11.390 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:11 smithi088 ceph-mon[27811]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mgr metadata", "who": "smithi088.wmndiv", "id": "smithi088.wmndiv"}]: dispatch 2024-09-17T04:22:11.390 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:11 smithi088 ceph-mon[27811]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T04:22:11.390 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:11 smithi088 ceph-mon[27811]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T04:22:11.390 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:11 smithi088 ceph-mon[27811]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T04:22:11.390 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:11 smithi088 ceph-mon[27811]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T04:22:11.390 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:11 smithi088 ceph-mon[27811]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T04:22:11.390 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:11 smithi088 ceph-mon[27811]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T04:22:11.391 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:11 smithi088 ceph-mon[27811]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T04:22:11.391 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:11 smithi088 ceph-mon[27811]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T04:22:11.391 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:11 smithi088 ceph-mon[27811]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T04:22:11.391 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:11 smithi088 ceph-mon[27811]: Manager daemon smithi088.wmndiv is now available 2024-09-17T04:22:11.391 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:11 smithi088 ceph-mon[27811]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:22:11.391 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:11 smithi088 ceph-mon[27811]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:22:11.391 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:11 smithi088 ceph-mon[27811]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-17T04:22:11.391 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:11 smithi088 ceph-mon[27811]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi088.wmndiv/mirror_snapshot_schedule"}]: dispatch 2024-09-17T04:22:11.391 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:11 smithi088 ceph-mon[27811]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi088.wmndiv/mirror_snapshot_schedule"}]: dispatch 2024-09-17T04:22:11.391 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:11 smithi088 ceph-mon[27811]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi088.wmndiv/trash_purge_schedule"}]: dispatch 2024-09-17T04:22:11.391 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:11 smithi088 ceph-mon[27811]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi088.wmndiv/trash_purge_schedule"}]: dispatch 2024-09-17T04:22:11.516 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:11 smithi134 ceph-mon[35201]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:22:11.517 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:11 smithi134 ceph-mon[35201]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:22:11.517 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:11 smithi134 ceph-mon[35201]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:22:11.517 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:11 smithi134 ceph-mon[35201]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:22:11.517 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:11 smithi134 ceph-mon[35201]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' 2024-09-17T04:22:11.517 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:11 smithi134 ceph-mon[35201]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:22:11.517 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:11 smithi134 ceph-mon[35201]: from='mgr.24431 172.21.15.134:0/2697944686' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "mgr fail", "who": "smithi134.vwdxcb"}]: dispatch 2024-09-17T04:22:11.517 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:11 smithi134 ceph-mon[35201]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "mgr fail", "who": "smithi134.vwdxcb"}]: dispatch 2024-09-17T04:22:11.517 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:11 smithi134 ceph-mon[35201]: Activating manager daemon smithi088.wmndiv 2024-09-17T04:22:11.517 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:11 smithi134 ceph-mon[35201]: from='mgr.24431 ' entity='mgr.smithi134.vwdxcb' cmd='[{"prefix": "mgr fail", "who": "smithi134.vwdxcb"}]': finished 2024-09-17T04:22:11.517 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:11 smithi134 ceph-mon[35201]: osdmap e47: 6 total, 6 up, 6 in 2024-09-17T04:22:11.517 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:11 smithi134 ceph-mon[35201]: mgrmap e28: smithi088.wmndiv(active, starting, since 0.00750077s) 2024-09-17T04:22:11.517 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:11 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2024-09-17T04:22:11.518 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:11 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-09-17T04:22:11.518 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:11 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.giqrgt"}]: dispatch 2024-09-17T04:22:11.518 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:11 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.psnynp"}]: dispatch 2024-09-17T04:22:11.518 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:11 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.ktuhce"}]: dispatch 2024-09-17T04:22:11.518 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:11 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.lgavsv"}]: dispatch 2024-09-17T04:22:11.518 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:11 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mgr metadata", "who": "smithi088.wmndiv", "id": "smithi088.wmndiv"}]: dispatch 2024-09-17T04:22:11.518 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:11 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T04:22:11.518 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:11 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T04:22:11.518 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:11 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T04:22:11.518 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:11 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T04:22:11.518 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:11 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T04:22:11.518 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:11 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T04:22:11.518 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:11 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T04:22:11.519 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:11 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T04:22:11.519 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:11 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T04:22:11.519 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:11 smithi134 ceph-mon[35201]: Manager daemon smithi088.wmndiv is now available 2024-09-17T04:22:11.519 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:11 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:22:11.519 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:11 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:22:11.519 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:11 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-17T04:22:11.519 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:11 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi088.wmndiv/mirror_snapshot_schedule"}]: dispatch 2024-09-17T04:22:11.519 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:11 smithi134 ceph-mon[35201]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi088.wmndiv/mirror_snapshot_schedule"}]: dispatch 2024-09-17T04:22:11.519 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:11 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi088.wmndiv/trash_purge_schedule"}]: dispatch 2024-09-17T04:22:11.519 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:11 smithi134 ceph-mon[35201]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi088.wmndiv/trash_purge_schedule"}]: dispatch 2024-09-17T04:22:12.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:12 smithi088 ceph-mon[27811]: mgrmap e29: smithi088.wmndiv(active, since 1.01188s) 2024-09-17T04:22:12.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:12 smithi088 ceph-mon[27811]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-17T04:22:12.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:12 smithi088 ceph-mon[27811]: pgmap v3: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-17T04:22:12.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:12 smithi088 ceph-mon[27811]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:12.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:12 smithi088 ceph-mon[27811]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:12.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:12 smithi134 ceph-mon[35201]: mgrmap e29: smithi088.wmndiv(active, since 1.01188s) 2024-09-17T04:22:12.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:12 smithi134 ceph-mon[35201]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-17T04:22:12.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:12 smithi134 ceph-mon[35201]: pgmap v3: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-17T04:22:12.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:12 smithi134 ceph-mon[35201]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:12.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:12 smithi134 ceph-mon[35201]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:13.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:13 smithi088 ceph-mon[27811]: [17/Sep/2024:04:22:12] ENGINE Bus STARTING 2024-09-17T04:22:13.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:13 smithi088 ceph-mon[27811]: [17/Sep/2024:04:22:12] ENGINE Serving on https://172.21.15.88:7150 2024-09-17T04:22:13.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:13 smithi088 ceph-mon[27811]: [17/Sep/2024:04:22:12] ENGINE Error in HTTPServer.serve 2024-09-17T04:22:13.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Traceback (most recent call last): 2024-09-17T04:22:13.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T04:22:13.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: self._connections.run(self.expiration_interval) 2024-09-17T04:22:13.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T04:22:13.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: self._run(expiration_interval) 2024-09-17T04:22:13.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T04:22:13.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T04:22:13.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T04:22:13.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T04:22:13.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T04:22:13.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: s = self.context.wrap_socket( 2024-09-17T04:22:13.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T04:22:13.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: return self.sslsocket_class._create( 2024-09-17T04:22:13.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T04:22:13.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: self.do_handshake() 2024-09-17T04:22:13.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T04:22:13.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: self._sslobj.do_handshake() 2024-09-17T04:22:13.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T04:22:13.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:13 smithi088 ceph-mon[27811]: [17/Sep/2024:04:22:12] ENGINE Serving on http://172.21.15.88:8765 2024-09-17T04:22:13.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:13 smithi088 ceph-mon[27811]: [17/Sep/2024:04:22:12] ENGINE Bus STARTED 2024-09-17T04:22:13.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:13 smithi088 ceph-mon[27811]: pgmap v4: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-17T04:22:13.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:13 smithi088 ceph-mon[27811]: mgrmap e30: smithi088.wmndiv(active, since 2s) 2024-09-17T04:22:13.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:13 smithi134 ceph-mon[35201]: [17/Sep/2024:04:22:12] ENGINE Bus STARTING 2024-09-17T04:22:13.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:13 smithi134 ceph-mon[35201]: [17/Sep/2024:04:22:12] ENGINE Serving on https://172.21.15.88:7150 2024-09-17T04:22:13.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:13 smithi134 ceph-mon[35201]: [17/Sep/2024:04:22:12] ENGINE Error in HTTPServer.serve 2024-09-17T04:22:13.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Traceback (most recent call last): 2024-09-17T04:22:13.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T04:22:13.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: self._connections.run(self.expiration_interval) 2024-09-17T04:22:13.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T04:22:13.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: self._run(expiration_interval) 2024-09-17T04:22:13.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T04:22:13.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T04:22:13.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T04:22:13.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T04:22:13.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T04:22:13.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: s = self.context.wrap_socket( 2024-09-17T04:22:13.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T04:22:13.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: return self.sslsocket_class._create( 2024-09-17T04:22:13.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T04:22:13.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: self.do_handshake() 2024-09-17T04:22:13.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T04:22:13.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: self._sslobj.do_handshake() 2024-09-17T04:22:13.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T04:22:13.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:13 smithi134 ceph-mon[35201]: [17/Sep/2024:04:22:12] ENGINE Serving on http://172.21.15.88:8765 2024-09-17T04:22:13.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:13 smithi134 ceph-mon[35201]: [17/Sep/2024:04:22:12] ENGINE Bus STARTED 2024-09-17T04:22:13.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:13 smithi134 ceph-mon[35201]: pgmap v4: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-17T04:22:13.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:13 smithi134 ceph-mon[35201]: mgrmap e30: smithi088.wmndiv(active, since 2s) 2024-09-17T04:22:15.556 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:15 smithi088 ceph-mon[27811]: pgmap v5: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-17T04:22:15.556 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:15 smithi088 ceph-mon[27811]: mgrmap e31: smithi088.wmndiv(active, since 4s) 2024-09-17T04:22:15.556 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:15 smithi088 ceph-mon[27811]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:15.556 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:15 smithi088 ceph-mon[27811]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:15.556 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:15 smithi088 ceph-mon[27811]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:15.556 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:15 smithi088 ceph-mon[27811]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:15.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:15 smithi134 ceph-mon[35201]: pgmap v5: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-17T04:22:15.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:15 smithi134 ceph-mon[35201]: mgrmap e31: smithi088.wmndiv(active, since 4s) 2024-09-17T04:22:15.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:15 smithi134 ceph-mon[35201]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:15.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:15 smithi134 ceph-mon[35201]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:15.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:15 smithi134 ceph-mon[35201]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:15.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:15 smithi134 ceph-mon[35201]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:16.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:16 smithi134 ceph-mon[35201]: Standby manager daemon smithi134.vwdxcb started 2024-09-17T04:22:16.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:16 smithi134 ceph-mon[35201]: from='mgr.? 172.21.15.134:0/1984397983' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.vwdxcb/crt"}]: dispatch 2024-09-17T04:22:16.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:16 smithi134 ceph-mon[35201]: from='mgr.? 172.21.15.134:0/1984397983' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T04:22:16.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:16 smithi134 ceph-mon[35201]: from='mgr.? 172.21.15.134:0/1984397983' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.vwdxcb/key"}]: dispatch 2024-09-17T04:22:16.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:16 smithi134 ceph-mon[35201]: from='mgr.? 172.21.15.134:0/1984397983' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T04:22:16.709 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:16 smithi088 ceph-mon[27811]: Standby manager daemon smithi134.vwdxcb started 2024-09-17T04:22:16.709 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:16 smithi088 ceph-mon[27811]: from='mgr.? 172.21.15.134:0/1984397983' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.vwdxcb/crt"}]: dispatch 2024-09-17T04:22:16.709 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:16 smithi088 ceph-mon[27811]: from='mgr.? 172.21.15.134:0/1984397983' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T04:22:16.709 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:16 smithi088 ceph-mon[27811]: from='mgr.? 172.21.15.134:0/1984397983' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.vwdxcb/key"}]: dispatch 2024-09-17T04:22:16.709 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:16 smithi088 ceph-mon[27811]: from='mgr.? 172.21.15.134:0/1984397983' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T04:22:17.722 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:17 smithi134 ceph-mon[35201]: pgmap v6: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-17T04:22:17.722 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:17 smithi134 ceph-mon[35201]: mgrmap e32: smithi088.wmndiv(active, since 6s), standbys: smithi134.vwdxcb 2024-09-17T04:22:17.722 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:17 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mgr metadata", "who": "smithi134.vwdxcb", "id": "smithi134.vwdxcb"}]: dispatch 2024-09-17T04:22:17.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:17 smithi088 ceph-mon[27811]: pgmap v6: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-17T04:22:17.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:17 smithi088 ceph-mon[27811]: mgrmap e32: smithi088.wmndiv(active, since 6s), standbys: smithi134.vwdxcb 2024-09-17T04:22:17.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:17 smithi088 ceph-mon[27811]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mgr metadata", "who": "smithi134.vwdxcb", "id": "smithi134.vwdxcb"}]: dispatch 2024-09-17T04:22:19.820 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:19 smithi088 ceph-mon[27811]: pgmap v7: 65 pgs: 65 active+clean; 304 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 125 op/s 2024-09-17T04:22:19.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:19 smithi134 ceph-mon[35201]: pgmap v7: 65 pgs: 65 active+clean; 304 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 125 op/s 2024-09-17T04:22:21.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:21 smithi088 ceph-mon[27811]: pgmap v8: 65 pgs: 65 active+clean; 304 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 944 KiB/s rd, 1.1 MiB/s wr, 97 op/s 2024-09-17T04:22:21.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:21 smithi134 ceph-mon[35201]: pgmap v8: 65 pgs: 65 active+clean; 304 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 944 KiB/s rd, 1.1 MiB/s wr, 97 op/s 2024-09-17T04:22:23.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:23 smithi088 ceph-mon[27811]: pgmap v9: 65 pgs: 65 active+clean; 306 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 377 op/s 2024-09-17T04:22:23.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:23 smithi088 ceph-mon[27811]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:23.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:23 smithi088 ceph-mon[27811]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:23.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:23 smithi134 ceph-mon[35201]: pgmap v9: 65 pgs: 65 active+clean; 306 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 377 op/s 2024-09-17T04:22:23.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:23 smithi134 ceph-mon[35201]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:23.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:23 smithi134 ceph-mon[35201]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:25.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:24 smithi088 ceph-mon[27811]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:25.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:24 smithi088 ceph-mon[27811]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:25.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:24 smithi088 ceph-mon[27811]: pgmap v10: 65 pgs: 65 active+clean; 306 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 345 op/s 2024-09-17T04:22:25.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:24 smithi134 ceph-mon[35201]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:25.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:24 smithi134 ceph-mon[35201]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:25.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:24 smithi134 ceph-mon[35201]: pgmap v10: 65 pgs: 65 active+clean; 306 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 345 op/s 2024-09-17T04:22:26.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:26 smithi088 ceph-mon[27811]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:22:26.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:26 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:22:27.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:27 smithi088 ceph-mon[27811]: pgmap v11: 65 pgs: 65 active+clean; 308 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 385 op/s 2024-09-17T04:22:27.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:27 smithi134 ceph-mon[35201]: pgmap v11: 65 pgs: 65 active+clean; 308 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 385 op/s 2024-09-17T04:22:28.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:28 smithi088 ceph-mon[27811]: pgmap v12: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 478 op/s 2024-09-17T04:22:28.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:28 smithi134 ceph-mon[35201]: pgmap v12: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 478 op/s 2024-09-17T04:22:30.825 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:30 smithi088 ceph-mon[27811]: pgmap v13: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 405 op/s 2024-09-17T04:22:30.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:30 smithi134 ceph-mon[35201]: pgmap v13: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 405 op/s 2024-09-17T04:22:32.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:32 smithi088 ceph-mon[27811]: pgmap v14: 65 pgs: 65 active+clean; 282 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 521 op/s 2024-09-17T04:22:32.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:32 smithi134 ceph-mon[35201]: pgmap v14: 65 pgs: 65 active+clean; 282 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 521 op/s 2024-09-17T04:22:34.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:34 smithi088 ceph-mon[27811]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:34.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:34 smithi088 ceph-mon[27811]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:34.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:34 smithi088 ceph-mon[27811]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:22:34.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:34 smithi088 ceph-mon[27811]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:22:34.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:34 smithi088 ceph-mon[27811]: Updating smithi088:/etc/ceph/ceph.conf 2024-09-17T04:22:34.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:34 smithi088 ceph-mon[27811]: Updating smithi134:/etc/ceph/ceph.conf 2024-09-17T04:22:34.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:34 smithi088 ceph-mon[27811]: Updating smithi134:/var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T04:22:34.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:34 smithi088 ceph-mon[27811]: Updating smithi088:/var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T04:22:34.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:34 smithi088 ceph-mon[27811]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:34.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:34 smithi088 ceph-mon[27811]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:34.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:34 smithi088 ceph-mon[27811]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:34.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:34 smithi088 ceph-mon[27811]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:34.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:34 smithi088 ceph-mon[27811]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:34.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:34 smithi134 ceph-mon[35201]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:34.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:34 smithi134 ceph-mon[35201]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:34.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:34 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:22:34.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:34 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:22:34.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:34 smithi134 ceph-mon[35201]: Updating smithi088:/etc/ceph/ceph.conf 2024-09-17T04:22:34.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:34 smithi134 ceph-mon[35201]: Updating smithi134:/etc/ceph/ceph.conf 2024-09-17T04:22:34.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:34 smithi134 ceph-mon[35201]: Updating smithi134:/var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T04:22:34.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:34 smithi134 ceph-mon[35201]: Updating smithi088:/var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T04:22:34.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:34 smithi134 ceph-mon[35201]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:34.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:34 smithi134 ceph-mon[35201]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:34.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:34 smithi134 ceph-mon[35201]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:34.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:34 smithi134 ceph-mon[35201]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:34.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:34 smithi134 ceph-mon[35201]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:35.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:35 smithi088 ceph-mon[27811]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2024-09-17T04:22:35.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:35 smithi088 ceph-mon[27811]: Updating smithi088:/etc/ceph/ceph.client.admin.keyring 2024-09-17T04:22:35.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:35 smithi088 ceph-mon[27811]: Updating smithi134:/var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T04:22:35.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:35 smithi088 ceph-mon[27811]: Updating smithi088:/var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T04:22:35.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:35 smithi088 ceph-mon[27811]: Reconfiguring prometheus.smithi088 (dependencies changed)... 2024-09-17T04:22:35.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:35 smithi088 ceph-mon[27811]: Reconfiguring daemon prometheus.smithi088 on smithi088 2024-09-17T04:22:35.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:35 smithi088 ceph-mon[27811]: pgmap v15: 65 pgs: 65 active+clean; 282 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 249 op/s 2024-09-17T04:22:35.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:35 smithi134 ceph-mon[35201]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2024-09-17T04:22:35.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:35 smithi134 ceph-mon[35201]: Updating smithi088:/etc/ceph/ceph.client.admin.keyring 2024-09-17T04:22:35.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:35 smithi134 ceph-mon[35201]: Updating smithi134:/var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T04:22:35.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:35 smithi134 ceph-mon[35201]: Updating smithi088:/var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T04:22:35.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:35 smithi134 ceph-mon[35201]: Reconfiguring prometheus.smithi088 (dependencies changed)... 2024-09-17T04:22:35.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:35 smithi134 ceph-mon[35201]: Reconfiguring daemon prometheus.smithi088 on smithi088 2024-09-17T04:22:35.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:35 smithi134 ceph-mon[35201]: pgmap v15: 65 pgs: 65 active+clean; 282 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 249 op/s 2024-09-17T04:22:36.636 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-09-17T04:22:36.636 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-09-17T04:22:36.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:36 smithi088 ceph-mon[27811]: pgmap v16: 65 pgs: 65 active+clean; 287 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 298 op/s 2024-09-17T04:22:36.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:36 smithi134 ceph-mon[35201]: pgmap v16: 65 pgs: 65 active+clean; 287 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 298 op/s 2024-09-17T04:22:36.919 DEBUG:teuthology.parallel:result is None 2024-09-17T04:22:38.772 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:38 smithi088 ceph-mon[27811]: pgmap v17: 65 pgs: 65 active+clean; 285 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 273 op/s 2024-09-17T04:22:38.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:38 smithi134 ceph-mon[35201]: pgmap v17: 65 pgs: 65 active+clean; 285 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 273 op/s 2024-09-17T04:22:39.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.408+0000 7f8534d2d640 1 -- 172.21.15.88:0/819696456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85300ffc10 msgr2=0x7f8530100010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:39.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.408+0000 7f8534d2d640 1 --2- 172.21.15.88:0/819696456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85300ffc10 0x7f8530100010 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f85200097e0 tx=0x7f852002a3f0 comp rx=0 tx=0).stop 2024-09-17T04:22:39.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.409+0000 7f8534d2d640 1 -- 172.21.15.88:0/819696456 shutdown_connections 2024-09-17T04:22:39.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.409+0000 7f8534d2d640 1 --2- 172.21.15.88:0/819696456 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8530102bf0 0x7f8530103070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:39.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.409+0000 7f8534d2d640 1 --2- 172.21.15.88:0/819696456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85300ffc10 0x7f8530100010 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:39.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.409+0000 7f8534d2d640 1 -- 172.21.15.88:0/819696456 >> 172.21.15.88:0/819696456 conn(0x7f85300fb760 msgr2=0x7f85300fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:22:39.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.409+0000 7f8534d2d640 1 -- 172.21.15.88:0/819696456 shutdown_connections 2024-09-17T04:22:39.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.409+0000 7f8534d2d640 1 -- 172.21.15.88:0/819696456 wait complete. 2024-09-17T04:22:39.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.409+0000 7f8534d2d640 1 Processor -- start 2024-09-17T04:22:39.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.409+0000 7f8534d2d640 1 -- start start 2024-09-17T04:22:39.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.410+0000 7f8534d2d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f85300ffc10 0x7f8530197540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:22:39.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.410+0000 7f8534d2d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8530102bf0 0x7f8530197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:22:39.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.410+0000 7f8534d2d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f853010a770 con 0x7f85300ffc10 2024-09-17T04:22:39.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.410+0000 7f8534d2d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f853010a5f0 con 0x7f8530102bf0 2024-09-17T04:22:39.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.410+0000 7f852e59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f85300ffc10 0x7f8530197540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:22:39.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.410+0000 7f852e59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f85300ffc10 0x7f8530197540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46192/0 (socket says 172.21.15.88:46192) 2024-09-17T04:22:39.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.410+0000 7f852e59c640 1 -- 172.21.15.88:0/2634524859 learned_addr learned my addr 172.21.15.88:0/2634524859 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:22:39.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.410+0000 7f852dd9b640 1 --2- 172.21.15.88:0/2634524859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8530102bf0 0x7f8530197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:22:39.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.410+0000 7f852e59c640 1 -- 172.21.15.88:0/2634524859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8530102bf0 msgr2=0x7f8530197a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:39.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.410+0000 7f852e59c640 1 --2- 172.21.15.88:0/2634524859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8530102bf0 0x7f8530197a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:39.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.410+0000 7f852e59c640 1 -- 172.21.15.88:0/2634524859 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8530198100 con 0x7f85300ffc10 2024-09-17T04:22:39.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.410+0000 7f852dd9b640 1 --2- 172.21.15.88:0/2634524859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8530102bf0 0x7f8530197a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:22:39.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.410+0000 7f852e59c640 1 --2- 172.21.15.88:0/2634524859 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f85300ffc10 0x7f8530197540 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8520030750 tx=0x7f85200043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:22:39.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.411+0000 7f851f7fe640 1 -- 172.21.15.88:0/2634524859 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8520040070 con 0x7f85300ffc10 2024-09-17T04:22:39.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.411+0000 7f851f7fe640 1 -- 172.21.15.88:0/2634524859 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8520030c00 con 0x7f85300ffc10 2024-09-17T04:22:39.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.411+0000 7f8534d2d640 1 -- 172.21.15.88:0/2634524859 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f853019ca70 con 0x7f85300ffc10 2024-09-17T04:22:39.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.411+0000 7f851f7fe640 1 -- 172.21.15.88:0/2634524859 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8520003ca0 con 0x7f85300ffc10 2024-09-17T04:22:39.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.411+0000 7f8534d2d640 1 -- 172.21.15.88:0/2634524859 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8530100c70 con 0x7f85300ffc10 2024-09-17T04:22:39.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.412+0000 7f8534d2d640 1 -- 172.21.15.88:0/2634524859 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8530100010 con 0x7f85300ffc10 2024-09-17T04:22:39.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.414+0000 7f851f7fe640 1 -- 172.21.15.88:0/2634524859 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 32) ==== 103422+0+0 (secure 0 0 0) 0x7f8520039040 con 0x7f85300ffc10 2024-09-17T04:22:39.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.414+0000 7f851f7fe640 1 --2- 172.21.15.88:0/2634524859 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f851807b0b0 0x7f851807d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:22:39.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.414+0000 7f851f7fe640 1 -- 172.21.15.88:0/2634524859 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7f85200bfa50 con 0x7f85300ffc10 2024-09-17T04:22:39.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.414+0000 7f852dd9b640 1 --2- 172.21.15.88:0/2634524859 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f851807b0b0 0x7f851807d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:22:39.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.415+0000 7f852dd9b640 1 --2- 172.21.15.88:0/2634524859 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f851807b0b0 0x7f851807d570 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8530198980 tx=0x7f8524009260 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:22:39.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.417+0000 7f851f7fe640 1 -- 172.21.15.88:0/2634524859 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f852008b0c0 con 0x7f85300ffc10 2024-09-17T04:22:39.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.644+0000 7f8534d2d640 1 -- 172.21.15.88:0/2634524859 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f85300626f0 con 0x7f851807b0b0 2024-09-17T04:22:39.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.646+0000 7f851f7fe640 1 -- 172.21.15.88:0/2634524859 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+337 (secure 0 0 0) 0x7f85300626f0 con 0x7f851807b0b0 2024-09-17T04:22:39.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.648+0000 7f8534d2d640 1 -- 172.21.15.88:0/2634524859 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f851807b0b0 msgr2=0x7f851807d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:39.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.648+0000 7f8534d2d640 1 --2- 172.21.15.88:0/2634524859 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f851807b0b0 0x7f851807d570 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8530198980 tx=0x7f8524009260 comp rx=0 tx=0).stop 2024-09-17T04:22:39.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.648+0000 7f8534d2d640 1 -- 172.21.15.88:0/2634524859 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f85300ffc10 msgr2=0x7f8530197540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:39.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.648+0000 7f8534d2d640 1 --2- 172.21.15.88:0/2634524859 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f85300ffc10 0x7f8530197540 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8520030750 tx=0x7f85200043b0 comp rx=0 tx=0).stop 2024-09-17T04:22:39.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.648+0000 7f8534d2d640 1 -- 172.21.15.88:0/2634524859 shutdown_connections 2024-09-17T04:22:39.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.648+0000 7f8534d2d640 1 --2- 172.21.15.88:0/2634524859 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f851807b0b0 0x7f851807d570 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:39.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.648+0000 7f8534d2d640 1 --2- 172.21.15.88:0/2634524859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8530102bf0 0x7f8530197a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:39.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.648+0000 7f8534d2d640 1 --2- 172.21.15.88:0/2634524859 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f85300ffc10 0x7f8530197540 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:39.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.648+0000 7f8534d2d640 1 -- 172.21.15.88:0/2634524859 >> 172.21.15.88:0/2634524859 conn(0x7f85300fb760 msgr2=0x7f8530106150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:22:39.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.648+0000 7f8534d2d640 1 -- 172.21.15.88:0/2634524859 shutdown_connections 2024-09-17T04:22:39.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.648+0000 7f8534d2d640 1 -- 172.21.15.88:0/2634524859 wait complete. 2024-09-17T04:22:39.657 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-09-17T04:22:39.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.742+0000 7eff27051640 1 -- 172.21.15.88:0/84215772 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff20101a60 msgr2=0x7eff20101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:39.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.742+0000 7eff27051640 1 --2- 172.21.15.88:0/84215772 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff20101a60 0x7eff20101ee0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7eff0c009880 tx=0x7eff0c02a4a0 comp rx=0 tx=0).stop 2024-09-17T04:22:39.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.743+0000 7eff27051640 1 -- 172.21.15.88:0/84215772 shutdown_connections 2024-09-17T04:22:39.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.743+0000 7eff27051640 1 --2- 172.21.15.88:0/84215772 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff20101a60 0x7eff20101ee0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:39.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.743+0000 7eff27051640 1 --2- 172.21.15.88:0/84215772 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff20100860 0x7eff20100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:39.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.743+0000 7eff27051640 1 -- 172.21.15.88:0/84215772 >> 172.21.15.88:0/84215772 conn(0x7eff200fc010 msgr2=0x7eff200fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:22:39.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.743+0000 7eff27051640 1 -- 172.21.15.88:0/84215772 shutdown_connections 2024-09-17T04:22:39.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.743+0000 7eff27051640 1 -- 172.21.15.88:0/84215772 wait complete. 2024-09-17T04:22:39.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.744+0000 7eff27051640 1 Processor -- start 2024-09-17T04:22:39.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.744+0000 7eff27051640 1 -- start start 2024-09-17T04:22:39.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.744+0000 7eff27051640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff20100860 0x7eff20195310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:22:39.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.744+0000 7eff27051640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff20101a60 0x7eff20195850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:22:39.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.745+0000 7eff24ded640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff20100860 0x7eff20195310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:22:39.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.745+0000 7eff24ded640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff20100860 0x7eff20195310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46202/0 (socket says 172.21.15.88:46202) 2024-09-17T04:22:39.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.745+0000 7eff24ded640 1 -- 172.21.15.88:0/3006623098 learned_addr learned my addr 172.21.15.88:0/3006623098 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:22:39.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.745+0000 7eff27051640 1 -- 172.21.15.88:0/3006623098 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7eff20108610 con 0x7eff20100860 2024-09-17T04:22:39.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.745+0000 7eff27051640 1 -- 172.21.15.88:0/3006623098 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7eff20108490 con 0x7eff20101a60 2024-09-17T04:22:39.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.745+0000 7eff1ffff640 1 --2- 172.21.15.88:0/3006623098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff20101a60 0x7eff20195850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:22:39.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.745+0000 7eff24ded640 1 -- 172.21.15.88:0/3006623098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff20101a60 msgr2=0x7eff20195850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:39.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.745+0000 7eff24ded640 1 --2- 172.21.15.88:0/3006623098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff20101a60 0x7eff20195850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:39.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.745+0000 7eff24ded640 1 -- 172.21.15.88:0/3006623098 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff20195ed0 con 0x7eff20100860 2024-09-17T04:22:39.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.745+0000 7eff24ded640 1 --2- 172.21.15.88:0/3006623098 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff20100860 0x7eff20195310 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7eff1400b3d0 tx=0x7eff1400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:22:39.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.746+0000 7eff1dffb640 1 -- 172.21.15.88:0/3006623098 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7eff14015020 con 0x7eff20100860 2024-09-17T04:22:39.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.746+0000 7eff1dffb640 1 -- 172.21.15.88:0/3006623098 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7eff14011af0 con 0x7eff20100860 2024-09-17T04:22:39.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.746+0000 7eff27051640 1 -- 172.21.15.88:0/3006623098 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff2019a910 con 0x7eff20100860 2024-09-17T04:22:39.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.746+0000 7eff1dffb640 1 -- 172.21.15.88:0/3006623098 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7eff14010da0 con 0x7eff20100860 2024-09-17T04:22:39.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.746+0000 7eff27051640 1 -- 172.21.15.88:0/3006623098 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff2019aef0 con 0x7eff20100860 2024-09-17T04:22:39.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.747+0000 7eff27051640 1 -- 172.21.15.88:0/3006623098 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff20100c60 con 0x7eff20100860 2024-09-17T04:22:39.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.748+0000 7eff1dffb640 1 -- 172.21.15.88:0/3006623098 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 32) ==== 103422+0+0 (secure 0 0 0) 0x7eff14018020 con 0x7eff20100860 2024-09-17T04:22:39.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.748+0000 7eff1dffb640 1 --2- 172.21.15.88:0/3006623098 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7eff1007d270 0x7eff1007f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:22:39.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.748+0000 7eff1dffb640 1 -- 172.21.15.88:0/3006623098 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7eff1409dc00 con 0x7eff20100860 2024-09-17T04:22:39.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.749+0000 7eff1ffff640 1 --2- 172.21.15.88:0/3006623098 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7eff1007d270 0x7eff1007f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:22:39.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.749+0000 7eff1ffff640 1 --2- 172.21.15.88:0/3006623098 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7eff1007d270 0x7eff1007f730 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7eff0c000c00 tx=0x7eff0c0058d0 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:22:39.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.753+0000 7eff1dffb640 1 -- 172.21.15.88:0/3006623098 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7eff140a3020 con 0x7eff20100860 2024-09-17T04:22:39.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.990+0000 7eff27051640 1 -- 172.21.15.88:0/3006623098 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7eff200626f0 con 0x7eff1007d270 2024-09-17T04:22:39.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.992+0000 7eff1dffb640 1 -- 172.21.15.88:0/3006623098 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+337 (secure 0 0 0) 0x7eff200626f0 con 0x7eff1007d270 2024-09-17T04:22:39.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.994+0000 7eff27051640 1 -- 172.21.15.88:0/3006623098 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7eff1007d270 msgr2=0x7eff1007f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:39.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.994+0000 7eff27051640 1 --2- 172.21.15.88:0/3006623098 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7eff1007d270 0x7eff1007f730 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7eff0c000c00 tx=0x7eff0c0058d0 comp rx=0 tx=0).stop 2024-09-17T04:22:39.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.994+0000 7eff27051640 1 -- 172.21.15.88:0/3006623098 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff20100860 msgr2=0x7eff20195310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:39.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.994+0000 7eff27051640 1 --2- 172.21.15.88:0/3006623098 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff20100860 0x7eff20195310 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7eff1400b3d0 tx=0x7eff1400b890 comp rx=0 tx=0).stop 2024-09-17T04:22:39.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.994+0000 7eff27051640 1 -- 172.21.15.88:0/3006623098 shutdown_connections 2024-09-17T04:22:39.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.994+0000 7eff27051640 1 --2- 172.21.15.88:0/3006623098 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7eff1007d270 0x7eff1007f730 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:39.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.994+0000 7eff27051640 1 --2- 172.21.15.88:0/3006623098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff20101a60 0x7eff20195850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:39.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.994+0000 7eff27051640 1 --2- 172.21.15.88:0/3006623098 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff20100860 0x7eff20195310 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:39.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.994+0000 7eff27051640 1 -- 172.21.15.88:0/3006623098 >> 172.21.15.88:0/3006623098 conn(0x7eff200fc010 msgr2=0x7eff20104fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:22:39.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.994+0000 7eff27051640 1 -- 172.21.15.88:0/3006623098 shutdown_connections 2024-09-17T04:22:39.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:39.994+0000 7eff27051640 1 -- 172.21.15.88:0/3006623098 wait complete. 2024-09-17T04:22:40.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.088+0000 7f3c85559640 1 -- 172.21.15.88:0/3454319988 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c801023f0 msgr2=0x7f3c801047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:40.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.088+0000 7f3c85559640 1 --2- 172.21.15.88:0/3454319988 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c801023f0 0x7f3c801047e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f3c700098b0 tx=0x7f3c7002a4d0 comp rx=0 tx=0).stop 2024-09-17T04:22:40.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.088+0000 7f3c85559640 1 -- 172.21.15.88:0/3454319988 shutdown_connections 2024-09-17T04:22:40.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.088+0000 7f3c85559640 1 --2- 172.21.15.88:0/3454319988 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c80104d20 0x7f3c80107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:40.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.088+0000 7f3c85559640 1 --2- 172.21.15.88:0/3454319988 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c801023f0 0x7f3c801047e0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:40.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.088+0000 7f3c85559640 1 -- 172.21.15.88:0/3454319988 >> 172.21.15.88:0/3454319988 conn(0x7f3c800fc010 msgr2=0x7f3c800fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:22:40.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.088+0000 7f3c85559640 1 -- 172.21.15.88:0/3454319988 shutdown_connections 2024-09-17T04:22:40.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.088+0000 7f3c85559640 1 -- 172.21.15.88:0/3454319988 wait complete. 2024-09-17T04:22:40.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.088+0000 7f3c85559640 1 Processor -- start 2024-09-17T04:22:40.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.089+0000 7f3c85559640 1 -- start start 2024-09-17T04:22:40.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.089+0000 7f3c85559640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c801023f0 0x7f3c801974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:22:40.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.089+0000 7f3c85559640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c80104d20 0x7f3c80197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:22:40.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.089+0000 7f3c85559640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f3c8010a7c0 con 0x7f3c801023f0 2024-09-17T04:22:40.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.089+0000 7f3c85559640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3c8010a640 con 0x7f3c80104d20 2024-09-17T04:22:40.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.089+0000 7f3c7effd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c801023f0 0x7f3c801974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:22:40.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.089+0000 7f3c7effd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c801023f0 0x7f3c801974e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46220/0 (socket says 172.21.15.88:46220) 2024-09-17T04:22:40.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.089+0000 7f3c7effd640 1 -- 172.21.15.88:0/923889236 learned_addr learned my addr 172.21.15.88:0/923889236 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:22:40.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.089+0000 7f3c7e7fc640 1 --2- 172.21.15.88:0/923889236 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c80104d20 0x7f3c80197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:22:40.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.089+0000 7f3c7effd640 1 -- 172.21.15.88:0/923889236 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c80104d20 msgr2=0x7f3c80197a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:40.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.089+0000 7f3c7effd640 1 --2- 172.21.15.88:0/923889236 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c80104d20 0x7f3c80197a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:40.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.089+0000 7f3c7effd640 1 -- 172.21.15.88:0/923889236 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c801980a0 con 0x7f3c801023f0 2024-09-17T04:22:40.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.090+0000 7f3c7effd640 1 --2- 172.21.15.88:0/923889236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c801023f0 0x7f3c801974e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f3c70009880 tx=0x7f3c700045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:22:40.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.090+0000 7f3c67fff640 1 -- 172.21.15.88:0/923889236 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3c7003f070 con 0x7f3c801023f0 2024-09-17T04:22:40.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.090+0000 7f3c85559640 1 -- 172.21.15.88:0/923889236 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c8019ca80 con 0x7f3c801023f0 2024-09-17T04:22:40.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.090+0000 7f3c85559640 1 -- 172.21.15.88:0/923889236 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c8019d010 con 0x7f3c801023f0 2024-09-17T04:22:40.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.090+0000 7f3c67fff640 1 -- 172.21.15.88:0/923889236 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3c70004a50 con 0x7f3c801023f0 2024-09-17T04:22:40.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.090+0000 7f3c67fff640 1 -- 172.21.15.88:0/923889236 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3c70049060 con 0x7f3c801023f0 2024-09-17T04:22:40.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.091+0000 7f3c85559640 1 -- 172.21.15.88:0/923889236 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c6c0052c0 con 0x7f3c801023f0 2024-09-17T04:22:40.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.092+0000 7f3c67fff640 1 -- 172.21.15.88:0/923889236 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 32) ==== 103422+0+0 (secure 0 0 0) 0x7f3c70042070 con 0x7f3c801023f0 2024-09-17T04:22:40.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.093+0000 7f3c67fff640 1 --2- 172.21.15.88:0/923889236 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f3c6807b050 0x7f3c6807d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:22:40.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.093+0000 7f3c67fff640 1 -- 172.21.15.88:0/923889236 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7f3c700bee40 con 0x7f3c801023f0 2024-09-17T04:22:40.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.093+0000 7f3c7e7fc640 1 --2- 172.21.15.88:0/923889236 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f3c6807b050 0x7f3c6807d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:22:40.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.094+0000 7f3c7e7fc640 1 --2- 172.21.15.88:0/923889236 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f3c6807b050 0x7f3c6807d510 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3c80198990 tx=0x7f3c7400b410 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:22:40.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.099+0000 7f3c67fff640 1 -- 172.21.15.88:0/923889236 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f3c7008a2f0 con 0x7f3c801023f0 2024-09-17T04:22:40.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.395+0000 7f3c85559640 1 -- 172.21.15.88:0/923889236 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f3c6c000bf0 con 0x7f3c6807b050 2024-09-17T04:22:40.406 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.407+0000 7f3c67fff640 1 -- 172.21.15.88:0/923889236 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f3c6c000bf0 con 0x7f3c6807b050 2024-09-17T04:22:40.407 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T04:22:40.407 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (8m) 17s ago 9m 25.4M - 0.25.0 c8568f914cd2 f2dbac7e939f 2024-09-17T04:22:40.407 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi088 smithi088 running (93s) 17s ago 10m 8300k - 19.1.1-330-gc2ddf972 ebb0615149de 683e1826a1a5 2024-09-17T04:22:40.407 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi134 smithi134 running (64s) 25s ago 9m 8166k - 19.1.1-330-gc2ddf972 ebb0615149de 83afa4200c0e 2024-09-17T04:22:40.407 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (9m) 17s ago 9m 6903k - 19.1.1-330-gc2ddf972 ebb0615149de de17f5571330 2024-09-17T04:22:40.407 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi134 smithi134 running (9m) 25s ago 9m 6899k - 19.1.1-330-gc2ddf972 ebb0615149de 27f7ef172a1c 2024-09-17T04:22:40.407 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (8m) 17s ago 9m 80.3M - 9.4.12 2bacad6d85d8 a6cff57a23f9 2024-09-17T04:22:40.407 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.giqrgt smithi088 running (4m) 17s ago 4m 223M - 19.1.1-330-gc2ddf972 ebb0615149de f724660799a1 2024-09-17T04:22:40.407 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.lgavsv smithi088 running (4m) 17s ago 4m 14.7M - 19.1.1-330-gc2ddf972 ebb0615149de 6cc0fe8a6aa9 2024-09-17T04:22:40.407 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi134.ktuhce smithi134 running (4m) 25s ago 4m 14.2M - 19.1.1-330-gc2ddf972 ebb0615149de 7ff5b70ca9cb 2024-09-17T04:22:40.407 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi134.psnynp smithi134 running (4m) 25s ago 4m 270M - 19.1.1-330-gc2ddf972 ebb0615149de 5326974fa3dd 2024-09-17T04:22:40.407 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.wmndiv smithi088 *:8443,9283,8765 running (58s) 17s ago 11m 557M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 49eb47f7f14f 2024-09-17T04:22:40.408 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi134.vwdxcb smithi134 *:8443,9283,8765 running (2m) 25s ago 8m 193M - 19.3.0-4989-gce1b342b 8e039cb7fe1e efa5f0c9df8c 2024-09-17T04:22:40.408 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (11m) 17s ago 11m 54.1M 2048M 19.1.1-330-gc2ddf972 ebb0615149de bbeb722f42bc 2024-09-17T04:22:40.408 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi134 smithi134 running (8m) 25s ago 8m 45.8M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 89de63fb6386 2024-09-17T04:22:40.408 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (9m) 17s ago 9m 16.1M - 1.5.0 0da6a335fe13 9ba03800993b 2024-09-17T04:22:40.408 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi134 smithi134 *:9100 running (9m) 25s ago 9m 17.2M - 1.5.0 0da6a335fe13 6deac483827f 2024-09-17T04:22:40.408 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (7m) 17s ago 7m 178M 1216M 19.1.1-330-gc2ddf972 ebb0615149de e309427ee12c 2024-09-17T04:22:40.408 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (7m) 17s ago 7m 193M 1216M 19.1.1-330-gc2ddf972 ebb0615149de cc68d92b3333 2024-09-17T04:22:40.408 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (6m) 17s ago 6m 166M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 1ba92f2bfce6 2024-09-17T04:22:40.408 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi134 running (6m) 25s ago 6m 215M 2240M 19.1.1-330-gc2ddf972 ebb0615149de ebd528c3ce1b 2024-09-17T04:22:40.408 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi134 running (5m) 25s ago 5m 186M 2240M 19.1.1-330-gc2ddf972 ebb0615149de eacc25537b3a 2024-09-17T04:22:40.408 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi134 running (5m) 25s ago 5m 167M 2240M 19.1.1-330-gc2ddf972 ebb0615149de bc1b434a92a8 2024-09-17T04:22:40.408 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (68s) 17s ago 9m 46.9M - 2.43.0 a07b618ecd1d 4aa9c236625e 2024-09-17T04:22:40.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.409+0000 7f3c85559640 1 -- 172.21.15.88:0/923889236 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f3c6807b050 msgr2=0x7f3c6807d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:40.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.409+0000 7f3c85559640 1 --2- 172.21.15.88:0/923889236 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f3c6807b050 0x7f3c6807d510 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3c80198990 tx=0x7f3c7400b410 comp rx=0 tx=0).stop 2024-09-17T04:22:40.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.409+0000 7f3c85559640 1 -- 172.21.15.88:0/923889236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c801023f0 msgr2=0x7f3c801974e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:40.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.409+0000 7f3c85559640 1 --2- 172.21.15.88:0/923889236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c801023f0 0x7f3c801974e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f3c70009880 tx=0x7f3c700045c0 comp rx=0 tx=0).stop 2024-09-17T04:22:40.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.409+0000 7f3c85559640 1 -- 172.21.15.88:0/923889236 shutdown_connections 2024-09-17T04:22:40.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.409+0000 7f3c85559640 1 --2- 172.21.15.88:0/923889236 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f3c6807b050 0x7f3c6807d510 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:40.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.409+0000 7f3c85559640 1 --2- 172.21.15.88:0/923889236 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c80104d20 0x7f3c80197a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:40.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.409+0000 7f3c85559640 1 --2- 172.21.15.88:0/923889236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c801023f0 0x7f3c801974e0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:40.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.409+0000 7f3c85559640 1 -- 172.21.15.88:0/923889236 >> 172.21.15.88:0/923889236 conn(0x7f3c800fc010 msgr2=0x7f3c800fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:22:40.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.409+0000 7f3c85559640 1 -- 172.21.15.88:0/923889236 shutdown_connections 2024-09-17T04:22:40.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.409+0000 7f3c85559640 1 -- 172.21.15.88:0/923889236 wait complete. 2024-09-17T04:22:40.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.508+0000 7f3aae069640 1 -- 172.21.15.88:0/3931350974 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3aa8100860 msgr2=0x7f3aa8100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:40.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.508+0000 7f3aae069640 1 --2- 172.21.15.88:0/3931350974 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3aa8100860 0x7f3aa8100c60 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f3a98009880 tx=0x7f3a9802a4a0 comp rx=0 tx=0).stop 2024-09-17T04:22:40.508 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:40 smithi088 ceph-mon[27811]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:22:40.508 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:40 smithi088 ceph-mon[27811]: from='client.14920 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:22:40.508 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:40 smithi088 ceph-mon[27811]: from='client.14924 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:22:40.508 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:40 smithi088 ceph-mon[27811]: pgmap v18: 65 pgs: 65 active+clean; 285 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 180 op/s 2024-09-17T04:22:40.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.508+0000 7f3aae069640 1 -- 172.21.15.88:0/3931350974 shutdown_connections 2024-09-17T04:22:40.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.508+0000 7f3aae069640 1 --2- 172.21.15.88:0/3931350974 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3aa8101a60 0x7f3aa8101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:40.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.508+0000 7f3aae069640 1 --2- 172.21.15.88:0/3931350974 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3aa8100860 0x7f3aa8100c60 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:40.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.508+0000 7f3aae069640 1 -- 172.21.15.88:0/3931350974 >> 172.21.15.88:0/3931350974 conn(0x7f3aa80fc010 msgr2=0x7f3aa80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:22:40.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.508+0000 7f3aae069640 1 -- 172.21.15.88:0/3931350974 shutdown_connections 2024-09-17T04:22:40.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.508+0000 7f3aae069640 1 -- 172.21.15.88:0/3931350974 wait complete. 2024-09-17T04:22:40.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.509+0000 7f3aae069640 1 Processor -- start 2024-09-17T04:22:40.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.509+0000 7f3aae069640 1 -- start start 2024-09-17T04:22:40.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.509+0000 7f3aae069640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3aa8100860 0x7f3aa81974b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:22:40.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.509+0000 7f3aae069640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3aa8101a60 0x7f3aa81979f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:22:40.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.509+0000 7f3aae069640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa810a780 con 0x7f3aa8101a60 2024-09-17T04:22:40.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.509+0000 7f3aae069640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa810a600 con 0x7f3aa8100860 2024-09-17T04:22:40.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.510+0000 7f3aa6ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3aa8101a60 0x7f3aa81979f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:22:40.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.510+0000 7f3aa6ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3aa8101a60 0x7f3aa81979f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46234/0 (socket says 172.21.15.88:46234) 2024-09-17T04:22:40.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.510+0000 7f3aa6ffd640 1 -- 172.21.15.88:0/700477212 learned_addr learned my addr 172.21.15.88:0/700477212 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:22:40.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.510+0000 7f3aa77fe640 1 --2- 172.21.15.88:0/700477212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3aa8100860 0x7f3aa81974b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:22:40.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.510+0000 7f3aa77fe640 1 -- 172.21.15.88:0/700477212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3aa8101a60 msgr2=0x7f3aa81979f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:40.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.510+0000 7f3aa77fe640 1 --2- 172.21.15.88:0/700477212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3aa8101a60 0x7f3aa81979f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:40.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.510+0000 7f3aa77fe640 1 -- 172.21.15.88:0/700477212 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3aa8198070 con 0x7f3aa8100860 2024-09-17T04:22:40.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.510+0000 7f3aa6ffd640 1 --2- 172.21.15.88:0/700477212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3aa8101a60 0x7f3aa81979f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:22:40.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.510+0000 7f3aa77fe640 1 --2- 172.21.15.88:0/700477212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3aa8100860 0x7f3aa81974b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3a98006010 tx=0x7f3a980045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:22:40.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.511+0000 7f3aa4ff9640 1 -- 172.21.15.88:0/700477212 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3a9803f070 con 0x7f3aa8100860 2024-09-17T04:22:40.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.511+0000 7f3aa4ff9640 1 -- 172.21.15.88:0/700477212 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3a980049d0 con 0x7f3aa8100860 2024-09-17T04:22:40.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.511+0000 7f3aae069640 1 -- 172.21.15.88:0/700477212 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3aa819ca50 con 0x7f3aa8100860 2024-09-17T04:22:40.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.511+0000 7f3aa4ff9640 1 -- 172.21.15.88:0/700477212 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3a98035030 con 0x7f3aa8100860 2024-09-17T04:22:40.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.511+0000 7f3aae069640 1 -- 172.21.15.88:0/700477212 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3aa819cfe0 con 0x7f3aa8100860 2024-09-17T04:22:40.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.512+0000 7f3aae069640 1 -- 172.21.15.88:0/700477212 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3aa8100c60 con 0x7f3aa8100860 2024-09-17T04:22:40.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.513+0000 7f3aa4ff9640 1 -- 172.21.15.88:0/700477212 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) ==== 103422+0+0 (secure 0 0 0) 0x7f3a98042070 con 0x7f3aa8100860 2024-09-17T04:22:40.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.513+0000 7f3aa4ff9640 1 --2- 172.21.15.88:0/700477212 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f3a9007b050 0x7f3a9007d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:22:40.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.513+0000 7f3aa4ff9640 1 -- 172.21.15.88:0/700477212 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7f3a980bec00 con 0x7f3aa8100860 2024-09-17T04:22:40.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.513+0000 7f3aa6ffd640 1 --2- 172.21.15.88:0/700477212 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f3a9007b050 0x7f3a9007d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:22:40.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.514+0000 7f3aa6ffd640 1 --2- 172.21.15.88:0/700477212 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f3a9007b050 0x7f3a9007d510 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3aa8198960 tx=0x7f3a9c005f90 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:22:40.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.518+0000 7f3aa4ff9640 1 -- 172.21.15.88:0/700477212 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f3a980c4020 con 0x7f3aa8100860 2024-09-17T04:22:40.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.856+0000 7f3aae069640 1 -- 172.21.15.88:0/700477212 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f3aa8062df0 con 0x7f3aa8100860 2024-09-17T04:22:40.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.856+0000 7f3aa4ff9640 1 -- 172.21.15.88:0/700477212 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f3a9808a030 con 0x7f3aa8100860 2024-09-17T04:22:40.857 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-17T04:22:40.857 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-09-17T04:22:40.857 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T04:22:40.857 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:22:40.857 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-09-17T04:22:40.857 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T04:22:40.857 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:22:40.857 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-09-17T04:22:40.857 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-17T04:22:40.857 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:22:40.858 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2024-09-17T04:22:40.858 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T04:22:40.858 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:22:40.858 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-09-17T04:22:40.858 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 12, 2024-09-17T04:22:40.858 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T04:22:40.858 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-17T04:22:40.858 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-17T04:22:40.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.859+0000 7f3aae069640 1 -- 172.21.15.88:0/700477212 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f3a9007b050 msgr2=0x7f3a9007d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:40.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.859+0000 7f3aae069640 1 --2- 172.21.15.88:0/700477212 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f3a9007b050 0x7f3a9007d510 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3aa8198960 tx=0x7f3a9c005f90 comp rx=0 tx=0).stop 2024-09-17T04:22:40.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.859+0000 7f3aae069640 1 -- 172.21.15.88:0/700477212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3aa8100860 msgr2=0x7f3aa81974b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:40.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.859+0000 7f3aae069640 1 --2- 172.21.15.88:0/700477212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3aa8100860 0x7f3aa81974b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3a98006010 tx=0x7f3a980045e0 comp rx=0 tx=0).stop 2024-09-17T04:22:40.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.859+0000 7f3aae069640 1 -- 172.21.15.88:0/700477212 shutdown_connections 2024-09-17T04:22:40.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.859+0000 7f3aae069640 1 --2- 172.21.15.88:0/700477212 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f3a9007b050 0x7f3a9007d510 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:40.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.859+0000 7f3aae069640 1 --2- 172.21.15.88:0/700477212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3aa8101a60 0x7f3aa81979f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:40.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.859+0000 7f3aae069640 1 --2- 172.21.15.88:0/700477212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3aa8100860 0x7f3aa81974b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:40.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.859+0000 7f3aae069640 1 -- 172.21.15.88:0/700477212 >> 172.21.15.88:0/700477212 conn(0x7f3aa80fc010 msgr2=0x7f3aa8104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:22:40.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.859+0000 7f3aae069640 1 -- 172.21.15.88:0/700477212 shutdown_connections 2024-09-17T04:22:40.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.859+0000 7f3aae069640 1 -- 172.21.15.88:0/700477212 wait complete. 2024-09-17T04:22:40.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:40 smithi134 ceph-mon[35201]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:22:40.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:40 smithi134 ceph-mon[35201]: from='client.14920 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:22:40.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:40 smithi134 ceph-mon[35201]: from='client.14924 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:22:40.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:40 smithi134 ceph-mon[35201]: pgmap v18: 65 pgs: 65 active+clean; 285 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 180 op/s 2024-09-17T04:22:40.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.960+0000 7fbf8b458640 1 -- 172.21.15.88:0/525533444 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf84101960 msgr2=0x7fbf84101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:40.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.960+0000 7fbf8b458640 1 --2- 172.21.15.88:0/525533444 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf84101960 0x7fbf84101d60 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fbf80009880 tx=0x7fbf8002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:22:40.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.960+0000 7fbf8b458640 1 -- 172.21.15.88:0/525533444 shutdown_connections 2024-09-17T04:22:40.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.960+0000 7fbf8b458640 1 --2- 172.21.15.88:0/525533444 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf84102b60 0x7fbf84102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:40.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.960+0000 7fbf8b458640 1 --2- 172.21.15.88:0/525533444 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf84101960 0x7fbf84101d60 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:40.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.960+0000 7fbf8b458640 1 -- 172.21.15.88:0/525533444 >> 172.21.15.88:0/525533444 conn(0x7fbf840fd0f0 msgr2=0x7fbf840ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:22:40.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.961+0000 7fbf8b458640 1 -- 172.21.15.88:0/525533444 shutdown_connections 2024-09-17T04:22:40.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.961+0000 7fbf8b458640 1 -- 172.21.15.88:0/525533444 wait complete. 2024-09-17T04:22:40.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.961+0000 7fbf8b458640 1 Processor -- start 2024-09-17T04:22:40.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.961+0000 7fbf8b458640 1 -- start start 2024-09-17T04:22:40.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.961+0000 7fbf8b458640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf84101960 0x7fbf84075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:22:40.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.961+0000 7fbf8b458640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf84102b60 0x7fbf840745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:22:40.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.961+0000 7fbf8b458640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fbf8410a780 con 0x7fbf84101960 2024-09-17T04:22:40.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.961+0000 7fbf8b458640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbf8410a600 con 0x7fbf84102b60 2024-09-17T04:22:40.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.962+0000 7fbf891f4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf84101960 0x7fbf84075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:22:40.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.962+0000 7fbf891f4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf84101960 0x7fbf84075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46244/0 (socket says 172.21.15.88:46244) 2024-09-17T04:22:40.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.962+0000 7fbf891f4640 1 -- 172.21.15.88:0/3172772989 learned_addr learned my addr 172.21.15.88:0/3172772989 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:22:40.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.962+0000 7fbf889f3640 1 --2- 172.21.15.88:0/3172772989 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf84102b60 0x7fbf840745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:22:40.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.962+0000 7fbf891f4640 1 -- 172.21.15.88:0/3172772989 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf84102b60 msgr2=0x7fbf840745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:40.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.962+0000 7fbf891f4640 1 --2- 172.21.15.88:0/3172772989 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf84102b60 0x7fbf840745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:40.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.962+0000 7fbf891f4640 1 -- 172.21.15.88:0/3172772989 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf84074b20 con 0x7fbf84101960 2024-09-17T04:22:40.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.962+0000 7fbf889f3640 1 --2- 172.21.15.88:0/3172772989 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf84102b60 0x7fbf840745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:22:40.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.962+0000 7fbf891f4640 1 --2- 172.21.15.88:0/3172772989 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf84101960 0x7fbf84075f20 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fbf80006010 tx=0x7fbf800045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:22:40.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.962+0000 7fbf7a7fc640 1 -- 172.21.15.88:0/3172772989 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbf8003f070 con 0x7fbf84101960 2024-09-17T04:22:40.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.962+0000 7fbf8b458640 1 -- 172.21.15.88:0/3172772989 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf84074db0 con 0x7fbf84101960 2024-09-17T04:22:40.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.963+0000 7fbf8b458640 1 -- 172.21.15.88:0/3172772989 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf840752e0 con 0x7fbf84101960 2024-09-17T04:22:40.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.963+0000 7fbf7a7fc640 1 -- 172.21.15.88:0/3172772989 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbf80004a50 con 0x7fbf84101960 2024-09-17T04:22:40.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.963+0000 7fbf7a7fc640 1 -- 172.21.15.88:0/3172772989 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbf80035030 con 0x7fbf84101960 2024-09-17T04:22:40.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.964+0000 7fbf8b458640 1 -- 172.21.15.88:0/3172772989 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf680052c0 con 0x7fbf84101960 2024-09-17T04:22:40.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.964+0000 7fbf7a7fc640 1 -- 172.21.15.88:0/3172772989 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 32) ==== 103422+0+0 (secure 0 0 0) 0x7fbf80042070 con 0x7fbf84101960 2024-09-17T04:22:40.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.965+0000 7fbf7a7fc640 1 --2- 172.21.15.88:0/3172772989 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fbf7007b0b0 0x7fbf7007d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:22:40.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.965+0000 7fbf7a7fc640 1 -- 172.21.15.88:0/3172772989 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7fbf800bebf0 con 0x7fbf84101960 2024-09-17T04:22:40.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.965+0000 7fbf889f3640 1 --2- 172.21.15.88:0/3172772989 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fbf7007b0b0 0x7fbf7007d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:22:40.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.966+0000 7fbf889f3640 1 --2- 172.21.15.88:0/3172772989 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fbf7007b0b0 0x7fbf7007d570 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbf84075ca0 tx=0x7fbf7400b410 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:22:40.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:40.970+0000 7fbf7a7fc640 1 -- 172.21.15.88:0/3172772989 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7fbf80004c00 con 0x7fbf84101960 2024-09-17T04:22:41.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.235+0000 7fbf8b458640 1 -- 172.21.15.88:0/3172772989 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fbf68005880 con 0x7fbf84101960 2024-09-17T04:22:41.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.235+0000 7fbf7a7fc640 1 -- 172.21.15.88:0/3172772989 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) ==== 76+0+2045 (secure 0 0 0) 0x7fbf8008a0a0 con 0x7fbf84101960 2024-09-17T04:22:41.235 INFO:teuthology.orchestra.run.smithi088.stdout:e15 2024-09-17T04:22:41.235 INFO:teuthology.orchestra.run.smithi088.stdout:btime 2024-09-17T04:18:27:750910+0000 2024-09-17T04:22:41.236 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T04:22:41.236 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:22:41.236 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2024-09-17T04:22:41.236 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:22:41.236 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2024-09-17T04:22:41.236 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2024-09-17T04:22:41.236 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 15 2024-09-17T04:22:41.236 INFO:teuthology.orchestra.run.smithi088.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T04:22:41.236 INFO:teuthology.orchestra.run.smithi088.stdout:created 2024-09-17T04:18:10.480573+0000 2024-09-17T04:22:41.236 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2024-09-17T04:18:27.750896+0000 2024-09-17T04:22:41.236 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2024-09-17T04:22:41.236 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2024-09-17T04:22:41.236 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2024-09-17T04:22:41.237 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2024-09-17T04:22:41.237 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2024-09-17T04:22:41.237 INFO:teuthology.orchestra.run.smithi088.stdout:max_xattr_size 65536 2024-09-17T04:22:41.237 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2024-09-17T04:22:41.237 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2024-09-17T04:22:41.237 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 45 2024-09-17T04:22:41.237 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:22:41.237 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 1 2024-09-17T04:22:41.237 INFO:teuthology.orchestra.run.smithi088.stdout:in 0 2024-09-17T04:22:41.237 INFO:teuthology.orchestra.run.smithi088.stdout:up {0=14590} 2024-09-17T04:22:41.237 INFO:teuthology.orchestra.run.smithi088.stdout:failed 2024-09-17T04:22:41.237 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2024-09-17T04:22:41.237 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2024-09-17T04:22:41.238 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2024-09-17T04:22:41.238 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2024-09-17T04:22:41.238 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data enabled 2024-09-17T04:22:41.238 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2024-09-17T04:22:41.238 INFO:teuthology.orchestra.run.smithi088.stdout:bal_rank_mask -1 2024-09-17T04:22:41.238 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 1 2024-09-17T04:22:41.238 INFO:teuthology.orchestra.run.smithi088.stdout:qdb_cluster leader: 14590 members: 14590 2024-09-17T04:22:41.238 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.giqrgt{0:14590} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.88:6828/1714846518,v1:172.21.15.88:6829/1714846518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:22:41.238 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi134.psnynp{0:24321} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.134:6826/2137586894,v1:172.21.15.134:6827/2137586894] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:22:41.238 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:22:41.238 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:22:41.238 INFO:teuthology.orchestra.run.smithi088.stdout:Standby daemons: 2024-09-17T04:22:41.238 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:22:41.238 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi134.ktuhce{-1:24325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/967997022,v1:172.21.15.134:6825/967997022] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:22:41.238 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.lgavsv{-1:24329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/1425146180,v1:172.21.15.88:6827/1425146180] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:22:41.239 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 15 2024-09-17T04:22:41.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.238+0000 7fbf8b458640 1 -- 172.21.15.88:0/3172772989 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fbf7007b0b0 msgr2=0x7fbf7007d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:41.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.238+0000 7fbf8b458640 1 --2- 172.21.15.88:0/3172772989 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fbf7007b0b0 0x7fbf7007d570 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbf84075ca0 tx=0x7fbf7400b410 comp rx=0 tx=0).stop 2024-09-17T04:22:41.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.238+0000 7fbf8b458640 1 -- 172.21.15.88:0/3172772989 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf84101960 msgr2=0x7fbf84075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:41.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.238+0000 7fbf8b458640 1 --2- 172.21.15.88:0/3172772989 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf84101960 0x7fbf84075f20 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fbf80006010 tx=0x7fbf800045e0 comp rx=0 tx=0).stop 2024-09-17T04:22:41.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.238+0000 7fbf8b458640 1 -- 172.21.15.88:0/3172772989 shutdown_connections 2024-09-17T04:22:41.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.238+0000 7fbf8b458640 1 --2- 172.21.15.88:0/3172772989 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fbf7007b0b0 0x7fbf7007d570 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:41.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.238+0000 7fbf8b458640 1 --2- 172.21.15.88:0/3172772989 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf84102b60 0x7fbf840745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:41.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.238+0000 7fbf8b458640 1 --2- 172.21.15.88:0/3172772989 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf84101960 0x7fbf84075f20 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:41.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.238+0000 7fbf8b458640 1 -- 172.21.15.88:0/3172772989 >> 172.21.15.88:0/3172772989 conn(0x7fbf840fd0f0 msgr2=0x7fbf84106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:22:41.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.238+0000 7fbf8b458640 1 -- 172.21.15.88:0/3172772989 shutdown_connections 2024-09-17T04:22:41.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.238+0000 7fbf8b458640 1 -- 172.21.15.88:0/3172772989 wait complete. 2024-09-17T04:22:41.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.357+0000 7f3290668640 1 -- 172.21.15.88:0/1230446691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3288101970 msgr2=0x7f3288101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:41.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.357+0000 7f3290668640 1 --2- 172.21.15.88:0/1230446691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3288101970 0x7f3288101d70 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f3284009880 tx=0x7f328402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:22:41.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.357+0000 7f3290668640 1 -- 172.21.15.88:0/1230446691 shutdown_connections 2024-09-17T04:22:41.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.357+0000 7f3290668640 1 --2- 172.21.15.88:0/1230446691 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3288102b70 0x7f3288102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:41.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.357+0000 7f3290668640 1 --2- 172.21.15.88:0/1230446691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3288101970 0x7f3288101d70 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:41.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.357+0000 7f3290668640 1 -- 172.21.15.88:0/1230446691 >> 172.21.15.88:0/1230446691 conn(0x7f32880fd140 msgr2=0x7f32880ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:22:41.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.358+0000 7f3290668640 1 -- 172.21.15.88:0/1230446691 shutdown_connections 2024-09-17T04:22:41.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.358+0000 7f3290668640 1 -- 172.21.15.88:0/1230446691 wait complete. 2024-09-17T04:22:41.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.358+0000 7f3290668640 1 Processor -- start 2024-09-17T04:22:41.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.359+0000 7f3290668640 1 -- start start 2024-09-17T04:22:41.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.359+0000 7f3290668640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3288101970 0x7f32881996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:22:41.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.359+0000 7f3290668640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3288102b70 0x7f3288199c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:22:41.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.359+0000 7f3290668640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f328810c9d0 con 0x7f3288102b70 2024-09-17T04:22:41.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.359+0000 7f3290668640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f328810c850 con 0x7f3288101970 2024-09-17T04:22:41.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.359+0000 7f328e404640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3288101970 0x7f32881996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:22:41.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.359+0000 7f328e404640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3288101970 0x7f32881996c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.88:58692/0 (socket says 172.21.15.88:58692) 2024-09-17T04:22:41.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.359+0000 7f328e404640 1 -- 172.21.15.88:0/3428284973 learned_addr learned my addr 172.21.15.88:0/3428284973 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:22:41.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.359+0000 7f328dc03640 1 --2- 172.21.15.88:0/3428284973 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3288102b70 0x7f3288199c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:22:41.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.360+0000 7f328dc03640 1 -- 172.21.15.88:0/3428284973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3288101970 msgr2=0x7f32881996c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:41.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.360+0000 7f328dc03640 1 --2- 172.21.15.88:0/3428284973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3288101970 0x7f32881996c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:41.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.360+0000 7f328dc03640 1 -- 172.21.15.88:0/3428284973 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f328819a280 con 0x7f3288102b70 2024-09-17T04:22:41.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.360+0000 7f328dc03640 1 --2- 172.21.15.88:0/3428284973 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3288102b70 0x7f3288199c00 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f327800e970 tx=0x7f327800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:22:41.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.361+0000 7f327f7fe640 1 -- 172.21.15.88:0/3428284973 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f327800cac0 con 0x7f3288102b70 2024-09-17T04:22:41.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.361+0000 7f327f7fe640 1 -- 172.21.15.88:0/3428284973 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f327800cc60 con 0x7f3288102b70 2024-09-17T04:22:41.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.361+0000 7f327f7fe640 1 -- 172.21.15.88:0/3428284973 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3278018720 con 0x7f3288102b70 2024-09-17T04:22:41.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.361+0000 7f3290668640 1 -- 172.21.15.88:0/3428284973 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f328806bcd0 con 0x7f3288102b70 2024-09-17T04:22:41.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.361+0000 7f3290668640 1 -- 172.21.15.88:0/3428284973 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f328806c260 con 0x7f3288102b70 2024-09-17T04:22:41.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.362+0000 7f3290668640 1 -- 172.21.15.88:0/3428284973 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3288101d70 con 0x7f3288102b70 2024-09-17T04:22:41.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.363+0000 7f327f7fe640 1 -- 172.21.15.88:0/3428284973 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 32) ==== 103422+0+0 (secure 0 0 0) 0x7f3278010430 con 0x7f3288102b70 2024-09-17T04:22:41.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.364+0000 7f327f7fe640 1 --2- 172.21.15.88:0/3428284973 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f327407b150 0x7f327407d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:22:41.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.364+0000 7f327f7fe640 1 -- 172.21.15.88:0/3428284973 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7f327809e580 con 0x7f3288102b70 2024-09-17T04:22:41.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.365+0000 7f328e404640 1 --2- 172.21.15.88:0/3428284973 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f327407b150 0x7f327407d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:22:41.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.366+0000 7f328e404640 1 --2- 172.21.15.88:0/3428284973 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f327407b150 0x7f327407d610 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f32840096c0 tx=0x7f328402a9a0 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:22:41.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.375+0000 7f327f7fe640 1 -- 172.21.15.88:0/3428284973 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f3278069ad0 con 0x7f3288102b70 2024-09-17T04:22:41.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.636+0000 7f3290668640 1 -- 172.21.15.88:0/3428284973 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3288062630 con 0x7f327407b150 2024-09-17T04:22:41.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.638+0000 7f327f7fe640 1 -- 172.21.15.88:0/3428284973 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+337 (secure 0 0 0) 0x7f3288062630 con 0x7f327407b150 2024-09-17T04:22:41.638 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-17T04:22:41.638 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f", 2024-09-17T04:22:41.638 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-09-17T04:22:41.638 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T04:22:41.638 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [ 2024-09-17T04:22:41.638 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr" 2024-09-17T04:22:41.638 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-17T04:22:41.638 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "2/23 daemons upgraded", 2024-09-17T04:22:41.638 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "", 2024-09-17T04:22:41.638 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-09-17T04:22:41.638 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-17T04:22:41.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.640+0000 7f3290668640 1 -- 172.21.15.88:0/3428284973 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f327407b150 msgr2=0x7f327407d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:41.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.640+0000 7f3290668640 1 --2- 172.21.15.88:0/3428284973 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f327407b150 0x7f327407d610 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f32840096c0 tx=0x7f328402a9a0 comp rx=0 tx=0).stop 2024-09-17T04:22:41.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.640+0000 7f3290668640 1 -- 172.21.15.88:0/3428284973 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3288102b70 msgr2=0x7f3288199c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:41.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.640+0000 7f3290668640 1 --2- 172.21.15.88:0/3428284973 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3288102b70 0x7f3288199c00 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f327800e970 tx=0x7f327800ee30 comp rx=0 tx=0).stop 2024-09-17T04:22:41.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.640+0000 7f3290668640 1 -- 172.21.15.88:0/3428284973 shutdown_connections 2024-09-17T04:22:41.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.640+0000 7f3290668640 1 --2- 172.21.15.88:0/3428284973 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f327407b150 0x7f327407d610 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:41.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.640+0000 7f3290668640 1 --2- 172.21.15.88:0/3428284973 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3288102b70 0x7f3288199c00 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:41.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.640+0000 7f3290668640 1 --2- 172.21.15.88:0/3428284973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3288101970 0x7f32881996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:41.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.640+0000 7f3290668640 1 -- 172.21.15.88:0/3428284973 >> 172.21.15.88:0/3428284973 conn(0x7f32880fd140 msgr2=0x7f3288106080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:22:41.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.640+0000 7f3290668640 1 -- 172.21.15.88:0/3428284973 shutdown_connections 2024-09-17T04:22:41.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.640+0000 7f3290668640 1 -- 172.21.15.88:0/3428284973 wait complete. 2024-09-17T04:22:41.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.745+0000 7fe7a0154640 1 -- 172.21.15.88:0/3112855148 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe798102450 msgr2=0x7fe798104840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:41.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.745+0000 7fe7a0154640 1 --2- 172.21.15.88:0/3112855148 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe798102450 0x7fe798104840 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe794009880 tx=0x7fe79402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:22:41.745 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:41 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/700477212' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T04:22:41.745 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:41 smithi088 ceph-mon[27811]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:22:41.745 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:41 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/3172772989' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T04:22:41.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.745+0000 7fe7a0154640 1 -- 172.21.15.88:0/3112855148 shutdown_connections 2024-09-17T04:22:41.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.745+0000 7fe7a0154640 1 --2- 172.21.15.88:0/3112855148 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe798104d80 0x7fe798107170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:41.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.745+0000 7fe7a0154640 1 --2- 172.21.15.88:0/3112855148 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe798102450 0x7fe798104840 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:41.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.745+0000 7fe7a0154640 1 -- 172.21.15.88:0/3112855148 >> 172.21.15.88:0/3112855148 conn(0x7fe7980fc010 msgr2=0x7fe7980fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:22:41.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.745+0000 7fe7a0154640 1 -- 172.21.15.88:0/3112855148 shutdown_connections 2024-09-17T04:22:41.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.745+0000 7fe7a0154640 1 -- 172.21.15.88:0/3112855148 wait complete. 2024-09-17T04:22:41.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.746+0000 7fe7a0154640 1 Processor -- start 2024-09-17T04:22:41.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.746+0000 7fe7a0154640 1 -- start start 2024-09-17T04:22:41.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.746+0000 7fe7a0154640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe798102450 0x7fe798197470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:22:41.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.746+0000 7fe7a0154640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe798104d80 0x7fe7981979b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:22:41.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.746+0000 7fe7a0154640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fe79810a770 con 0x7fe798104d80 2024-09-17T04:22:41.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.746+0000 7fe7a0154640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe79810a5f0 con 0x7fe798102450 2024-09-17T04:22:41.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.746+0000 7fe79d6ef640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe798104d80 0x7fe7981979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:22:41.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.746+0000 7fe79d6ef640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe798104d80 0x7fe7981979b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46284/0 (socket says 172.21.15.88:46284) 2024-09-17T04:22:41.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.746+0000 7fe79d6ef640 1 -- 172.21.15.88:0/3151659325 learned_addr learned my addr 172.21.15.88:0/3151659325 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:22:41.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.746+0000 7fe79def0640 1 --2- 172.21.15.88:0/3151659325 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe798102450 0x7fe798197470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:22:41.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.746+0000 7fe79d6ef640 1 -- 172.21.15.88:0/3151659325 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe798102450 msgr2=0x7fe798197470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:41.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.746+0000 7fe79d6ef640 1 --2- 172.21.15.88:0/3151659325 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe798102450 0x7fe798197470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:41.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.746+0000 7fe79d6ef640 1 -- 172.21.15.88:0/3151659325 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe798198030 con 0x7fe798104d80 2024-09-17T04:22:41.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.747+0000 7fe79d6ef640 1 --2- 172.21.15.88:0/3151659325 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe798104d80 0x7fe7981979b0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fe78800d6c0 tx=0x7fe78800db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:22:41.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.747+0000 7fe78effd640 1 -- 172.21.15.88:0/3151659325 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe788017070 con 0x7fe798104d80 2024-09-17T04:22:41.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.747+0000 7fe78effd640 1 -- 172.21.15.88:0/3151659325 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe7880054e0 con 0x7fe798104d80 2024-09-17T04:22:41.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.747+0000 7fe7a0154640 1 -- 172.21.15.88:0/3151659325 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe79819ca70 con 0x7fe798104d80 2024-09-17T04:22:41.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.747+0000 7fe78effd640 1 -- 172.21.15.88:0/3151659325 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe788004b70 con 0x7fe798104d80 2024-09-17T04:22:41.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.747+0000 7fe7a0154640 1 -- 172.21.15.88:0/3151659325 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe79819d000 con 0x7fe798104d80 2024-09-17T04:22:41.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.748+0000 7fe7a0154640 1 -- 172.21.15.88:0/3151659325 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe77c0052c0 con 0x7fe798104d80 2024-09-17T04:22:41.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.749+0000 7fe78effd640 1 -- 172.21.15.88:0/3151659325 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 32) ==== 103422+0+0 (secure 0 0 0) 0x7fe788004e30 con 0x7fe798104d80 2024-09-17T04:22:41.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.749+0000 7fe78effd640 1 --2- 172.21.15.88:0/3151659325 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe78407b050 0x7fe78407d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:22:41.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.749+0000 7fe78effd640 1 -- 172.21.15.88:0/3151659325 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7fe78809dd00 con 0x7fe798104d80 2024-09-17T04:22:41.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.749+0000 7fe79def0640 1 --2- 172.21.15.88:0/3151659325 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe78407b050 0x7fe78407d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:22:41.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.750+0000 7fe79def0640 1 --2- 172.21.15.88:0/3151659325 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe78407b050 0x7fe78407d510 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe794000c00 tx=0x7fe794005a20 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:22:41.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:41.755+0000 7fe78effd640 1 -- 172.21.15.88:0/3151659325 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7fe7880a1030 con 0x7fe798104d80 2024-09-17T04:22:41.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:41 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/700477212' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T04:22:41.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:41 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:22:41.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:41 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/3172772989' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T04:22:42.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:42.079+0000 7fe7a0154640 1 -- 172.21.15.88:0/3151659325 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fe77c005880 con 0x7fe798104d80 2024-09-17T04:22:42.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:42.080+0000 7fe78effd640 1 -- 172.21.15.88:0/3151659325 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7fe788069130 con 0x7fe798104d80 2024-09-17T04:22:42.080 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T04:22:42.080 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T04:22:42.081 INFO:teuthology.orchestra.run.smithi088.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T04:22:42.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:42.082+0000 7fe7a0154640 1 -- 172.21.15.88:0/3151659325 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe78407b050 msgr2=0x7fe78407d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:42.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:42.082+0000 7fe7a0154640 1 --2- 172.21.15.88:0/3151659325 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe78407b050 0x7fe78407d510 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe794000c00 tx=0x7fe794005a20 comp rx=0 tx=0).stop 2024-09-17T04:22:42.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:42.082+0000 7fe7a0154640 1 -- 172.21.15.88:0/3151659325 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe798104d80 msgr2=0x7fe7981979b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:22:42.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:42.082+0000 7fe7a0154640 1 --2- 172.21.15.88:0/3151659325 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe798104d80 0x7fe7981979b0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fe78800d6c0 tx=0x7fe78800db80 comp rx=0 tx=0).stop 2024-09-17T04:22:42.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:42.083+0000 7fe7a0154640 1 -- 172.21.15.88:0/3151659325 shutdown_connections 2024-09-17T04:22:42.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:42.083+0000 7fe7a0154640 1 --2- 172.21.15.88:0/3151659325 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe78407b050 0x7fe78407d510 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:42.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:42.083+0000 7fe7a0154640 1 --2- 172.21.15.88:0/3151659325 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe798104d80 0x7fe7981979b0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:42.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:42.083+0000 7fe7a0154640 1 --2- 172.21.15.88:0/3151659325 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe798102450 0x7fe798197470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:22:42.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:42.083+0000 7fe7a0154640 1 -- 172.21.15.88:0/3151659325 >> 172.21.15.88:0/3151659325 conn(0x7fe7980fc010 msgr2=0x7fe7980fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:22:42.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:42.083+0000 7fe7a0154640 1 -- 172.21.15.88:0/3151659325 shutdown_connections 2024-09-17T04:22:42.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:22:42.083+0000 7fe7a0154640 1 -- 172.21.15.88:0/3151659325 wait complete. 2024-09-17T04:22:42.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:42 smithi088 ceph-mon[27811]: from='client.14936 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:22:42.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:42 smithi088 ceph-mon[27811]: from='client.? 172.21.15.88:0/3151659325' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T04:22:42.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:42 smithi088 ceph-mon[27811]: pgmap v19: 65 pgs: 65 active+clean; 278 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 268 op/s 2024-09-17T04:22:42.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:42 smithi134 ceph-mon[35201]: from='client.14936 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:22:42.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:42 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/3151659325' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T04:22:42.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:42 smithi134 ceph-mon[35201]: pgmap v19: 65 pgs: 65 active+clean; 278 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 268 op/s 2024-09-17T04:22:44.771 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:44 smithi088 ceph-mon[27811]: pgmap v20: 65 pgs: 65 active+clean; 278 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 152 op/s 2024-09-17T04:22:44.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:44 smithi134 ceph-mon[35201]: pgmap v20: 65 pgs: 65 active+clean; 278 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 152 op/s 2024-09-17T04:22:46.115 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:45 smithi088 ceph-mon[27811]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:46.115 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:45 smithi088 ceph-mon[27811]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:46.115 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:45 smithi088 ceph-mon[27811]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T04:22:46.115 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:45 smithi088 ceph-mon[27811]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T04:22:46.115 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:45 smithi088 ceph-mon[27811]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:22:46.116 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-09-17T04:22:46.116 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-17T04:22:46.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:45 smithi134 ceph-mon[35201]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:46.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:45 smithi134 ceph-mon[35201]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:46.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:45 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T04:22:46.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:45 smithi134 ceph-mon[35201]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T04:22:46.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:45 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:22:46.453 DEBUG:teuthology.parallel:result is None 2024-09-17T04:22:46.453 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-17T04:22:46.483 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-17T04:22:46.484 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-09-17T04:22:46.518 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-09-17T04:22:46.519 DEBUG:teuthology.parallel:result is None 2024-09-17T04:22:47.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:46 smithi088 ceph-mon[27811]: Upgrade: Updating mgr.smithi134.vwdxcb 2024-09-17T04:22:47.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:46 smithi088 ceph-mon[27811]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.vwdxcb", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T04:22:47.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:46 smithi088 ceph-mon[27811]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.vwdxcb", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T04:22:47.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:46 smithi088 ceph-mon[27811]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T04:22:47.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:46 smithi088 ceph-mon[27811]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:22:47.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:46 smithi088 ceph-mon[27811]: Deploying daemon mgr.smithi134.vwdxcb on smithi134 2024-09-17T04:22:47.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:46 smithi088 ceph-mon[27811]: pgmap v21: 65 pgs: 65 active+clean; 277 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 191 op/s 2024-09-17T04:22:47.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:46 smithi134 ceph-mon[35201]: Upgrade: Updating mgr.smithi134.vwdxcb 2024-09-17T04:22:47.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:46 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.vwdxcb", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T04:22:47.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:46 smithi134 ceph-mon[35201]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.vwdxcb", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T04:22:47.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:46 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T04:22:47.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:46 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:22:47.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:46 smithi134 ceph-mon[35201]: Deploying daemon mgr.smithi134.vwdxcb on smithi134 2024-09-17T04:22:47.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:46 smithi134 ceph-mon[35201]: pgmap v21: 65 pgs: 65 active+clean; 277 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 191 op/s 2024-09-17T04:22:48.869 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:48 smithi134 ceph-mon[35201]: pgmap v22: 65 pgs: 65 active+clean; 278 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1006 KiB/s wr, 179 op/s 2024-09-17T04:22:48.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:48 smithi088 ceph-mon[27811]: pgmap v22: 65 pgs: 65 active+clean; 278 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1006 KiB/s wr, 179 op/s 2024-09-17T04:22:51.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:50 smithi088 ceph-mon[27811]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:51.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:50 smithi088 ceph-mon[27811]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:51.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:50 smithi088 ceph-mon[27811]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:22:51.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:50 smithi088 ceph-mon[27811]: pgmap v23: 65 pgs: 65 active+clean; 278 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1006 KiB/s wr, 163 op/s 2024-09-17T04:22:51.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:50 smithi134 ceph-mon[35201]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:51.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:50 smithi134 ceph-mon[35201]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:51.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:50 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:22:51.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:50 smithi134 ceph-mon[35201]: pgmap v23: 65 pgs: 65 active+clean; 278 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1006 KiB/s wr, 163 op/s 2024-09-17T04:22:52.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:52 smithi088 ceph-mon[27811]: pgmap v24: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 177 op/s 2024-09-17T04:22:52.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:52 smithi134 ceph-mon[35201]: pgmap v24: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 177 op/s 2024-09-17T04:22:54.385 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:54 smithi088 ceph-mon[27811]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:54.385 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:54 smithi088 ceph-mon[27811]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:54.386 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:54 smithi088 ceph-mon[27811]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:54.386 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:54 smithi088 ceph-mon[27811]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:54.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:54 smithi134 ceph-mon[35201]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:54.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:54 smithi134 ceph-mon[35201]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:54.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:54 smithi134 ceph-mon[35201]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:54.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:54 smithi134 ceph-mon[35201]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:55.303 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:55 smithi134 ceph-mon[35201]: pgmap v25: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 553 KiB/s rd, 534 KiB/s wr, 89 op/s 2024-09-17T04:22:55.303 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:55 smithi134 ceph-mon[35201]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:55.303 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:55 smithi134 ceph-mon[35201]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:55.303 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:55 smithi134 ceph-mon[35201]: Standby manager daemon smithi134.vwdxcb restarted 2024-09-17T04:22:55.303 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:55 smithi134 ceph-mon[35201]: Standby manager daemon smithi134.vwdxcb started 2024-09-17T04:22:55.303 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:55 smithi134 ceph-mon[35201]: from='mgr.? 172.21.15.134:0/2937175347' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.vwdxcb/crt"}]: dispatch 2024-09-17T04:22:55.304 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:55 smithi134 ceph-mon[35201]: from='mgr.? 172.21.15.134:0/2937175347' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T04:22:55.304 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:55 smithi134 ceph-mon[35201]: from='mgr.? 172.21.15.134:0/2937175347' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.vwdxcb/key"}]: dispatch 2024-09-17T04:22:55.304 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:55 smithi134 ceph-mon[35201]: from='mgr.? 172.21.15.134:0/2937175347' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T04:22:55.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:55 smithi088 ceph-mon[27811]: pgmap v25: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 553 KiB/s rd, 534 KiB/s wr, 89 op/s 2024-09-17T04:22:55.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:55 smithi088 ceph-mon[27811]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:55.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:55 smithi088 ceph-mon[27811]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:55.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:55 smithi088 ceph-mon[27811]: Standby manager daemon smithi134.vwdxcb restarted 2024-09-17T04:22:55.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:55 smithi088 ceph-mon[27811]: Standby manager daemon smithi134.vwdxcb started 2024-09-17T04:22:55.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:55 smithi088 ceph-mon[27811]: from='mgr.? 172.21.15.134:0/2937175347' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.vwdxcb/crt"}]: dispatch 2024-09-17T04:22:55.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:55 smithi088 ceph-mon[27811]: from='mgr.? 172.21.15.134:0/2937175347' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T04:22:55.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:55 smithi088 ceph-mon[27811]: from='mgr.? 172.21.15.134:0/2937175347' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.vwdxcb/key"}]: dispatch 2024-09-17T04:22:55.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:55 smithi088 ceph-mon[27811]: from='mgr.? 172.21.15.134:0/2937175347' entity='mgr.smithi134.vwdxcb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T04:22:57.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:56 smithi088 ceph-mon[27811]: mgrmap e33: smithi088.wmndiv(active, since 45s), standbys: smithi134.vwdxcb 2024-09-17T04:22:57.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:56 smithi088 ceph-mon[27811]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:22:57.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:56 smithi088 ceph-mon[27811]: pgmap v26: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 553 KiB/s rd, 534 KiB/s wr, 91 op/s 2024-09-17T04:22:57.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:56 smithi134 ceph-mon[35201]: mgrmap e33: smithi088.wmndiv(active, since 45s), standbys: smithi134.vwdxcb 2024-09-17T04:22:57.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:56 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:22:57.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:56 smithi134 ceph-mon[35201]: pgmap v26: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 553 KiB/s rd, 534 KiB/s wr, 91 op/s 2024-09-17T04:22:58.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:58 smithi088 ceph-mon[27811]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:58.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:58 smithi088 ceph-mon[27811]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:58.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:58 smithi088 ceph-mon[27811]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:22:58.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:58 smithi088 ceph-mon[27811]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:22:58.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:58 smithi088 ceph-mon[27811]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:58.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:58 smithi088 ceph-mon[27811]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:22:58.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:58 smithi088 ceph-mon[27811]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T04:22:58.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:58 smithi088 ceph-mon[27811]: Upgrade: Setting container_image for all mgr 2024-09-17T04:22:58.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:58 smithi088 ceph-mon[27811]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:58.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:58 smithi088 ceph-mon[27811]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi088.wmndiv"}]: dispatch 2024-09-17T04:22:58.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:58 smithi088 ceph-mon[27811]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi088.wmndiv"}]: dispatch 2024-09-17T04:22:58.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:58 smithi088 ceph-mon[27811]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi088.wmndiv"}]': finished 2024-09-17T04:22:58.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:58 smithi088 ceph-mon[27811]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi134.vwdxcb"}]: dispatch 2024-09-17T04:22:58.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:58 smithi088 ceph-mon[27811]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi134.vwdxcb"}]: dispatch 2024-09-17T04:22:58.639 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:58 smithi088 ceph-mon[27811]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi134.vwdxcb"}]': finished 2024-09-17T04:22:58.639 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:58 smithi088 ceph-mon[27811]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-17T04:22:58.639 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:22:58 smithi088 ceph-mon[27811]: pgmap v27: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 307 KiB/s rd, 311 KiB/s wr, 52 op/s 2024-09-17T04:22:58.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:58 smithi134 ceph-mon[35201]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:58.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:58 smithi134 ceph-mon[35201]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:58.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:58 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:22:58.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:58 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:22:58.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:58 smithi134 ceph-mon[35201]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:58.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:58 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:22:58.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:58 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T04:22:58.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:58 smithi134 ceph-mon[35201]: Upgrade: Setting container_image for all mgr 2024-09-17T04:22:58.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:58 smithi134 ceph-mon[35201]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:22:58.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:58 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi088.wmndiv"}]: dispatch 2024-09-17T04:22:58.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:58 smithi134 ceph-mon[35201]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi088.wmndiv"}]: dispatch 2024-09-17T04:22:58.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:58 smithi134 ceph-mon[35201]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi088.wmndiv"}]': finished 2024-09-17T04:22:58.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:58 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi134.vwdxcb"}]: dispatch 2024-09-17T04:22:58.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:58 smithi134 ceph-mon[35201]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi134.vwdxcb"}]: dispatch 2024-09-17T04:22:58.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:58 smithi134 ceph-mon[35201]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi134.vwdxcb"}]': finished 2024-09-17T04:22:58.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:58 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-17T04:22:58.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:22:58 smithi134 ceph-mon[35201]: pgmap v27: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 307 KiB/s rd, 311 KiB/s wr, 52 op/s 2024-09-17T04:23:00.319 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:00 smithi088 ceph-mon[27811]: Upgrade: Updating mon.smithi088 2024-09-17T04:23:00.319 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:00 smithi088 ceph-mon[27811]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:00.319 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:00 smithi088 ceph-mon[27811]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T04:23:00.319 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:00 smithi088 ceph-mon[27811]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T04:23:00.320 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:00 smithi088 ceph-mon[27811]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:23:00.320 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:00 smithi088 ceph-mon[27811]: Deploying daemon mon.smithi088 on smithi088 2024-09-17T04:23:00.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:00 smithi134 ceph-mon[35201]: Upgrade: Updating mon.smithi088 2024-09-17T04:23:00.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:00 smithi134 ceph-mon[35201]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:00.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:00 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T04:23:00.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:00 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T04:23:00.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:00 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:23:00.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:00 smithi134 ceph-mon[35201]: Deploying daemon mon.smithi088 on smithi088 2024-09-17T04:23:00.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:00 smithi088 systemd[1]: Stopping Ceph mon.smithi088 for bf2b79a4-74aa-11ef-bceb-c7b262605968... 2024-09-17T04:23:01.192 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:00 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-mon-smithi088[27807]: 2024-09-17T04:23:00.917+0000 7f699ed3f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi088 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T04:23:01.192 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:00 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-mon-smithi088[27807]: 2024-09-17T04:23:00.917+0000 7f699ed3f640 -1 mon.smithi088@0(leader) e2 *** Got Signal Terminated *** 2024-09-17T04:23:01.192 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:00 smithi088 podman[90706]: 2024-09-17 04:23:00.939100948 +0000 UTC m=+0.182604851 container died bbeb722f42bcd0d13e6217f8943f7e6fd8a8b06d1e68f8040ba46456b56fa8cc (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-mon-smithi088, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T04:23:01.575 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:01 smithi088 podman[90706]: 2024-09-17 04:23:01.374760722 +0000 UTC m=+0.618264624 container cleanup bbeb722f42bcd0d13e6217f8943f7e6fd8a8b06d1e68f8040ba46456b56fa8cc (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-mon-smithi088, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-17T04:23:01.576 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:01 smithi088 bash[90706]: ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-mon-smithi088 2024-09-17T04:23:01.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:01 smithi088 podman[90721]: 2024-09-17 04:23:01.576344826 +0000 UTC m=+0.635261301 container remove bbeb722f42bcd0d13e6217f8943f7e6fd8a8b06d1e68f8040ba46456b56fa8cc (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-mon-smithi088, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-17T04:23:01.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:01 smithi088 systemd[1]: ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968@mon.smithi088.service: Deactivated successfully. 2024-09-17T04:23:01.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:01 smithi088 systemd[1]: Stopped Ceph mon.smithi088 for bf2b79a4-74aa-11ef-bceb-c7b262605968. 2024-09-17T04:23:01.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:01 smithi088 systemd[1]: ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968@mon.smithi088.service: Consumed 11.532s CPU time. 2024-09-17T04:23:02.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 systemd[1]: Starting Ceph mon.smithi088 for bf2b79a4-74aa-11ef-bceb-c7b262605968... 2024-09-17T04:23:02.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 podman[90847]: 2024-09-17 04:23:02.115260469 +0000 UTC m=+0.015622848 image pull 8e039cb7fe1eece5854872e8884a61a26632c7691b2c85cbac9078a9c5c62fae quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f 2024-09-17T04:23:02.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 podman[90847]: 2024-09-17 04:23:02.244369672 +0000 UTC m=+0.144732094 container create ac633201524324e2e5e02f45811dcee645315fac8c42db84b0efb9afce5e27c6 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-mon-smithi088, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-17T04:23:02.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 podman[90847]: 2024-09-17 04:23:02.671903289 +0000 UTC m=+0.572265689 container init ac633201524324e2e5e02f45811dcee645315fac8c42db84b0efb9afce5e27c6 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-mon-smithi088, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-17T04:23:02.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 podman[90847]: 2024-09-17 04:23:02.675213209 +0000 UTC m=+0.575575592 container start ac633201524324e2e5e02f45811dcee645315fac8c42db84b0efb9afce5e27c6 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-mon-smithi088, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T04:23:02.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: set uid:gid to 167:167 (ceph:ceph) 2024-09-17T04:23:02.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev), process ceph-mon, pid 2 2024-09-17T04:23:02.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: pidfile_write: ignore empty --pid-file 2024-09-17T04:23:02.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: load: jerasure load: lrc 2024-09-17T04:23:02.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: RocksDB version: 7.9.2 2024-09-17T04:23:02.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Git sha 0 2024-09-17T04:23:02.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Compile date 2024-09-17 00:23:36 2024-09-17T04:23:02.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: DB SUMMARY 2024-09-17T04:23:02.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: DB Session ID: TZNHOYHVDD2PCOBB96UO 2024-09-17T04:23:02.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: CURRENT file: CURRENT 2024-09-17T04:23:02.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: IDENTITY file: IDENTITY 2024-09-17T04:23:02.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1265 Bytes 2024-09-17T04:23:02.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi088/store.db dir, Total Num: 1, files: 000029.sst 2024-09-17T04:23:02.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi088/store.db: 000027.log size: 3259819 ; 2024-09-17T04:23:02.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.error_if_exists: 0 2024-09-17T04:23:02.890 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.create_if_missing: 0 2024-09-17T04:23:02.890 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.paranoid_checks: 1 2024-09-17T04:23:02.890 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-17T04:23:02.890 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-17T04:23:02.890 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-17T04:23:02.890 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.env: 0x560584368d60 2024-09-17T04:23:02.890 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.fs: PosixFileSystem 2024-09-17T04:23:02.890 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.info_log: 0x560589ff5580 2024-09-17T04:23:02.890 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.max_file_opening_threads: 16 2024-09-17T04:23:02.890 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.statistics: (nil) 2024-09-17T04:23:02.890 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.use_fsync: 0 2024-09-17T04:23:02.890 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.max_log_file_size: 0 2024-09-17T04:23:02.890 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-17T04:23:02.890 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-17T04:23:02.891 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.keep_log_file_num: 1000 2024-09-17T04:23:02.891 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.recycle_log_file_num: 0 2024-09-17T04:23:02.891 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.allow_fallocate: 1 2024-09-17T04:23:02.891 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.allow_mmap_reads: 0 2024-09-17T04:23:02.891 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.allow_mmap_writes: 0 2024-09-17T04:23:02.891 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.use_direct_reads: 0 2024-09-17T04:23:02.891 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-17T04:23:02.891 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.create_missing_column_families: 0 2024-09-17T04:23:02.891 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.db_log_dir: 2024-09-17T04:23:02.891 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.wal_dir: 2024-09-17T04:23:02.891 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-17T04:23:02.891 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-17T04:23:02.891 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-17T04:23:02.892 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-17T04:23:02.892 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-17T04:23:02.892 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-17T04:23:02.892 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.advise_random_on_open: 1 2024-09-17T04:23:02.892 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.db_write_buffer_size: 0 2024-09-17T04:23:02.892 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.write_buffer_manager: 0x560589ff9d60 2024-09-17T04:23:02.892 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-17T04:23:02.892 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-17T04:23:02.892 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-17T04:23:02.892 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.rate_limiter: (nil) 2024-09-17T04:23:02.892 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-17T04:23:02.892 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.wal_recovery_mode: 2 2024-09-17T04:23:02.892 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.enable_thread_tracking: 0 2024-09-17T04:23:02.892 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.enable_pipelined_write: 0 2024-09-17T04:23:02.893 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.unordered_write: 0 2024-09-17T04:23:02.893 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-17T04:23:02.893 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-17T04:23:02.893 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-17T04:23:02.893 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-17T04:23:02.893 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.row_cache: None 2024-09-17T04:23:02.893 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.wal_filter: None 2024-09-17T04:23:02.894 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-17T04:23:02.894 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.allow_ingest_behind: 0 2024-09-17T04:23:02.894 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.two_write_queues: 0 2024-09-17T04:23:02.895 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.manual_wal_flush: 0 2024-09-17T04:23:02.895 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.wal_compression: 0 2024-09-17T04:23:02.895 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.atomic_flush: 0 2024-09-17T04:23:02.895 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-17T04:23:02.895 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-17T04:23:02.895 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-17T04:23:02.895 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.log_readahead_size: 0 2024-09-17T04:23:02.895 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-17T04:23:02.896 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.best_efforts_recovery: 0 2024-09-17T04:23:02.896 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-17T04:23:02.896 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-17T04:23:02.896 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.allow_data_in_errors: 0 2024-09-17T04:23:02.896 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.db_host_id: __hostname__ 2024-09-17T04:23:02.896 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-17T04:23:02.896 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.max_background_jobs: 2 2024-09-17T04:23:02.896 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.max_background_compactions: -1 2024-09-17T04:23:02.896 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.max_subcompactions: 1 2024-09-17T04:23:02.896 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-17T04:23:02.897 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-17T04:23:02.897 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-17T04:23:02.897 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.max_total_wal_size: 0 2024-09-17T04:23:02.897 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-17T04:23:02.897 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-17T04:23:02.897 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-17T04:23:02.897 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-17T04:23:02.897 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.max_open_files: -1 2024-09-17T04:23:02.897 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.bytes_per_sync: 0 2024-09-17T04:23:02.897 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-17T04:23:02.897 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-17T04:23:02.897 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.compaction_readahead_size: 0 2024-09-17T04:23:02.897 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.max_background_flushes: -1 2024-09-17T04:23:02.898 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Compression algorithms supported: 2024-09-17T04:23:02.898 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: kZSTD supported: 0 2024-09-17T04:23:02.898 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: kXpressCompression supported: 0 2024-09-17T04:23:02.898 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: kBZip2Compression supported: 0 2024-09-17T04:23:02.898 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-17T04:23:02.898 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: kLZ4Compression supported: 1 2024-09-17T04:23:02.898 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: kZlibCompression supported: 1 2024-09-17T04:23:02.898 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: kLZ4HCCompression supported: 1 2024-09-17T04:23:02.898 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: kSnappyCompression supported: 1 2024-09-17T04:23:02.898 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-17T04:23:02.898 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-17T04:23:02.898 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi088/store.db/MANIFEST-000015 2024-09-17T04:23:02.898 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-17T04:23:02.899 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-17T04:23:02.899 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.merge_operator: 2024-09-17T04:23:02.899 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.compaction_filter: None 2024-09-17T04:23:02.899 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.compaction_filter_factory: None 2024-09-17T04:23:02.899 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.sst_partitioner_factory: None 2024-09-17T04:23:02.899 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-17T04:23:02.899 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-17T04:23:02.899 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x560589ff51a0) 2024-09-17T04:23:02.899 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: cache_index_and_filter_blocks: 1 2024-09-17T04:23:02.899 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-17T04:23:02.899 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-17T04:23:02.899 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: pin_top_level_index_and_filter: 1 2024-09-17T04:23:02.899 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: index_type: 0 2024-09-17T04:23:02.899 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: data_block_index_type: 0 2024-09-17T04:23:02.900 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: index_shortening: 1 2024-09-17T04:23:02.900 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-17T04:23:02.900 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: checksum: 4 2024-09-17T04:23:02.900 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: no_block_cache: 0 2024-09-17T04:23:02.900 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: block_cache: 0x560585fb9610 2024-09-17T04:23:02.900 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: block_cache_name: BinnedLRUCache 2024-09-17T04:23:02.900 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: block_cache_options: 2024-09-17T04:23:02.900 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: capacity : 536870912 2024-09-17T04:23:02.900 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: num_shard_bits : 4 2024-09-17T04:23:02.900 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: strict_capacity_limit : 0 2024-09-17T04:23:02.900 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: high_pri_pool_ratio: 0.000 2024-09-17T04:23:02.900 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: block_cache_compressed: (nil) 2024-09-17T04:23:02.900 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: persistent_cache: (nil) 2024-09-17T04:23:02.901 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: block_size: 4096 2024-09-17T04:23:02.901 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: block_size_deviation: 10 2024-09-17T04:23:02.901 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: block_restart_interval: 16 2024-09-17T04:23:02.901 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: index_block_restart_interval: 1 2024-09-17T04:23:02.901 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: metadata_block_size: 4096 2024-09-17T04:23:02.901 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: partition_filters: 0 2024-09-17T04:23:02.901 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: use_delta_encoding: 1 2024-09-17T04:23:02.901 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: filter_policy: bloomfilter 2024-09-17T04:23:02.901 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: whole_key_filtering: 1 2024-09-17T04:23:02.901 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: verify_compression: 0 2024-09-17T04:23:02.901 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: read_amp_bytes_per_bit: 0 2024-09-17T04:23:02.901 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: format_version: 5 2024-09-17T04:23:02.901 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: enable_index_compression: 1 2024-09-17T04:23:02.901 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: block_align: 0 2024-09-17T04:23:02.902 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: max_auto_readahead_size: 262144 2024-09-17T04:23:02.902 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: prepopulate_block_cache: 0 2024-09-17T04:23:02.902 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: initial_auto_readahead_size: 8192 2024-09-17T04:23:02.902 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: num_file_reads_for_auto_readahead: 2 2024-09-17T04:23:02.902 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.write_buffer_size: 33554432 2024-09-17T04:23:02.902 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.max_write_buffer_number: 2 2024-09-17T04:23:02.902 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.compression: NoCompression 2024-09-17T04:23:02.902 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.bottommost_compression: Disabled 2024-09-17T04:23:02.902 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.prefix_extractor: nullptr 2024-09-17T04:23:02.902 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-17T04:23:02.902 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.num_levels: 7 2024-09-17T04:23:02.902 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-17T04:23:02.902 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-17T04:23:02.903 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-17T04:23:02.903 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-17T04:23:02.903 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-17T04:23:02.903 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-17T04:23:02.903 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-17T04:23:02.903 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-17T04:23:02.903 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-17T04:23:02.903 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-17T04:23:02.903 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-17T04:23:02.903 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-17T04:23:02.904 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-17T04:23:02.904 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.compression_opts.level: 32767 2024-09-17T04:23:02.904 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.compression_opts.strategy: 0 2024-09-17T04:23:02.904 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-17T04:23:02.904 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-17T04:23:02.904 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-17T04:23:02.904 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-17T04:23:02.905 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.compression_opts.enabled: false 2024-09-17T04:23:02.905 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-17T04:23:02.905 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-17T04:23:02.905 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-17T04:23:02.905 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-17T04:23:02.905 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.target_file_size_base: 67108864 2024-09-17T04:23:02.905 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-17T04:23:02.905 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-17T04:23:02.905 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-17T04:23:02.905 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-17T04:23:02.905 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-17T04:23:02.905 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-17T04:23:02.906 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-17T04:23:02.906 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-17T04:23:02.906 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-17T04:23:02.906 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-17T04:23:02.906 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-17T04:23:02.906 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-17T04:23:02.906 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-17T04:23:02.906 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-17T04:23:02.906 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.arena_block_size: 1048576 2024-09-17T04:23:02.907 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-17T04:23:02.907 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-17T04:23:02.907 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.disable_auto_compactions: 0 2024-09-17T04:23:02.907 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-17T04:23:02.907 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-17T04:23:02.907 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-17T04:23:02.907 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-17T04:23:02.907 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-17T04:23:02.907 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-17T04:23:02.907 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-17T04:23:02.908 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-17T04:23:02.908 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-17T04:23:02.908 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-17T04:23:02.908 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-17T04:23:02.908 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.inplace_update_support: 0 2024-09-17T04:23:02.908 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-17T04:23:02.908 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-17T04:23:02.908 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-17T04:23:02.908 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-17T04:23:02.908 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.bloom_locality: 0 2024-09-17T04:23:02.908 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.max_successive_merges: 0 2024-09-17T04:23:02.908 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-17T04:23:02.909 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.paranoid_file_checks: 0 2024-09-17T04:23:02.909 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.force_consistency_checks: 1 2024-09-17T04:23:02.909 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.report_bg_io_stats: 0 2024-09-17T04:23:02.909 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.ttl: 2592000 2024-09-17T04:23:02.909 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-17T04:23:02.909 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-17T04:23:02.909 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-17T04:23:02.909 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.enable_blob_files: false 2024-09-17T04:23:02.909 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.min_blob_size: 0 2024-09-17T04:23:02.909 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.blob_file_size: 268435456 2024-09-17T04:23:02.909 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-17T04:23:02.909 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-17T04:23:02.909 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-17T04:23:02.909 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-17T04:23:02.910 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-17T04:23:02.910 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.blob_file_starting_level: 0 2024-09-17T04:23:02.910 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-17T04:23:02.910 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-17T04:23:02.910 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi088/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 31, last_sequence is 10486, log_number is 27,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 27 2024-09-17T04:23:02.910 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 27 2024-09-17T04:23:02.910 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 2e427fae-164b-4a81-bc04-59a083d43a88 2024-09-17T04:23:02.910 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726546982711399, "job": 1, "event": "recovery_started", "wal_files": [27]} 2024-09-17T04:23:02.910 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #27 mode 2 2024-09-17T04:23:02.910 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726546982721412, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 32, "file_size": 2991010, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 10487, "largest_seqno": 11784, "table_properties": {"data_size": 2984087, "index_size": 4406, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1477, "raw_key_size": 13263, "raw_average_key_size": 22, "raw_value_size": 2971235, "raw_average_value_size": 5131, "num_data_blocks": 201, "num_entries": 579, "num_filter_entries": 579, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726546982, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "2e427fae-164b-4a81-bc04-59a083d43a88", "db_session_id": "TZNHOYHVDD2PCOBB96UO", "orig_file_number": 32, "seqno_to_time_mapping": "N/A"}} 2024-09-17T04:23:02.910 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726546982721551, "job": 1, "event": "recovery_finished"} 2024-09-17T04:23:02.910 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: [db/version_set.cc:5047] Creating manifest 34 2024-09-17T04:23:02.910 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-17T04:23:02.911 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi088/store.db/000027.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-17T04:23:02.911 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56058a018a80 2024-09-17T04:23:02.911 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: DB pointer 0x56058adbe000 2024-09-17T04:23:02.911 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-17T04:23:02.911 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-17T04:23:02.911 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: ** DB Stats ** 2024-09-17T04:23:02.911 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T04:23:02.911 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-17T04:23:02.911 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T04:23:02.911 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T04:23:02.911 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-17T04:23:02.911 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T04:23:02.911 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T04:23:02.912 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: 2024-09-17T04:23:02.912 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: ** Compaction Stats [default] ** 2024-09-17T04:23:02.912 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T04:23:02.912 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-17T04:23:02.912 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: L0 1/0 2.85 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 630.8 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-09-17T04:23:02.912 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: L6 1/0 5.61 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-17T04:23:02.912 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Sum 2/0 8.46 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 630.8 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-09-17T04:23:02.912 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 630.8 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-09-17T04:23:02.912 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: 2024-09-17T04:23:02.912 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: ** Compaction Stats [default] ** 2024-09-17T04:23:02.912 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T04:23:02.912 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-17T04:23:02.912 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 630.8 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-09-17T04:23:02.912 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: 2024-09-17T04:23:02.913 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-17T04:23:02.913 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: 2024-09-17T04:23:02.913 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T04:23:02.913 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Flush(GB): cumulative 0.003, interval 0.003 2024-09-17T04:23:02.913 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-17T04:23:02.913 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-17T04:23:02.913 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-17T04:23:02.913 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-17T04:23:02.913 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Cumulative compaction: 0.00 GB write, 171.10 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T04:23:02.913 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Interval compaction: 0.00 GB write, 171.10 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T04:23:02.913 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-17T04:23:02.913 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Block cache BinnedLRUCache@0x560585fb9610#2 capacity: 512.00 MB usage: 6.12 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-17T04:23:02.913 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.54 KB,0.000293553%) IndexBlock(1,4.58 KB,0.000873208%) Misc(1,0.00 KB,0%) 2024-09-17T04:23:02.914 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: 2024-09-17T04:23:02.914 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-17T04:23:02.914 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: starting mon.smithi088 rank 0 at public addrs [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] at bind addrs [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi088 fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 2024-09-17T04:23:02.914 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: mon.smithi088@-1(???) e2 preinit fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 2024-09-17T04:23:02.914 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: mon.smithi088@-1(???).mds e15 new map 2024-09-17T04:23:02.914 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: mon.smithi088@-1(???).mds e15 print_map 2024-09-17T04:23:02.914 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: e15 2024-09-17T04:23:02.914 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: btime 2024-09-17T04:18:27:750910+0000 2024-09-17T04:23:02.914 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T04:23:02.914 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:23:02.914 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: legacy client fscid: 1 2024-09-17T04:23:02.914 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: 2024-09-17T04:23:02.914 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Filesystem 'cephfs' (1) 2024-09-17T04:23:02.915 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: fs_name cephfs 2024-09-17T04:23:02.915 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: epoch 15 2024-09-17T04:23:02.915 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T04:23:02.915 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: created 2024-09-17T04:18:10.480573+0000 2024-09-17T04:23:02.915 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: modified 2024-09-17T04:18:27.750896+0000 2024-09-17T04:23:02.915 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: tableserver 0 2024-09-17T04:23:02.915 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: root 0 2024-09-17T04:23:02.915 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: session_timeout 60 2024-09-17T04:23:02.915 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: session_autoclose 300 2024-09-17T04:23:02.915 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: max_file_size 1099511627776 2024-09-17T04:23:02.915 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: max_xattr_size 65536 2024-09-17T04:23:02.915 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: required_client_features {} 2024-09-17T04:23:02.915 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: last_failure 0 2024-09-17T04:23:02.916 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: last_failure_osd_epoch 45 2024-09-17T04:23:02.916 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:23:02.916 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: max_mds 1 2024-09-17T04:23:02.916 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: in 0 2024-09-17T04:23:02.916 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: up {0=14590} 2024-09-17T04:23:02.916 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: failed 2024-09-17T04:23:02.916 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: damaged 2024-09-17T04:23:02.916 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: stopped 2024-09-17T04:23:02.916 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: data_pools [3] 2024-09-17T04:23:02.916 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: metadata_pool 2 2024-09-17T04:23:02.916 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: inline_data enabled 2024-09-17T04:23:02.916 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: balancer 2024-09-17T04:23:02.916 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: bal_rank_mask -1 2024-09-17T04:23:02.916 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: standby_count_wanted 1 2024-09-17T04:23:02.917 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: qdb_cluster leader: 14590 members: 14590 2024-09-17T04:23:02.917 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: [mds.cephfs.smithi088.giqrgt{0:14590} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.88:6828/1714846518,v1:172.21.15.88:6829/1714846518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:23:02.917 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: [mds.cephfs.smithi134.psnynp{0:24321} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.134:6826/2137586894,v1:172.21.15.134:6827/2137586894] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:23:02.917 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: 2024-09-17T04:23:02.917 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: 2024-09-17T04:23:02.917 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Standby daemons: 2024-09-17T04:23:02.917 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: 2024-09-17T04:23:02.917 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: [mds.cephfs.smithi134.ktuhce{-1:24325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/967997022,v1:172.21.15.134:6825/967997022] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:23:02.917 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: [mds.cephfs.smithi088.lgavsv{-1:24329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/1425146180,v1:172.21.15.88:6827/1425146180] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:23:02.917 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: mon.smithi088@-1(???).osd e47 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-17T04:23:02.917 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: mon.smithi088@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-17T04:23:02.917 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: mon.smithi088@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-17T04:23:02.917 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: mon.smithi088@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-17T04:23:02.917 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 ceph-mon[90867]: mon.smithi088@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2024-09-17T04:23:02.918 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 bash[90847]: ac633201524324e2e5e02f45811dcee645315fac8c42db84b0efb9afce5e27c6 2024-09-17T04:23:02.918 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:02 smithi088 systemd[1]: Started Ceph mon.smithi088 for bf2b79a4-74aa-11ef-bceb-c7b262605968. 2024-09-17T04:23:04.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:04 smithi088 ceph-mon[90867]: pgmap v29: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 36 KiB/s rd, 36 KiB/s wr, 16 op/s 2024-09-17T04:23:04.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:04 smithi088 ceph-mon[90867]: mon.smithi088 calling monitor election 2024-09-17T04:23:04.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:04 smithi088 ceph-mon[90867]: mon.smithi088 is new leader, mons smithi088,smithi134 in quorum (ranks 0,1) 2024-09-17T04:23:04.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:04 smithi088 ceph-mon[90867]: monmap epoch 2 2024-09-17T04:23:04.639 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:04 smithi088 ceph-mon[90867]: fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 2024-09-17T04:23:04.639 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:04 smithi088 ceph-mon[90867]: last_changed 2024-09-17T04:13:45.364213+0000 2024-09-17T04:23:04.639 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:04 smithi088 ceph-mon[90867]: created 2024-09-17T04:11:18.564226+0000 2024-09-17T04:23:04.639 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:04 smithi088 ceph-mon[90867]: min_mon_release 19 (squid) 2024-09-17T04:23:04.639 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:04 smithi088 ceph-mon[90867]: election_strategy: 1 2024-09-17T04:23:04.639 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:04 smithi088 ceph-mon[90867]: 0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.smithi088 2024-09-17T04:23:04.640 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:04 smithi088 ceph-mon[90867]: 1: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.smithi134 2024-09-17T04:23:04.640 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:04 smithi088 ceph-mon[90867]: fsmap cephfs:1 {0=cephfs.smithi088.giqrgt=up:active} 1 up:standby-replay 2 up:standby 2024-09-17T04:23:04.640 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:04 smithi088 ceph-mon[90867]: osdmap e47: 6 total, 6 up, 6 in 2024-09-17T04:23:04.640 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:04 smithi088 ceph-mon[90867]: mgrmap e33: smithi088.wmndiv(active, since 53s), standbys: smithi134.vwdxcb 2024-09-17T04:23:04.640 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:04 smithi088 ceph-mon[90867]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T04:23:04.641 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:04 smithi088 ceph-mon[90867]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T04:23:04.641 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:04 smithi088 ceph-mon[90867]: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T04:23:04.641 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:04 smithi088 ceph-mon[90867]: from='mgr.14858 ' entity='' 2024-09-17T04:23:04.641 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:04 smithi088 ceph-mon[90867]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:04.641 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:04 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:23:04.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:04 smithi134 ceph-mon[35201]: pgmap v29: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 36 KiB/s rd, 36 KiB/s wr, 16 op/s 2024-09-17T04:23:04.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:04 smithi134 ceph-mon[35201]: mon.smithi088 calling monitor election 2024-09-17T04:23:04.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:04 smithi134 ceph-mon[35201]: mon.smithi088 is new leader, mons smithi088,smithi134 in quorum (ranks 0,1) 2024-09-17T04:23:04.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:04 smithi134 ceph-mon[35201]: monmap epoch 2 2024-09-17T04:23:04.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:04 smithi134 ceph-mon[35201]: fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 2024-09-17T04:23:04.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:04 smithi134 ceph-mon[35201]: last_changed 2024-09-17T04:13:45.364213+0000 2024-09-17T04:23:04.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:04 smithi134 ceph-mon[35201]: created 2024-09-17T04:11:18.564226+0000 2024-09-17T04:23:04.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:04 smithi134 ceph-mon[35201]: min_mon_release 19 (squid) 2024-09-17T04:23:04.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:04 smithi134 ceph-mon[35201]: election_strategy: 1 2024-09-17T04:23:04.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:04 smithi134 ceph-mon[35201]: 0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.smithi088 2024-09-17T04:23:04.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:04 smithi134 ceph-mon[35201]: 1: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.smithi134 2024-09-17T04:23:04.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:04 smithi134 ceph-mon[35201]: fsmap cephfs:1 {0=cephfs.smithi088.giqrgt=up:active} 1 up:standby-replay 2 up:standby 2024-09-17T04:23:04.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:04 smithi134 ceph-mon[35201]: osdmap e47: 6 total, 6 up, 6 in 2024-09-17T04:23:04.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:04 smithi134 ceph-mon[35201]: mgrmap e33: smithi088.wmndiv(active, since 53s), standbys: smithi134.vwdxcb 2024-09-17T04:23:04.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:04 smithi134 ceph-mon[35201]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T04:23:04.649 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:04 smithi134 ceph-mon[35201]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T04:23:04.649 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:04 smithi134 ceph-mon[35201]: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T04:23:04.649 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:04 smithi134 ceph-mon[35201]: from='mgr.14858 ' entity='' 2024-09-17T04:23:04.649 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:04 smithi134 ceph-mon[35201]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:04.649 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:04 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:23:05.503 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:05 smithi088 ceph-mon[90867]: pgmap v30: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-17T04:23:05.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:05 smithi134 ceph-mon[35201]: pgmap v30: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-17T04:23:06.818 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:06 smithi134 ceph-mon[35201]: pgmap v31: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-17T04:23:06.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:06 smithi088 ceph-mon[90867]: pgmap v31: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-17T04:23:08.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:08 smithi134 ceph-mon[35201]: pgmap v32: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:23:08.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:08 smithi088 ceph-mon[90867]: pgmap v32: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:23:10.338 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:10 smithi088 ceph-mon[90867]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:10.338 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:10 smithi088 ceph-mon[90867]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:10.338 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:10 smithi088 ceph-mon[90867]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:10.338 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:10 smithi088 ceph-mon[90867]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:10.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:10 smithi134 ceph-mon[35201]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:10.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:10 smithi134 ceph-mon[35201]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:10.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:10 smithi134 ceph-mon[35201]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:10.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:10 smithi134 ceph-mon[35201]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:11.267 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:11 smithi088 ceph-mon[90867]: pgmap v33: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:23:11.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:11 smithi134 ceph-mon[35201]: pgmap v33: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:23:12.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.181+0000 7f69b88d7640 1 -- 172.21.15.88:0/3210333140 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69b4101a60 msgr2=0x7f69b4101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:12.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.181+0000 7f69b88d7640 1 --2- 172.21.15.88:0/3210333140 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69b4101a60 0x7f69b4101ee0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f699c0097e0 tx=0x7f699c02a3f0 comp rx=0 tx=0).stop 2024-09-17T04:23:12.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.181+0000 7f69b88d7640 1 -- 172.21.15.88:0/3210333140 shutdown_connections 2024-09-17T04:23:12.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.181+0000 7f69b88d7640 1 --2- 172.21.15.88:0/3210333140 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69b4101a60 0x7f69b4101ee0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:12.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.181+0000 7f69b88d7640 1 --2- 172.21.15.88:0/3210333140 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69b4100860 0x7f69b4100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:12.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.181+0000 7f69b88d7640 1 -- 172.21.15.88:0/3210333140 >> 172.21.15.88:0/3210333140 conn(0x7f69b40fbff0 msgr2=0x7f69b40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:12.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.181+0000 7f69b88d7640 1 -- 172.21.15.88:0/3210333140 shutdown_connections 2024-09-17T04:23:12.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.181+0000 7f69b88d7640 1 -- 172.21.15.88:0/3210333140 wait complete. 2024-09-17T04:23:12.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.182+0000 7f69b88d7640 1 Processor -- start 2024-09-17T04:23:12.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.182+0000 7f69b88d7640 1 -- start start 2024-09-17T04:23:12.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.183+0000 7f69b88d7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69b4100860 0x7f69b41963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:12.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.183+0000 7f69b88d7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69b4101a60 0x7f69b4196910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:12.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.183+0000 7f69b88d7640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f69b41096a0 con 0x7f69b4100860 2024-09-17T04:23:12.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.183+0000 7f69b88d7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f69b4109520 con 0x7f69b4101a60 2024-09-17T04:23:12.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.183+0000 7f69b259c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69b4100860 0x7f69b41963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:12.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.183+0000 7f69a9d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69b4101a60 0x7f69b4196910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:12.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.183+0000 7f69b259c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69b4100860 0x7f69b41963d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38126/0 (socket says 172.21.15.88:38126) 2024-09-17T04:23:12.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.183+0000 7f69b259c640 1 -- 172.21.15.88:0/577700770 learned_addr learned my addr 172.21.15.88:0/577700770 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:23:12.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.183+0000 7f69b259c640 1 -- 172.21.15.88:0/577700770 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69b4100860 msgr2=0x7f69b41963d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-17T04:23:12.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.183+0000 7f69b259c640 1 -- 172.21.15.88:0/577700770 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69b4100860 msgr2=0x7f69b41963d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-17T04:23:12.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.183+0000 7f69b259c640 1 --2- 172.21.15.88:0/577700770 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69b4100860 0x7f69b41963d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-17T04:23:12.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.183+0000 7f69b259c640 1 --2- 172.21.15.88:0/577700770 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69b4100860 0x7f69b41963d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T04:23:12.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.183+0000 7f69a9d9b640 1 -- 172.21.15.88:0/577700770 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69b4100860 msgr2=0x7f69b41963d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T04:23:12.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.183+0000 7f69a9d9b640 1 --2- 172.21.15.88:0/577700770 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69b4100860 0x7f69b41963d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:12.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.183+0000 7f69a9d9b640 1 -- 172.21.15.88:0/577700770 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69b4196f90 con 0x7f69b4101a60 2024-09-17T04:23:12.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.184+0000 7f69a9d9b640 1 --2- 172.21.15.88:0/577700770 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69b4101a60 0x7f69b4196910 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f699c02a910 tx=0x7f699c0045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:12.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.184+0000 7f69abfff640 1 -- 172.21.15.88:0/577700770 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f699c040070 con 0x7f69b4101a60 2024-09-17T04:23:12.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.184+0000 7f69abfff640 1 -- 172.21.15.88:0/577700770 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f699c030c00 con 0x7f69b4101a60 2024-09-17T04:23:12.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.184+0000 7f69b88d7640 1 -- 172.21.15.88:0/577700770 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69b419b970 con 0x7f69b4101a60 2024-09-17T04:23:12.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.184+0000 7f69abfff640 1 -- 172.21.15.88:0/577700770 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f699c003d80 con 0x7f69b4101a60 2024-09-17T04:23:12.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.184+0000 7f69b88d7640 1 -- 172.21.15.88:0/577700770 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69b406a4c0 con 0x7f69b4101a60 2024-09-17T04:23:12.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.185+0000 7f69b88d7640 1 -- 172.21.15.88:0/577700770 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69b4100c60 con 0x7f69b4101a60 2024-09-17T04:23:12.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.186+0000 7f69abfff640 1 -- 172.21.15.88:0/577700770 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 33) ==== 103422+0+0 (secure 0 0 0) 0x7f699c039040 con 0x7f69b4101a60 2024-09-17T04:23:12.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.187+0000 7f69abfff640 1 --2- 172.21.15.88:0/577700770 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f69a007d2c0 0x7f69a007f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:12.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.187+0000 7f69abfff640 1 -- 172.21.15.88:0/577700770 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7f699c0bf540 con 0x7f69b4101a60 2024-09-17T04:23:12.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.187+0000 7f69b259c640 1 --2- 172.21.15.88:0/577700770 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f69a007d2c0 0x7f69a007f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:12.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.187+0000 7f69b259c640 1 --2- 172.21.15.88:0/577700770 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f69a007d2c0 0x7f69a007f780 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f69a4005f80 tx=0x7f69a4005f10 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:12.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.192+0000 7f69abfff640 1 -- 172.21.15.88:0/577700770 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f699c08a9f0 con 0x7f69b4101a60 2024-09-17T04:23:12.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:23:12.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.392+0000 7f69b88d7640 1 -- 172.21.15.88:0/577700770 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f69b406a770 con 0x7f69a007d2c0 2024-09-17T04:23:12.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.393+0000 7f69abfff640 1 -- 172.21.15.88:0/577700770 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+368 (secure 0 0 0) 0x7f69b406a770 con 0x7f69a007d2c0 2024-09-17T04:23:12.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.395+0000 7f69b88d7640 1 -- 172.21.15.88:0/577700770 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f69a007d2c0 msgr2=0x7f69a007f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:12.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.395+0000 7f69b88d7640 1 --2- 172.21.15.88:0/577700770 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f69a007d2c0 0x7f69a007f780 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f69a4005f80 tx=0x7f69a4005f10 comp rx=0 tx=0).stop 2024-09-17T04:23:12.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.395+0000 7f69b88d7640 1 -- 172.21.15.88:0/577700770 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69b4101a60 msgr2=0x7f69b4196910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:12.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.395+0000 7f69b88d7640 1 --2- 172.21.15.88:0/577700770 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69b4101a60 0x7f69b4196910 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f699c02a910 tx=0x7f699c0045e0 comp rx=0 tx=0).stop 2024-09-17T04:23:12.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.395+0000 7f69b88d7640 1 -- 172.21.15.88:0/577700770 shutdown_connections 2024-09-17T04:23:12.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.395+0000 7f69b88d7640 1 --2- 172.21.15.88:0/577700770 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f69a007d2c0 0x7f69a007f780 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:12.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.395+0000 7f69b88d7640 1 --2- 172.21.15.88:0/577700770 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69b4101a60 0x7f69b4196910 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:12.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.395+0000 7f69b88d7640 1 --2- 172.21.15.88:0/577700770 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69b4100860 0x7f69b41963d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:12.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.395+0000 7f69b88d7640 1 -- 172.21.15.88:0/577700770 >> 172.21.15.88:0/577700770 conn(0x7f69b40fbff0 msgr2=0x7f69b4104f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:12.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.395+0000 7f69b88d7640 1 -- 172.21.15.88:0/577700770 shutdown_connections 2024-09-17T04:23:12.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.395+0000 7f69b88d7640 1 -- 172.21.15.88:0/577700770 wait complete. 2024-09-17T04:23:12.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:12 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T04:23:12.404 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-09-17T04:23:12.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.479+0000 7f2aef106640 1 -- 172.21.15.88:0/144668515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ae8100860 msgr2=0x7f2ae8100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:12.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.479+0000 7f2aef106640 1 --2- 172.21.15.88:0/144668515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ae8100860 0x7f2ae8100c60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2adc0097e0 tx=0x7f2adc02a3f0 comp rx=0 tx=0).stop 2024-09-17T04:23:12.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.479+0000 7f2aef106640 1 -- 172.21.15.88:0/144668515 shutdown_connections 2024-09-17T04:23:12.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.479+0000 7f2aef106640 1 --2- 172.21.15.88:0/144668515 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ae8101a60 0x7f2ae8101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:12.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.479+0000 7f2aef106640 1 --2- 172.21.15.88:0/144668515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ae8100860 0x7f2ae8100c60 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:12.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.479+0000 7f2aef106640 1 -- 172.21.15.88:0/144668515 >> 172.21.15.88:0/144668515 conn(0x7f2ae80fc010 msgr2=0x7f2ae80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:12.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.479+0000 7f2aef106640 1 -- 172.21.15.88:0/144668515 shutdown_connections 2024-09-17T04:23:12.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.479+0000 7f2aef106640 1 -- 172.21.15.88:0/144668515 wait complete. 2024-09-17T04:23:12.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.480+0000 7f2aef106640 1 Processor -- start 2024-09-17T04:23:12.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.480+0000 7f2aef106640 1 -- start start 2024-09-17T04:23:12.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.480+0000 7f2aef106640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ae8100860 0x7f2ae806a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:12.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.480+0000 7f2aef106640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ae8101a60 0x7f2ae819c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:12.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.480+0000 7f2aef106640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae81096a0 con 0x7f2ae8101a60 2024-09-17T04:23:12.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.480+0000 7f2aef106640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae8109520 con 0x7f2ae8100860 2024-09-17T04:23:12.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.480+0000 7f2ae7fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ae8101a60 0x7f2ae819c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:12.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.480+0000 7f2ae7fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ae8101a60 0x7f2ae819c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55876/0 (socket says 172.21.15.88:55876) 2024-09-17T04:23:12.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.480+0000 7f2ae7fff640 1 -- 172.21.15.88:0/2471961724 learned_addr learned my addr 172.21.15.88:0/2471961724 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:23:12.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.480+0000 7f2ae7fff640 1 -- 172.21.15.88:0/2471961724 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ae8101a60 msgr2=0x7f2ae819c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-17T04:23:12.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.480+0000 7f2ae7fff640 1 -- 172.21.15.88:0/2471961724 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ae8101a60 msgr2=0x7f2ae819c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-17T04:23:12.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.480+0000 7f2ae7fff640 1 --2- 172.21.15.88:0/2471961724 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ae8101a60 0x7f2ae819c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-17T04:23:12.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.480+0000 7f2ae7fff640 1 --2- 172.21.15.88:0/2471961724 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ae8101a60 0x7f2ae819c220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T04:23:12.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.480+0000 7f2aecea2640 1 --2- 172.21.15.88:0/2471961724 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ae8100860 0x7f2ae806a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:12.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.481+0000 7f2aecea2640 1 -- 172.21.15.88:0/2471961724 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ae8101a60 msgr2=0x7f2ae819c220 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T04:23:12.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.481+0000 7f2aecea2640 1 --2- 172.21.15.88:0/2471961724 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ae8101a60 0x7f2ae819c220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:12.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.481+0000 7f2aecea2640 1 -- 172.21.15.88:0/2471961724 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ae819c7e0 con 0x7f2ae8100860 2024-09-17T04:23:12.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.481+0000 7f2aecea2640 1 --2- 172.21.15.88:0/2471961724 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ae8100860 0x7f2ae806a790 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2adc0097e0 tx=0x7f2adc0045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:12.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.481+0000 7f2ae5ffb640 1 -- 172.21.15.88:0/2471961724 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2adc040070 con 0x7f2ae8100860 2024-09-17T04:23:12.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.481+0000 7f2aef106640 1 -- 172.21.15.88:0/2471961724 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ae819ca70 con 0x7f2ae8100860 2024-09-17T04:23:12.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.482+0000 7f2aef106640 1 -- 172.21.15.88:0/2471961724 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ae819cfa0 con 0x7f2ae8100860 2024-09-17T04:23:12.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.482+0000 7f2ae5ffb640 1 -- 172.21.15.88:0/2471961724 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2adc030c00 con 0x7f2ae8100860 2024-09-17T04:23:12.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.482+0000 7f2ae5ffb640 1 -- 172.21.15.88:0/2471961724 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2adc003b80 con 0x7f2ae8100860 2024-09-17T04:23:12.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.482+0000 7f2aef106640 1 -- 172.21.15.88:0/2471961724 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2acc0052c0 con 0x7f2ae8100860 2024-09-17T04:23:12.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.484+0000 7f2ae5ffb640 1 -- 172.21.15.88:0/2471961724 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 33) ==== 103422+0+0 (secure 0 0 0) 0x7f2adc039040 con 0x7f2ae8100860 2024-09-17T04:23:12.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.484+0000 7f2ae5ffb640 1 --2- 172.21.15.88:0/2471961724 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f2ad807b050 0x7f2ad807d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:12.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.484+0000 7f2ae5ffb640 1 -- 172.21.15.88:0/2471961724 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7f2adc0bf670 con 0x7f2ae8100860 2024-09-17T04:23:12.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.484+0000 7f2ae7fff640 1 --2- 172.21.15.88:0/2471961724 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f2ad807b050 0x7f2ad807d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:12.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.484+0000 7f2ae7fff640 1 --2- 172.21.15.88:0/2471961724 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f2ad807b050 0x7f2ad807d510 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4005fd0 tx=0x7f2ad4005f40 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:12.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.488+0000 7f2ae5ffb640 1 -- 172.21.15.88:0/2471961724 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f2adc08aa30 con 0x7f2ae8100860 2024-09-17T04:23:12.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.683+0000 7f2aef106640 1 -- 172.21.15.88:0/2471961724 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2acc000bf0 con 0x7f2ad807b050 2024-09-17T04:23:12.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.684+0000 7f2ae5ffb640 1 -- 172.21.15.88:0/2471961724 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+368 (secure 0 0 0) 0x7f2acc000bf0 con 0x7f2ad807b050 2024-09-17T04:23:12.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.686+0000 7f2aef106640 1 -- 172.21.15.88:0/2471961724 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f2ad807b050 msgr2=0x7f2ad807d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:12.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.686+0000 7f2aef106640 1 --2- 172.21.15.88:0/2471961724 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f2ad807b050 0x7f2ad807d510 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4005fd0 tx=0x7f2ad4005f40 comp rx=0 tx=0).stop 2024-09-17T04:23:12.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.686+0000 7f2aef106640 1 -- 172.21.15.88:0/2471961724 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ae8100860 msgr2=0x7f2ae806a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:12.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.686+0000 7f2aef106640 1 --2- 172.21.15.88:0/2471961724 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ae8100860 0x7f2ae806a790 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2adc0097e0 tx=0x7f2adc0045e0 comp rx=0 tx=0).stop 2024-09-17T04:23:12.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.686+0000 7f2aef106640 1 -- 172.21.15.88:0/2471961724 shutdown_connections 2024-09-17T04:23:12.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.686+0000 7f2aef106640 1 --2- 172.21.15.88:0/2471961724 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f2ad807b050 0x7f2ad807d510 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:12.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.686+0000 7f2aef106640 1 --2- 172.21.15.88:0/2471961724 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ae8101a60 0x7f2ae819c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:12.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.686+0000 7f2aef106640 1 --2- 172.21.15.88:0/2471961724 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ae8100860 0x7f2ae806a790 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:12.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.686+0000 7f2aef106640 1 -- 172.21.15.88:0/2471961724 >> 172.21.15.88:0/2471961724 conn(0x7f2ae80fc010 msgr2=0x7f2ae8104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:12.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.686+0000 7f2aef106640 1 -- 172.21.15.88:0/2471961724 shutdown_connections 2024-09-17T04:23:12.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.686+0000 7f2aef106640 1 -- 172.21.15.88:0/2471961724 wait complete. 2024-09-17T04:23:12.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.770+0000 7fdbac30e640 1 -- 172.21.15.88:0/2477442796 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdba4100860 msgr2=0x7fdba4100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:12.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.770+0000 7fdbac30e640 1 --2- 172.21.15.88:0/2477442796 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdba4100860 0x7fdba4100c60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdba00097e0 tx=0x7fdba002a3f0 comp rx=0 tx=0).stop 2024-09-17T04:23:12.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.770+0000 7fdbac30e640 1 -- 172.21.15.88:0/2477442796 shutdown_connections 2024-09-17T04:23:12.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.770+0000 7fdbac30e640 1 --2- 172.21.15.88:0/2477442796 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdba4101a60 0x7fdba4101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:12.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.770+0000 7fdbac30e640 1 --2- 172.21.15.88:0/2477442796 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdba4100860 0x7fdba4100c60 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:12.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.770+0000 7fdbac30e640 1 -- 172.21.15.88:0/2477442796 >> 172.21.15.88:0/2477442796 conn(0x7fdba40fc010 msgr2=0x7fdba40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:12.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.770+0000 7fdbac30e640 1 -- 172.21.15.88:0/2477442796 shutdown_connections 2024-09-17T04:23:12.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.770+0000 7fdbac30e640 1 -- 172.21.15.88:0/2477442796 wait complete. 2024-09-17T04:23:12.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.770+0000 7fdbac30e640 1 Processor -- start 2024-09-17T04:23:12.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.770+0000 7fdbac30e640 1 -- start start 2024-09-17T04:23:12.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.770+0000 7fdbac30e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdba4100860 0x7fdba4197540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:12.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.770+0000 7fdbac30e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdba4101a60 0x7fdba4197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:12.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.770+0000 7fdbac30e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fdba41096a0 con 0x7fdba4100860 2024-09-17T04:23:12.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.770+0000 7fdbac30e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdba4109520 con 0x7fdba4101a60 2024-09-17T04:23:12.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.771+0000 7fdbaa0aa640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdba4100860 0x7fdba4197540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:12.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.771+0000 7fdbaa0aa640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdba4100860 0x7fdba4197540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55894/0 (socket says 172.21.15.88:55894) 2024-09-17T04:23:12.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.771+0000 7fdbaa0aa640 1 -- 172.21.15.88:0/51711651 learned_addr learned my addr 172.21.15.88:0/51711651 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:23:12.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.771+0000 7fdbaa0aa640 1 -- 172.21.15.88:0/51711651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdba4100860 msgr2=0x7fdba4197540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-17T04:23:12.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.771+0000 7fdbaa0aa640 1 -- 172.21.15.88:0/51711651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdba4100860 msgr2=0x7fdba4197540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-17T04:23:12.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.771+0000 7fdbaa0aa640 1 --2- 172.21.15.88:0/51711651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdba4100860 0x7fdba4197540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-17T04:23:12.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.771+0000 7fdbaa0aa640 1 --2- 172.21.15.88:0/51711651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdba4100860 0x7fdba4197540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T04:23:12.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.771+0000 7fdba98a9640 1 --2- 172.21.15.88:0/51711651 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdba4101a60 0x7fdba4197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:12.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.771+0000 7fdba98a9640 1 -- 172.21.15.88:0/51711651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdba4100860 msgr2=0x7fdba4197540 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T04:23:12.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.771+0000 7fdba98a9640 1 --2- 172.21.15.88:0/51711651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdba4100860 0x7fdba4197540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:12.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.771+0000 7fdba98a9640 1 -- 172.21.15.88:0/51711651 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdba4198100 con 0x7fdba4101a60 2024-09-17T04:23:12.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.771+0000 7fdba98a9640 1 --2- 172.21.15.88:0/51711651 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdba4101a60 0x7fdba4197a80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdb9400d6a0 tx=0x7fdb9400db60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:12.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.771+0000 7fdb9b7fe640 1 -- 172.21.15.88:0/51711651 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdb94017070 con 0x7fdba4101a60 2024-09-17T04:23:12.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.772+0000 7fdb9b7fe640 1 -- 172.21.15.88:0/51711651 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdb940097c0 con 0x7fdba4101a60 2024-09-17T04:23:12.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.772+0000 7fdbac30e640 1 -- 172.21.15.88:0/51711651 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdba419cad0 con 0x7fdba4101a60 2024-09-17T04:23:12.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.772+0000 7fdb9b7fe640 1 -- 172.21.15.88:0/51711651 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdb94003a90 con 0x7fdba4101a60 2024-09-17T04:23:12.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.772+0000 7fdbac30e640 1 -- 172.21.15.88:0/51711651 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdba419d060 con 0x7fdba4101a60 2024-09-17T04:23:12.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.772+0000 7fdbac30e640 1 -- 172.21.15.88:0/51711651 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdba4100c60 con 0x7fdba4101a60 2024-09-17T04:23:12.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.773+0000 7fdb9b7fe640 1 -- 172.21.15.88:0/51711651 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 33) ==== 103422+0+0 (secure 0 0 0) 0x7fdb94009970 con 0x7fdba4101a60 2024-09-17T04:23:12.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.774+0000 7fdb9b7fe640 1 --2- 172.21.15.88:0/51711651 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fdb9007b050 0x7fdb9007d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:12.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.774+0000 7fdbaa0aa640 1 --2- 172.21.15.88:0/51711651 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fdb9007b050 0x7fdb9007d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:12.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.774+0000 7fdb9b7fe640 1 -- 172.21.15.88:0/51711651 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7fdb9409de00 con 0x7fdba4101a60 2024-09-17T04:23:12.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.775+0000 7fdbaa0aa640 1 --2- 172.21.15.88:0/51711651 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fdb9007b050 0x7fdb9007d510 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdba00308f0 tx=0x7fdba0009490 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:12.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.778+0000 7fdb9b7fe640 1 -- 172.21.15.88:0/51711651 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fdb94069290 con 0x7fdba4101a60 2024-09-17T04:23:12.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.963+0000 7fdbac30e640 1 -- 172.21.15.88:0/51711651 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fdba406a3e0 con 0x7fdb9007b050 2024-09-17T04:23:12.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.973+0000 7fdb9b7fe640 1 -- 172.21.15.88:0/51711651 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fdba406a3e0 con 0x7fdb9007b050 2024-09-17T04:23:12.973 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T04:23:12.973 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (8m) 3s ago 10m 25.4M - 0.25.0 c8568f914cd2 f2dbac7e939f 2024-09-17T04:23:12.973 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi088 smithi088 running (2m) 3s ago 10m 8446k - 19.1.1-330-gc2ddf972 ebb0615149de 683e1826a1a5 2024-09-17T04:23:12.973 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi134 smithi134 running (96s) 19s ago 9m 8368k - 19.1.1-330-gc2ddf972 ebb0615149de 83afa4200c0e 2024-09-17T04:23:12.973 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (10m) 3s ago 10m 6903k - 19.1.1-330-gc2ddf972 ebb0615149de de17f5571330 2024-09-17T04:23:12.973 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi134 smithi134 running (9m) 19s ago 9m 6899k - 19.1.1-330-gc2ddf972 ebb0615149de 27f7ef172a1c 2024-09-17T04:23:12.973 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (8m) 3s ago 10m 79.4M - 9.4.12 2bacad6d85d8 a6cff57a23f9 2024-09-17T04:23:12.974 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.giqrgt smithi088 running (4m) 3s ago 4m 150M - 19.1.1-330-gc2ddf972 ebb0615149de f724660799a1 2024-09-17T04:23:12.974 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.lgavsv smithi088 running (4m) 3s ago 4m 15.0M - 19.1.1-330-gc2ddf972 ebb0615149de 6cc0fe8a6aa9 2024-09-17T04:23:12.974 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi134.ktuhce smithi134 running (4m) 19s ago 4m 14.5M - 19.1.1-330-gc2ddf972 ebb0615149de 7ff5b70ca9cb 2024-09-17T04:23:12.974 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi134.psnynp smithi134 running (4m) 19s ago 4m 96.7M - 19.1.1-330-gc2ddf972 ebb0615149de 5326974fa3dd 2024-09-17T04:23:12.974 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.wmndiv smithi088 *:8443,9283,8765 running (90s) 3s ago 11m 575M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 49eb47f7f14f 2024-09-17T04:23:12.974 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi134.vwdxcb smithi134 *:8443,9283,8765 running (23s) 19s ago 9m 132M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 8a6d45eb0595 2024-09-17T04:23:12.974 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (10s) 3s ago 11m 95.1M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e ac6332015243 2024-09-17T04:23:12.974 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi134 smithi134 running (9m) 19s ago 9m 46.4M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 89de63fb6386 2024-09-17T04:23:12.974 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (10m) 3s ago 10m 15.9M - 1.5.0 0da6a335fe13 9ba03800993b 2024-09-17T04:23:12.974 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi134 smithi134 *:9100 running (9m) 19s ago 9m 17.3M - 1.5.0 0da6a335fe13 6deac483827f 2024-09-17T04:23:12.974 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (8m) 3s ago 8m 197M 1216M 19.1.1-330-gc2ddf972 ebb0615149de e309427ee12c 2024-09-17T04:23:12.974 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (7m) 3s ago 7m 213M 1216M 19.1.1-330-gc2ddf972 ebb0615149de cc68d92b3333 2024-09-17T04:23:12.975 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (7m) 3s ago 7m 180M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 1ba92f2bfce6 2024-09-17T04:23:12.975 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi134 running (6m) 19s ago 6m 233M 2240M 19.1.1-330-gc2ddf972 ebb0615149de ebd528c3ce1b 2024-09-17T04:23:12.975 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi134 running (6m) 19s ago 6m 206M 2240M 19.1.1-330-gc2ddf972 ebb0615149de eacc25537b3a 2024-09-17T04:23:12.975 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi134 running (5m) 19s ago 5m 183M 2240M 19.1.1-330-gc2ddf972 ebb0615149de bc1b434a92a8 2024-09-17T04:23:12.975 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (29s) 3s ago 9m 49.5M - 2.43.0 a07b618ecd1d b51d7899d341 2024-09-17T04:23:12.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.975+0000 7fdbac30e640 1 -- 172.21.15.88:0/51711651 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fdb9007b050 msgr2=0x7fdb9007d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:12.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.975+0000 7fdbac30e640 1 --2- 172.21.15.88:0/51711651 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fdb9007b050 0x7fdb9007d510 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdba00308f0 tx=0x7fdba0009490 comp rx=0 tx=0).stop 2024-09-17T04:23:12.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.975+0000 7fdbac30e640 1 -- 172.21.15.88:0/51711651 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdba4101a60 msgr2=0x7fdba4197a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:12.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.975+0000 7fdbac30e640 1 --2- 172.21.15.88:0/51711651 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdba4101a60 0x7fdba4197a80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdb9400d6a0 tx=0x7fdb9400db60 comp rx=0 tx=0).stop 2024-09-17T04:23:12.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.975+0000 7fdbac30e640 1 -- 172.21.15.88:0/51711651 shutdown_connections 2024-09-17T04:23:12.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.975+0000 7fdbac30e640 1 --2- 172.21.15.88:0/51711651 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fdb9007b050 0x7fdb9007d510 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:12.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.975+0000 7fdbac30e640 1 --2- 172.21.15.88:0/51711651 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdba4101a60 0x7fdba4197a80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:12.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.975+0000 7fdbac30e640 1 --2- 172.21.15.88:0/51711651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdba4100860 0x7fdba4197540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:12.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.975+0000 7fdbac30e640 1 -- 172.21.15.88:0/51711651 >> 172.21.15.88:0/51711651 conn(0x7fdba40fc010 msgr2=0x7fdba4069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:12.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.975+0000 7fdbac30e640 1 -- 172.21.15.88:0/51711651 shutdown_connections 2024-09-17T04:23:12.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:12.975+0000 7fdbac30e640 1 -- 172.21.15.88:0/51711651 wait complete. 2024-09-17T04:23:13.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.063+0000 7f0c7b486640 1 -- 172.21.15.88:0/2989545705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c74101a60 msgr2=0x7f0c74101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:13.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.063+0000 7f0c7b486640 1 --2- 172.21.15.88:0/2989545705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c74101a60 0x7f0c74101ee0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0c640097e0 tx=0x7f0c6402a3f0 comp rx=0 tx=0).stop 2024-09-17T04:23:13.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.063+0000 7f0c7b486640 1 -- 172.21.15.88:0/2989545705 shutdown_connections 2024-09-17T04:23:13.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.063+0000 7f0c7b486640 1 --2- 172.21.15.88:0/2989545705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c74101a60 0x7f0c74101ee0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:13.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.063+0000 7f0c7b486640 1 --2- 172.21.15.88:0/2989545705 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c74100860 0x7f0c74100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:13.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.063+0000 7f0c7b486640 1 -- 172.21.15.88:0/2989545705 >> 172.21.15.88:0/2989545705 conn(0x7f0c740fc010 msgr2=0x7f0c740fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:13.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.063+0000 7f0c7b486640 1 -- 172.21.15.88:0/2989545705 shutdown_connections 2024-09-17T04:23:13.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.063+0000 7f0c7b486640 1 -- 172.21.15.88:0/2989545705 wait complete. 2024-09-17T04:23:13.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.063+0000 7f0c7b486640 1 Processor -- start 2024-09-17T04:23:13.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.063+0000 7f0c7b486640 1 -- start start 2024-09-17T04:23:13.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.063+0000 7f0c7b486640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c74100860 0x7f0c74104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:13.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.063+0000 7f0c7b486640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c74101a60 0x7f0c74102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:13.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.063+0000 7f0c7b486640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f0c741096a0 con 0x7f0c74100860 2024-09-17T04:23:13.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.063+0000 7f0c7b486640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0c74109520 con 0x7f0c74101a60 2024-09-17T04:23:13.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.064+0000 7f0c79222640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c74100860 0x7f0c74104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:13.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.064+0000 7f0c79222640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c74100860 0x7f0c74104780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55918/0 (socket says 172.21.15.88:55918) 2024-09-17T04:23:13.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.064+0000 7f0c79222640 1 -- 172.21.15.88:0/2955982882 learned_addr learned my addr 172.21.15.88:0/2955982882 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:23:13.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.064+0000 7f0c79222640 1 -- 172.21.15.88:0/2955982882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c74100860 msgr2=0x7f0c74104780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-17T04:23:13.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.064+0000 7f0c79222640 1 -- 172.21.15.88:0/2955982882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c74100860 msgr2=0x7f0c74104780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-17T04:23:13.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.064+0000 7f0c79222640 1 --2- 172.21.15.88:0/2955982882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c74100860 0x7f0c74104780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-17T04:23:13.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.064+0000 7f0c79222640 1 --2- 172.21.15.88:0/2955982882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c74100860 0x7f0c74104780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T04:23:13.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.064+0000 7f0c78a21640 1 --2- 172.21.15.88:0/2955982882 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c74101a60 0x7f0c74102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:13.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.064+0000 7f0c78a21640 1 -- 172.21.15.88:0/2955982882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c74100860 msgr2=0x7f0c74104780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T04:23:13.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.064+0000 7f0c78a21640 1 --2- 172.21.15.88:0/2955982882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c74100860 0x7f0c74104780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:13.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.064+0000 7f0c78a21640 1 -- 172.21.15.88:0/2955982882 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c74103380 con 0x7f0c74101a60 2024-09-17T04:23:13.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.064+0000 7f0c78a21640 1 --2- 172.21.15.88:0/2955982882 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c74101a60 0x7f0c74102e40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0c6402a910 tx=0x7f0c640045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:13.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.065+0000 7f0c6a7fc640 1 -- 172.21.15.88:0/2955982882 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0c64040070 con 0x7f0c74101a60 2024-09-17T04:23:13.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.065+0000 7f0c7b486640 1 -- 172.21.15.88:0/2955982882 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c74103610 con 0x7f0c74101a60 2024-09-17T04:23:13.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.065+0000 7f0c6a7fc640 1 -- 172.21.15.88:0/2955982882 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0c64030c00 con 0x7f0c74101a60 2024-09-17T04:23:13.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.065+0000 7f0c6a7fc640 1 -- 172.21.15.88:0/2955982882 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0c64003d50 con 0x7f0c74101a60 2024-09-17T04:23:13.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.065+0000 7f0c7b486640 1 -- 172.21.15.88:0/2955982882 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c74103b40 con 0x7f0c74101a60 2024-09-17T04:23:13.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.066+0000 7f0c7b486640 1 -- 172.21.15.88:0/2955982882 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c74100c60 con 0x7f0c74101a60 2024-09-17T04:23:13.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.067+0000 7f0c6a7fc640 1 -- 172.21.15.88:0/2955982882 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 33) ==== 103422+0+0 (secure 0 0 0) 0x7f0c64039040 con 0x7f0c74101a60 2024-09-17T04:23:13.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.067+0000 7f0c6a7fc640 1 --2- 172.21.15.88:0/2955982882 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f0c6007b050 0x7f0c6007d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:13.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.067+0000 7f0c79222640 1 --2- 172.21.15.88:0/2955982882 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f0c6007b050 0x7f0c6007d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:13.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.068+0000 7f0c79222640 1 --2- 172.21.15.88:0/2955982882 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f0c6007b050 0x7f0c6007d510 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0c70005f80 tx=0x7f0c70005f10 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:13.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.070+0000 7f0c6a7fc640 1 -- 172.21.15.88:0/2955982882 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7f0c64043df0 con 0x7f0c74101a60 2024-09-17T04:23:13.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.075+0000 7f0c6a7fc640 1 -- 172.21.15.88:0/2955982882 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f0c6408aa20 con 0x7f0c74101a60 2024-09-17T04:23:13.335 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:13 smithi088 ceph-mon[90867]: from='client.24625 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:23:13.335 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:13 smithi088 ceph-mon[90867]: pgmap v34: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:23:13.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.335+0000 7f0c7b486640 1 -- 172.21.15.88:0/2955982882 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f0c7419f690 con 0x7f0c74101a60 2024-09-17T04:23:13.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.336+0000 7f0c6a7fc640 1 -- 172.21.15.88:0/2955982882 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+839 (secure 0 0 0) 0x7f0c6408f8d0 con 0x7f0c74101a60 2024-09-17T04:23:13.336 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-17T04:23:13.336 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-09-17T04:23:13.336 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 1, 2024-09-17T04:23:13.336 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 1 2024-09-17T04:23:13.336 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:23:13.337 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-09-17T04:23:13.337 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T04:23:13.337 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:23:13.337 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-09-17T04:23:13.337 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-17T04:23:13.337 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:23:13.337 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2024-09-17T04:23:13.337 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T04:23:13.337 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:23:13.337 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-09-17T04:23:13.337 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 11, 2024-09-17T04:23:13.337 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 3 2024-09-17T04:23:13.338 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-17T04:23:13.338 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-17T04:23:13.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.338+0000 7f0c7b486640 1 -- 172.21.15.88:0/2955982882 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f0c6007b050 msgr2=0x7f0c6007d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:13.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.338+0000 7f0c7b486640 1 --2- 172.21.15.88:0/2955982882 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f0c6007b050 0x7f0c6007d510 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0c70005f80 tx=0x7f0c70005f10 comp rx=0 tx=0).stop 2024-09-17T04:23:13.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.338+0000 7f0c7b486640 1 -- 172.21.15.88:0/2955982882 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c74101a60 msgr2=0x7f0c74102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:13.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.338+0000 7f0c7b486640 1 --2- 172.21.15.88:0/2955982882 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c74101a60 0x7f0c74102e40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0c6402a910 tx=0x7f0c640045e0 comp rx=0 tx=0).stop 2024-09-17T04:23:13.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.338+0000 7f0c7b486640 1 -- 172.21.15.88:0/2955982882 shutdown_connections 2024-09-17T04:23:13.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.338+0000 7f0c7b486640 1 --2- 172.21.15.88:0/2955982882 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f0c6007b050 0x7f0c6007d510 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:13.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.338+0000 7f0c7b486640 1 --2- 172.21.15.88:0/2955982882 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c74101a60 0x7f0c74102e40 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:13.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.338+0000 7f0c7b486640 1 --2- 172.21.15.88:0/2955982882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c74100860 0x7f0c74104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:13.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.338+0000 7f0c7b486640 1 -- 172.21.15.88:0/2955982882 >> 172.21.15.88:0/2955982882 conn(0x7f0c740fc010 msgr2=0x7f0c74069d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:13.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.338+0000 7f0c7b486640 1 -- 172.21.15.88:0/2955982882 shutdown_connections 2024-09-17T04:23:13.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.338+0000 7f0c7b486640 1 -- 172.21.15.88:0/2955982882 wait complete. 2024-09-17T04:23:13.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:13 smithi134 ceph-mon[35201]: from='client.24625 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:23:13.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:13 smithi134 ceph-mon[35201]: pgmap v34: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:23:13.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.419+0000 7f129b5dd640 1 -- 172.21.15.88:0/2881131201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1294104d20 msgr2=0x7f1294107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:13.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.419+0000 7f129b5dd640 1 --2- 172.21.15.88:0/2881131201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1294104d20 0x7f1294107110 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f12840097e0 tx=0x7f128402a3f0 comp rx=0 tx=0).stop 2024-09-17T04:23:13.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.419+0000 7f129b5dd640 1 -- 172.21.15.88:0/2881131201 shutdown_connections 2024-09-17T04:23:13.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.419+0000 7f129b5dd640 1 --2- 172.21.15.88:0/2881131201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1294104d20 0x7f1294107110 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:13.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.419+0000 7f129b5dd640 1 --2- 172.21.15.88:0/2881131201 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12941023f0 0x7f12941047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:13.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.419+0000 7f129b5dd640 1 -- 172.21.15.88:0/2881131201 >> 172.21.15.88:0/2881131201 conn(0x7f12940fc010 msgr2=0x7f12940fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:13.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.420+0000 7f129b5dd640 1 -- 172.21.15.88:0/2881131201 shutdown_connections 2024-09-17T04:23:13.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.420+0000 7f129b5dd640 1 -- 172.21.15.88:0/2881131201 wait complete. 2024-09-17T04:23:13.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.420+0000 7f129b5dd640 1 Processor -- start 2024-09-17T04:23:13.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.420+0000 7f129b5dd640 1 -- start start 2024-09-17T04:23:13.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.420+0000 7f129b5dd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12941023f0 0x7f1294197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:13.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.420+0000 7f129b5dd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1294104d20 0x7f1294197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:13.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.420+0000 7f129b5dd640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f129410a7b0 con 0x7f12941023f0 2024-09-17T04:23:13.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.420+0000 7f129b5dd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f129410a630 con 0x7f1294104d20 2024-09-17T04:23:13.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.420+0000 7f1299379640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12941023f0 0x7f1294197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:13.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.420+0000 7f1299379640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12941023f0 0x7f1294197500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55928/0 (socket says 172.21.15.88:55928) 2024-09-17T04:23:13.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.420+0000 7f1299379640 1 -- 172.21.15.88:0/4046151486 learned_addr learned my addr 172.21.15.88:0/4046151486 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:23:13.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.421+0000 7f1298b78640 1 --2- 172.21.15.88:0/4046151486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1294104d20 0x7f1294197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:13.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.421+0000 7f1299379640 1 -- 172.21.15.88:0/4046151486 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12941023f0 msgr2=0x7f1294197500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-17T04:23:13.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.421+0000 7f1299379640 1 -- 172.21.15.88:0/4046151486 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12941023f0 msgr2=0x7f1294197500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-17T04:23:13.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.421+0000 7f1299379640 1 --2- 172.21.15.88:0/4046151486 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12941023f0 0x7f1294197500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-17T04:23:13.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.421+0000 7f1299379640 1 --2- 172.21.15.88:0/4046151486 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12941023f0 0x7f1294197500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T04:23:13.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.421+0000 7f1298b78640 1 -- 172.21.15.88:0/4046151486 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12941023f0 msgr2=0x7f1294197500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T04:23:13.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.421+0000 7f1298b78640 1 --2- 172.21.15.88:0/4046151486 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12941023f0 0x7f1294197500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:13.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.421+0000 7f1298b78640 1 -- 172.21.15.88:0/4046151486 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12941980c0 con 0x7f1294104d20 2024-09-17T04:23:13.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.421+0000 7f1298b78640 1 --2- 172.21.15.88:0/4046151486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1294104d20 0x7f1294197a40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f128402a910 tx=0x7f12840305d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:13.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.421+0000 7f128a7fc640 1 -- 172.21.15.88:0/4046151486 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1284040070 con 0x7f1294104d20 2024-09-17T04:23:13.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.421+0000 7f129b5dd640 1 -- 172.21.15.88:0/4046151486 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f129419caa0 con 0x7f1294104d20 2024-09-17T04:23:13.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.421+0000 7f128a7fc640 1 -- 172.21.15.88:0/4046151486 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1284030bf0 con 0x7f1294104d20 2024-09-17T04:23:13.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.421+0000 7f128a7fc640 1 -- 172.21.15.88:0/4046151486 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1284003db0 con 0x7f1294104d20 2024-09-17T04:23:13.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.421+0000 7f129b5dd640 1 -- 172.21.15.88:0/4046151486 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f129419d030 con 0x7f1294104d20 2024-09-17T04:23:13.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.422+0000 7f129b5dd640 1 -- 172.21.15.88:0/4046151486 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12941027d0 con 0x7f1294104d20 2024-09-17T04:23:13.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.423+0000 7f128a7fc640 1 -- 172.21.15.88:0/4046151486 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 33) ==== 103422+0+0 (secure 0 0 0) 0x7f1284039040 con 0x7f1294104d20 2024-09-17T04:23:13.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.423+0000 7f128a7fc640 1 --2- 172.21.15.88:0/4046151486 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f128007b050 0x7f128007d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:13.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.423+0000 7f1299379640 1 --2- 172.21.15.88:0/4046151486 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f128007b050 0x7f128007d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:13.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.424+0000 7f128a7fc640 1 -- 172.21.15.88:0/4046151486 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7f12840bf5b0 con 0x7f1294104d20 2024-09-17T04:23:13.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.424+0000 7f1299379640 1 --2- 172.21.15.88:0/4046151486 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f128007b050 0x7f128007d510 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1290009540 tx=0x7f1290009940 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:13.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.428+0000 7f128a7fc640 1 -- 172.21.15.88:0/4046151486 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f128408a940 con 0x7f1294104d20 2024-09-17T04:23:13.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.639+0000 7f129b5dd640 1 -- 172.21.15.88:0/4046151486 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f129419d3d0 con 0x7f1294104d20 2024-09-17T04:23:13.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.640+0000 7f128a7fc640 1 -- 172.21.15.88:0/4046151486 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) ==== 76+0+2045 (secure 0 0 0) 0x7f128408f7f0 con 0x7f1294104d20 2024-09-17T04:23:13.640 INFO:teuthology.orchestra.run.smithi088.stdout:e15 2024-09-17T04:23:13.640 INFO:teuthology.orchestra.run.smithi088.stdout:btime 2024-09-17T04:18:27:750910+0000 2024-09-17T04:23:13.640 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T04:23:13.641 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:23:13.641 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2024-09-17T04:23:13.641 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:23:13.641 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2024-09-17T04:23:13.641 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2024-09-17T04:23:13.641 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 15 2024-09-17T04:23:13.641 INFO:teuthology.orchestra.run.smithi088.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T04:23:13.641 INFO:teuthology.orchestra.run.smithi088.stdout:created 2024-09-17T04:18:10.480573+0000 2024-09-17T04:23:13.641 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2024-09-17T04:18:27.750896+0000 2024-09-17T04:23:13.641 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2024-09-17T04:23:13.641 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2024-09-17T04:23:13.641 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2024-09-17T04:23:13.641 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2024-09-17T04:23:13.641 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2024-09-17T04:23:13.642 INFO:teuthology.orchestra.run.smithi088.stdout:max_xattr_size 65536 2024-09-17T04:23:13.642 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2024-09-17T04:23:13.642 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2024-09-17T04:23:13.642 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 45 2024-09-17T04:23:13.642 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:23:13.642 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 1 2024-09-17T04:23:13.642 INFO:teuthology.orchestra.run.smithi088.stdout:in 0 2024-09-17T04:23:13.642 INFO:teuthology.orchestra.run.smithi088.stdout:up {0=14590} 2024-09-17T04:23:13.642 INFO:teuthology.orchestra.run.smithi088.stdout:failed 2024-09-17T04:23:13.642 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2024-09-17T04:23:13.643 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2024-09-17T04:23:13.643 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2024-09-17T04:23:13.643 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2024-09-17T04:23:13.643 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data enabled 2024-09-17T04:23:13.643 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2024-09-17T04:23:13.643 INFO:teuthology.orchestra.run.smithi088.stdout:bal_rank_mask -1 2024-09-17T04:23:13.643 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 1 2024-09-17T04:23:13.643 INFO:teuthology.orchestra.run.smithi088.stdout:qdb_cluster leader: 14590 members: 14590 2024-09-17T04:23:13.643 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.giqrgt{0:14590} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.88:6828/1714846518,v1:172.21.15.88:6829/1714846518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:23:13.643 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi134.psnynp{0:24321} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.134:6826/2137586894,v1:172.21.15.134:6827/2137586894] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:23:13.643 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:23:13.643 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:23:13.643 INFO:teuthology.orchestra.run.smithi088.stdout:Standby daemons: 2024-09-17T04:23:13.643 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:23:13.644 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi134.ktuhce{-1:24325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/967997022,v1:172.21.15.134:6825/967997022] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:23:13.644 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.lgavsv{-1:24329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/1425146180,v1:172.21.15.88:6827/1425146180] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:23:13.644 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 15 2024-09-17T04:23:13.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.642+0000 7f129b5dd640 1 -- 172.21.15.88:0/4046151486 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f128007b050 msgr2=0x7f128007d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:13.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.642+0000 7f129b5dd640 1 --2- 172.21.15.88:0/4046151486 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f128007b050 0x7f128007d510 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1290009540 tx=0x7f1290009940 comp rx=0 tx=0).stop 2024-09-17T04:23:13.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.642+0000 7f129b5dd640 1 -- 172.21.15.88:0/4046151486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1294104d20 msgr2=0x7f1294197a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:13.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.642+0000 7f129b5dd640 1 --2- 172.21.15.88:0/4046151486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1294104d20 0x7f1294197a40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f128402a910 tx=0x7f12840305d0 comp rx=0 tx=0).stop 2024-09-17T04:23:13.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.642+0000 7f129b5dd640 1 -- 172.21.15.88:0/4046151486 shutdown_connections 2024-09-17T04:23:13.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.642+0000 7f129b5dd640 1 --2- 172.21.15.88:0/4046151486 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f128007b050 0x7f128007d510 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:13.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.642+0000 7f129b5dd640 1 --2- 172.21.15.88:0/4046151486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1294104d20 0x7f1294197a40 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:13.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.642+0000 7f129b5dd640 1 --2- 172.21.15.88:0/4046151486 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12941023f0 0x7f1294197500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:13.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.643+0000 7f129b5dd640 1 -- 172.21.15.88:0/4046151486 >> 172.21.15.88:0/4046151486 conn(0x7f12940fc010 msgr2=0x7f12940fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:13.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.643+0000 7f129b5dd640 1 -- 172.21.15.88:0/4046151486 shutdown_connections 2024-09-17T04:23:13.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.643+0000 7f129b5dd640 1 -- 172.21.15.88:0/4046151486 wait complete. 2024-09-17T04:23:13.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.725+0000 7fd145f02640 1 -- 172.21.15.88:0/1616773332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd140100860 msgr2=0x7fd140100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:13.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.725+0000 7fd145f02640 1 --2- 172.21.15.88:0/1616773332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd140100860 0x7fd140100c60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd1300097e0 tx=0x7fd13002a3f0 comp rx=0 tx=0).stop 2024-09-17T04:23:13.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.725+0000 7fd145f02640 1 -- 172.21.15.88:0/1616773332 shutdown_connections 2024-09-17T04:23:13.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.725+0000 7fd145f02640 1 --2- 172.21.15.88:0/1616773332 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd140101a60 0x7fd140101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:13.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.725+0000 7fd145f02640 1 --2- 172.21.15.88:0/1616773332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd140100860 0x7fd140100c60 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:13.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.725+0000 7fd145f02640 1 -- 172.21.15.88:0/1616773332 >> 172.21.15.88:0/1616773332 conn(0x7fd1400fc010 msgr2=0x7fd1400fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:13.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.725+0000 7fd145f02640 1 -- 172.21.15.88:0/1616773332 shutdown_connections 2024-09-17T04:23:13.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.725+0000 7fd145f02640 1 -- 172.21.15.88:0/1616773332 wait complete. 2024-09-17T04:23:13.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.726+0000 7fd145f02640 1 Processor -- start 2024-09-17T04:23:13.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.726+0000 7fd145f02640 1 -- start start 2024-09-17T04:23:13.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.726+0000 7fd145f02640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd140100860 0x7fd1401996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:13.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.726+0000 7fd145f02640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd140101a60 0x7fd140199c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:13.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.726+0000 7fd145f02640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fd1401096a0 con 0x7fd140100860 2024-09-17T04:23:13.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.726+0000 7fd145f02640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd140109520 con 0x7fd140101a60 2024-09-17T04:23:13.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.726+0000 7fd13f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd140100860 0x7fd1401996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:13.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.726+0000 7fd13f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd140100860 0x7fd1401996d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55948/0 (socket says 172.21.15.88:55948) 2024-09-17T04:23:13.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.726+0000 7fd13f7fe640 1 -- 172.21.15.88:0/4146762545 learned_addr learned my addr 172.21.15.88:0/4146762545 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:23:13.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.726+0000 7fd13f7fe640 1 -- 172.21.15.88:0/4146762545 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd140100860 msgr2=0x7fd1401996d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-17T04:23:13.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.726+0000 7fd13f7fe640 1 -- 172.21.15.88:0/4146762545 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd140100860 msgr2=0x7fd1401996d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-17T04:23:13.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.726+0000 7fd13f7fe640 1 --2- 172.21.15.88:0/4146762545 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd140100860 0x7fd1401996d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-17T04:23:13.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.726+0000 7fd13effd640 1 --2- 172.21.15.88:0/4146762545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd140101a60 0x7fd140199c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:13.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.726+0000 7fd13f7fe640 1 --2- 172.21.15.88:0/4146762545 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd140100860 0x7fd1401996d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T04:23:13.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.727+0000 7fd13effd640 1 -- 172.21.15.88:0/4146762545 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd140100860 msgr2=0x7fd1401996d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T04:23:13.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.727+0000 7fd13effd640 1 --2- 172.21.15.88:0/4146762545 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd140100860 0x7fd1401996d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:13.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.727+0000 7fd13effd640 1 -- 172.21.15.88:0/4146762545 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd14019a290 con 0x7fd140101a60 2024-09-17T04:23:13.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.727+0000 7fd13effd640 1 --2- 172.21.15.88:0/4146762545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd140101a60 0x7fd140199c10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd13400d6a0 tx=0x7fd13400db60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:13.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.727+0000 7fd13cff9640 1 -- 172.21.15.88:0/4146762545 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd134017070 con 0x7fd140101a60 2024-09-17T04:23:13.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.727+0000 7fd13cff9640 1 -- 172.21.15.88:0/4146762545 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd1340097c0 con 0x7fd140101a60 2024-09-17T04:23:13.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.727+0000 7fd145f02640 1 -- 172.21.15.88:0/4146762545 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd14019ecd0 con 0x7fd140101a60 2024-09-17T04:23:13.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.727+0000 7fd13cff9640 1 -- 172.21.15.88:0/4146762545 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd134003a90 con 0x7fd140101a60 2024-09-17T04:23:13.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.727+0000 7fd145f02640 1 -- 172.21.15.88:0/4146762545 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd14019f200 con 0x7fd140101a60 2024-09-17T04:23:13.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.728+0000 7fd145f02640 1 -- 172.21.15.88:0/4146762545 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd140100c60 con 0x7fd140101a60 2024-09-17T04:23:13.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.729+0000 7fd13cff9640 1 -- 172.21.15.88:0/4146762545 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 33) ==== 103422+0+0 (secure 0 0 0) 0x7fd134009970 con 0x7fd140101a60 2024-09-17T04:23:13.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.729+0000 7fd13cff9640 1 --2- 172.21.15.88:0/4146762545 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fd12807b050 0x7fd12807d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:13.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.729+0000 7fd13cff9640 1 -- 172.21.15.88:0/4146762545 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7fd13409de40 con 0x7fd140101a60 2024-09-17T04:23:13.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.729+0000 7fd13f7fe640 1 --2- 172.21.15.88:0/4146762545 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fd12807b050 0x7fd12807d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:13.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.730+0000 7fd13f7fe640 1 --2- 172.21.15.88:0/4146762545 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fd12807b050 0x7fd12807d510 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd1300308f0 tx=0x7fd130009490 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:13.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.733+0000 7fd13cff9640 1 -- 172.21.15.88:0/4146762545 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fd1340691d0 con 0x7fd140101a60 2024-09-17T04:23:13.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.927+0000 7fd145f02640 1 -- 172.21.15.88:0/4146762545 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fd14019f4e0 con 0x7fd12807b050 2024-09-17T04:23:13.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.928+0000 7fd13cff9640 1 -- 172.21.15.88:0/4146762545 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+368 (secure 0 0 0) 0x7fd14019f4e0 con 0x7fd12807b050 2024-09-17T04:23:13.928 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-17T04:23:13.928 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f", 2024-09-17T04:23:13.928 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-09-17T04:23:13.928 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T04:23:13.928 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [ 2024-09-17T04:23:13.928 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr" 2024-09-17T04:23:13.928 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-17T04:23:13.928 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "3/23 daemons upgraded", 2024-09-17T04:23:13.928 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading mon daemons", 2024-09-17T04:23:13.929 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-09-17T04:23:13.929 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-17T04:23:13.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.930+0000 7fd145f02640 1 -- 172.21.15.88:0/4146762545 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fd12807b050 msgr2=0x7fd12807d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:13.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.930+0000 7fd145f02640 1 --2- 172.21.15.88:0/4146762545 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fd12807b050 0x7fd12807d510 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd1300308f0 tx=0x7fd130009490 comp rx=0 tx=0).stop 2024-09-17T04:23:13.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.930+0000 7fd145f02640 1 -- 172.21.15.88:0/4146762545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd140101a60 msgr2=0x7fd140199c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:13.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.930+0000 7fd145f02640 1 --2- 172.21.15.88:0/4146762545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd140101a60 0x7fd140199c10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd13400d6a0 tx=0x7fd13400db60 comp rx=0 tx=0).stop 2024-09-17T04:23:13.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.931+0000 7fd145f02640 1 -- 172.21.15.88:0/4146762545 shutdown_connections 2024-09-17T04:23:13.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.931+0000 7fd145f02640 1 --2- 172.21.15.88:0/4146762545 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fd12807b050 0x7fd12807d510 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:13.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.931+0000 7fd145f02640 1 --2- 172.21.15.88:0/4146762545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd140101a60 0x7fd140199c10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:13.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.931+0000 7fd145f02640 1 --2- 172.21.15.88:0/4146762545 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd140100860 0x7fd1401996d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:13.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.931+0000 7fd145f02640 1 -- 172.21.15.88:0/4146762545 >> 172.21.15.88:0/4146762545 conn(0x7fd1400fc010 msgr2=0x7fd14006a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:13.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.931+0000 7fd145f02640 1 -- 172.21.15.88:0/4146762545 shutdown_connections 2024-09-17T04:23:13.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:13.931+0000 7fd145f02640 1 -- 172.21.15.88:0/4146762545 wait complete. 2024-09-17T04:23:14.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:14.012+0000 7fb09192d640 1 -- 172.21.15.88:0/900468952 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb08c101a60 msgr2=0x7fb08c101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:14.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:14.012+0000 7fb09192d640 1 --2- 172.21.15.88:0/900468952 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb08c101a60 0x7fb08c101ee0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb0800097e0 tx=0x7fb08002a3f0 comp rx=0 tx=0).stop 2024-09-17T04:23:14.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:14.012+0000 7fb09192d640 1 -- 172.21.15.88:0/900468952 shutdown_connections 2024-09-17T04:23:14.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:14.012+0000 7fb09192d640 1 --2- 172.21.15.88:0/900468952 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb08c101a60 0x7fb08c101ee0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:14.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:14.012+0000 7fb09192d640 1 --2- 172.21.15.88:0/900468952 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb08c100860 0x7fb08c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:14.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:14.012+0000 7fb09192d640 1 -- 172.21.15.88:0/900468952 >> 172.21.15.88:0/900468952 conn(0x7fb08c0fc010 msgr2=0x7fb08c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:14.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:14.012+0000 7fb09192d640 1 -- 172.21.15.88:0/900468952 shutdown_connections 2024-09-17T04:23:14.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:14.012+0000 7fb09192d640 1 -- 172.21.15.88:0/900468952 wait complete. 2024-09-17T04:23:14.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:14.013+0000 7fb09192d640 1 Processor -- start 2024-09-17T04:23:14.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:14.013+0000 7fb09192d640 1 -- start start 2024-09-17T04:23:14.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:14.013+0000 7fb09192d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb08c100860 0x7fb08c197540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:14.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:14.013+0000 7fb09192d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb08c101a60 0x7fb08c197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:14.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:14.013+0000 7fb09192d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fb08c1096a0 con 0x7fb08c101a60 2024-09-17T04:23:14.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:14.013+0000 7fb09192d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb08c109520 con 0x7fb08c100860 2024-09-17T04:23:14.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:14.014+0000 7fb08a7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb08c101a60 0x7fb08c197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:14.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:14.014+0000 7fb08a7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb08c101a60 0x7fb08c197a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55958/0 (socket says 172.21.15.88:55958) 2024-09-17T04:23:14.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:14.014+0000 7fb08a7fc640 1 -- 172.21.15.88:0/99923896 learned_addr learned my addr 172.21.15.88:0/99923896 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:23:14.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:14.014+0000 7fb08affd640 1 --2- 172.21.15.88:0/99923896 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb08c100860 0x7fb08c197540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:14.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:14.014+0000 7fb08a7fc640 1 -- 172.21.15.88:0/99923896 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb08c101a60 msgr2=0x7fb08c197a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-17T04:23:14.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:14.014+0000 7fb08a7fc640 1 -- 172.21.15.88:0/99923896 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb08c101a60 msgr2=0x7fb08c197a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-17T04:23:14.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:14.014+0000 7fb08a7fc640 1 --2- 172.21.15.88:0/99923896 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb08c101a60 0x7fb08c197a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-17T04:23:14.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:14.014+0000 7fb08a7fc640 1 --2- 172.21.15.88:0/99923896 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb08c101a60 0x7fb08c197a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T04:23:14.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:14.014+0000 7fb08affd640 1 -- 172.21.15.88:0/99923896 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb08c101a60 msgr2=0x7fb08c197a80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T04:23:14.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:14.014+0000 7fb08affd640 1 --2- 172.21.15.88:0/99923896 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb08c101a60 0x7fb08c197a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:14.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:14.014+0000 7fb08affd640 1 -- 172.21.15.88:0/99923896 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb08c198100 con 0x7fb08c100860 2024-09-17T04:23:14.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:14.014+0000 7fb08affd640 1 --2- 172.21.15.88:0/99923896 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb08c100860 0x7fb08c197540 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb07c00d6a0 tx=0x7fb07c00db60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:14.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:14.014+0000 7fb09092b640 1 -- 172.21.15.88:0/99923896 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb07c017070 con 0x7fb08c100860 2024-09-17T04:23:14.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:14.014+0000 7fb09192d640 1 -- 172.21.15.88:0/99923896 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb08c19cb40 con 0x7fb08c100860 2024-09-17T04:23:14.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:14.014+0000 7fb09192d640 1 -- 172.21.15.88:0/99923896 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb08c19d0d0 con 0x7fb08c100860 2024-09-17T04:23:14.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:14.015+0000 7fb09092b640 1 -- 172.21.15.88:0/99923896 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb07c009820 con 0x7fb08c100860 2024-09-17T04:23:14.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:14.015+0000 7fb09092b640 1 -- 172.21.15.88:0/99923896 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb07c003a50 con 0x7fb08c100860 2024-09-17T04:23:14.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:14.015+0000 7fb09192d640 1 -- 172.21.15.88:0/99923896 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb078005290 con 0x7fb08c100860 2024-09-17T04:23:14.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:14.016+0000 7fb09092b640 1 -- 172.21.15.88:0/99923896 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 33) ==== 103422+0+0 (secure 0 0 0) 0x7fb07c0099d0 con 0x7fb08c100860 2024-09-17T04:23:14.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:14.017+0000 7fb09092b640 1 --2- 172.21.15.88:0/99923896 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fb07407b050 0x7fb07407d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:14.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:14.017+0000 7fb09092b640 1 -- 172.21.15.88:0/99923896 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7fb07c09dcb0 con 0x7fb08c100860 2024-09-17T04:23:14.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:14.017+0000 7fb08a7fc640 1 --2- 172.21.15.88:0/99923896 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fb07407b050 0x7fb07407d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:14.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:14.017+0000 7fb08a7fc640 1 --2- 172.21.15.88:0/99923896 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fb07407b050 0x7fb07407d510 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb08c1989f0 tx=0x7fb080030890 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:14.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:14.020+0000 7fb09092b640 1 -- 172.21.15.88:0/99923896 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fb07c069200 con 0x7fb08c100860 2024-09-17T04:23:14.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:14 smithi134 ceph-mon[35201]: from='client.24629 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:23:14.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:14 smithi134 ceph-mon[35201]: from='client.24633 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:23:14.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:14 smithi134 ceph-mon[35201]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:14.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:14 smithi134 ceph-mon[35201]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:14.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:14 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:23:14.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:14 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:23:14.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:14 smithi134 ceph-mon[35201]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:14.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:14 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:23:14.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:14 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T04:23:14.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:14 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-17T04:23:14.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:14 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/2955982882' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T04:23:14.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:14 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/4046151486' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T04:23:14.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:14.266+0000 7fb09192d640 1 -- 172.21.15.88:0/99923896 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fb078005850 con 0x7fb08c100860 2024-09-17T04:23:14.267 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:14 smithi088 ceph-mon[90867]: from='client.24629 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:23:14.267 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:14 smithi088 ceph-mon[90867]: from='client.24633 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:23:14.267 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:14 smithi088 ceph-mon[90867]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:14.267 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:14 smithi088 ceph-mon[90867]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:14.267 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:14 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:23:14.267 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:14 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T04:23:14.267 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:14 smithi088 ceph-mon[90867]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:14.267 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:14 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T04:23:14.267 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:14 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T04:23:14.267 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:14 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-17T04:23:14.267 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:14 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/2955982882' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T04:23:14.268 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:14 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/4046151486' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T04:23:14.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:14.267+0000 7fb09092b640 1 -- 172.21.15.88:0/99923896 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7fb07c05ee20 con 0x7fb08c100860 2024-09-17T04:23:14.268 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T04:23:14.268 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T04:23:14.268 INFO:teuthology.orchestra.run.smithi088.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T04:23:14.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:14.269+0000 7fb09192d640 1 -- 172.21.15.88:0/99923896 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fb07407b050 msgr2=0x7fb07407d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:14.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:14.269+0000 7fb09192d640 1 --2- 172.21.15.88:0/99923896 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fb07407b050 0x7fb07407d510 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb08c1989f0 tx=0x7fb080030890 comp rx=0 tx=0).stop 2024-09-17T04:23:14.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:14.269+0000 7fb09192d640 1 -- 172.21.15.88:0/99923896 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb08c100860 msgr2=0x7fb08c197540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:14.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:14.269+0000 7fb09192d640 1 --2- 172.21.15.88:0/99923896 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb08c100860 0x7fb08c197540 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb07c00d6a0 tx=0x7fb07c00db60 comp rx=0 tx=0).stop 2024-09-17T04:23:14.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:14.269+0000 7fb09192d640 1 -- 172.21.15.88:0/99923896 shutdown_connections 2024-09-17T04:23:14.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:14.269+0000 7fb09192d640 1 --2- 172.21.15.88:0/99923896 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fb07407b050 0x7fb07407d510 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:14.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:14.269+0000 7fb09192d640 1 --2- 172.21.15.88:0/99923896 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb08c101a60 0x7fb08c197a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:14.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:14.269+0000 7fb09192d640 1 --2- 172.21.15.88:0/99923896 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb08c100860 0x7fb08c197540 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:14.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:14.269+0000 7fb09192d640 1 -- 172.21.15.88:0/99923896 >> 172.21.15.88:0/99923896 conn(0x7fb08c0fc010 msgr2=0x7fb08c06a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:14.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:14.269+0000 7fb09192d640 1 -- 172.21.15.88:0/99923896 shutdown_connections 2024-09-17T04:23:14.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:14.269+0000 7fb09192d640 1 -- 172.21.15.88:0/99923896 wait complete. 2024-09-17T04:23:15.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:15 smithi134 ceph-mon[35201]: from='client.24645 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:23:15.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:15 smithi134 ceph-mon[35201]: from='client.? 172.21.15.88:0/99923896' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T04:23:15.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:15 smithi134 ceph-mon[35201]: pgmap v35: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:23:15.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:15 smithi134 ceph-mon[35201]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:15.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:15 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T04:23:15.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:15 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T04:23:15.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:15 smithi134 ceph-mon[35201]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:23:15.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:15 smithi088 ceph-mon[90867]: from='client.24645 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:23:15.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:15 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/99923896' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T04:23:15.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:15 smithi088 ceph-mon[90867]: pgmap v35: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:23:15.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:15 smithi088 ceph-mon[90867]: from='mgr.14858 ' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:15.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:15 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T04:23:15.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:15 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T04:23:15.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:15 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T04:23:16.278 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:16 smithi134 ceph-mon[35201]: Upgrade: Updating mon.smithi134 2024-09-17T04:23:16.278 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:16 smithi134 ceph-mon[35201]: Deploying daemon mon.smithi134 on smithi134 2024-09-17T04:23:16.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:16 smithi088 ceph-mon[90867]: Upgrade: Updating mon.smithi134 2024-09-17T04:23:16.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:16 smithi088 ceph-mon[90867]: Deploying daemon mon.smithi134 on smithi134 2024-09-17T04:23:16.582 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:16 smithi134 systemd[1]: Stopping Ceph mon.smithi134 for bf2b79a4-74aa-11ef-bceb-c7b262605968... 2024-09-17T04:23:16.582 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:16 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-mon-smithi134[35195]: 2024-09-17T04:23:16.521+0000 7f3575e82640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi134 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T04:23:16.583 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:16 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-mon-smithi134[35195]: 2024-09-17T04:23:16.521+0000 7f3575e82640 -1 mon.smithi134@1(peon) e2 *** Got Signal Terminated *** 2024-09-17T04:23:16.888 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:16 smithi134 podman[76517]: 2024-09-17 04:23:16.583205538 +0000 UTC m=+0.160008626 container died 89de63fb6386c4f5188f4050c55b493b65494feb5afb32676bac5c8c50fbef78 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-mon-smithi134, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97) 2024-09-17T04:23:17.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:16 smithi134 podman[76517]: 2024-09-17 04:23:16.988400675 +0000 UTC m=+0.565203762 container cleanup 89de63fb6386c4f5188f4050c55b493b65494feb5afb32676bac5c8c50fbef78 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-mon-smithi134, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T04:23:17.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:16 smithi134 bash[76517]: ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-mon-smithi134 2024-09-17T04:23:17.472 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:17 smithi134 podman[76529]: 2024-09-17 04:23:17.222771506 +0000 UTC m=+0.636263493 container remove 89de63fb6386c4f5188f4050c55b493b65494feb5afb32676bac5c8c50fbef78 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-mon-smithi134, RELEASE=squid-c2ddf97, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2) 2024-09-17T04:23:17.473 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:17 smithi134 systemd[1]: ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968@mon.smithi134.service: Deactivated successfully. 2024-09-17T04:23:17.473 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:17 smithi134 systemd[1]: Stopped Ceph mon.smithi134 for bf2b79a4-74aa-11ef-bceb-c7b262605968. 2024-09-17T04:23:17.473 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:17 smithi134 systemd[1]: ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968@mon.smithi134.service: Consumed 6.228s CPU time. 2024-09-17T04:23:17.838 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:17 smithi134 systemd[1]: Starting Ceph mon.smithi134 for bf2b79a4-74aa-11ef-bceb-c7b262605968... 2024-09-17T04:23:18.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:17 smithi134 podman[76658]: 2024-09-17 04:23:17.775671221 +0000 UTC m=+0.015865064 image pull 8e039cb7fe1eece5854872e8884a61a26632c7691b2c85cbac9078a9c5c62fae quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f 2024-09-17T04:23:18.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:17 smithi134 podman[76658]: 2024-09-17 04:23:17.91113974 +0000 UTC m=+0.151333580 container create ea49f690e26b3fedf26718ff186d78657b883cb4ce33257307b4f59e6371eadf (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-mon-smithi134, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-17T04:23:18.539 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 podman[76658]: 2024-09-17 04:23:18.171961326 +0000 UTC m=+0.412155174 container init ea49f690e26b3fedf26718ff186d78657b883cb4ce33257307b4f59e6371eadf (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-mon-smithi134, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-17T04:23:18.539 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 podman[76658]: 2024-09-17 04:23:18.175379907 +0000 UTC m=+0.415573748 container start ea49f690e26b3fedf26718ff186d78657b883cb4ce33257307b4f59e6371eadf (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-mon-smithi134, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342) 2024-09-17T04:23:18.540 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: set uid:gid to 167:167 (ceph:ceph) 2024-09-17T04:23:18.540 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev), process ceph-mon, pid 2 2024-09-17T04:23:18.540 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: pidfile_write: ignore empty --pid-file 2024-09-17T04:23:18.540 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: load: jerasure load: lrc 2024-09-17T04:23:18.540 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: RocksDB version: 7.9.2 2024-09-17T04:23:18.540 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Git sha 0 2024-09-17T04:23:18.540 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Compile date 2024-09-17 00:23:36 2024-09-17T04:23:18.540 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: DB SUMMARY 2024-09-17T04:23:18.540 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: DB Session ID: A10BTAUSCL0Q4PO3PAEI 2024-09-17T04:23:18.540 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: CURRENT file: CURRENT 2024-09-17T04:23:18.540 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: IDENTITY file: IDENTITY 2024-09-17T04:23:18.540 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: MANIFEST file: MANIFEST-000010 size: 1411 Bytes 2024-09-17T04:23:18.541 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi134/store.db dir, Total Num: 1, files: 000027.sst 2024-09-17T04:23:18.541 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi134/store.db: 000025.log size: 424629 ; 2024-09-17T04:23:18.541 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.error_if_exists: 0 2024-09-17T04:23:18.541 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.create_if_missing: 0 2024-09-17T04:23:18.541 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.paranoid_checks: 1 2024-09-17T04:23:18.541 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-17T04:23:18.541 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-17T04:23:18.541 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-17T04:23:18.541 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.env: 0x5624eac85d60 2024-09-17T04:23:18.541 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.fs: PosixFileSystem 2024-09-17T04:23:18.541 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.info_log: 0x5624f0f0d580 2024-09-17T04:23:18.541 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.max_file_opening_threads: 16 2024-09-17T04:23:18.543 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.statistics: (nil) 2024-09-17T04:23:18.543 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.use_fsync: 0 2024-09-17T04:23:18.543 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.max_log_file_size: 0 2024-09-17T04:23:18.543 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-17T04:23:18.543 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-17T04:23:18.543 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.keep_log_file_num: 1000 2024-09-17T04:23:18.543 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.recycle_log_file_num: 0 2024-09-17T04:23:18.543 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.allow_fallocate: 1 2024-09-17T04:23:18.544 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.allow_mmap_reads: 0 2024-09-17T04:23:18.544 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.allow_mmap_writes: 0 2024-09-17T04:23:18.544 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.use_direct_reads: 0 2024-09-17T04:23:18.544 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-17T04:23:18.544 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.create_missing_column_families: 0 2024-09-17T04:23:18.544 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.db_log_dir: 2024-09-17T04:23:18.544 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.wal_dir: 2024-09-17T04:23:18.544 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-17T04:23:18.544 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-17T04:23:18.544 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-17T04:23:18.544 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-17T04:23:18.544 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-17T04:23:18.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-17T04:23:18.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.advise_random_on_open: 1 2024-09-17T04:23:18.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.db_write_buffer_size: 0 2024-09-17T04:23:18.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.write_buffer_manager: 0x5624f0f11d60 2024-09-17T04:23:18.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-17T04:23:18.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-17T04:23:18.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-17T04:23:18.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.rate_limiter: (nil) 2024-09-17T04:23:18.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-17T04:23:18.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.wal_recovery_mode: 2 2024-09-17T04:23:18.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.enable_thread_tracking: 0 2024-09-17T04:23:18.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.enable_pipelined_write: 0 2024-09-17T04:23:18.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.unordered_write: 0 2024-09-17T04:23:18.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-17T04:23:18.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-17T04:23:18.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-17T04:23:18.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-17T04:23:18.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.row_cache: None 2024-09-17T04:23:18.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.wal_filter: None 2024-09-17T04:23:18.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-17T04:23:18.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.allow_ingest_behind: 0 2024-09-17T04:23:18.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.two_write_queues: 0 2024-09-17T04:23:18.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.manual_wal_flush: 0 2024-09-17T04:23:18.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.wal_compression: 0 2024-09-17T04:23:18.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.atomic_flush: 0 2024-09-17T04:23:18.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-17T04:23:18.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-17T04:23:18.547 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-17T04:23:18.547 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.log_readahead_size: 0 2024-09-17T04:23:18.547 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-17T04:23:18.547 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.best_efforts_recovery: 0 2024-09-17T04:23:18.547 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-17T04:23:18.547 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-17T04:23:18.547 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.allow_data_in_errors: 0 2024-09-17T04:23:18.547 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.db_host_id: __hostname__ 2024-09-17T04:23:18.547 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-17T04:23:18.547 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.max_background_jobs: 2 2024-09-17T04:23:18.547 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.max_background_compactions: -1 2024-09-17T04:23:18.547 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.max_subcompactions: 1 2024-09-17T04:23:18.547 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-17T04:23:18.548 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-17T04:23:18.548 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-17T04:23:18.548 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.max_total_wal_size: 0 2024-09-17T04:23:18.548 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-17T04:23:18.548 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-17T04:23:18.548 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-17T04:23:18.548 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-17T04:23:18.548 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.max_open_files: -1 2024-09-17T04:23:18.549 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.bytes_per_sync: 0 2024-09-17T04:23:18.549 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-17T04:23:18.549 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-17T04:23:18.549 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.compaction_readahead_size: 0 2024-09-17T04:23:18.549 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.max_background_flushes: -1 2024-09-17T04:23:18.549 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Compression algorithms supported: 2024-09-17T04:23:18.549 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: kZSTD supported: 0 2024-09-17T04:23:18.549 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: kXpressCompression supported: 0 2024-09-17T04:23:18.549 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: kBZip2Compression supported: 0 2024-09-17T04:23:18.549 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-17T04:23:18.549 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: kLZ4Compression supported: 1 2024-09-17T04:23:18.549 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: kZlibCompression supported: 1 2024-09-17T04:23:18.549 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: kLZ4HCCompression supported: 1 2024-09-17T04:23:18.550 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: kSnappyCompression supported: 1 2024-09-17T04:23:18.550 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-17T04:23:18.550 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-17T04:23:18.550 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi134/store.db/MANIFEST-000010 2024-09-17T04:23:18.550 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-17T04:23:18.550 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-17T04:23:18.550 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.merge_operator: 2024-09-17T04:23:18.550 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.compaction_filter: None 2024-09-17T04:23:18.550 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.compaction_filter_factory: None 2024-09-17T04:23:18.550 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.sst_partitioner_factory: None 2024-09-17T04:23:18.550 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-17T04:23:18.550 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-17T04:23:18.550 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5624f0f0d1a0) 2024-09-17T04:23:18.551 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: cache_index_and_filter_blocks: 1 2024-09-17T04:23:18.551 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-17T04:23:18.551 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-17T04:23:18.551 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: pin_top_level_index_and_filter: 1 2024-09-17T04:23:18.551 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: index_type: 0 2024-09-17T04:23:18.551 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: data_block_index_type: 0 2024-09-17T04:23:18.551 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: index_shortening: 1 2024-09-17T04:23:18.551 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-17T04:23:18.551 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: checksum: 4 2024-09-17T04:23:18.551 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: no_block_cache: 0 2024-09-17T04:23:18.551 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_cache: 0x5624eced1610 2024-09-17T04:23:18.551 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_cache_name: BinnedLRUCache 2024-09-17T04:23:18.551 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_cache_options: 2024-09-17T04:23:18.551 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: capacity : 536870912 2024-09-17T04:23:18.552 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: num_shard_bits : 4 2024-09-17T04:23:18.552 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: strict_capacity_limit : 0 2024-09-17T04:23:18.552 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: high_pri_pool_ratio: 0.000 2024-09-17T04:23:18.552 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_cache_compressed: (nil) 2024-09-17T04:23:18.552 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: persistent_cache: (nil) 2024-09-17T04:23:18.552 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_size: 4096 2024-09-17T04:23:18.552 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_size_deviation: 10 2024-09-17T04:23:18.552 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_restart_interval: 16 2024-09-17T04:23:18.552 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: index_block_restart_interval: 1 2024-09-17T04:23:18.552 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: metadata_block_size: 4096 2024-09-17T04:23:18.552 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: partition_filters: 0 2024-09-17T04:23:18.552 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: use_delta_encoding: 1 2024-09-17T04:23:18.552 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: filter_policy: bloomfilter 2024-09-17T04:23:18.552 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: whole_key_filtering: 1 2024-09-17T04:23:18.553 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: verify_compression: 0 2024-09-17T04:23:18.553 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: read_amp_bytes_per_bit: 0 2024-09-17T04:23:18.553 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: format_version: 5 2024-09-17T04:23:18.553 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: enable_index_compression: 1 2024-09-17T04:23:18.553 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_align: 0 2024-09-17T04:23:18.553 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: max_auto_readahead_size: 262144 2024-09-17T04:23:18.553 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: prepopulate_block_cache: 0 2024-09-17T04:23:18.553 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: initial_auto_readahead_size: 8192 2024-09-17T04:23:18.553 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: num_file_reads_for_auto_readahead: 2 2024-09-17T04:23:18.553 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.write_buffer_size: 33554432 2024-09-17T04:23:18.553 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.max_write_buffer_number: 2 2024-09-17T04:23:18.553 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.compression: NoCompression 2024-09-17T04:23:18.553 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.bottommost_compression: Disabled 2024-09-17T04:23:18.553 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.prefix_extractor: nullptr 2024-09-17T04:23:18.554 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-17T04:23:18.554 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.num_levels: 7 2024-09-17T04:23:18.554 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-17T04:23:18.554 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-17T04:23:18.554 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-17T04:23:18.554 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-17T04:23:18.554 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-17T04:23:18.554 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-17T04:23:18.554 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-17T04:23:18.554 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-17T04:23:18.554 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-17T04:23:18.554 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-17T04:23:18.554 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-17T04:23:18.554 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-17T04:23:18.555 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-17T04:23:18.555 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.compression_opts.level: 32767 2024-09-17T04:23:18.555 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.compression_opts.strategy: 0 2024-09-17T04:23:18.555 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-17T04:23:18.555 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-17T04:23:18.555 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-17T04:23:18.555 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-17T04:23:18.555 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.compression_opts.enabled: false 2024-09-17T04:23:18.555 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-17T04:23:18.555 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-17T04:23:18.555 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-17T04:23:18.555 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-17T04:23:18.555 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.target_file_size_base: 67108864 2024-09-17T04:23:18.555 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-17T04:23:18.556 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-17T04:23:18.556 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-17T04:23:18.556 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-17T04:23:18.556 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-17T04:23:18.556 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-17T04:23:18.556 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-17T04:23:18.556 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-17T04:23:18.556 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-17T04:23:18.556 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-17T04:23:18.556 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-17T04:23:18.556 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-17T04:23:18.556 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-17T04:23:18.557 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-17T04:23:18.557 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.arena_block_size: 1048576 2024-09-17T04:23:18.557 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-17T04:23:18.557 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-17T04:23:18.557 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.disable_auto_compactions: 0 2024-09-17T04:23:18.557 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-17T04:23:18.557 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-17T04:23:18.557 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-17T04:23:18.557 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-17T04:23:18.557 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-17T04:23:18.557 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-17T04:23:18.557 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-17T04:23:18.557 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-17T04:23:18.558 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-17T04:23:18.558 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-17T04:23:18.558 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-17T04:23:18.558 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.inplace_update_support: 0 2024-09-17T04:23:18.558 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-17T04:23:18.558 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-17T04:23:18.558 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-17T04:23:18.558 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-17T04:23:18.558 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.bloom_locality: 0 2024-09-17T04:23:18.558 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.max_successive_merges: 0 2024-09-17T04:23:18.558 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-17T04:23:18.558 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.paranoid_file_checks: 0 2024-09-17T04:23:18.558 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.force_consistency_checks: 1 2024-09-17T04:23:18.559 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.report_bg_io_stats: 0 2024-09-17T04:23:18.559 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.ttl: 2592000 2024-09-17T04:23:18.559 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-17T04:23:18.559 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-17T04:23:18.559 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-17T04:23:18.559 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.enable_blob_files: false 2024-09-17T04:23:18.559 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.min_blob_size: 0 2024-09-17T04:23:18.559 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.blob_file_size: 268435456 2024-09-17T04:23:18.559 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-17T04:23:18.559 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-17T04:23:18.559 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-17T04:23:18.559 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-17T04:23:18.559 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-17T04:23:18.560 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.blob_file_starting_level: 0 2024-09-17T04:23:18.560 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-17T04:23:18.560 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-17T04:23:18.560 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi134/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 29, last_sequence is 12274, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 25 2024-09-17T04:23:18.560 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-09-17T04:23:18.560 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e0a6f3dc-2439-4ea3-bbce-edfa023dcf7e 2024-09-17T04:23:18.560 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726546998212363, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-09-17T04:23:18.560 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-09-17T04:23:18.560 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726546998214238, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 250833, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12279, "largest_seqno": 12492, "table_properties": {"data_size": 248898, "index_size": 641, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 261, "raw_key_size": 2271, "raw_average_key_size": 23, "raw_value_size": 246693, "raw_average_value_size": 2596, "num_data_blocks": 28, "num_entries": 95, "num_filter_entries": 95, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726546998, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "e0a6f3dc-2439-4ea3-bbce-edfa023dcf7e", "db_session_id": "A10BTAUSCL0Q4PO3PAEI", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-09-17T04:23:18.560 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726546998214336, "job": 1, "event": "recovery_finished"} 2024-09-17T04:23:18.560 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-09-17T04:23:18.560 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-17T04:23:18.560 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi134/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-17T04:23:18.560 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5624f0f30a80 2024-09-17T04:23:18.561 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: DB pointer 0x5624f1cd6000 2024-09-17T04:23:18.561 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-17T04:23:18.561 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-17T04:23:18.561 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ** DB Stats ** 2024-09-17T04:23:18.561 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T04:23:18.561 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-17T04:23:18.561 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T04:23:18.561 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T04:23:18.561 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-17T04:23:18.561 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T04:23:18.561 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T04:23:18.561 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-09-17T04:23:18.561 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ** Compaction Stats [default] ** 2024-09-17T04:23:18.561 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T04:23:18.562 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-17T04:23:18.562 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: L0 1/0 244.95 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 276.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-17T04:23:18.562 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: L6 1/0 7.48 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-17T04:23:18.562 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Sum 2/0 7.72 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 276.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-17T04:23:18.562 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 276.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-17T04:23:18.562 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-09-17T04:23:18.562 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ** Compaction Stats [default] ** 2024-09-17T04:23:18.562 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T04:23:18.562 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-17T04:23:18.562 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 276.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-17T04:23:18.562 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-09-17T04:23:18.562 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-17T04:23:18.562 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-09-17T04:23:18.562 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T04:23:18.563 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-17T04:23:18.563 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-17T04:23:18.563 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-17T04:23:18.563 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-17T04:23:18.563 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-17T04:23:18.563 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Cumulative compaction: 0.00 GB write, 37.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T04:23:18.563 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Interval compaction: 0.00 GB write, 37.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T04:23:18.563 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-17T04:23:18.563 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Block cache BinnedLRUCache@0x5624eced1610#2 capacity: 512.00 MB usage: 1.09 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.3e-05 secs_since: 0 2024-09-17T04:23:18.563 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.32 KB,6.10948e-05%) IndexBlock(1,0.77 KB,0.000146031%) Misc(1,0.00 KB,0%) 2024-09-17T04:23:18.563 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-09-17T04:23:18.563 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-17T04:23:18.563 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: starting mon.smithi134 rank 1 at public addrs [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] at bind addrs [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi134 fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 2024-09-17T04:23:18.563 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: mon.smithi134@-1(???) e2 preinit fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 2024-09-17T04:23:18.564 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: mon.smithi134@-1(???).mds e15 new map 2024-09-17T04:23:18.564 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: mon.smithi134@-1(???).mds e15 print_map 2024-09-17T04:23:18.564 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: e15 2024-09-17T04:23:18.564 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: btime 2024-09-17T04:18:27:750910+0000 2024-09-17T04:23:18.564 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T04:23:18.564 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:23:18.564 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: legacy client fscid: 1 2024-09-17T04:23:18.564 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-09-17T04:23:18.564 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Filesystem 'cephfs' (1) 2024-09-17T04:23:18.564 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: fs_name cephfs 2024-09-17T04:23:18.564 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: epoch 15 2024-09-17T04:23:18.565 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T04:23:18.565 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: created 2024-09-17T04:18:10.480573+0000 2024-09-17T04:23:18.565 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: modified 2024-09-17T04:18:27.750896+0000 2024-09-17T04:23:18.565 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: tableserver 0 2024-09-17T04:23:18.565 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: root 0 2024-09-17T04:23:18.565 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: session_timeout 60 2024-09-17T04:23:18.565 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: session_autoclose 300 2024-09-17T04:23:18.565 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: max_file_size 1099511627776 2024-09-17T04:23:18.565 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: max_xattr_size 65536 2024-09-17T04:23:18.565 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: required_client_features {} 2024-09-17T04:23:18.565 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: last_failure 0 2024-09-17T04:23:18.565 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: last_failure_osd_epoch 45 2024-09-17T04:23:18.565 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:23:18.565 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: max_mds 1 2024-09-17T04:23:18.566 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: in 0 2024-09-17T04:23:18.566 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: up {0=14590} 2024-09-17T04:23:18.566 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: failed 2024-09-17T04:23:18.566 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: damaged 2024-09-17T04:23:18.566 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: stopped 2024-09-17T04:23:18.566 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: data_pools [3] 2024-09-17T04:23:18.566 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: metadata_pool 2 2024-09-17T04:23:18.566 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: inline_data enabled 2024-09-17T04:23:18.566 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: balancer 2024-09-17T04:23:18.566 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: bal_rank_mask -1 2024-09-17T04:23:18.566 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: standby_count_wanted 1 2024-09-17T04:23:18.566 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: qdb_cluster leader: 14590 members: 14590 2024-09-17T04:23:18.566 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: [mds.cephfs.smithi088.giqrgt{0:14590} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.88:6828/1714846518,v1:172.21.15.88:6829/1714846518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:23:18.566 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: [mds.cephfs.smithi134.psnynp{0:24321} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.134:6826/2137586894,v1:172.21.15.134:6827/2137586894] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:23:18.567 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-09-17T04:23:18.567 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-09-17T04:23:18.567 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Standby daemons: 2024-09-17T04:23:18.567 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-09-17T04:23:18.567 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: [mds.cephfs.smithi134.ktuhce{-1:24325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/967997022,v1:172.21.15.134:6825/967997022] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:23:18.567 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: [mds.cephfs.smithi088.lgavsv{-1:24329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/1425146180,v1:172.21.15.88:6827/1425146180] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:23:18.567 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: mon.smithi134@-1(???).osd e47 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-17T04:23:18.567 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: mon.smithi134@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-17T04:23:18.567 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: mon.smithi134@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-17T04:23:18.567 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: mon.smithi134@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-17T04:23:18.567 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 ceph-mon[76677]: mon.smithi134@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2024-09-17T04:23:18.567 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 bash[76658]: ea49f690e26b3fedf26718ff186d78657b883cb4ce33257307b4f59e6371eadf 2024-09-17T04:23:18.567 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:18 smithi134 systemd[1]: Started Ceph mon.smithi134 for bf2b79a4-74aa-11ef-bceb-c7b262605968. 2024-09-17T04:23:19.835 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:19 smithi134 ceph-mon[76677]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-17T04:23:19.835 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:19 smithi134 ceph-mon[76677]: pgmap v37: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:23:19.836 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:19 smithi134 ceph-mon[76677]: mon.smithi134 calling monitor election 2024-09-17T04:23:19.836 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:19 smithi134 ceph-mon[76677]: mon.smithi088 calling monitor election 2024-09-17T04:23:19.836 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:19 smithi134 ceph-mon[76677]: mon.smithi088 is new leader, mons smithi088,smithi134 in quorum (ranks 0,1) 2024-09-17T04:23:19.836 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:19 smithi134 ceph-mon[76677]: monmap epoch 2 2024-09-17T04:23:19.836 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:19 smithi134 ceph-mon[76677]: fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 2024-09-17T04:23:19.836 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:19 smithi134 ceph-mon[76677]: last_changed 2024-09-17T04:13:45.364213+0000 2024-09-17T04:23:19.836 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:19 smithi134 ceph-mon[76677]: created 2024-09-17T04:11:18.564226+0000 2024-09-17T04:23:19.836 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:19 smithi134 ceph-mon[76677]: min_mon_release 19 (squid) 2024-09-17T04:23:19.836 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:19 smithi134 ceph-mon[76677]: election_strategy: 1 2024-09-17T04:23:19.836 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:19 smithi134 ceph-mon[76677]: 0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.smithi088 2024-09-17T04:23:19.836 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:19 smithi134 ceph-mon[76677]: 1: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.smithi134 2024-09-17T04:23:19.836 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:19 smithi134 ceph-mon[76677]: fsmap cephfs:1 {0=cephfs.smithi088.giqrgt=up:active} 1 up:standby-replay 2 up:standby 2024-09-17T04:23:19.836 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:19 smithi134 ceph-mon[76677]: osdmap e47: 6 total, 6 up, 6 in 2024-09-17T04:23:19.837 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:19 smithi134 ceph-mon[76677]: mgrmap e33: smithi088.wmndiv(active, since 68s), standbys: smithi134.vwdxcb 2024-09-17T04:23:19.837 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:19 smithi134 ceph-mon[76677]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T04:23:19.837 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:19 smithi134 ceph-mon[76677]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T04:23:19.837 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:19 smithi134 ceph-mon[76677]: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T04:23:19.837 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:19 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:19.837 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:19 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:19.837 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:19 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:23:19.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:19 smithi088 ceph-mon[90867]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-17T04:23:19.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:19 smithi088 ceph-mon[90867]: pgmap v37: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:23:19.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:19 smithi088 ceph-mon[90867]: mon.smithi134 calling monitor election 2024-09-17T04:23:19.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:19 smithi088 ceph-mon[90867]: mon.smithi088 calling monitor election 2024-09-17T04:23:19.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:19 smithi088 ceph-mon[90867]: mon.smithi088 is new leader, mons smithi088,smithi134 in quorum (ranks 0,1) 2024-09-17T04:23:19.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:19 smithi088 ceph-mon[90867]: monmap epoch 2 2024-09-17T04:23:19.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:19 smithi088 ceph-mon[90867]: fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 2024-09-17T04:23:19.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:19 smithi088 ceph-mon[90867]: last_changed 2024-09-17T04:13:45.364213+0000 2024-09-17T04:23:19.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:19 smithi088 ceph-mon[90867]: created 2024-09-17T04:11:18.564226+0000 2024-09-17T04:23:19.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:19 smithi088 ceph-mon[90867]: min_mon_release 19 (squid) 2024-09-17T04:23:19.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:19 smithi088 ceph-mon[90867]: election_strategy: 1 2024-09-17T04:23:19.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:19 smithi088 ceph-mon[90867]: 0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.smithi088 2024-09-17T04:23:19.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:19 smithi088 ceph-mon[90867]: 1: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.smithi134 2024-09-17T04:23:19.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:19 smithi088 ceph-mon[90867]: fsmap cephfs:1 {0=cephfs.smithi088.giqrgt=up:active} 1 up:standby-replay 2 up:standby 2024-09-17T04:23:19.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:19 smithi088 ceph-mon[90867]: osdmap e47: 6 total, 6 up, 6 in 2024-09-17T04:23:19.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:19 smithi088 ceph-mon[90867]: mgrmap e33: smithi088.wmndiv(active, since 68s), standbys: smithi134.vwdxcb 2024-09-17T04:23:19.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:19 smithi088 ceph-mon[90867]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T04:23:19.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:19 smithi088 ceph-mon[90867]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T04:23:19.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:19 smithi088 ceph-mon[90867]: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T04:23:19.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:19 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:19.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:19 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:19.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:19 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:23:20.806 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:20 smithi134 ceph-mon[76677]: pgmap v38: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:23:20.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:20 smithi088 ceph-mon[90867]: pgmap v38: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:23:22.590 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:22 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:22.590 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:22 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:22.590 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:22 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:22.590 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:22 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:22.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:22 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:22.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:22 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:22.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:22 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:22.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:22 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:23.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:23 smithi088 ceph-mon[90867]: pgmap v39: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:23:23.637 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:23 smithi134 ceph-mon[76677]: pgmap v39: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:23:24.865 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:24 smithi134 ceph-mon[76677]: pgmap v40: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:23:24.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:24 smithi088 ceph-mon[90867]: pgmap v40: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:23:26.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:26 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:26.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:26 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:26.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:26 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:23:26.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:26 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:23:26.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:26 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:26.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:26 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:23:26.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:26 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:23:26.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:26 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:23:26.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:26 smithi088 ceph-mon[90867]: Upgrade: Setting container_image for all mon 2024-09-17T04:23:26.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:26 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:26.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:26 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi088"} : dispatch 2024-09-17T04:23:26.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:26 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi088"}]': finished 2024-09-17T04:23:26.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:26 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi134"} : dispatch 2024-09-17T04:23:26.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:26 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi134"}]': finished 2024-09-17T04:23:26.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:26 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:23:26.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:26 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:26.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:26 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:26.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:26 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:23:26.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:26 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:23:26.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:26 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:26.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:26 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:23:26.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:26 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:23:26.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:26 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:23:26.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:26 smithi134 ceph-mon[76677]: Upgrade: Setting container_image for all mon 2024-09-17T04:23:26.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:26 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:26.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:26 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi088"} : dispatch 2024-09-17T04:23:26.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:26 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi088"}]': finished 2024-09-17T04:23:26.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:26 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi134"} : dispatch 2024-09-17T04:23:26.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:26 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi134"}]': finished 2024-09-17T04:23:26.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:26 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:23:27.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:27 smithi088 ceph-mon[90867]: pgmap v41: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T04:23:27.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:27 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:27.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:27 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi088", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-17T04:23:27.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:27 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:23:27.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:27 smithi134 ceph-mon[76677]: pgmap v41: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T04:23:27.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:27 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:27.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:27 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi088", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-17T04:23:27.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:27 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:23:28.386 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:28 smithi088 ceph-mon[90867]: Upgrade: Updating crash.smithi088 (1/2) 2024-09-17T04:23:28.386 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:28 smithi088 ceph-mon[90867]: Deploying daemon crash.smithi088 on smithi088 2024-09-17T04:23:28.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:28 smithi134 ceph-mon[76677]: Upgrade: Updating crash.smithi088 (1/2) 2024-09-17T04:23:28.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:28 smithi134 ceph-mon[76677]: Deploying daemon crash.smithi088 on smithi088 2024-09-17T04:23:29.602 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:29 smithi088 ceph-mon[90867]: pgmap v42: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:23:29.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:29 smithi134 ceph-mon[76677]: pgmap v42: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:23:31.746 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:31 smithi134 ceph-mon[76677]: pgmap v43: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:23:31.746 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:31 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:31.746 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:31 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:31.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:31 smithi088 ceph-mon[90867]: pgmap v43: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:23:31.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:31 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:31.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:31 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:33.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:32 smithi134 ceph-mon[76677]: Upgrade: Updating crash.smithi134 (2/2) 2024-09-17T04:23:33.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:32 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:33.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:32 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi134", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-17T04:23:33.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:32 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:23:33.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:32 smithi134 ceph-mon[76677]: Deploying daemon crash.smithi134 on smithi134 2024-09-17T04:23:33.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:32 smithi134 ceph-mon[76677]: pgmap v44: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:23:33.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:32 smithi088 ceph-mon[90867]: Upgrade: Updating crash.smithi134 (2/2) 2024-09-17T04:23:33.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:32 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:33.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:32 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi134", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-17T04:23:33.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:32 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:23:33.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:32 smithi088 ceph-mon[90867]: Deploying daemon crash.smithi134 on smithi134 2024-09-17T04:23:33.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:32 smithi088 ceph-mon[90867]: pgmap v44: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:23:34.644 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:34 smithi134 ceph-mon[76677]: pgmap v45: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:23:34.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:34 smithi088 ceph-mon[90867]: pgmap v45: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:23:36.623 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:36 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:36.623 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:36 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:36.623 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:36 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:23:36.623 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:36 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:36.623 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:36 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:36.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:36 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:36.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:36 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:36.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:36 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:23:36.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:36 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:36.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:36 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:37.520 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:37 smithi134 ceph-mon[76677]: pgmap v46: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T04:23:37.601 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:37 smithi088 ceph-mon[90867]: pgmap v46: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T04:23:39.533 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:39 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:39.533 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:39 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:39.533 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:39 smithi134 ceph-mon[76677]: pgmap v47: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:23:39.533 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:39 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:39.533 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:39 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:39.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:39 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:39.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:39 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:39.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:39 smithi088 ceph-mon[90867]: pgmap v47: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:23:39.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:39 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:39.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:39 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:41.575 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:41 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:41.575 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:41 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:41.575 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:41 smithi088 ceph-mon[90867]: pgmap v48: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:23:41.575 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:41 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:41.575 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:41 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:41.575 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:41 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:23:41.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:41 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:41.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:41 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:41.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:41 smithi134 ceph-mon[76677]: pgmap v48: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:23:41.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:41 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:41.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:41 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:41.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:41 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:23:43.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:43 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:43.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:43 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:43.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:43 smithi088 ceph-mon[90867]: mgrmap e34: smithi088.wmndiv(active, since 91s), standbys: smithi134.vwdxcb 2024-09-17T04:23:43.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:43 smithi088 ceph-mon[90867]: pgmap v49: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-17T04:23:43.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:43 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:43.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:43 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:43.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:43 smithi134 ceph-mon[76677]: mgrmap e34: smithi088.wmndiv(active, since 91s), standbys: smithi134.vwdxcb 2024-09-17T04:23:43.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:43 smithi134 ceph-mon[76677]: pgmap v49: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-17T04:23:44.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.355+0000 7f462148c640 1 -- 172.21.15.88:0/980660465 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f461c101a60 msgr2=0x7f461c101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:44.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.355+0000 7f462148c640 1 --2- 172.21.15.88:0/980660465 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f461c101a60 0x7f461c101ee0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4604009880 tx=0x7f460402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:23:44.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.356+0000 7f462148c640 1 -- 172.21.15.88:0/980660465 shutdown_connections 2024-09-17T04:23:44.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.356+0000 7f462148c640 1 --2- 172.21.15.88:0/980660465 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f461c101a60 0x7f461c101ee0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:44.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.356+0000 7f462148c640 1 --2- 172.21.15.88:0/980660465 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f461c100860 0x7f461c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:44.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.356+0000 7f462148c640 1 -- 172.21.15.88:0/980660465 >> 172.21.15.88:0/980660465 conn(0x7f461c0fc010 msgr2=0x7f461c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:44.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.356+0000 7f462148c640 1 -- 172.21.15.88:0/980660465 shutdown_connections 2024-09-17T04:23:44.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.356+0000 7f462148c640 1 -- 172.21.15.88:0/980660465 wait complete. 2024-09-17T04:23:44.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.356+0000 7f462148c640 1 Processor -- start 2024-09-17T04:23:44.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.356+0000 7f462148c640 1 -- start start 2024-09-17T04:23:44.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.357+0000 7f462148c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f461c100860 0x7f461c104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:44.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.357+0000 7f462148c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f461c101a60 0x7f461c102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:44.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.357+0000 7f462148c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f461c109720 con 0x7f461c101a60 2024-09-17T04:23:44.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.357+0000 7f462148c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f461c1095a0 con 0x7f461c100860 2024-09-17T04:23:44.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.357+0000 7f461a7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f461c101a60 0x7f461c102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:44.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.357+0000 7f461a7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f461c101a60 0x7f461c102e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46302/0 (socket says 172.21.15.88:46302) 2024-09-17T04:23:44.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.357+0000 7f461a7fc640 1 -- 172.21.15.88:0/103106281 learned_addr learned my addr 172.21.15.88:0/103106281 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:23:44.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.357+0000 7f461affd640 1 --2- 172.21.15.88:0/103106281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f461c100860 0x7f461c104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:44.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.357+0000 7f461a7fc640 1 -- 172.21.15.88:0/103106281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f461c100860 msgr2=0x7f461c104780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:44.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.357+0000 7f461a7fc640 1 --2- 172.21.15.88:0/103106281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f461c100860 0x7f461c104780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:44.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.357+0000 7f461a7fc640 1 -- 172.21.15.88:0/103106281 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f461c103380 con 0x7f461c101a60 2024-09-17T04:23:44.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.357+0000 7f461a7fc640 1 --2- 172.21.15.88:0/103106281 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f461c101a60 0x7f461c102e40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4604006010 tx=0x7f46040048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:44.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.357+0000 7f4613fff640 1 -- 172.21.15.88:0/103106281 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f460403f070 con 0x7f461c101a60 2024-09-17T04:23:44.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.357+0000 7f462148c640 1 -- 172.21.15.88:0/103106281 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f461c103610 con 0x7f461c101a60 2024-09-17T04:23:44.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.358+0000 7f462148c640 1 -- 172.21.15.88:0/103106281 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f461c103bc0 con 0x7f461c101a60 2024-09-17T04:23:44.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.358+0000 7f4613fff640 1 -- 172.21.15.88:0/103106281 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f46040044d0 con 0x7f461c101a60 2024-09-17T04:23:44.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.358+0000 7f4613fff640 1 -- 172.21.15.88:0/103106281 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4604035030 con 0x7f461c101a60 2024-09-17T04:23:44.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.359+0000 7f462148c640 1 -- 172.21.15.88:0/103106281 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45fc005290 con 0x7f461c101a60 2024-09-17T04:23:44.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.359+0000 7f4613fff640 1 -- 172.21.15.88:0/103106281 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f4604042070 con 0x7f461c101a60 2024-09-17T04:23:44.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.360+0000 7f4613fff640 1 --2- 172.21.15.88:0/103106281 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f460807af80 0x7f460807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:44.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.360+0000 7f4613fff640 1 -- 172.21.15.88:0/103106281 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7f46040beae0 con 0x7f461c101a60 2024-09-17T04:23:44.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.360+0000 7f461affd640 1 --2- 172.21.15.88:0/103106281 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f460807af80 0x7f460807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:44.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.360+0000 7f461affd640 1 --2- 172.21.15.88:0/103106281 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f460807af80 0x7f460807d440 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f461c1018c0 tx=0x7f4614008040 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:44.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.365+0000 7f4613fff640 1 -- 172.21.15.88:0/103106281 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f460408a1b0 con 0x7f461c101a60 2024-09-17T04:23:44.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.578+0000 7f462148c640 1 -- 172.21.15.88:0/103106281 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f45fc000bc0 con 0x7f460807af80 2024-09-17T04:23:44.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.580+0000 7f4613fff640 1 -- 172.21.15.88:0/103106281 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+402 (secure 0 0 0) 0x7f45fc000bc0 con 0x7f460807af80 2024-09-17T04:23:44.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.582+0000 7f462148c640 1 -- 172.21.15.88:0/103106281 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f460807af80 msgr2=0x7f460807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:44.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.582+0000 7f462148c640 1 --2- 172.21.15.88:0/103106281 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f460807af80 0x7f460807d440 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f461c1018c0 tx=0x7f4614008040 comp rx=0 tx=0).stop 2024-09-17T04:23:44.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.582+0000 7f462148c640 1 -- 172.21.15.88:0/103106281 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f461c101a60 msgr2=0x7f461c102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:44.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.582+0000 7f462148c640 1 --2- 172.21.15.88:0/103106281 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f461c101a60 0x7f461c102e40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4604006010 tx=0x7f46040048f0 comp rx=0 tx=0).stop 2024-09-17T04:23:44.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.582+0000 7f462148c640 1 -- 172.21.15.88:0/103106281 shutdown_connections 2024-09-17T04:23:44.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.582+0000 7f462148c640 1 --2- 172.21.15.88:0/103106281 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f460807af80 0x7f460807d440 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:44.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.582+0000 7f462148c640 1 --2- 172.21.15.88:0/103106281 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f461c101a60 0x7f461c102e40 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:44.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.582+0000 7f462148c640 1 --2- 172.21.15.88:0/103106281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f461c100860 0x7f461c104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:44.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.582+0000 7f462148c640 1 -- 172.21.15.88:0/103106281 >> 172.21.15.88:0/103106281 conn(0x7f461c0fc010 msgr2=0x7f461c069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:44.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.582+0000 7f462148c640 1 -- 172.21.15.88:0/103106281 shutdown_connections 2024-09-17T04:23:44.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.582+0000 7f462148c640 1 -- 172.21.15.88:0/103106281 wait complete. 2024-09-17T04:23:44.591 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-09-17T04:23:44.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:44 smithi088 ceph-mon[90867]: pgmap v50: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 255 B/s wr, 1 op/s 2024-09-17T04:23:44.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.676+0000 7fbd593d4640 1 -- 172.21.15.88:0/1696442787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbd54100880 msgr2=0x7fbd54100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:44.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.676+0000 7fbd593d4640 1 --2- 172.21.15.88:0/1696442787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbd54100880 0x7fbd54100c80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fbd44009880 tx=0x7fbd4402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:23:44.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.676+0000 7fbd593d4640 1 -- 172.21.15.88:0/1696442787 shutdown_connections 2024-09-17T04:23:44.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.676+0000 7fbd593d4640 1 --2- 172.21.15.88:0/1696442787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd54101a80 0x7fbd54101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:44.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.676+0000 7fbd593d4640 1 --2- 172.21.15.88:0/1696442787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbd54100880 0x7fbd54100c80 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:44.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.676+0000 7fbd593d4640 1 -- 172.21.15.88:0/1696442787 >> 172.21.15.88:0/1696442787 conn(0x7fbd540fc010 msgr2=0x7fbd540fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:44.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.676+0000 7fbd593d4640 1 -- 172.21.15.88:0/1696442787 shutdown_connections 2024-09-17T04:23:44.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.676+0000 7fbd593d4640 1 -- 172.21.15.88:0/1696442787 wait complete. 2024-09-17T04:23:44.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.676+0000 7fbd593d4640 1 Processor -- start 2024-09-17T04:23:44.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.677+0000 7fbd593d4640 1 -- start start 2024-09-17T04:23:44.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.677+0000 7fbd593d4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbd54100880 0x7fbd541974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:44.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.677+0000 7fbd593d4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd54101a80 0x7fbd54197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:44.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.677+0000 7fbd593d4640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fbd541096a0 con 0x7fbd54100880 2024-09-17T04:23:44.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.677+0000 7fbd593d4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbd54109520 con 0x7fbd54101a80 2024-09-17T04:23:44.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.677+0000 7fbd52ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbd54100880 0x7fbd541974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:44.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.677+0000 7fbd52ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbd54100880 0x7fbd541974f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46316/0 (socket says 172.21.15.88:46316) 2024-09-17T04:23:44.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.677+0000 7fbd52ffd640 1 -- 172.21.15.88:0/2984485070 learned_addr learned my addr 172.21.15.88:0/2984485070 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:23:44.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.677+0000 7fbd527fc640 1 --2- 172.21.15.88:0/2984485070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd54101a80 0x7fbd54197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:44.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.678+0000 7fbd52ffd640 1 -- 172.21.15.88:0/2984485070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd54101a80 msgr2=0x7fbd54197a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:44.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.678+0000 7fbd52ffd640 1 --2- 172.21.15.88:0/2984485070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd54101a80 0x7fbd54197a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:44.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.678+0000 7fbd52ffd640 1 -- 172.21.15.88:0/2984485070 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd541980b0 con 0x7fbd54100880 2024-09-17T04:23:44.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.678+0000 7fbd52ffd640 1 --2- 172.21.15.88:0/2984485070 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbd54100880 0x7fbd541974f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbd44006010 tx=0x7fbd440045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:44.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.678+0000 7fbd3bfff640 1 -- 172.21.15.88:0/2984485070 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbd4403f070 con 0x7fbd54100880 2024-09-17T04:23:44.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.678+0000 7fbd593d4640 1 -- 172.21.15.88:0/2984485070 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd5419ca90 con 0x7fbd54100880 2024-09-17T04:23:44.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.678+0000 7fbd3bfff640 1 -- 172.21.15.88:0/2984485070 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbd44004a50 con 0x7fbd54100880 2024-09-17T04:23:44.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.678+0000 7fbd3bfff640 1 -- 172.21.15.88:0/2984485070 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbd44035030 con 0x7fbd54100880 2024-09-17T04:23:44.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.678+0000 7fbd593d4640 1 -- 172.21.15.88:0/2984485070 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd5419d020 con 0x7fbd54100880 2024-09-17T04:23:44.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.679+0000 7fbd593d4640 1 -- 172.21.15.88:0/2984485070 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd54100c80 con 0x7fbd54100880 2024-09-17T04:23:44.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.680+0000 7fbd3bfff640 1 -- 172.21.15.88:0/2984485070 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fbd44042070 con 0x7fbd54100880 2024-09-17T04:23:44.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.681+0000 7fbd3bfff640 1 --2- 172.21.15.88:0/2984485070 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fbd3c07af80 0x7fbd3c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:44.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.681+0000 7fbd3bfff640 1 -- 172.21.15.88:0/2984485070 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7fbd440bea50 con 0x7fbd54100880 2024-09-17T04:23:44.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.681+0000 7fbd527fc640 1 --2- 172.21.15.88:0/2984485070 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fbd3c07af80 0x7fbd3c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:44.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.682+0000 7fbd527fc640 1 --2- 172.21.15.88:0/2984485070 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fbd3c07af80 0x7fbd3c07d440 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbd541989a0 tx=0x7fbd4800b410 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:44.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.686+0000 7fbd3bfff640 1 -- 172.21.15.88:0/2984485070 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fbd44004c00 con 0x7fbd54100880 2024-09-17T04:23:44.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:44 smithi134 ceph-mon[76677]: pgmap v50: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 255 B/s wr, 1 op/s 2024-09-17T04:23:44.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.925+0000 7fbd593d4640 1 -- 172.21.15.88:0/2984485070 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fbd5406ac20 con 0x7fbd3c07af80 2024-09-17T04:23:44.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.926+0000 7fbd3bfff640 1 -- 172.21.15.88:0/2984485070 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7fbd5406ac20 con 0x7fbd3c07af80 2024-09-17T04:23:44.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.929+0000 7fbd593d4640 1 -- 172.21.15.88:0/2984485070 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fbd3c07af80 msgr2=0x7fbd3c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:44.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.929+0000 7fbd593d4640 1 --2- 172.21.15.88:0/2984485070 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fbd3c07af80 0x7fbd3c07d440 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbd541989a0 tx=0x7fbd4800b410 comp rx=0 tx=0).stop 2024-09-17T04:23:44.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.929+0000 7fbd593d4640 1 -- 172.21.15.88:0/2984485070 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbd54100880 msgr2=0x7fbd541974f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:44.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.929+0000 7fbd593d4640 1 --2- 172.21.15.88:0/2984485070 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbd54100880 0x7fbd541974f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbd44006010 tx=0x7fbd440045e0 comp rx=0 tx=0).stop 2024-09-17T04:23:44.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.929+0000 7fbd593d4640 1 -- 172.21.15.88:0/2984485070 shutdown_connections 2024-09-17T04:23:44.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.929+0000 7fbd593d4640 1 --2- 172.21.15.88:0/2984485070 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fbd3c07af80 0x7fbd3c07d440 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:44.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.929+0000 7fbd593d4640 1 --2- 172.21.15.88:0/2984485070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd54101a80 0x7fbd54197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:44.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.929+0000 7fbd593d4640 1 --2- 172.21.15.88:0/2984485070 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbd54100880 0x7fbd541974f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:44.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.929+0000 7fbd593d4640 1 -- 172.21.15.88:0/2984485070 >> 172.21.15.88:0/2984485070 conn(0x7fbd540fc010 msgr2=0x7fbd5406a510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:44.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.929+0000 7fbd593d4640 1 -- 172.21.15.88:0/2984485070 shutdown_connections 2024-09-17T04:23:44.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:44.929+0000 7fbd593d4640 1 -- 172.21.15.88:0/2984485070 wait complete. 2024-09-17T04:23:45.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.011+0000 7f5de3394640 1 -- 172.21.15.88:0/2158552215 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ddc102b30 msgr2=0x7f5ddc104fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:45.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.011+0000 7f5de3394640 1 --2- 172.21.15.88:0/2158552215 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ddc102b30 0x7f5ddc104fa0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc009880 tx=0x7f5dcc02a4a0 comp rx=0 tx=0).stop 2024-09-17T04:23:45.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.012+0000 7f5de3394640 1 -- 172.21.15.88:0/2158552215 shutdown_connections 2024-09-17T04:23:45.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.012+0000 7f5de3394640 1 --2- 172.21.15.88:0/2158552215 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ddc102b30 0x7f5ddc104fa0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:45.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.012+0000 7f5de3394640 1 --2- 172.21.15.88:0/2158552215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ddc1001e0 0x7f5ddc1025f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:45.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.012+0000 7f5de3394640 1 -- 172.21.15.88:0/2158552215 >> 172.21.15.88:0/2158552215 conn(0x7f5ddc0fc010 msgr2=0x7f5ddc0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:45.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.012+0000 7f5de3394640 1 -- 172.21.15.88:0/2158552215 shutdown_connections 2024-09-17T04:23:45.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.012+0000 7f5de3394640 1 -- 172.21.15.88:0/2158552215 wait complete. 2024-09-17T04:23:45.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.012+0000 7f5de3394640 1 Processor -- start 2024-09-17T04:23:45.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.012+0000 7f5de3394640 1 -- start start 2024-09-17T04:23:45.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.012+0000 7f5de3394640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ddc1001e0 0x7f5ddc19dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:45.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.012+0000 7f5de3394640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ddc102b30 0x7f5ddc19e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:45.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.012+0000 7f5de3394640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f5ddc110d90 con 0x7f5ddc1001e0 2024-09-17T04:23:45.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.012+0000 7f5de3394640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5ddc110c10 con 0x7f5ddc102b30 2024-09-17T04:23:45.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.013+0000 7f5de1130640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ddc1001e0 0x7f5ddc19dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:45.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.013+0000 7f5de1130640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ddc1001e0 0x7f5ddc19dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46336/0 (socket says 172.21.15.88:46336) 2024-09-17T04:23:45.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.013+0000 7f5de1130640 1 -- 172.21.15.88:0/2011606809 learned_addr learned my addr 172.21.15.88:0/2011606809 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:23:45.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.013+0000 7f5de1130640 1 -- 172.21.15.88:0/2011606809 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ddc102b30 msgr2=0x7f5ddc19e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:45.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.013+0000 7f5de1130640 1 --2- 172.21.15.88:0/2011606809 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ddc102b30 0x7f5ddc19e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:45.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.013+0000 7f5de1130640 1 -- 172.21.15.88:0/2011606809 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ddc19e6a0 con 0x7f5ddc1001e0 2024-09-17T04:23:45.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.013+0000 7f5de1130640 1 --2- 172.21.15.88:0/2011606809 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ddc1001e0 0x7f5ddc19dae0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5dd800cc60 tx=0x7f5dd800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:45.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.013+0000 7f5dd27fc640 1 -- 172.21.15.88:0/2011606809 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5dd800ad30 con 0x7f5ddc1001e0 2024-09-17T04:23:45.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.013+0000 7f5de3394640 1 -- 172.21.15.88:0/2011606809 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ddc1a30e0 con 0x7f5ddc1001e0 2024-09-17T04:23:45.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.013+0000 7f5dd27fc640 1 -- 172.21.15.88:0/2011606809 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5dd8005020 con 0x7f5ddc1001e0 2024-09-17T04:23:45.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.013+0000 7f5dd27fc640 1 -- 172.21.15.88:0/2011606809 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5dd800f640 con 0x7f5ddc1001e0 2024-09-17T04:23:45.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.013+0000 7f5de3394640 1 -- 172.21.15.88:0/2011606809 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ddc1a3670 con 0x7f5ddc1001e0 2024-09-17T04:23:45.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.014+0000 7f5de3394640 1 -- 172.21.15.88:0/2011606809 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ddc1005e0 con 0x7f5ddc1001e0 2024-09-17T04:23:45.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.015+0000 7f5dd27fc640 1 -- 172.21.15.88:0/2011606809 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f5dd80051d0 con 0x7f5ddc1001e0 2024-09-17T04:23:45.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.015+0000 7f5dd27fc640 1 --2- 172.21.15.88:0/2011606809 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f5dc807af30 0x7f5dc807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:45.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.016+0000 7f5dd27fc640 1 -- 172.21.15.88:0/2011606809 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7f5dd809e2e0 con 0x7f5ddc1001e0 2024-09-17T04:23:45.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.016+0000 7f5de092f640 1 --2- 172.21.15.88:0/2011606809 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f5dc807af30 0x7f5dc807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:45.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.016+0000 7f5de092f640 1 --2- 172.21.15.88:0/2011606809 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f5dc807af30 0x7f5dc807d3f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc0096c0 tx=0x7f5dcc000bc0 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:45.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.020+0000 7f5dd27fc640 1 -- 172.21.15.88:0/2011606809 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f5dd8014030 con 0x7f5ddc1001e0 2024-09-17T04:23:45.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.209+0000 7f5de3394640 1 -- 172.21.15.88:0/2011606809 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f5ddc103530 con 0x7f5dc807af30 2024-09-17T04:23:45.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.219+0000 7f5dd27fc640 1 -- 172.21.15.88:0/2011606809 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f5ddc103530 con 0x7f5dc807af30 2024-09-17T04:23:45.220 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T04:23:45.220 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (9m) 4s ago 10m 25.4M - 0.25.0 c8568f914cd2 f2dbac7e939f 2024-09-17T04:23:45.220 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi088 smithi088 running (2m) 4s ago 11m 8484k - 19.1.1-330-gc2ddf972 ebb0615149de 683e1826a1a5 2024-09-17T04:23:45.220 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi134 smithi134 running (2m) 6s ago 10m 8426k - 19.1.1-330-gc2ddf972 ebb0615149de 83afa4200c0e 2024-09-17T04:23:45.220 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (15s) 4s ago 11m 6891k - 19.3.0-4989-gce1b342b 8e039cb7fe1e 10355648c406 2024-09-17T04:23:45.220 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi134 smithi134 running (10s) 6s ago 10m 6899k - 19.3.0-4989-gce1b342b 8e039cb7fe1e d709085ffe5d 2024-09-17T04:23:45.220 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (9m) 4s ago 10m 79.5M - 9.4.12 2bacad6d85d8 a6cff57a23f9 2024-09-17T04:23:45.220 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.giqrgt smithi088 running (5m) 4s ago 5m 149M - 19.1.1-330-gc2ddf972 ebb0615149de f724660799a1 2024-09-17T04:23:45.220 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.lgavsv smithi088 running (5m) 4s ago 5m 15.6M - 19.1.1-330-gc2ddf972 ebb0615149de 6cc0fe8a6aa9 2024-09-17T04:23:45.221 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi134.ktuhce smithi134 running (5m) 6s ago 5m 15.0M - 19.1.1-330-gc2ddf972 ebb0615149de 7ff5b70ca9cb 2024-09-17T04:23:45.221 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi134.psnynp smithi134 running (5m) 6s ago 5m 90.6M - 19.1.1-330-gc2ddf972 ebb0615149de 5326974fa3dd 2024-09-17T04:23:45.221 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.wmndiv smithi088 *:8443,9283,8765 running (2m) 4s ago 12m 577M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 49eb47f7f14f 2024-09-17T04:23:45.221 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi134.vwdxcb smithi134 *:8443,9283,8765 running (55s) 6s ago 10m 520M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 8a6d45eb0595 2024-09-17T04:23:45.221 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (43s) 4s ago 12m 106M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e ac6332015243 2024-09-17T04:23:45.221 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi134 smithi134 running (27s) 6s ago 9m 91.9M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e ea49f690e26b 2024-09-17T04:23:45.221 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (10m) 4s ago 10m 17.2M - 1.5.0 0da6a335fe13 9ba03800993b 2024-09-17T04:23:45.221 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi134 smithi134 *:9100 running (10m) 6s ago 10m 17.1M - 1.5.0 0da6a335fe13 6deac483827f 2024-09-17T04:23:45.221 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (8m) 4s ago 8m 198M 1216M 19.1.1-330-gc2ddf972 ebb0615149de e309427ee12c 2024-09-17T04:23:45.221 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (8m) 4s ago 8m 213M 1216M 19.1.1-330-gc2ddf972 ebb0615149de cc68d92b3333 2024-09-17T04:23:45.221 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (7m) 4s ago 7m 180M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 1ba92f2bfce6 2024-09-17T04:23:45.222 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi134 running (7m) 6s ago 7m 233M 2240M 19.1.1-330-gc2ddf972 ebb0615149de ebd528c3ce1b 2024-09-17T04:23:45.222 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi134 running (6m) 6s ago 6m 208M 2240M 19.1.1-330-gc2ddf972 ebb0615149de eacc25537b3a 2024-09-17T04:23:45.222 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi134 running (6m) 6s ago 6m 185M 2240M 19.1.1-330-gc2ddf972 ebb0615149de bc1b434a92a8 2024-09-17T04:23:45.222 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (61s) 4s ago 10m 58.3M - 2.43.0 a07b618ecd1d b51d7899d341 2024-09-17T04:23:45.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.221+0000 7f5de3394640 1 -- 172.21.15.88:0/2011606809 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f5dc807af30 msgr2=0x7f5dc807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:45.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.221+0000 7f5de3394640 1 --2- 172.21.15.88:0/2011606809 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f5dc807af30 0x7f5dc807d3f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc0096c0 tx=0x7f5dcc000bc0 comp rx=0 tx=0).stop 2024-09-17T04:23:45.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.221+0000 7f5de3394640 1 -- 172.21.15.88:0/2011606809 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ddc1001e0 msgr2=0x7f5ddc19dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:45.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.221+0000 7f5de3394640 1 --2- 172.21.15.88:0/2011606809 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ddc1001e0 0x7f5ddc19dae0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5dd800cc60 tx=0x7f5dd800a620 comp rx=0 tx=0).stop 2024-09-17T04:23:45.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.221+0000 7f5de3394640 1 -- 172.21.15.88:0/2011606809 shutdown_connections 2024-09-17T04:23:45.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.221+0000 7f5de3394640 1 --2- 172.21.15.88:0/2011606809 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f5dc807af30 0x7f5dc807d3f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:45.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.221+0000 7f5de3394640 1 --2- 172.21.15.88:0/2011606809 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ddc102b30 0x7f5ddc19e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:45.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.221+0000 7f5de3394640 1 --2- 172.21.15.88:0/2011606809 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ddc1001e0 0x7f5ddc19dae0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:45.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.221+0000 7f5de3394640 1 -- 172.21.15.88:0/2011606809 >> 172.21.15.88:0/2011606809 conn(0x7f5ddc0fc010 msgr2=0x7f5ddc0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:45.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.221+0000 7f5de3394640 1 -- 172.21.15.88:0/2011606809 shutdown_connections 2024-09-17T04:23:45.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.221+0000 7f5de3394640 1 -- 172.21.15.88:0/2011606809 wait complete. 2024-09-17T04:23:45.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.301+0000 7fe34c13e640 1 -- 172.21.15.88:0/1467912073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe344102b60 msgr2=0x7fe344102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:45.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.301+0000 7fe34c13e640 1 --2- 172.21.15.88:0/1467912073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe344102b60 0x7fe344102fe0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe338009880 tx=0x7fe33802a4a0 comp rx=0 tx=0).stop 2024-09-17T04:23:45.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.301+0000 7fe34c13e640 1 -- 172.21.15.88:0/1467912073 shutdown_connections 2024-09-17T04:23:45.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.301+0000 7fe34c13e640 1 --2- 172.21.15.88:0/1467912073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe344102b60 0x7fe344102fe0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:45.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.301+0000 7fe34c13e640 1 --2- 172.21.15.88:0/1467912073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe344101960 0x7fe344101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:45.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.301+0000 7fe34c13e640 1 -- 172.21.15.88:0/1467912073 >> 172.21.15.88:0/1467912073 conn(0x7fe3440fd110 msgr2=0x7fe3440ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:45.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.302+0000 7fe34c13e640 1 -- 172.21.15.88:0/1467912073 shutdown_connections 2024-09-17T04:23:45.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.302+0000 7fe34c13e640 1 -- 172.21.15.88:0/1467912073 wait complete. 2024-09-17T04:23:45.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.302+0000 7fe34c13e640 1 Processor -- start 2024-09-17T04:23:45.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.302+0000 7fe34c13e640 1 -- start start 2024-09-17T04:23:45.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.302+0000 7fe34c13e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe344101960 0x7fe3441974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:45.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.302+0000 7fe34c13e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe344102b60 0x7fe3441979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:45.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.302+0000 7fe34c13e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fe34410a7a0 con 0x7fe344101960 2024-09-17T04:23:45.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.302+0000 7fe34c13e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe34410a620 con 0x7fe344102b60 2024-09-17T04:23:45.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.302+0000 7fe349eda640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe344101960 0x7fe3441974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:45.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.302+0000 7fe349eda640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe344101960 0x7fe3441974a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46366/0 (socket says 172.21.15.88:46366) 2024-09-17T04:23:45.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.302+0000 7fe349eda640 1 -- 172.21.15.88:0/939393436 learned_addr learned my addr 172.21.15.88:0/939393436 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:23:45.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.303+0000 7fe3496d9640 1 --2- 172.21.15.88:0/939393436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe344102b60 0x7fe3441979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:45.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.303+0000 7fe349eda640 1 -- 172.21.15.88:0/939393436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe344102b60 msgr2=0x7fe3441979e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:45.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.303+0000 7fe349eda640 1 --2- 172.21.15.88:0/939393436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe344102b60 0x7fe3441979e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:45.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.303+0000 7fe349eda640 1 -- 172.21.15.88:0/939393436 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe344198060 con 0x7fe344101960 2024-09-17T04:23:45.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.303+0000 7fe349eda640 1 --2- 172.21.15.88:0/939393436 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe344101960 0x7fe3441974a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe33c00c8f0 tx=0x7fe33c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:45.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.303+0000 7fe342ffd640 1 -- 172.21.15.88:0/939393436 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe33c004020 con 0x7fe344101960 2024-09-17T04:23:45.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.303+0000 7fe34c13e640 1 -- 172.21.15.88:0/939393436 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe34419caa0 con 0x7fe344101960 2024-09-17T04:23:45.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.303+0000 7fe342ffd640 1 -- 172.21.15.88:0/939393436 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe33c0041c0 con 0x7fe344101960 2024-09-17T04:23:45.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.303+0000 7fe342ffd640 1 -- 172.21.15.88:0/939393436 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe33c0047a0 con 0x7fe344101960 2024-09-17T04:23:45.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.303+0000 7fe34c13e640 1 -- 172.21.15.88:0/939393436 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe34419d030 con 0x7fe344101960 2024-09-17T04:23:45.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.304+0000 7fe34c13e640 1 -- 172.21.15.88:0/939393436 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe344101d60 con 0x7fe344101960 2024-09-17T04:23:45.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.305+0000 7fe342ffd640 1 -- 172.21.15.88:0/939393436 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fe33c004370 con 0x7fe344101960 2024-09-17T04:23:45.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.305+0000 7fe342ffd640 1 --2- 172.21.15.88:0/939393436 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe32c07af30 0x7fe32c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:45.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.305+0000 7fe342ffd640 1 -- 172.21.15.88:0/939393436 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7fe33c09df10 con 0x7fe344101960 2024-09-17T04:23:45.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.305+0000 7fe3496d9640 1 --2- 172.21.15.88:0/939393436 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe32c07af30 0x7fe32c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:45.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.306+0000 7fe3496d9640 1 --2- 172.21.15.88:0/939393436 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe32c07af30 0x7fe32c07d3f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe344198950 tx=0x7fe338005a20 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:45.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.310+0000 7fe342ffd640 1 -- 172.21.15.88:0/939393436 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fe33c014030 con 0x7fe344101960 2024-09-17T04:23:45.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.567+0000 7fe34c13e640 1 -- 172.21.15.88:0/939393436 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fe344062df0 con 0x7fe344101960 2024-09-17T04:23:45.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.567+0000 7fe342ffd640 1 -- 172.21.15.88:0/939393436 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+733 (secure 0 0 0) 0x7fe33c069560 con 0x7fe344101960 2024-09-17T04:23:45.568 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-17T04:23:45.569 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-09-17T04:23:45.569 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T04:23:45.569 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:23:45.569 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-09-17T04:23:45.569 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T04:23:45.569 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:23:45.569 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-09-17T04:23:45.569 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-17T04:23:45.569 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:23:45.569 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2024-09-17T04:23:45.569 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T04:23:45.569 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:23:45.569 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-09-17T04:23:45.570 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 10, 2024-09-17T04:23:45.570 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 4 2024-09-17T04:23:45.570 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-17T04:23:45.570 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-17T04:23:45.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.569+0000 7fe34c13e640 1 -- 172.21.15.88:0/939393436 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe32c07af30 msgr2=0x7fe32c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:45.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.569+0000 7fe34c13e640 1 --2- 172.21.15.88:0/939393436 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe32c07af30 0x7fe32c07d3f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe344198950 tx=0x7fe338005a20 comp rx=0 tx=0).stop 2024-09-17T04:23:45.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.569+0000 7fe34c13e640 1 -- 172.21.15.88:0/939393436 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe344101960 msgr2=0x7fe3441974a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:45.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.569+0000 7fe34c13e640 1 --2- 172.21.15.88:0/939393436 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe344101960 0x7fe3441974a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe33c00c8f0 tx=0x7fe33c00cdb0 comp rx=0 tx=0).stop 2024-09-17T04:23:45.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.569+0000 7fe34c13e640 1 -- 172.21.15.88:0/939393436 shutdown_connections 2024-09-17T04:23:45.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.569+0000 7fe34c13e640 1 --2- 172.21.15.88:0/939393436 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe32c07af30 0x7fe32c07d3f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:45.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.569+0000 7fe34c13e640 1 --2- 172.21.15.88:0/939393436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe344102b60 0x7fe3441979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:45.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.569+0000 7fe34c13e640 1 --2- 172.21.15.88:0/939393436 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe344101960 0x7fe3441974a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:45.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.569+0000 7fe34c13e640 1 -- 172.21.15.88:0/939393436 >> 172.21.15.88:0/939393436 conn(0x7fe3440fd110 msgr2=0x7fe344106070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:45.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.570+0000 7fe34c13e640 1 -- 172.21.15.88:0/939393436 shutdown_connections 2024-09-17T04:23:45.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.570+0000 7fe34c13e640 1 -- 172.21.15.88:0/939393436 wait complete. 2024-09-17T04:23:45.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.651+0000 7f5540bb1640 1 -- 172.21.15.88:0/513911732 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f553c104d20 msgr2=0x7f553c107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:45.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.651+0000 7f5540bb1640 1 --2- 172.21.15.88:0/513911732 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f553c104d20 0x7f553c107110 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f55300098b0 tx=0x7f553002a4d0 comp rx=0 tx=0).stop 2024-09-17T04:23:45.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.651+0000 7f5540bb1640 1 -- 172.21.15.88:0/513911732 shutdown_connections 2024-09-17T04:23:45.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.651+0000 7f5540bb1640 1 --2- 172.21.15.88:0/513911732 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f553c104d20 0x7f553c107110 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:45.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.651+0000 7f5540bb1640 1 --2- 172.21.15.88:0/513911732 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f553c1023f0 0x7f553c1047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:45.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.651+0000 7f5540bb1640 1 -- 172.21.15.88:0/513911732 >> 172.21.15.88:0/513911732 conn(0x7f553c0fc010 msgr2=0x7f553c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:45.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.651+0000 7f5540bb1640 1 -- 172.21.15.88:0/513911732 shutdown_connections 2024-09-17T04:23:45.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.651+0000 7f5540bb1640 1 -- 172.21.15.88:0/513911732 wait complete. 2024-09-17T04:23:45.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.652+0000 7f5540bb1640 1 Processor -- start 2024-09-17T04:23:45.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.652+0000 7f5540bb1640 1 -- start start 2024-09-17T04:23:45.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.652+0000 7f5540bb1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f553c1023f0 0x7f553c1996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:45.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.652+0000 7f5540bb1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f553c104d20 0x7f553c199c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:45.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.652+0000 7f5540bb1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f553c10a790 con 0x7f553c104d20 2024-09-17T04:23:45.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.652+0000 7f5540bb1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f553c10a610 con 0x7f553c1023f0 2024-09-17T04:23:45.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.652+0000 7f5539d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f553c104d20 0x7f553c199c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:45.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.652+0000 7f5539d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f553c104d20 0x7f553c199c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46374/0 (socket says 172.21.15.88:46374) 2024-09-17T04:23:45.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.652+0000 7f5539d9b640 1 -- 172.21.15.88:0/866876258 learned_addr learned my addr 172.21.15.88:0/866876258 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:23:45.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.652+0000 7f553a59c640 1 --2- 172.21.15.88:0/866876258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f553c1023f0 0x7f553c1996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:45.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.652+0000 7f5539d9b640 1 -- 172.21.15.88:0/866876258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f553c1023f0 msgr2=0x7f553c1996f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:45.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.652+0000 7f5539d9b640 1 --2- 172.21.15.88:0/866876258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f553c1023f0 0x7f553c1996f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:45.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.652+0000 7f5539d9b640 1 -- 172.21.15.88:0/866876258 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f553c19a220 con 0x7f553c104d20 2024-09-17T04:23:45.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.653+0000 7f5539d9b640 1 --2- 172.21.15.88:0/866876258 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f553c104d20 0x7f553c199c30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5530009230 tx=0x7f55300048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:45.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.653+0000 7f552b7fe640 1 -- 172.21.15.88:0/866876258 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f553003f070 con 0x7f553c104d20 2024-09-17T04:23:45.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.653+0000 7f552b7fe640 1 -- 172.21.15.88:0/866876258 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f55300044d0 con 0x7f553c104d20 2024-09-17T04:23:45.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.653+0000 7f5540bb1640 1 -- 172.21.15.88:0/866876258 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f553c19ec30 con 0x7f553c104d20 2024-09-17T04:23:45.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.653+0000 7f552b7fe640 1 -- 172.21.15.88:0/866876258 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5530035030 con 0x7f553c104d20 2024-09-17T04:23:45.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.653+0000 7f5540bb1640 1 -- 172.21.15.88:0/866876258 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f553c19f130 con 0x7f553c104d20 2024-09-17T04:23:45.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.654+0000 7f5540bb1640 1 -- 172.21.15.88:0/866876258 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f553c1027d0 con 0x7f553c104d20 2024-09-17T04:23:45.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.654+0000 7f552b7fe640 1 -- 172.21.15.88:0/866876258 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f5530042070 con 0x7f553c104d20 2024-09-17T04:23:45.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.655+0000 7f552b7fe640 1 --2- 172.21.15.88:0/866876258 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f552407af30 0x7f552407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:45.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.655+0000 7f552b7fe640 1 -- 172.21.15.88:0/866876258 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7f55300bebe0 con 0x7f553c104d20 2024-09-17T04:23:45.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.655+0000 7f553a59c640 1 --2- 172.21.15.88:0/866876258 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f552407af30 0x7f552407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:45.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.655+0000 7f553a59c640 1 --2- 172.21.15.88:0/866876258 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f552407af30 0x7f552407d3f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f552c005e10 tx=0x7f552c005da0 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:45.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.660+0000 7f552b7fe640 1 -- 172.21.15.88:0/866876258 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f553008a230 con 0x7f553c104d20 2024-09-17T04:23:45.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.877+0000 7f5540bb1640 1 -- 172.21.15.88:0/866876258 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f553c062df0 con 0x7f553c104d20 2024-09-17T04:23:45.879 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.878+0000 7f552b7fe640 1 -- 172.21.15.88:0/866876258 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) ==== 76+0+2045 (secure 0 0 0) 0x7f553008f0e0 con 0x7f553c104d20 2024-09-17T04:23:45.879 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:45 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:45.879 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:45 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:45.879 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:45 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:23:45.879 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:45 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:23:45.879 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:45 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:45.879 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:45 smithi088 ceph-mon[90867]: from='client.34100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:23:45.880 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:45 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:23:45.880 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:45 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:23:45.880 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:45 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:23:45.880 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:45 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:23:45.880 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:45 smithi088 ceph-mon[90867]: Upgrade: Setting container_image for all crash 2024-09-17T04:23:45.880 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:45 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:45.880 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:45 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi088"} : dispatch 2024-09-17T04:23:45.880 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:45 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi088"}]': finished 2024-09-17T04:23:45.880 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:45 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi134"} : dispatch 2024-09-17T04:23:45.880 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:45 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi134"}]': finished 2024-09-17T04:23:45.880 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:45 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16} : dispatch 2024-09-17T04:23:45.880 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:45 smithi088 ceph-mon[90867]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-17T04:23:45.880 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:45 smithi088 ceph-mon[90867]: Upgrade: osd.0 is safe to restart 2024-09-17T04:23:45.880 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:45 smithi088 ceph-mon[90867]: from='client.34104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:23:45.881 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:45 smithi088 ceph-mon[90867]: from='client.34108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:23:45.881 INFO:teuthology.orchestra.run.smithi088.stdout:e15 2024-09-17T04:23:45.881 INFO:teuthology.orchestra.run.smithi088.stdout:btime 2024-09-17T04:18:27:750910+0000 2024-09-17T04:23:45.881 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T04:23:45.881 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:23:45.881 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2024-09-17T04:23:45.881 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:23:45.881 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2024-09-17T04:23:45.881 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2024-09-17T04:23:45.882 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 15 2024-09-17T04:23:45.882 INFO:teuthology.orchestra.run.smithi088.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T04:23:45.882 INFO:teuthology.orchestra.run.smithi088.stdout:created 2024-09-17T04:18:10.480573+0000 2024-09-17T04:23:45.882 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2024-09-17T04:18:27.750896+0000 2024-09-17T04:23:45.882 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2024-09-17T04:23:45.882 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2024-09-17T04:23:45.882 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2024-09-17T04:23:45.882 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2024-09-17T04:23:45.882 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2024-09-17T04:23:45.882 INFO:teuthology.orchestra.run.smithi088.stdout:max_xattr_size 65536 2024-09-17T04:23:45.882 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2024-09-17T04:23:45.882 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2024-09-17T04:23:45.882 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 45 2024-09-17T04:23:45.882 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:23:45.883 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 1 2024-09-17T04:23:45.883 INFO:teuthology.orchestra.run.smithi088.stdout:in 0 2024-09-17T04:23:45.883 INFO:teuthology.orchestra.run.smithi088.stdout:up {0=14590} 2024-09-17T04:23:45.883 INFO:teuthology.orchestra.run.smithi088.stdout:failed 2024-09-17T04:23:45.883 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2024-09-17T04:23:45.883 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2024-09-17T04:23:45.883 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2024-09-17T04:23:45.883 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2024-09-17T04:23:45.883 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data enabled 2024-09-17T04:23:45.883 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2024-09-17T04:23:45.883 INFO:teuthology.orchestra.run.smithi088.stdout:bal_rank_mask -1 2024-09-17T04:23:45.883 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 1 2024-09-17T04:23:45.883 INFO:teuthology.orchestra.run.smithi088.stdout:qdb_cluster leader: 14590 members: 14590 2024-09-17T04:23:45.883 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.giqrgt{0:14590} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.88:6828/1714846518,v1:172.21.15.88:6829/1714846518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:23:45.884 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi134.psnynp{0:24321} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.134:6826/2137586894,v1:172.21.15.134:6827/2137586894] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:23:45.884 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:23:45.884 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:23:45.884 INFO:teuthology.orchestra.run.smithi088.stdout:Standby daemons: 2024-09-17T04:23:45.884 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:23:45.884 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi134.ktuhce{-1:24325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/967997022,v1:172.21.15.134:6825/967997022] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:23:45.884 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.lgavsv{-1:24329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/1425146180,v1:172.21.15.88:6827/1425146180] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:23:45.885 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 15 2024-09-17T04:23:45.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.880+0000 7f5540bb1640 1 -- 172.21.15.88:0/866876258 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f552407af30 msgr2=0x7f552407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:45.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.880+0000 7f5540bb1640 1 --2- 172.21.15.88:0/866876258 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f552407af30 0x7f552407d3f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f552c005e10 tx=0x7f552c005da0 comp rx=0 tx=0).stop 2024-09-17T04:23:45.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.880+0000 7f5540bb1640 1 -- 172.21.15.88:0/866876258 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f553c104d20 msgr2=0x7f553c199c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:45.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.880+0000 7f5540bb1640 1 --2- 172.21.15.88:0/866876258 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f553c104d20 0x7f553c199c30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5530009230 tx=0x7f55300048f0 comp rx=0 tx=0).stop 2024-09-17T04:23:45.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.881+0000 7f5540bb1640 1 -- 172.21.15.88:0/866876258 shutdown_connections 2024-09-17T04:23:45.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.881+0000 7f5540bb1640 1 --2- 172.21.15.88:0/866876258 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f552407af30 0x7f552407d3f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:45.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.881+0000 7f5540bb1640 1 --2- 172.21.15.88:0/866876258 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f553c104d20 0x7f553c199c30 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:45.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.881+0000 7f5540bb1640 1 --2- 172.21.15.88:0/866876258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f553c1023f0 0x7f553c1996f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:45.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.881+0000 7f5540bb1640 1 -- 172.21.15.88:0/866876258 >> 172.21.15.88:0/866876258 conn(0x7f553c0fc010 msgr2=0x7f553c101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:45.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.881+0000 7f5540bb1640 1 -- 172.21.15.88:0/866876258 shutdown_connections 2024-09-17T04:23:45.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.881+0000 7f5540bb1640 1 -- 172.21.15.88:0/866876258 wait complete. 2024-09-17T04:23:45.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:45 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:45.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:45 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:45.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:45 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:23:45.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:45 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:23:45.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:45 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:45.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:45 smithi134 ceph-mon[76677]: from='client.34100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:23:45.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:45 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:23:45.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:45 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:23:45.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:45 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:23:45.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:45 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:23:45.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:45 smithi134 ceph-mon[76677]: Upgrade: Setting container_image for all crash 2024-09-17T04:23:45.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:45 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:45.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:45 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi088"} : dispatch 2024-09-17T04:23:45.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:45 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi088"}]': finished 2024-09-17T04:23:45.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:45 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi134"} : dispatch 2024-09-17T04:23:45.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:45 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi134"}]': finished 2024-09-17T04:23:45.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:45 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16} : dispatch 2024-09-17T04:23:45.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:45 smithi134 ceph-mon[76677]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-17T04:23:45.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:45 smithi134 ceph-mon[76677]: Upgrade: osd.0 is safe to restart 2024-09-17T04:23:45.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:45 smithi134 ceph-mon[76677]: from='client.34104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:23:45.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:45 smithi134 ceph-mon[76677]: from='client.34108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:23:45.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.963+0000 7f9b42ba0640 1 -- 172.21.15.88:0/2141963673 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b3c102990 msgr2=0x7f9b3c102e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:45.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.963+0000 7f9b42ba0640 1 --2- 172.21.15.88:0/2141963673 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b3c102990 0x7f9b3c102e10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9b30009880 tx=0x7f9b3002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:23:45.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.964+0000 7f9b42ba0640 1 -- 172.21.15.88:0/2141963673 shutdown_connections 2024-09-17T04:23:45.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.964+0000 7f9b42ba0640 1 --2- 172.21.15.88:0/2141963673 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b3c102990 0x7f9b3c102e10 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:45.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.964+0000 7f9b42ba0640 1 --2- 172.21.15.88:0/2141963673 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b3c101790 0x7f9b3c101b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:45.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.964+0000 7f9b42ba0640 1 -- 172.21.15.88:0/2141963673 >> 172.21.15.88:0/2141963673 conn(0x7f9b3c0fcf00 msgr2=0x7f9b3c0ff360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:45.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.964+0000 7f9b42ba0640 1 -- 172.21.15.88:0/2141963673 shutdown_connections 2024-09-17T04:23:45.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.964+0000 7f9b42ba0640 1 -- 172.21.15.88:0/2141963673 wait complete. 2024-09-17T04:23:45.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.964+0000 7f9b42ba0640 1 Processor -- start 2024-09-17T04:23:45.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.964+0000 7f9b42ba0640 1 -- start start 2024-09-17T04:23:45.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.964+0000 7f9b42ba0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b3c101790 0x7f9b3c075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:45.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.964+0000 7f9b42ba0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b3c102990 0x7f9b3c0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:45.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.964+0000 7f9b42ba0640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f9b3c10a5d0 con 0x7f9b3c102990 2024-09-17T04:23:45.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.964+0000 7f9b42ba0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9b3c10a450 con 0x7f9b3c101790 2024-09-17T04:23:45.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.965+0000 7f9b4139d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b3c102990 0x7f9b3c0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:45.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.965+0000 7f9b4139d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b3c102990 0x7f9b3c0745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46390/0 (socket says 172.21.15.88:46390) 2024-09-17T04:23:45.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.965+0000 7f9b4139d640 1 -- 172.21.15.88:0/2148355160 learned_addr learned my addr 172.21.15.88:0/2148355160 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:23:45.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.965+0000 7f9b41b9e640 1 --2- 172.21.15.88:0/2148355160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b3c101790 0x7f9b3c075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:45.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.965+0000 7f9b4139d640 1 -- 172.21.15.88:0/2148355160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b3c101790 msgr2=0x7f9b3c075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:45.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.965+0000 7f9b4139d640 1 --2- 172.21.15.88:0/2148355160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b3c101790 0x7f9b3c075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:45.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.965+0000 7f9b4139d640 1 -- 172.21.15.88:0/2148355160 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b3c074b20 con 0x7f9b3c102990 2024-09-17T04:23:45.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.965+0000 7f9b4139d640 1 --2- 172.21.15.88:0/2148355160 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b3c102990 0x7f9b3c0745e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9b30006010 tx=0x7f9b300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:45.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.965+0000 7f9b3affd640 1 -- 172.21.15.88:0/2148355160 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9b3003f070 con 0x7f9b3c102990 2024-09-17T04:23:45.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.965+0000 7f9b42ba0640 1 -- 172.21.15.88:0/2148355160 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b3c074db0 con 0x7f9b3c102990 2024-09-17T04:23:45.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.965+0000 7f9b3affd640 1 -- 172.21.15.88:0/2148355160 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9b30004ac0 con 0x7f9b3c102990 2024-09-17T04:23:45.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.965+0000 7f9b3affd640 1 -- 172.21.15.88:0/2148355160 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9b30035030 con 0x7f9b3c102990 2024-09-17T04:23:45.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.965+0000 7f9b42ba0640 1 -- 172.21.15.88:0/2148355160 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b3c0752e0 con 0x7f9b3c102990 2024-09-17T04:23:45.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.966+0000 7f9b42ba0640 1 -- 172.21.15.88:0/2148355160 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b3c101b90 con 0x7f9b3c102990 2024-09-17T04:23:45.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.967+0000 7f9b3affd640 1 -- 172.21.15.88:0/2148355160 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f9b30042070 con 0x7f9b3c102990 2024-09-17T04:23:45.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.968+0000 7f9b3affd640 1 --2- 172.21.15.88:0/2148355160 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f9b2407af30 0x7f9b2407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:45.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.968+0000 7f9b3affd640 1 -- 172.21.15.88:0/2148355160 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7f9b300bf1e0 con 0x7f9b3c102990 2024-09-17T04:23:45.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.968+0000 7f9b41b9e640 1 --2- 172.21.15.88:0/2148355160 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f9b2407af30 0x7f9b2407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:45.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.968+0000 7f9b41b9e640 1 --2- 172.21.15.88:0/2148355160 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f9b2407af30 0x7f9b2407d3f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c1027f0 tx=0x7f9b2c009680 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:45.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:45.972+0000 7f9b3affd640 1 -- 172.21.15.88:0/2148355160 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f9b3008a8b0 con 0x7f9b3c102990 2024-09-17T04:23:46.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.169+0000 7f9b42ba0640 1 -- 172.21.15.88:0/2148355160 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9b3c062630 con 0x7f9b2407af30 2024-09-17T04:23:46.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.170+0000 7f9b3affd640 1 -- 172.21.15.88:0/2148355160 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f9b3c062630 con 0x7f9b2407af30 2024-09-17T04:23:46.171 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-17T04:23:46.172 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f", 2024-09-17T04:23:46.172 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-09-17T04:23:46.172 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T04:23:46.172 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [ 2024-09-17T04:23:46.172 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr", 2024-09-17T04:23:46.172 INFO:teuthology.orchestra.run.smithi088.stdout: "mon", 2024-09-17T04:23:46.172 INFO:teuthology.orchestra.run.smithi088.stdout: "crash" 2024-09-17T04:23:46.172 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-17T04:23:46.172 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "6/23 daemons upgraded", 2024-09-17T04:23:46.172 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading osd daemons", 2024-09-17T04:23:46.173 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-09-17T04:23:46.173 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-17T04:23:46.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.173+0000 7f9b42ba0640 1 -- 172.21.15.88:0/2148355160 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f9b2407af30 msgr2=0x7f9b2407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:46.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.173+0000 7f9b42ba0640 1 --2- 172.21.15.88:0/2148355160 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f9b2407af30 0x7f9b2407d3f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c1027f0 tx=0x7f9b2c009680 comp rx=0 tx=0).stop 2024-09-17T04:23:46.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.173+0000 7f9b42ba0640 1 -- 172.21.15.88:0/2148355160 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b3c102990 msgr2=0x7f9b3c0745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:46.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.173+0000 7f9b42ba0640 1 --2- 172.21.15.88:0/2148355160 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b3c102990 0x7f9b3c0745e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9b30006010 tx=0x7f9b300046c0 comp rx=0 tx=0).stop 2024-09-17T04:23:46.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.173+0000 7f9b42ba0640 1 -- 172.21.15.88:0/2148355160 shutdown_connections 2024-09-17T04:23:46.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.173+0000 7f9b42ba0640 1 --2- 172.21.15.88:0/2148355160 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f9b2407af30 0x7f9b2407d3f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:46.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.173+0000 7f9b42ba0640 1 --2- 172.21.15.88:0/2148355160 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b3c102990 0x7f9b3c0745e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:46.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.173+0000 7f9b42ba0640 1 --2- 172.21.15.88:0/2148355160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b3c101790 0x7f9b3c075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:46.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.173+0000 7f9b42ba0640 1 -- 172.21.15.88:0/2148355160 >> 172.21.15.88:0/2148355160 conn(0x7f9b3c0fcf00 msgr2=0x7f9b3c105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:46.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.174+0000 7f9b42ba0640 1 -- 172.21.15.88:0/2148355160 shutdown_connections 2024-09-17T04:23:46.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.174+0000 7f9b42ba0640 1 -- 172.21.15.88:0/2148355160 wait complete. 2024-09-17T04:23:46.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.262+0000 7f1ecd852640 1 -- 172.21.15.88:0/309042293 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ec8104d80 msgr2=0x7f1ec8107170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:46.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.262+0000 7f1ecd852640 1 --2- 172.21.15.88:0/309042293 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ec8104d80 0x7f1ec8107170 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc009880 tx=0x7f1ebc02a4a0 comp rx=0 tx=0).stop 2024-09-17T04:23:46.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.262+0000 7f1ecd852640 1 -- 172.21.15.88:0/309042293 shutdown_connections 2024-09-17T04:23:46.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.262+0000 7f1ecd852640 1 --2- 172.21.15.88:0/309042293 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ec8104d80 0x7f1ec8107170 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:46.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.262+0000 7f1ecd852640 1 --2- 172.21.15.88:0/309042293 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ec8102450 0x7f1ec8104840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:46.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.262+0000 7f1ecd852640 1 -- 172.21.15.88:0/309042293 >> 172.21.15.88:0/309042293 conn(0x7f1ec80fc010 msgr2=0x7f1ec80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:46.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.262+0000 7f1ecd852640 1 -- 172.21.15.88:0/309042293 shutdown_connections 2024-09-17T04:23:46.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.262+0000 7f1ecd852640 1 -- 172.21.15.88:0/309042293 wait complete. 2024-09-17T04:23:46.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.263+0000 7f1ecd852640 1 Processor -- start 2024-09-17T04:23:46.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.263+0000 7f1ecd852640 1 -- start start 2024-09-17T04:23:46.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.263+0000 7f1ecd852640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ec8102450 0x7f1ec8101d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:46.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.263+0000 7f1ecd852640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ec8104d80 0x7f1ec8100400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:46.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.263+0000 7f1ecd852640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec810a740 con 0x7f1ec8102450 2024-09-17T04:23:46.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.263+0000 7f1ecd852640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec810a5c0 con 0x7f1ec8104d80 2024-09-17T04:23:46.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.263+0000 7f1ec6ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ec8102450 0x7f1ec8101d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:46.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.263+0000 7f1ec6ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ec8102450 0x7f1ec8101d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46396/0 (socket says 172.21.15.88:46396) 2024-09-17T04:23:46.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.263+0000 7f1ec6ffd640 1 -- 172.21.15.88:0/1708714848 learned_addr learned my addr 172.21.15.88:0/1708714848 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:23:46.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.264+0000 7f1ec67fc640 1 --2- 172.21.15.88:0/1708714848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ec8104d80 0x7f1ec8100400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:46.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.264+0000 7f1ec6ffd640 1 -- 172.21.15.88:0/1708714848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ec8104d80 msgr2=0x7f1ec8100400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:46.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.264+0000 7f1ec6ffd640 1 --2- 172.21.15.88:0/1708714848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ec8104d80 0x7f1ec8100400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:46.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.264+0000 7f1ec6ffd640 1 -- 172.21.15.88:0/1708714848 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ec8100940 con 0x7f1ec8102450 2024-09-17T04:23:46.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.264+0000 7f1ec6ffd640 1 --2- 172.21.15.88:0/1708714848 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ec8102450 0x7f1ec8101d40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1eb800c8f0 tx=0x7f1eb800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:46.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.264+0000 7f1ecc850640 1 -- 172.21.15.88:0/1708714848 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1eb80079b0 con 0x7f1ec8102450 2024-09-17T04:23:46.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.264+0000 7f1ecc850640 1 -- 172.21.15.88:0/1708714848 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1eb80054e0 con 0x7f1ec8102450 2024-09-17T04:23:46.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.264+0000 7f1ecd852640 1 -- 172.21.15.88:0/1708714848 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ec8100c30 con 0x7f1ec8102450 2024-09-17T04:23:46.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.264+0000 7f1ecc850640 1 -- 172.21.15.88:0/1708714848 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1eb8004dd0 con 0x7f1ec8102450 2024-09-17T04:23:46.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.264+0000 7f1ecd852640 1 -- 172.21.15.88:0/1708714848 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ec8101190 con 0x7f1ec8102450 2024-09-17T04:23:46.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.265+0000 7f1ecd852640 1 -- 172.21.15.88:0/1708714848 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ec8102830 con 0x7f1ec8102450 2024-09-17T04:23:46.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.266+0000 7f1ecc850640 1 -- 172.21.15.88:0/1708714848 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f1eb8005020 con 0x7f1ec8102450 2024-09-17T04:23:46.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.267+0000 7f1ecc850640 1 --2- 172.21.15.88:0/1708714848 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f1eb007aed0 0x7f1eb007d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:46.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.267+0000 7f1ecc850640 1 -- 172.21.15.88:0/1708714848 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7f1eb809ded0 con 0x7f1ec8102450 2024-09-17T04:23:46.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.267+0000 7f1ec67fc640 1 --2- 172.21.15.88:0/1708714848 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f1eb007aed0 0x7f1eb007d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:46.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.267+0000 7f1ec67fc640 1 --2- 172.21.15.88:0/1708714848 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f1eb007aed0 0x7f1eb007d390 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc009230 tx=0x7f1ebc0058d0 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:46.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.272+0000 7f1ecc850640 1 -- 172.21.15.88:0/1708714848 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f1eb8014030 con 0x7f1ec8102450 2024-09-17T04:23:46.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.544+0000 7f1ecd852640 1 -- 172.21.15.88:0/1708714848 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f1ec819f750 con 0x7f1ec8102450 2024-09-17T04:23:46.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.544+0000 7f1ecc850640 1 -- 172.21.15.88:0/1708714848 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f1eb8069520 con 0x7f1ec8102450 2024-09-17T04:23:46.546 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T04:23:46.546 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T04:23:46.546 INFO:teuthology.orchestra.run.smithi088.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T04:23:46.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.546+0000 7f1ecd852640 1 -- 172.21.15.88:0/1708714848 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f1eb007aed0 msgr2=0x7f1eb007d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:46.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.546+0000 7f1ecd852640 1 --2- 172.21.15.88:0/1708714848 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f1eb007aed0 0x7f1eb007d390 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc009230 tx=0x7f1ebc0058d0 comp rx=0 tx=0).stop 2024-09-17T04:23:46.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.546+0000 7f1ecd852640 1 -- 172.21.15.88:0/1708714848 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ec8102450 msgr2=0x7f1ec8101d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:46.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.546+0000 7f1ecd852640 1 --2- 172.21.15.88:0/1708714848 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ec8102450 0x7f1ec8101d40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1eb800c8f0 tx=0x7f1eb800cdb0 comp rx=0 tx=0).stop 2024-09-17T04:23:46.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.546+0000 7f1ecd852640 1 -- 172.21.15.88:0/1708714848 shutdown_connections 2024-09-17T04:23:46.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.546+0000 7f1ecd852640 1 --2- 172.21.15.88:0/1708714848 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f1eb007aed0 0x7f1eb007d390 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:46.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.546+0000 7f1ecd852640 1 --2- 172.21.15.88:0/1708714848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ec8104d80 0x7f1ec8100400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:46.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.547+0000 7f1ecd852640 1 --2- 172.21.15.88:0/1708714848 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ec8102450 0x7f1ec8101d40 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:46.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.547+0000 7f1ecd852640 1 -- 172.21.15.88:0/1708714848 >> 172.21.15.88:0/1708714848 conn(0x7f1ec80fc010 msgr2=0x7f1ec80fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:46.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.547+0000 7f1ecd852640 1 -- 172.21.15.88:0/1708714848 shutdown_connections 2024-09-17T04:23:46.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:23:46.547+0000 7f1ecd852640 1 -- 172.21.15.88:0/1708714848 wait complete. 2024-09-17T04:23:46.791 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:46 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/939393436' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:23:46.791 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:46 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/866876258' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T04:23:46.791 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:46 smithi088 ceph-mon[90867]: from='client.34120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:23:46.792 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:46 smithi088 ceph-mon[90867]: Upgrade: Updating osd.0 2024-09-17T04:23:46.792 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:46 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:46.792 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:46 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-17T04:23:46.792 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:46 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:23:46.792 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:46 smithi088 ceph-mon[90867]: Deploying daemon osd.0 on smithi088 2024-09-17T04:23:46.792 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:46 smithi088 ceph-mon[90867]: pgmap v51: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-17T04:23:46.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:46 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/939393436' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:23:46.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:46 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/866876258' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T04:23:46.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:46 smithi134 ceph-mon[76677]: from='client.34120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:23:46.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:46 smithi134 ceph-mon[76677]: Upgrade: Updating osd.0 2024-09-17T04:23:46.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:46 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:46.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:46 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-17T04:23:46.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:46 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:23:46.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:46 smithi134 ceph-mon[76677]: Deploying daemon osd.0 on smithi088 2024-09-17T04:23:46.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:46 smithi134 ceph-mon[76677]: pgmap v51: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-17T04:23:47.812 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:47 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/1708714848' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T04:23:47.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:47 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/1708714848' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T04:23:48.838 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:48 smithi088 ceph-mon[90867]: pgmap v52: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-17T04:23:48.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:48 smithi134 ceph-mon[76677]: pgmap v52: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-17T04:23:49.540 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:23:49 smithi088 systemd[1]: Stopping Ceph osd.0 for bf2b79a4-74aa-11ef-bceb-c7b262605968... 2024-09-17T04:23:49.540 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:23:49 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-0[49653]: 2024-09-17T04:23:49.489+0000 7feb92319640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T04:23:49.540 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:23:49 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-0[49653]: 2024-09-17T04:23:49.489+0000 7feb92319640 -1 osd.0 47 *** Got signal Terminated *** 2024-09-17T04:23:49.540 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:23:49 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-0[49653]: 2024-09-17T04:23:49.489+0000 7feb92319640 -1 osd.0 47 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T04:23:49.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:49 smithi088 ceph-mon[90867]: osd.0 marked itself down and dead 2024-09-17T04:23:49.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:49 smithi134 ceph-mon[76677]: osd.0 marked itself down and dead 2024-09-17T04:23:50.225 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:23:49 smithi088 podman[99121]: 2024-09-17 04:23:49.889435454 +0000 UTC m=+0.501187262 container died e309427ee12c3f7b62a31829dfb12911105f0520e4a6658bb6a076f9ed074e73 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-0, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T04:23:50.525 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:23:50 smithi088 podman[99121]: 2024-09-17 04:23:50.324694401 +0000 UTC m=+0.936446196 container cleanup e309427ee12c3f7b62a31829dfb12911105f0520e4a6658bb6a076f9ed074e73 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-17T04:23:50.525 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:23:50 smithi088 bash[99121]: ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-0 2024-09-17T04:23:50.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:50 smithi088 ceph-mon[90867]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T04:23:50.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:50 smithi088 ceph-mon[90867]: osdmap e48: 6 total, 5 up, 6 in 2024-09-17T04:23:50.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:50 smithi088 ceph-mon[90867]: pgmap v54: 65 pgs: 9 stale+active+clean, 56 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-09-17T04:23:50.888 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:23:50 smithi088 podman[99136]: 2024-09-17 04:23:50.525957266 +0000 UTC m=+0.634777530 container remove e309427ee12c3f7b62a31829dfb12911105f0520e4a6658bb6a076f9ed074e73 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T04:23:50.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:50 smithi134 ceph-mon[76677]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T04:23:50.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:50 smithi134 ceph-mon[76677]: osdmap e48: 6 total, 5 up, 6 in 2024-09-17T04:23:50.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:50 smithi134 ceph-mon[76677]: pgmap v54: 65 pgs: 9 stale+active+clean, 56 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-09-17T04:23:51.220 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:23:50 smithi088 podman[99226]: 2024-09-17 04:23:50.838314311 +0000 UTC m=+0.016231124 image pull 8e039cb7fe1eece5854872e8884a61a26632c7691b2c85cbac9078a9c5c62fae quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f 2024-09-17T04:23:51.220 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:23:50 smithi088 podman[99226]: 2024-09-17 04:23:50.960201856 +0000 UTC m=+0.138118659 container create 8cfe8a7a79e309c912d7ff180702ab4bab41c395ca52484bcf1fec67c33723ba (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-17T04:23:51.220 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:23:51 smithi088 podman[99226]: 2024-09-17 04:23:51.221180817 +0000 UTC m=+0.399097642 container init 8cfe8a7a79e309c912d7ff180702ab4bab41c395ca52484bcf1fec67c33723ba (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-0-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-17T04:23:51.550 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:23:51 smithi088 podman[99226]: 2024-09-17 04:23:51.224546689 +0000 UTC m=+0.402463502 container start 8cfe8a7a79e309c912d7ff180702ab4bab41c395ca52484bcf1fec67c33723ba (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-17T04:23:51.550 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:23:51 smithi088 podman[99226]: 2024-09-17 04:23:51.321123009 +0000 UTC m=+0.499039815 container attach 8cfe8a7a79e309c912d7ff180702ab4bab41c395ca52484bcf1fec67c33723ba (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342) 2024-09-17T04:23:51.550 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:23:51 smithi088 podman[99226]: 2024-09-17 04:23:51.410527798 +0000 UTC m=+0.588444611 container died 8cfe8a7a79e309c912d7ff180702ab4bab41c395ca52484bcf1fec67c33723ba (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-0-deactivate, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-17T04:23:51.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:51 smithi088 ceph-mon[90867]: osdmap e49: 6 total, 5 up, 6 in 2024-09-17T04:23:51.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:51 smithi134 ceph-mon[76677]: osdmap e49: 6 total, 5 up, 6 in 2024-09-17T04:23:52.388 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:23:51 smithi088 podman[99249]: 2024-09-17 04:23:51.991484402 +0000 UTC m=+0.574807945 container remove 8cfe8a7a79e309c912d7ff180702ab4bab41c395ca52484bcf1fec67c33723ba (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-17T04:23:52.388 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:23:52 smithi088 systemd[1]: ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968@osd.0.service: Deactivated successfully. 2024-09-17T04:23:52.388 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:23:52 smithi088 systemd[1]: Stopped Ceph osd.0 for bf2b79a4-74aa-11ef-bceb-c7b262605968. 2024-09-17T04:23:52.388 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:23:52 smithi088 systemd[1]: ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968@osd.0.service: Consumed 49.439s CPU time. 2024-09-17T04:23:52.388 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:23:52 smithi088 systemd[1]: Starting Ceph osd.0 for bf2b79a4-74aa-11ef-bceb-c7b262605968... 2024-09-17T04:23:52.686 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:52 smithi088 ceph-mon[90867]: pgmap v56: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s; 55/276 objects degraded (19.928%) 2024-09-17T04:23:52.687 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:23:52 smithi088 podman[99348]: 2024-09-17 04:23:52.333354187 +0000 UTC m=+0.015639784 image pull 8e039cb7fe1eece5854872e8884a61a26632c7691b2c85cbac9078a9c5c62fae quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f 2024-09-17T04:23:52.687 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:23:52 smithi088 podman[99348]: 2024-09-17 04:23:52.451246413 +0000 UTC m=+0.133532000 container create edc4a4770f7be92534575c6b4781c1a91b2be8c5df88ff6839132b86bcf424c6 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-0-activate, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, CEPH_POINT_RELEASE=) 2024-09-17T04:23:52.687 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:23:52 smithi088 podman[99348]: 2024-09-17 04:23:52.687094956 +0000 UTC m=+0.369380558 container init edc4a4770f7be92534575c6b4781c1a91b2be8c5df88ff6839132b86bcf424c6 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-0-activate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, ceph=True, org.label-schema.schema-version=1.0) 2024-09-17T04:23:52.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:52 smithi134 ceph-mon[76677]: pgmap v56: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s; 55/276 objects degraded (19.928%) 2024-09-17T04:23:53.138 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:23:52 smithi088 podman[99348]: 2024-09-17 04:23:52.690718768 +0000 UTC m=+0.373004360 container start edc4a4770f7be92534575c6b4781c1a91b2be8c5df88ff6839132b86bcf424c6 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-0-activate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T04:23:53.138 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:23:52 smithi088 podman[99348]: 2024-09-17 04:23:52.795469021 +0000 UTC m=+0.477754615 container attach edc4a4770f7be92534575c6b4781c1a91b2be8c5df88ff6839132b86bcf424c6 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-17T04:23:53.138 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:23:52 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-0-activate[99362]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T04:23:53.138 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:23:52 smithi088 bash[99348]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T04:23:53.138 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:23:52 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-0-activate[99362]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T04:23:53.138 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:23:52 smithi088 bash[99348]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T04:23:53.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:53 smithi088 ceph-mon[90867]: Health check failed: Degraded data redundancy: 55/276 objects degraded (19.928%), 19 pgs degraded (PG_DEGRADED) 2024-09-17T04:23:53.888 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:23:53 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-0-activate[99362]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T04:23:53.889 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:23:53 smithi088 bash[99348]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T04:23:53.889 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:23:53 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-0-activate[99362]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-17T04:23:53.889 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:23:53 smithi088 bash[99348]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-17T04:23:53.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:53 smithi134 ceph-mon[76677]: Health check failed: Degraded data redundancy: 55/276 objects degraded (19.928%), 19 pgs degraded (PG_DEGRADED) 2024-09-17T04:23:54.297 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:23:53 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-0-activate[99362]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-17T04:23:54.297 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:23:53 smithi088 bash[99348]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-17T04:23:54.297 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:23:53 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-0-activate[99362]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-17T04:23:54.298 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:23:53 smithi088 bash[99348]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-17T04:23:54.298 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:23:53 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-0-activate[99362]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-17T04:23:54.298 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:23:53 smithi088 bash[99348]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-17T04:23:54.298 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:23:53 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-0-activate[99362]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T04:23:54.298 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:23:53 smithi088 bash[99348]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T04:23:54.298 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:23:53 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-0-activate[99362]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-17T04:23:54.298 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:23:53 smithi088 bash[99348]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-17T04:23:54.298 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:23:54 smithi088 podman[99514]: 2024-09-17 04:23:54.019536915 +0000 UTC m=+0.016645635 container died edc4a4770f7be92534575c6b4781c1a91b2be8c5df88ff6839132b86bcf424c6 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-17T04:23:54.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:54 smithi088 ceph-mon[90867]: pgmap v57: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s; 55/276 objects degraded (19.928%) 2024-09-17T04:23:54.887 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:23:54 smithi088 podman[99514]: 2024-09-17 04:23:54.766005154 +0000 UTC m=+0.763113870 container remove edc4a4770f7be92534575c6b4781c1a91b2be8c5df88ff6839132b86bcf424c6 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-0-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-17T04:23:54.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:54 smithi134 ceph-mon[76677]: pgmap v57: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s; 55/276 objects degraded (19.928%) 2024-09-17T04:23:55.235 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:23:54 smithi088 podman[99574]: 2024-09-17 04:23:54.874499232 +0000 UTC m=+0.016377781 image pull 8e039cb7fe1eece5854872e8884a61a26632c7691b2c85cbac9078a9c5c62fae quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f 2024-09-17T04:23:55.236 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:23:55 smithi088 podman[99574]: 2024-09-17 04:23:55.000642338 +0000 UTC m=+0.142520873 container create 4ef267302248f32ae39a9df00d76e80189e279a223ed4a76c0123f188e6fe54d (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T04:23:55.236 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:23:55 smithi088 podman[99574]: 2024-09-17 04:23:55.236399109 +0000 UTC m=+0.378277652 container init 4ef267302248f32ae39a9df00d76e80189e279a223ed4a76c0123f188e6fe54d (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True) 2024-09-17T04:23:55.637 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:23:55 smithi088 podman[99574]: 2024-09-17 04:23:55.23976988 +0000 UTC m=+0.381648415 container start 4ef267302248f32ae39a9df00d76e80189e279a223ed4a76c0123f188e6fe54d (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-0, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T04:23:55.637 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:23:55 smithi088 ceph-osd[99593]: -- 172.21.15.88:0/2812511300 <== mon.0 v2:172.21.15.88:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562b5b2de1e0 con 0x562b5a566d00 2024-09-17T04:23:55.638 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:23:55 smithi088 bash[99574]: 4ef267302248f32ae39a9df00d76e80189e279a223ed4a76c0123f188e6fe54d 2024-09-17T04:23:55.638 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:23:55 smithi088 systemd[1]: Started Ceph osd.0 for bf2b79a4-74aa-11ef-bceb-c7b262605968. 2024-09-17T04:23:56.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:56 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:56.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:56 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:56.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:56 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:23:56.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:56 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:56.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:56 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:23:56.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:56 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:56.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:56 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:56.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:56 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:23:56.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:56 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:23:56.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:56 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:23:57.137 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:23:56 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-0[99589]: 2024-09-17T04:23:56.873+0000 7fa9e5fb1640 -1 Falling back to public interface 2024-09-17T04:23:57.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:57 smithi088 ceph-mon[90867]: pgmap v58: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 1 op/s; 55/276 objects degraded (19.928%) 2024-09-17T04:23:57.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:57 smithi134 ceph-mon[76677]: pgmap v58: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 1 op/s; 55/276 objects degraded (19.928%) 2024-09-17T04:23:58.868 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:23:58 smithi088 ceph-mon[90867]: pgmap v59: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 1 op/s; 55/276 objects degraded (19.928%) 2024-09-17T04:23:58.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:23:58 smithi134 ceph-mon[76677]: pgmap v59: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 1 op/s; 55/276 objects degraded (19.928%) 2024-09-17T04:24:00.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:00 smithi088 ceph-mon[90867]: pgmap v60: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 921 B/s rd, 1 op/s; 55/276 objects degraded (19.928%) 2024-09-17T04:24:00.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:00 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:24:00.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:00 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:24:00.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:00 smithi134 ceph-mon[76677]: pgmap v60: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 921 B/s rd, 1 op/s; 55/276 objects degraded (19.928%) 2024-09-17T04:24:00.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:00 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:24:00.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:00 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:24:02.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:02 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:24:02.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:02 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:24:02.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:02 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:24:02.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:02 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:24:03.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:03 smithi088 ceph-mon[90867]: pgmap v61: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 55/276 objects degraded (19.928%) 2024-09-17T04:24:03.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:03 smithi088 ceph-mon[90867]: from='osd.0 [v2:172.21.15.88:6802/1355210533,v1:172.21.15.88:6803/1355210533]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-17T04:24:03.138 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:24:02 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-0[99589]: 2024-09-17T04:24:02.846+0000 7fa9e5fb1640 -1 osd.0 47 log_to_monitors true 2024-09-17T04:24:03.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:03 smithi134 ceph-mon[76677]: pgmap v61: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 55/276 objects degraded (19.928%) 2024-09-17T04:24:03.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:03 smithi134 ceph-mon[76677]: from='osd.0 [v2:172.21.15.88:6802/1355210533,v1:172.21.15.88:6803/1355210533]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-17T04:24:04.079 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:24:04 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-0[99589]: 2024-09-17T04:24:04.001+0000 7fa9d9d29640 -1 osd.0 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T04:24:04.079 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:04 smithi088 ceph-mon[90867]: from='osd.0 [v2:172.21.15.88:6802/1355210533,v1:172.21.15.88:6803/1355210533]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-17T04:24:04.079 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:04 smithi088 ceph-mon[90867]: osdmap e50: 6 total, 5 up, 6 in 2024-09-17T04:24:04.079 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:04 smithi088 ceph-mon[90867]: from='osd.0 [v2:172.21.15.88:6802/1355210533,v1:172.21.15.88:6803/1355210533]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi088", "root=default"]} : dispatch 2024-09-17T04:24:04.079 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:04 smithi088 ceph-mon[90867]: from='osd.0 [v2:172.21.15.88:6802/1355210533,v1:172.21.15.88:6803/1355210533]' entity='osd.0' 2024-09-17T04:24:04.319 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:04 smithi134 ceph-mon[76677]: from='osd.0 [v2:172.21.15.88:6802/1355210533,v1:172.21.15.88:6803/1355210533]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-17T04:24:04.319 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:04 smithi134 ceph-mon[76677]: osdmap e50: 6 total, 5 up, 6 in 2024-09-17T04:24:04.319 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:04 smithi134 ceph-mon[76677]: from='osd.0 [v2:172.21.15.88:6802/1355210533,v1:172.21.15.88:6803/1355210533]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi088", "root=default"]} : dispatch 2024-09-17T04:24:04.319 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:04 smithi134 ceph-mon[76677]: from='osd.0 [v2:172.21.15.88:6802/1355210533,v1:172.21.15.88:6803/1355210533]' entity='osd.0' 2024-09-17T04:24:05.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:05 smithi088 ceph-mon[90867]: pgmap v63: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 55/276 objects degraded (19.928%) 2024-09-17T04:24:05.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:05 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:24:05.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:05 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:24:05.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:05 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:24:05.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:05 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:24:05.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:05 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:24:05.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:05 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:24:05.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:05 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:24:05.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:05 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:24:05.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:05 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:24:05.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:05 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-17T04:24:05.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:05 smithi088 ceph-mon[90867]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T04:24:05.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:05 smithi088 ceph-mon[90867]: osd.0 [v2:172.21.15.88:6802/1355210533,v1:172.21.15.88:6803/1355210533] boot 2024-09-17T04:24:05.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:05 smithi088 ceph-mon[90867]: osdmap e51: 6 total, 6 up, 6 in 2024-09-17T04:24:05.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:05 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-17T04:24:05.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:05 smithi134 ceph-mon[76677]: pgmap v63: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 55/276 objects degraded (19.928%) 2024-09-17T04:24:05.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:05 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:24:05.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:05 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:24:05.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:05 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:24:05.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:05 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:24:05.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:05 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:24:05.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:05 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:24:05.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:05 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:24:05.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:05 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:24:05.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:05 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:24:05.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:05 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-17T04:24:05.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:05 smithi134 ceph-mon[76677]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T04:24:05.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:05 smithi134 ceph-mon[76677]: osd.0 [v2:172.21.15.88:6802/1355210533,v1:172.21.15.88:6803/1355210533] boot 2024-09-17T04:24:05.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:05 smithi134 ceph-mon[76677]: osdmap e51: 6 total, 6 up, 6 in 2024-09-17T04:24:05.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:05 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-17T04:24:06.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:06 smithi088 ceph-mon[90867]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-17T04:24:06.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:06 smithi088 ceph-mon[90867]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-17T04:24:06.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:06 smithi088 ceph-mon[90867]: osdmap e52: 6 total, 6 up, 6 in 2024-09-17T04:24:06.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:06 smithi134 ceph-mon[76677]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-17T04:24:06.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:06 smithi134 ceph-mon[76677]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-17T04:24:06.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:06 smithi134 ceph-mon[76677]: osdmap e52: 6 total, 6 up, 6 in 2024-09-17T04:24:07.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:07 smithi088 ceph-mon[90867]: pgmap v66: 65 pgs: 6 active+undersized, 3 active+undersized+degraded, 56 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s; 8/276 objects degraded (2.899%) 2024-09-17T04:24:07.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:07 smithi134 ceph-mon[76677]: pgmap v66: 65 pgs: 6 active+undersized, 3 active+undersized+degraded, 56 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s; 8/276 objects degraded (2.899%) 2024-09-17T04:24:08.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:08 smithi088 ceph-mon[90867]: Health check update: Degraded data redundancy: 8/276 objects degraded (2.899%), 3 pgs degraded (PG_DEGRADED) 2024-09-17T04:24:08.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:08 smithi134 ceph-mon[76677]: Health check update: Degraded data redundancy: 8/276 objects degraded (2.899%), 3 pgs degraded (PG_DEGRADED) 2024-09-17T04:24:09.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:09 smithi088 ceph-mon[90867]: pgmap v67: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:24:09.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:09 smithi134 ceph-mon[76677]: pgmap v67: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:24:10.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:10 smithi088 ceph-mon[90867]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 8/276 objects degraded (2.899%), 3 pgs degraded) 2024-09-17T04:24:10.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:10 smithi134 ceph-mon[76677]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 8/276 objects degraded (2.899%), 3 pgs degraded) 2024-09-17T04:24:11.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:11 smithi088 ceph-mon[90867]: pgmap v68: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 695 B/s rd, 1 op/s 2024-09-17T04:24:11.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:11 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:24:11.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:11 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:24:11.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:11 smithi134 ceph-mon[76677]: pgmap v68: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 695 B/s rd, 1 op/s 2024-09-17T04:24:11.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:11 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:24:11.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:11 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:24:12.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:12 smithi088 ceph-mon[90867]: pgmap v69: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:24:12.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:12 smithi134 ceph-mon[76677]: pgmap v69: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:24:14.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:14 smithi088 ceph-mon[90867]: pgmap v70: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-17T04:24:14.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:14 smithi134 ceph-mon[76677]: pgmap v70: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-17T04:24:16.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.638+0000 7fa6e8de4640 1 -- 172.21.15.88:0/675568534 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa6e4102450 msgr2=0x7fa6e4104840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:16.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.638+0000 7fa6e8de4640 1 --2- 172.21.15.88:0/675568534 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa6e4102450 0x7fa6e4104840 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa6d4009880 tx=0x7fa6d402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:24:16.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.638+0000 7fa6e8de4640 1 -- 172.21.15.88:0/675568534 shutdown_connections 2024-09-17T04:24:16.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.638+0000 7fa6e8de4640 1 --2- 172.21.15.88:0/675568534 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6e4104d80 0x7fa6e4107170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:16.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.638+0000 7fa6e8de4640 1 --2- 172.21.15.88:0/675568534 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa6e4102450 0x7fa6e4104840 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:16.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.638+0000 7fa6e8de4640 1 -- 172.21.15.88:0/675568534 >> 172.21.15.88:0/675568534 conn(0x7fa6e40fc010 msgr2=0x7fa6e40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:16.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.638+0000 7fa6e8de4640 1 -- 172.21.15.88:0/675568534 shutdown_connections 2024-09-17T04:24:16.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.638+0000 7fa6e8de4640 1 -- 172.21.15.88:0/675568534 wait complete. 2024-09-17T04:24:16.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.639+0000 7fa6e8de4640 1 Processor -- start 2024-09-17T04:24:16.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.639+0000 7fa6e8de4640 1 -- start start 2024-09-17T04:24:16.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.639+0000 7fa6e8de4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa6e4102450 0x7fa6e4197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:16.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.639+0000 7fa6e8de4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6e4104d80 0x7fa6e4197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:16.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.639+0000 7fa6e8de4640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e410a7c0 con 0x7fa6e4102450 2024-09-17T04:24:16.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.639+0000 7fa6e8de4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e410a640 con 0x7fa6e4104d80 2024-09-17T04:24:16.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.639+0000 7fa6e259c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa6e4102450 0x7fa6e4197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:16.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.639+0000 7fa6e259c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa6e4102450 0x7fa6e4197520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57582/0 (socket says 172.21.15.88:57582) 2024-09-17T04:24:16.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.639+0000 7fa6e259c640 1 -- 172.21.15.88:0/1603878192 learned_addr learned my addr 172.21.15.88:0/1603878192 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:24:16.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.639+0000 7fa6e1d9b640 1 --2- 172.21.15.88:0/1603878192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6e4104d80 0x7fa6e4197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:16.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.640+0000 7fa6e259c640 1 -- 172.21.15.88:0/1603878192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6e4104d80 msgr2=0x7fa6e4197a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:16.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.640+0000 7fa6e259c640 1 --2- 172.21.15.88:0/1603878192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6e4104d80 0x7fa6e4197a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:16.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.640+0000 7fa6e259c640 1 -- 172.21.15.88:0/1603878192 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6e41980e0 con 0x7fa6e4102450 2024-09-17T04:24:16.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.640+0000 7fa6e259c640 1 --2- 172.21.15.88:0/1603878192 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa6e4102450 0x7fa6e4197520 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa6d4006010 tx=0x7fa6d40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:16.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.640+0000 7fa6d37fe640 1 -- 172.21.15.88:0/1603878192 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa6d403f070 con 0x7fa6e4102450 2024-09-17T04:24:16.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.640+0000 7fa6e8de4640 1 -- 172.21.15.88:0/1603878192 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6e419cb20 con 0x7fa6e4102450 2024-09-17T04:24:16.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.640+0000 7fa6d37fe640 1 -- 172.21.15.88:0/1603878192 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa6d40044d0 con 0x7fa6e4102450 2024-09-17T04:24:16.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.640+0000 7fa6d37fe640 1 -- 172.21.15.88:0/1603878192 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa6d4035030 con 0x7fa6e4102450 2024-09-17T04:24:16.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.640+0000 7fa6e8de4640 1 -- 172.21.15.88:0/1603878192 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6e419d0b0 con 0x7fa6e4102450 2024-09-17T04:24:16.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.641+0000 7fa6e8de4640 1 -- 172.21.15.88:0/1603878192 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6e4102830 con 0x7fa6e4102450 2024-09-17T04:24:16.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.642+0000 7fa6d37fe640 1 -- 172.21.15.88:0/1603878192 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fa6d4042070 con 0x7fa6e4102450 2024-09-17T04:24:16.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.642+0000 7fa6d37fe640 1 --2- 172.21.15.88:0/1603878192 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fa6cc07af30 0x7fa6cc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:16.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.643+0000 7fa6d37fe640 1 -- 172.21.15.88:0/1603878192 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6070+0+0 (secure 0 0 0) 0x7fa6d40bebe0 con 0x7fa6e4102450 2024-09-17T04:24:16.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.643+0000 7fa6e1d9b640 1 --2- 172.21.15.88:0/1603878192 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fa6cc07af30 0x7fa6cc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:16.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.643+0000 7fa6e1d9b640 1 --2- 172.21.15.88:0/1603878192 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fa6cc07af30 0x7fa6cc07d3f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa6e41989d0 tx=0x7fa6d8009110 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:16.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.647+0000 7fa6d37fe640 1 -- 172.21.15.88:0/1603878192 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fa6d408a230 con 0x7fa6e4102450 2024-09-17T04:24:16.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.838+0000 7fa6e8de4640 1 -- 172.21.15.88:0/1603878192 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa6e4105700 con 0x7fa6cc07af30 2024-09-17T04:24:16.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.839+0000 7fa6d37fe640 1 -- 172.21.15.88:0/1603878192 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7fa6e4105700 con 0x7fa6cc07af30 2024-09-17T04:24:16.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.841+0000 7fa6e8de4640 1 -- 172.21.15.88:0/1603878192 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fa6cc07af30 msgr2=0x7fa6cc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:16.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.841+0000 7fa6e8de4640 1 --2- 172.21.15.88:0/1603878192 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fa6cc07af30 0x7fa6cc07d3f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa6e41989d0 tx=0x7fa6d8009110 comp rx=0 tx=0).stop 2024-09-17T04:24:16.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.841+0000 7fa6e8de4640 1 -- 172.21.15.88:0/1603878192 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa6e4102450 msgr2=0x7fa6e4197520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:16.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.841+0000 7fa6e8de4640 1 --2- 172.21.15.88:0/1603878192 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa6e4102450 0x7fa6e4197520 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa6d4006010 tx=0x7fa6d40048f0 comp rx=0 tx=0).stop 2024-09-17T04:24:16.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.841+0000 7fa6e8de4640 1 -- 172.21.15.88:0/1603878192 shutdown_connections 2024-09-17T04:24:16.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.841+0000 7fa6e8de4640 1 --2- 172.21.15.88:0/1603878192 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fa6cc07af30 0x7fa6cc07d3f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:16.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.841+0000 7fa6e8de4640 1 --2- 172.21.15.88:0/1603878192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6e4104d80 0x7fa6e4197a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:16.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.841+0000 7fa6e8de4640 1 --2- 172.21.15.88:0/1603878192 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa6e4102450 0x7fa6e4197520 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:16.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.841+0000 7fa6e8de4640 1 -- 172.21.15.88:0/1603878192 >> 172.21.15.88:0/1603878192 conn(0x7fa6e40fc010 msgr2=0x7fa6e40fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:16.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.841+0000 7fa6e8de4640 1 -- 172.21.15.88:0/1603878192 shutdown_connections 2024-09-17T04:24:16.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.841+0000 7fa6e8de4640 1 -- 172.21.15.88:0/1603878192 wait complete. 2024-09-17T04:24:16.850 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-09-17T04:24:16.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.924+0000 7f6024a46640 1 -- 172.21.15.88:0/1204923270 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6020104d20 msgr2=0x7f6020107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:16.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.924+0000 7f6024a46640 1 --2- 172.21.15.88:0/1204923270 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6020104d20 0x7f6020107110 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f60080098b0 tx=0x7f600802a4d0 comp rx=0 tx=0).stop 2024-09-17T04:24:16.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.925+0000 7f6024a46640 1 -- 172.21.15.88:0/1204923270 shutdown_connections 2024-09-17T04:24:16.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.925+0000 7f6024a46640 1 --2- 172.21.15.88:0/1204923270 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6020104d20 0x7f6020107110 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:16.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.925+0000 7f6024a46640 1 --2- 172.21.15.88:0/1204923270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60201023f0 0x7f60201047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:16.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.925+0000 7f6024a46640 1 -- 172.21.15.88:0/1204923270 >> 172.21.15.88:0/1204923270 conn(0x7f60200fc010 msgr2=0x7f60200fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:16.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.925+0000 7f6024a46640 1 -- 172.21.15.88:0/1204923270 shutdown_connections 2024-09-17T04:24:16.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.925+0000 7f6024a46640 1 -- 172.21.15.88:0/1204923270 wait complete. 2024-09-17T04:24:16.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.926+0000 7f6024a46640 1 Processor -- start 2024-09-17T04:24:16.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.926+0000 7f6024a46640 1 -- start start 2024-09-17T04:24:16.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.926+0000 7f6024a46640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60201023f0 0x7f6020197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:16.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.926+0000 7f6024a46640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6020104d20 0x7f6020197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:16.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.926+0000 7f6024a46640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f602010a790 con 0x7f6020104d20 2024-09-17T04:24:16.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.926+0000 7f6024a46640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f602010a610 con 0x7f60201023f0 2024-09-17T04:24:16.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.926+0000 7f601dd9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6020104d20 0x7f6020197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:16.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.926+0000 7f601dd9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6020104d20 0x7f6020197a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57598/0 (socket says 172.21.15.88:57598) 2024-09-17T04:24:16.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.926+0000 7f601dd9b640 1 -- 172.21.15.88:0/246984416 learned_addr learned my addr 172.21.15.88:0/246984416 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:24:16.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.926+0000 7f601e59c640 1 --2- 172.21.15.88:0/246984416 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60201023f0 0x7f6020197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:16.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.926+0000 7f601dd9b640 1 -- 172.21.15.88:0/246984416 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60201023f0 msgr2=0x7f6020197510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:16.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.926+0000 7f601dd9b640 1 --2- 172.21.15.88:0/246984416 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60201023f0 0x7f6020197510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:16.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.926+0000 7f601dd9b640 1 -- 172.21.15.88:0/246984416 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60201980d0 con 0x7f6020104d20 2024-09-17T04:24:16.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.927+0000 7f601dd9b640 1 --2- 172.21.15.88:0/246984416 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6020104d20 0x7f6020197a50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6008009230 tx=0x7f60080048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:16.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.927+0000 7f60177fe640 1 -- 172.21.15.88:0/246984416 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f600803f070 con 0x7f6020104d20 2024-09-17T04:24:16.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.927+0000 7f6024a46640 1 -- 172.21.15.88:0/246984416 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f602019cab0 con 0x7f6020104d20 2024-09-17T04:24:16.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.927+0000 7f60177fe640 1 -- 172.21.15.88:0/246984416 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f60080044d0 con 0x7f6020104d20 2024-09-17T04:24:16.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.927+0000 7f60177fe640 1 -- 172.21.15.88:0/246984416 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6008035030 con 0x7f6020104d20 2024-09-17T04:24:16.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.927+0000 7f6024a46640 1 -- 172.21.15.88:0/246984416 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f602019d040 con 0x7f6020104d20 2024-09-17T04:24:16.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.928+0000 7f6024a46640 1 -- 172.21.15.88:0/246984416 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60201027d0 con 0x7f6020104d20 2024-09-17T04:24:16.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.929+0000 7f60177fe640 1 -- 172.21.15.88:0/246984416 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f6008042070 con 0x7f6020104d20 2024-09-17T04:24:16.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.930+0000 7f60177fe640 1 --2- 172.21.15.88:0/246984416 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f600c07af80 0x7f600c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:16.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.930+0000 7f601e59c640 1 --2- 172.21.15.88:0/246984416 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f600c07af80 0x7f600c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:16.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.930+0000 7f60177fe640 1 -- 172.21.15.88:0/246984416 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6070+0+0 (secure 0 0 0) 0x7f60080beb60 con 0x7f6020104d20 2024-09-17T04:24:16.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.930+0000 7f601e59c640 1 --2- 172.21.15.88:0/246984416 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f600c07af80 0x7f600c07d440 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f60180058c0 tx=0x7f601800a2d0 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:16.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:16.934+0000 7f60177fe640 1 -- 172.21.15.88:0/246984416 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f600808a190 con 0x7f6020104d20 2024-09-17T04:24:17.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.125+0000 7f6024a46640 1 -- 172.21.15.88:0/246984416 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6020105780 con 0x7f600c07af80 2024-09-17T04:24:17.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.127+0000 7f60177fe640 1 -- 172.21.15.88:0/246984416 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f6020105780 con 0x7f600c07af80 2024-09-17T04:24:17.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.129+0000 7f6024a46640 1 -- 172.21.15.88:0/246984416 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f600c07af80 msgr2=0x7f600c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:17.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.129+0000 7f6024a46640 1 --2- 172.21.15.88:0/246984416 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f600c07af80 0x7f600c07d440 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f60180058c0 tx=0x7f601800a2d0 comp rx=0 tx=0).stop 2024-09-17T04:24:17.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.129+0000 7f6024a46640 1 -- 172.21.15.88:0/246984416 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6020104d20 msgr2=0x7f6020197a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:17.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.129+0000 7f6024a46640 1 --2- 172.21.15.88:0/246984416 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6020104d20 0x7f6020197a50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6008009230 tx=0x7f60080048f0 comp rx=0 tx=0).stop 2024-09-17T04:24:17.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.129+0000 7f6024a46640 1 -- 172.21.15.88:0/246984416 shutdown_connections 2024-09-17T04:24:17.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.129+0000 7f6024a46640 1 --2- 172.21.15.88:0/246984416 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f600c07af80 0x7f600c07d440 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:17.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.129+0000 7f6024a46640 1 --2- 172.21.15.88:0/246984416 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6020104d20 0x7f6020197a50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:17.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.129+0000 7f6024a46640 1 --2- 172.21.15.88:0/246984416 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60201023f0 0x7f6020197510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:17.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.129+0000 7f6024a46640 1 -- 172.21.15.88:0/246984416 >> 172.21.15.88:0/246984416 conn(0x7f60200fc010 msgr2=0x7f60200fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:17.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.129+0000 7f6024a46640 1 -- 172.21.15.88:0/246984416 shutdown_connections 2024-09-17T04:24:17.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.129+0000 7f6024a46640 1 -- 172.21.15.88:0/246984416 wait complete. 2024-09-17T04:24:17.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.210+0000 7fd280614640 1 -- 172.21.15.88:0/3570317643 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd278102cc0 msgr2=0x7fd278103140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:17.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.210+0000 7fd280614640 1 --2- 172.21.15.88:0/3570317643 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd278102cc0 0x7fd278103140 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd268009880 tx=0x7fd26802a4a0 comp rx=0 tx=0).stop 2024-09-17T04:24:17.211 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:17 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:24:17.211 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:17 smithi088 ceph-mon[90867]: pgmap v71: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-17T04:24:17.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.210+0000 7fd280614640 1 -- 172.21.15.88:0/3570317643 shutdown_connections 2024-09-17T04:24:17.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.210+0000 7fd280614640 1 --2- 172.21.15.88:0/3570317643 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd278102cc0 0x7fd278103140 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:17.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.210+0000 7fd280614640 1 --2- 172.21.15.88:0/3570317643 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2780ffc40 0x7fd278100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:17.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.210+0000 7fd280614640 1 -- 172.21.15.88:0/3570317643 >> 172.21.15.88:0/3570317643 conn(0x7fd2780fb770 msgr2=0x7fd2780fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:17.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.210+0000 7fd280614640 1 -- 172.21.15.88:0/3570317643 shutdown_connections 2024-09-17T04:24:17.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.210+0000 7fd280614640 1 -- 172.21.15.88:0/3570317643 wait complete. 2024-09-17T04:24:17.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.211+0000 7fd280614640 1 Processor -- start 2024-09-17T04:24:17.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.211+0000 7fd280614640 1 -- start start 2024-09-17T04:24:17.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.211+0000 7fd280614640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2780ffc40 0x7fd2781025b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:17.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.211+0000 7fd280614640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd278102cc0 0x7fd278100c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:17.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.211+0000 7fd280614640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fd27810a820 con 0x7fd2780ffc40 2024-09-17T04:24:17.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.211+0000 7fd280614640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd27810a6a0 con 0x7fd278102cc0 2024-09-17T04:24:17.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.211+0000 7fd27e3b0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2780ffc40 0x7fd2781025b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:17.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.211+0000 7fd27e3b0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2780ffc40 0x7fd2781025b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57628/0 (socket says 172.21.15.88:57628) 2024-09-17T04:24:17.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.211+0000 7fd27e3b0640 1 -- 172.21.15.88:0/1382006207 learned_addr learned my addr 172.21.15.88:0/1382006207 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:24:17.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.211+0000 7fd27dbaf640 1 --2- 172.21.15.88:0/1382006207 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd278102cc0 0x7fd278100c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:17.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.212+0000 7fd27e3b0640 1 -- 172.21.15.88:0/1382006207 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd278102cc0 msgr2=0x7fd278100c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:17.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.212+0000 7fd27e3b0640 1 --2- 172.21.15.88:0/1382006207 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd278102cc0 0x7fd278100c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:17.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.212+0000 7fd27e3b0640 1 -- 172.21.15.88:0/1382006207 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2781011b0 con 0x7fd2780ffc40 2024-09-17T04:24:17.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.212+0000 7fd27e3b0640 1 --2- 172.21.15.88:0/1382006207 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2780ffc40 0x7fd2781025b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd27400b3d0 tx=0x7fd27400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:17.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.212+0000 7fd26f7fe640 1 -- 172.21.15.88:0/1382006207 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd274015020 con 0x7fd2780ffc40 2024-09-17T04:24:17.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.212+0000 7fd280614640 1 -- 172.21.15.88:0/1382006207 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2781014a0 con 0x7fd2780ffc40 2024-09-17T04:24:17.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.212+0000 7fd26f7fe640 1 -- 172.21.15.88:0/1382006207 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd274011af0 con 0x7fd2780ffc40 2024-09-17T04:24:17.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.212+0000 7fd26f7fe640 1 -- 172.21.15.88:0/1382006207 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd274010da0 con 0x7fd2780ffc40 2024-09-17T04:24:17.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.212+0000 7fd280614640 1 -- 172.21.15.88:0/1382006207 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd278101ab0 con 0x7fd2780ffc40 2024-09-17T04:24:17.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.213+0000 7fd280614640 1 -- 172.21.15.88:0/1382006207 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd278100040 con 0x7fd2780ffc40 2024-09-17T04:24:17.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.214+0000 7fd26f7fe640 1 -- 172.21.15.88:0/1382006207 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fd274018020 con 0x7fd2780ffc40 2024-09-17T04:24:17.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.214+0000 7fd26f7fe640 1 --2- 172.21.15.88:0/1382006207 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fd26407af30 0x7fd26407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:17.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.214+0000 7fd26f7fe640 1 -- 172.21.15.88:0/1382006207 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6070+0+0 (secure 0 0 0) 0x7fd27409d9d0 con 0x7fd2780ffc40 2024-09-17T04:24:17.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.214+0000 7fd27dbaf640 1 --2- 172.21.15.88:0/1382006207 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fd26407af30 0x7fd26407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:17.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.215+0000 7fd27dbaf640 1 --2- 172.21.15.88:0/1382006207 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fd26407af30 0x7fd26407d3f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd278102330 tx=0x7fd268005a20 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:17.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.219+0000 7fd26f7fe640 1 -- 172.21.15.88:0/1382006207 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fd27401f020 con 0x7fd2780ffc40 2024-09-17T04:24:17.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:17 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:24:17.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:17 smithi134 ceph-mon[76677]: pgmap v71: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-17T04:24:17.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.401+0000 7fd280614640 1 -- 172.21.15.88:0/1382006207 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fd278062630 con 0x7fd26407af30 2024-09-17T04:24:17.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.410+0000 7fd26f7fe640 1 -- 172.21.15.88:0/1382006207 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fd278062630 con 0x7fd26407af30 2024-09-17T04:24:17.412 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T04:24:17.412 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (9m) 16s ago 11m 25.4M - 0.25.0 c8568f914cd2 f2dbac7e939f 2024-09-17T04:24:17.412 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi088 smithi088 running (3m) 16s ago 11m 8510k - 19.1.1-330-gc2ddf972 ebb0615149de 683e1826a1a5 2024-09-17T04:24:17.413 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi134 smithi134 running (2m) 39s ago 10m 8426k - 19.1.1-330-gc2ddf972 ebb0615149de 83afa4200c0e 2024-09-17T04:24:17.413 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (47s) 16s ago 11m 6891k - 19.3.0-4989-gce1b342b 8e039cb7fe1e 10355648c406 2024-09-17T04:24:17.413 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi134 smithi134 running (42s) 39s ago 10m 6899k - 19.3.0-4989-gce1b342b 8e039cb7fe1e d709085ffe5d 2024-09-17T04:24:17.413 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (9m) 16s ago 11m 79.5M - 9.4.12 2bacad6d85d8 a6cff57a23f9 2024-09-17T04:24:17.413 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.giqrgt smithi088 running (5m) 16s ago 5m 149M - 19.1.1-330-gc2ddf972 ebb0615149de f724660799a1 2024-09-17T04:24:17.413 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.lgavsv smithi088 running (6m) 16s ago 6m 15.7M - 19.1.1-330-gc2ddf972 ebb0615149de 6cc0fe8a6aa9 2024-09-17T04:24:17.413 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi134.ktuhce smithi134 running (6m) 39s ago 6m 15.0M - 19.1.1-330-gc2ddf972 ebb0615149de 7ff5b70ca9cb 2024-09-17T04:24:17.413 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi134.psnynp smithi134 running (5m) 39s ago 5m 90.6M - 19.1.1-330-gc2ddf972 ebb0615149de 5326974fa3dd 2024-09-17T04:24:17.413 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.wmndiv smithi088 *:8443,9283,8765 running (2m) 16s ago 12m 579M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 49eb47f7f14f 2024-09-17T04:24:17.413 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi134.vwdxcb smithi134 *:8443,9283,8765 running (88s) 39s ago 10m 520M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 8a6d45eb0595 2024-09-17T04:24:17.413 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (75s) 16s ago 12m 109M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e ac6332015243 2024-09-17T04:24:17.413 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi134 smithi134 running (59s) 39s ago 10m 91.9M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e ea49f690e26b 2024-09-17T04:24:17.413 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (11m) 16s ago 11m 16.8M - 1.5.0 0da6a335fe13 9ba03800993b 2024-09-17T04:24:17.413 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi134 smithi134 *:9100 running (10m) 39s ago 10m 17.1M - 1.5.0 0da6a335fe13 6deac483827f 2024-09-17T04:24:17.414 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (22s) 16s ago 9m 79.2M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 4ef267302248 2024-09-17T04:24:17.414 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (8m) 16s ago 8m 213M 1216M 19.1.1-330-gc2ddf972 ebb0615149de cc68d92b3333 2024-09-17T04:24:17.414 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (8m) 16s ago 8m 178M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 1ba92f2bfce6 2024-09-17T04:24:17.414 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi134 running (7m) 39s ago 7m 233M 2240M 19.1.1-330-gc2ddf972 ebb0615149de ebd528c3ce1b 2024-09-17T04:24:17.414 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi134 running (7m) 39s ago 7m 208M 2240M 19.1.1-330-gc2ddf972 ebb0615149de eacc25537b3a 2024-09-17T04:24:17.414 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi134 running (7m) 39s ago 7m 185M 2240M 19.1.1-330-gc2ddf972 ebb0615149de bc1b434a92a8 2024-09-17T04:24:17.414 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (93s) 16s ago 11m 58.4M - 2.43.0 a07b618ecd1d b51d7899d341 2024-09-17T04:24:17.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.412+0000 7fd280614640 1 -- 172.21.15.88:0/1382006207 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fd26407af30 msgr2=0x7fd26407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:17.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.412+0000 7fd280614640 1 --2- 172.21.15.88:0/1382006207 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fd26407af30 0x7fd26407d3f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd278102330 tx=0x7fd268005a20 comp rx=0 tx=0).stop 2024-09-17T04:24:17.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.412+0000 7fd280614640 1 -- 172.21.15.88:0/1382006207 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2780ffc40 msgr2=0x7fd2781025b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:17.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.412+0000 7fd280614640 1 --2- 172.21.15.88:0/1382006207 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2780ffc40 0x7fd2781025b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd27400b3d0 tx=0x7fd27400b890 comp rx=0 tx=0).stop 2024-09-17T04:24:17.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.412+0000 7fd280614640 1 -- 172.21.15.88:0/1382006207 shutdown_connections 2024-09-17T04:24:17.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.412+0000 7fd280614640 1 --2- 172.21.15.88:0/1382006207 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fd26407af30 0x7fd26407d3f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:17.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.412+0000 7fd280614640 1 --2- 172.21.15.88:0/1382006207 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd278102cc0 0x7fd278100c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:17.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.412+0000 7fd280614640 1 --2- 172.21.15.88:0/1382006207 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2780ffc40 0x7fd2781025b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:17.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.412+0000 7fd280614640 1 -- 172.21.15.88:0/1382006207 >> 172.21.15.88:0/1382006207 conn(0x7fd2780fb770 msgr2=0x7fd278106170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:17.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.412+0000 7fd280614640 1 -- 172.21.15.88:0/1382006207 shutdown_connections 2024-09-17T04:24:17.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.412+0000 7fd280614640 1 -- 172.21.15.88:0/1382006207 wait complete. 2024-09-17T04:24:17.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.493+0000 7f47d69ea640 1 -- 172.21.15.88:0/2858604583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47d0100860 msgr2=0x7f47d0100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:17.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.493+0000 7f47d69ea640 1 --2- 172.21.15.88:0/2858604583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47d0100860 0x7f47d0100c60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f47c0009880 tx=0x7f47c002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:24:17.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.493+0000 7f47d69ea640 1 -- 172.21.15.88:0/2858604583 shutdown_connections 2024-09-17T04:24:17.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.493+0000 7f47d69ea640 1 --2- 172.21.15.88:0/2858604583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47d0101a60 0x7f47d0101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:17.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.493+0000 7f47d69ea640 1 --2- 172.21.15.88:0/2858604583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47d0100860 0x7f47d0100c60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:17.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.493+0000 7f47d69ea640 1 -- 172.21.15.88:0/2858604583 >> 172.21.15.88:0/2858604583 conn(0x7f47d00fc010 msgr2=0x7f47d00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:17.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.493+0000 7f47d69ea640 1 -- 172.21.15.88:0/2858604583 shutdown_connections 2024-09-17T04:24:17.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.493+0000 7f47d69ea640 1 -- 172.21.15.88:0/2858604583 wait complete. 2024-09-17T04:24:17.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.494+0000 7f47d69ea640 1 Processor -- start 2024-09-17T04:24:17.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.494+0000 7f47d69ea640 1 -- start start 2024-09-17T04:24:17.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.494+0000 7f47d69ea640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47d0100860 0x7f47d006aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:17.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.494+0000 7f47d69ea640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47d0101a60 0x7f47d019c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:17.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.494+0000 7f47d69ea640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f47d01096a0 con 0x7f47d0101a60 2024-09-17T04:24:17.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.494+0000 7f47d69ea640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f47d0109520 con 0x7f47d0100860 2024-09-17T04:24:17.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.494+0000 7f47cf7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47d0101a60 0x7f47d019c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:17.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.494+0000 7f47cf7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47d0101a60 0x7f47d019c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57640/0 (socket says 172.21.15.88:57640) 2024-09-17T04:24:17.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.494+0000 7f47cf7fe640 1 -- 172.21.15.88:0/2178407834 learned_addr learned my addr 172.21.15.88:0/2178407834 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:24:17.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.494+0000 7f47cffff640 1 --2- 172.21.15.88:0/2178407834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47d0100860 0x7f47d006aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:17.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.494+0000 7f47cf7fe640 1 -- 172.21.15.88:0/2178407834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47d0100860 msgr2=0x7f47d006aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:17.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.494+0000 7f47cf7fe640 1 --2- 172.21.15.88:0/2178407834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47d0100860 0x7f47d006aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:17.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.494+0000 7f47cf7fe640 1 -- 172.21.15.88:0/2178407834 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47d019c7e0 con 0x7f47d0101a60 2024-09-17T04:24:17.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.495+0000 7f47cf7fe640 1 --2- 172.21.15.88:0/2178407834 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47d0101a60 0x7f47d019c220 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f47c400d6f0 tx=0x7f47c400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:17.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.495+0000 7f47cd7fa640 1 -- 172.21.15.88:0/2178407834 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f47c4017070 con 0x7f47d0101a60 2024-09-17T04:24:17.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.495+0000 7f47cd7fa640 1 -- 172.21.15.88:0/2178407834 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f47c400de00 con 0x7f47d0101a60 2024-09-17T04:24:17.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.495+0000 7f47d69ea640 1 -- 172.21.15.88:0/2178407834 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47d019cad0 con 0x7f47d0101a60 2024-09-17T04:24:17.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.495+0000 7f47cd7fa640 1 -- 172.21.15.88:0/2178407834 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f47c4004bb0 con 0x7f47d0101a60 2024-09-17T04:24:17.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.495+0000 7f47d69ea640 1 -- 172.21.15.88:0/2178407834 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47d019d060 con 0x7f47d0101a60 2024-09-17T04:24:17.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.496+0000 7f47d69ea640 1 -- 172.21.15.88:0/2178407834 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47d0100c60 con 0x7f47d0101a60 2024-09-17T04:24:17.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.497+0000 7f47cd7fa640 1 -- 172.21.15.88:0/2178407834 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f47c4004e60 con 0x7f47d0101a60 2024-09-17T04:24:17.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.498+0000 7f47cd7fa640 1 --2- 172.21.15.88:0/2178407834 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f47b807af30 0x7f47b807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:17.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.498+0000 7f47cffff640 1 --2- 172.21.15.88:0/2178407834 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f47b807af30 0x7f47b807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:17.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.498+0000 7f47cd7fa640 1 -- 172.21.15.88:0/2178407834 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6070+0+0 (secure 0 0 0) 0x7f47c409dfc0 con 0x7f47d0101a60 2024-09-17T04:24:17.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.498+0000 7f47cffff640 1 --2- 172.21.15.88:0/2178407834 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f47b807af30 0x7f47b807d3f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f47c0009230 tx=0x7f47c00058d0 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:17.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.502+0000 7f47cd7fa640 1 -- 172.21.15.88:0/2178407834 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f47c4069620 con 0x7f47d0101a60 2024-09-17T04:24:17.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.743+0000 7f47d69ea640 1 -- 172.21.15.88:0/2178407834 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f47d019d560 con 0x7f47d0101a60 2024-09-17T04:24:17.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.743+0000 7f47cd7fa640 1 -- 172.21.15.88:0/2178407834 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7f47c406e4d0 con 0x7f47d0101a60 2024-09-17T04:24:17.744 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-17T04:24:17.744 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-09-17T04:24:17.744 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T04:24:17.744 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:24:17.744 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-09-17T04:24:17.745 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T04:24:17.745 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:24:17.745 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-09-17T04:24:17.745 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 5, 2024-09-17T04:24:17.745 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 1 2024-09-17T04:24:17.745 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:24:17.745 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2024-09-17T04:24:17.745 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T04:24:17.745 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:24:17.745 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-09-17T04:24:17.746 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 9, 2024-09-17T04:24:17.746 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 5 2024-09-17T04:24:17.746 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-17T04:24:17.746 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-17T04:24:17.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.745+0000 7f47d69ea640 1 -- 172.21.15.88:0/2178407834 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f47b807af30 msgr2=0x7f47b807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:17.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.745+0000 7f47d69ea640 1 --2- 172.21.15.88:0/2178407834 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f47b807af30 0x7f47b807d3f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f47c0009230 tx=0x7f47c00058d0 comp rx=0 tx=0).stop 2024-09-17T04:24:17.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.745+0000 7f47d69ea640 1 -- 172.21.15.88:0/2178407834 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47d0101a60 msgr2=0x7f47d019c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:17.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.745+0000 7f47d69ea640 1 --2- 172.21.15.88:0/2178407834 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47d0101a60 0x7f47d019c220 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f47c400d6f0 tx=0x7f47c400dbb0 comp rx=0 tx=0).stop 2024-09-17T04:24:17.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.746+0000 7f47d69ea640 1 -- 172.21.15.88:0/2178407834 shutdown_connections 2024-09-17T04:24:17.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.746+0000 7f47d69ea640 1 --2- 172.21.15.88:0/2178407834 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f47b807af30 0x7f47b807d3f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:17.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.746+0000 7f47d69ea640 1 --2- 172.21.15.88:0/2178407834 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47d0101a60 0x7f47d019c220 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:17.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.746+0000 7f47d69ea640 1 --2- 172.21.15.88:0/2178407834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47d0100860 0x7f47d006aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:17.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.746+0000 7f47d69ea640 1 -- 172.21.15.88:0/2178407834 >> 172.21.15.88:0/2178407834 conn(0x7f47d00fc010 msgr2=0x7f47d00fe230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:17.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.746+0000 7f47d69ea640 1 -- 172.21.15.88:0/2178407834 shutdown_connections 2024-09-17T04:24:17.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.746+0000 7f47d69ea640 1 -- 172.21.15.88:0/2178407834 wait complete. 2024-09-17T04:24:17.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.827+0000 7f3182988640 1 -- 172.21.15.88:0/4200353951 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f317c104d20 msgr2=0x7f317c107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:17.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.827+0000 7f3182988640 1 --2- 172.21.15.88:0/4200353951 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f317c104d20 0x7f317c107110 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f31700098b0 tx=0x7f317002a4d0 comp rx=0 tx=0).stop 2024-09-17T04:24:17.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.827+0000 7f3182988640 1 -- 172.21.15.88:0/4200353951 shutdown_connections 2024-09-17T04:24:17.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.827+0000 7f3182988640 1 --2- 172.21.15.88:0/4200353951 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f317c104d20 0x7f317c107110 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:17.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.827+0000 7f3182988640 1 --2- 172.21.15.88:0/4200353951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f317c1023f0 0x7f317c1047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:17.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.827+0000 7f3182988640 1 -- 172.21.15.88:0/4200353951 >> 172.21.15.88:0/4200353951 conn(0x7f317c0fc010 msgr2=0x7f317c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:17.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.827+0000 7f3182988640 1 -- 172.21.15.88:0/4200353951 shutdown_connections 2024-09-17T04:24:17.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.827+0000 7f3182988640 1 -- 172.21.15.88:0/4200353951 wait complete. 2024-09-17T04:24:17.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.828+0000 7f3182988640 1 Processor -- start 2024-09-17T04:24:17.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.828+0000 7f3182988640 1 -- start start 2024-09-17T04:24:17.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.828+0000 7f3182988640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f317c1023f0 0x7f317c101ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:17.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.828+0000 7f3182988640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f317c104d20 0x7f317c1003a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:17.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.828+0000 7f3182988640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f317c10a7b0 con 0x7f317c104d20 2024-09-17T04:24:17.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.828+0000 7f3182988640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f317c10a630 con 0x7f317c1023f0 2024-09-17T04:24:17.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.828+0000 7f317b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f317c104d20 0x7f317c1003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:17.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.828+0000 7f317b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f317c104d20 0x7f317c1003a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57658/0 (socket says 172.21.15.88:57658) 2024-09-17T04:24:17.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.828+0000 7f317b7fe640 1 -- 172.21.15.88:0/3126982130 learned_addr learned my addr 172.21.15.88:0/3126982130 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:24:17.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.829+0000 7f317bfff640 1 --2- 172.21.15.88:0/3126982130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f317c1023f0 0x7f317c101ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:17.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.829+0000 7f317b7fe640 1 -- 172.21.15.88:0/3126982130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f317c1023f0 msgr2=0x7f317c101ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:17.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.829+0000 7f317b7fe640 1 --2- 172.21.15.88:0/3126982130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f317c1023f0 0x7f317c101ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:17.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.829+0000 7f317b7fe640 1 -- 172.21.15.88:0/3126982130 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f317c1008e0 con 0x7f317c104d20 2024-09-17T04:24:17.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.829+0000 7f317b7fe640 1 --2- 172.21.15.88:0/3126982130 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f317c104d20 0x7f317c1003a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3170009230 tx=0x7f31700045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:17.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.829+0000 7f31797fa640 1 -- 172.21.15.88:0/3126982130 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f317003f070 con 0x7f317c104d20 2024-09-17T04:24:17.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.829+0000 7f31797fa640 1 -- 172.21.15.88:0/3126982130 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3170004a50 con 0x7f317c104d20 2024-09-17T04:24:17.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.829+0000 7f3182988640 1 -- 172.21.15.88:0/3126982130 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f317c100b70 con 0x7f317c104d20 2024-09-17T04:24:17.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.829+0000 7f31797fa640 1 -- 172.21.15.88:0/3126982130 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3170035030 con 0x7f317c104d20 2024-09-17T04:24:17.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.829+0000 7f3182988640 1 -- 172.21.15.88:0/3126982130 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f317c1010a0 con 0x7f317c104d20 2024-09-17T04:24:17.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.830+0000 7f3182988640 1 -- 172.21.15.88:0/3126982130 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f317c1027d0 con 0x7f317c104d20 2024-09-17T04:24:17.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.831+0000 7f31797fa640 1 -- 172.21.15.88:0/3126982130 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f3170042070 con 0x7f317c104d20 2024-09-17T04:24:17.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.831+0000 7f31797fa640 1 --2- 172.21.15.88:0/3126982130 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f316407af80 0x7f316407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:17.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.831+0000 7f31797fa640 1 -- 172.21.15.88:0/3126982130 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6070+0+0 (secure 0 0 0) 0x7f31700be9b0 con 0x7f317c104d20 2024-09-17T04:24:17.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.832+0000 7f317bfff640 1 --2- 172.21.15.88:0/3126982130 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f316407af80 0x7f316407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:17.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.832+0000 7f317bfff640 1 --2- 172.21.15.88:0/3126982130 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f316407af80 0x7f316407d440 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f316c005fd0 tx=0x7f316c00b390 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:17.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:17.836+0000 7f31797fa640 1 -- 172.21.15.88:0/3126982130 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f317008a080 con 0x7f317c104d20 2024-09-17T04:24:18.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.047+0000 7f3182988640 1 -- 172.21.15.88:0/3126982130 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f317c19f760 con 0x7f317c104d20 2024-09-17T04:24:18.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.048+0000 7f31797fa640 1 -- 172.21.15.88:0/3126982130 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) ==== 76+0+2045 (secure 0 0 0) 0x7f317008ef30 con 0x7f317c104d20 2024-09-17T04:24:18.048 INFO:teuthology.orchestra.run.smithi088.stdout:e15 2024-09-17T04:24:18.048 INFO:teuthology.orchestra.run.smithi088.stdout:btime 2024-09-17T04:18:27:750910+0000 2024-09-17T04:24:18.048 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T04:24:18.048 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:24:18.048 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2024-09-17T04:24:18.048 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:24:18.048 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2024-09-17T04:24:18.049 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2024-09-17T04:24:18.049 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 15 2024-09-17T04:24:18.049 INFO:teuthology.orchestra.run.smithi088.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T04:24:18.049 INFO:teuthology.orchestra.run.smithi088.stdout:created 2024-09-17T04:18:10.480573+0000 2024-09-17T04:24:18.049 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2024-09-17T04:18:27.750896+0000 2024-09-17T04:24:18.049 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2024-09-17T04:24:18.049 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2024-09-17T04:24:18.049 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2024-09-17T04:24:18.049 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2024-09-17T04:24:18.049 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2024-09-17T04:24:18.049 INFO:teuthology.orchestra.run.smithi088.stdout:max_xattr_size 65536 2024-09-17T04:24:18.049 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2024-09-17T04:24:18.049 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2024-09-17T04:24:18.049 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 45 2024-09-17T04:24:18.049 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:24:18.050 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 1 2024-09-17T04:24:18.050 INFO:teuthology.orchestra.run.smithi088.stdout:in 0 2024-09-17T04:24:18.050 INFO:teuthology.orchestra.run.smithi088.stdout:up {0=14590} 2024-09-17T04:24:18.050 INFO:teuthology.orchestra.run.smithi088.stdout:failed 2024-09-17T04:24:18.050 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2024-09-17T04:24:18.050 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2024-09-17T04:24:18.050 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2024-09-17T04:24:18.050 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2024-09-17T04:24:18.050 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data enabled 2024-09-17T04:24:18.050 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2024-09-17T04:24:18.050 INFO:teuthology.orchestra.run.smithi088.stdout:bal_rank_mask -1 2024-09-17T04:24:18.050 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 1 2024-09-17T04:24:18.050 INFO:teuthology.orchestra.run.smithi088.stdout:qdb_cluster leader: 14590 members: 14590 2024-09-17T04:24:18.050 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.giqrgt{0:14590} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.88:6828/1714846518,v1:172.21.15.88:6829/1714846518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:24:18.050 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi134.psnynp{0:24321} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.134:6826/2137586894,v1:172.21.15.134:6827/2137586894] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:24:18.050 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:24:18.051 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:24:18.051 INFO:teuthology.orchestra.run.smithi088.stdout:Standby daemons: 2024-09-17T04:24:18.051 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:24:18.051 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi134.ktuhce{-1:24325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/967997022,v1:172.21.15.134:6825/967997022] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:24:18.051 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.lgavsv{-1:24329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/1425146180,v1:172.21.15.88:6827/1425146180] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:24:18.052 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 15 2024-09-17T04:24:18.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.051+0000 7f3182988640 1 -- 172.21.15.88:0/3126982130 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f316407af80 msgr2=0x7f316407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:18.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.051+0000 7f3182988640 1 --2- 172.21.15.88:0/3126982130 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f316407af80 0x7f316407d440 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f316c005fd0 tx=0x7f316c00b390 comp rx=0 tx=0).stop 2024-09-17T04:24:18.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.051+0000 7f3182988640 1 -- 172.21.15.88:0/3126982130 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f317c104d20 msgr2=0x7f317c1003a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:18.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.051+0000 7f3182988640 1 --2- 172.21.15.88:0/3126982130 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f317c104d20 0x7f317c1003a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3170009230 tx=0x7f31700045e0 comp rx=0 tx=0).stop 2024-09-17T04:24:18.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.051+0000 7f3182988640 1 -- 172.21.15.88:0/3126982130 shutdown_connections 2024-09-17T04:24:18.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.051+0000 7f3182988640 1 --2- 172.21.15.88:0/3126982130 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f316407af80 0x7f316407d440 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:18.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.051+0000 7f3182988640 1 --2- 172.21.15.88:0/3126982130 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f317c104d20 0x7f317c1003a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:18.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.051+0000 7f3182988640 1 --2- 172.21.15.88:0/3126982130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f317c1023f0 0x7f317c101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:18.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.051+0000 7f3182988640 1 -- 172.21.15.88:0/3126982130 >> 172.21.15.88:0/3126982130 conn(0x7f317c0fc010 msgr2=0x7f317c0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:18.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.051+0000 7f3182988640 1 -- 172.21.15.88:0/3126982130 shutdown_connections 2024-09-17T04:24:18.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.051+0000 7f3182988640 1 -- 172.21.15.88:0/3126982130 wait complete. 2024-09-17T04:24:18.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.134+0000 7fc73056b640 1 -- 172.21.15.88:0/3674851434 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc728100ad0 msgr2=0x7fc728100f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:18.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.134+0000 7fc73056b640 1 --2- 172.21.15.88:0/3674851434 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc728100ad0 0x7fc728100f50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc718009880 tx=0x7fc71802a4a0 comp rx=0 tx=0).stop 2024-09-17T04:24:18.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.134+0000 7fc73056b640 1 -- 172.21.15.88:0/3674851434 shutdown_connections 2024-09-17T04:24:18.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.134+0000 7fc73056b640 1 --2- 172.21.15.88:0/3674851434 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc728100ad0 0x7fc728100f50 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:18.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.134+0000 7fc73056b640 1 --2- 172.21.15.88:0/3674851434 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc728101e70 0x7fc728102270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:18.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.134+0000 7fc73056b640 1 -- 172.21.15.88:0/3674851434 >> 172.21.15.88:0/3674851434 conn(0x7fc7280fb770 msgr2=0x7fc7280fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:18.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.134+0000 7fc73056b640 1 -- 172.21.15.88:0/3674851434 shutdown_connections 2024-09-17T04:24:18.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.134+0000 7fc73056b640 1 -- 172.21.15.88:0/3674851434 wait complete. 2024-09-17T04:24:18.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.135+0000 7fc73056b640 1 Processor -- start 2024-09-17T04:24:18.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.135+0000 7fc73056b640 1 -- start start 2024-09-17T04:24:18.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.135+0000 7fc73056b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc728100ad0 0x7fc728197570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:18.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.135+0000 7fc73056b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc728101e70 0x7fc728197ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:18.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.135+0000 7fc73056b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc7281096c0 con 0x7fc728100ad0 2024-09-17T04:24:18.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.135+0000 7fc73056b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc728109540 con 0x7fc728101e70 2024-09-17T04:24:18.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.135+0000 7fc72e307640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc728100ad0 0x7fc728197570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:18.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.135+0000 7fc72e307640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc728100ad0 0x7fc728197570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57670/0 (socket says 172.21.15.88:57670) 2024-09-17T04:24:18.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.135+0000 7fc72e307640 1 -- 172.21.15.88:0/2733355743 learned_addr learned my addr 172.21.15.88:0/2733355743 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:24:18.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.135+0000 7fc72db06640 1 --2- 172.21.15.88:0/2733355743 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc728101e70 0x7fc728197ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:18.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.135+0000 7fc72e307640 1 -- 172.21.15.88:0/2733355743 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc728101e70 msgr2=0x7fc728197ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:18.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.135+0000 7fc72e307640 1 --2- 172.21.15.88:0/2733355743 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc728101e70 0x7fc728197ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:18.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.135+0000 7fc72e307640 1 -- 172.21.15.88:0/2733355743 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc728198130 con 0x7fc728100ad0 2024-09-17T04:24:18.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.136+0000 7fc72e307640 1 --2- 172.21.15.88:0/2733355743 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc728100ad0 0x7fc728197570 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc72400d8d0 tx=0x7fc72400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:18.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.136+0000 7fc71f7fe640 1 -- 172.21.15.88:0/2733355743 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc724017070 con 0x7fc728100ad0 2024-09-17T04:24:18.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.136+0000 7fc71f7fe640 1 -- 172.21.15.88:0/2733355743 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc72400be10 con 0x7fc728100ad0 2024-09-17T04:24:18.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.136+0000 7fc73056b640 1 -- 172.21.15.88:0/2733355743 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc72819cb00 con 0x7fc728100ad0 2024-09-17T04:24:18.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.136+0000 7fc71f7fe640 1 -- 172.21.15.88:0/2733355743 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc72400f3c0 con 0x7fc728100ad0 2024-09-17T04:24:18.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.136+0000 7fc73056b640 1 -- 172.21.15.88:0/2733355743 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc72819d060 con 0x7fc728100ad0 2024-09-17T04:24:18.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.137+0000 7fc73056b640 1 -- 172.21.15.88:0/2733355743 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc728100f50 con 0x7fc728100ad0 2024-09-17T04:24:18.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.137+0000 7fc71f7fe640 1 -- 172.21.15.88:0/2733355743 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fc72401a070 con 0x7fc728100ad0 2024-09-17T04:24:18.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.138+0000 7fc71f7fe640 1 --2- 172.21.15.88:0/2733355743 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fc71407af80 0x7fc71407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:18.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.138+0000 7fc71f7fe640 1 -- 172.21.15.88:0/2733355743 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6070+0+0 (secure 0 0 0) 0x7fc72409da50 con 0x7fc728100ad0 2024-09-17T04:24:18.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.138+0000 7fc72db06640 1 --2- 172.21.15.88:0/2733355743 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fc71407af80 0x7fc71407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:18.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.138+0000 7fc72db06640 1 --2- 172.21.15.88:0/2733355743 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fc71407af80 0x7fc71407d440 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc718009230 tx=0x7fc7180058d0 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:18.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.142+0000 7fc71f7fe640 1 -- 172.21.15.88:0/2733355743 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fc724069120 con 0x7fc728100ad0 2024-09-17T04:24:18.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.333+0000 7fc73056b640 1 -- 172.21.15.88:0/2733355743 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc72802c640 con 0x7fc71407af80 2024-09-17T04:24:18.334 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:18 smithi088 ceph-mon[90867]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:24:18.334 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:18 smithi088 ceph-mon[90867]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:24:18.334 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:18 smithi088 ceph-mon[90867]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:24:18.334 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:18 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/2178407834' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:24:18.334 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:18 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/3126982130' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T04:24:18.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.335+0000 7fc71f7fe640 1 -- 172.21.15.88:0/2733355743 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7fc72802c640 con 0x7fc71407af80 2024-09-17T04:24:18.335 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-17T04:24:18.335 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f", 2024-09-17T04:24:18.335 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-09-17T04:24:18.335 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T04:24:18.335 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [ 2024-09-17T04:24:18.335 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr", 2024-09-17T04:24:18.335 INFO:teuthology.orchestra.run.smithi088.stdout: "mon", 2024-09-17T04:24:18.335 INFO:teuthology.orchestra.run.smithi088.stdout: "crash" 2024-09-17T04:24:18.335 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-17T04:24:18.335 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "7/23 daemons upgraded", 2024-09-17T04:24:18.336 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading osd daemons", 2024-09-17T04:24:18.336 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-09-17T04:24:18.336 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-17T04:24:18.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.337+0000 7fc73056b640 1 -- 172.21.15.88:0/2733355743 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fc71407af80 msgr2=0x7fc71407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:18.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.337+0000 7fc73056b640 1 --2- 172.21.15.88:0/2733355743 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fc71407af80 0x7fc71407d440 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc718009230 tx=0x7fc7180058d0 comp rx=0 tx=0).stop 2024-09-17T04:24:18.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.337+0000 7fc73056b640 1 -- 172.21.15.88:0/2733355743 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc728100ad0 msgr2=0x7fc728197570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:18.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.337+0000 7fc73056b640 1 --2- 172.21.15.88:0/2733355743 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc728100ad0 0x7fc728197570 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc72400d8d0 tx=0x7fc72400dd90 comp rx=0 tx=0).stop 2024-09-17T04:24:18.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.337+0000 7fc73056b640 1 -- 172.21.15.88:0/2733355743 shutdown_connections 2024-09-17T04:24:18.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.337+0000 7fc73056b640 1 --2- 172.21.15.88:0/2733355743 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fc71407af80 0x7fc71407d440 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:18.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.337+0000 7fc73056b640 1 --2- 172.21.15.88:0/2733355743 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc728101e70 0x7fc728197ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:18.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.337+0000 7fc73056b640 1 --2- 172.21.15.88:0/2733355743 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc728100ad0 0x7fc728197570 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:18.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.337+0000 7fc73056b640 1 -- 172.21.15.88:0/2733355743 >> 172.21.15.88:0/2733355743 conn(0x7fc7280fb770 msgr2=0x7fc7280fd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:18.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.337+0000 7fc73056b640 1 -- 172.21.15.88:0/2733355743 shutdown_connections 2024-09-17T04:24:18.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.337+0000 7fc73056b640 1 -- 172.21.15.88:0/2733355743 wait complete. 2024-09-17T04:24:18.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:18 smithi134 ceph-mon[76677]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:24:18.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:18 smithi134 ceph-mon[76677]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:24:18.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:18 smithi134 ceph-mon[76677]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:24:18.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:18 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/2178407834' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:24:18.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:18 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/3126982130' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T04:24:18.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.418+0000 7fc877e3a640 1 -- 172.21.15.88:0/4036105541 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc870102b60 msgr2=0x7fc870102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:18.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.418+0000 7fc877e3a640 1 --2- 172.21.15.88:0/4036105541 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc870102b60 0x7fc870102fe0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc860009880 tx=0x7fc86002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:24:18.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.418+0000 7fc877e3a640 1 -- 172.21.15.88:0/4036105541 shutdown_connections 2024-09-17T04:24:18.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.418+0000 7fc877e3a640 1 --2- 172.21.15.88:0/4036105541 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc870102b60 0x7fc870102fe0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:18.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.418+0000 7fc877e3a640 1 --2- 172.21.15.88:0/4036105541 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc870101960 0x7fc870101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:18.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.418+0000 7fc877e3a640 1 -- 172.21.15.88:0/4036105541 >> 172.21.15.88:0/4036105541 conn(0x7fc8700fd0f0 msgr2=0x7fc8700ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:18.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.418+0000 7fc877e3a640 1 -- 172.21.15.88:0/4036105541 shutdown_connections 2024-09-17T04:24:18.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.418+0000 7fc877e3a640 1 -- 172.21.15.88:0/4036105541 wait complete. 2024-09-17T04:24:18.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.419+0000 7fc877e3a640 1 Processor -- start 2024-09-17T04:24:18.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.419+0000 7fc877e3a640 1 -- start start 2024-09-17T04:24:18.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.419+0000 7fc877e3a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc870101960 0x7fc8701974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:18.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.419+0000 7fc877e3a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc870102b60 0x7fc8701979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:18.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.419+0000 7fc877e3a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc87010a7a0 con 0x7fc870101960 2024-09-17T04:24:18.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.419+0000 7fc877e3a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc87010a620 con 0x7fc870102b60 2024-09-17T04:24:18.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.419+0000 7fc875bd6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc870101960 0x7fc8701974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:18.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.419+0000 7fc875bd6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc870101960 0x7fc8701974a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57694/0 (socket says 172.21.15.88:57694) 2024-09-17T04:24:18.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.419+0000 7fc875bd6640 1 -- 172.21.15.88:0/829753459 learned_addr learned my addr 172.21.15.88:0/829753459 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:24:18.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.419+0000 7fc8753d5640 1 --2- 172.21.15.88:0/829753459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc870102b60 0x7fc8701979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:18.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.419+0000 7fc875bd6640 1 -- 172.21.15.88:0/829753459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc870102b60 msgr2=0x7fc8701979e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:18.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.419+0000 7fc875bd6640 1 --2- 172.21.15.88:0/829753459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc870102b60 0x7fc8701979e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:18.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.419+0000 7fc875bd6640 1 -- 172.21.15.88:0/829753459 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc870198060 con 0x7fc870101960 2024-09-17T04:24:18.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.419+0000 7fc8753d5640 1 --2- 172.21.15.88:0/829753459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc870102b60 0x7fc8701979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:24:18.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.420+0000 7fc875bd6640 1 --2- 172.21.15.88:0/829753459 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc870101960 0x7fc8701974a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc86c00d8d0 tx=0x7fc86c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:18.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.420+0000 7fc866ffd640 1 -- 172.21.15.88:0/829753459 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc86c017070 con 0x7fc870101960 2024-09-17T04:24:18.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.420+0000 7fc866ffd640 1 -- 172.21.15.88:0/829753459 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc86c00be10 con 0x7fc870101960 2024-09-17T04:24:18.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.420+0000 7fc877e3a640 1 -- 172.21.15.88:0/829753459 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc87019caa0 con 0x7fc870101960 2024-09-17T04:24:18.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.420+0000 7fc866ffd640 1 -- 172.21.15.88:0/829753459 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc86c00f3c0 con 0x7fc870101960 2024-09-17T04:24:18.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.420+0000 7fc877e3a640 1 -- 172.21.15.88:0/829753459 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc87019d030 con 0x7fc870101960 2024-09-17T04:24:18.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.421+0000 7fc877e3a640 1 -- 172.21.15.88:0/829753459 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc870101d60 con 0x7fc870101960 2024-09-17T04:24:18.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.421+0000 7fc866ffd640 1 -- 172.21.15.88:0/829753459 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fc86c01a070 con 0x7fc870101960 2024-09-17T04:24:18.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.422+0000 7fc866ffd640 1 --2- 172.21.15.88:0/829753459 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fc85c07af30 0x7fc85c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:18.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.422+0000 7fc866ffd640 1 -- 172.21.15.88:0/829753459 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6070+0+0 (secure 0 0 0) 0x7fc86c09dcb0 con 0x7fc870101960 2024-09-17T04:24:18.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.422+0000 7fc8753d5640 1 --2- 172.21.15.88:0/829753459 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fc85c07af30 0x7fc85c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:18.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.422+0000 7fc8753d5640 1 --2- 172.21.15.88:0/829753459 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fc85c07af30 0x7fc85c07d3f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc870198950 tx=0x7fc860005a20 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:18.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.426+0000 7fc866ffd640 1 -- 172.21.15.88:0/829753459 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fc86c069260 con 0x7fc870101960 2024-09-17T04:24:18.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.675+0000 7fc877e3a640 1 -- 172.21.15.88:0/829753459 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fc870062df0 con 0x7fc870101960 2024-09-17T04:24:18.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.675+0000 7fc866ffd640 1 -- 172.21.15.88:0/829753459 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7fc86c06e110 con 0x7fc870101960 2024-09-17T04:24:18.675 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T04:24:18.676 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T04:24:18.676 INFO:teuthology.orchestra.run.smithi088.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T04:24:18.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.677+0000 7fc877e3a640 1 -- 172.21.15.88:0/829753459 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fc85c07af30 msgr2=0x7fc85c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:18.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.677+0000 7fc877e3a640 1 --2- 172.21.15.88:0/829753459 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fc85c07af30 0x7fc85c07d3f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc870198950 tx=0x7fc860005a20 comp rx=0 tx=0).stop 2024-09-17T04:24:18.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.677+0000 7fc877e3a640 1 -- 172.21.15.88:0/829753459 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc870101960 msgr2=0x7fc8701974a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:18.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.677+0000 7fc877e3a640 1 --2- 172.21.15.88:0/829753459 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc870101960 0x7fc8701974a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc86c00d8d0 tx=0x7fc86c00dd90 comp rx=0 tx=0).stop 2024-09-17T04:24:18.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.677+0000 7fc877e3a640 1 -- 172.21.15.88:0/829753459 shutdown_connections 2024-09-17T04:24:18.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.677+0000 7fc877e3a640 1 --2- 172.21.15.88:0/829753459 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fc85c07af30 0x7fc85c07d3f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:18.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.677+0000 7fc877e3a640 1 --2- 172.21.15.88:0/829753459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc870102b60 0x7fc8701979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:18.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.677+0000 7fc877e3a640 1 --2- 172.21.15.88:0/829753459 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc870101960 0x7fc8701974a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:18.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.677+0000 7fc877e3a640 1 -- 172.21.15.88:0/829753459 >> 172.21.15.88:0/829753459 conn(0x7fc8700fd0f0 msgr2=0x7fc870106070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:18.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.678+0000 7fc877e3a640 1 -- 172.21.15.88:0/829753459 shutdown_connections 2024-09-17T04:24:18.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:18.678+0000 7fc877e3a640 1 -- 172.21.15.88:0/829753459 wait complete. 2024-09-17T04:24:19.344 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:19 smithi088 ceph-mon[90867]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:24:19.344 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:19 smithi088 ceph-mon[90867]: pgmap v72: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:24:19.344 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:19 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/829753459' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T04:24:19.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:19 smithi134 ceph-mon[76677]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:24:19.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:19 smithi134 ceph-mon[76677]: pgmap v72: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:24:19.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:19 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/829753459' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T04:24:20.229 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:20 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-17T04:24:20.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:20 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-17T04:24:21.213 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:21 smithi088 ceph-mon[90867]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-17T04:24:21.213 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:21 smithi088 ceph-mon[90867]: Upgrade: osd.1 is safe to restart 2024-09-17T04:24:21.213 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:21 smithi088 ceph-mon[90867]: pgmap v73: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:24:21.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:21 smithi134 ceph-mon[76677]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-17T04:24:21.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:21 smithi134 ceph-mon[76677]: Upgrade: osd.1 is safe to restart 2024-09-17T04:24:21.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:21 smithi134 ceph-mon[76677]: pgmap v73: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:24:22.578 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:22 smithi088 ceph-mon[90867]: Upgrade: Updating osd.1 2024-09-17T04:24:22.579 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:22 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:24:22.579 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:22 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-17T04:24:22.579 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:22 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:24:22.579 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:22 smithi088 ceph-mon[90867]: Deploying daemon osd.1 on smithi088 2024-09-17T04:24:22.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:22 smithi134 ceph-mon[76677]: Upgrade: Updating osd.1 2024-09-17T04:24:22.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:22 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:24:22.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:22 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-17T04:24:22.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:22 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:24:22.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:22 smithi134 ceph-mon[76677]: Deploying daemon osd.1 on smithi088 2024-09-17T04:24:23.569 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:23 smithi088 ceph-mon[90867]: pgmap v74: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:24:23.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:23 smithi134 ceph-mon[76677]: pgmap v74: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:24:24.515 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:24 smithi088 ceph-mon[90867]: pgmap v75: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:24:24.515 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:24 smithi088 systemd[1]: Stopping Ceph osd.1 for bf2b79a4-74aa-11ef-bceb-c7b262605968... 2024-09-17T04:24:24.888 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:24 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-1[57630]: 2024-09-17T04:24:24.515+0000 7f6cf44a3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T04:24:24.888 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:24 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-1[57630]: 2024-09-17T04:24:24.515+0000 7f6cf44a3640 -1 osd.1 52 *** Got signal Terminated *** 2024-09-17T04:24:24.888 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:24 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-1[57630]: 2024-09-17T04:24:24.515+0000 7f6cf44a3640 -1 osd.1 52 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T04:24:24.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:24 smithi134 ceph-mon[76677]: pgmap v75: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:24:25.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:25 smithi088 ceph-mon[90867]: osd.1 marked itself down and dead 2024-09-17T04:24:25.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:25 smithi134 ceph-mon[76677]: osd.1 marked itself down and dead 2024-09-17T04:24:26.387 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:26 smithi088 podman[104736]: 2024-09-17 04:24:26.007111648 +0000 UTC m=+1.598470628 container died cc68d92b33336f29529fb7b246376effc1191993eb9d94c8e786ea7253809e3c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-1, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-17T04:24:26.733 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:26 smithi088 podman[104736]: 2024-09-17 04:24:26.565668531 +0000 UTC m=+2.157027510 container cleanup cc68d92b33336f29529fb7b246376effc1191993eb9d94c8e786ea7253809e3c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, ceph=True, org.label-schema.build-date=20240731) 2024-09-17T04:24:26.733 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:26 smithi088 bash[104736]: ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-1 2024-09-17T04:24:26.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:26 smithi088 ceph-mon[90867]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T04:24:26.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:26 smithi088 ceph-mon[90867]: osdmap e53: 6 total, 5 up, 6 in 2024-09-17T04:24:26.734 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:26 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:24:26.734 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:26 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:24:26.734 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:26 smithi088 ceph-mon[90867]: pgmap v77: 65 pgs: 29 peering, 3 stale+active+clean, 33 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s 2024-09-17T04:24:26.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:26 smithi134 ceph-mon[76677]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T04:24:26.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:26 smithi134 ceph-mon[76677]: osdmap e53: 6 total, 5 up, 6 in 2024-09-17T04:24:26.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:26 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:24:26.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:26 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:24:26.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:26 smithi134 ceph-mon[76677]: pgmap v77: 65 pgs: 29 peering, 3 stale+active+clean, 33 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s 2024-09-17T04:24:27.137 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:26 smithi088 podman[104751]: 2024-09-17 04:24:26.733542933 +0000 UTC m=+0.728669678 container remove cc68d92b33336f29529fb7b246376effc1191993eb9d94c8e786ea7253809e3c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True) 2024-09-17T04:24:27.419 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:27 smithi088 podman[104838]: 2024-09-17 04:24:27.052524911 +0000 UTC m=+0.015619486 image pull 8e039cb7fe1eece5854872e8884a61a26632c7691b2c85cbac9078a9c5c62fae quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f 2024-09-17T04:24:27.420 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:27 smithi088 podman[104838]: 2024-09-17 04:24:27.188791082 +0000 UTC m=+0.151885641 container create 0f66e4cb3db5c7f1e5c72ab27cf4716b728ce52ff272ac83697c7777e4bf21b4 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_CLEAN=True) 2024-09-17T04:24:27.420 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:27 smithi088 podman[104838]: 2024-09-17 04:24:27.420561512 +0000 UTC m=+0.383656083 container init 0f66e4cb3db5c7f1e5c72ab27cf4716b728ce52ff272ac83697c7777e4bf21b4 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS) 2024-09-17T04:24:27.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:27 smithi088 ceph-mon[90867]: osdmap e54: 6 total, 5 up, 6 in 2024-09-17T04:24:27.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:27 smithi088 ceph-mon[90867]: Health check failed: Reduced data availability: 9 pgs peering (PG_AVAILABILITY) 2024-09-17T04:24:27.888 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:27 smithi088 podman[104838]: 2024-09-17 04:24:27.424016875 +0000 UTC m=+0.387111437 container start 0f66e4cb3db5c7f1e5c72ab27cf4716b728ce52ff272ac83697c7777e4bf21b4 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-17T04:24:27.888 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:27 smithi088 podman[104838]: 2024-09-17 04:24:27.512114157 +0000 UTC m=+0.475208727 container attach 0f66e4cb3db5c7f1e5c72ab27cf4716b728ce52ff272ac83697c7777e4bf21b4 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-17T04:24:27.888 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:27 smithi088 podman[104838]: 2024-09-17 04:24:27.620696305 +0000 UTC m=+0.583790898 container died 0f66e4cb3db5c7f1e5c72ab27cf4716b728ce52ff272ac83697c7777e4bf21b4 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T04:24:27.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:27 smithi134 ceph-mon[76677]: osdmap e54: 6 total, 5 up, 6 in 2024-09-17T04:24:27.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:27 smithi134 ceph-mon[76677]: Health check failed: Reduced data availability: 9 pgs peering (PG_AVAILABILITY) 2024-09-17T04:24:28.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:28 smithi088 ceph-mon[90867]: pgmap v79: 65 pgs: 3 active+undersized, 29 peering, 2 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 2/276 objects degraded (0.725%) 2024-09-17T04:24:28.638 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:28 smithi088 podman[104860]: 2024-09-17 04:24:28.302335616 +0000 UTC m=+0.675451355 container remove 0f66e4cb3db5c7f1e5c72ab27cf4716b728ce52ff272ac83697c7777e4bf21b4 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-17T04:24:28.638 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:28 smithi088 systemd[1]: ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968@osd.1.service: Deactivated successfully. 2024-09-17T04:24:28.638 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:28 smithi088 systemd[1]: Stopped Ceph osd.1 for bf2b79a4-74aa-11ef-bceb-c7b262605968. 2024-09-17T04:24:28.638 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:28 smithi088 systemd[1]: ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968@osd.1.service: Consumed 54.233s CPU time. 2024-09-17T04:24:28.638 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:28 smithi088 systemd[1]: Starting Ceph osd.1 for bf2b79a4-74aa-11ef-bceb-c7b262605968... 2024-09-17T04:24:28.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:28 smithi134 ceph-mon[76677]: pgmap v79: 65 pgs: 3 active+undersized, 29 peering, 2 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 2/276 objects degraded (0.725%) 2024-09-17T04:24:29.069 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:28 smithi088 podman[104960]: 2024-09-17 04:24:28.653491827 +0000 UTC m=+0.015871583 image pull 8e039cb7fe1eece5854872e8884a61a26632c7691b2c85cbac9078a9c5c62fae quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f 2024-09-17T04:24:29.069 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:28 smithi088 podman[104960]: 2024-09-17 04:24:28.75082128 +0000 UTC m=+0.113201036 container create 22aa24310732016acb2437f93f7d80cb8e60ffae7ad6105bc001f173ca2f26ef (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True) 2024-09-17T04:24:29.069 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:28 smithi088 podman[104960]: 2024-09-17 04:24:28.986707436 +0000 UTC m=+0.349087197 container init 22aa24310732016acb2437f93f7d80cb8e60ffae7ad6105bc001f173ca2f26ef (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-1-activate, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-17T04:24:29.069 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:28 smithi088 podman[104960]: 2024-09-17 04:24:28.990143259 +0000 UTC m=+0.352523024 container start 22aa24310732016acb2437f93f7d80cb8e60ffae7ad6105bc001f173ca2f26ef (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-1-activate, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-17T04:24:29.069 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:29 smithi088 podman[104960]: 2024-09-17 04:24:29.069866402 +0000 UTC m=+0.432246192 container attach 22aa24310732016acb2437f93f7d80cb8e60ffae7ad6105bc001f173ca2f26ef (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-1-activate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342) 2024-09-17T04:24:29.387 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:29 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-1-activate[104975]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T04:24:29.387 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:29 smithi088 bash[104960]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T04:24:29.388 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:29 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-1-activate[104975]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T04:24:29.388 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:29 smithi088 bash[104960]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T04:24:29.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:29 smithi088 ceph-mon[90867]: Health check failed: Degraded data redundancy: 2/276 objects degraded (0.725%), 2 pgs degraded (PG_DEGRADED) 2024-09-17T04:24:29.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:29 smithi134 ceph-mon[76677]: Health check failed: Degraded data redundancy: 2/276 objects degraded (0.725%), 2 pgs degraded (PG_DEGRADED) 2024-09-17T04:24:30.254 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:29 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-1-activate[104975]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T04:24:30.254 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:29 smithi088 bash[104960]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T04:24:30.255 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:29 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-1-activate[104975]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-17T04:24:30.255 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:29 smithi088 bash[104960]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-17T04:24:30.519 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:30 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-1-activate[104975]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-17T04:24:30.519 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:30 smithi088 bash[104960]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-17T04:24:30.519 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:30 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-1-activate[104975]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-17T04:24:30.519 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:30 smithi088 bash[104960]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-17T04:24:30.519 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:30 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-1-activate[104975]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-17T04:24:30.519 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:30 smithi088 bash[104960]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-17T04:24:30.519 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:30 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-1-activate[104975]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T04:24:30.519 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:30 smithi088 bash[104960]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T04:24:30.519 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:30 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-1-activate[104975]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-17T04:24:30.519 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:30 smithi088 bash[104960]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-17T04:24:30.520 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:30 smithi088 podman[104960]: 2024-09-17 04:24:30.284732784 +0000 UTC m=+1.647112546 container died 22aa24310732016acb2437f93f7d80cb8e60ffae7ad6105bc001f173ca2f26ef (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-17T04:24:30.839 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:30 smithi088 ceph-mon[90867]: pgmap v80: 65 pgs: 3 active+undersized, 29 peering, 2 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2/276 objects degraded (0.725%) 2024-09-17T04:24:30.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:30 smithi134 ceph-mon[76677]: pgmap v80: 65 pgs: 3 active+undersized, 29 peering, 2 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2/276 objects degraded (0.725%) 2024-09-17T04:24:31.137 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:30 smithi088 podman[105125]: 2024-09-17 04:24:30.840215604 +0000 UTC m=+0.549329055 container remove 22aa24310732016acb2437f93f7d80cb8e60ffae7ad6105bc001f173ca2f26ef (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-17T04:24:31.138 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:31 smithi088 podman[105184]: 2024-09-17 04:24:30.947841815 +0000 UTC m=+0.016059729 image pull 8e039cb7fe1eece5854872e8884a61a26632c7691b2c85cbac9078a9c5c62fae quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f 2024-09-17T04:24:31.138 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:31 smithi088 podman[105184]: 2024-09-17 04:24:31.066244012 +0000 UTC m=+0.134461917 container create 17b67c13c7aa47289943a6671163c76b5ec9c4f12ece62c6ef4161d4811c5178 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-1, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS) 2024-09-17T04:24:31.637 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:31 smithi088 podman[105184]: 2024-09-17 04:24:31.32724286 +0000 UTC m=+0.395460768 container init 17b67c13c7aa47289943a6671163c76b5ec9c4f12ece62c6ef4161d4811c5178 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-1, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T04:24:31.638 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:31 smithi088 podman[105184]: 2024-09-17 04:24:31.330548694 +0000 UTC m=+0.398766608 container start 17b67c13c7aa47289943a6671163c76b5ec9c4f12ece62c6ef4161d4811c5178 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-1, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T04:24:31.638 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:31 smithi088 ceph-osd[105203]: -- 172.21.15.88:0/968387557 <== mon.0 v2:172.21.15.88:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f5a9c341e0 con 0x55f5a8ebcd00 2024-09-17T04:24:31.638 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:31 smithi088 bash[105184]: 17b67c13c7aa47289943a6671163c76b5ec9c4f12ece62c6ef4161d4811c5178 2024-09-17T04:24:31.638 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:31 smithi088 systemd[1]: Started Ceph osd.1 for bf2b79a4-74aa-11ef-bceb-c7b262605968. 2024-09-17T04:24:32.855 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:32 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-1[105199]: 2024-09-17T04:24:32.712+0000 7fb84ca93640 -1 Falling back to public interface 2024-09-17T04:24:32.855 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:32 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:24:32.855 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:32 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:24:32.855 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:32 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:24:32.855 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:32 smithi088 ceph-mon[90867]: pgmap v81: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 37/276 objects degraded (13.406%) 2024-09-17T04:24:32.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:32 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:24:32.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:32 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:24:32.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:32 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:24:32.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:32 smithi134 ceph-mon[76677]: pgmap v81: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 37/276 objects degraded (13.406%) 2024-09-17T04:24:33.519 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:33 smithi088 ceph-mon[90867]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 9 pgs peering) 2024-09-17T04:24:33.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:33 smithi134 ceph-mon[76677]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 9 pgs peering) 2024-09-17T04:24:34.839 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:34 smithi134 ceph-mon[76677]: pgmap v82: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 37/276 objects degraded (13.406%) 2024-09-17T04:24:34.884 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:34 smithi088 ceph-mon[90867]: pgmap v82: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 37/276 objects degraded (13.406%) 2024-09-17T04:24:37.635 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:37 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:24:37.635 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:37 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:24:37.635 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:37 smithi088 ceph-mon[90867]: pgmap v83: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 37/276 objects degraded (13.406%) 2024-09-17T04:24:37.635 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:37 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:24:37.635 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:37 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:24:37.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:37 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:24:37.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:37 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:24:37.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:37 smithi134 ceph-mon[76677]: pgmap v83: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 37/276 objects degraded (13.406%) 2024-09-17T04:24:37.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:37 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:24:37.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:37 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:24:38.548 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:38 smithi088 ceph-mon[90867]: Health check update: Degraded data redundancy: 37/276 objects degraded (13.406%), 13 pgs degraded (PG_DEGRADED) 2024-09-17T04:24:38.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:38 smithi134 ceph-mon[76677]: Health check update: Degraded data redundancy: 37/276 objects degraded (13.406%), 13 pgs degraded (PG_DEGRADED) 2024-09-17T04:24:39.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:39 smithi088 ceph-mon[90867]: pgmap v84: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 37/276 objects degraded (13.406%) 2024-09-17T04:24:39.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:39 smithi134 ceph-mon[76677]: pgmap v84: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 37/276 objects degraded (13.406%) 2024-09-17T04:24:40.004 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:39 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-1[105199]: 2024-09-17T04:24:39.691+0000 7fb84ca93640 -1 osd.1 52 log_to_monitors true 2024-09-17T04:24:40.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:40 smithi088 ceph-mon[90867]: from='osd.1 [v2:172.21.15.88:6810/61135060,v1:172.21.15.88:6811/61135060]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-17T04:24:40.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:40 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:24:40.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:40 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:24:40.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:40 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:24:40.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:40 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:24:40.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:40 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:24:40.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:40 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:24:40.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:40 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:24:40.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:40 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:24:40.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:40 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:24:40.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:40 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-17T04:24:40.639 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:24:40 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-1[105199]: 2024-09-17T04:24:40.349+0000 7fb84080b640 -1 osd.1 52 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T04:24:40.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:40 smithi134 ceph-mon[76677]: from='osd.1 [v2:172.21.15.88:6810/61135060,v1:172.21.15.88:6811/61135060]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-17T04:24:40.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:40 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:24:40.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:40 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:24:40.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:40 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:24:40.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:40 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:24:40.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:40 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:24:40.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:40 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:24:40.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:40 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:24:40.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:40 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:24:40.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:40 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:24:40.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:40 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-17T04:24:41.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:41 smithi088 ceph-mon[90867]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-17T04:24:41.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:41 smithi088 ceph-mon[90867]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-17T04:24:41.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:41 smithi088 ceph-mon[90867]: from='osd.1 [v2:172.21.15.88:6810/61135060,v1:172.21.15.88:6811/61135060]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-17T04:24:41.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:41 smithi088 ceph-mon[90867]: osdmap e55: 6 total, 5 up, 6 in 2024-09-17T04:24:41.639 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:41 smithi088 ceph-mon[90867]: from='osd.1 [v2:172.21.15.88:6810/61135060,v1:172.21.15.88:6811/61135060]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi088", "root=default"]} : dispatch 2024-09-17T04:24:41.639 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:41 smithi088 ceph-mon[90867]: pgmap v86: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 921 B/s rd, 1 op/s; 37/276 objects degraded (13.406%) 2024-09-17T04:24:41.639 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:41 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:24:41.639 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:41 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:24:41.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:41 smithi134 ceph-mon[76677]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-17T04:24:41.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:41 smithi134 ceph-mon[76677]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-17T04:24:41.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:41 smithi134 ceph-mon[76677]: from='osd.1 [v2:172.21.15.88:6810/61135060,v1:172.21.15.88:6811/61135060]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-17T04:24:41.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:41 smithi134 ceph-mon[76677]: osdmap e55: 6 total, 5 up, 6 in 2024-09-17T04:24:41.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:41 smithi134 ceph-mon[76677]: from='osd.1 [v2:172.21.15.88:6810/61135060,v1:172.21.15.88:6811/61135060]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi088", "root=default"]} : dispatch 2024-09-17T04:24:41.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:41 smithi134 ceph-mon[76677]: pgmap v86: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 921 B/s rd, 1 op/s; 37/276 objects degraded (13.406%) 2024-09-17T04:24:41.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:41 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:24:41.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:41 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:24:42.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:42 smithi088 ceph-mon[90867]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T04:24:42.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:42 smithi088 ceph-mon[90867]: osd.1 [v2:172.21.15.88:6810/61135060,v1:172.21.15.88:6811/61135060] boot 2024-09-17T04:24:42.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:42 smithi088 ceph-mon[90867]: osdmap e56: 6 total, 6 up, 6 in 2024-09-17T04:24:42.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:42 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-17T04:24:42.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:42 smithi088 ceph-mon[90867]: osdmap e57: 6 total, 6 up, 6 in 2024-09-17T04:24:42.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:42 smithi134 ceph-mon[76677]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T04:24:42.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:42 smithi134 ceph-mon[76677]: osd.1 [v2:172.21.15.88:6810/61135060,v1:172.21.15.88:6811/61135060] boot 2024-09-17T04:24:42.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:42 smithi134 ceph-mon[76677]: osdmap e56: 6 total, 6 up, 6 in 2024-09-17T04:24:42.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:42 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-17T04:24:42.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:42 smithi134 ceph-mon[76677]: osdmap e57: 6 total, 6 up, 6 in 2024-09-17T04:24:43.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:43 smithi088 ceph-mon[90867]: pgmap v89: 65 pgs: 20 peering, 7 active+undersized, 7 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 18/276 objects degraded (6.522%) 2024-09-17T04:24:43.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:43 smithi134 ceph-mon[76677]: pgmap v89: 65 pgs: 20 peering, 7 active+undersized, 7 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 18/276 objects degraded (6.522%) 2024-09-17T04:24:44.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:44 smithi088 ceph-mon[90867]: Health check update: Degraded data redundancy: 18/276 objects degraded (6.522%), 7 pgs degraded (PG_DEGRADED) 2024-09-17T04:24:44.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:44 smithi134 ceph-mon[76677]: Health check update: Degraded data redundancy: 18/276 objects degraded (6.522%), 7 pgs degraded (PG_DEGRADED) 2024-09-17T04:24:45.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:45 smithi088 ceph-mon[90867]: pgmap v90: 65 pgs: 20 peering, 5 active+undersized, 7 active+undersized+degraded, 33 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 18/276 objects degraded (6.522%) 2024-09-17T04:24:45.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:45 smithi134 ceph-mon[76677]: pgmap v90: 65 pgs: 20 peering, 5 active+undersized, 7 active+undersized+degraded, 33 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 18/276 objects degraded (6.522%) 2024-09-17T04:24:46.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:46 smithi088 ceph-mon[90867]: pgmap v91: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-17T04:24:46.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:46 smithi088 ceph-mon[90867]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 18/276 objects degraded (6.522%), 7 pgs degraded) 2024-09-17T04:24:46.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:46 smithi134 ceph-mon[76677]: pgmap v91: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-17T04:24:46.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:46 smithi134 ceph-mon[76677]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 18/276 objects degraded (6.522%), 7 pgs degraded) 2024-09-17T04:24:48.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:48 smithi134 ceph-mon[76677]: pgmap v92: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:24:48.772 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:48 smithi088 ceph-mon[90867]: pgmap v92: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:24:48.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:48.772+0000 7fd36bfc7640 1 -- 172.21.15.88:0/2015215437 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3641023f0 msgr2=0x7fd3641047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:48.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:48.772+0000 7fd36bfc7640 1 --2- 172.21.15.88:0/2015215437 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3641023f0 0x7fd3641047e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd3600098b0 tx=0x7fd36002a4d0 comp rx=0 tx=0).stop 2024-09-17T04:24:48.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:48.772+0000 7fd36bfc7640 1 -- 172.21.15.88:0/2015215437 shutdown_connections 2024-09-17T04:24:48.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:48.772+0000 7fd36bfc7640 1 --2- 172.21.15.88:0/2015215437 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd364104d20 0x7fd364107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:48.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:48.772+0000 7fd36bfc7640 1 --2- 172.21.15.88:0/2015215437 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3641023f0 0x7fd3641047e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:48.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:48.772+0000 7fd36bfc7640 1 -- 172.21.15.88:0/2015215437 >> 172.21.15.88:0/2015215437 conn(0x7fd3640fc010 msgr2=0x7fd3640fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:48.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:48.772+0000 7fd36bfc7640 1 -- 172.21.15.88:0/2015215437 shutdown_connections 2024-09-17T04:24:48.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:48.772+0000 7fd36bfc7640 1 -- 172.21.15.88:0/2015215437 wait complete. 2024-09-17T04:24:48.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:48.773+0000 7fd36bfc7640 1 Processor -- start 2024-09-17T04:24:48.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:48.773+0000 7fd36bfc7640 1 -- start start 2024-09-17T04:24:48.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:48.773+0000 7fd36bfc7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3641023f0 0x7fd364199710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:48.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:48.773+0000 7fd36bfc7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd364104d20 0x7fd364199c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:48.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:48.773+0000 7fd36bfc7640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fd36410a7c0 con 0x7fd3641023f0 2024-09-17T04:24:48.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:48.773+0000 7fd36bfc7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd36410a640 con 0x7fd364104d20 2024-09-17T04:24:48.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:48.773+0000 7fd369d63640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3641023f0 0x7fd364199710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:48.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:48.773+0000 7fd369d63640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3641023f0 0x7fd364199710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35208/0 (socket says 172.21.15.88:35208) 2024-09-17T04:24:48.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:48.773+0000 7fd369d63640 1 -- 172.21.15.88:0/4269874328 learned_addr learned my addr 172.21.15.88:0/4269874328 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:24:48.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:48.774+0000 7fd369d63640 1 -- 172.21.15.88:0/4269874328 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd364104d20 msgr2=0x7fd364199c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:48.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:48.774+0000 7fd369562640 1 --2- 172.21.15.88:0/4269874328 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd364104d20 0x7fd364199c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:48.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:48.774+0000 7fd369d63640 1 --2- 172.21.15.88:0/4269874328 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd364104d20 0x7fd364199c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:48.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:48.774+0000 7fd369d63640 1 -- 172.21.15.88:0/4269874328 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd36419a2d0 con 0x7fd3641023f0 2024-09-17T04:24:48.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:48.774+0000 7fd369562640 1 --2- 172.21.15.88:0/4269874328 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd364104d20 0x7fd364199c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:24:48.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:48.774+0000 7fd369d63640 1 --2- 172.21.15.88:0/4269874328 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3641023f0 0x7fd364199710 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd3600099d0 tx=0x7fd3600048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:48.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:48.774+0000 7fd35affd640 1 -- 172.21.15.88:0/4269874328 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd36003f070 con 0x7fd3641023f0 2024-09-17T04:24:48.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:48.774+0000 7fd35affd640 1 -- 172.21.15.88:0/4269874328 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd360004c70 con 0x7fd3641023f0 2024-09-17T04:24:48.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:48.774+0000 7fd36bfc7640 1 -- 172.21.15.88:0/4269874328 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd36419ecb0 con 0x7fd3641023f0 2024-09-17T04:24:48.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:48.774+0000 7fd35affd640 1 -- 172.21.15.88:0/4269874328 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd360035030 con 0x7fd3641023f0 2024-09-17T04:24:48.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:48.774+0000 7fd36bfc7640 1 -- 172.21.15.88:0/4269874328 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd36419f190 con 0x7fd3641023f0 2024-09-17T04:24:48.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:48.775+0000 7fd36bfc7640 1 -- 172.21.15.88:0/4269874328 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3641027d0 con 0x7fd3641023f0 2024-09-17T04:24:48.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:48.776+0000 7fd35affd640 1 -- 172.21.15.88:0/4269874328 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fd360042070 con 0x7fd3641023f0 2024-09-17T04:24:48.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:48.776+0000 7fd35affd640 1 --2- 172.21.15.88:0/4269874328 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fd35007af30 0x7fd35007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:48.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:48.777+0000 7fd35affd640 1 -- 172.21.15.88:0/4269874328 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6070+0+0 (secure 0 0 0) 0x7fd3600bec90 con 0x7fd3641023f0 2024-09-17T04:24:48.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:48.777+0000 7fd369562640 1 --2- 172.21.15.88:0/4269874328 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fd35007af30 0x7fd35007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:48.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:48.777+0000 7fd369562640 1 --2- 172.21.15.88:0/4269874328 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fd35007af30 0x7fd35007d3f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd36419abc0 tx=0x7fd354005d30 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:48.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:48.782+0000 7fd35affd640 1 -- 172.21.15.88:0/4269874328 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fd36008a2e0 con 0x7fd3641023f0 2024-09-17T04:24:48.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:48.974+0000 7fd36bfc7640 1 -- 172.21.15.88:0/4269874328 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fd364062630 con 0x7fd35007af30 2024-09-17T04:24:48.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:48.975+0000 7fd35affd640 1 -- 172.21.15.88:0/4269874328 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7fd364062630 con 0x7fd35007af30 2024-09-17T04:24:48.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:48.977+0000 7fd36bfc7640 1 -- 172.21.15.88:0/4269874328 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fd35007af30 msgr2=0x7fd35007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:48.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:48.977+0000 7fd36bfc7640 1 --2- 172.21.15.88:0/4269874328 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fd35007af30 0x7fd35007d3f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd36419abc0 tx=0x7fd354005d30 comp rx=0 tx=0).stop 2024-09-17T04:24:48.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:48.977+0000 7fd36bfc7640 1 -- 172.21.15.88:0/4269874328 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3641023f0 msgr2=0x7fd364199710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:48.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:48.977+0000 7fd36bfc7640 1 --2- 172.21.15.88:0/4269874328 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3641023f0 0x7fd364199710 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd3600099d0 tx=0x7fd3600048f0 comp rx=0 tx=0).stop 2024-09-17T04:24:48.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:48.977+0000 7fd36bfc7640 1 -- 172.21.15.88:0/4269874328 shutdown_connections 2024-09-17T04:24:48.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:48.977+0000 7fd36bfc7640 1 --2- 172.21.15.88:0/4269874328 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fd35007af30 0x7fd35007d3f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:48.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:48.977+0000 7fd36bfc7640 1 --2- 172.21.15.88:0/4269874328 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd364104d20 0x7fd364199c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:48.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:48.977+0000 7fd36bfc7640 1 --2- 172.21.15.88:0/4269874328 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3641023f0 0x7fd364199710 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:48.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:48.977+0000 7fd36bfc7640 1 -- 172.21.15.88:0/4269874328 >> 172.21.15.88:0/4269874328 conn(0x7fd3640fc010 msgr2=0x7fd364101aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:48.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:48.977+0000 7fd36bfc7640 1 -- 172.21.15.88:0/4269874328 shutdown_connections 2024-09-17T04:24:48.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:48.977+0000 7fd36bfc7640 1 -- 172.21.15.88:0/4269874328 wait complete. 2024-09-17T04:24:48.986 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-09-17T04:24:49.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.060+0000 7f1948669640 1 -- 172.21.15.88:0/2699341246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1940101a60 msgr2=0x7f1940101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:49.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.060+0000 7f1948669640 1 --2- 172.21.15.88:0/2699341246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1940101a60 0x7f1940101ee0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1930009880 tx=0x7f193002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:24:49.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.060+0000 7f1948669640 1 -- 172.21.15.88:0/2699341246 shutdown_connections 2024-09-17T04:24:49.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.060+0000 7f1948669640 1 --2- 172.21.15.88:0/2699341246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1940101a60 0x7f1940101ee0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:49.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.060+0000 7f1948669640 1 --2- 172.21.15.88:0/2699341246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1940100860 0x7f1940100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:49.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.060+0000 7f1948669640 1 -- 172.21.15.88:0/2699341246 >> 172.21.15.88:0/2699341246 conn(0x7f19400fc010 msgr2=0x7f19400fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:49.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.060+0000 7f1948669640 1 -- 172.21.15.88:0/2699341246 shutdown_connections 2024-09-17T04:24:49.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.060+0000 7f1948669640 1 -- 172.21.15.88:0/2699341246 wait complete. 2024-09-17T04:24:49.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.061+0000 7f1948669640 1 Processor -- start 2024-09-17T04:24:49.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.061+0000 7f1948669640 1 -- start start 2024-09-17T04:24:49.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.061+0000 7f1948669640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1940100860 0x7f19401974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:49.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.061+0000 7f1948669640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1940101a60 0x7f1940197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:49.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.061+0000 7f1948669640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f19401096a0 con 0x7f1940101a60 2024-09-17T04:24:49.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.061+0000 7f1948669640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1940109520 con 0x7f1940100860 2024-09-17T04:24:49.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.061+0000 7f1945c04640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1940101a60 0x7f1940197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:49.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.061+0000 7f1945c04640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1940101a60 0x7f1940197a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35220/0 (socket says 172.21.15.88:35220) 2024-09-17T04:24:49.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.061+0000 7f1945c04640 1 -- 172.21.15.88:0/4006862968 learned_addr learned my addr 172.21.15.88:0/4006862968 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:24:49.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.061+0000 7f1946405640 1 --2- 172.21.15.88:0/4006862968 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1940100860 0x7f19401974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:49.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.062+0000 7f1945c04640 1 -- 172.21.15.88:0/4006862968 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1940100860 msgr2=0x7f19401974f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:49.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.062+0000 7f1945c04640 1 --2- 172.21.15.88:0/4006862968 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1940100860 0x7f19401974f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:49.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.062+0000 7f1945c04640 1 -- 172.21.15.88:0/4006862968 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19401980b0 con 0x7f1940101a60 2024-09-17T04:24:49.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.062+0000 7f1945c04640 1 --2- 172.21.15.88:0/4006862968 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1940101a60 0x7f1940197a30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1930006010 tx=0x7f19300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:49.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.062+0000 7f19377fe640 1 -- 172.21.15.88:0/4006862968 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f193003f070 con 0x7f1940101a60 2024-09-17T04:24:49.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.062+0000 7f1948669640 1 -- 172.21.15.88:0/4006862968 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f194019ca90 con 0x7f1940101a60 2024-09-17T04:24:49.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.062+0000 7f19377fe640 1 -- 172.21.15.88:0/4006862968 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1930004ac0 con 0x7f1940101a60 2024-09-17T04:24:49.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.062+0000 7f1948669640 1 -- 172.21.15.88:0/4006862968 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f194019d020 con 0x7f1940101a60 2024-09-17T04:24:49.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.062+0000 7f19377fe640 1 -- 172.21.15.88:0/4006862968 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1930035030 con 0x7f1940101a60 2024-09-17T04:24:49.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.064+0000 7f1948669640 1 -- 172.21.15.88:0/4006862968 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1940100c60 con 0x7f1940101a60 2024-09-17T04:24:49.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.064+0000 7f19377fe640 1 -- 172.21.15.88:0/4006862968 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f1930042070 con 0x7f1940101a60 2024-09-17T04:24:49.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.064+0000 7f19377fe640 1 --2- 172.21.15.88:0/4006862968 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f192c07af80 0x7f192c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:49.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.064+0000 7f19377fe640 1 -- 172.21.15.88:0/4006862968 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6070+0+0 (secure 0 0 0) 0x7f19300beaa0 con 0x7f1940101a60 2024-09-17T04:24:49.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.064+0000 7f1946405640 1 --2- 172.21.15.88:0/4006862968 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f192c07af80 0x7f192c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:49.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.065+0000 7f1946405640 1 --2- 172.21.15.88:0/4006862968 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f192c07af80 0x7f192c07d440 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f193c005fd0 tx=0x7f193c00b390 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:49.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.069+0000 7f19377fe640 1 -- 172.21.15.88:0/4006862968 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f193008a170 con 0x7f1940101a60 2024-09-17T04:24:49.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.261+0000 7f1948669640 1 -- 172.21.15.88:0/4006862968 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f194006a9b0 con 0x7f192c07af80 2024-09-17T04:24:49.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.262+0000 7f19377fe640 1 -- 172.21.15.88:0/4006862968 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f194006a9b0 con 0x7f192c07af80 2024-09-17T04:24:49.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.265+0000 7f1948669640 1 -- 172.21.15.88:0/4006862968 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f192c07af80 msgr2=0x7f192c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:49.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.265+0000 7f1948669640 1 --2- 172.21.15.88:0/4006862968 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f192c07af80 0x7f192c07d440 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f193c005fd0 tx=0x7f193c00b390 comp rx=0 tx=0).stop 2024-09-17T04:24:49.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.265+0000 7f1948669640 1 -- 172.21.15.88:0/4006862968 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1940101a60 msgr2=0x7f1940197a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:49.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.265+0000 7f1948669640 1 --2- 172.21.15.88:0/4006862968 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1940101a60 0x7f1940197a30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1930006010 tx=0x7f19300046c0 comp rx=0 tx=0).stop 2024-09-17T04:24:49.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.265+0000 7f1948669640 1 -- 172.21.15.88:0/4006862968 shutdown_connections 2024-09-17T04:24:49.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.265+0000 7f1948669640 1 --2- 172.21.15.88:0/4006862968 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f192c07af80 0x7f192c07d440 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:49.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.265+0000 7f1948669640 1 --2- 172.21.15.88:0/4006862968 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1940101a60 0x7f1940197a30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:49.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.265+0000 7f1948669640 1 --2- 172.21.15.88:0/4006862968 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1940100860 0x7f19401974f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:49.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.265+0000 7f1948669640 1 -- 172.21.15.88:0/4006862968 >> 172.21.15.88:0/4006862968 conn(0x7f19400fc010 msgr2=0x7f194006a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:49.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.265+0000 7f1948669640 1 -- 172.21.15.88:0/4006862968 shutdown_connections 2024-09-17T04:24:49.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.265+0000 7f1948669640 1 -- 172.21.15.88:0/4006862968 wait complete. 2024-09-17T04:24:49.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.347+0000 7f0d90bb6640 1 -- 172.21.15.88:0/4248227788 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d8c101a60 msgr2=0x7f0d8c101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:49.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.347+0000 7f0d90bb6640 1 --2- 172.21.15.88:0/4248227788 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d8c101a60 0x7f0d8c101ee0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0d74009880 tx=0x7f0d7402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:24:49.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.347+0000 7f0d90bb6640 1 -- 172.21.15.88:0/4248227788 shutdown_connections 2024-09-17T04:24:49.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.347+0000 7f0d90bb6640 1 --2- 172.21.15.88:0/4248227788 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d8c101a60 0x7f0d8c101ee0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:49.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.347+0000 7f0d90bb6640 1 --2- 172.21.15.88:0/4248227788 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d8c100860 0x7f0d8c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:49.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.347+0000 7f0d90bb6640 1 -- 172.21.15.88:0/4248227788 >> 172.21.15.88:0/4248227788 conn(0x7f0d8c0fc010 msgr2=0x7f0d8c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:49.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.347+0000 7f0d90bb6640 1 -- 172.21.15.88:0/4248227788 shutdown_connections 2024-09-17T04:24:49.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.347+0000 7f0d90bb6640 1 -- 172.21.15.88:0/4248227788 wait complete. 2024-09-17T04:24:49.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.348+0000 7f0d90bb6640 1 Processor -- start 2024-09-17T04:24:49.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.348+0000 7f0d90bb6640 1 -- start start 2024-09-17T04:24:49.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.348+0000 7f0d90bb6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d8c100860 0x7f0d8c1963c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:49.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.348+0000 7f0d90bb6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d8c101a60 0x7f0d8c196900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:49.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.348+0000 7f0d90bb6640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f0d8c1096a0 con 0x7f0d8c101a60 2024-09-17T04:24:49.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.348+0000 7f0d90bb6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0d8c109520 con 0x7f0d8c100860 2024-09-17T04:24:49.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.348+0000 7f0d89d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d8c101a60 0x7f0d8c196900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:49.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.349+0000 7f0d89d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d8c101a60 0x7f0d8c196900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35246/0 (socket says 172.21.15.88:35246) 2024-09-17T04:24:49.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.349+0000 7f0d89d9b640 1 -- 172.21.15.88:0/376998237 learned_addr learned my addr 172.21.15.88:0/376998237 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:24:49.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.349+0000 7f0d8a59c640 1 --2- 172.21.15.88:0/376998237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d8c100860 0x7f0d8c1963c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:49.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.349+0000 7f0d89d9b640 1 -- 172.21.15.88:0/376998237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d8c100860 msgr2=0x7f0d8c1963c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:49.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.349+0000 7f0d89d9b640 1 --2- 172.21.15.88:0/376998237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d8c100860 0x7f0d8c1963c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:49.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.349+0000 7f0d89d9b640 1 -- 172.21.15.88:0/376998237 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d8c196f80 con 0x7f0d8c101a60 2024-09-17T04:24:49.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.349+0000 7f0d89d9b640 1 --2- 172.21.15.88:0/376998237 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d8c101a60 0x7f0d8c196900 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0d74006010 tx=0x7f0d740048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:49.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.349+0000 7f0d837fe640 1 -- 172.21.15.88:0/376998237 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0d7403f070 con 0x7f0d8c101a60 2024-09-17T04:24:49.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.349+0000 7f0d837fe640 1 -- 172.21.15.88:0/376998237 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0d740044d0 con 0x7f0d8c101a60 2024-09-17T04:24:49.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.349+0000 7f0d90bb6640 1 -- 172.21.15.88:0/376998237 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d8c19b960 con 0x7f0d8c101a60 2024-09-17T04:24:49.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.349+0000 7f0d837fe640 1 -- 172.21.15.88:0/376998237 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0d74035030 con 0x7f0d8c101a60 2024-09-17T04:24:49.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.349+0000 7f0d90bb6640 1 -- 172.21.15.88:0/376998237 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d8c19bef0 con 0x7f0d8c101a60 2024-09-17T04:24:49.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.350+0000 7f0d90bb6640 1 -- 172.21.15.88:0/376998237 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d8c100c60 con 0x7f0d8c101a60 2024-09-17T04:24:49.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.351+0000 7f0d837fe640 1 -- 172.21.15.88:0/376998237 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f0d74042070 con 0x7f0d8c101a60 2024-09-17T04:24:49.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.352+0000 7f0d837fe640 1 --2- 172.21.15.88:0/376998237 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f0d7807af30 0x7f0d7807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:49.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.352+0000 7f0d837fe640 1 -- 172.21.15.88:0/376998237 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6070+0+0 (secure 0 0 0) 0x7f0d740bec70 con 0x7f0d8c101a60 2024-09-17T04:24:49.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.352+0000 7f0d8a59c640 1 --2- 172.21.15.88:0/376998237 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f0d7807af30 0x7f0d7807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:49.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.352+0000 7f0d8a59c640 1 --2- 172.21.15.88:0/376998237 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f0d7807af30 0x7f0d7807d3f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c0058c0 tx=0x7f0d7c00a2d0 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:49.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.356+0000 7f0d837fe640 1 -- 172.21.15.88:0/376998237 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f0d7408a2c0 con 0x7f0d8c101a60 2024-09-17T04:24:49.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.543+0000 7f0d90bb6640 1 -- 172.21.15.88:0/376998237 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f0d8c062630 con 0x7f0d7807af30 2024-09-17T04:24:49.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.553+0000 7f0d837fe640 1 -- 172.21.15.88:0/376998237 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f0d8c062630 con 0x7f0d7807af30 2024-09-17T04:24:49.552 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T04:24:49.553 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (10m) 13s ago 11m 25.4M - 0.25.0 c8568f914cd2 f2dbac7e939f 2024-09-17T04:24:49.553 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi088 smithi088 running (3m) 13s ago 12m 8560k - 19.1.1-330-gc2ddf972 ebb0615149de 683e1826a1a5 2024-09-17T04:24:49.553 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi134 smithi134 running (3m) 71s ago 11m 8426k - 19.1.1-330-gc2ddf972 ebb0615149de 83afa4200c0e 2024-09-17T04:24:49.553 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (79s) 13s ago 12m 6891k - 19.3.0-4989-gce1b342b 8e039cb7fe1e 10355648c406 2024-09-17T04:24:49.553 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi134 smithi134 running (74s) 71s ago 11m 6899k - 19.3.0-4989-gce1b342b 8e039cb7fe1e d709085ffe5d 2024-09-17T04:24:49.553 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (10m) 13s ago 11m 78.0M - 9.4.12 2bacad6d85d8 a6cff57a23f9 2024-09-17T04:24:49.553 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.giqrgt smithi088 running (6m) 13s ago 6m 149M - 19.1.1-330-gc2ddf972 ebb0615149de f724660799a1 2024-09-17T04:24:49.553 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.lgavsv smithi088 running (6m) 13s ago 6m 16.0M - 19.1.1-330-gc2ddf972 ebb0615149de 6cc0fe8a6aa9 2024-09-17T04:24:49.553 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi134.ktuhce smithi134 running (6m) 71s ago 6m 15.0M - 19.1.1-330-gc2ddf972 ebb0615149de 7ff5b70ca9cb 2024-09-17T04:24:49.553 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi134.psnynp smithi134 running (6m) 71s ago 6m 90.6M - 19.1.1-330-gc2ddf972 ebb0615149de 5326974fa3dd 2024-09-17T04:24:49.553 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.wmndiv smithi088 *:8443,9283,8765 running (3m) 13s ago 13m 583M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 49eb47f7f14f 2024-09-17T04:24:49.554 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi134.vwdxcb smithi134 *:8443,9283,8765 running (2m) 71s ago 11m 520M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 8a6d45eb0595 2024-09-17T04:24:49.554 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (107s) 13s ago 13m 111M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e ac6332015243 2024-09-17T04:24:49.554 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi134 smithi134 running (91s) 71s ago 11m 91.9M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e ea49f690e26b 2024-09-17T04:24:49.554 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (12m) 13s ago 12m 16.2M - 1.5.0 0da6a335fe13 9ba03800993b 2024-09-17T04:24:49.554 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi134 smithi134 *:9100 running (11m) 71s ago 11m 17.1M - 1.5.0 0da6a335fe13 6deac483827f 2024-09-17T04:24:49.554 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (54s) 13s ago 9m 154M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 4ef267302248 2024-09-17T04:24:49.554 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (18s) 13s ago 9m 79.6M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 17b67c13c7aa 2024-09-17T04:24:49.554 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (8m) 13s ago 8m 178M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 1ba92f2bfce6 2024-09-17T04:24:49.554 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi134 running (8m) 71s ago 8m 233M 2240M 19.1.1-330-gc2ddf972 ebb0615149de ebd528c3ce1b 2024-09-17T04:24:49.554 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi134 running (8m) 71s ago 8m 208M 2240M 19.1.1-330-gc2ddf972 ebb0615149de eacc25537b3a 2024-09-17T04:24:49.554 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi134 running (7m) 71s ago 7m 185M 2240M 19.1.1-330-gc2ddf972 ebb0615149de bc1b434a92a8 2024-09-17T04:24:49.554 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (2m) 13s ago 11m 66.9M - 2.43.0 a07b618ecd1d b51d7899d341 2024-09-17T04:24:49.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.555+0000 7f0d90bb6640 1 -- 172.21.15.88:0/376998237 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f0d7807af30 msgr2=0x7f0d7807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:49.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.555+0000 7f0d90bb6640 1 --2- 172.21.15.88:0/376998237 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f0d7807af30 0x7f0d7807d3f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c0058c0 tx=0x7f0d7c00a2d0 comp rx=0 tx=0).stop 2024-09-17T04:24:49.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.555+0000 7f0d90bb6640 1 -- 172.21.15.88:0/376998237 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d8c101a60 msgr2=0x7f0d8c196900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:49.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.555+0000 7f0d90bb6640 1 --2- 172.21.15.88:0/376998237 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d8c101a60 0x7f0d8c196900 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0d74006010 tx=0x7f0d740048f0 comp rx=0 tx=0).stop 2024-09-17T04:24:49.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.555+0000 7f0d90bb6640 1 -- 172.21.15.88:0/376998237 shutdown_connections 2024-09-17T04:24:49.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.555+0000 7f0d90bb6640 1 --2- 172.21.15.88:0/376998237 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f0d7807af30 0x7f0d7807d3f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:49.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.555+0000 7f0d90bb6640 1 --2- 172.21.15.88:0/376998237 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d8c101a60 0x7f0d8c196900 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:49.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.555+0000 7f0d90bb6640 1 --2- 172.21.15.88:0/376998237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d8c100860 0x7f0d8c1963c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:49.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.555+0000 7f0d90bb6640 1 -- 172.21.15.88:0/376998237 >> 172.21.15.88:0/376998237 conn(0x7f0d8c0fc010 msgr2=0x7f0d8c104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:49.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.555+0000 7f0d90bb6640 1 -- 172.21.15.88:0/376998237 shutdown_connections 2024-09-17T04:24:49.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.555+0000 7f0d90bb6640 1 -- 172.21.15.88:0/376998237 wait complete. 2024-09-17T04:24:49.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.635+0000 7f24b797f640 1 -- 172.21.15.88:0/589724507 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24b0101a60 msgr2=0x7f24b0101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:49.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.635+0000 7f24b797f640 1 --2- 172.21.15.88:0/589724507 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24b0101a60 0x7f24b0101ee0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f24a4009880 tx=0x7f24a402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:24:49.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.636+0000 7f24b797f640 1 -- 172.21.15.88:0/589724507 shutdown_connections 2024-09-17T04:24:49.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.636+0000 7f24b797f640 1 --2- 172.21.15.88:0/589724507 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24b0101a60 0x7f24b0101ee0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:49.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.636+0000 7f24b797f640 1 --2- 172.21.15.88:0/589724507 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24b0100860 0x7f24b0100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:49.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.636+0000 7f24b797f640 1 -- 172.21.15.88:0/589724507 >> 172.21.15.88:0/589724507 conn(0x7f24b00fc010 msgr2=0x7f24b00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:49.636 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:49 smithi088 ceph-mon[90867]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:24:49.636 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:49 smithi088 ceph-mon[90867]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:24:49.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.636+0000 7f24b797f640 1 -- 172.21.15.88:0/589724507 shutdown_connections 2024-09-17T04:24:49.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.636+0000 7f24b797f640 1 -- 172.21.15.88:0/589724507 wait complete. 2024-09-17T04:24:49.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.636+0000 7f24b797f640 1 Processor -- start 2024-09-17T04:24:49.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.637+0000 7f24b797f640 1 -- start start 2024-09-17T04:24:49.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.637+0000 7f24b797f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24b0100860 0x7f24b006a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:49.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.637+0000 7f24b797f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24b0101a60 0x7f24b019c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:49.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.637+0000 7f24b797f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f24b0109720 con 0x7f24b0100860 2024-09-17T04:24:49.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.637+0000 7f24b797f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f24b01095a0 con 0x7f24b0101a60 2024-09-17T04:24:49.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.637+0000 7f24b571b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24b0100860 0x7f24b006a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:49.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.637+0000 7f24b571b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24b0100860 0x7f24b006a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35270/0 (socket says 172.21.15.88:35270) 2024-09-17T04:24:49.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.637+0000 7f24b571b640 1 -- 172.21.15.88:0/1827994275 learned_addr learned my addr 172.21.15.88:0/1827994275 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:24:49.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.637+0000 7f24b4f1a640 1 --2- 172.21.15.88:0/1827994275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24b0101a60 0x7f24b019c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:49.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.637+0000 7f24b571b640 1 -- 172.21.15.88:0/1827994275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24b0101a60 msgr2=0x7f24b019c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:49.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.637+0000 7f24b571b640 1 --2- 172.21.15.88:0/1827994275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24b0101a60 0x7f24b019c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:49.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.637+0000 7f24b571b640 1 -- 172.21.15.88:0/1827994275 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24b019c880 con 0x7f24b0100860 2024-09-17T04:24:49.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.637+0000 7f24b571b640 1 --2- 172.21.15.88:0/1827994275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24b0100860 0x7f24b006a790 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f24a000b9c0 tx=0x7f24a000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:49.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.638+0000 7f24ae7fc640 1 -- 172.21.15.88:0/1827994275 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f24a0019070 con 0x7f24b0100860 2024-09-17T04:24:49.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.638+0000 7f24ae7fc640 1 -- 172.21.15.88:0/1827994275 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f24a000cde0 con 0x7f24b0100860 2024-09-17T04:24:49.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.638+0000 7f24b797f640 1 -- 172.21.15.88:0/1827994275 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24b019cb70 con 0x7f24b0100860 2024-09-17T04:24:49.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.638+0000 7f24ae7fc640 1 -- 172.21.15.88:0/1827994275 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f24a0012570 con 0x7f24b0100860 2024-09-17T04:24:49.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.638+0000 7f24b797f640 1 -- 172.21.15.88:0/1827994275 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24b019d0d0 con 0x7f24b0100860 2024-09-17T04:24:49.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.639+0000 7f24b797f640 1 -- 172.21.15.88:0/1827994275 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24b0100c60 con 0x7f24b0100860 2024-09-17T04:24:49.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.639+0000 7f24ae7fc640 1 -- 172.21.15.88:0/1827994275 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f24a001c070 con 0x7f24b0100860 2024-09-17T04:24:49.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.640+0000 7f24ae7fc640 1 --2- 172.21.15.88:0/1827994275 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f249807af30 0x7f249807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:49.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.640+0000 7f24ae7fc640 1 -- 172.21.15.88:0/1827994275 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6070+0+0 (secure 0 0 0) 0x7f24a009d820 con 0x7f24b0100860 2024-09-17T04:24:49.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.640+0000 7f24b4f1a640 1 --2- 172.21.15.88:0/1827994275 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f249807af30 0x7f249807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:49.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.641+0000 7f24b4f1a640 1 --2- 172.21.15.88:0/1827994275 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f249807af30 0x7f249807d3f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f24a4000c00 tx=0x7f24a40058d0 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:49.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.645+0000 7f24ae7fc640 1 -- 172.21.15.88:0/1827994275 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f24a0068de0 con 0x7f24b0100860 2024-09-17T04:24:49.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.895+0000 7f24b797f640 1 -- 172.21.15.88:0/1827994275 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f24b0062df0 con 0x7f24b0100860 2024-09-17T04:24:49.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.896+0000 7f24ae7fc640 1 -- 172.21.15.88:0/1827994275 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7f24a006dc90 con 0x7f24b0100860 2024-09-17T04:24:49.895 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-17T04:24:49.896 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-09-17T04:24:49.896 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T04:24:49.896 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:24:49.896 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-09-17T04:24:49.896 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T04:24:49.896 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:24:49.896 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-09-17T04:24:49.896 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4, 2024-09-17T04:24:49.896 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T04:24:49.896 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:24:49.896 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2024-09-17T04:24:49.896 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T04:24:49.897 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:24:49.897 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-09-17T04:24:49.897 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 8, 2024-09-17T04:24:49.897 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 6 2024-09-17T04:24:49.897 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-17T04:24:49.897 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-17T04:24:49.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:49 smithi134 ceph-mon[76677]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:24:49.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:49 smithi134 ceph-mon[76677]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:24:49.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.898+0000 7f24b797f640 1 -- 172.21.15.88:0/1827994275 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f249807af30 msgr2=0x7f249807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:49.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.898+0000 7f24b797f640 1 --2- 172.21.15.88:0/1827994275 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f249807af30 0x7f249807d3f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f24a4000c00 tx=0x7f24a40058d0 comp rx=0 tx=0).stop 2024-09-17T04:24:49.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.898+0000 7f24b797f640 1 -- 172.21.15.88:0/1827994275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24b0100860 msgr2=0x7f24b006a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:49.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.898+0000 7f24b797f640 1 --2- 172.21.15.88:0/1827994275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24b0100860 0x7f24b006a790 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f24a000b9c0 tx=0x7f24a000be80 comp rx=0 tx=0).stop 2024-09-17T04:24:49.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.899+0000 7f24b797f640 1 -- 172.21.15.88:0/1827994275 shutdown_connections 2024-09-17T04:24:49.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.899+0000 7f24b797f640 1 --2- 172.21.15.88:0/1827994275 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f249807af30 0x7f249807d3f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:49.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.899+0000 7f24b797f640 1 --2- 172.21.15.88:0/1827994275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24b0101a60 0x7f24b019c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:49.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.899+0000 7f24b797f640 1 --2- 172.21.15.88:0/1827994275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24b0100860 0x7f24b006a790 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:49.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.899+0000 7f24b797f640 1 -- 172.21.15.88:0/1827994275 >> 172.21.15.88:0/1827994275 conn(0x7f24b00fc010 msgr2=0x7f24b0104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:49.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.899+0000 7f24b797f640 1 -- 172.21.15.88:0/1827994275 shutdown_connections 2024-09-17T04:24:49.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.899+0000 7f24b797f640 1 -- 172.21.15.88:0/1827994275 wait complete. 2024-09-17T04:24:49.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.981+0000 7f1fc1cc6640 1 -- 172.21.15.88:0/1373138029 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fbc104da0 msgr2=0x7f1fbc107190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:49.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.981+0000 7f1fc1cc6640 1 --2- 172.21.15.88:0/1373138029 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fbc104da0 0x7f1fbc107190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1fa4009880 tx=0x7f1fa402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:24:49.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.981+0000 7f1fc1cc6640 1 -- 172.21.15.88:0/1373138029 shutdown_connections 2024-09-17T04:24:49.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.981+0000 7f1fc1cc6640 1 --2- 172.21.15.88:0/1373138029 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fbc104da0 0x7f1fbc107190 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:49.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.981+0000 7f1fc1cc6640 1 --2- 172.21.15.88:0/1373138029 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fbc102470 0x7f1fbc104860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:49.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.981+0000 7f1fc1cc6640 1 -- 172.21.15.88:0/1373138029 >> 172.21.15.88:0/1373138029 conn(0x7f1fbc0fc010 msgr2=0x7f1fbc0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:49.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.981+0000 7f1fc1cc6640 1 -- 172.21.15.88:0/1373138029 shutdown_connections 2024-09-17T04:24:49.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.981+0000 7f1fc1cc6640 1 -- 172.21.15.88:0/1373138029 wait complete. 2024-09-17T04:24:49.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.982+0000 7f1fc1cc6640 1 Processor -- start 2024-09-17T04:24:49.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.982+0000 7f1fc1cc6640 1 -- start start 2024-09-17T04:24:49.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.982+0000 7f1fc1cc6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fbc102470 0x7f1fbc1974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:49.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.982+0000 7f1fc1cc6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fbc104da0 0x7f1fbc197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:49.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.982+0000 7f1fc1cc6640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f1fbc10a780 con 0x7f1fbc102470 2024-09-17T04:24:49.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.982+0000 7f1fc1cc6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1fbc10a600 con 0x7f1fbc104da0 2024-09-17T04:24:49.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.982+0000 7f1fbb7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fbc102470 0x7f1fbc1974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:49.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.982+0000 7f1fbb7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fbc102470 0x7f1fbc1974e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35294/0 (socket says 172.21.15.88:35294) 2024-09-17T04:24:49.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.982+0000 7f1fbb7fe640 1 -- 172.21.15.88:0/1216657824 learned_addr learned my addr 172.21.15.88:0/1216657824 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:24:49.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.982+0000 7f1fb3fff640 1 --2- 172.21.15.88:0/1216657824 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fbc104da0 0x7f1fbc197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:49.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.982+0000 7f1fbb7fe640 1 -- 172.21.15.88:0/1216657824 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fbc104da0 msgr2=0x7f1fbc197a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:49.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.982+0000 7f1fbb7fe640 1 --2- 172.21.15.88:0/1216657824 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fbc104da0 0x7f1fbc197a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:49.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.982+0000 7f1fbb7fe640 1 -- 172.21.15.88:0/1216657824 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fbc1980a0 con 0x7f1fbc102470 2024-09-17T04:24:49.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.983+0000 7f1fbb7fe640 1 --2- 172.21.15.88:0/1216657824 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fbc102470 0x7f1fbc1974e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1fac00c810 tx=0x7f1fac00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:49.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.983+0000 7f1fb97fa640 1 -- 172.21.15.88:0/1216657824 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1fac004020 con 0x7f1fbc102470 2024-09-17T04:24:49.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.983+0000 7f1fc1cc6640 1 -- 172.21.15.88:0/1216657824 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fbc19cae0 con 0x7f1fbc102470 2024-09-17T04:24:49.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.983+0000 7f1fb97fa640 1 -- 172.21.15.88:0/1216657824 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1fac0041c0 con 0x7f1fbc102470 2024-09-17T04:24:49.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.983+0000 7f1fb97fa640 1 -- 172.21.15.88:0/1216657824 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1fac0047a0 con 0x7f1fbc102470 2024-09-17T04:24:49.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.983+0000 7f1fc1cc6640 1 -- 172.21.15.88:0/1216657824 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fbc19d040 con 0x7f1fbc102470 2024-09-17T04:24:49.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.984+0000 7f1fc1cc6640 1 -- 172.21.15.88:0/1216657824 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fbc102850 con 0x7f1fbc102470 2024-09-17T04:24:49.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.985+0000 7f1fb97fa640 1 -- 172.21.15.88:0/1216657824 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f1fac0079b0 con 0x7f1fbc102470 2024-09-17T04:24:49.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.985+0000 7f1fb97fa640 1 --2- 172.21.15.88:0/1216657824 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f1fa807af30 0x7f1fa807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:49.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.985+0000 7f1fb3fff640 1 --2- 172.21.15.88:0/1216657824 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f1fa807af30 0x7f1fa807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:49.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.985+0000 7f1fb97fa640 1 -- 172.21.15.88:0/1216657824 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6070+0+0 (secure 0 0 0) 0x7f1fac09df70 con 0x7f1fbc102470 2024-09-17T04:24:49.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.986+0000 7f1fb3fff640 1 --2- 172.21.15.88:0/1216657824 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f1fa807af30 0x7f1fa807d3f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1fa4000c00 tx=0x7f1fa4005a20 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:49.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:49.990+0000 7f1fb97fa640 1 -- 172.21.15.88:0/1216657824 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f1fac014030 con 0x7f1fbc102470 2024-09-17T04:24:50.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.199+0000 7f1fc1cc6640 1 -- 172.21.15.88:0/1216657824 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f1fbc19d450 con 0x7f1fbc102470 2024-09-17T04:24:50.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.199+0000 7f1fb97fa640 1 -- 172.21.15.88:0/1216657824 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) ==== 76+0+2045 (secure 0 0 0) 0x7f1fac0695c0 con 0x7f1fbc102470 2024-09-17T04:24:50.200 INFO:teuthology.orchestra.run.smithi088.stdout:e15 2024-09-17T04:24:50.200 INFO:teuthology.orchestra.run.smithi088.stdout:btime 2024-09-17T04:18:27:750910+0000 2024-09-17T04:24:50.200 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T04:24:50.200 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:24:50.200 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2024-09-17T04:24:50.200 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:24:50.200 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2024-09-17T04:24:50.200 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2024-09-17T04:24:50.200 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 15 2024-09-17T04:24:50.200 INFO:teuthology.orchestra.run.smithi088.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T04:24:50.200 INFO:teuthology.orchestra.run.smithi088.stdout:created 2024-09-17T04:18:10.480573+0000 2024-09-17T04:24:50.201 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2024-09-17T04:18:27.750896+0000 2024-09-17T04:24:50.201 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2024-09-17T04:24:50.201 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2024-09-17T04:24:50.201 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2024-09-17T04:24:50.201 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2024-09-17T04:24:50.201 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2024-09-17T04:24:50.201 INFO:teuthology.orchestra.run.smithi088.stdout:max_xattr_size 65536 2024-09-17T04:24:50.201 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2024-09-17T04:24:50.201 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2024-09-17T04:24:50.201 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 45 2024-09-17T04:24:50.201 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:24:50.201 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 1 2024-09-17T04:24:50.201 INFO:teuthology.orchestra.run.smithi088.stdout:in 0 2024-09-17T04:24:50.202 INFO:teuthology.orchestra.run.smithi088.stdout:up {0=14590} 2024-09-17T04:24:50.202 INFO:teuthology.orchestra.run.smithi088.stdout:failed 2024-09-17T04:24:50.202 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2024-09-17T04:24:50.202 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2024-09-17T04:24:50.202 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2024-09-17T04:24:50.202 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2024-09-17T04:24:50.202 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data enabled 2024-09-17T04:24:50.202 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2024-09-17T04:24:50.202 INFO:teuthology.orchestra.run.smithi088.stdout:bal_rank_mask -1 2024-09-17T04:24:50.202 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 1 2024-09-17T04:24:50.202 INFO:teuthology.orchestra.run.smithi088.stdout:qdb_cluster leader: 14590 members: 14590 2024-09-17T04:24:50.202 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.giqrgt{0:14590} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.88:6828/1714846518,v1:172.21.15.88:6829/1714846518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:24:50.202 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi134.psnynp{0:24321} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.134:6826/2137586894,v1:172.21.15.134:6827/2137586894] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:24:50.202 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:24:50.202 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:24:50.203 INFO:teuthology.orchestra.run.smithi088.stdout:Standby daemons: 2024-09-17T04:24:50.203 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:24:50.203 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi134.ktuhce{-1:24325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/967997022,v1:172.21.15.134:6825/967997022] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:24:50.203 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.lgavsv{-1:24329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/1425146180,v1:172.21.15.88:6827/1425146180] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:24:50.204 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 15 2024-09-17T04:24:50.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.202+0000 7f1fc1cc6640 1 -- 172.21.15.88:0/1216657824 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f1fa807af30 msgr2=0x7f1fa807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:50.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.202+0000 7f1fc1cc6640 1 --2- 172.21.15.88:0/1216657824 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f1fa807af30 0x7f1fa807d3f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1fa4000c00 tx=0x7f1fa4005a20 comp rx=0 tx=0).stop 2024-09-17T04:24:50.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.202+0000 7f1fc1cc6640 1 -- 172.21.15.88:0/1216657824 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fbc102470 msgr2=0x7f1fbc1974e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:50.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.202+0000 7f1fc1cc6640 1 --2- 172.21.15.88:0/1216657824 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fbc102470 0x7f1fbc1974e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1fac00c810 tx=0x7f1fac00ccd0 comp rx=0 tx=0).stop 2024-09-17T04:24:50.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.202+0000 7f1fc1cc6640 1 -- 172.21.15.88:0/1216657824 shutdown_connections 2024-09-17T04:24:50.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.202+0000 7f1fc1cc6640 1 --2- 172.21.15.88:0/1216657824 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f1fa807af30 0x7f1fa807d3f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:50.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.202+0000 7f1fc1cc6640 1 --2- 172.21.15.88:0/1216657824 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fbc104da0 0x7f1fbc197a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:50.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.202+0000 7f1fc1cc6640 1 --2- 172.21.15.88:0/1216657824 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fbc102470 0x7f1fbc1974e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:50.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.202+0000 7f1fc1cc6640 1 -- 172.21.15.88:0/1216657824 >> 172.21.15.88:0/1216657824 conn(0x7f1fbc0fc010 msgr2=0x7f1fbc0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:50.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.202+0000 7f1fc1cc6640 1 -- 172.21.15.88:0/1216657824 shutdown_connections 2024-09-17T04:24:50.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.202+0000 7f1fc1cc6640 1 -- 172.21.15.88:0/1216657824 wait complete. 2024-09-17T04:24:50.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.286+0000 7ff9fc254640 1 -- 172.21.15.88:0/511730148 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9f4100b30 msgr2=0x7ff9f4100fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:50.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.286+0000 7ff9fc254640 1 --2- 172.21.15.88:0/511730148 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9f4100b30 0x7ff9f4100fb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4009880 tx=0x7ff9e402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:24:50.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.286+0000 7ff9fc254640 1 -- 172.21.15.88:0/511730148 shutdown_connections 2024-09-17T04:24:50.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.286+0000 7ff9fc254640 1 --2- 172.21.15.88:0/511730148 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9f4100b30 0x7ff9f4100fb0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:50.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.286+0000 7ff9fc254640 1 --2- 172.21.15.88:0/511730148 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9f4101df0 0x7ff9f41021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:50.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.286+0000 7ff9fc254640 1 -- 172.21.15.88:0/511730148 >> 172.21.15.88:0/511730148 conn(0x7ff9f40fb770 msgr2=0x7ff9f40fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:50.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.286+0000 7ff9fc254640 1 -- 172.21.15.88:0/511730148 shutdown_connections 2024-09-17T04:24:50.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.286+0000 7ff9fc254640 1 -- 172.21.15.88:0/511730148 wait complete. 2024-09-17T04:24:50.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.287+0000 7ff9fc254640 1 Processor -- start 2024-09-17T04:24:50.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.287+0000 7ff9fc254640 1 -- start start 2024-09-17T04:24:50.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.287+0000 7ff9fc254640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9f4100b30 0x7ff9f41996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:50.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.287+0000 7ff9fc254640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9f4101df0 0x7ff9f4199c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:50.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.287+0000 7ff9fc254640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f41096a0 con 0x7ff9f4101df0 2024-09-17T04:24:50.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.287+0000 7ff9fc254640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f4109520 con 0x7ff9f4100b30 2024-09-17T04:24:50.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.287+0000 7ff9f97ef640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9f4101df0 0x7ff9f4199c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:50.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.287+0000 7ff9f97ef640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9f4101df0 0x7ff9f4199c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35306/0 (socket says 172.21.15.88:35306) 2024-09-17T04:24:50.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.287+0000 7ff9f97ef640 1 -- 172.21.15.88:0/96193303 learned_addr learned my addr 172.21.15.88:0/96193303 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:24:50.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.288+0000 7ff9f9ff0640 1 --2- 172.21.15.88:0/96193303 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9f4100b30 0x7ff9f41996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:50.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.288+0000 7ff9f97ef640 1 -- 172.21.15.88:0/96193303 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9f4100b30 msgr2=0x7ff9f41996c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:50.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.288+0000 7ff9f97ef640 1 --2- 172.21.15.88:0/96193303 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9f4100b30 0x7ff9f41996c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:50.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.288+0000 7ff9f97ef640 1 -- 172.21.15.88:0/96193303 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9f419a280 con 0x7ff9f4101df0 2024-09-17T04:24:50.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.288+0000 7ff9f97ef640 1 --2- 172.21.15.88:0/96193303 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9f4101df0 0x7ff9f4199c00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4006010 tx=0x7ff9e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:50.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.288+0000 7ff9eaffd640 1 -- 172.21.15.88:0/96193303 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff9e403f070 con 0x7ff9f4101df0 2024-09-17T04:24:50.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.288+0000 7ff9eaffd640 1 -- 172.21.15.88:0/96193303 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff9e4004ac0 con 0x7ff9f4101df0 2024-09-17T04:24:50.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.288+0000 7ff9fc254640 1 -- 172.21.15.88:0/96193303 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9f419ec60 con 0x7ff9f4101df0 2024-09-17T04:24:50.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.288+0000 7ff9eaffd640 1 -- 172.21.15.88:0/96193303 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff9e4035030 con 0x7ff9f4101df0 2024-09-17T04:24:50.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.288+0000 7ff9fc254640 1 -- 172.21.15.88:0/96193303 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9f419f1a0 con 0x7ff9f4101df0 2024-09-17T04:24:50.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.289+0000 7ff9fc254640 1 -- 172.21.15.88:0/96193303 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9f4100fb0 con 0x7ff9f4101df0 2024-09-17T04:24:50.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.290+0000 7ff9eaffd640 1 -- 172.21.15.88:0/96193303 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7ff9e4042070 con 0x7ff9f4101df0 2024-09-17T04:24:50.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.290+0000 7ff9eaffd640 1 --2- 172.21.15.88:0/96193303 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7ff9e007af30 0x7ff9e007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:50.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.290+0000 7ff9eaffd640 1 -- 172.21.15.88:0/96193303 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6070+0+0 (secure 0 0 0) 0x7ff9e40bebb0 con 0x7ff9f4101df0 2024-09-17T04:24:50.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.290+0000 7ff9f9ff0640 1 --2- 172.21.15.88:0/96193303 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7ff9e007af30 0x7ff9e007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:50.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.291+0000 7ff9f9ff0640 1 --2- 172.21.15.88:0/96193303 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7ff9e007af30 0x7ff9e007d3f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0005fd0 tx=0x7ff9f000b390 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:50.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.295+0000 7ff9eaffd640 1 -- 172.21.15.88:0/96193303 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7ff9e40c5080 con 0x7ff9f4101df0 2024-09-17T04:24:50.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.491+0000 7ff9fc254640 1 -- 172.21.15.88:0/96193303 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff9f4100220 con 0x7ff9e007af30 2024-09-17T04:24:50.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.492+0000 7ff9eaffd640 1 -- 172.21.15.88:0/96193303 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7ff9f4100220 con 0x7ff9e007af30 2024-09-17T04:24:50.492 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-17T04:24:50.492 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f", 2024-09-17T04:24:50.492 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-09-17T04:24:50.492 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T04:24:50.492 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [ 2024-09-17T04:24:50.492 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr", 2024-09-17T04:24:50.492 INFO:teuthology.orchestra.run.smithi088.stdout: "mon", 2024-09-17T04:24:50.493 INFO:teuthology.orchestra.run.smithi088.stdout: "crash" 2024-09-17T04:24:50.493 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-17T04:24:50.493 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "8/23 daemons upgraded", 2024-09-17T04:24:50.493 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading osd daemons", 2024-09-17T04:24:50.493 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-09-17T04:24:50.493 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-17T04:24:50.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.495+0000 7ff9fc254640 1 -- 172.21.15.88:0/96193303 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7ff9e007af30 msgr2=0x7ff9e007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:50.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.495+0000 7ff9fc254640 1 --2- 172.21.15.88:0/96193303 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7ff9e007af30 0x7ff9e007d3f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0005fd0 tx=0x7ff9f000b390 comp rx=0 tx=0).stop 2024-09-17T04:24:50.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.495+0000 7ff9fc254640 1 -- 172.21.15.88:0/96193303 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9f4101df0 msgr2=0x7ff9f4199c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:50.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.495+0000 7ff9fc254640 1 --2- 172.21.15.88:0/96193303 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9f4101df0 0x7ff9f4199c00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4006010 tx=0x7ff9e40046c0 comp rx=0 tx=0).stop 2024-09-17T04:24:50.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.495+0000 7ff9fc254640 1 -- 172.21.15.88:0/96193303 shutdown_connections 2024-09-17T04:24:50.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.495+0000 7ff9fc254640 1 --2- 172.21.15.88:0/96193303 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7ff9e007af30 0x7ff9e007d3f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:50.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.495+0000 7ff9fc254640 1 --2- 172.21.15.88:0/96193303 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9f4101df0 0x7ff9f4199c00 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:50.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.495+0000 7ff9fc254640 1 --2- 172.21.15.88:0/96193303 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9f4100b30 0x7ff9f41996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:50.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.495+0000 7ff9fc254640 1 -- 172.21.15.88:0/96193303 >> 172.21.15.88:0/96193303 conn(0x7ff9f40fb770 msgr2=0x7ff9f40ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:50.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.495+0000 7ff9fc254640 1 -- 172.21.15.88:0/96193303 shutdown_connections 2024-09-17T04:24:50.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.495+0000 7ff9fc254640 1 -- 172.21.15.88:0/96193303 wait complete. 2024-09-17T04:24:50.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.578+0000 7fe375f57640 1 -- 172.21.15.88:0/173446379 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe370100880 msgr2=0x7fe370100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:50.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.578+0000 7fe375f57640 1 --2- 172.21.15.88:0/173446379 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe370100880 0x7fe370100c80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe360009880 tx=0x7fe36002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:24:50.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.579+0000 7fe375f57640 1 -- 172.21.15.88:0/173446379 shutdown_connections 2024-09-17T04:24:50.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.579+0000 7fe375f57640 1 --2- 172.21.15.88:0/173446379 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe370101a80 0x7fe370101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:50.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.579+0000 7fe375f57640 1 --2- 172.21.15.88:0/173446379 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe370100880 0x7fe370100c80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:50.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.579+0000 7fe375f57640 1 -- 172.21.15.88:0/173446379 >> 172.21.15.88:0/173446379 conn(0x7fe3700fc030 msgr2=0x7fe3700fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:50.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.579+0000 7fe375f57640 1 -- 172.21.15.88:0/173446379 shutdown_connections 2024-09-17T04:24:50.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.579+0000 7fe375f57640 1 -- 172.21.15.88:0/173446379 wait complete. 2024-09-17T04:24:50.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.579+0000 7fe375f57640 1 Processor -- start 2024-09-17T04:24:50.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.579+0000 7fe375f57640 1 -- start start 2024-09-17T04:24:50.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.580+0000 7fe375f57640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe370100880 0x7fe3701974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:50.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.580+0000 7fe375f57640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe370101a80 0x7fe370197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:50.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.580+0000 7fe375f57640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fe3701096a0 con 0x7fe370101a80 2024-09-17T04:24:50.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.580+0000 7fe375f57640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe370109520 con 0x7fe370100880 2024-09-17T04:24:50.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.580+0000 7fe36effd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe370101a80 0x7fe370197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:50.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.580+0000 7fe36effd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe370101a80 0x7fe370197a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35316/0 (socket says 172.21.15.88:35316) 2024-09-17T04:24:50.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.580+0000 7fe36effd640 1 -- 172.21.15.88:0/1142039595 learned_addr learned my addr 172.21.15.88:0/1142039595 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:24:50.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.580+0000 7fe36f7fe640 1 --2- 172.21.15.88:0/1142039595 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe370100880 0x7fe3701974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:50.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.580+0000 7fe36effd640 1 -- 172.21.15.88:0/1142039595 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe370100880 msgr2=0x7fe3701974f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:50.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.580+0000 7fe36effd640 1 --2- 172.21.15.88:0/1142039595 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe370100880 0x7fe3701974f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:50.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.580+0000 7fe36effd640 1 -- 172.21.15.88:0/1142039595 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe370198020 con 0x7fe370101a80 2024-09-17T04:24:50.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.580+0000 7fe36effd640 1 --2- 172.21.15.88:0/1142039595 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe370101a80 0x7fe370197a30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe36400c8a0 tx=0x7fe36400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:50.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.580+0000 7fe36cff9640 1 -- 172.21.15.88:0/1142039595 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe3640079b0 con 0x7fe370101a80 2024-09-17T04:24:50.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.580+0000 7fe36cff9640 1 -- 172.21.15.88:0/1142039595 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe364007b50 con 0x7fe370101a80 2024-09-17T04:24:50.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.580+0000 7fe375f57640 1 -- 172.21.15.88:0/1142039595 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe37019ca90 con 0x7fe370101a80 2024-09-17T04:24:50.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.580+0000 7fe36cff9640 1 -- 172.21.15.88:0/1142039595 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe364018700 con 0x7fe370101a80 2024-09-17T04:24:50.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.580+0000 7fe375f57640 1 -- 172.21.15.88:0/1142039595 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe37019cff0 con 0x7fe370101a80 2024-09-17T04:24:50.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.582+0000 7fe375f57640 1 -- 172.21.15.88:0/1142039595 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe370100c80 con 0x7fe370101a80 2024-09-17T04:24:50.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.582+0000 7fe36cff9640 1 -- 172.21.15.88:0/1142039595 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fe364007d00 con 0x7fe370101a80 2024-09-17T04:24:50.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.583+0000 7fe36cff9640 1 --2- 172.21.15.88:0/1142039595 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe35807af30 0x7fe35807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:50.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.583+0000 7fe36cff9640 1 -- 172.21.15.88:0/1142039595 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6070+0+0 (secure 0 0 0) 0x7fe36409e220 con 0x7fe370101a80 2024-09-17T04:24:50.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.583+0000 7fe36f7fe640 1 --2- 172.21.15.88:0/1142039595 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe35807af30 0x7fe35807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:50.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.583+0000 7fe36f7fe640 1 --2- 172.21.15.88:0/1142039595 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe35807af30 0x7fe35807d3f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe360009230 tx=0x7fe3600058d0 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:50.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.587+0000 7fe36cff9640 1 -- 172.21.15.88:0/1142039595 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fe364014030 con 0x7fe370101a80 2024-09-17T04:24:50.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.831+0000 7fe375f57640 1 -- 172.21.15.88:0/1142039595 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fe37019d940 con 0x7fe370101a80 2024-09-17T04:24:50.832 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:50 smithi088 ceph-mon[90867]: from='client.34172 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:24:50.832 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:50 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/1827994275' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:24:50.832 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:50 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/1216657824' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T04:24:50.832 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:50 smithi088 ceph-mon[90867]: pgmap v93: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-17T04:24:50.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.832+0000 7fe36cff9640 1 -- 172.21.15.88:0/1142039595 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7fe364069870 con 0x7fe370101a80 2024-09-17T04:24:50.833 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T04:24:50.833 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T04:24:50.833 INFO:teuthology.orchestra.run.smithi088.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T04:24:50.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.834+0000 7fe375f57640 1 -- 172.21.15.88:0/1142039595 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe35807af30 msgr2=0x7fe35807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:50.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.834+0000 7fe375f57640 1 --2- 172.21.15.88:0/1142039595 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe35807af30 0x7fe35807d3f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe360009230 tx=0x7fe3600058d0 comp rx=0 tx=0).stop 2024-09-17T04:24:50.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.834+0000 7fe375f57640 1 -- 172.21.15.88:0/1142039595 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe370101a80 msgr2=0x7fe370197a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:50.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.834+0000 7fe375f57640 1 --2- 172.21.15.88:0/1142039595 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe370101a80 0x7fe370197a30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe36400c8a0 tx=0x7fe36400cd60 comp rx=0 tx=0).stop 2024-09-17T04:24:50.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.835+0000 7fe375f57640 1 -- 172.21.15.88:0/1142039595 shutdown_connections 2024-09-17T04:24:50.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.835+0000 7fe375f57640 1 --2- 172.21.15.88:0/1142039595 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe35807af30 0x7fe35807d3f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:50.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.835+0000 7fe375f57640 1 --2- 172.21.15.88:0/1142039595 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe370101a80 0x7fe370197a30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:50.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.835+0000 7fe375f57640 1 --2- 172.21.15.88:0/1142039595 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe370100880 0x7fe3701974f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:50.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.835+0000 7fe375f57640 1 -- 172.21.15.88:0/1142039595 >> 172.21.15.88:0/1142039595 conn(0x7fe3700fc030 msgr2=0x7fe37006a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:50.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.835+0000 7fe375f57640 1 -- 172.21.15.88:0/1142039595 shutdown_connections 2024-09-17T04:24:50.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:24:50.835+0000 7fe375f57640 1 -- 172.21.15.88:0/1142039595 wait complete. 2024-09-17T04:24:50.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:50 smithi134 ceph-mon[76677]: from='client.34172 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:24:50.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:50 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/1827994275' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:24:50.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:50 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/1216657824' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T04:24:50.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:50 smithi134 ceph-mon[76677]: pgmap v93: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-17T04:24:51.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:51 smithi088 ceph-mon[90867]: from='client.34184 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:24:51.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:51 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/1142039595' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T04:24:51.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:51 smithi134 ceph-mon[76677]: from='client.34184 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:24:51.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:51 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/1142039595' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T04:24:52.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:52 smithi088 ceph-mon[90867]: pgmap v94: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1013 B/s rd, 1 op/s 2024-09-17T04:24:52.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:52 smithi134 ceph-mon[76677]: pgmap v94: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1013 B/s rd, 1 op/s 2024-09-17T04:24:54.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:54 smithi088 ceph-mon[90867]: pgmap v95: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:24:54.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:54 smithi134 ceph-mon[76677]: pgmap v95: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:24:55.606 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:55 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-17T04:24:55.606 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:55 smithi088 ceph-mon[90867]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-17T04:24:55.606 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:55 smithi088 ceph-mon[90867]: Upgrade: osd.2 is safe to restart 2024-09-17T04:24:55.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:55 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-17T04:24:55.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:55 smithi134 ceph-mon[76677]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-17T04:24:55.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:55 smithi134 ceph-mon[76677]: Upgrade: osd.2 is safe to restart 2024-09-17T04:24:57.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:57 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:24:57.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:57 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:24:57.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:57 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:24:57.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:57 smithi088 ceph-mon[90867]: Upgrade: Updating osd.2 2024-09-17T04:24:57.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:57 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:24:57.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:57 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-17T04:24:57.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:57 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:24:57.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:57 smithi088 ceph-mon[90867]: Deploying daemon osd.2 on smithi088 2024-09-17T04:24:57.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:57 smithi088 ceph-mon[90867]: pgmap v96: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:24:57.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:57 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:24:57.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:57 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:24:57.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:57 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:24:57.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:57 smithi134 ceph-mon[76677]: Upgrade: Updating osd.2 2024-09-17T04:24:57.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:57 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:24:57.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:57 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-17T04:24:57.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:57 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:24:57.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:57 smithi134 ceph-mon[76677]: Deploying daemon osd.2 on smithi088 2024-09-17T04:24:57.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:57 smithi134 ceph-mon[76677]: pgmap v96: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:24:58.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:58 smithi088 ceph-mon[90867]: pgmap v97: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:24:58.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:58 smithi134 ceph-mon[76677]: pgmap v97: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:24:59.571 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:24:59 smithi088 systemd[1]: Stopping Ceph osd.2 for bf2b79a4-74aa-11ef-bceb-c7b262605968... 2024-09-17T04:24:59.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:24:59 smithi088 ceph-mon[90867]: osd.2 marked itself down and dead 2024-09-17T04:24:59.888 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:24:59 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-2[64975]: 2024-09-17T04:24:59.753+0000 7f441e82d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T04:24:59.889 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:24:59 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-2[64975]: 2024-09-17T04:24:59.753+0000 7f441e82d640 -1 osd.2 57 *** Got signal Terminated *** 2024-09-17T04:24:59.889 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:24:59 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-2[64975]: 2024-09-17T04:24:59.753+0000 7f441e82d640 -1 osd.2 57 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T04:25:00.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:24:59 smithi134 ceph-mon[76677]: osd.2 marked itself down and dead 2024-09-17T04:25:00.666 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:25:00 smithi088 podman[109884]: 2024-09-17 04:25:00.393923621 +0000 UTC m=+0.927388172 container died 1ba92f2bfce62c66529d5130b1a6a2c44cd25b6befd6094105baf5c9c7f1cab6 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-17T04:25:01.078 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:25:00 smithi088 podman[109884]: 2024-09-17 04:25:00.787025503 +0000 UTC m=+1.320490057 container cleanup 1ba92f2bfce62c66529d5130b1a6a2c44cd25b6befd6094105baf5c9c7f1cab6 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-17T04:25:01.078 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:25:00 smithi088 bash[109884]: ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-2 2024-09-17T04:25:01.078 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:00 smithi088 ceph-mon[90867]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T04:25:01.078 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:00 smithi088 ceph-mon[90867]: osdmap e58: 6 total, 5 up, 6 in 2024-09-17T04:25:01.078 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:00 smithi088 ceph-mon[90867]: pgmap v99: 65 pgs: 7 peering, 5 stale+active+clean, 53 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-17T04:25:01.078 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:00 smithi088 ceph-mon[90867]: osdmap e59: 6 total, 5 up, 6 in 2024-09-17T04:25:01.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:00 smithi134 ceph-mon[76677]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T04:25:01.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:00 smithi134 ceph-mon[76677]: osdmap e58: 6 total, 5 up, 6 in 2024-09-17T04:25:01.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:00 smithi134 ceph-mon[76677]: pgmap v99: 65 pgs: 7 peering, 5 stale+active+clean, 53 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-17T04:25:01.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:00 smithi134 ceph-mon[76677]: osdmap e59: 6 total, 5 up, 6 in 2024-09-17T04:25:01.387 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:25:01 smithi088 podman[109909]: 2024-09-17 04:25:01.078897556 +0000 UTC m=+0.687410888 container remove 1ba92f2bfce62c66529d5130b1a6a2c44cd25b6befd6094105baf5c9c7f1cab6 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2) 2024-09-17T04:25:01.668 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:25:01 smithi088 podman[109997]: 2024-09-17 04:25:01.321162271 +0000 UTC m=+0.015999954 image pull 8e039cb7fe1eece5854872e8884a61a26632c7691b2c85cbac9078a9c5c62fae quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f 2024-09-17T04:25:01.668 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:25:01 smithi088 podman[109997]: 2024-09-17 04:25:01.424816106 +0000 UTC m=+0.119653790 container create 8f3538eb5f5622bf5a2c4f47f72089c3107f82df3b2dc6cbc8b397a479f75f9f (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-17T04:25:01.668 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:25:01 smithi088 podman[109997]: 2024-09-17 04:25:01.66905628 +0000 UTC m=+0.363893976 container init 8f3538eb5f5622bf5a2c4f47f72089c3107f82df3b2dc6cbc8b397a479f75f9f (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T04:25:02.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:01 smithi088 ceph-mon[90867]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2024-09-17T04:25:02.138 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:25:01 smithi088 podman[109997]: 2024-09-17 04:25:01.672502426 +0000 UTC m=+0.367340112 container start 8f3538eb5f5622bf5a2c4f47f72089c3107f82df3b2dc6cbc8b397a479f75f9f (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True) 2024-09-17T04:25:02.138 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:25:01 smithi088 podman[109997]: 2024-09-17 04:25:01.744122142 +0000 UTC m=+0.438959841 container attach 8f3538eb5f5622bf5a2c4f47f72089c3107f82df3b2dc6cbc8b397a479f75f9f (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-17T04:25:02.138 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:25:01 smithi088 podman[109997]: 2024-09-17 04:25:01.862424399 +0000 UTC m=+0.557262083 container died 8f3538eb5f5622bf5a2c4f47f72089c3107f82df3b2dc6cbc8b397a479f75f9f (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-2-deactivate, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T04:25:02.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:01 smithi134 ceph-mon[76677]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2024-09-17T04:25:02.831 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:25:02 smithi088 podman[110020]: 2024-09-17 04:25:02.447401114 +0000 UTC m=+0.579659595 container remove 8f3538eb5f5622bf5a2c4f47f72089c3107f82df3b2dc6cbc8b397a479f75f9f (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-17T04:25:02.832 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:25:02 smithi088 systemd[1]: ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968@osd.2.service: Deactivated successfully. 2024-09-17T04:25:02.832 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:25:02 smithi088 systemd[1]: Stopped Ceph osd.2 for bf2b79a4-74aa-11ef-bceb-c7b262605968. 2024-09-17T04:25:02.832 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:25:02 smithi088 systemd[1]: ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968@osd.2.service: Consumed 45.789s CPU time. 2024-09-17T04:25:02.832 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:25:02 smithi088 systemd[1]: Starting Ceph osd.2 for bf2b79a4-74aa-11ef-bceb-c7b262605968... 2024-09-17T04:25:03.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:02 smithi088 ceph-mon[90867]: pgmap v101: 65 pgs: 7 active+undersized, 7 peering, 3 stale+active+clean, 5 active+undersized+degraded, 43 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 10/276 objects degraded (3.623%) 2024-09-17T04:25:03.138 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:25:02 smithi088 podman[110118]: 2024-09-17 04:25:02.795036845 +0000 UTC m=+0.015784147 image pull 8e039cb7fe1eece5854872e8884a61a26632c7691b2c85cbac9078a9c5c62fae quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f 2024-09-17T04:25:03.138 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:25:02 smithi088 podman[110118]: 2024-09-17 04:25:02.924204883 +0000 UTC m=+0.144952222 container create 65fccbaf04a558c0951a3ad1e0c300ee202cb2ff6a99108e68f100fe75b36d50 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-17T04:25:03.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:02 smithi134 ceph-mon[76677]: pgmap v101: 65 pgs: 7 active+undersized, 7 peering, 3 stale+active+clean, 5 active+undersized+degraded, 43 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 10/276 objects degraded (3.623%) 2024-09-17T04:25:03.638 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:25:03 smithi088 podman[110118]: 2024-09-17 04:25:03.151744884 +0000 UTC m=+0.372492198 container init 65fccbaf04a558c0951a3ad1e0c300ee202cb2ff6a99108e68f100fe75b36d50 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-2-activate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-17T04:25:03.638 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:25:03 smithi088 podman[110118]: 2024-09-17 04:25:03.155139226 +0000 UTC m=+0.375886531 container start 65fccbaf04a558c0951a3ad1e0c300ee202cb2ff6a99108e68f100fe75b36d50 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-2-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-17T04:25:03.638 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:25:03 smithi088 podman[110118]: 2024-09-17 04:25:03.226507296 +0000 UTC m=+0.447254587 container attach 65fccbaf04a558c0951a3ad1e0c300ee202cb2ff6a99108e68f100fe75b36d50 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.vendor=CentOS) 2024-09-17T04:25:03.638 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:25:03 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-2-activate[110132]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T04:25:03.638 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:25:03 smithi088 bash[110118]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T04:25:03.638 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:25:03 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-2-activate[110132]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T04:25:03.638 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:25:03 smithi088 bash[110118]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T04:25:04.117 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:03 smithi088 ceph-mon[90867]: Health check failed: Degraded data redundancy: 10/276 objects degraded (3.623%), 5 pgs degraded (PG_DEGRADED) 2024-09-17T04:25:04.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:03 smithi134 ceph-mon[76677]: Health check failed: Degraded data redundancy: 10/276 objects degraded (3.623%), 5 pgs degraded (PG_DEGRADED) 2024-09-17T04:25:04.387 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:25:04 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-2-activate[110132]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-17T04:25:04.387 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:25:04 smithi088 bash[110118]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-17T04:25:04.387 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:25:04 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-2-activate[110132]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-17T04:25:04.388 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:25:04 smithi088 bash[110118]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-17T04:25:04.839 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:25:04 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-2-activate[110132]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-17T04:25:04.840 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:25:04 smithi088 bash[110118]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-17T04:25:04.840 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:25:04 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-2-activate[110132]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-17T04:25:04.840 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:25:04 smithi088 bash[110118]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-17T04:25:04.840 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:25:04 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-2-activate[110132]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-17T04:25:04.840 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:25:04 smithi088 bash[110118]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-17T04:25:04.840 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:25:04 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-2-activate[110132]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-17T04:25:04.840 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:25:04 smithi088 bash[110118]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-17T04:25:04.840 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:25:04 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-2-activate[110132]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-17T04:25:04.840 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:25:04 smithi088 bash[110118]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-17T04:25:04.840 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:25:04 smithi088 podman[110118]: 2024-09-17 04:25:04.444919095 +0000 UTC m=+1.665666400 container died 65fccbaf04a558c0951a3ad1e0c300ee202cb2ff6a99108e68f100fe75b36d50 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-2-activate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-17T04:25:05.116 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:04 smithi088 ceph-mon[90867]: pgmap v102: 65 pgs: 11 active+undersized, 7 peering, 9 active+undersized+degraded, 38 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 21/276 objects degraded (7.609%) 2024-09-17T04:25:05.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:04 smithi134 ceph-mon[76677]: pgmap v102: 65 pgs: 11 active+undersized, 7 peering, 9 active+undersized+degraded, 38 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 21/276 objects degraded (7.609%) 2024-09-17T04:25:05.387 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:25:05 smithi088 podman[110266]: 2024-09-17 04:25:05.247387674 +0000 UTC m=+0.796668719 container remove 65fccbaf04a558c0951a3ad1e0c300ee202cb2ff6a99108e68f100fe75b36d50 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T04:25:05.725 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:25:05 smithi088 podman[110329]: 2024-09-17 04:25:05.355366546 +0000 UTC m=+0.016213882 image pull 8e039cb7fe1eece5854872e8884a61a26632c7691b2c85cbac9078a9c5c62fae quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f 2024-09-17T04:25:05.725 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:25:05 smithi088 podman[110329]: 2024-09-17 04:25:05.473377208 +0000 UTC m=+0.134224531 container create 83d38ad792c97e23ec49f47ac05b1a3e751030c374fb0b9d4b2e46c261608970 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-2, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-17T04:25:05.725 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:25:05 smithi088 podman[110329]: 2024-09-17 04:25:05.726079287 +0000 UTC m=+0.386926610 container init 83d38ad792c97e23ec49f47ac05b1a3e751030c374fb0b9d4b2e46c261608970 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T04:25:06.137 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:25:05 smithi088 podman[110329]: 2024-09-17 04:25:05.729426097 +0000 UTC m=+0.390273421 container start 83d38ad792c97e23ec49f47ac05b1a3e751030c374fb0b9d4b2e46c261608970 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T04:25:06.138 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:25:05 smithi088 ceph-osd[110348]: -- 172.21.15.88:0/3103666907 <== mon.0 v2:172.21.15.88:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562d8e4481e0 con 0x562d8d724d00 2024-09-17T04:25:06.138 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:25:05 smithi088 bash[110329]: 83d38ad792c97e23ec49f47ac05b1a3e751030c374fb0b9d4b2e46c261608970 2024-09-17T04:25:06.138 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:25:05 smithi088 systemd[1]: Started Ceph osd.2 for bf2b79a4-74aa-11ef-bceb-c7b262605968. 2024-09-17T04:25:07.127 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:06 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:25:07.127 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:06 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:25:07.127 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:06 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:25:07.127 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:06 smithi088 ceph-mon[90867]: pgmap v103: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35/276 objects degraded (12.681%) 2024-09-17T04:25:07.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:06 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:25:07.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:06 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:25:07.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:06 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:25:07.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:06 smithi134 ceph-mon[76677]: pgmap v103: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35/276 objects degraded (12.681%) 2024-09-17T04:25:07.380 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:25:07 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-2[110344]: 2024-09-17T04:25:07.126+0000 7fb720f0c640 -1 Falling back to public interface 2024-09-17T04:25:08.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:07 smithi088 ceph-mon[90867]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs peering) 2024-09-17T04:25:08.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:07 smithi134 ceph-mon[76677]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs peering) 2024-09-17T04:25:09.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:08 smithi088 ceph-mon[90867]: pgmap v104: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35/276 objects degraded (12.681%) 2024-09-17T04:25:09.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:08 smithi134 ceph-mon[76677]: pgmap v104: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35/276 objects degraded (12.681%) 2024-09-17T04:25:10.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:10 smithi088 ceph-mon[90867]: pgmap v105: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 35/276 objects degraded (12.681%) 2024-09-17T04:25:10.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:10 smithi134 ceph-mon[76677]: pgmap v105: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 35/276 objects degraded (12.681%) 2024-09-17T04:25:12.084 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:11 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:25:12.084 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:11 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:25:12.084 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:11 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:25:12.084 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:11 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:25:12.084 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:11 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:25:12.085 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:11 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:25:12.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:11 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:25:12.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:11 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:25:12.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:11 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:25:12.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:11 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:25:12.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:11 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:25:12.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:11 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:25:13.031 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:12 smithi088 ceph-mon[90867]: pgmap v106: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 35/276 objects degraded (12.681%) 2024-09-17T04:25:13.032 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:12 smithi088 ceph-mon[90867]: Health check update: Degraded data redundancy: 35/276 objects degraded (12.681%), 12 pgs degraded (PG_DEGRADED) 2024-09-17T04:25:13.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:12 smithi134 ceph-mon[76677]: pgmap v106: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 35/276 objects degraded (12.681%) 2024-09-17T04:25:13.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:12 smithi134 ceph-mon[76677]: Health check update: Degraded data redundancy: 35/276 objects degraded (12.681%), 12 pgs degraded (PG_DEGRADED) 2024-09-17T04:25:13.387 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:25:13 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-2[110344]: 2024-09-17T04:25:13.031+0000 7fb720f0c640 -1 osd.2 57 log_to_monitors true 2024-09-17T04:25:14.112 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:13 smithi088 ceph-mon[90867]: from='osd.2 [v2:172.21.15.88:6818/3777193924,v1:172.21.15.88:6819/3777193924]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-17T04:25:14.112 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:25:13 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-2[110344]: 2024-09-17T04:25:13.792+0000 7fb718c8c640 -1 osd.2 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T04:25:14.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:13 smithi134 ceph-mon[76677]: from='osd.2 [v2:172.21.15.88:6818/3777193924,v1:172.21.15.88:6819/3777193924]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-17T04:25:15.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:14 smithi088 ceph-mon[90867]: from='osd.2 [v2:172.21.15.88:6818/3777193924,v1:172.21.15.88:6819/3777193924]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-17T04:25:15.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:14 smithi088 ceph-mon[90867]: osdmap e60: 6 total, 5 up, 6 in 2024-09-17T04:25:15.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:14 smithi088 ceph-mon[90867]: from='osd.2 [v2:172.21.15.88:6818/3777193924,v1:172.21.15.88:6819/3777193924]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi088", "root=default"]} : dispatch 2024-09-17T04:25:15.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:14 smithi088 ceph-mon[90867]: pgmap v108: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 35/276 objects degraded (12.681%) 2024-09-17T04:25:15.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:14 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:25:15.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:14 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:25:15.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:14 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:25:15.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:14 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:25:15.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:14 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:25:15.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:14 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:25:15.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:14 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:25:15.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:14 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:25:15.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:14 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:25:15.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:14 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-17T04:25:15.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:14 smithi134 ceph-mon[76677]: from='osd.2 [v2:172.21.15.88:6818/3777193924,v1:172.21.15.88:6819/3777193924]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-17T04:25:15.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:14 smithi134 ceph-mon[76677]: osdmap e60: 6 total, 5 up, 6 in 2024-09-17T04:25:15.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:14 smithi134 ceph-mon[76677]: from='osd.2 [v2:172.21.15.88:6818/3777193924,v1:172.21.15.88:6819/3777193924]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi088", "root=default"]} : dispatch 2024-09-17T04:25:15.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:14 smithi134 ceph-mon[76677]: pgmap v108: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 35/276 objects degraded (12.681%) 2024-09-17T04:25:15.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:14 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:25:15.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:14 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:25:15.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:14 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:25:15.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:14 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:25:15.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:14 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:25:15.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:14 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:25:15.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:14 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:25:15.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:14 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:25:15.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:14 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:25:15.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:14 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-17T04:25:15.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:15 smithi088 ceph-mon[90867]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-17T04:25:15.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:15 smithi088 ceph-mon[90867]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-17T04:25:15.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:15 smithi088 ceph-mon[90867]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T04:25:15.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:15 smithi088 ceph-mon[90867]: osd.2 [v2:172.21.15.88:6818/3777193924,v1:172.21.15.88:6819/3777193924] boot 2024-09-17T04:25:15.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:15 smithi088 ceph-mon[90867]: osdmap e61: 6 total, 6 up, 6 in 2024-09-17T04:25:15.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:15 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-17T04:25:16.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:15 smithi134 ceph-mon[76677]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-17T04:25:16.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:15 smithi134 ceph-mon[76677]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-17T04:25:16.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:15 smithi134 ceph-mon[76677]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T04:25:16.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:15 smithi134 ceph-mon[76677]: osd.2 [v2:172.21.15.88:6818/3777193924,v1:172.21.15.88:6819/3777193924] boot 2024-09-17T04:25:16.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:15 smithi134 ceph-mon[76677]: osdmap e61: 6 total, 6 up, 6 in 2024-09-17T04:25:16.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:15 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-17T04:25:17.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:16 smithi088 ceph-mon[90867]: osdmap e62: 6 total, 6 up, 6 in 2024-09-17T04:25:17.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:16 smithi088 ceph-mon[90867]: pgmap v111: 65 pgs: 3 peering, 7 active+undersized, 7 active+undersized+degraded, 48 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 1 op/s; 22/276 objects degraded (7.971%) 2024-09-17T04:25:17.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:16 smithi134 ceph-mon[76677]: osdmap e62: 6 total, 6 up, 6 in 2024-09-17T04:25:17.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:16 smithi134 ceph-mon[76677]: pgmap v111: 65 pgs: 3 peering, 7 active+undersized, 7 active+undersized+degraded, 48 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 1 op/s; 22/276 objects degraded (7.971%) 2024-09-17T04:25:18.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:17 smithi088 ceph-mon[90867]: Health check update: Degraded data redundancy: 22/276 objects degraded (7.971%), 7 pgs degraded (PG_DEGRADED) 2024-09-17T04:25:18.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:17 smithi134 ceph-mon[76677]: Health check update: Degraded data redundancy: 22/276 objects degraded (7.971%), 7 pgs degraded (PG_DEGRADED) 2024-09-17T04:25:19.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:18 smithi088 ceph-mon[90867]: pgmap v112: 65 pgs: 3 peering, 4 active+undersized, 5 active+undersized+degraded, 53 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 682 B/s rd, 0 op/s; 17/276 objects degraded (6.159%) 2024-09-17T04:25:19.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:18 smithi134 ceph-mon[76677]: pgmap v112: 65 pgs: 3 peering, 4 active+undersized, 5 active+undersized+degraded, 53 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 682 B/s rd, 0 op/s; 17/276 objects degraded (6.159%) 2024-09-17T04:25:20.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:20 smithi088 ceph-mon[90867]: pgmap v113: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-17T04:25:20.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:20 smithi088 ceph-mon[90867]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 17/276 objects degraded (6.159%), 5 pgs degraded) 2024-09-17T04:25:20.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:20 smithi134 ceph-mon[76677]: pgmap v113: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-17T04:25:20.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:20 smithi134 ceph-mon[76677]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 17/276 objects degraded (6.159%), 5 pgs degraded) 2024-09-17T04:25:20.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:20.924+0000 7f5d8eb43640 1 -- 172.21.15.88:0/1298115893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d88100860 msgr2=0x7f5d88100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:20.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:20.924+0000 7f5d8eb43640 1 --2- 172.21.15.88:0/1298115893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d88100860 0x7f5d88100c60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5d84009880 tx=0x7f5d8402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:25:20.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:20.924+0000 7f5d8eb43640 1 -- 172.21.15.88:0/1298115893 shutdown_connections 2024-09-17T04:25:20.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:20.924+0000 7f5d8eb43640 1 --2- 172.21.15.88:0/1298115893 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d88101a60 0x7f5d88101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:20.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:20.924+0000 7f5d8eb43640 1 --2- 172.21.15.88:0/1298115893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d88100860 0x7f5d88100c60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:20.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:20.924+0000 7f5d8eb43640 1 -- 172.21.15.88:0/1298115893 >> 172.21.15.88:0/1298115893 conn(0x7f5d880fc010 msgr2=0x7f5d880fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:20.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:20.925+0000 7f5d8eb43640 1 -- 172.21.15.88:0/1298115893 shutdown_connections 2024-09-17T04:25:20.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:20.925+0000 7f5d8eb43640 1 -- 172.21.15.88:0/1298115893 wait complete. 2024-09-17T04:25:20.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:20.925+0000 7f5d8eb43640 1 Processor -- start 2024-09-17T04:25:20.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:20.925+0000 7f5d8eb43640 1 -- start start 2024-09-17T04:25:20.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:20.925+0000 7f5d8eb43640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d88100860 0x7f5d881963b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:20.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:20.925+0000 7f5d8eb43640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d88101a60 0x7f5d881968f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:20.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:20.925+0000 7f5d8eb43640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f5d88109680 con 0x7f5d88101a60 2024-09-17T04:25:20.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:20.925+0000 7f5d8eb43640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5d88109500 con 0x7f5d88100860 2024-09-17T04:25:20.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:20.926+0000 7f5d7ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d88101a60 0x7f5d881968f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:20.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:20.926+0000 7f5d7ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d88101a60 0x7f5d881968f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54030/0 (socket says 172.21.15.88:54030) 2024-09-17T04:25:20.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:20.926+0000 7f5d7ffff640 1 -- 172.21.15.88:0/2668631642 learned_addr learned my addr 172.21.15.88:0/2668631642 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:25:20.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:20.926+0000 7f5d8c8df640 1 --2- 172.21.15.88:0/2668631642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d88100860 0x7f5d881963b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:20.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:20.926+0000 7f5d7ffff640 1 -- 172.21.15.88:0/2668631642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d88100860 msgr2=0x7f5d881963b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:20.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:20.926+0000 7f5d7ffff640 1 --2- 172.21.15.88:0/2668631642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d88100860 0x7f5d881963b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:20.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:20.926+0000 7f5d7ffff640 1 -- 172.21.15.88:0/2668631642 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d88196ee0 con 0x7f5d88101a60 2024-09-17T04:25:20.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:20.926+0000 7f5d8c8df640 1 --2- 172.21.15.88:0/2668631642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d88100860 0x7f5d881963b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:25:20.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:20.926+0000 7f5d7ffff640 1 --2- 172.21.15.88:0/2668631642 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d88101a60 0x7f5d881968f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5d7800c8a0 tx=0x7f5d7800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:20.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:20.926+0000 7f5d7dffb640 1 -- 172.21.15.88:0/2668631642 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5d780079b0 con 0x7f5d88101a60 2024-09-17T04:25:20.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:20.926+0000 7f5d7dffb640 1 -- 172.21.15.88:0/2668631642 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5d78007b50 con 0x7f5d88101a60 2024-09-17T04:25:20.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:20.926+0000 7f5d7dffb640 1 -- 172.21.15.88:0/2668631642 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5d78018700 con 0x7f5d88101a60 2024-09-17T04:25:20.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:20.926+0000 7f5d8eb43640 1 -- 172.21.15.88:0/2668631642 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d8819b950 con 0x7f5d88101a60 2024-09-17T04:25:20.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:20.927+0000 7f5d8eb43640 1 -- 172.21.15.88:0/2668631642 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d8819beb0 con 0x7f5d88101a60 2024-09-17T04:25:20.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:20.928+0000 7f5d8eb43640 1 -- 172.21.15.88:0/2668631642 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d88100c60 con 0x7f5d88101a60 2024-09-17T04:25:20.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:20.928+0000 7f5d7dffb640 1 -- 172.21.15.88:0/2668631642 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f5d78007d00 con 0x7f5d88101a60 2024-09-17T04:25:20.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:20.929+0000 7f5d7dffb640 1 --2- 172.21.15.88:0/2668631642 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f5d7007af30 0x7f5d7007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:20.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:20.929+0000 7f5d8c8df640 1 --2- 172.21.15.88:0/2668631642 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f5d7007af30 0x7f5d7007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:20.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:20.929+0000 7f5d7dffb640 1 -- 172.21.15.88:0/2668631642 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6070+0+0 (secure 0 0 0) 0x7f5d7809e2c0 con 0x7f5d88101a60 2024-09-17T04:25:20.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:20.929+0000 7f5d8c8df640 1 --2- 172.21.15.88:0/2668631642 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f5d7007af30 0x7f5d7007d3f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5d84000c00 tx=0x7f5d84005a20 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:20.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:20.933+0000 7f5d7dffb640 1 -- 172.21.15.88:0/2668631642 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f5d78014030 con 0x7f5d88101a60 2024-09-17T04:25:21.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.125+0000 7f5d8eb43640 1 -- 172.21.15.88:0/2668631642 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5d88106030 con 0x7f5d7007af30 2024-09-17T04:25:21.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.127+0000 7f5d7dffb640 1 -- 172.21.15.88:0/2668631642 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f5d88106030 con 0x7f5d7007af30 2024-09-17T04:25:21.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.129+0000 7f5d8eb43640 1 -- 172.21.15.88:0/2668631642 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f5d7007af30 msgr2=0x7f5d7007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:21.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.129+0000 7f5d8eb43640 1 --2- 172.21.15.88:0/2668631642 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f5d7007af30 0x7f5d7007d3f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5d84000c00 tx=0x7f5d84005a20 comp rx=0 tx=0).stop 2024-09-17T04:25:21.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.129+0000 7f5d8eb43640 1 -- 172.21.15.88:0/2668631642 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d88101a60 msgr2=0x7f5d881968f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:21.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.129+0000 7f5d8eb43640 1 --2- 172.21.15.88:0/2668631642 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d88101a60 0x7f5d881968f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5d7800c8a0 tx=0x7f5d7800cd60 comp rx=0 tx=0).stop 2024-09-17T04:25:21.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.129+0000 7f5d8eb43640 1 -- 172.21.15.88:0/2668631642 shutdown_connections 2024-09-17T04:25:21.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.129+0000 7f5d8eb43640 1 --2- 172.21.15.88:0/2668631642 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f5d7007af30 0x7f5d7007d3f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:21.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.129+0000 7f5d8eb43640 1 --2- 172.21.15.88:0/2668631642 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d88101a60 0x7f5d881968f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:21.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.129+0000 7f5d8eb43640 1 --2- 172.21.15.88:0/2668631642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d88100860 0x7f5d881963b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:21.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.129+0000 7f5d8eb43640 1 -- 172.21.15.88:0/2668631642 >> 172.21.15.88:0/2668631642 conn(0x7f5d880fc010 msgr2=0x7f5d880fe210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:21.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.129+0000 7f5d8eb43640 1 -- 172.21.15.88:0/2668631642 shutdown_connections 2024-09-17T04:25:21.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.129+0000 7f5d8eb43640 1 -- 172.21.15.88:0/2668631642 wait complete. 2024-09-17T04:25:21.139 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-09-17T04:25:21.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.213+0000 7fce9c597640 1 -- 172.21.15.88:0/1441727596 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce94102bf0 msgr2=0x7fce94103070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:21.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.213+0000 7fce9c597640 1 --2- 172.21.15.88:0/1441727596 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce94102bf0 0x7fce94103070 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fce88009880 tx=0x7fce8802a4a0 comp rx=0 tx=0).stop 2024-09-17T04:25:21.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.214+0000 7fce9c597640 1 -- 172.21.15.88:0/1441727596 shutdown_connections 2024-09-17T04:25:21.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.214+0000 7fce9c597640 1 --2- 172.21.15.88:0/1441727596 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce94102bf0 0x7fce94103070 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:21.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.214+0000 7fce9c597640 1 --2- 172.21.15.88:0/1441727596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce940ffc10 0x7fce94100010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:21.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.214+0000 7fce9c597640 1 -- 172.21.15.88:0/1441727596 >> 172.21.15.88:0/1441727596 conn(0x7fce940fb760 msgr2=0x7fce940fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:21.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.214+0000 7fce9c597640 1 -- 172.21.15.88:0/1441727596 shutdown_connections 2024-09-17T04:25:21.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.214+0000 7fce9c597640 1 -- 172.21.15.88:0/1441727596 wait complete. 2024-09-17T04:25:21.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.214+0000 7fce9c597640 1 Processor -- start 2024-09-17T04:25:21.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.214+0000 7fce9c597640 1 -- start start 2024-09-17T04:25:21.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.215+0000 7fce9c597640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce940ffc10 0x7fce941974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:21.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.215+0000 7fce9c597640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce94102bf0 0x7fce94197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:21.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.215+0000 7fce9c597640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fce9410a790 con 0x7fce94102bf0 2024-09-17T04:25:21.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.215+0000 7fce9c597640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fce9410a610 con 0x7fce940ffc10 2024-09-17T04:25:21.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.215+0000 7fce99b32640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce94102bf0 0x7fce94197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:21.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.215+0000 7fce99b32640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce94102bf0 0x7fce94197a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54048/0 (socket says 172.21.15.88:54048) 2024-09-17T04:25:21.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.215+0000 7fce99b32640 1 -- 172.21.15.88:0/3915949922 learned_addr learned my addr 172.21.15.88:0/3915949922 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:25:21.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.215+0000 7fce9a333640 1 --2- 172.21.15.88:0/3915949922 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce940ffc10 0x7fce941974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:21.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.215+0000 7fce99b32640 1 -- 172.21.15.88:0/3915949922 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce940ffc10 msgr2=0x7fce941974c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:21.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.215+0000 7fce99b32640 1 --2- 172.21.15.88:0/3915949922 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce940ffc10 0x7fce941974c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:21.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.215+0000 7fce99b32640 1 -- 172.21.15.88:0/3915949922 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce94198080 con 0x7fce94102bf0 2024-09-17T04:25:21.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.215+0000 7fce9a333640 1 --2- 172.21.15.88:0/3915949922 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce940ffc10 0x7fce941974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:25:21.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.215+0000 7fce99b32640 1 --2- 172.21.15.88:0/3915949922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce94102bf0 0x7fce94197a00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fce88006010 tx=0x7fce880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:21.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.216+0000 7fce937fe640 1 -- 172.21.15.88:0/3915949922 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fce8803f070 con 0x7fce94102bf0 2024-09-17T04:25:21.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.216+0000 7fce937fe640 1 -- 172.21.15.88:0/3915949922 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fce88004ac0 con 0x7fce94102bf0 2024-09-17T04:25:21.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.216+0000 7fce9c597640 1 -- 172.21.15.88:0/3915949922 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce9419ca60 con 0x7fce94102bf0 2024-09-17T04:25:21.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.216+0000 7fce937fe640 1 -- 172.21.15.88:0/3915949922 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fce88035030 con 0x7fce94102bf0 2024-09-17T04:25:21.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.216+0000 7fce9c597640 1 -- 172.21.15.88:0/3915949922 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce9419cff0 con 0x7fce94102bf0 2024-09-17T04:25:21.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.217+0000 7fce9c597640 1 -- 172.21.15.88:0/3915949922 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce94100010 con 0x7fce94102bf0 2024-09-17T04:25:21.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.218+0000 7fce937fe640 1 -- 172.21.15.88:0/3915949922 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fce88042070 con 0x7fce94102bf0 2024-09-17T04:25:21.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.218+0000 7fce937fe640 1 --2- 172.21.15.88:0/3915949922 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fce7c07af80 0x7fce7c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:21.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.218+0000 7fce937fe640 1 -- 172.21.15.88:0/3915949922 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6070+0+0 (secure 0 0 0) 0x7fce880beb80 con 0x7fce94102bf0 2024-09-17T04:25:21.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.218+0000 7fce9a333640 1 --2- 172.21.15.88:0/3915949922 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fce7c07af80 0x7fce7c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:21.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.219+0000 7fce9a333640 1 --2- 172.21.15.88:0/3915949922 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fce7c07af80 0x7fce7c07d440 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fce94069aa0 tx=0x7fce84009400 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:21.225 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.224+0000 7fce937fe640 1 -- 172.21.15.88:0/3915949922 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fce8808a250 con 0x7fce94102bf0 2024-09-17T04:25:21.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.414+0000 7fce9c597640 1 -- 172.21.15.88:0/3915949922 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fce94062630 con 0x7fce7c07af80 2024-09-17T04:25:21.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.415+0000 7fce937fe640 1 -- 172.21.15.88:0/3915949922 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7fce94062630 con 0x7fce7c07af80 2024-09-17T04:25:21.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.417+0000 7fce9c597640 1 -- 172.21.15.88:0/3915949922 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fce7c07af80 msgr2=0x7fce7c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:21.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.417+0000 7fce9c597640 1 --2- 172.21.15.88:0/3915949922 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fce7c07af80 0x7fce7c07d440 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fce94069aa0 tx=0x7fce84009400 comp rx=0 tx=0).stop 2024-09-17T04:25:21.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.417+0000 7fce9c597640 1 -- 172.21.15.88:0/3915949922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce94102bf0 msgr2=0x7fce94197a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:21.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.417+0000 7fce9c597640 1 --2- 172.21.15.88:0/3915949922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce94102bf0 0x7fce94197a00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fce88006010 tx=0x7fce880046c0 comp rx=0 tx=0).stop 2024-09-17T04:25:21.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.417+0000 7fce9c597640 1 -- 172.21.15.88:0/3915949922 shutdown_connections 2024-09-17T04:25:21.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.417+0000 7fce9c597640 1 --2- 172.21.15.88:0/3915949922 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fce7c07af80 0x7fce7c07d440 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:21.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.417+0000 7fce9c597640 1 --2- 172.21.15.88:0/3915949922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce94102bf0 0x7fce94197a00 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:21.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.417+0000 7fce9c597640 1 --2- 172.21.15.88:0/3915949922 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce940ffc10 0x7fce941974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:21.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.417+0000 7fce9c597640 1 -- 172.21.15.88:0/3915949922 >> 172.21.15.88:0/3915949922 conn(0x7fce940fb760 msgr2=0x7fce94106150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:21.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.418+0000 7fce9c597640 1 -- 172.21.15.88:0/3915949922 shutdown_connections 2024-09-17T04:25:21.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.418+0000 7fce9c597640 1 -- 172.21.15.88:0/3915949922 wait complete. 2024-09-17T04:25:21.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.499+0000 7f5b94b14640 1 -- 172.21.15.88:0/3420689890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b90102b60 msgr2=0x7f5b90102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:21.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.499+0000 7f5b94b14640 1 --2- 172.21.15.88:0/3420689890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b90102b60 0x7f5b90102fe0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5b84009880 tx=0x7f5b8402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:25:21.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.499+0000 7f5b94b14640 1 -- 172.21.15.88:0/3420689890 shutdown_connections 2024-09-17T04:25:21.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.499+0000 7f5b94b14640 1 --2- 172.21.15.88:0/3420689890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b90102b60 0x7f5b90102fe0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:21.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.499+0000 7f5b94b14640 1 --2- 172.21.15.88:0/3420689890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b90101960 0x7f5b90101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:21.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.499+0000 7f5b94b14640 1 -- 172.21.15.88:0/3420689890 >> 172.21.15.88:0/3420689890 conn(0x7f5b900fd0f0 msgr2=0x7f5b900ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:21.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.499+0000 7f5b94b14640 1 -- 172.21.15.88:0/3420689890 shutdown_connections 2024-09-17T04:25:21.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.499+0000 7f5b94b14640 1 -- 172.21.15.88:0/3420689890 wait complete. 2024-09-17T04:25:21.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.500+0000 7f5b94b14640 1 Processor -- start 2024-09-17T04:25:21.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.500+0000 7f5b94b14640 1 -- start start 2024-09-17T04:25:21.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.501+0000 7f5b94b14640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b90101960 0x7f5b90197470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:21.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.501+0000 7f5b94b14640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b90102b60 0x7f5b901979b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:21.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.501+0000 7f5b94b14640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9010a780 con 0x7f5b90101960 2024-09-17T04:25:21.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.501+0000 7f5b94b14640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9010a600 con 0x7f5b90102b60 2024-09-17T04:25:21.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.501+0000 7f5b8e59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b90101960 0x7f5b90197470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:21.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.501+0000 7f5b8e59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b90101960 0x7f5b90197470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54062/0 (socket says 172.21.15.88:54062) 2024-09-17T04:25:21.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.501+0000 7f5b8e59c640 1 -- 172.21.15.88:0/1466426024 learned_addr learned my addr 172.21.15.88:0/1466426024 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:25:21.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.501+0000 7f5b8dd9b640 1 --2- 172.21.15.88:0/1466426024 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b90102b60 0x7f5b901979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:21.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.501+0000 7f5b8e59c640 1 -- 172.21.15.88:0/1466426024 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b90102b60 msgr2=0x7f5b901979b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:21.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.501+0000 7f5b8e59c640 1 --2- 172.21.15.88:0/1466426024 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b90102b60 0x7f5b901979b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:21.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.501+0000 7f5b8e59c640 1 -- 172.21.15.88:0/1466426024 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b90198030 con 0x7f5b90101960 2024-09-17T04:25:21.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.501+0000 7f5b8e59c640 1 --2- 172.21.15.88:0/1466426024 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b90101960 0x7f5b90197470 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5b8000e940 tx=0x7f5b8000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:21.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.505+0000 7f5b7f7fe640 1 -- 172.21.15.88:0/1466426024 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5b8000cac0 con 0x7f5b90101960 2024-09-17T04:25:21.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.505+0000 7f5b7f7fe640 1 -- 172.21.15.88:0/1466426024 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5b8000cc60 con 0x7f5b90101960 2024-09-17T04:25:21.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.505+0000 7f5b7f7fe640 1 -- 172.21.15.88:0/1466426024 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5b80003de0 con 0x7f5b90101960 2024-09-17T04:25:21.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.505+0000 7f5b94b14640 1 -- 172.21.15.88:0/1466426024 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b9019ca70 con 0x7f5b90101960 2024-09-17T04:25:21.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.505+0000 7f5b94b14640 1 -- 172.21.15.88:0/1466426024 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b9019cfd0 con 0x7f5b90101960 2024-09-17T04:25:21.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.506+0000 7f5b94b14640 1 -- 172.21.15.88:0/1466426024 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b90101d60 con 0x7f5b90101960 2024-09-17T04:25:21.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.506+0000 7f5b7f7fe640 1 -- 172.21.15.88:0/1466426024 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f5b80003fe0 con 0x7f5b90101960 2024-09-17T04:25:21.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.507+0000 7f5b7f7fe640 1 --2- 172.21.15.88:0/1466426024 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f5b7807af80 0x7f5b7807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:21.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.507+0000 7f5b7f7fe640 1 -- 172.21.15.88:0/1466426024 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6070+0+0 (secure 0 0 0) 0x7f5b8009e5d0 con 0x7f5b90101960 2024-09-17T04:25:21.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.507+0000 7f5b8dd9b640 1 --2- 172.21.15.88:0/1466426024 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f5b7807af80 0x7f5b7807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:21.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.508+0000 7f5b8dd9b640 1 --2- 172.21.15.88:0/1466426024 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f5b7807af80 0x7f5b7807d440 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5b84000c00 tx=0x7f5b840058d0 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:21.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.512+0000 7f5b7f7fe640 1 -- 172.21.15.88:0/1466426024 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f5b80069ca0 con 0x7f5b90101960 2024-09-17T04:25:21.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.697+0000 7f5b94b14640 1 -- 172.21.15.88:0/1466426024 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f5b9002c640 con 0x7f5b7807af80 2024-09-17T04:25:21.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.707+0000 7f5b7f7fe640 1 -- 172.21.15.88:0/1466426024 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f5b9002c640 con 0x7f5b7807af80 2024-09-17T04:25:21.708 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T04:25:21.708 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (10m) 10s ago 12m 25.4M - 0.25.0 c8568f914cd2 f2dbac7e939f 2024-09-17T04:25:21.708 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi088 smithi088 running (4m) 10s ago 12m 8678k - 19.1.1-330-gc2ddf972 ebb0615149de 683e1826a1a5 2024-09-17T04:25:21.708 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi134 smithi134 running (3m) 103s ago 11m 8426k - 19.1.1-330-gc2ddf972 ebb0615149de 83afa4200c0e 2024-09-17T04:25:21.708 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (111s) 10s ago 12m 6891k - 19.3.0-4989-gce1b342b 8e039cb7fe1e 10355648c406 2024-09-17T04:25:21.708 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi134 smithi134 running (106s) 103s ago 11m 6899k - 19.3.0-4989-gce1b342b 8e039cb7fe1e d709085ffe5d 2024-09-17T04:25:21.708 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (10m) 10s ago 12m 79.3M - 9.4.12 2bacad6d85d8 a6cff57a23f9 2024-09-17T04:25:21.708 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.giqrgt smithi088 running (7m) 10s ago 7m 148M - 19.1.1-330-gc2ddf972 ebb0615149de f724660799a1 2024-09-17T04:25:21.708 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.lgavsv smithi088 running (7m) 10s ago 7m 16.2M - 19.1.1-330-gc2ddf972 ebb0615149de 6cc0fe8a6aa9 2024-09-17T04:25:21.709 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi134.ktuhce smithi134 running (7m) 103s ago 7m 15.0M - 19.1.1-330-gc2ddf972 ebb0615149de 7ff5b70ca9cb 2024-09-17T04:25:21.709 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi134.psnynp smithi134 running (6m) 103s ago 6m 90.6M - 19.1.1-330-gc2ddf972 ebb0615149de 5326974fa3dd 2024-09-17T04:25:21.709 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.wmndiv smithi088 *:8443,9283,8765 running (3m) 10s ago 13m 584M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 49eb47f7f14f 2024-09-17T04:25:21.709 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi134.vwdxcb smithi134 *:8443,9283,8765 running (2m) 103s ago 11m 520M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 8a6d45eb0595 2024-09-17T04:25:21.709 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (2m) 10s ago 13m 112M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e ac6332015243 2024-09-17T04:25:21.709 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi134 smithi134 running (2m) 103s ago 11m 91.9M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e ea49f690e26b 2024-09-17T04:25:21.709 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (12m) 10s ago 12m 16.4M - 1.5.0 0da6a335fe13 9ba03800993b 2024-09-17T04:25:21.710 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi134 smithi134 *:9100 running (11m) 103s ago 11m 17.1M - 1.5.0 0da6a335fe13 6deac483827f 2024-09-17T04:25:21.710 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (86s) 10s ago 10m 155M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 4ef267302248 2024-09-17T04:25:21.710 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (50s) 10s ago 9m 153M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 17b67c13c7aa 2024-09-17T04:25:21.710 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (16s) 10s ago 9m 79.4M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 83d38ad792c9 2024-09-17T04:25:21.710 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi134 running (9m) 103s ago 8m 233M 2240M 19.1.1-330-gc2ddf972 ebb0615149de ebd528c3ce1b 2024-09-17T04:25:21.710 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi134 running (8m) 103s ago 8m 208M 2240M 19.1.1-330-gc2ddf972 ebb0615149de eacc25537b3a 2024-09-17T04:25:21.710 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi134 running (8m) 103s ago 8m 185M 2240M 19.1.1-330-gc2ddf972 ebb0615149de bc1b434a92a8 2024-09-17T04:25:21.710 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (2m) 10s ago 12m 66.9M - 2.43.0 a07b618ecd1d b51d7899d341 2024-09-17T04:25:21.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.709+0000 7f5b94b14640 1 -- 172.21.15.88:0/1466426024 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f5b7807af80 msgr2=0x7f5b7807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:21.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.709+0000 7f5b94b14640 1 --2- 172.21.15.88:0/1466426024 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f5b7807af80 0x7f5b7807d440 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5b84000c00 tx=0x7f5b840058d0 comp rx=0 tx=0).stop 2024-09-17T04:25:21.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.709+0000 7f5b94b14640 1 -- 172.21.15.88:0/1466426024 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b90101960 msgr2=0x7f5b90197470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:21.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.709+0000 7f5b94b14640 1 --2- 172.21.15.88:0/1466426024 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b90101960 0x7f5b90197470 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5b8000e940 tx=0x7f5b8000ee00 comp rx=0 tx=0).stop 2024-09-17T04:25:21.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.709+0000 7f5b94b14640 1 -- 172.21.15.88:0/1466426024 shutdown_connections 2024-09-17T04:25:21.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.709+0000 7f5b94b14640 1 --2- 172.21.15.88:0/1466426024 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f5b7807af80 0x7f5b7807d440 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:21.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.709+0000 7f5b94b14640 1 --2- 172.21.15.88:0/1466426024 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b90102b60 0x7f5b901979b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:21.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.709+0000 7f5b94b14640 1 --2- 172.21.15.88:0/1466426024 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b90101960 0x7f5b90197470 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:21.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.709+0000 7f5b94b14640 1 -- 172.21.15.88:0/1466426024 >> 172.21.15.88:0/1466426024 conn(0x7f5b900fd0f0 msgr2=0x7f5b90106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:21.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.709+0000 7f5b94b14640 1 -- 172.21.15.88:0/1466426024 shutdown_connections 2024-09-17T04:25:21.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.709+0000 7f5b94b14640 1 -- 172.21.15.88:0/1466426024 wait complete. 2024-09-17T04:25:21.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.789+0000 7f2210695640 1 -- 172.21.15.88:0/3114627034 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2208101a60 msgr2=0x7f2208101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:21.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.789+0000 7f2210695640 1 --2- 172.21.15.88:0/3114627034 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2208101a60 0x7f2208101ee0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f21f8009880 tx=0x7f21f802a4a0 comp rx=0 tx=0).stop 2024-09-17T04:25:21.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.789+0000 7f2210695640 1 -- 172.21.15.88:0/3114627034 shutdown_connections 2024-09-17T04:25:21.791 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:21 smithi088 ceph-mon[90867]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:25:21.791 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:21 smithi088 ceph-mon[90867]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:25:21.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.789+0000 7f2210695640 1 --2- 172.21.15.88:0/3114627034 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2208101a60 0x7f2208101ee0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:21.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.789+0000 7f2210695640 1 --2- 172.21.15.88:0/3114627034 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2208100860 0x7f2208100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:21.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.789+0000 7f2210695640 1 -- 172.21.15.88:0/3114627034 >> 172.21.15.88:0/3114627034 conn(0x7f22080fc010 msgr2=0x7f22080fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:21.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.789+0000 7f2210695640 1 -- 172.21.15.88:0/3114627034 shutdown_connections 2024-09-17T04:25:21.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.789+0000 7f2210695640 1 -- 172.21.15.88:0/3114627034 wait complete. 2024-09-17T04:25:21.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.790+0000 7f2210695640 1 Processor -- start 2024-09-17T04:25:21.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.790+0000 7f2210695640 1 -- start start 2024-09-17T04:25:21.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.790+0000 7f2210695640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2208100860 0x7f2208104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:21.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.790+0000 7f2210695640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2208101a60 0x7f2208102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:21.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.790+0000 7f2210695640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f2208109720 con 0x7f2208101a60 2024-09-17T04:25:21.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.790+0000 7f2210695640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f22081095a0 con 0x7f2208100860 2024-09-17T04:25:21.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.790+0000 7f220dc30640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2208101a60 0x7f2208102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:21.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.790+0000 7f220dc30640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2208101a60 0x7f2208102e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54070/0 (socket says 172.21.15.88:54070) 2024-09-17T04:25:21.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.790+0000 7f220dc30640 1 -- 172.21.15.88:0/448503856 learned_addr learned my addr 172.21.15.88:0/448503856 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:25:21.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.790+0000 7f220e431640 1 --2- 172.21.15.88:0/448503856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2208100860 0x7f2208104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:21.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.790+0000 7f220dc30640 1 -- 172.21.15.88:0/448503856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2208100860 msgr2=0x7f2208104780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:21.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.790+0000 7f220dc30640 1 --2- 172.21.15.88:0/448503856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2208100860 0x7f2208104780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:21.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.790+0000 7f220dc30640 1 -- 172.21.15.88:0/448503856 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2208103380 con 0x7f2208101a60 2024-09-17T04:25:21.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.790+0000 7f220e431640 1 --2- 172.21.15.88:0/448503856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2208100860 0x7f2208104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:25:21.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.791+0000 7f220dc30640 1 --2- 172.21.15.88:0/448503856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2208101a60 0x7f2208102e40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f21f8006010 tx=0x7f21f80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:21.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.791+0000 7f21ff7fe640 1 -- 172.21.15.88:0/448503856 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f21f803f070 con 0x7f2208101a60 2024-09-17T04:25:21.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.791+0000 7f21ff7fe640 1 -- 172.21.15.88:0/448503856 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f21f80044d0 con 0x7f2208101a60 2024-09-17T04:25:21.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.791+0000 7f2210695640 1 -- 172.21.15.88:0/448503856 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2208103610 con 0x7f2208101a60 2024-09-17T04:25:21.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.791+0000 7f21ff7fe640 1 -- 172.21.15.88:0/448503856 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f21f8035030 con 0x7f2208101a60 2024-09-17T04:25:21.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.791+0000 7f2210695640 1 -- 172.21.15.88:0/448503856 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2208103bc0 con 0x7f2208101a60 2024-09-17T04:25:21.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.792+0000 7f2210695640 1 -- 172.21.15.88:0/448503856 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2208100c40 con 0x7f2208101a60 2024-09-17T04:25:21.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.793+0000 7f21ff7fe640 1 -- 172.21.15.88:0/448503856 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f21f8042070 con 0x7f2208101a60 2024-09-17T04:25:21.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.793+0000 7f21ff7fe640 1 --2- 172.21.15.88:0/448503856 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f21f407af30 0x7f21f407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:21.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.793+0000 7f21ff7fe640 1 -- 172.21.15.88:0/448503856 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6070+0+0 (secure 0 0 0) 0x7f21f80bed20 con 0x7f2208101a60 2024-09-17T04:25:21.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.793+0000 7f220e431640 1 --2- 172.21.15.88:0/448503856 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f21f407af30 0x7f21f407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:21.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.794+0000 7f220e431640 1 --2- 172.21.15.88:0/448503856 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f21f407af30 0x7f21f407d3f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f22081018c0 tx=0x7f2204008040 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:21.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:21.798+0000 7f21ff7fe640 1 -- 172.21.15.88:0/448503856 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f21f808a370 con 0x7f2208101a60 2024-09-17T04:25:21.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:21 smithi134 ceph-mon[76677]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:25:21.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:21 smithi134 ceph-mon[76677]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:25:22.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.040+0000 7f2210695640 1 -- 172.21.15.88:0/448503856 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f220819fbc0 con 0x7f2208101a60 2024-09-17T04:25:22.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.041+0000 7f21ff7fe640 1 -- 172.21.15.88:0/448503856 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7f21f808f220 con 0x7f2208101a60 2024-09-17T04:25:22.042 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-17T04:25:22.042 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-09-17T04:25:22.042 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T04:25:22.042 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:25:22.042 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-09-17T04:25:22.042 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T04:25:22.042 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:25:22.042 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-09-17T04:25:22.042 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 3, 2024-09-17T04:25:22.042 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 3 2024-09-17T04:25:22.043 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:25:22.043 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2024-09-17T04:25:22.043 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T04:25:22.043 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:25:22.043 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-09-17T04:25:22.043 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 7, 2024-09-17T04:25:22.043 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 7 2024-09-17T04:25:22.043 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-17T04:25:22.043 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-17T04:25:22.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.043+0000 7f2210695640 1 -- 172.21.15.88:0/448503856 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f21f407af30 msgr2=0x7f21f407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:22.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.043+0000 7f2210695640 1 --2- 172.21.15.88:0/448503856 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f21f407af30 0x7f21f407d3f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f22081018c0 tx=0x7f2204008040 comp rx=0 tx=0).stop 2024-09-17T04:25:22.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.043+0000 7f2210695640 1 -- 172.21.15.88:0/448503856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2208101a60 msgr2=0x7f2208102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:22.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.043+0000 7f2210695640 1 --2- 172.21.15.88:0/448503856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2208101a60 0x7f2208102e40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f21f8006010 tx=0x7f21f80048f0 comp rx=0 tx=0).stop 2024-09-17T04:25:22.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.043+0000 7f2210695640 1 -- 172.21.15.88:0/448503856 shutdown_connections 2024-09-17T04:25:22.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.043+0000 7f2210695640 1 --2- 172.21.15.88:0/448503856 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f21f407af30 0x7f21f407d3f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:22.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.043+0000 7f2210695640 1 --2- 172.21.15.88:0/448503856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2208101a60 0x7f2208102e40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:22.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.043+0000 7f2210695640 1 --2- 172.21.15.88:0/448503856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2208100860 0x7f2208104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:22.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.043+0000 7f2210695640 1 -- 172.21.15.88:0/448503856 >> 172.21.15.88:0/448503856 conn(0x7f22080fc010 msgr2=0x7f2208069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:22.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.043+0000 7f2210695640 1 -- 172.21.15.88:0/448503856 shutdown_connections 2024-09-17T04:25:22.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.043+0000 7f2210695640 1 -- 172.21.15.88:0/448503856 wait complete. 2024-09-17T04:25:22.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.124+0000 7f59b670c640 1 -- 172.21.15.88:0/1763222849 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59b0101a60 msgr2=0x7f59b0101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:22.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.124+0000 7f59b670c640 1 --2- 172.21.15.88:0/1763222849 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59b0101a60 0x7f59b0101ee0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f59a4009880 tx=0x7f59a402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:25:22.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.124+0000 7f59b670c640 1 -- 172.21.15.88:0/1763222849 shutdown_connections 2024-09-17T04:25:22.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.124+0000 7f59b670c640 1 --2- 172.21.15.88:0/1763222849 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59b0101a60 0x7f59b0101ee0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:22.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.124+0000 7f59b670c640 1 --2- 172.21.15.88:0/1763222849 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59b0100860 0x7f59b0100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:22.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.124+0000 7f59b670c640 1 -- 172.21.15.88:0/1763222849 >> 172.21.15.88:0/1763222849 conn(0x7f59b00fc010 msgr2=0x7f59b00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:22.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.124+0000 7f59b670c640 1 -- 172.21.15.88:0/1763222849 shutdown_connections 2024-09-17T04:25:22.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.124+0000 7f59b670c640 1 -- 172.21.15.88:0/1763222849 wait complete. 2024-09-17T04:25:22.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.124+0000 7f59b670c640 1 Processor -- start 2024-09-17T04:25:22.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.125+0000 7f59b670c640 1 -- start start 2024-09-17T04:25:22.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.125+0000 7f59b670c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59b0100860 0x7f59b0197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:22.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.125+0000 7f59b670c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59b0101a60 0x7f59b0197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:22.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.125+0000 7f59b670c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f59b01096a0 con 0x7f59b0100860 2024-09-17T04:25:22.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.125+0000 7f59b670c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f59b0109520 con 0x7f59b0101a60 2024-09-17T04:25:22.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.125+0000 7f59affff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59b0100860 0x7f59b0197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:22.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.125+0000 7f59affff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59b0100860 0x7f59b0197500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54090/0 (socket says 172.21.15.88:54090) 2024-09-17T04:25:22.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.125+0000 7f59affff640 1 -- 172.21.15.88:0/2929674937 learned_addr learned my addr 172.21.15.88:0/2929674937 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:25:22.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.125+0000 7f59af7fe640 1 --2- 172.21.15.88:0/2929674937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59b0101a60 0x7f59b0197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:22.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.125+0000 7f59affff640 1 -- 172.21.15.88:0/2929674937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59b0101a60 msgr2=0x7f59b0197a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:22.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.125+0000 7f59affff640 1 --2- 172.21.15.88:0/2929674937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59b0101a60 0x7f59b0197a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:22.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.125+0000 7f59affff640 1 -- 172.21.15.88:0/2929674937 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59b01980c0 con 0x7f59b0100860 2024-09-17T04:25:22.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.126+0000 7f59affff640 1 --2- 172.21.15.88:0/2929674937 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59b0100860 0x7f59b0197500 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f59a000d8d0 tx=0x7f59a000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:22.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.126+0000 7f59ad7fa640 1 -- 172.21.15.88:0/2929674937 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f59a0017070 con 0x7f59b0100860 2024-09-17T04:25:22.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.126+0000 7f59ad7fa640 1 -- 172.21.15.88:0/2929674937 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f59a000be10 con 0x7f59b0100860 2024-09-17T04:25:22.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.126+0000 7f59b670c640 1 -- 172.21.15.88:0/2929674937 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59b019cb00 con 0x7f59b0100860 2024-09-17T04:25:22.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.126+0000 7f59ad7fa640 1 -- 172.21.15.88:0/2929674937 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f59a000f3c0 con 0x7f59b0100860 2024-09-17T04:25:22.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.126+0000 7f59b670c640 1 -- 172.21.15.88:0/2929674937 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59b019d090 con 0x7f59b0100860 2024-09-17T04:25:22.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.127+0000 7f59b670c640 1 -- 172.21.15.88:0/2929674937 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59b0100c60 con 0x7f59b0100860 2024-09-17T04:25:22.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.128+0000 7f59ad7fa640 1 -- 172.21.15.88:0/2929674937 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f59a001a070 con 0x7f59b0100860 2024-09-17T04:25:22.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.128+0000 7f59ad7fa640 1 --2- 172.21.15.88:0/2929674937 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f599807af30 0x7f599807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:22.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.128+0000 7f59ad7fa640 1 -- 172.21.15.88:0/2929674937 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6070+0+0 (secure 0 0 0) 0x7f59a009dc80 con 0x7f59b0100860 2024-09-17T04:25:22.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.128+0000 7f59af7fe640 1 --2- 172.21.15.88:0/2929674937 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f599807af30 0x7f599807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:22.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.129+0000 7f59af7fe640 1 --2- 172.21.15.88:0/2929674937 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f599807af30 0x7f599807d3f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f59b01989b0 tx=0x7f59a4005a20 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:22.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.133+0000 7f59ad7fa640 1 -- 172.21.15.88:0/2929674937 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f59a00a3020 con 0x7f59b0100860 2024-09-17T04:25:22.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.342+0000 7f59b670c640 1 -- 172.21.15.88:0/2929674937 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f59b019da00 con 0x7f59b0100860 2024-09-17T04:25:22.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.343+0000 7f59ad7fa640 1 -- 172.21.15.88:0/2929674937 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) ==== 76+0+2045 (secure 0 0 0) 0x7f59a0069270 con 0x7f59b0100860 2024-09-17T04:25:22.344 INFO:teuthology.orchestra.run.smithi088.stdout:e15 2024-09-17T04:25:22.344 INFO:teuthology.orchestra.run.smithi088.stdout:btime 2024-09-17T04:18:27:750910+0000 2024-09-17T04:25:22.344 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T04:25:22.344 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:25:22.344 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2024-09-17T04:25:22.344 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:25:22.344 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2024-09-17T04:25:22.344 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2024-09-17T04:25:22.344 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 15 2024-09-17T04:25:22.345 INFO:teuthology.orchestra.run.smithi088.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T04:25:22.345 INFO:teuthology.orchestra.run.smithi088.stdout:created 2024-09-17T04:18:10.480573+0000 2024-09-17T04:25:22.345 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2024-09-17T04:18:27.750896+0000 2024-09-17T04:25:22.345 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2024-09-17T04:25:22.345 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2024-09-17T04:25:22.345 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2024-09-17T04:25:22.345 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2024-09-17T04:25:22.345 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2024-09-17T04:25:22.345 INFO:teuthology.orchestra.run.smithi088.stdout:max_xattr_size 65536 2024-09-17T04:25:22.345 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2024-09-17T04:25:22.345 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2024-09-17T04:25:22.345 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 45 2024-09-17T04:25:22.345 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:25:22.345 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 1 2024-09-17T04:25:22.346 INFO:teuthology.orchestra.run.smithi088.stdout:in 0 2024-09-17T04:25:22.346 INFO:teuthology.orchestra.run.smithi088.stdout:up {0=14590} 2024-09-17T04:25:22.346 INFO:teuthology.orchestra.run.smithi088.stdout:failed 2024-09-17T04:25:22.346 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2024-09-17T04:25:22.346 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2024-09-17T04:25:22.346 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2024-09-17T04:25:22.346 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2024-09-17T04:25:22.346 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data enabled 2024-09-17T04:25:22.346 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2024-09-17T04:25:22.346 INFO:teuthology.orchestra.run.smithi088.stdout:bal_rank_mask -1 2024-09-17T04:25:22.346 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 1 2024-09-17T04:25:22.346 INFO:teuthology.orchestra.run.smithi088.stdout:qdb_cluster leader: 14590 members: 14590 2024-09-17T04:25:22.346 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.giqrgt{0:14590} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.88:6828/1714846518,v1:172.21.15.88:6829/1714846518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:25:22.346 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi134.psnynp{0:24321} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.134:6826/2137586894,v1:172.21.15.134:6827/2137586894] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:25:22.347 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:25:22.347 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:25:22.347 INFO:teuthology.orchestra.run.smithi088.stdout:Standby daemons: 2024-09-17T04:25:22.347 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:25:22.347 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi134.ktuhce{-1:24325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/967997022,v1:172.21.15.134:6825/967997022] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:25:22.347 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.lgavsv{-1:24329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/1425146180,v1:172.21.15.88:6827/1425146180] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:25:22.348 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 15 2024-09-17T04:25:22.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.345+0000 7f59b670c640 1 -- 172.21.15.88:0/2929674937 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f599807af30 msgr2=0x7f599807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:22.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.345+0000 7f59b670c640 1 --2- 172.21.15.88:0/2929674937 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f599807af30 0x7f599807d3f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f59b01989b0 tx=0x7f59a4005a20 comp rx=0 tx=0).stop 2024-09-17T04:25:22.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.345+0000 7f59b670c640 1 -- 172.21.15.88:0/2929674937 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59b0100860 msgr2=0x7f59b0197500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:22.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.345+0000 7f59b670c640 1 --2- 172.21.15.88:0/2929674937 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59b0100860 0x7f59b0197500 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f59a000d8d0 tx=0x7f59a000dd90 comp rx=0 tx=0).stop 2024-09-17T04:25:22.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.345+0000 7f59b670c640 1 -- 172.21.15.88:0/2929674937 shutdown_connections 2024-09-17T04:25:22.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.345+0000 7f59b670c640 1 --2- 172.21.15.88:0/2929674937 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f599807af30 0x7f599807d3f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:22.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.345+0000 7f59b670c640 1 --2- 172.21.15.88:0/2929674937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59b0101a60 0x7f59b0197a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:22.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.345+0000 7f59b670c640 1 --2- 172.21.15.88:0/2929674937 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59b0100860 0x7f59b0197500 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:22.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.345+0000 7f59b670c640 1 -- 172.21.15.88:0/2929674937 >> 172.21.15.88:0/2929674937 conn(0x7f59b00fc010 msgr2=0x7f59b006a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:22.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.346+0000 7f59b670c640 1 -- 172.21.15.88:0/2929674937 shutdown_connections 2024-09-17T04:25:22.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.346+0000 7f59b670c640 1 -- 172.21.15.88:0/2929674937 wait complete. 2024-09-17T04:25:22.431 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.429+0000 7f9f0ddac640 1 -- 172.21.15.88:0/3649580507 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f08101a60 msgr2=0x7f9f08101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:22.431 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.429+0000 7f9f0ddac640 1 --2- 172.21.15.88:0/3649580507 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f08101a60 0x7f9f08101ee0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9efc009880 tx=0x7f9efc02a4a0 comp rx=0 tx=0).stop 2024-09-17T04:25:22.431 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.430+0000 7f9f0ddac640 1 -- 172.21.15.88:0/3649580507 shutdown_connections 2024-09-17T04:25:22.431 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.430+0000 7f9f0ddac640 1 --2- 172.21.15.88:0/3649580507 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f08101a60 0x7f9f08101ee0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:22.431 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.430+0000 7f9f0ddac640 1 --2- 172.21.15.88:0/3649580507 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f08100860 0x7f9f08100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:22.431 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.430+0000 7f9f0ddac640 1 -- 172.21.15.88:0/3649580507 >> 172.21.15.88:0/3649580507 conn(0x7f9f080fc010 msgr2=0x7f9f080fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:22.431 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.430+0000 7f9f0ddac640 1 -- 172.21.15.88:0/3649580507 shutdown_connections 2024-09-17T04:25:22.431 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.430+0000 7f9f0ddac640 1 -- 172.21.15.88:0/3649580507 wait complete. 2024-09-17T04:25:22.431 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.430+0000 7f9f0ddac640 1 Processor -- start 2024-09-17T04:25:22.432 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.430+0000 7f9f0ddac640 1 -- start start 2024-09-17T04:25:22.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.431+0000 7f9f0ddac640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f08100860 0x7f9f0806a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:22.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.431+0000 7f9f0ddac640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f08101a60 0x7f9f0819c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:22.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.431+0000 7f9f0ddac640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f9f08109680 con 0x7f9f08100860 2024-09-17T04:25:22.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.431+0000 7f9f0ddac640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9f08109500 con 0x7f9f08101a60 2024-09-17T04:25:22.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.431+0000 7f9f077fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f08100860 0x7f9f0806a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:22.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.431+0000 7f9f077fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f08100860 0x7f9f0806a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37572/0 (socket says 172.21.15.88:37572) 2024-09-17T04:25:22.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.431+0000 7f9f077fe640 1 -- 172.21.15.88:0/1768678574 learned_addr learned my addr 172.21.15.88:0/1768678574 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:25:22.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.431+0000 7f9f06ffd640 1 --2- 172.21.15.88:0/1768678574 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f08101a60 0x7f9f0819c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:22.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.431+0000 7f9f077fe640 1 -- 172.21.15.88:0/1768678574 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f08101a60 msgr2=0x7f9f0819c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:22.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.431+0000 7f9f077fe640 1 --2- 172.21.15.88:0/1768678574 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f08101a60 0x7f9f0819c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:22.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.431+0000 7f9f077fe640 1 -- 172.21.15.88:0/1768678574 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f0819c7d0 con 0x7f9f08100860 2024-09-17T04:25:22.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.431+0000 7f9f077fe640 1 --2- 172.21.15.88:0/1768678574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f08100860 0x7f9f0806a7d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8009fd0 tx=0x7f9ef800ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:22.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.431+0000 7f9f04ff9640 1 -- 172.21.15.88:0/1768678574 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9ef800cc40 con 0x7f9f08100860 2024-09-17T04:25:22.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.431+0000 7f9f0ddac640 1 -- 172.21.15.88:0/1768678574 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f0819cac0 con 0x7f9f08100860 2024-09-17T04:25:22.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.431+0000 7f9f04ff9640 1 -- 172.21.15.88:0/1768678574 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9ef800cde0 con 0x7f9f08100860 2024-09-17T04:25:22.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.431+0000 7f9f04ff9640 1 -- 172.21.15.88:0/1768678574 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9ef801a9d0 con 0x7f9f08100860 2024-09-17T04:25:22.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.431+0000 7f9f0ddac640 1 -- 172.21.15.88:0/1768678574 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f0819d050 con 0x7f9f08100860 2024-09-17T04:25:22.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.433+0000 7f9f0ddac640 1 -- 172.21.15.88:0/1768678574 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f08100c60 con 0x7f9f08100860 2024-09-17T04:25:22.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.433+0000 7f9f04ff9640 1 -- 172.21.15.88:0/1768678574 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f9ef801ab70 con 0x7f9f08100860 2024-09-17T04:25:22.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.433+0000 7f9f04ff9640 1 --2- 172.21.15.88:0/1768678574 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f9ef007af30 0x7f9ef007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:22.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.434+0000 7f9f04ff9640 1 -- 172.21.15.88:0/1768678574 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6070+0+0 (secure 0 0 0) 0x7f9ef809e8a0 con 0x7f9f08100860 2024-09-17T04:25:22.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.434+0000 7f9f06ffd640 1 --2- 172.21.15.88:0/1768678574 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f9ef007af30 0x7f9ef007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:22.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.434+0000 7f9f06ffd640 1 --2- 172.21.15.88:0/1768678574 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f9ef007af30 0x7f9ef007d3f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9f0806a550 tx=0x7f9efc005a20 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:22.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.438+0000 7f9f04ff9640 1 -- 172.21.15.88:0/1768678574 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f9ef8016030 con 0x7f9f08100860 2024-09-17T04:25:22.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.630+0000 7f9f0ddac640 1 -- 172.21.15.88:0/1768678574 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9f08062630 con 0x7f9ef007af30 2024-09-17T04:25:22.631 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:22 smithi088 ceph-mon[90867]: from='client.34204 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:25:22.631 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:22 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/448503856' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:25:22.631 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:22 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/2929674937' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T04:25:22.631 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:22 smithi088 ceph-mon[90867]: pgmap v114: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-17T04:25:22.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.631+0000 7f9f04ff9640 1 -- 172.21.15.88:0/1768678574 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f9f08062630 con 0x7f9ef007af30 2024-09-17T04:25:22.632 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-17T04:25:22.632 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f", 2024-09-17T04:25:22.632 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-09-17T04:25:22.633 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T04:25:22.633 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [ 2024-09-17T04:25:22.633 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr", 2024-09-17T04:25:22.633 INFO:teuthology.orchestra.run.smithi088.stdout: "mon", 2024-09-17T04:25:22.633 INFO:teuthology.orchestra.run.smithi088.stdout: "crash" 2024-09-17T04:25:22.633 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-17T04:25:22.633 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "9/23 daemons upgraded", 2024-09-17T04:25:22.633 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading osd daemons", 2024-09-17T04:25:22.633 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-09-17T04:25:22.633 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-17T04:25:22.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.634+0000 7f9f0ddac640 1 -- 172.21.15.88:0/1768678574 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f9ef007af30 msgr2=0x7f9ef007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:22.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.634+0000 7f9f0ddac640 1 --2- 172.21.15.88:0/1768678574 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f9ef007af30 0x7f9ef007d3f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9f0806a550 tx=0x7f9efc005a20 comp rx=0 tx=0).stop 2024-09-17T04:25:22.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.634+0000 7f9f0ddac640 1 -- 172.21.15.88:0/1768678574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f08100860 msgr2=0x7f9f0806a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:22.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.634+0000 7f9f0ddac640 1 --2- 172.21.15.88:0/1768678574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f08100860 0x7f9f0806a7d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8009fd0 tx=0x7f9ef800ef40 comp rx=0 tx=0).stop 2024-09-17T04:25:22.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.634+0000 7f9f0ddac640 1 -- 172.21.15.88:0/1768678574 shutdown_connections 2024-09-17T04:25:22.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.634+0000 7f9f0ddac640 1 --2- 172.21.15.88:0/1768678574 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f9ef007af30 0x7f9ef007d3f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:22.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.634+0000 7f9f0ddac640 1 --2- 172.21.15.88:0/1768678574 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f08101a60 0x7f9f0819c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:22.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.634+0000 7f9f0ddac640 1 --2- 172.21.15.88:0/1768678574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f08100860 0x7f9f0806a7d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:22.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.634+0000 7f9f0ddac640 1 -- 172.21.15.88:0/1768678574 >> 172.21.15.88:0/1768678574 conn(0x7f9f080fc010 msgr2=0x7f9f08104f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:22.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.634+0000 7f9f0ddac640 1 -- 172.21.15.88:0/1768678574 shutdown_connections 2024-09-17T04:25:22.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.634+0000 7f9f0ddac640 1 -- 172.21.15.88:0/1768678574 wait complete. 2024-09-17T04:25:22.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.715+0000 7f71177f7640 1 -- 172.21.15.88:0/2006511666 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71100ffc20 msgr2=0x7f7110100020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:22.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.715+0000 7f71177f7640 1 --2- 172.21.15.88:0/2006511666 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71100ffc20 0x7f7110100020 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f710c009880 tx=0x7f710c02a4a0 comp rx=0 tx=0).stop 2024-09-17T04:25:22.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.715+0000 7f71177f7640 1 -- 172.21.15.88:0/2006511666 shutdown_connections 2024-09-17T04:25:22.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.715+0000 7f71177f7640 1 --2- 172.21.15.88:0/2006511666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7110102c00 0x7f7110103080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:22.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.715+0000 7f71177f7640 1 --2- 172.21.15.88:0/2006511666 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71100ffc20 0x7f7110100020 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:22.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.715+0000 7f71177f7640 1 -- 172.21.15.88:0/2006511666 >> 172.21.15.88:0/2006511666 conn(0x7f71100fb770 msgr2=0x7f71100fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:22.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.716+0000 7f71177f7640 1 -- 172.21.15.88:0/2006511666 shutdown_connections 2024-09-17T04:25:22.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.716+0000 7f71177f7640 1 -- 172.21.15.88:0/2006511666 wait complete. 2024-09-17T04:25:22.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.716+0000 7f71177f7640 1 Processor -- start 2024-09-17T04:25:22.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.716+0000 7f71177f7640 1 -- start start 2024-09-17T04:25:22.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.716+0000 7f71177f7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71100ffc20 0x7f7110197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:22.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.716+0000 7f71177f7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7110102c00 0x7f7110197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:22.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.716+0000 7f71177f7640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f711010a800 con 0x7f7110102c00 2024-09-17T04:25:22.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.716+0000 7f71177f7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f711010a680 con 0x7f71100ffc20 2024-09-17T04:25:22.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.717+0000 7f7114d92640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7110102c00 0x7f7110197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:22.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.717+0000 7f7114d92640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7110102c00 0x7f7110197a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37600/0 (socket says 172.21.15.88:37600) 2024-09-17T04:25:22.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.717+0000 7f7114d92640 1 -- 172.21.15.88:0/1211963222 learned_addr learned my addr 172.21.15.88:0/1211963222 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:25:22.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.717+0000 7f7115593640 1 --2- 172.21.15.88:0/1211963222 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71100ffc20 0x7f7110197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:22.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.717+0000 7f7114d92640 1 -- 172.21.15.88:0/1211963222 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71100ffc20 msgr2=0x7f7110197530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:22.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.717+0000 7f7114d92640 1 --2- 172.21.15.88:0/1211963222 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71100ffc20 0x7f7110197530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:22.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.717+0000 7f7114d92640 1 -- 172.21.15.88:0/1211963222 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71101980f0 con 0x7f7110102c00 2024-09-17T04:25:22.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.717+0000 7f7114d92640 1 --2- 172.21.15.88:0/1211963222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7110102c00 0x7f7110197a70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f710000b420 tx=0x7f710000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:22.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.717+0000 7f71067fc640 1 -- 172.21.15.88:0/1211963222 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7100011630 con 0x7f7110102c00 2024-09-17T04:25:22.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.717+0000 7f71067fc640 1 -- 172.21.15.88:0/1211963222 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7100016070 con 0x7f7110102c00 2024-09-17T04:25:22.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.717+0000 7f71177f7640 1 -- 172.21.15.88:0/1211963222 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f711019cb30 con 0x7f7110102c00 2024-09-17T04:25:22.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.717+0000 7f71067fc640 1 -- 172.21.15.88:0/1211963222 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7100010d40 con 0x7f7110102c00 2024-09-17T04:25:22.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.717+0000 7f71177f7640 1 -- 172.21.15.88:0/1211963222 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f711019d140 con 0x7f7110102c00 2024-09-17T04:25:22.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.718+0000 7f71177f7640 1 -- 172.21.15.88:0/1211963222 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7110100020 con 0x7f7110102c00 2024-09-17T04:25:22.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.719+0000 7f71067fc640 1 -- 172.21.15.88:0/1211963222 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f710001b460 con 0x7f7110102c00 2024-09-17T04:25:22.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.719+0000 7f71067fc640 1 --2- 172.21.15.88:0/1211963222 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f70fc07af30 0x7f70fc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:22.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.719+0000 7f71067fc640 1 -- 172.21.15.88:0/1211963222 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6070+0+0 (secure 0 0 0) 0x7f710009d760 con 0x7f7110102c00 2024-09-17T04:25:22.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.719+0000 7f7115593640 1 --2- 172.21.15.88:0/1211963222 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f70fc07af30 0x7f70fc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:22.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.720+0000 7f7115593640 1 --2- 172.21.15.88:0/1211963222 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f70fc07af30 0x7f70fc07d3f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f710c000c00 tx=0x7f710c005a20 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:22.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.724+0000 7f71067fc640 1 -- 172.21.15.88:0/1211963222 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f7100068db0 con 0x7f7110102c00 2024-09-17T04:25:22.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:22 smithi134 ceph-mon[76677]: from='client.34204 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:25:22.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:22 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/448503856' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:25:22.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:22 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/2929674937' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T04:25:22.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:22 smithi134 ceph-mon[76677]: pgmap v114: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-17T04:25:22.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.968+0000 7f71177f7640 1 -- 172.21.15.88:0/1211963222 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f7110062df0 con 0x7f7110102c00 2024-09-17T04:25:22.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.968+0000 7f71067fc640 1 -- 172.21.15.88:0/1211963222 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f710006dc60 con 0x7f7110102c00 2024-09-17T04:25:22.969 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T04:25:22.969 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T04:25:22.969 INFO:teuthology.orchestra.run.smithi088.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T04:25:22.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.970+0000 7f71177f7640 1 -- 172.21.15.88:0/1211963222 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f70fc07af30 msgr2=0x7f70fc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:22.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.970+0000 7f71177f7640 1 --2- 172.21.15.88:0/1211963222 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f70fc07af30 0x7f70fc07d3f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f710c000c00 tx=0x7f710c005a20 comp rx=0 tx=0).stop 2024-09-17T04:25:22.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.970+0000 7f71177f7640 1 -- 172.21.15.88:0/1211963222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7110102c00 msgr2=0x7f7110197a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:22.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.970+0000 7f71177f7640 1 --2- 172.21.15.88:0/1211963222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7110102c00 0x7f7110197a70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f710000b420 tx=0x7f710000b8e0 comp rx=0 tx=0).stop 2024-09-17T04:25:22.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.970+0000 7f71177f7640 1 -- 172.21.15.88:0/1211963222 shutdown_connections 2024-09-17T04:25:22.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.970+0000 7f71177f7640 1 --2- 172.21.15.88:0/1211963222 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f70fc07af30 0x7f70fc07d3f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:22.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.970+0000 7f71177f7640 1 --2- 172.21.15.88:0/1211963222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7110102c00 0x7f7110197a70 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:22.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.970+0000 7f71177f7640 1 --2- 172.21.15.88:0/1211963222 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71100ffc20 0x7f7110197530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:22.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.970+0000 7f71177f7640 1 -- 172.21.15.88:0/1211963222 >> 172.21.15.88:0/1211963222 conn(0x7f71100fb770 msgr2=0x7f7110106160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:22.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.970+0000 7f71177f7640 1 -- 172.21.15.88:0/1211963222 shutdown_connections 2024-09-17T04:25:22.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:22.970+0000 7f71177f7640 1 -- 172.21.15.88:0/1211963222 wait complete. 2024-09-17T04:25:23.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:23 smithi088 ceph-mon[90867]: from='client.34216 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:25:23.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:23 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/1211963222' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T04:25:23.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:23 smithi134 ceph-mon[76677]: from='client.34216 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:25:23.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:23 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/1211963222' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T04:25:24.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:24 smithi088 ceph-mon[90867]: pgmap v115: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 953 B/s rd, 0 op/s 2024-09-17T04:25:24.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:24 smithi134 ceph-mon[76677]: pgmap v115: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 953 B/s rd, 0 op/s 2024-09-17T04:25:27.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:27 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:25:27.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:27 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:25:27.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:27 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:25:27.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:27 smithi088 ceph-mon[90867]: pgmap v116: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-17T04:25:27.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:27 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:25:27.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:27 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:25:27.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:27 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:25:27.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:27 smithi134 ceph-mon[76677]: pgmap v116: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-17T04:25:28.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:28 smithi088 ceph-mon[90867]: pgmap v117: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T04:25:28.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:28 smithi134 ceph-mon[76677]: pgmap v117: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T04:25:29.967 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:29 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-17T04:25:30.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:29 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-17T04:25:30.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:30 smithi088 ceph-mon[90867]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-17T04:25:30.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:30 smithi088 ceph-mon[90867]: Upgrade: osd.3 is safe to restart 2024-09-17T04:25:30.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:30 smithi088 ceph-mon[90867]: pgmap v118: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:25:30.997 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:30 smithi134 ceph-mon[76677]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-17T04:25:30.997 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:30 smithi134 ceph-mon[76677]: Upgrade: osd.3 is safe to restart 2024-09-17T04:25:30.997 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:30 smithi134 ceph-mon[76677]: pgmap v118: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:25:32.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:32 smithi088 ceph-mon[90867]: Upgrade: Updating osd.3 2024-09-17T04:25:32.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:32 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:25:32.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:32 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-17T04:25:32.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:32 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:25:32.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:32 smithi088 ceph-mon[90867]: Deploying daemon osd.3 on smithi134 2024-09-17T04:25:32.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:32 smithi134 ceph-mon[76677]: Upgrade: Updating osd.3 2024-09-17T04:25:32.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:32 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:25:32.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:32 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-17T04:25:32.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:32 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:25:32.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:32 smithi134 ceph-mon[76677]: Deploying daemon osd.3 on smithi134 2024-09-17T04:25:33.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:33 smithi088 ceph-mon[90867]: pgmap v119: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:25:33.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:33 smithi134 ceph-mon[76677]: pgmap v119: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:25:34.464 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:34 smithi134 systemd[1]: Stopping Ceph osd.3 for bf2b79a4-74aa-11ef-bceb-c7b262605968... 2024-09-17T04:25:34.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:34 smithi088 ceph-mon[90867]: pgmap v120: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T04:25:34.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:34 smithi088 ceph-mon[90867]: osd.3 marked itself down and dead 2024-09-17T04:25:34.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:34 smithi134 ceph-mon[76677]: pgmap v120: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T04:25:34.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:34 smithi134 ceph-mon[76677]: osd.3 marked itself down and dead 2024-09-17T04:25:34.896 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:34 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-3[41152]: 2024-09-17T04:25:34.494+0000 7f8530e3a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T04:25:34.896 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:34 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-3[41152]: 2024-09-17T04:25:34.494+0000 7f8530e3a640 -1 osd.3 62 *** Got signal Terminated *** 2024-09-17T04:25:34.896 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:34 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-3[41152]: 2024-09-17T04:25:34.494+0000 7f8530e3a640 -1 osd.3 62 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T04:25:35.197 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:34 smithi134 podman[84295]: 2024-09-17 04:25:34.924301292 +0000 UTC m=+0.569682893 container died ebd528c3ce1bd5db8934d8df9981a8fba5775d7f0f32feaea3ba399679d78c53 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-17T04:25:35.505 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:35 smithi134 podman[84295]: 2024-09-17 04:25:35.363310634 +0000 UTC m=+1.008692268 container cleanup ebd528c3ce1bd5db8934d8df9981a8fba5775d7f0f32feaea3ba399679d78c53 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-3, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-17T04:25:35.505 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:35 smithi134 bash[84295]: ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-3 2024-09-17T04:25:35.881 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:35 smithi134 ceph-mon[76677]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T04:25:35.881 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:35 smithi134 ceph-mon[76677]: osdmap e63: 6 total, 5 up, 6 in 2024-09-17T04:25:35.882 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:35 smithi134 podman[84312]: 2024-09-17 04:25:35.664590428 +0000 UTC m=+0.736982801 container remove ebd528c3ce1bd5db8934d8df9981a8fba5775d7f0f32feaea3ba399679d78c53 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-3, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-17T04:25:35.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:35 smithi088 ceph-mon[90867]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T04:25:35.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:35 smithi088 ceph-mon[90867]: osdmap e63: 6 total, 5 up, 6 in 2024-09-17T04:25:36.131 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:36 smithi134 podman[84406]: 2024-09-17 04:25:36.022075858 +0000 UTC m=+0.016248877 image pull 8e039cb7fe1eece5854872e8884a61a26632c7691b2c85cbac9078a9c5c62fae quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f 2024-09-17T04:25:36.131 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:36 smithi134 podman[84406]: 2024-09-17 04:25:36.132252748 +0000 UTC m=+0.126425743 container create 980d12f386e0869adbdab1ad4afe6351bd7539da92aa9a4506f87e84ec164626 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-17T04:25:36.396 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:36 smithi134 podman[84406]: 2024-09-17 04:25:36.359918471 +0000 UTC m=+0.354091466 container init 980d12f386e0869adbdab1ad4afe6351bd7539da92aa9a4506f87e84ec164626 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-17T04:25:36.396 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:36 smithi134 podman[84406]: 2024-09-17 04:25:36.36315825 +0000 UTC m=+0.357331246 container start 980d12f386e0869adbdab1ad4afe6351bd7539da92aa9a4506f87e84ec164626 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-17T04:25:36.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:36 smithi088 ceph-mon[90867]: osdmap e64: 6 total, 5 up, 6 in 2024-09-17T04:25:36.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:36 smithi088 ceph-mon[90867]: pgmap v123: 65 pgs: 10 active+undersized, 9 peering, 4 stale+active+clean, 8 active+undersized+degraded, 34 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 31/276 objects degraded (11.232%) 2024-09-17T04:25:36.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:36 smithi134 ceph-mon[76677]: osdmap e64: 6 total, 5 up, 6 in 2024-09-17T04:25:36.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:36 smithi134 ceph-mon[76677]: pgmap v123: 65 pgs: 10 active+undersized, 9 peering, 4 stale+active+clean, 8 active+undersized+degraded, 34 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 31/276 objects degraded (11.232%) 2024-09-17T04:25:36.896 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:36 smithi134 podman[84406]: 2024-09-17 04:25:36.438191036 +0000 UTC m=+0.432364046 container attach 980d12f386e0869adbdab1ad4afe6351bd7539da92aa9a4506f87e84ec164626 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-17T04:25:36.896 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:36 smithi134 podman[84406]: 2024-09-17 04:25:36.55949418 +0000 UTC m=+0.553667176 container died 980d12f386e0869adbdab1ad4afe6351bd7539da92aa9a4506f87e84ec164626 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-17T04:25:37.396 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:37 smithi134 podman[84429]: 2024-09-17 04:25:37.180140799 +0000 UTC m=+0.610976109 container remove 980d12f386e0869adbdab1ad4afe6351bd7539da92aa9a4506f87e84ec164626 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T04:25:37.396 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:37 smithi134 systemd[1]: ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968@osd.3.service: Deactivated successfully. 2024-09-17T04:25:37.396 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:37 smithi134 systemd[1]: Stopped Ceph osd.3 for bf2b79a4-74aa-11ef-bceb-c7b262605968. 2024-09-17T04:25:37.396 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:37 smithi134 systemd[1]: ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968@osd.3.service: Consumed 1min 851ms CPU time. 2024-09-17T04:25:37.664 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:37 smithi134 ceph-mon[76677]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-17T04:25:37.664 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:37 smithi134 ceph-mon[76677]: Health check failed: Degraded data redundancy: 31/276 objects degraded (11.232%), 8 pgs degraded (PG_DEGRADED) 2024-09-17T04:25:37.664 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:37 smithi134 systemd[1]: Starting Ceph osd.3 for bf2b79a4-74aa-11ef-bceb-c7b262605968... 2024-09-17T04:25:37.664 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:37 smithi134 podman[84532]: 2024-09-17 04:25:37.532989118 +0000 UTC m=+0.015900514 image pull 8e039cb7fe1eece5854872e8884a61a26632c7691b2c85cbac9078a9c5c62fae quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f 2024-09-17T04:25:37.665 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:37 smithi134 podman[84532]: 2024-09-17 04:25:37.664949804 +0000 UTC m=+0.147861229 container create db165a9baf4d6b43b150a1abad0cb2dc6d5255da8c77cdd0c0ded21ea76a04b6 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-17T04:25:37.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:37 smithi088 ceph-mon[90867]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-17T04:25:37.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:37 smithi088 ceph-mon[90867]: Health check failed: Degraded data redundancy: 31/276 objects degraded (11.232%), 8 pgs degraded (PG_DEGRADED) 2024-09-17T04:25:38.396 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:37 smithi134 podman[84532]: 2024-09-17 04:25:37.942370917 +0000 UTC m=+0.425282309 container init db165a9baf4d6b43b150a1abad0cb2dc6d5255da8c77cdd0c0ded21ea76a04b6 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-3-activate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-17T04:25:38.396 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:37 smithi134 podman[84532]: 2024-09-17 04:25:37.945803779 +0000 UTC m=+0.428715166 container start db165a9baf4d6b43b150a1abad0cb2dc6d5255da8c77cdd0c0ded21ea76a04b6 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-3-activate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, io.buildah.version=1.37.2) 2024-09-17T04:25:38.396 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:38 smithi134 podman[84532]: 2024-09-17 04:25:38.05077797 +0000 UTC m=+0.533689369 container attach db165a9baf4d6b43b150a1abad0cb2dc6d5255da8c77cdd0c0ded21ea76a04b6 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-17T04:25:38.396 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:38 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-3-activate[84547]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T04:25:38.396 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:38 smithi134 bash[84532]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T04:25:38.396 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:38 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-3-activate[84547]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T04:25:38.396 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:38 smithi134 bash[84532]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T04:25:38.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:38 smithi088 ceph-mon[90867]: pgmap v124: 65 pgs: 14 active+undersized, 9 peering, 1 stale+active+clean, 11 active+undersized+degraded, 30 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 40/276 objects degraded (14.493%) 2024-09-17T04:25:38.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:38 smithi134 ceph-mon[76677]: pgmap v124: 65 pgs: 14 active+undersized, 9 peering, 1 stale+active+clean, 11 active+undersized+degraded, 30 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 40/276 objects degraded (14.493%) 2024-09-17T04:25:39.203 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:38 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-3-activate[84547]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-17T04:25:39.203 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:38 smithi134 bash[84532]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-17T04:25:39.203 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:38 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-3-activate[84547]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-17T04:25:39.203 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:38 smithi134 bash[84532]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-17T04:25:39.546 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:39 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-3-activate[84547]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-17T04:25:39.546 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:39 smithi134 bash[84532]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-17T04:25:39.546 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:39 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-3-activate[84547]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-17T04:25:39.546 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:39 smithi134 bash[84532]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-17T04:25:39.546 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:39 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-3-activate[84547]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-17T04:25:39.546 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:39 smithi134 bash[84532]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-17T04:25:39.546 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:39 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-3-activate[84547]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-17T04:25:39.546 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:39 smithi134 bash[84532]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-17T04:25:39.546 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:39 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-3-activate[84547]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-17T04:25:39.546 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:39 smithi134 bash[84532]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-17T04:25:39.546 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:39 smithi134 podman[84532]: 2024-09-17 04:25:39.232141604 +0000 UTC m=+1.715052998 container died db165a9baf4d6b43b150a1abad0cb2dc6d5255da8c77cdd0c0ded21ea76a04b6 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731) 2024-09-17T04:25:40.214 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:39 smithi134 podman[84693]: 2024-09-17 04:25:39.955122852 +0000 UTC m=+0.716223745 container remove db165a9baf4d6b43b150a1abad0cb2dc6d5255da8c77cdd0c0ded21ea76a04b6 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-3-activate, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T04:25:40.214 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:40 smithi134 podman[84753]: 2024-09-17 04:25:40.065085499 +0000 UTC m=+0.015767718 image pull 8e039cb7fe1eece5854872e8884a61a26632c7691b2c85cbac9078a9c5c62fae quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f 2024-09-17T04:25:40.214 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:40 smithi134 podman[84753]: 2024-09-17 04:25:40.214555366 +0000 UTC m=+0.165237618 container create 336a363ac39f8646c12c87dd7bee2d2e092ab6eba7c5544ec60d8269c3587cd1 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-17T04:25:40.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:40 smithi088 ceph-mon[90867]: pgmap v125: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 61/276 objects degraded (22.101%) 2024-09-17T04:25:40.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:40 smithi088 ceph-mon[90867]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-17T04:25:40.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:40 smithi134 ceph-mon[76677]: pgmap v125: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 61/276 objects degraded (22.101%) 2024-09-17T04:25:40.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:40 smithi134 ceph-mon[76677]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-17T04:25:40.896 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:40 smithi134 podman[84753]: 2024-09-17 04:25:40.466761787 +0000 UTC m=+0.417444002 container init 336a363ac39f8646c12c87dd7bee2d2e092ab6eba7c5544ec60d8269c3587cd1 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-3, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-17T04:25:40.896 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:40 smithi134 podman[84753]: 2024-09-17 04:25:40.469987384 +0000 UTC m=+0.420669594 container start 336a363ac39f8646c12c87dd7bee2d2e092ab6eba7c5544ec60d8269c3587cd1 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-3, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T04:25:40.896 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:40 smithi134 bash[84753]: 336a363ac39f8646c12c87dd7bee2d2e092ab6eba7c5544ec60d8269c3587cd1 2024-09-17T04:25:40.896 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:40 smithi134 systemd[1]: Started Ceph osd.3 for bf2b79a4-74aa-11ef-bceb-c7b262605968. 2024-09-17T04:25:41.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:41 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:25:41.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:41 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:25:41.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:41 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:25:41.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:41 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:25:41.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:41 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:25:41.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:41 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:25:41.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:41 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:25:41.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:41 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:25:41.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:41 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:25:41.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:41 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:25:42.396 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:42 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-3[84767]: 2024-09-17T04:25:42.121+0000 7f2d3941e640 -1 Falling back to public interface 2024-09-17T04:25:42.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:42 smithi088 ceph-mon[90867]: pgmap v126: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 61/276 objects degraded (22.101%) 2024-09-17T04:25:42.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:42 smithi134 ceph-mon[76677]: pgmap v126: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 61/276 objects degraded (22.101%) 2024-09-17T04:25:43.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:43 smithi088 ceph-mon[90867]: Health check update: Degraded data redundancy: 61/276 objects degraded (22.101%), 18 pgs degraded (PG_DEGRADED) 2024-09-17T04:25:43.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:43 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:25:43.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:43 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:25:43.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:43 smithi134 ceph-mon[76677]: Health check update: Degraded data redundancy: 61/276 objects degraded (22.101%), 18 pgs degraded (PG_DEGRADED) 2024-09-17T04:25:43.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:43 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:25:43.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:43 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:25:45.359 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:44 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:25:45.359 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:44 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:25:45.359 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:44 smithi134 ceph-mon[76677]: pgmap v127: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 61/276 objects degraded (22.101%) 2024-09-17T04:25:45.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:44 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:25:45.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:44 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:25:45.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:44 smithi088 ceph-mon[90867]: pgmap v127: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 61/276 objects degraded (22.101%) 2024-09-17T04:25:46.833 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:46 smithi134 ceph-mon[76677]: pgmap v128: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 61/276 objects degraded (22.101%) 2024-09-17T04:25:46.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:46 smithi088 ceph-mon[90867]: pgmap v128: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 61/276 objects degraded (22.101%) 2024-09-17T04:25:48.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:48 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:25:48.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:48 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:25:48.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:48 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:25:48.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:48 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:25:48.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:48 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:25:48.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:48 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:25:48.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:48 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:25:48.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:48 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:25:48.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:48 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:25:48.639 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:48 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-17T04:25:48.639 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:48 smithi088 ceph-mon[90867]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-17T04:25:48.639 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:48 smithi088 ceph-mon[90867]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-17T04:25:48.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:48 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:25:48.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:48 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:25:48.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:48 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:25:48.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:48 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:25:48.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:48 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:25:48.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:48 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:25:48.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:48 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:25:48.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:48 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:25:48.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:48 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:25:48.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:48 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-17T04:25:48.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:48 smithi134 ceph-mon[76677]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-17T04:25:48.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:48 smithi134 ceph-mon[76677]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-17T04:25:49.146 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:48 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-3[84767]: 2024-09-17T04:25:48.820+0000 7f2d3941e640 -1 osd.3 62 log_to_monitors true 2024-09-17T04:25:49.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:49 smithi088 ceph-mon[90867]: pgmap v129: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 61/276 objects degraded (22.101%) 2024-09-17T04:25:49.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:49 smithi088 ceph-mon[90867]: from='osd.3 [v2:172.21.15.134:6800/2593313006,v1:172.21.15.134:6801/2593313006]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-17T04:25:49.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:49 smithi088 ceph-mon[90867]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-17T04:25:49.646 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:25:49 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-3[84767]: 2024-09-17T04:25:49.217+0000 7f2d2d196640 -1 osd.3 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T04:25:49.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:49 smithi134 ceph-mon[76677]: pgmap v129: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 61/276 objects degraded (22.101%) 2024-09-17T04:25:49.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:49 smithi134 ceph-mon[76677]: from='osd.3 [v2:172.21.15.134:6800/2593313006,v1:172.21.15.134:6801/2593313006]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-17T04:25:49.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:49 smithi134 ceph-mon[76677]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-17T04:25:50.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:50 smithi088 ceph-mon[90867]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-17T04:25:50.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:50 smithi088 ceph-mon[90867]: from='osd.3 [v2:172.21.15.134:6800/2593313006,v1:172.21.15.134:6801/2593313006]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-09-17T04:25:50.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:50 smithi088 ceph-mon[90867]: osdmap e65: 6 total, 5 up, 6 in 2024-09-17T04:25:50.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:50 smithi088 ceph-mon[90867]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-09-17T04:25:50.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:50 smithi134 ceph-mon[76677]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-17T04:25:50.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:50 smithi134 ceph-mon[76677]: from='osd.3 [v2:172.21.15.134:6800/2593313006,v1:172.21.15.134:6801/2593313006]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-09-17T04:25:50.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:50 smithi134 ceph-mon[76677]: osdmap e65: 6 total, 5 up, 6 in 2024-09-17T04:25:50.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:50 smithi134 ceph-mon[76677]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-09-17T04:25:51.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:51 smithi134 ceph-mon[76677]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T04:25:51.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:51 smithi134 ceph-mon[76677]: osd.3 [v2:172.21.15.134:6800/2593313006,v1:172.21.15.134:6801/2593313006] boot 2024-09-17T04:25:51.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:51 smithi134 ceph-mon[76677]: osdmap e66: 6 total, 6 up, 6 in 2024-09-17T04:25:51.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:51 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-17T04:25:51.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:51 smithi134 ceph-mon[76677]: pgmap v132: 65 pgs: 7 peering, 17 active+undersized, 14 active+undersized+degraded, 27 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 47/276 objects degraded (17.029%) 2024-09-17T04:25:51.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:51 smithi134 ceph-mon[76677]: osdmap e67: 6 total, 6 up, 6 in 2024-09-17T04:25:51.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:51 smithi088 ceph-mon[90867]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T04:25:51.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:51 smithi088 ceph-mon[90867]: osd.3 [v2:172.21.15.134:6800/2593313006,v1:172.21.15.134:6801/2593313006] boot 2024-09-17T04:25:51.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:51 smithi088 ceph-mon[90867]: osdmap e66: 6 total, 6 up, 6 in 2024-09-17T04:25:51.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:51 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-17T04:25:51.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:51 smithi088 ceph-mon[90867]: pgmap v132: 65 pgs: 7 peering, 17 active+undersized, 14 active+undersized+degraded, 27 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 47/276 objects degraded (17.029%) 2024-09-17T04:25:51.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:51 smithi088 ceph-mon[90867]: osdmap e67: 6 total, 6 up, 6 in 2024-09-17T04:25:52.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:52 smithi088 ceph-mon[90867]: Health check update: Degraded data redundancy: 47/276 objects degraded (17.029%), 14 pgs degraded (PG_DEGRADED) 2024-09-17T04:25:52.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:52 smithi134 ceph-mon[76677]: Health check update: Degraded data redundancy: 47/276 objects degraded (17.029%), 14 pgs degraded (PG_DEGRADED) 2024-09-17T04:25:53.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.066+0000 7fec713de640 1 -- 172.21.15.88:0/2621864952 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec6c076220 msgr2=0x7fec6c074680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:53.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.066+0000 7fec713de640 1 --2- 172.21.15.88:0/2621864952 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec6c076220 0x7fec6c074680 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fec54009880 tx=0x7fec5402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:25:53.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.066+0000 7fec713de640 1 -- 172.21.15.88:0/2621864952 shutdown_connections 2024-09-17T04:25:53.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.066+0000 7fec713de640 1 --2- 172.21.15.88:0/2621864952 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec6c074c50 0x7fec6c0750b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:53.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.066+0000 7fec713de640 1 --2- 172.21.15.88:0/2621864952 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec6c076220 0x7fec6c074680 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:53.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.066+0000 7fec713de640 1 -- 172.21.15.88:0/2621864952 >> 172.21.15.88:0/2621864952 conn(0x7fec6c0fd0f0 msgr2=0x7fec6c0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:53.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.066+0000 7fec713de640 1 -- 172.21.15.88:0/2621864952 shutdown_connections 2024-09-17T04:25:53.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.066+0000 7fec713de640 1 -- 172.21.15.88:0/2621864952 wait complete. 2024-09-17T04:25:53.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.067+0000 7fec713de640 1 Processor -- start 2024-09-17T04:25:53.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.067+0000 7fec713de640 1 -- start start 2024-09-17T04:25:53.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.067+0000 7fec713de640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec6c074c50 0x7fec6c1996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:53.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.067+0000 7fec713de640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec6c076220 0x7fec6c199c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:53.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.067+0000 7fec713de640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fec6c10c9a0 con 0x7fec6c074c50 2024-09-17T04:25:53.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.067+0000 7fec713de640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fec6c10c820 con 0x7fec6c076220 2024-09-17T04:25:53.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.067+0000 7fec6affd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec6c074c50 0x7fec6c1996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:53.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.067+0000 7fec6affd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec6c074c50 0x7fec6c1996e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46250/0 (socket says 172.21.15.88:46250) 2024-09-17T04:25:53.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.067+0000 7fec6affd640 1 -- 172.21.15.88:0/3212993714 learned_addr learned my addr 172.21.15.88:0/3212993714 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:25:53.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.068+0000 7fec6affd640 1 -- 172.21.15.88:0/3212993714 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec6c076220 msgr2=0x7fec6c199c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:53.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.068+0000 7fec6affd640 1 --2- 172.21.15.88:0/3212993714 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec6c076220 0x7fec6c199c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:53.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.068+0000 7fec6affd640 1 -- 172.21.15.88:0/3212993714 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec6c19a2a0 con 0x7fec6c074c50 2024-09-17T04:25:53.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.068+0000 7fec6affd640 1 --2- 172.21.15.88:0/3212993714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec6c074c50 0x7fec6c1996e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fec54006010 tx=0x7fec540045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:53.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.068+0000 7fec63fff640 1 -- 172.21.15.88:0/3212993714 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fec5403f070 con 0x7fec6c074c50 2024-09-17T04:25:53.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.068+0000 7fec713de640 1 -- 172.21.15.88:0/3212993714 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec6c19ec80 con 0x7fec6c074c50 2024-09-17T04:25:53.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.068+0000 7fec63fff640 1 -- 172.21.15.88:0/3212993714 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fec54004a50 con 0x7fec6c074c50 2024-09-17T04:25:53.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.068+0000 7fec63fff640 1 -- 172.21.15.88:0/3212993714 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fec54035030 con 0x7fec6c074c50 2024-09-17T04:25:53.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.068+0000 7fec713de640 1 -- 172.21.15.88:0/3212993714 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec6c19f1c0 con 0x7fec6c074c50 2024-09-17T04:25:53.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.069+0000 7fec713de640 1 -- 172.21.15.88:0/3212993714 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec6c0750b0 con 0x7fec6c074c50 2024-09-17T04:25:53.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.070+0000 7fec63fff640 1 -- 172.21.15.88:0/3212993714 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fec54042070 con 0x7fec6c074c50 2024-09-17T04:25:53.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.070+0000 7fec63fff640 1 --2- 172.21.15.88:0/3212993714 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fec5807af30 0x7fec5807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:53.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.071+0000 7fec6a7fc640 1 --2- 172.21.15.88:0/3212993714 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fec5807af30 0x7fec5807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:53.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.071+0000 7fec63fff640 1 -- 172.21.15.88:0/3212993714 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6070+0+0 (secure 0 0 0) 0x7fec540bebd0 con 0x7fec6c074c50 2024-09-17T04:25:53.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.071+0000 7fec6a7fc640 1 --2- 172.21.15.88:0/3212993714 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fec5807af30 0x7fec5807d3f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fec5c005fd0 tx=0x7fec5c005850 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:53.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.075+0000 7fec63fff640 1 -- 172.21.15.88:0/3212993714 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fec54004c00 con 0x7fec6c074c50 2024-09-17T04:25:53.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.271+0000 7fec713de640 1 -- 172.21.15.88:0/3212993714 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fec6c0626f0 con 0x7fec5807af30 2024-09-17T04:25:53.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.272+0000 7fec63fff640 1 -- 172.21.15.88:0/3212993714 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7fec6c0626f0 con 0x7fec5807af30 2024-09-17T04:25:53.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.275+0000 7fec713de640 1 -- 172.21.15.88:0/3212993714 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fec5807af30 msgr2=0x7fec5807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:53.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.275+0000 7fec713de640 1 --2- 172.21.15.88:0/3212993714 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fec5807af30 0x7fec5807d3f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fec5c005fd0 tx=0x7fec5c005850 comp rx=0 tx=0).stop 2024-09-17T04:25:53.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.275+0000 7fec713de640 1 -- 172.21.15.88:0/3212993714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec6c074c50 msgr2=0x7fec6c1996e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:53.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.275+0000 7fec713de640 1 --2- 172.21.15.88:0/3212993714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec6c074c50 0x7fec6c1996e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fec54006010 tx=0x7fec540045e0 comp rx=0 tx=0).stop 2024-09-17T04:25:53.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.275+0000 7fec713de640 1 -- 172.21.15.88:0/3212993714 shutdown_connections 2024-09-17T04:25:53.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.275+0000 7fec713de640 1 --2- 172.21.15.88:0/3212993714 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fec5807af30 0x7fec5807d3f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:53.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.275+0000 7fec713de640 1 --2- 172.21.15.88:0/3212993714 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec6c076220 0x7fec6c199c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:53.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.275+0000 7fec713de640 1 --2- 172.21.15.88:0/3212993714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec6c074c50 0x7fec6c1996e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:53.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.275+0000 7fec713de640 1 -- 172.21.15.88:0/3212993714 >> 172.21.15.88:0/3212993714 conn(0x7fec6c0fd0f0 msgr2=0x7fec6c1079c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:53.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.275+0000 7fec713de640 1 -- 172.21.15.88:0/3212993714 shutdown_connections 2024-09-17T04:25:53.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.275+0000 7fec713de640 1 -- 172.21.15.88:0/3212993714 wait complete. 2024-09-17T04:25:53.284 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-09-17T04:25:53.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.357+0000 7f962a500640 1 -- 172.21.15.88:0/606238306 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9624101200 msgr2=0x7f9624101680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:53.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.357+0000 7f962a500640 1 --2- 172.21.15.88:0/606238306 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9624101200 0x7f9624101680 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f961800a990 tx=0x7f961802b7d0 comp rx=0 tx=0).stop 2024-09-17T04:25:53.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.357+0000 7f962a500640 1 -- 172.21.15.88:0/606238306 shutdown_connections 2024-09-17T04:25:53.358 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:53 smithi088 ceph-mon[90867]: pgmap v134: 65 pgs: 7 peering, 11 active+undersized, 12 active+undersized+degraded, 35 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 38/276 objects degraded (13.768%) 2024-09-17T04:25:53.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.357+0000 7f962a500640 1 --2- 172.21.15.88:0/606238306 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9624101200 0x7f9624101680 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:53.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.357+0000 7f962a500640 1 --2- 172.21.15.88:0/606238306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9624100000 0x7f9624100400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:53.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.357+0000 7f962a500640 1 -- 172.21.15.88:0/606238306 >> 172.21.15.88:0/606238306 conn(0x7f96240fb790 msgr2=0x7f96240fdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:53.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.358+0000 7f962a500640 1 -- 172.21.15.88:0/606238306 shutdown_connections 2024-09-17T04:25:53.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.358+0000 7f962a500640 1 -- 172.21.15.88:0/606238306 wait complete. 2024-09-17T04:25:53.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.358+0000 7f962a500640 1 Processor -- start 2024-09-17T04:25:53.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.358+0000 7f962a500640 1 -- start start 2024-09-17T04:25:53.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.358+0000 7f962a500640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9624100000 0x7f9624103f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:53.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.358+0000 7f962a500640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9624101200 0x7f96241025e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:53.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.358+0000 7f962a500640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f9624108560 con 0x7f9624101200 2024-09-17T04:25:53.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.359+0000 7f962a500640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f96241083e0 con 0x7f9624100000 2024-09-17T04:25:53.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.359+0000 7f96237fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9624101200 0x7f96241025e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:53.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.359+0000 7f96237fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9624101200 0x7f96241025e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46260/0 (socket says 172.21.15.88:46260) 2024-09-17T04:25:53.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.359+0000 7f96237fe640 1 -- 172.21.15.88:0/2572731181 learned_addr learned my addr 172.21.15.88:0/2572731181 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:25:53.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.359+0000 7f9623fff640 1 --2- 172.21.15.88:0/2572731181 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9624100000 0x7f9624103f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:53.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.359+0000 7f96237fe640 1 -- 172.21.15.88:0/2572731181 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9624100000 msgr2=0x7f9624103f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:53.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.359+0000 7f96237fe640 1 --2- 172.21.15.88:0/2572731181 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9624100000 0x7f9624103f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:53.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.359+0000 7f96237fe640 1 -- 172.21.15.88:0/2572731181 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9624102b20 con 0x7f9624101200 2024-09-17T04:25:53.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.359+0000 7f96237fe640 1 --2- 172.21.15.88:0/2572731181 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9624101200 0x7f96241025e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9618006010 tx=0x7f9618004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:53.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.359+0000 7f96217fa640 1 -- 172.21.15.88:0/2572731181 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9618042070 con 0x7f9624101200 2024-09-17T04:25:53.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.359+0000 7f962a500640 1 -- 172.21.15.88:0/2572731181 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9624102db0 con 0x7f9624101200 2024-09-17T04:25:53.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.359+0000 7f96217fa640 1 -- 172.21.15.88:0/2572731181 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9618004b80 con 0x7f9624101200 2024-09-17T04:25:53.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.360+0000 7f96217fa640 1 -- 172.21.15.88:0/2572731181 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f96180035f0 con 0x7f9624101200 2024-09-17T04:25:53.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.360+0000 7f962a500640 1 -- 172.21.15.88:0/2572731181 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96241033c0 con 0x7f9624101200 2024-09-17T04:25:53.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.361+0000 7f962a500640 1 -- 172.21.15.88:0/2572731181 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9624100400 con 0x7f9624101200 2024-09-17T04:25:53.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.361+0000 7f96217fa640 1 -- 172.21.15.88:0/2572731181 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f9618045070 con 0x7f9624101200 2024-09-17T04:25:53.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.362+0000 7f96217fa640 1 --2- 172.21.15.88:0/2572731181 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f960c07af30 0x7f960c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:53.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.362+0000 7f96217fa640 1 -- 172.21.15.88:0/2572731181 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6070+0+0 (secure 0 0 0) 0x7f96180bec50 con 0x7f9624101200 2024-09-17T04:25:53.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.362+0000 7f9623fff640 1 --2- 172.21.15.88:0/2572731181 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f960c07af30 0x7f960c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:53.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.362+0000 7f9623fff640 1 --2- 172.21.15.88:0/2572731181 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f960c07af30 0x7f960c07d3f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9624101060 tx=0x7f9614005f90 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:53.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.366+0000 7f96217fa640 1 -- 172.21.15.88:0/2572731181 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f961808a2a0 con 0x7f9624101200 2024-09-17T04:25:53.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.559+0000 7f962a500640 1 -- 172.21.15.88:0/2572731181 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9624062630 con 0x7f960c07af30 2024-09-17T04:25:53.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.560+0000 7f96217fa640 1 -- 172.21.15.88:0/2572731181 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f9624062630 con 0x7f960c07af30 2024-09-17T04:25:53.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.562+0000 7f962a500640 1 -- 172.21.15.88:0/2572731181 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f960c07af30 msgr2=0x7f960c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:53.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.562+0000 7f962a500640 1 --2- 172.21.15.88:0/2572731181 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f960c07af30 0x7f960c07d3f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9624101060 tx=0x7f9614005f90 comp rx=0 tx=0).stop 2024-09-17T04:25:53.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.562+0000 7f962a500640 1 -- 172.21.15.88:0/2572731181 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9624101200 msgr2=0x7f96241025e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:53.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.562+0000 7f962a500640 1 --2- 172.21.15.88:0/2572731181 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9624101200 0x7f96241025e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9618006010 tx=0x7f9618004270 comp rx=0 tx=0).stop 2024-09-17T04:25:53.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.563+0000 7f962a500640 1 -- 172.21.15.88:0/2572731181 shutdown_connections 2024-09-17T04:25:53.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.563+0000 7f962a500640 1 --2- 172.21.15.88:0/2572731181 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f960c07af30 0x7f960c07d3f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:53.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.563+0000 7f962a500640 1 --2- 172.21.15.88:0/2572731181 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9624101200 0x7f96241025e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:53.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.563+0000 7f962a500640 1 --2- 172.21.15.88:0/2572731181 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9624100000 0x7f9624103f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:53.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.563+0000 7f962a500640 1 -- 172.21.15.88:0/2572731181 >> 172.21.15.88:0/2572731181 conn(0x7f96240fb790 msgr2=0x7f9624104960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:53.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.563+0000 7f962a500640 1 -- 172.21.15.88:0/2572731181 shutdown_connections 2024-09-17T04:25:53.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.563+0000 7f962a500640 1 -- 172.21.15.88:0/2572731181 wait complete. 2024-09-17T04:25:53.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.645+0000 7f9745170640 1 -- 172.21.15.88:0/2420105897 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9740101960 msgr2=0x7f9740101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:53.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.645+0000 7f9745170640 1 --2- 172.21.15.88:0/2420105897 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9740101960 0x7f9740101d60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9730009880 tx=0x7f973002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:25:53.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.645+0000 7f9745170640 1 -- 172.21.15.88:0/2420105897 shutdown_connections 2024-09-17T04:25:53.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.645+0000 7f9745170640 1 --2- 172.21.15.88:0/2420105897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9740102b60 0x7f9740102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:53.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.645+0000 7f9745170640 1 --2- 172.21.15.88:0/2420105897 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9740101960 0x7f9740101d60 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:53.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.645+0000 7f9745170640 1 -- 172.21.15.88:0/2420105897 >> 172.21.15.88:0/2420105897 conn(0x7f97400fd0f0 msgr2=0x7f97400ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:53.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.645+0000 7f9745170640 1 -- 172.21.15.88:0/2420105897 shutdown_connections 2024-09-17T04:25:53.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.645+0000 7f9745170640 1 -- 172.21.15.88:0/2420105897 wait complete. 2024-09-17T04:25:53.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:53 smithi134 ceph-mon[76677]: pgmap v134: 65 pgs: 7 peering, 11 active+undersized, 12 active+undersized+degraded, 35 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 38/276 objects degraded (13.768%) 2024-09-17T04:25:53.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.646+0000 7f9745170640 1 Processor -- start 2024-09-17T04:25:53.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.646+0000 7f9745170640 1 -- start start 2024-09-17T04:25:53.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.646+0000 7f9745170640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9740101960 0x7f9740197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:53.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.646+0000 7f9745170640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9740102b60 0x7f97401979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:53.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.646+0000 7f9745170640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f974010a780 con 0x7f9740102b60 2024-09-17T04:25:53.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.646+0000 7f9745170640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f974010a600 con 0x7f9740101960 2024-09-17T04:25:53.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.646+0000 7f973e59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9740102b60 0x7f97401979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:53.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.646+0000 7f973e59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9740102b60 0x7f97401979d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46284/0 (socket says 172.21.15.88:46284) 2024-09-17T04:25:53.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.646+0000 7f973e59c640 1 -- 172.21.15.88:0/1154431927 learned_addr learned my addr 172.21.15.88:0/1154431927 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:25:53.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.647+0000 7f973ed9d640 1 --2- 172.21.15.88:0/1154431927 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9740101960 0x7f9740197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:53.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.647+0000 7f973e59c640 1 -- 172.21.15.88:0/1154431927 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9740101960 msgr2=0x7f9740197490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:53.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.647+0000 7f973e59c640 1 --2- 172.21.15.88:0/1154431927 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9740101960 0x7f9740197490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:53.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.647+0000 7f973e59c640 1 -- 172.21.15.88:0/1154431927 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9740198050 con 0x7f9740102b60 2024-09-17T04:25:53.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.647+0000 7f973e59c640 1 --2- 172.21.15.88:0/1154431927 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9740102b60 0x7f97401979d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f973400c810 tx=0x7f973400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:53.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.647+0000 7f9727fff640 1 -- 172.21.15.88:0/1154431927 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9734004020 con 0x7f9740102b60 2024-09-17T04:25:53.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.647+0000 7f9745170640 1 -- 172.21.15.88:0/1154431927 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f974019ca90 con 0x7f9740102b60 2024-09-17T04:25:53.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.647+0000 7f9727fff640 1 -- 172.21.15.88:0/1154431927 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f97340041c0 con 0x7f9740102b60 2024-09-17T04:25:53.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.647+0000 7f9727fff640 1 -- 172.21.15.88:0/1154431927 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f97340047a0 con 0x7f9740102b60 2024-09-17T04:25:53.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.647+0000 7f9745170640 1 -- 172.21.15.88:0/1154431927 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f974019d020 con 0x7f9740102b60 2024-09-17T04:25:53.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.648+0000 7f9745170640 1 -- 172.21.15.88:0/1154431927 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9740101d60 con 0x7f9740102b60 2024-09-17T04:25:53.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.649+0000 7f9727fff640 1 -- 172.21.15.88:0/1154431927 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f97340079b0 con 0x7f9740102b60 2024-09-17T04:25:53.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.649+0000 7f9727fff640 1 --2- 172.21.15.88:0/1154431927 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f972807af30 0x7f972807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:53.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.650+0000 7f9727fff640 1 -- 172.21.15.88:0/1154431927 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6070+0+0 (secure 0 0 0) 0x7f973409de70 con 0x7f9740102b60 2024-09-17T04:25:53.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.650+0000 7f973ed9d640 1 --2- 172.21.15.88:0/1154431927 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f972807af30 0x7f972807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:53.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.650+0000 7f973ed9d640 1 --2- 172.21.15.88:0/1154431927 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f972807af30 0x7f972807d3f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9730009230 tx=0x7f97300058d0 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:53.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.654+0000 7f9727fff640 1 -- 172.21.15.88:0/1154431927 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f9734014030 con 0x7f9740102b60 2024-09-17T04:25:53.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.839+0000 7f9745170640 1 -- 172.21.15.88:0/1154431927 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f9740062630 con 0x7f972807af30 2024-09-17T04:25:53.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.848+0000 7f9727fff640 1 -- 172.21.15.88:0/1154431927 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f9740062630 con 0x7f972807af30 2024-09-17T04:25:53.848 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T04:25:53.849 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (11m) 43s ago 12m 25.4M - 0.25.0 c8568f914cd2 f2dbac7e939f 2024-09-17T04:25:53.849 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi088 smithi088 running (4m) 43s ago 13m 8678k - 19.1.1-330-gc2ddf972 ebb0615149de 683e1826a1a5 2024-09-17T04:25:53.849 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi134 smithi134 running (4m) 10s ago 12m 8619k - 19.1.1-330-gc2ddf972 ebb0615149de 83afa4200c0e 2024-09-17T04:25:53.849 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (2m) 43s ago 13m 6891k - 19.3.0-4989-gce1b342b 8e039cb7fe1e 10355648c406 2024-09-17T04:25:53.849 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi134 smithi134 running (2m) 10s ago 12m 6899k - 19.3.0-4989-gce1b342b 8e039cb7fe1e d709085ffe5d 2024-09-17T04:25:53.849 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (11m) 43s ago 12m 79.3M - 9.4.12 2bacad6d85d8 a6cff57a23f9 2024-09-17T04:25:53.849 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.giqrgt smithi088 running (7m) 43s ago 7m 148M - 19.1.1-330-gc2ddf972 ebb0615149de f724660799a1 2024-09-17T04:25:53.849 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.lgavsv smithi088 running (7m) 43s ago 7m 16.2M - 19.1.1-330-gc2ddf972 ebb0615149de 6cc0fe8a6aa9 2024-09-17T04:25:53.849 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi134.ktuhce smithi134 running (7m) 10s ago 7m 15.8M - 19.1.1-330-gc2ddf972 ebb0615149de 7ff5b70ca9cb 2024-09-17T04:25:53.849 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi134.psnynp smithi134 running (7m) 10s ago 7m 90.6M - 19.1.1-330-gc2ddf972 ebb0615149de 5326974fa3dd 2024-09-17T04:25:53.849 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.wmndiv smithi088 *:8443,9283,8765 running (4m) 43s ago 14m 584M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 49eb47f7f14f 2024-09-17T04:25:53.850 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi134.vwdxcb smithi134 *:8443,9283,8765 running (3m) 10s ago 12m 521M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 8a6d45eb0595 2024-09-17T04:25:53.850 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (2m) 43s ago 14m 112M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e ac6332015243 2024-09-17T04:25:53.850 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi134 smithi134 running (2m) 10s ago 12m 102M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e ea49f690e26b 2024-09-17T04:25:53.850 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (13m) 43s ago 13m 16.4M - 1.5.0 0da6a335fe13 9ba03800993b 2024-09-17T04:25:53.850 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi134 smithi134 *:9100 running (12m) 10s ago 12m 17.4M - 1.5.0 0da6a335fe13 6deac483827f 2024-09-17T04:25:53.850 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (118s) 43s ago 10m 155M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 4ef267302248 2024-09-17T04:25:53.850 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (82s) 43s ago 10m 153M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 17b67c13c7aa 2024-09-17T04:25:53.850 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (48s) 43s ago 9m 79.4M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 83d38ad792c9 2024-09-17T04:25:53.850 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi134 running (13s) 10s ago 9m 80.7M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e 336a363ac39f 2024-09-17T04:25:53.850 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi134 running (9m) 10s ago 9m 210M 2240M 19.1.1-330-gc2ddf972 ebb0615149de eacc25537b3a 2024-09-17T04:25:53.851 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi134 running (8m) 10s ago 8m 186M 2240M 19.1.1-330-gc2ddf972 ebb0615149de bc1b434a92a8 2024-09-17T04:25:53.851 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (3m) 43s ago 12m 66.9M - 2.43.0 a07b618ecd1d b51d7899d341 2024-09-17T04:25:53.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.850+0000 7f9745170640 1 -- 172.21.15.88:0/1154431927 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f972807af30 msgr2=0x7f972807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:53.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.850+0000 7f9745170640 1 --2- 172.21.15.88:0/1154431927 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f972807af30 0x7f972807d3f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9730009230 tx=0x7f97300058d0 comp rx=0 tx=0).stop 2024-09-17T04:25:53.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.850+0000 7f9745170640 1 -- 172.21.15.88:0/1154431927 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9740102b60 msgr2=0x7f97401979d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:53.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.850+0000 7f9745170640 1 --2- 172.21.15.88:0/1154431927 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9740102b60 0x7f97401979d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f973400c810 tx=0x7f973400ccd0 comp rx=0 tx=0).stop 2024-09-17T04:25:53.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.850+0000 7f9745170640 1 -- 172.21.15.88:0/1154431927 shutdown_connections 2024-09-17T04:25:53.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.850+0000 7f9745170640 1 --2- 172.21.15.88:0/1154431927 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f972807af30 0x7f972807d3f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:53.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.850+0000 7f9745170640 1 --2- 172.21.15.88:0/1154431927 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9740102b60 0x7f97401979d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:53.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.850+0000 7f9745170640 1 --2- 172.21.15.88:0/1154431927 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9740101960 0x7f9740197490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:53.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.850+0000 7f9745170640 1 -- 172.21.15.88:0/1154431927 >> 172.21.15.88:0/1154431927 conn(0x7f97400fd0f0 msgr2=0x7f9740105fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:53.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.851+0000 7f9745170640 1 -- 172.21.15.88:0/1154431927 shutdown_connections 2024-09-17T04:25:53.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.851+0000 7f9745170640 1 -- 172.21.15.88:0/1154431927 wait complete. 2024-09-17T04:25:53.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.931+0000 7fed7cc70640 1 -- 172.21.15.88:0/3674067358 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed78100860 msgr2=0x7fed78100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:53.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.931+0000 7fed7cc70640 1 --2- 172.21.15.88:0/3674067358 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed78100860 0x7fed78100c60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fed70009880 tx=0x7fed7002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:25:53.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.931+0000 7fed7cc70640 1 -- 172.21.15.88:0/3674067358 shutdown_connections 2024-09-17T04:25:53.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.931+0000 7fed7cc70640 1 --2- 172.21.15.88:0/3674067358 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed78101a60 0x7fed78101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:53.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.931+0000 7fed7cc70640 1 --2- 172.21.15.88:0/3674067358 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed78100860 0x7fed78100c60 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:53.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.931+0000 7fed7cc70640 1 -- 172.21.15.88:0/3674067358 >> 172.21.15.88:0/3674067358 conn(0x7fed780fc010 msgr2=0x7fed780fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:53.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.931+0000 7fed7cc70640 1 -- 172.21.15.88:0/3674067358 shutdown_connections 2024-09-17T04:25:53.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.931+0000 7fed7cc70640 1 -- 172.21.15.88:0/3674067358 wait complete. 2024-09-17T04:25:53.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.932+0000 7fed7cc70640 1 Processor -- start 2024-09-17T04:25:53.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.932+0000 7fed7cc70640 1 -- start start 2024-09-17T04:25:53.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.932+0000 7fed7cc70640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed78100860 0x7fed781963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:53.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.932+0000 7fed7cc70640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed78101a60 0x7fed78196910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:53.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.932+0000 7fed7cc70640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fed781096a0 con 0x7fed78101a60 2024-09-17T04:25:53.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.932+0000 7fed7cc70640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fed78109520 con 0x7fed78100860 2024-09-17T04:25:53.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.932+0000 7fed75d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed78101a60 0x7fed78196910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:53.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.932+0000 7fed75d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed78101a60 0x7fed78196910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46294/0 (socket says 172.21.15.88:46294) 2024-09-17T04:25:53.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.932+0000 7fed75d9b640 1 -- 172.21.15.88:0/1686683487 learned_addr learned my addr 172.21.15.88:0/1686683487 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:25:53.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.932+0000 7fed7659c640 1 --2- 172.21.15.88:0/1686683487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed78100860 0x7fed781963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:53.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.932+0000 7fed75d9b640 1 -- 172.21.15.88:0/1686683487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed78100860 msgr2=0x7fed781963d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:53.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.932+0000 7fed75d9b640 1 --2- 172.21.15.88:0/1686683487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed78100860 0x7fed781963d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:53.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.932+0000 7fed75d9b640 1 -- 172.21.15.88:0/1686683487 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed78196f90 con 0x7fed78101a60 2024-09-17T04:25:53.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.932+0000 7fed7659c640 1 --2- 172.21.15.88:0/1686683487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed78100860 0x7fed781963d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:25:53.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.933+0000 7fed75d9b640 1 --2- 172.21.15.88:0/1686683487 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed78101a60 0x7fed78196910 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fed6000d6f0 tx=0x7fed6000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:53.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.933+0000 7fed6f7fe640 1 -- 172.21.15.88:0/1686683487 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fed60017070 con 0x7fed78101a60 2024-09-17T04:25:53.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.933+0000 7fed7cc70640 1 -- 172.21.15.88:0/1686683487 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed7819b9d0 con 0x7fed78101a60 2024-09-17T04:25:53.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.933+0000 7fed6f7fe640 1 -- 172.21.15.88:0/1686683487 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fed6000de00 con 0x7fed78101a60 2024-09-17T04:25:53.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.933+0000 7fed6f7fe640 1 -- 172.21.15.88:0/1686683487 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fed60004bb0 con 0x7fed78101a60 2024-09-17T04:25:53.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.933+0000 7fed7cc70640 1 -- 172.21.15.88:0/1686683487 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed7806a1b0 con 0x7fed78101a60 2024-09-17T04:25:53.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.934+0000 7fed7cc70640 1 -- 172.21.15.88:0/1686683487 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed78100c60 con 0x7fed78101a60 2024-09-17T04:25:53.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.935+0000 7fed6f7fe640 1 -- 172.21.15.88:0/1686683487 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fed60010460 con 0x7fed78101a60 2024-09-17T04:25:53.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.935+0000 7fed6f7fe640 1 --2- 172.21.15.88:0/1686683487 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fed6407d140 0x7fed6407f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:53.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.936+0000 7fed7659c640 1 --2- 172.21.15.88:0/1686683487 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fed6407d140 0x7fed6407f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:53.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.936+0000 7fed6f7fe640 1 -- 172.21.15.88:0/1686683487 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6070+0+0 (secure 0 0 0) 0x7fed6009dbd0 con 0x7fed78101a60 2024-09-17T04:25:53.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.936+0000 7fed7659c640 1 --2- 172.21.15.88:0/1686683487 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fed6407d140 0x7fed6407f600 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fed700096c0 tx=0x7fed70009650 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:53.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:53.940+0000 7fed6f7fe640 1 -- 172.21.15.88:0/1686683487 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fed60069220 con 0x7fed78101a60 2024-09-17T04:25:54.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.187+0000 7fed7cc70640 1 -- 172.21.15.88:0/1686683487 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fed7818ff20 con 0x7fed78101a60 2024-09-17T04:25:54.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.188+0000 7fed6f7fe640 1 -- 172.21.15.88:0/1686683487 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7fed6006e0d0 con 0x7fed78101a60 2024-09-17T04:25:54.188 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-17T04:25:54.188 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-09-17T04:25:54.188 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T04:25:54.188 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:25:54.188 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-09-17T04:25:54.188 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T04:25:54.188 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:25:54.188 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-09-17T04:25:54.188 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2, 2024-09-17T04:25:54.188 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 4 2024-09-17T04:25:54.188 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:25:54.188 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2024-09-17T04:25:54.188 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T04:25:54.189 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:25:54.189 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-09-17T04:25:54.189 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6, 2024-09-17T04:25:54.189 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 8 2024-09-17T04:25:54.189 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-17T04:25:54.189 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-17T04:25:54.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.190+0000 7fed7cc70640 1 -- 172.21.15.88:0/1686683487 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fed6407d140 msgr2=0x7fed6407f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:54.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.190+0000 7fed7cc70640 1 --2- 172.21.15.88:0/1686683487 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fed6407d140 0x7fed6407f600 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fed700096c0 tx=0x7fed70009650 comp rx=0 tx=0).stop 2024-09-17T04:25:54.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.190+0000 7fed7cc70640 1 -- 172.21.15.88:0/1686683487 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed78101a60 msgr2=0x7fed78196910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:54.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.190+0000 7fed7cc70640 1 --2- 172.21.15.88:0/1686683487 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed78101a60 0x7fed78196910 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fed6000d6f0 tx=0x7fed6000dbb0 comp rx=0 tx=0).stop 2024-09-17T04:25:54.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.190+0000 7fed7cc70640 1 -- 172.21.15.88:0/1686683487 shutdown_connections 2024-09-17T04:25:54.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.190+0000 7fed7cc70640 1 --2- 172.21.15.88:0/1686683487 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fed6407d140 0x7fed6407f600 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:54.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.190+0000 7fed7cc70640 1 --2- 172.21.15.88:0/1686683487 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed78101a60 0x7fed78196910 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:54.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.190+0000 7fed7cc70640 1 --2- 172.21.15.88:0/1686683487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed78100860 0x7fed781963d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:54.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.190+0000 7fed7cc70640 1 -- 172.21.15.88:0/1686683487 >> 172.21.15.88:0/1686683487 conn(0x7fed780fc010 msgr2=0x7fed78104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:54.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.190+0000 7fed7cc70640 1 -- 172.21.15.88:0/1686683487 shutdown_connections 2024-09-17T04:25:54.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.190+0000 7fed7cc70640 1 -- 172.21.15.88:0/1686683487 wait complete. 2024-09-17T04:25:54.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.273+0000 7fd3656d2640 1 -- 172.21.15.88:0/902595491 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd360101960 msgr2=0x7fd360101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:54.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.273+0000 7fd3656d2640 1 --2- 172.21.15.88:0/902595491 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd360101960 0x7fd360101d60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd350009880 tx=0x7fd35002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:25:54.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.273+0000 7fd3656d2640 1 -- 172.21.15.88:0/902595491 shutdown_connections 2024-09-17T04:25:54.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.273+0000 7fd3656d2640 1 --2- 172.21.15.88:0/902595491 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd360102b60 0x7fd360102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:54.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.273+0000 7fd3656d2640 1 --2- 172.21.15.88:0/902595491 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd360101960 0x7fd360101d60 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:54.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.273+0000 7fd3656d2640 1 -- 172.21.15.88:0/902595491 >> 172.21.15.88:0/902595491 conn(0x7fd3600fd0f0 msgr2=0x7fd3600ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:54.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.273+0000 7fd3656d2640 1 -- 172.21.15.88:0/902595491 shutdown_connections 2024-09-17T04:25:54.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.273+0000 7fd3656d2640 1 -- 172.21.15.88:0/902595491 wait complete. 2024-09-17T04:25:54.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.274+0000 7fd3656d2640 1 Processor -- start 2024-09-17T04:25:54.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.274+0000 7fd3656d2640 1 -- start start 2024-09-17T04:25:54.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.274+0000 7fd3656d2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd360101960 0x7fd360197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:54.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.274+0000 7fd3656d2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd360102b60 0x7fd360197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:54.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.274+0000 7fd3656d2640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fd36010a800 con 0x7fd360102b60 2024-09-17T04:25:54.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.274+0000 7fd3656d2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd36010a680 con 0x7fd360101960 2024-09-17T04:25:54.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.274+0000 7fd35e7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd360102b60 0x7fd360197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:54.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.274+0000 7fd35e7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd360102b60 0x7fd360197a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46306/0 (socket says 172.21.15.88:46306) 2024-09-17T04:25:54.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.274+0000 7fd35e7fc640 1 -- 172.21.15.88:0/548053462 learned_addr learned my addr 172.21.15.88:0/548053462 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:25:54.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.275+0000 7fd35effd640 1 --2- 172.21.15.88:0/548053462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd360101960 0x7fd360197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:54.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.275+0000 7fd35e7fc640 1 -- 172.21.15.88:0/548053462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd360101960 msgr2=0x7fd360197510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:54.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.275+0000 7fd35e7fc640 1 --2- 172.21.15.88:0/548053462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd360101960 0x7fd360197510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:54.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.275+0000 7fd35e7fc640 1 -- 172.21.15.88:0/548053462 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3601980d0 con 0x7fd360102b60 2024-09-17T04:25:54.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.275+0000 7fd35e7fc640 1 --2- 172.21.15.88:0/548053462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd360102b60 0x7fd360197a50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd35400b420 tx=0x7fd35400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:54.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.275+0000 7fd347fff640 1 -- 172.21.15.88:0/548053462 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd354011630 con 0x7fd360102b60 2024-09-17T04:25:54.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.275+0000 7fd3656d2640 1 -- 172.21.15.88:0/548053462 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd36019cb10 con 0x7fd360102b60 2024-09-17T04:25:54.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.275+0000 7fd347fff640 1 -- 172.21.15.88:0/548053462 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd354016070 con 0x7fd360102b60 2024-09-17T04:25:54.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.275+0000 7fd3656d2640 1 -- 172.21.15.88:0/548053462 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd36019d120 con 0x7fd360102b60 2024-09-17T04:25:54.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.275+0000 7fd347fff640 1 -- 172.21.15.88:0/548053462 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd354010d40 con 0x7fd360102b60 2024-09-17T04:25:54.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.277+0000 7fd3656d2640 1 -- 172.21.15.88:0/548053462 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd360101d60 con 0x7fd360102b60 2024-09-17T04:25:54.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.277+0000 7fd347fff640 1 -- 172.21.15.88:0/548053462 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fd35401b460 con 0x7fd360102b60 2024-09-17T04:25:54.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.277+0000 7fd347fff640 1 --2- 172.21.15.88:0/548053462 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fd34807af80 0x7fd34807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:54.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.277+0000 7fd35effd640 1 --2- 172.21.15.88:0/548053462 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fd34807af80 0x7fd34807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:54.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.277+0000 7fd347fff640 1 -- 172.21.15.88:0/548053462 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6070+0+0 (secure 0 0 0) 0x7fd35409d6d0 con 0x7fd360102b60 2024-09-17T04:25:54.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.278+0000 7fd35effd640 1 --2- 172.21.15.88:0/548053462 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fd34807af80 0x7fd34807d440 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd350006010 tx=0x7fd350000bc0 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:54.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.282+0000 7fd347fff640 1 -- 172.21.15.88:0/548053462 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fd354068da0 con 0x7fd360102b60 2024-09-17T04:25:54.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.492+0000 7fd3656d2640 1 -- 172.21.15.88:0/548053462 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fd36002d7c0 con 0x7fd360102b60 2024-09-17T04:25:54.493 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:54 smithi088 ceph-mon[90867]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:25:54.493 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:54 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/1686683487' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:25:54.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.492+0000 7fd347fff640 1 -- 172.21.15.88:0/548053462 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) ==== 76+0+2045 (secure 0 0 0) 0x7fd35406dc50 con 0x7fd360102b60 2024-09-17T04:25:54.494 INFO:teuthology.orchestra.run.smithi088.stdout:e15 2024-09-17T04:25:54.494 INFO:teuthology.orchestra.run.smithi088.stdout:btime 2024-09-17T04:18:27:750910+0000 2024-09-17T04:25:54.494 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T04:25:54.494 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:25:54.495 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2024-09-17T04:25:54.495 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:25:54.495 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2024-09-17T04:25:54.495 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2024-09-17T04:25:54.495 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 15 2024-09-17T04:25:54.495 INFO:teuthology.orchestra.run.smithi088.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T04:25:54.495 INFO:teuthology.orchestra.run.smithi088.stdout:created 2024-09-17T04:18:10.480573+0000 2024-09-17T04:25:54.495 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2024-09-17T04:18:27.750896+0000 2024-09-17T04:25:54.496 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2024-09-17T04:25:54.496 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2024-09-17T04:25:54.496 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2024-09-17T04:25:54.496 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2024-09-17T04:25:54.496 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2024-09-17T04:25:54.496 INFO:teuthology.orchestra.run.smithi088.stdout:max_xattr_size 65536 2024-09-17T04:25:54.496 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2024-09-17T04:25:54.497 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2024-09-17T04:25:54.497 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 45 2024-09-17T04:25:54.497 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:25:54.497 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 1 2024-09-17T04:25:54.497 INFO:teuthology.orchestra.run.smithi088.stdout:in 0 2024-09-17T04:25:54.497 INFO:teuthology.orchestra.run.smithi088.stdout:up {0=14590} 2024-09-17T04:25:54.498 INFO:teuthology.orchestra.run.smithi088.stdout:failed 2024-09-17T04:25:54.498 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2024-09-17T04:25:54.498 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2024-09-17T04:25:54.498 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2024-09-17T04:25:54.498 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2024-09-17T04:25:54.498 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data enabled 2024-09-17T04:25:54.499 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2024-09-17T04:25:54.499 INFO:teuthology.orchestra.run.smithi088.stdout:bal_rank_mask -1 2024-09-17T04:25:54.499 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 1 2024-09-17T04:25:54.499 INFO:teuthology.orchestra.run.smithi088.stdout:qdb_cluster leader: 14590 members: 14590 2024-09-17T04:25:54.499 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.giqrgt{0:14590} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.88:6828/1714846518,v1:172.21.15.88:6829/1714846518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:25:54.499 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi134.psnynp{0:24321} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.134:6826/2137586894,v1:172.21.15.134:6827/2137586894] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:25:54.499 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:25:54.500 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:25:54.500 INFO:teuthology.orchestra.run.smithi088.stdout:Standby daemons: 2024-09-17T04:25:54.500 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:25:54.500 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi134.ktuhce{-1:24325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/967997022,v1:172.21.15.134:6825/967997022] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:25:54.500 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.lgavsv{-1:24329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/1425146180,v1:172.21.15.88:6827/1425146180] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:25:54.500 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 15 2024-09-17T04:25:54.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.494+0000 7fd3656d2640 1 -- 172.21.15.88:0/548053462 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fd34807af80 msgr2=0x7fd34807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:54.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.494+0000 7fd3656d2640 1 --2- 172.21.15.88:0/548053462 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fd34807af80 0x7fd34807d440 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd350006010 tx=0x7fd350000bc0 comp rx=0 tx=0).stop 2024-09-17T04:25:54.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.494+0000 7fd3656d2640 1 -- 172.21.15.88:0/548053462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd360102b60 msgr2=0x7fd360197a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:54.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.494+0000 7fd3656d2640 1 --2- 172.21.15.88:0/548053462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd360102b60 0x7fd360197a50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd35400b420 tx=0x7fd35400b8e0 comp rx=0 tx=0).stop 2024-09-17T04:25:54.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.495+0000 7fd3656d2640 1 -- 172.21.15.88:0/548053462 shutdown_connections 2024-09-17T04:25:54.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.495+0000 7fd3656d2640 1 --2- 172.21.15.88:0/548053462 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fd34807af80 0x7fd34807d440 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:54.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.495+0000 7fd3656d2640 1 --2- 172.21.15.88:0/548053462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd360102b60 0x7fd360197a50 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:54.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.495+0000 7fd3656d2640 1 --2- 172.21.15.88:0/548053462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd360101960 0x7fd360197510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:54.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.495+0000 7fd3656d2640 1 -- 172.21.15.88:0/548053462 >> 172.21.15.88:0/548053462 conn(0x7fd3600fd0f0 msgr2=0x7fd360105fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:54.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.495+0000 7fd3656d2640 1 -- 172.21.15.88:0/548053462 shutdown_connections 2024-09-17T04:25:54.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.495+0000 7fd3656d2640 1 -- 172.21.15.88:0/548053462 wait complete. 2024-09-17T04:25:54.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.578+0000 7f93ea79d640 1 -- 172.21.15.88:0/1322063383 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93e4101880 msgr2=0x7f93e4101d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:54.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.578+0000 7f93ea79d640 1 --2- 172.21.15.88:0/1322063383 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93e4101880 0x7f93e4101d00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f93d4009880 tx=0x7f93d402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:25:54.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.578+0000 7f93ea79d640 1 -- 172.21.15.88:0/1322063383 shutdown_connections 2024-09-17T04:25:54.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.578+0000 7f93ea79d640 1 --2- 172.21.15.88:0/1322063383 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93e4101880 0x7f93e4101d00 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:54.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.578+0000 7f93ea79d640 1 --2- 172.21.15.88:0/1322063383 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93e4100680 0x7f93e4100a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:54.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.578+0000 7f93ea79d640 1 -- 172.21.15.88:0/1322063383 >> 172.21.15.88:0/1322063383 conn(0x7f93e40fbe30 msgr2=0x7f93e40fe250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:54.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.578+0000 7f93ea79d640 1 -- 172.21.15.88:0/1322063383 shutdown_connections 2024-09-17T04:25:54.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.578+0000 7f93ea79d640 1 -- 172.21.15.88:0/1322063383 wait complete. 2024-09-17T04:25:54.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.578+0000 7f93ea79d640 1 Processor -- start 2024-09-17T04:25:54.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.578+0000 7f93ea79d640 1 -- start start 2024-09-17T04:25:54.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.578+0000 7f93ea79d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93e4100680 0x7f93e41994c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:54.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.579+0000 7f93ea79d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93e4101880 0x7f93e4199a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:54.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.579+0000 7f93ea79d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f93e4108390 con 0x7f93e4100680 2024-09-17T04:25:54.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.579+0000 7f93ea79d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f93e4108210 con 0x7f93e4101880 2024-09-17T04:25:54.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.579+0000 7f93e979b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93e4100680 0x7f93e41994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:54.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.579+0000 7f93e979b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93e4100680 0x7f93e41994c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46322/0 (socket says 172.21.15.88:46322) 2024-09-17T04:25:54.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.579+0000 7f93e979b640 1 -- 172.21.15.88:0/348562526 learned_addr learned my addr 172.21.15.88:0/348562526 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:25:54.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.579+0000 7f93e8f9a640 1 --2- 172.21.15.88:0/348562526 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93e4101880 0x7f93e4199a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:54.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.579+0000 7f93e979b640 1 -- 172.21.15.88:0/348562526 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93e4101880 msgr2=0x7f93e4199a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:54.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.579+0000 7f93e979b640 1 --2- 172.21.15.88:0/348562526 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93e4101880 0x7f93e4199a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:54.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.579+0000 7f93e979b640 1 -- 172.21.15.88:0/348562526 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93e4199ff0 con 0x7f93e4100680 2024-09-17T04:25:54.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.579+0000 7f93e979b640 1 --2- 172.21.15.88:0/348562526 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93e4100680 0x7f93e41994c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f93e000c8f0 tx=0x7f93e000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:54.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.579+0000 7f93da7fc640 1 -- 172.21.15.88:0/348562526 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f93e0004020 con 0x7f93e4100680 2024-09-17T04:25:54.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.579+0000 7f93ea79d640 1 -- 172.21.15.88:0/348562526 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93e419ea60 con 0x7f93e4100680 2024-09-17T04:25:54.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.579+0000 7f93da7fc640 1 -- 172.21.15.88:0/348562526 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f93e0007e10 con 0x7f93e4100680 2024-09-17T04:25:54.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.579+0000 7f93da7fc640 1 -- 172.21.15.88:0/348562526 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f93e0003e10 con 0x7f93e4100680 2024-09-17T04:25:54.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.579+0000 7f93ea79d640 1 -- 172.21.15.88:0/348562526 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93e419efc0 con 0x7f93e4100680 2024-09-17T04:25:54.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.580+0000 7f93ea79d640 1 -- 172.21.15.88:0/348562526 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93e4100a80 con 0x7f93e4100680 2024-09-17T04:25:54.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.581+0000 7f93da7fc640 1 -- 172.21.15.88:0/348562526 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f93e00041c0 con 0x7f93e4100680 2024-09-17T04:25:54.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.581+0000 7f93da7fc640 1 --2- 172.21.15.88:0/348562526 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f93d007af30 0x7f93d007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:54.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.582+0000 7f93da7fc640 1 -- 172.21.15.88:0/348562526 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6070+0+0 (secure 0 0 0) 0x7f93e009e170 con 0x7f93e4100680 2024-09-17T04:25:54.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.582+0000 7f93e8f9a640 1 --2- 172.21.15.88:0/348562526 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f93d007af30 0x7f93d007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:54.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.582+0000 7f93e8f9a640 1 --2- 172.21.15.88:0/348562526 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f93d007af30 0x7f93d007d3f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f93d4006010 tx=0x7f93d4000bc0 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:54.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.586+0000 7f93da7fc640 1 -- 172.21.15.88:0/348562526 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f93e00697c0 con 0x7f93e4100680 2024-09-17T04:25:54.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:54 smithi134 ceph-mon[76677]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:25:54.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:54 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/1686683487' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:25:54.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.779+0000 7f93ea79d640 1 -- 172.21.15.88:0/348562526 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f93e4105e80 con 0x7f93d007af30 2024-09-17T04:25:54.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.780+0000 7f93da7fc640 1 -- 172.21.15.88:0/348562526 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f93e4105e80 con 0x7f93d007af30 2024-09-17T04:25:54.780 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-17T04:25:54.780 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f", 2024-09-17T04:25:54.781 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-09-17T04:25:54.781 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T04:25:54.781 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [ 2024-09-17T04:25:54.781 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr", 2024-09-17T04:25:54.781 INFO:teuthology.orchestra.run.smithi088.stdout: "mon", 2024-09-17T04:25:54.781 INFO:teuthology.orchestra.run.smithi088.stdout: "crash" 2024-09-17T04:25:54.781 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-17T04:25:54.781 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "10/23 daemons upgraded", 2024-09-17T04:25:54.781 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading osd daemons", 2024-09-17T04:25:54.781 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-09-17T04:25:54.781 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-17T04:25:54.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.782+0000 7f93ea79d640 1 -- 172.21.15.88:0/348562526 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f93d007af30 msgr2=0x7f93d007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:54.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.782+0000 7f93ea79d640 1 --2- 172.21.15.88:0/348562526 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f93d007af30 0x7f93d007d3f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f93d4006010 tx=0x7f93d4000bc0 comp rx=0 tx=0).stop 2024-09-17T04:25:54.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.782+0000 7f93ea79d640 1 -- 172.21.15.88:0/348562526 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93e4100680 msgr2=0x7f93e41994c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:54.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.782+0000 7f93ea79d640 1 --2- 172.21.15.88:0/348562526 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93e4100680 0x7f93e41994c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f93e000c8f0 tx=0x7f93e000cdb0 comp rx=0 tx=0).stop 2024-09-17T04:25:54.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.782+0000 7f93ea79d640 1 -- 172.21.15.88:0/348562526 shutdown_connections 2024-09-17T04:25:54.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.782+0000 7f93ea79d640 1 --2- 172.21.15.88:0/348562526 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f93d007af30 0x7f93d007d3f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:54.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.782+0000 7f93ea79d640 1 --2- 172.21.15.88:0/348562526 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93e4101880 0x7f93e4199a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:54.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.782+0000 7f93ea79d640 1 --2- 172.21.15.88:0/348562526 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93e4100680 0x7f93e41994c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:54.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.782+0000 7f93ea79d640 1 -- 172.21.15.88:0/348562526 >> 172.21.15.88:0/348562526 conn(0x7f93e40fbe30 msgr2=0x7f93e40fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:54.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.783+0000 7f93ea79d640 1 -- 172.21.15.88:0/348562526 shutdown_connections 2024-09-17T04:25:54.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.783+0000 7f93ea79d640 1 -- 172.21.15.88:0/348562526 wait complete. 2024-09-17T04:25:54.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.864+0000 7fba0c89c640 1 -- 172.21.15.88:0/1730255752 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba08101960 msgr2=0x7fba08101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:54.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.864+0000 7fba0c89c640 1 --2- 172.21.15.88:0/1730255752 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba08101960 0x7fba08101d60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8009880 tx=0x7fb9f802a4a0 comp rx=0 tx=0).stop 2024-09-17T04:25:54.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.864+0000 7fba0c89c640 1 -- 172.21.15.88:0/1730255752 shutdown_connections 2024-09-17T04:25:54.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.864+0000 7fba0c89c640 1 --2- 172.21.15.88:0/1730255752 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba08102b60 0x7fba08102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:54.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.864+0000 7fba0c89c640 1 --2- 172.21.15.88:0/1730255752 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba08101960 0x7fba08101d60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:54.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.864+0000 7fba0c89c640 1 -- 172.21.15.88:0/1730255752 >> 172.21.15.88:0/1730255752 conn(0x7fba080fd0f0 msgr2=0x7fba080ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:54.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.864+0000 7fba0c89c640 1 -- 172.21.15.88:0/1730255752 shutdown_connections 2024-09-17T04:25:54.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.864+0000 7fba0c89c640 1 -- 172.21.15.88:0/1730255752 wait complete. 2024-09-17T04:25:54.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.865+0000 7fba0c89c640 1 Processor -- start 2024-09-17T04:25:54.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.865+0000 7fba0c89c640 1 -- start start 2024-09-17T04:25:54.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.865+0000 7fba0c89c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba08101960 0x7fba081974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:54.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.865+0000 7fba0c89c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba08102b60 0x7fba08197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:54.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.865+0000 7fba0c89c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fba0810a7a0 con 0x7fba08101960 2024-09-17T04:25:54.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.865+0000 7fba0c89c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fba0810a620 con 0x7fba08102b60 2024-09-17T04:25:54.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.865+0000 7fba0659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba08101960 0x7fba081974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:54.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.865+0000 7fba0659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba08101960 0x7fba081974d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46330/0 (socket says 172.21.15.88:46330) 2024-09-17T04:25:54.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.865+0000 7fba0659c640 1 -- 172.21.15.88:0/2607397742 learned_addr learned my addr 172.21.15.88:0/2607397742 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:25:54.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.866+0000 7fba0659c640 1 -- 172.21.15.88:0/2607397742 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba08102b60 msgr2=0x7fba08197a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:54.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.866+0000 7fba0659c640 1 --2- 172.21.15.88:0/2607397742 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba08102b60 0x7fba08197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:54.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.866+0000 7fba0659c640 1 -- 172.21.15.88:0/2607397742 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba08198090 con 0x7fba08101960 2024-09-17T04:25:54.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.866+0000 7fba0659c640 1 --2- 172.21.15.88:0/2607397742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba08101960 0x7fba081974d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8006010 tx=0x7fb9f80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:54.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.866+0000 7fb9f77fe640 1 -- 172.21.15.88:0/2607397742 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb9f803f070 con 0x7fba08101960 2024-09-17T04:25:54.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.866+0000 7fba0c89c640 1 -- 172.21.15.88:0/2607397742 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba0819ca70 con 0x7fba08101960 2024-09-17T04:25:54.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.866+0000 7fb9f77fe640 1 -- 172.21.15.88:0/2607397742 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb9f80044d0 con 0x7fba08101960 2024-09-17T04:25:54.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.866+0000 7fb9f77fe640 1 -- 172.21.15.88:0/2607397742 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb9f8035030 con 0x7fba08101960 2024-09-17T04:25:54.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.866+0000 7fba0c89c640 1 -- 172.21.15.88:0/2607397742 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba0819d000 con 0x7fba08101960 2024-09-17T04:25:54.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.867+0000 7fba0c89c640 1 -- 172.21.15.88:0/2607397742 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba08101d60 con 0x7fba08101960 2024-09-17T04:25:54.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.868+0000 7fb9f77fe640 1 -- 172.21.15.88:0/2607397742 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fb9f8042070 con 0x7fba08101960 2024-09-17T04:25:54.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.868+0000 7fb9f77fe640 1 --2- 172.21.15.88:0/2607397742 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fb9f007af30 0x7fb9f007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:54.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.868+0000 7fb9f77fe640 1 -- 172.21.15.88:0/2607397742 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6070+0+0 (secure 0 0 0) 0x7fb9f80bec90 con 0x7fba08101960 2024-09-17T04:25:54.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.868+0000 7fba05d9b640 1 --2- 172.21.15.88:0/2607397742 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fb9f007af30 0x7fb9f007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:54.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.869+0000 7fba05d9b640 1 --2- 172.21.15.88:0/2607397742 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fb9f007af30 0x7fb9f007d3f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fba08198980 tx=0x7fb9fc005bf0 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:54.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:54.873+0000 7fb9f77fe640 1 -- 172.21.15.88:0/2607397742 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fb9f808a2e0 con 0x7fba08101960 2024-09-17T04:25:55.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:55.116+0000 7fba0c89c640 1 -- 172.21.15.88:0/2607397742 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fba08062df0 con 0x7fba08101960 2024-09-17T04:25:55.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:55.116+0000 7fb9f77fe640 1 -- 172.21.15.88:0/2607397742 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1039 (secure 0 0 0) 0x7fb9f808f190 con 0x7fba08101960 2024-09-17T04:25:55.116 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Degraded data redundancy: 38/276 objects degraded (13.768%), 12 pgs degraded 2024-09-17T04:25:55.116 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T04:25:55.116 INFO:teuthology.orchestra.run.smithi088.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T04:25:55.116 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 38/276 objects degraded (13.768%), 12 pgs degraded 2024-09-17T04:25:55.116 INFO:teuthology.orchestra.run.smithi088.stdout: pg 1.0 is active+undersized+degraded, acting [0,1] 2024-09-17T04:25:55.116 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.0 is active+undersized+degraded, acting [1,0] 2024-09-17T04:25:55.117 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.5 is active+undersized+degraded, acting [0,4] 2024-09-17T04:25:55.117 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.7 is active+undersized+degraded, acting [4,2] 2024-09-17T04:25:55.117 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.8 is active+undersized+degraded, acting [5,0] 2024-09-17T04:25:55.117 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.b is active+undersized+degraded, acting [4,5] 2024-09-17T04:25:55.117 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.c is active+undersized+degraded, acting [2,0] 2024-09-17T04:25:55.117 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.e is active+undersized+degraded, acting [2,0] 2024-09-17T04:25:55.117 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.14 is active+undersized+degraded, acting [4,5] 2024-09-17T04:25:55.117 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.1a is active+undersized+degraded, acting [4,5] 2024-09-17T04:25:55.117 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.1d is active+undersized+degraded, acting [5,0] 2024-09-17T04:25:55.117 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.1f is active+undersized+degraded, acting [0,4] 2024-09-17T04:25:55.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:55.118+0000 7fba0c89c640 1 -- 172.21.15.88:0/2607397742 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fb9f007af30 msgr2=0x7fb9f007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:55.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:55.118+0000 7fba0c89c640 1 --2- 172.21.15.88:0/2607397742 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fb9f007af30 0x7fb9f007d3f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fba08198980 tx=0x7fb9fc005bf0 comp rx=0 tx=0).stop 2024-09-17T04:25:55.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:55.118+0000 7fba0c89c640 1 -- 172.21.15.88:0/2607397742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba08101960 msgr2=0x7fba081974d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:55.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:55.118+0000 7fba0c89c640 1 --2- 172.21.15.88:0/2607397742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba08101960 0x7fba081974d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8006010 tx=0x7fb9f80048f0 comp rx=0 tx=0).stop 2024-09-17T04:25:55.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:55.118+0000 7fba0c89c640 1 -- 172.21.15.88:0/2607397742 shutdown_connections 2024-09-17T04:25:55.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:55.118+0000 7fba0c89c640 1 --2- 172.21.15.88:0/2607397742 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fb9f007af30 0x7fb9f007d3f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:55.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:55.118+0000 7fba0c89c640 1 --2- 172.21.15.88:0/2607397742 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba08102b60 0x7fba08197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:55.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:55.118+0000 7fba0c89c640 1 --2- 172.21.15.88:0/2607397742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba08101960 0x7fba081974d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:55.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:55.118+0000 7fba0c89c640 1 -- 172.21.15.88:0/2607397742 >> 172.21.15.88:0/2607397742 conn(0x7fba080fd0f0 msgr2=0x7fba08106060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:55.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:55.118+0000 7fba0c89c640 1 -- 172.21.15.88:0/2607397742 shutdown_connections 2024-09-17T04:25:55.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:25:55.119+0000 7fba0c89c640 1 -- 172.21.15.88:0/2607397742 wait complete. 2024-09-17T04:25:55.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:55 smithi088 ceph-mon[90867]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:25:55.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:55 smithi088 ceph-mon[90867]: from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:25:55.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:55 smithi088 ceph-mon[90867]: pgmap v135: 65 pgs: 7 peering, 58 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 2 op/s 2024-09-17T04:25:55.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:55 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/548053462' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T04:25:55.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:55 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/2607397742' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T04:25:55.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:55 smithi134 ceph-mon[76677]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:25:55.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:55 smithi134 ceph-mon[76677]: from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:25:55.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:55 smithi134 ceph-mon[76677]: pgmap v135: 65 pgs: 7 peering, 58 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 2 op/s 2024-09-17T04:25:55.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:55 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/548053462' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T04:25:55.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:55 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/2607397742' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T04:25:56.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:56 smithi088 ceph-mon[90867]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:25:56.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:56 smithi088 ceph-mon[90867]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 38/276 objects degraded (13.768%), 12 pgs degraded) 2024-09-17T04:25:56.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:56 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:25:56.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:56 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:25:56.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:56 smithi134 ceph-mon[76677]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:25:56.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:56 smithi134 ceph-mon[76677]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 38/276 objects degraded (13.768%), 12 pgs degraded) 2024-09-17T04:25:56.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:56 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:25:56.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:56 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:25:57.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:57 smithi088 ceph-mon[90867]: pgmap v136: 65 pgs: 65 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 846 B/s rd, 1 op/s 2024-09-17T04:25:57.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:57 smithi134 ceph-mon[76677]: pgmap v136: 65 pgs: 65 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 846 B/s rd, 1 op/s 2024-09-17T04:25:58.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:25:58 smithi088 ceph-mon[90867]: pgmap v137: 65 pgs: 65 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 744 B/s rd, 1 op/s 2024-09-17T04:25:58.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:25:58 smithi134 ceph-mon[76677]: pgmap v137: 65 pgs: 65 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 744 B/s rd, 1 op/s 2024-09-17T04:26:00.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:00 smithi088 ceph-mon[90867]: pgmap v138: 65 pgs: 65 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-17T04:26:00.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:00 smithi134 ceph-mon[76677]: pgmap v138: 65 pgs: 65 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-17T04:26:02.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:02 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-17T04:26:02.645 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:02 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-17T04:26:03.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:03 smithi088 ceph-mon[90867]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-17T04:26:03.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:03 smithi088 ceph-mon[90867]: Upgrade: osd.4 is safe to restart 2024-09-17T04:26:03.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:03 smithi088 ceph-mon[90867]: pgmap v139: 65 pgs: 65 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1000 B/s rd, 1 op/s 2024-09-17T04:26:03.645 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:03 smithi134 ceph-mon[76677]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-17T04:26:03.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:03 smithi134 ceph-mon[76677]: Upgrade: osd.4 is safe to restart 2024-09-17T04:26:03.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:03 smithi134 ceph-mon[76677]: pgmap v139: 65 pgs: 65 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1000 B/s rd, 1 op/s 2024-09-17T04:26:04.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:04 smithi088 ceph-mon[90867]: Upgrade: Updating osd.4 2024-09-17T04:26:04.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:04 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:04.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:04 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-17T04:26:04.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:04 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:26:04.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:04 smithi088 ceph-mon[90867]: Deploying daemon osd.4 on smithi134 2024-09-17T04:26:04.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:04 smithi088 ceph-mon[90867]: pgmap v140: 65 pgs: 65 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-17T04:26:04.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:04 smithi134 ceph-mon[76677]: Upgrade: Updating osd.4 2024-09-17T04:26:04.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:04 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:04.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:04 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-17T04:26:04.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:04 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:26:04.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:04 smithi134 ceph-mon[76677]: Deploying daemon osd.4 on smithi134 2024-09-17T04:26:04.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:04 smithi134 ceph-mon[76677]: pgmap v140: 65 pgs: 65 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-17T04:26:06.849 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:06 smithi134 systemd[1]: Stopping Ceph osd.4 for bf2b79a4-74aa-11ef-bceb-c7b262605968... 2024-09-17T04:26:07.112 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:06 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4[48024]: 2024-09-17T04:26:06.857+0000 7f0e6e364640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T04:26:07.112 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:06 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4[48024]: 2024-09-17T04:26:06.857+0000 7f0e6e364640 -1 osd.4 67 *** Got signal Terminated *** 2024-09-17T04:26:07.112 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:06 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4[48024]: 2024-09-17T04:26:06.857+0000 7f0e6e364640 -1 osd.4 67 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T04:26:07.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:07 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:07.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:07 smithi088 ceph-mon[90867]: pgmap v141: 65 pgs: 65 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:26:07.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:07 smithi088 ceph-mon[90867]: osd.4 marked itself down and dead 2024-09-17T04:26:07.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:07 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:07.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:07 smithi134 ceph-mon[76677]: pgmap v141: 65 pgs: 65 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:26:07.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:07 smithi134 ceph-mon[76677]: osd.4 marked itself down and dead 2024-09-17T04:26:07.896 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:07 smithi134 podman[89239]: 2024-09-17 04:26:07.600121146 +0000 UTC m=+0.851474384 container died eacc25537b3a4cef1199a60c95a326ab37adb886320a9d358402cfe11d20014b (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-17T04:26:08.342 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:08 smithi134 ceph-mon[76677]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T04:26:08.342 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:08 smithi134 ceph-mon[76677]: osdmap e68: 6 total, 5 up, 6 in 2024-09-17T04:26:08.342 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:08 smithi134 podman[89239]: 2024-09-17 04:26:08.082720621 +0000 UTC m=+1.334073900 container cleanup eacc25537b3a4cef1199a60c95a326ab37adb886320a9d358402cfe11d20014b (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-17T04:26:08.342 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:08 smithi134 bash[89239]: ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4 2024-09-17T04:26:08.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:08 smithi088 ceph-mon[90867]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T04:26:08.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:08 smithi088 ceph-mon[90867]: osdmap e68: 6 total, 5 up, 6 in 2024-09-17T04:26:08.646 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:08 smithi134 podman[89266]: 2024-09-17 04:26:08.342506111 +0000 UTC m=+0.744456578 container remove eacc25537b3a4cef1199a60c95a326ab37adb886320a9d358402cfe11d20014b (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, ceph=True) 2024-09-17T04:26:08.912 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:08 smithi134 podman[89355]: 2024-09-17 04:26:08.558942193 +0000 UTC m=+0.015742600 image pull 8e039cb7fe1eece5854872e8884a61a26632c7691b2c85cbac9078a9c5c62fae quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f 2024-09-17T04:26:08.912 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:08 smithi134 podman[89355]: 2024-09-17 04:26:08.668336643 +0000 UTC m=+0.125137042 container create 9b8853eeea0a084891bd482ac18772a65a648d0102a526f3ea9816d2a2d18d54 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4-deactivate, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T04:26:08.912 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:08 smithi134 podman[89355]: 2024-09-17 04:26:08.912667955 +0000 UTC m=+0.369468373 container init 9b8853eeea0a084891bd482ac18772a65a648d0102a526f3ea9816d2a2d18d54 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-17T04:26:09.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:09 smithi088 ceph-mon[90867]: osdmap e69: 6 total, 5 up, 6 in 2024-09-17T04:26:09.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:09 smithi088 ceph-mon[90867]: pgmap v144: 65 pgs: 8 peering, 4 stale+active+clean, 53 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-09-17T04:26:09.390 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:09 smithi134 ceph-mon[76677]: osdmap e69: 6 total, 5 up, 6 in 2024-09-17T04:26:09.390 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:09 smithi134 ceph-mon[76677]: pgmap v144: 65 pgs: 8 peering, 4 stale+active+clean, 53 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-09-17T04:26:09.390 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:08 smithi134 podman[89355]: 2024-09-17 04:26:08.916108612 +0000 UTC m=+0.372909017 container start 9b8853eeea0a084891bd482ac18772a65a648d0102a526f3ea9816d2a2d18d54 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0) 2024-09-17T04:26:09.390 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:08 smithi134 podman[89355]: 2024-09-17 04:26:08.995865692 +0000 UTC m=+0.452666103 container attach 9b8853eeea0a084891bd482ac18772a65a648d0102a526f3ea9816d2a2d18d54 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4-deactivate, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-17T04:26:09.390 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:09 smithi134 podman[89355]: 2024-09-17 04:26:09.103973535 +0000 UTC m=+0.560773936 container died 9b8853eeea0a084891bd482ac18772a65a648d0102a526f3ea9816d2a2d18d54 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4-deactivate, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-17T04:26:10.112 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:09 smithi134 podman[89379]: 2024-09-17 04:26:09.682996365 +0000 UTC m=+0.572933967 container remove 9b8853eeea0a084891bd482ac18772a65a648d0102a526f3ea9816d2a2d18d54 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-17T04:26:10.112 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:09 smithi134 systemd[1]: ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968@osd.4.service: Deactivated successfully. 2024-09-17T04:26:10.112 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:09 smithi134 systemd[1]: Stopped Ceph osd.4 for bf2b79a4-74aa-11ef-bceb-c7b262605968. 2024-09-17T04:26:10.112 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:09 smithi134 systemd[1]: ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968@osd.4.service: Consumed 50.080s CPU time. 2024-09-17T04:26:10.112 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:09 smithi134 systemd[1]: Starting Ceph osd.4 for bf2b79a4-74aa-11ef-bceb-c7b262605968... 2024-09-17T04:26:10.364 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:10 smithi134 ceph-mon[76677]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-17T04:26:10.364 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:10 smithi134 podman[89477]: 2024-09-17 04:26:10.014479103 +0000 UTC m=+0.015620377 image pull 8e039cb7fe1eece5854872e8884a61a26632c7691b2c85cbac9078a9c5c62fae quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f 2024-09-17T04:26:10.364 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:10 smithi134 podman[89477]: 2024-09-17 04:26:10.12570361 +0000 UTC m=+0.126844870 container create 411fe3d25b507eb549799f7da794b8baf7180eb11091d9ded7d8413a8cc47dbe (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T04:26:10.364 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:10 smithi134 podman[89477]: 2024-09-17 04:26:10.36161022 +0000 UTC m=+0.362751485 container init 411fe3d25b507eb549799f7da794b8baf7180eb11091d9ded7d8413a8cc47dbe (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4-activate, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-17T04:26:10.365 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:10 smithi134 podman[89477]: 2024-09-17 04:26:10.365028021 +0000 UTC m=+0.366169289 container start 411fe3d25b507eb549799f7da794b8baf7180eb11091d9ded7d8413a8cc47dbe (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-17T04:26:10.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:10 smithi088 ceph-mon[90867]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-17T04:26:10.646 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:10 smithi134 podman[89477]: 2024-09-17 04:26:10.461669141 +0000 UTC m=+0.462810423 container attach 411fe3d25b507eb549799f7da794b8baf7180eb11091d9ded7d8413a8cc47dbe (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.schema-version=1.0) 2024-09-17T04:26:10.646 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:10 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4-activate[89492]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T04:26:10.646 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:10 smithi134 bash[89477]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T04:26:10.646 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:10 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4-activate[89492]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T04:26:10.646 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:10 smithi134 bash[89477]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T04:26:11.624 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:11 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4-activate[89492]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-17T04:26:11.624 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:11 smithi134 bash[89477]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-17T04:26:11.624 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:11 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4-activate[89492]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-17T04:26:11.624 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:11 smithi134 bash[89477]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-17T04:26:11.896 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:11 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4-activate[89492]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-17T04:26:11.897 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:11 smithi134 bash[89477]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-17T04:26:11.897 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:11 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4-activate[89492]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-17T04:26:11.897 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:11 smithi134 bash[89477]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-17T04:26:11.897 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:11 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4-activate[89492]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-17T04:26:11.897 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:11 smithi134 bash[89477]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-17T04:26:11.897 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:11 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4-activate[89492]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-17T04:26:11.897 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:11 smithi134 bash[89477]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-17T04:26:11.897 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:11 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4-activate[89492]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-17T04:26:11.897 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:11 smithi134 bash[89477]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-17T04:26:11.897 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:11 smithi134 podman[89477]: 2024-09-17 04:26:11.653020866 +0000 UTC m=+1.654162138 container died 411fe3d25b507eb549799f7da794b8baf7180eb11091d9ded7d8413a8cc47dbe (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T04:26:12.281 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:12 smithi134 ceph-mon[76677]: pgmap v145: 65 pgs: 12 active+undersized, 8 peering, 1 stale+active+clean, 9 active+undersized+degraded, 35 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 1 op/s; 28/276 objects degraded (10.145%) 2024-09-17T04:26:12.281 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:12.282 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:26:12.282 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:12 smithi134 ceph-mon[76677]: Health check failed: Degraded data redundancy: 28/276 objects degraded (10.145%), 9 pgs degraded (PG_DEGRADED) 2024-09-17T04:26:12.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:12 smithi088 ceph-mon[90867]: pgmap v145: 65 pgs: 12 active+undersized, 8 peering, 1 stale+active+clean, 9 active+undersized+degraded, 35 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 1 op/s; 28/276 objects degraded (10.145%) 2024-09-17T04:26:12.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:12.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:26:12.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:12 smithi088 ceph-mon[90867]: Health check failed: Degraded data redundancy: 28/276 objects degraded (10.145%), 9 pgs degraded (PG_DEGRADED) 2024-09-17T04:26:12.626 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:12 smithi134 podman[89632]: 2024-09-17 04:26:12.282048953 +0000 UTC m=+0.620785907 container remove 411fe3d25b507eb549799f7da794b8baf7180eb11091d9ded7d8413a8cc47dbe (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4-activate, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-17T04:26:12.626 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:12 smithi134 podman[89692]: 2024-09-17 04:26:12.39338552 +0000 UTC m=+0.015967455 image pull 8e039cb7fe1eece5854872e8884a61a26632c7691b2c85cbac9078a9c5c62fae quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f 2024-09-17T04:26:12.626 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:12 smithi134 podman[89692]: 2024-09-17 04:26:12.50801417 +0000 UTC m=+0.130596142 container create 6df8a692310a21bf1af83a7cfc98a091a745fe97358f9e2a9c2ec89660cc0a3c (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T04:26:12.896 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:12 smithi134 podman[89692]: 2024-09-17 04:26:12.769153709 +0000 UTC m=+0.391735635 container init 6df8a692310a21bf1af83a7cfc98a091a745fe97358f9e2a9c2ec89660cc0a3c (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-17T04:26:12.896 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:12 smithi134 podman[89692]: 2024-09-17 04:26:12.772514406 +0000 UTC m=+0.395096335 container start 6df8a692310a21bf1af83a7cfc98a091a745fe97358f9e2a9c2ec89660cc0a3c (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-17T04:26:12.896 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:12 smithi134 ceph-osd[89711]: -- 172.21.15.134:0/917068644 <== mon.1 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b4778261e0 con 0x55b476b17180 2024-09-17T04:26:13.396 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:13 smithi134 bash[89692]: 6df8a692310a21bf1af83a7cfc98a091a745fe97358f9e2a9c2ec89660cc0a3c 2024-09-17T04:26:13.396 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:13 smithi134 systemd[1]: Started Ceph osd.4 for bf2b79a4-74aa-11ef-bceb-c7b262605968. 2024-09-17T04:26:14.349 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:14 smithi134 ceph-mon[76677]: pgmap v146: 65 pgs: 15 active+undersized, 8 peering, 11 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 35/276 objects degraded (12.681%) 2024-09-17T04:26:14.350 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:14 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:14.350 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:14 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:14.350 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:14 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:26:14.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:14 smithi088 ceph-mon[90867]: pgmap v146: 65 pgs: 15 active+undersized, 8 peering, 11 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 35/276 objects degraded (12.681%) 2024-09-17T04:26:14.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:14 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:14.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:14 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:14.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:14 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:26:15.035 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:14 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4[89707]: 2024-09-17T04:26:14.687+0000 7f1c05ada640 -1 Falling back to public interface 2024-09-17T04:26:15.294 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:15 smithi134 ceph-mon[76677]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-17T04:26:15.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:15 smithi088 ceph-mon[90867]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-17T04:26:16.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:16 smithi088 ceph-mon[90867]: pgmap v147: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 1 op/s; 46/276 objects degraded (16.667%) 2024-09-17T04:26:16.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:16 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:16.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:16 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:16.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:16 smithi134 ceph-mon[76677]: pgmap v147: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 1 op/s; 46/276 objects degraded (16.667%) 2024-09-17T04:26:16.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:16 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:16.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:16 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:17.794 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:17 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:17.794 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:17 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:17.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:17 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:17.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:17 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:18.825 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:18 smithi134 ceph-mon[76677]: pgmap v148: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 219 B/s rd, 1 op/s; 46/276 objects degraded (16.667%) 2024-09-17T04:26:18.825 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:18 smithi134 ceph-mon[76677]: Health check update: Degraded data redundancy: 46/276 objects degraded (16.667%), 15 pgs degraded (PG_DEGRADED) 2024-09-17T04:26:18.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:18 smithi088 ceph-mon[90867]: pgmap v148: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 219 B/s rd, 1 op/s; 46/276 objects degraded (16.667%) 2024-09-17T04:26:18.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:18 smithi088 ceph-mon[90867]: Health check update: Degraded data redundancy: 46/276 objects degraded (16.667%), 15 pgs degraded (PG_DEGRADED) 2024-09-17T04:26:20.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:20 smithi088 ceph-mon[90867]: pgmap v149: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 197 B/s rd, 1 op/s; 46/276 objects degraded (16.667%) 2024-09-17T04:26:20.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:20 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:20.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:20 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:20.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:20 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:26:20.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:20 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:26:20.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:20 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:20.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:20 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:26:20.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:20 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:26:20.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:20 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:26:20.890 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:20 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:26:20.890 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:20 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-17T04:26:20.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:20 smithi134 ceph-mon[76677]: pgmap v149: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 197 B/s rd, 1 op/s; 46/276 objects degraded (16.667%) 2024-09-17T04:26:20.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:20 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:20.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:20 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:20.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:20 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:26:20.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:20 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:26:20.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:20 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:20.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:20 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:26:20.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:20 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:26:20.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:20 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:26:20.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:20 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:26:20.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:20 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-17T04:26:21.396 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:21 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4[89707]: 2024-09-17T04:26:21.088+0000 7f1c05ada640 -1 osd.4 67 log_to_monitors true 2024-09-17T04:26:21.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:21 smithi088 ceph-mon[90867]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-17T04:26:21.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:21 smithi088 ceph-mon[90867]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-17T04:26:21.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:21 smithi088 ceph-mon[90867]: from='osd.4 [v2:172.21.15.134:6808/2008638034,v1:172.21.15.134:6809/2008638034]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-17T04:26:21.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:21 smithi088 ceph-mon[90867]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-17T04:26:21.896 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:26:21 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4[89707]: 2024-09-17T04:26:21.478+0000 7f1bfd85a640 -1 osd.4 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T04:26:21.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:21 smithi134 ceph-mon[76677]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-17T04:26:21.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:21 smithi134 ceph-mon[76677]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-17T04:26:21.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:21 smithi134 ceph-mon[76677]: from='osd.4 [v2:172.21.15.134:6808/2008638034,v1:172.21.15.134:6809/2008638034]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-17T04:26:21.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:21 smithi134 ceph-mon[76677]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-17T04:26:22.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:22 smithi088 ceph-mon[90867]: pgmap v150: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 597 B/s rd, 1 op/s; 46/276 objects degraded (16.667%) 2024-09-17T04:26:22.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:22 smithi088 ceph-mon[90867]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-17T04:26:22.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:22 smithi088 ceph-mon[90867]: from='osd.4 [v2:172.21.15.134:6808/2008638034,v1:172.21.15.134:6809/2008638034]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-09-17T04:26:22.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:22 smithi088 ceph-mon[90867]: osdmap e70: 6 total, 5 up, 6 in 2024-09-17T04:26:22.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:22 smithi088 ceph-mon[90867]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-09-17T04:26:22.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:22 smithi134 ceph-mon[76677]: pgmap v150: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 597 B/s rd, 1 op/s; 46/276 objects degraded (16.667%) 2024-09-17T04:26:22.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:22 smithi134 ceph-mon[76677]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-17T04:26:22.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:22 smithi134 ceph-mon[76677]: from='osd.4 [v2:172.21.15.134:6808/2008638034,v1:172.21.15.134:6809/2008638034]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-09-17T04:26:22.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:22 smithi134 ceph-mon[76677]: osdmap e70: 6 total, 5 up, 6 in 2024-09-17T04:26:22.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:22 smithi134 ceph-mon[76677]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-09-17T04:26:23.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:23 smithi088 ceph-mon[90867]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T04:26:23.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:23 smithi088 ceph-mon[90867]: osd.4 [v2:172.21.15.134:6808/2008638034,v1:172.21.15.134:6809/2008638034] boot 2024-09-17T04:26:23.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:23 smithi088 ceph-mon[90867]: osdmap e71: 6 total, 6 up, 6 in 2024-09-17T04:26:23.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:23 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-17T04:26:23.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:23 smithi134 ceph-mon[76677]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T04:26:23.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:23 smithi134 ceph-mon[76677]: osd.4 [v2:172.21.15.134:6808/2008638034,v1:172.21.15.134:6809/2008638034] boot 2024-09-17T04:26:23.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:23 smithi134 ceph-mon[76677]: osdmap e71: 6 total, 6 up, 6 in 2024-09-17T04:26:23.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:23 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-17T04:26:24.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:24 smithi088 ceph-mon[90867]: pgmap v153: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 46/276 objects degraded (16.667%) 2024-09-17T04:26:24.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:24 smithi088 ceph-mon[90867]: osdmap e72: 6 total, 6 up, 6 in 2024-09-17T04:26:24.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:24 smithi134 ceph-mon[76677]: pgmap v153: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 46/276 objects degraded (16.667%) 2024-09-17T04:26:24.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:24 smithi134 ceph-mon[76677]: osdmap e72: 6 total, 6 up, 6 in 2024-09-17T04:26:25.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.213+0000 7faf2a898640 1 -- 172.21.15.88:0/75121566 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf24100ad0 msgr2=0x7faf24100f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:25.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.213+0000 7faf2a898640 1 --2- 172.21.15.88:0/75121566 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf24100ad0 0x7faf24100f50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7faf18009880 tx=0x7faf1802a4a0 comp rx=0 tx=0).stop 2024-09-17T04:26:25.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.213+0000 7faf2a898640 1 -- 172.21.15.88:0/75121566 shutdown_connections 2024-09-17T04:26:25.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.213+0000 7faf2a898640 1 --2- 172.21.15.88:0/75121566 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf24100ad0 0x7faf24100f50 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:25.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.213+0000 7faf2a898640 1 --2- 172.21.15.88:0/75121566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf24101e70 0x7faf24102270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:25.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.213+0000 7faf2a898640 1 -- 172.21.15.88:0/75121566 >> 172.21.15.88:0/75121566 conn(0x7faf240fb770 msgr2=0x7faf240fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:25.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.213+0000 7faf2a898640 1 -- 172.21.15.88:0/75121566 shutdown_connections 2024-09-17T04:26:25.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.213+0000 7faf2a898640 1 -- 172.21.15.88:0/75121566 wait complete. 2024-09-17T04:26:25.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.214+0000 7faf2a898640 1 Processor -- start 2024-09-17T04:26:25.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.214+0000 7faf2a898640 1 -- start start 2024-09-17T04:26:25.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.214+0000 7faf2a898640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf24100ad0 0x7faf24197560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:25.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.214+0000 7faf2a898640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf24101e70 0x7faf24197aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:25.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.214+0000 7faf2a898640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7faf241096c0 con 0x7faf24101e70 2024-09-17T04:26:25.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.214+0000 7faf2a898640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7faf24109540 con 0x7faf24100ad0 2024-09-17T04:26:25.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.214+0000 7faf237fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf24101e70 0x7faf24197aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:25.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.214+0000 7faf237fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf24101e70 0x7faf24197aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52862/0 (socket says 172.21.15.88:52862) 2024-09-17T04:26:25.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.214+0000 7faf237fe640 1 -- 172.21.15.88:0/1224097496 learned_addr learned my addr 172.21.15.88:0/1224097496 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:26:25.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.215+0000 7faf23fff640 1 --2- 172.21.15.88:0/1224097496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf24100ad0 0x7faf24197560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:25.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.215+0000 7faf237fe640 1 -- 172.21.15.88:0/1224097496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf24100ad0 msgr2=0x7faf24197560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:25.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.215+0000 7faf237fe640 1 --2- 172.21.15.88:0/1224097496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf24100ad0 0x7faf24197560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:25.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.215+0000 7faf237fe640 1 -- 172.21.15.88:0/1224097496 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf24198120 con 0x7faf24101e70 2024-09-17T04:26:25.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.215+0000 7faf237fe640 1 --2- 172.21.15.88:0/1224097496 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf24101e70 0x7faf24197aa0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7faf18006010 tx=0x7faf180045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:25.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.215+0000 7faf217fa640 1 -- 172.21.15.88:0/1224097496 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faf1803f070 con 0x7faf24101e70 2024-09-17T04:26:25.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.215+0000 7faf2a898640 1 -- 172.21.15.88:0/1224097496 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf2419cb00 con 0x7faf24101e70 2024-09-17T04:26:25.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.215+0000 7faf217fa640 1 -- 172.21.15.88:0/1224097496 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faf18004a50 con 0x7faf24101e70 2024-09-17T04:26:25.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.215+0000 7faf217fa640 1 -- 172.21.15.88:0/1224097496 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faf18035030 con 0x7faf24101e70 2024-09-17T04:26:25.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.215+0000 7faf2a898640 1 -- 172.21.15.88:0/1224097496 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf2419d090 con 0x7faf24101e70 2024-09-17T04:26:25.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.216+0000 7faf2a898640 1 -- 172.21.15.88:0/1224097496 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf24100f50 con 0x7faf24101e70 2024-09-17T04:26:25.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.217+0000 7faf217fa640 1 -- 172.21.15.88:0/1224097496 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7faf18042070 con 0x7faf24101e70 2024-09-17T04:26:25.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.217+0000 7faf217fa640 1 --2- 172.21.15.88:0/1224097496 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7faf0c07af30 0x7faf0c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:25.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.218+0000 7faf23fff640 1 --2- 172.21.15.88:0/1224097496 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7faf0c07af30 0x7faf0c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:25.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.218+0000 7faf217fa640 1 -- 172.21.15.88:0/1224097496 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6070+0+0 (secure 0 0 0) 0x7faf180beb70 con 0x7faf24101e70 2024-09-17T04:26:25.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.218+0000 7faf23fff640 1 --2- 172.21.15.88:0/1224097496 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7faf0c07af30 0x7faf0c07d3f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7faf14005fd0 tx=0x7faf14005850 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:25.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.222+0000 7faf217fa640 1 -- 172.21.15.88:0/1224097496 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7faf18004c00 con 0x7faf24101e70 2024-09-17T04:26:25.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.416+0000 7faf2a898640 1 -- 172.21.15.88:0/1224097496 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7faf24100120 con 0x7faf0c07af30 2024-09-17T04:26:25.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.417+0000 7faf217fa640 1 -- 172.21.15.88:0/1224097496 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7faf24100120 con 0x7faf0c07af30 2024-09-17T04:26:25.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.419+0000 7faf2a898640 1 -- 172.21.15.88:0/1224097496 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7faf0c07af30 msgr2=0x7faf0c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:25.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.419+0000 7faf2a898640 1 --2- 172.21.15.88:0/1224097496 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7faf0c07af30 0x7faf0c07d3f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7faf14005fd0 tx=0x7faf14005850 comp rx=0 tx=0).stop 2024-09-17T04:26:25.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.419+0000 7faf2a898640 1 -- 172.21.15.88:0/1224097496 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf24101e70 msgr2=0x7faf24197aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:25.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.419+0000 7faf2a898640 1 --2- 172.21.15.88:0/1224097496 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf24101e70 0x7faf24197aa0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7faf18006010 tx=0x7faf180045e0 comp rx=0 tx=0).stop 2024-09-17T04:26:25.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.419+0000 7faf2a898640 1 -- 172.21.15.88:0/1224097496 shutdown_connections 2024-09-17T04:26:25.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.419+0000 7faf2a898640 1 --2- 172.21.15.88:0/1224097496 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7faf0c07af30 0x7faf0c07d3f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:25.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.419+0000 7faf2a898640 1 --2- 172.21.15.88:0/1224097496 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf24101e70 0x7faf24197aa0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:25.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.419+0000 7faf2a898640 1 --2- 172.21.15.88:0/1224097496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf24100ad0 0x7faf24197560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:25.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.419+0000 7faf2a898640 1 -- 172.21.15.88:0/1224097496 >> 172.21.15.88:0/1224097496 conn(0x7faf240fb770 msgr2=0x7faf240ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:25.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.419+0000 7faf2a898640 1 -- 172.21.15.88:0/1224097496 shutdown_connections 2024-09-17T04:26:25.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.419+0000 7faf2a898640 1 -- 172.21.15.88:0/1224097496 wait complete. 2024-09-17T04:26:25.428 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-09-17T04:26:25.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.504+0000 7f164ab38640 1 -- 172.21.15.88:0/1279763717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1644100860 msgr2=0x7f1644100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:25.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.504+0000 7f164ab38640 1 --2- 172.21.15.88:0/1279763717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1644100860 0x7f1644100c60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1634009880 tx=0x7f163402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:26:25.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.504+0000 7f164ab38640 1 -- 172.21.15.88:0/1279763717 shutdown_connections 2024-09-17T04:26:25.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.504+0000 7f164ab38640 1 --2- 172.21.15.88:0/1279763717 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1644101a60 0x7f1644101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:25.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.504+0000 7f164ab38640 1 --2- 172.21.15.88:0/1279763717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1644100860 0x7f1644100c60 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:25.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.504+0000 7f164ab38640 1 -- 172.21.15.88:0/1279763717 >> 172.21.15.88:0/1279763717 conn(0x7f16440fc010 msgr2=0x7f16440fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:25.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.504+0000 7f164ab38640 1 -- 172.21.15.88:0/1279763717 shutdown_connections 2024-09-17T04:26:25.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.504+0000 7f164ab38640 1 -- 172.21.15.88:0/1279763717 wait complete. 2024-09-17T04:26:25.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.504+0000 7f164ab38640 1 Processor -- start 2024-09-17T04:26:25.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.504+0000 7f164ab38640 1 -- start start 2024-09-17T04:26:25.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.505+0000 7f164ab38640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1644100860 0x7f1644104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:25.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.505+0000 7f164ab38640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1644101a60 0x7f1644102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:25.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.505+0000 7f164ab38640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f16441096a0 con 0x7f1644101a60 2024-09-17T04:26:25.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.505+0000 7f164ab38640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1644109520 con 0x7f1644100860 2024-09-17T04:26:25.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.505+0000 7f1643fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1644101a60 0x7f1644102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:25.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.505+0000 7f1643fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1644101a60 0x7f1644102e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52882/0 (socket says 172.21.15.88:52882) 2024-09-17T04:26:25.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.505+0000 7f1643fff640 1 -- 172.21.15.88:0/2445605523 learned_addr learned my addr 172.21.15.88:0/2445605523 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:26:25.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.505+0000 7f16488d4640 1 --2- 172.21.15.88:0/2445605523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1644100860 0x7f1644104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:25.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.505+0000 7f1643fff640 1 -- 172.21.15.88:0/2445605523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1644100860 msgr2=0x7f1644104780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:25.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.505+0000 7f1643fff640 1 --2- 172.21.15.88:0/2445605523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1644100860 0x7f1644104780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:25.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.505+0000 7f1643fff640 1 -- 172.21.15.88:0/2445605523 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1644103380 con 0x7f1644101a60 2024-09-17T04:26:25.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.505+0000 7f1643fff640 1 --2- 172.21.15.88:0/2445605523 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1644101a60 0x7f1644102e40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f163800d6f0 tx=0x7f163800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:25.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.505+0000 7f1641ffb640 1 -- 172.21.15.88:0/2445605523 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1638017070 con 0x7f1644101a60 2024-09-17T04:26:25.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.505+0000 7f164ab38640 1 -- 172.21.15.88:0/2445605523 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1644103670 con 0x7f1644101a60 2024-09-17T04:26:25.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.505+0000 7f1641ffb640 1 -- 172.21.15.88:0/2445605523 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f163800de00 con 0x7f1644101a60 2024-09-17T04:26:25.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.505+0000 7f1641ffb640 1 -- 172.21.15.88:0/2445605523 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1638004bb0 con 0x7f1644101a60 2024-09-17T04:26:25.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.506+0000 7f164ab38640 1 -- 172.21.15.88:0/2445605523 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1644103c00 con 0x7f1644101a60 2024-09-17T04:26:25.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.507+0000 7f164ab38640 1 -- 172.21.15.88:0/2445605523 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1644100c60 con 0x7f1644101a60 2024-09-17T04:26:25.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.507+0000 7f1641ffb640 1 -- 172.21.15.88:0/2445605523 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f1638004e60 con 0x7f1644101a60 2024-09-17T04:26:25.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.508+0000 7f1641ffb640 1 --2- 172.21.15.88:0/2445605523 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f162c07af30 0x7f162c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:25.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.508+0000 7f1641ffb640 1 -- 172.21.15.88:0/2445605523 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6070+0+0 (secure 0 0 0) 0x7f163809db50 con 0x7f1644101a60 2024-09-17T04:26:25.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.508+0000 7f16488d4640 1 --2- 172.21.15.88:0/2445605523 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f162c07af30 0x7f162c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:25.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.508+0000 7f16488d4640 1 --2- 172.21.15.88:0/2445605523 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f162c07af30 0x7f162c07d3f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1634009230 tx=0x7f16340058d0 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:25.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.512+0000 7f1641ffb640 1 -- 172.21.15.88:0/2445605523 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f16380691a0 con 0x7f1644101a60 2024-09-17T04:26:25.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.704+0000 7f164ab38640 1 -- 172.21.15.88:0/2445605523 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f164406a460 con 0x7f162c07af30 2024-09-17T04:26:25.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.705+0000 7f1641ffb640 1 -- 172.21.15.88:0/2445605523 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f164406a460 con 0x7f162c07af30 2024-09-17T04:26:25.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.707+0000 7f164ab38640 1 -- 172.21.15.88:0/2445605523 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f162c07af30 msgr2=0x7f162c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:25.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.707+0000 7f164ab38640 1 --2- 172.21.15.88:0/2445605523 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f162c07af30 0x7f162c07d3f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1634009230 tx=0x7f16340058d0 comp rx=0 tx=0).stop 2024-09-17T04:26:25.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.707+0000 7f164ab38640 1 -- 172.21.15.88:0/2445605523 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1644101a60 msgr2=0x7f1644102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:25.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.707+0000 7f164ab38640 1 --2- 172.21.15.88:0/2445605523 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1644101a60 0x7f1644102e40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f163800d6f0 tx=0x7f163800dbb0 comp rx=0 tx=0).stop 2024-09-17T04:26:25.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.707+0000 7f164ab38640 1 -- 172.21.15.88:0/2445605523 shutdown_connections 2024-09-17T04:26:25.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.707+0000 7f164ab38640 1 --2- 172.21.15.88:0/2445605523 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f162c07af30 0x7f162c07d3f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:25.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.707+0000 7f164ab38640 1 --2- 172.21.15.88:0/2445605523 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1644101a60 0x7f1644102e40 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:25.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.707+0000 7f164ab38640 1 --2- 172.21.15.88:0/2445605523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1644100860 0x7f1644104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:25.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.708+0000 7f164ab38640 1 -- 172.21.15.88:0/2445605523 >> 172.21.15.88:0/2445605523 conn(0x7f16440fc010 msgr2=0x7f1644069d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:25.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.708+0000 7f164ab38640 1 -- 172.21.15.88:0/2445605523 shutdown_connections 2024-09-17T04:26:25.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.708+0000 7f164ab38640 1 -- 172.21.15.88:0/2445605523 wait complete. 2024-09-17T04:26:25.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.789+0000 7fa506ffb640 1 -- 172.21.15.88:0/3238632375 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa500100860 msgr2=0x7fa500100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:25.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.789+0000 7fa506ffb640 1 --2- 172.21.15.88:0/3238632375 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa500100860 0x7fa500100c60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4009880 tx=0x7fa4f402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:26:25.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.789+0000 7fa506ffb640 1 -- 172.21.15.88:0/3238632375 shutdown_connections 2024-09-17T04:26:25.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.789+0000 7fa506ffb640 1 --2- 172.21.15.88:0/3238632375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa500101a60 0x7fa500101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:25.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.789+0000 7fa506ffb640 1 --2- 172.21.15.88:0/3238632375 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa500100860 0x7fa500100c60 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:25.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.789+0000 7fa506ffb640 1 -- 172.21.15.88:0/3238632375 >> 172.21.15.88:0/3238632375 conn(0x7fa5000fc010 msgr2=0x7fa5000fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:25.790 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:25 smithi088 ceph-mon[90867]: pgmap v155: 65 pgs: 6 peering, 10 active+undersized, 7 active+undersized+degraded, 42 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s; 17/276 objects degraded (6.159%) 2024-09-17T04:26:25.790 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:25 smithi088 ceph-mon[90867]: Health check update: Degraded data redundancy: 17/276 objects degraded (6.159%), 7 pgs degraded (PG_DEGRADED) 2024-09-17T04:26:25.790 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:25 smithi088 ceph-mon[90867]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:26:25.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.789+0000 7fa506ffb640 1 -- 172.21.15.88:0/3238632375 shutdown_connections 2024-09-17T04:26:25.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.789+0000 7fa506ffb640 1 -- 172.21.15.88:0/3238632375 wait complete. 2024-09-17T04:26:25.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.790+0000 7fa506ffb640 1 Processor -- start 2024-09-17T04:26:25.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.790+0000 7fa506ffb640 1 -- start start 2024-09-17T04:26:25.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.790+0000 7fa506ffb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa500100860 0x7fa5001963c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:25.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.790+0000 7fa506ffb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa500101a60 0x7fa500196900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:25.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.790+0000 7fa506ffb640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa500109680 con 0x7fa500100860 2024-09-17T04:26:25.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.790+0000 7fa506ffb640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa500109500 con 0x7fa500101a60 2024-09-17T04:26:25.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.790+0000 7fa504d97640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa500100860 0x7fa5001963c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:25.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.790+0000 7fa504d97640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa500100860 0x7fa5001963c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52898/0 (socket says 172.21.15.88:52898) 2024-09-17T04:26:25.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.790+0000 7fa504d97640 1 -- 172.21.15.88:0/3494143702 learned_addr learned my addr 172.21.15.88:0/3494143702 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:26:25.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.791+0000 7fa4fffff640 1 --2- 172.21.15.88:0/3494143702 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa500101a60 0x7fa500196900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:25.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.791+0000 7fa504d97640 1 -- 172.21.15.88:0/3494143702 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa500101a60 msgr2=0x7fa500196900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:25.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.791+0000 7fa504d97640 1 --2- 172.21.15.88:0/3494143702 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa500101a60 0x7fa500196900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:25.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.791+0000 7fa504d97640 1 -- 172.21.15.88:0/3494143702 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa500196ef0 con 0x7fa500100860 2024-09-17T04:26:25.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.791+0000 7fa504d97640 1 --2- 172.21.15.88:0/3494143702 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa500100860 0x7fa5001963c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4006010 tx=0x7fa4f40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:25.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.791+0000 7fa4fdffb640 1 -- 172.21.15.88:0/3494143702 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa4f403f070 con 0x7fa500100860 2024-09-17T04:26:25.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.791+0000 7fa506ffb640 1 -- 172.21.15.88:0/3494143702 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa50006a1b0 con 0x7fa500100860 2024-09-17T04:26:25.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.791+0000 7fa4fdffb640 1 -- 172.21.15.88:0/3494143702 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa4f40044d0 con 0x7fa500100860 2024-09-17T04:26:25.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.791+0000 7fa4fdffb640 1 -- 172.21.15.88:0/3494143702 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa4f4035030 con 0x7fa500100860 2024-09-17T04:26:25.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.791+0000 7fa506ffb640 1 -- 172.21.15.88:0/3494143702 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa50006a6e0 con 0x7fa500100860 2024-09-17T04:26:25.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.792+0000 7fa506ffb640 1 -- 172.21.15.88:0/3494143702 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa500109e60 con 0x7fa500100860 2024-09-17T04:26:25.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.793+0000 7fa4fdffb640 1 -- 172.21.15.88:0/3494143702 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fa4f4042070 con 0x7fa500100860 2024-09-17T04:26:25.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.794+0000 7fa4fdffb640 1 --2- 172.21.15.88:0/3494143702 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fa4f007af30 0x7fa4f007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:25.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.794+0000 7fa4fdffb640 1 -- 172.21.15.88:0/3494143702 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6070+0+0 (secure 0 0 0) 0x7fa4f40bf110 con 0x7fa500100860 2024-09-17T04:26:25.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.794+0000 7fa4fffff640 1 --2- 172.21.15.88:0/3494143702 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fa4f007af30 0x7fa4f007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:25.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.794+0000 7fa4fffff640 1 --2- 172.21.15.88:0/3494143702 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fa4f007af30 0x7fa4f007d3f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec005e10 tx=0x7fa4ec005da0 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:25.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.799+0000 7fa4fdffb640 1 -- 172.21.15.88:0/3494143702 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fa4f408a780 con 0x7fa500100860 2024-09-17T04:26:25.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:25 smithi134 ceph-mon[76677]: pgmap v155: 65 pgs: 6 peering, 10 active+undersized, 7 active+undersized+degraded, 42 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s; 17/276 objects degraded (6.159%) 2024-09-17T04:26:25.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:25 smithi134 ceph-mon[76677]: Health check update: Degraded data redundancy: 17/276 objects degraded (6.159%), 7 pgs degraded (PG_DEGRADED) 2024-09-17T04:26:25.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:25 smithi134 ceph-mon[76677]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:26:25.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.982+0000 7fa506ffb640 1 -- 172.21.15.88:0/3494143702 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fa500190450 con 0x7fa4f007af30 2024-09-17T04:26:25.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.991+0000 7fa4fdffb640 1 -- 172.21.15.88:0/3494143702 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7fa500190450 con 0x7fa4f007af30 2024-09-17T04:26:25.991 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T04:26:25.991 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (11m) 75s ago 13m 25.4M - 0.25.0 c8568f914cd2 f2dbac7e939f 2024-09-17T04:26:25.992 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi088 smithi088 running (5m) 75s ago 13m 8678k - 19.1.1-330-gc2ddf972 ebb0615149de 683e1826a1a5 2024-09-17T04:26:25.992 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi134 smithi134 running (4m) 10s ago 12m 8674k - 19.1.1-330-gc2ddf972 ebb0615149de 83afa4200c0e 2024-09-17T04:26:25.992 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (2m) 75s ago 13m 6891k - 19.3.0-4989-gce1b342b 8e039cb7fe1e 10355648c406 2024-09-17T04:26:25.992 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi134 smithi134 running (2m) 10s ago 12m 6899k - 19.3.0-4989-gce1b342b 8e039cb7fe1e d709085ffe5d 2024-09-17T04:26:25.992 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (11m) 75s ago 13m 79.3M - 9.4.12 2bacad6d85d8 a6cff57a23f9 2024-09-17T04:26:25.992 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.giqrgt smithi088 running (8m) 75s ago 8m 148M - 19.1.1-330-gc2ddf972 ebb0615149de f724660799a1 2024-09-17T04:26:25.992 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.lgavsv smithi088 running (8m) 75s ago 8m 16.2M - 19.1.1-330-gc2ddf972 ebb0615149de 6cc0fe8a6aa9 2024-09-17T04:26:25.992 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi134.ktuhce smithi134 running (8m) 10s ago 8m 16.1M - 19.1.1-330-gc2ddf972 ebb0615149de 7ff5b70ca9cb 2024-09-17T04:26:25.992 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi134.psnynp smithi134 running (8m) 10s ago 8m 90.9M - 19.1.1-330-gc2ddf972 ebb0615149de 5326974fa3dd 2024-09-17T04:26:25.992 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.wmndiv smithi088 *:8443,9283,8765 running (4m) 75s ago 14m 584M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 49eb47f7f14f 2024-09-17T04:26:25.992 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi134.vwdxcb smithi134 *:8443,9283,8765 running (3m) 10s ago 12m 522M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 8a6d45eb0595 2024-09-17T04:26:25.992 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (3m) 75s ago 14m 112M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e ac6332015243 2024-09-17T04:26:25.992 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi134 smithi134 running (3m) 10s ago 12m 104M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e ea49f690e26b 2024-09-17T04:26:25.993 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (13m) 75s ago 13m 16.4M - 1.5.0 0da6a335fe13 9ba03800993b 2024-09-17T04:26:25.993 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi134 smithi134 *:9100 running (12m) 10s ago 12m 17.6M - 1.5.0 0da6a335fe13 6deac483827f 2024-09-17T04:26:25.993 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (2m) 75s ago 11m 155M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 4ef267302248 2024-09-17T04:26:25.993 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (115s) 75s ago 10m 153M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 17b67c13c7aa 2024-09-17T04:26:25.993 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (80s) 75s ago 10m 79.4M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 83d38ad792c9 2024-09-17T04:26:25.993 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi134 running (45s) 10s ago 10m 155M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e 336a363ac39f 2024-09-17T04:26:25.993 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi134 running (13s) 10s ago 9m 81.9M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e 6df8a692310a 2024-09-17T04:26:25.993 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi134 running (9m) 10s ago 9m 187M 2240M 19.1.1-330-gc2ddf972 ebb0615149de bc1b434a92a8 2024-09-17T04:26:25.993 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (3m) 75s ago 13m 66.9M - 2.43.0 a07b618ecd1d b51d7899d341 2024-09-17T04:26:25.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.994+0000 7fa506ffb640 1 -- 172.21.15.88:0/3494143702 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fa4f007af30 msgr2=0x7fa4f007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:25.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.994+0000 7fa506ffb640 1 --2- 172.21.15.88:0/3494143702 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fa4f007af30 0x7fa4f007d3f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec005e10 tx=0x7fa4ec005da0 comp rx=0 tx=0).stop 2024-09-17T04:26:25.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.994+0000 7fa506ffb640 1 -- 172.21.15.88:0/3494143702 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa500100860 msgr2=0x7fa5001963c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:25.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.994+0000 7fa506ffb640 1 --2- 172.21.15.88:0/3494143702 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa500100860 0x7fa5001963c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4006010 tx=0x7fa4f40048f0 comp rx=0 tx=0).stop 2024-09-17T04:26:25.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.994+0000 7fa506ffb640 1 -- 172.21.15.88:0/3494143702 shutdown_connections 2024-09-17T04:26:25.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.994+0000 7fa506ffb640 1 --2- 172.21.15.88:0/3494143702 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fa4f007af30 0x7fa4f007d3f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:25.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.994+0000 7fa506ffb640 1 --2- 172.21.15.88:0/3494143702 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa500101a60 0x7fa500196900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:25.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.994+0000 7fa506ffb640 1 --2- 172.21.15.88:0/3494143702 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa500100860 0x7fa5001963c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:25.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.994+0000 7fa506ffb640 1 -- 172.21.15.88:0/3494143702 >> 172.21.15.88:0/3494143702 conn(0x7fa5000fc010 msgr2=0x7fa500104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:25.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.994+0000 7fa506ffb640 1 -- 172.21.15.88:0/3494143702 shutdown_connections 2024-09-17T04:26:25.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:25.994+0000 7fa506ffb640 1 -- 172.21.15.88:0/3494143702 wait complete. 2024-09-17T04:26:26.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.076+0000 7fc762180640 1 -- 172.21.15.88:0/2860506509 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc75c104d20 msgr2=0x7fc75c107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:26.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.076+0000 7fc762180640 1 --2- 172.21.15.88:0/2860506509 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc75c104d20 0x7fc75c107110 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc7440098b0 tx=0x7fc74402a4d0 comp rx=0 tx=0).stop 2024-09-17T04:26:26.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.076+0000 7fc762180640 1 -- 172.21.15.88:0/2860506509 shutdown_connections 2024-09-17T04:26:26.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.076+0000 7fc762180640 1 --2- 172.21.15.88:0/2860506509 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc75c104d20 0x7fc75c107110 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:26.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.076+0000 7fc762180640 1 --2- 172.21.15.88:0/2860506509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc75c1023f0 0x7fc75c1047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:26.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.076+0000 7fc762180640 1 -- 172.21.15.88:0/2860506509 >> 172.21.15.88:0/2860506509 conn(0x7fc75c0fc010 msgr2=0x7fc75c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:26.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.076+0000 7fc762180640 1 -- 172.21.15.88:0/2860506509 shutdown_connections 2024-09-17T04:26:26.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.076+0000 7fc762180640 1 -- 172.21.15.88:0/2860506509 wait complete. 2024-09-17T04:26:26.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.076+0000 7fc762180640 1 Processor -- start 2024-09-17T04:26:26.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.076+0000 7fc762180640 1 -- start start 2024-09-17T04:26:26.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.077+0000 7fc762180640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc75c1023f0 0x7fc75c197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:26.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.077+0000 7fc762180640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc75c104d20 0x7fc75c197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:26.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.077+0000 7fc762180640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc75c10a7b0 con 0x7fc75c1023f0 2024-09-17T04:26:26.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.077+0000 7fc762180640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc75c10a630 con 0x7fc75c104d20 2024-09-17T04:26:26.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.077+0000 7fc75b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc75c1023f0 0x7fc75c197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:26.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.077+0000 7fc75b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc75c1023f0 0x7fc75c197530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52926/0 (socket says 172.21.15.88:52926) 2024-09-17T04:26:26.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.077+0000 7fc75b7fe640 1 -- 172.21.15.88:0/3855721433 learned_addr learned my addr 172.21.15.88:0/3855721433 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:26:26.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.077+0000 7fc752ffd640 1 --2- 172.21.15.88:0/3855721433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc75c104d20 0x7fc75c197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:26.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.077+0000 7fc75b7fe640 1 -- 172.21.15.88:0/3855721433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc75c104d20 msgr2=0x7fc75c197a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:26.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.077+0000 7fc75b7fe640 1 --2- 172.21.15.88:0/3855721433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc75c104d20 0x7fc75c197a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:26.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.077+0000 7fc75b7fe640 1 -- 172.21.15.88:0/3855721433 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc75c1980f0 con 0x7fc75c1023f0 2024-09-17T04:26:26.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.077+0000 7fc75b7fe640 1 --2- 172.21.15.88:0/3855721433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc75c1023f0 0x7fc75c197530 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc74c00d6f0 tx=0x7fc74c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:26.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.078+0000 7fc7597fa640 1 -- 172.21.15.88:0/3855721433 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc74c017070 con 0x7fc75c1023f0 2024-09-17T04:26:26.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.078+0000 7fc762180640 1 -- 172.21.15.88:0/3855721433 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc75c19cb30 con 0x7fc75c1023f0 2024-09-17T04:26:26.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.078+0000 7fc7597fa640 1 -- 172.21.15.88:0/3855721433 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc74c00de00 con 0x7fc75c1023f0 2024-09-17T04:26:26.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.078+0000 7fc7597fa640 1 -- 172.21.15.88:0/3855721433 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc74c004bb0 con 0x7fc75c1023f0 2024-09-17T04:26:26.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.078+0000 7fc762180640 1 -- 172.21.15.88:0/3855721433 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc75c19d090 con 0x7fc75c1023f0 2024-09-17T04:26:26.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.079+0000 7fc762180640 1 -- 172.21.15.88:0/3855721433 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc75c1027d0 con 0x7fc75c1023f0 2024-09-17T04:26:26.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.079+0000 7fc7597fa640 1 -- 172.21.15.88:0/3855721433 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fc74c004e60 con 0x7fc75c1023f0 2024-09-17T04:26:26.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.080+0000 7fc7597fa640 1 --2- 172.21.15.88:0/3855721433 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fc74807af30 0x7fc74807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:26.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.080+0000 7fc7597fa640 1 -- 172.21.15.88:0/3855721433 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6070+0+0 (secure 0 0 0) 0x7fc74c09dc00 con 0x7fc75c1023f0 2024-09-17T04:26:26.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.080+0000 7fc752ffd640 1 --2- 172.21.15.88:0/3855721433 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fc74807af30 0x7fc74807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:26.081 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.081+0000 7fc752ffd640 1 --2- 172.21.15.88:0/3855721433 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fc74807af30 0x7fc74807d3f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc744006010 tx=0x7fc744009580 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:26.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.085+0000 7fc7597fa640 1 -- 172.21.15.88:0/3855721433 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fc74c0a3020 con 0x7fc75c1023f0 2024-09-17T04:26:26.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.329+0000 7fc762180640 1 -- 172.21.15.88:0/3855721433 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fc75c19da90 con 0x7fc75c1023f0 2024-09-17T04:26:26.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.330+0000 7fc7597fa640 1 -- 172.21.15.88:0/3855721433 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7fc74c069250 con 0x7fc75c1023f0 2024-09-17T04:26:26.330 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-17T04:26:26.331 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-09-17T04:26:26.331 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T04:26:26.331 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:26:26.331 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-09-17T04:26:26.331 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T04:26:26.331 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:26:26.332 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-09-17T04:26:26.332 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 1, 2024-09-17T04:26:26.332 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 5 2024-09-17T04:26:26.332 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:26:26.332 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2024-09-17T04:26:26.333 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T04:26:26.333 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:26:26.333 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-09-17T04:26:26.333 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 5, 2024-09-17T04:26:26.333 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 9 2024-09-17T04:26:26.334 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-17T04:26:26.334 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-17T04:26:26.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.332+0000 7fc762180640 1 -- 172.21.15.88:0/3855721433 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fc74807af30 msgr2=0x7fc74807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:26.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.332+0000 7fc762180640 1 --2- 172.21.15.88:0/3855721433 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fc74807af30 0x7fc74807d3f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc744006010 tx=0x7fc744009580 comp rx=0 tx=0).stop 2024-09-17T04:26:26.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.332+0000 7fc762180640 1 -- 172.21.15.88:0/3855721433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc75c1023f0 msgr2=0x7fc75c197530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:26.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.332+0000 7fc762180640 1 --2- 172.21.15.88:0/3855721433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc75c1023f0 0x7fc75c197530 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc74c00d6f0 tx=0x7fc74c00dbb0 comp rx=0 tx=0).stop 2024-09-17T04:26:26.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.333+0000 7fc762180640 1 -- 172.21.15.88:0/3855721433 shutdown_connections 2024-09-17T04:26:26.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.333+0000 7fc762180640 1 --2- 172.21.15.88:0/3855721433 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fc74807af30 0x7fc74807d3f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:26.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.333+0000 7fc762180640 1 --2- 172.21.15.88:0/3855721433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc75c104d20 0x7fc75c197a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:26.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.333+0000 7fc762180640 1 --2- 172.21.15.88:0/3855721433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc75c1023f0 0x7fc75c197530 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:26.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.333+0000 7fc762180640 1 -- 172.21.15.88:0/3855721433 >> 172.21.15.88:0/3855721433 conn(0x7fc75c0fc010 msgr2=0x7fc75c0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:26.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.333+0000 7fc762180640 1 -- 172.21.15.88:0/3855721433 shutdown_connections 2024-09-17T04:26:26.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.333+0000 7fc762180640 1 -- 172.21.15.88:0/3855721433 wait complete. 2024-09-17T04:26:26.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.414+0000 7f19696b0640 1 -- 172.21.15.88:0/207010707 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1964104d20 msgr2=0x7f1964107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:26.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.414+0000 7f19696b0640 1 --2- 172.21.15.88:0/207010707 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1964104d20 0x7f1964107110 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f194c0098b0 tx=0x7f194c02a4d0 comp rx=0 tx=0).stop 2024-09-17T04:26:26.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.414+0000 7f19696b0640 1 -- 172.21.15.88:0/207010707 shutdown_connections 2024-09-17T04:26:26.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.414+0000 7f19696b0640 1 --2- 172.21.15.88:0/207010707 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1964104d20 0x7f1964107110 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:26.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.414+0000 7f19696b0640 1 --2- 172.21.15.88:0/207010707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19641023f0 0x7f19641047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:26.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.414+0000 7f19696b0640 1 -- 172.21.15.88:0/207010707 >> 172.21.15.88:0/207010707 conn(0x7f19640fc010 msgr2=0x7f19640fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:26.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.414+0000 7f19696b0640 1 -- 172.21.15.88:0/207010707 shutdown_connections 2024-09-17T04:26:26.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.414+0000 7f19696b0640 1 -- 172.21.15.88:0/207010707 wait complete. 2024-09-17T04:26:26.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.414+0000 7f19696b0640 1 Processor -- start 2024-09-17T04:26:26.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.414+0000 7f19696b0640 1 -- start start 2024-09-17T04:26:26.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.415+0000 7f19696b0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19641023f0 0x7f1964197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:26.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.415+0000 7f19696b0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1964104d20 0x7f1964197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:26.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.415+0000 7f19696b0640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f196410a790 con 0x7f19641023f0 2024-09-17T04:26:26.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.415+0000 7f19696b0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f196410a610 con 0x7f1964104d20 2024-09-17T04:26:26.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.415+0000 7f1962ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19641023f0 0x7f1964197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:26.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.415+0000 7f1962ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19641023f0 0x7f1964197510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52954/0 (socket says 172.21.15.88:52954) 2024-09-17T04:26:26.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.415+0000 7f1962ffd640 1 -- 172.21.15.88:0/440129563 learned_addr learned my addr 172.21.15.88:0/440129563 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:26:26.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.415+0000 7f19627fc640 1 --2- 172.21.15.88:0/440129563 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1964104d20 0x7f1964197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:26.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.415+0000 7f1962ffd640 1 -- 172.21.15.88:0/440129563 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1964104d20 msgr2=0x7f1964197a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:26.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.415+0000 7f1962ffd640 1 --2- 172.21.15.88:0/440129563 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1964104d20 0x7f1964197a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:26.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.415+0000 7f1962ffd640 1 -- 172.21.15.88:0/440129563 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19641980d0 con 0x7f19641023f0 2024-09-17T04:26:26.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.415+0000 7f1962ffd640 1 --2- 172.21.15.88:0/440129563 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19641023f0 0x7f1964197510 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f195400d8d0 tx=0x7f195400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:26.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.415+0000 7f195bfff640 1 -- 172.21.15.88:0/440129563 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1954017070 con 0x7f19641023f0 2024-09-17T04:26:26.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.415+0000 7f195bfff640 1 -- 172.21.15.88:0/440129563 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1954010460 con 0x7f19641023f0 2024-09-17T04:26:26.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.415+0000 7f19696b0640 1 -- 172.21.15.88:0/440129563 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f196419cb10 con 0x7f19641023f0 2024-09-17T04:26:26.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.415+0000 7f195bfff640 1 -- 172.21.15.88:0/440129563 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f195400f5f0 con 0x7f19641023f0 2024-09-17T04:26:26.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.416+0000 7f19696b0640 1 -- 172.21.15.88:0/440129563 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f196419d0a0 con 0x7f19641023f0 2024-09-17T04:26:26.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.417+0000 7f19696b0640 1 -- 172.21.15.88:0/440129563 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19641027d0 con 0x7f19641023f0 2024-09-17T04:26:26.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.417+0000 7f195bfff640 1 -- 172.21.15.88:0/440129563 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f1954009a30 con 0x7f19641023f0 2024-09-17T04:26:26.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.418+0000 7f195bfff640 1 --2- 172.21.15.88:0/440129563 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f195007af30 0x7f195007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:26.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.418+0000 7f195bfff640 1 -- 172.21.15.88:0/440129563 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6070+0+0 (secure 0 0 0) 0x7f195409de90 con 0x7f19641023f0 2024-09-17T04:26:26.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.418+0000 7f19627fc640 1 --2- 172.21.15.88:0/440129563 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f195007af30 0x7f195007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:26.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.418+0000 7f19627fc640 1 --2- 172.21.15.88:0/440129563 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f195007af30 0x7f195007d3f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f194c006010 tx=0x7f194c000bc0 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:26.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.423+0000 7f195bfff640 1 -- 172.21.15.88:0/440129563 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f19540694e0 con 0x7f19641023f0 2024-09-17T04:26:26.665 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.665+0000 7f19696b0640 1 -- 172.21.15.88:0/440129563 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f196419da30 con 0x7f19641023f0 2024-09-17T04:26:26.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.666+0000 7f195bfff640 1 -- 172.21.15.88:0/440129563 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) ==== 76+0+2045 (secure 0 0 0) 0x7f195406e390 con 0x7f19641023f0 2024-09-17T04:26:26.666 INFO:teuthology.orchestra.run.smithi088.stdout:e15 2024-09-17T04:26:26.666 INFO:teuthology.orchestra.run.smithi088.stdout:btime 2024-09-17T04:18:27:750910+0000 2024-09-17T04:26:26.666 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T04:26:26.666 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:26:26.666 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2024-09-17T04:26:26.666 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:26:26.666 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2024-09-17T04:26:26.667 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2024-09-17T04:26:26.667 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 15 2024-09-17T04:26:26.667 INFO:teuthology.orchestra.run.smithi088.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T04:26:26.667 INFO:teuthology.orchestra.run.smithi088.stdout:created 2024-09-17T04:18:10.480573+0000 2024-09-17T04:26:26.667 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2024-09-17T04:18:27.750896+0000 2024-09-17T04:26:26.667 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2024-09-17T04:26:26.667 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2024-09-17T04:26:26.667 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2024-09-17T04:26:26.667 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2024-09-17T04:26:26.667 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2024-09-17T04:26:26.667 INFO:teuthology.orchestra.run.smithi088.stdout:max_xattr_size 65536 2024-09-17T04:26:26.667 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2024-09-17T04:26:26.667 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2024-09-17T04:26:26.667 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 45 2024-09-17T04:26:26.668 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:26:26.668 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 1 2024-09-17T04:26:26.668 INFO:teuthology.orchestra.run.smithi088.stdout:in 0 2024-09-17T04:26:26.668 INFO:teuthology.orchestra.run.smithi088.stdout:up {0=14590} 2024-09-17T04:26:26.668 INFO:teuthology.orchestra.run.smithi088.stdout:failed 2024-09-17T04:26:26.668 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2024-09-17T04:26:26.668 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2024-09-17T04:26:26.668 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2024-09-17T04:26:26.668 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2024-09-17T04:26:26.668 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data enabled 2024-09-17T04:26:26.668 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2024-09-17T04:26:26.668 INFO:teuthology.orchestra.run.smithi088.stdout:bal_rank_mask -1 2024-09-17T04:26:26.668 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 1 2024-09-17T04:26:26.669 INFO:teuthology.orchestra.run.smithi088.stdout:qdb_cluster leader: 14590 members: 14590 2024-09-17T04:26:26.669 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.giqrgt{0:14590} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.88:6828/1714846518,v1:172.21.15.88:6829/1714846518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:26:26.669 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi134.psnynp{0:24321} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.134:6826/2137586894,v1:172.21.15.134:6827/2137586894] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:26:26.669 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:26:26.669 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:26:26.669 INFO:teuthology.orchestra.run.smithi088.stdout:Standby daemons: 2024-09-17T04:26:26.669 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:26:26.669 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi134.ktuhce{-1:24325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/967997022,v1:172.21.15.134:6825/967997022] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:26:26.669 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.lgavsv{-1:24329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/1425146180,v1:172.21.15.88:6827/1425146180] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:26:26.670 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 15 2024-09-17T04:26:26.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.668+0000 7f19696b0640 1 -- 172.21.15.88:0/440129563 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f195007af30 msgr2=0x7f195007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:26.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.668+0000 7f19696b0640 1 --2- 172.21.15.88:0/440129563 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f195007af30 0x7f195007d3f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f194c006010 tx=0x7f194c000bc0 comp rx=0 tx=0).stop 2024-09-17T04:26:26.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.668+0000 7f19696b0640 1 -- 172.21.15.88:0/440129563 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19641023f0 msgr2=0x7f1964197510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:26.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.668+0000 7f19696b0640 1 --2- 172.21.15.88:0/440129563 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19641023f0 0x7f1964197510 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f195400d8d0 tx=0x7f195400dd90 comp rx=0 tx=0).stop 2024-09-17T04:26:26.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.668+0000 7f19696b0640 1 -- 172.21.15.88:0/440129563 shutdown_connections 2024-09-17T04:26:26.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.668+0000 7f19696b0640 1 --2- 172.21.15.88:0/440129563 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f195007af30 0x7f195007d3f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:26.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.668+0000 7f19696b0640 1 --2- 172.21.15.88:0/440129563 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1964104d20 0x7f1964197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:26.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.668+0000 7f19696b0640 1 --2- 172.21.15.88:0/440129563 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19641023f0 0x7f1964197510 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:26.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.668+0000 7f19696b0640 1 -- 172.21.15.88:0/440129563 >> 172.21.15.88:0/440129563 conn(0x7f19640fc010 msgr2=0x7f19640fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:26.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.669+0000 7f19696b0640 1 -- 172.21.15.88:0/440129563 shutdown_connections 2024-09-17T04:26:26.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.669+0000 7f19696b0640 1 -- 172.21.15.88:0/440129563 wait complete. 2024-09-17T04:26:26.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.751+0000 7f2bf8e6c640 1 -- 172.21.15.88:0/934328058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bf4101a60 msgr2=0x7f2bf4101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:26.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.751+0000 7f2bf8e6c640 1 --2- 172.21.15.88:0/934328058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bf4101a60 0x7f2bf4101ee0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc009880 tx=0x7f2bdc02a4a0 comp rx=0 tx=0).stop 2024-09-17T04:26:26.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.751+0000 7f2bf8e6c640 1 -- 172.21.15.88:0/934328058 shutdown_connections 2024-09-17T04:26:26.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.751+0000 7f2bf8e6c640 1 --2- 172.21.15.88:0/934328058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bf4101a60 0x7f2bf4101ee0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:26.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.751+0000 7f2bf8e6c640 1 --2- 172.21.15.88:0/934328058 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2bf4100860 0x7f2bf4100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:26.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.751+0000 7f2bf8e6c640 1 -- 172.21.15.88:0/934328058 >> 172.21.15.88:0/934328058 conn(0x7f2bf40fc010 msgr2=0x7f2bf40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:26.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.751+0000 7f2bf8e6c640 1 -- 172.21.15.88:0/934328058 shutdown_connections 2024-09-17T04:26:26.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.751+0000 7f2bf8e6c640 1 -- 172.21.15.88:0/934328058 wait complete. 2024-09-17T04:26:26.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.752+0000 7f2bf8e6c640 1 Processor -- start 2024-09-17T04:26:26.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.752+0000 7f2bf8e6c640 1 -- start start 2024-09-17T04:26:26.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.752+0000 7f2bf8e6c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bf4100860 0x7f2bf4197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:26.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.752+0000 7f2bf8e6c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2bf4101a60 0x7f2bf4197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:26.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.752+0000 7f2bf8e6c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf4109680 con 0x7f2bf4100860 2024-09-17T04:26:26.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.752+0000 7f2bf8e6c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf4109500 con 0x7f2bf4101a60 2024-09-17T04:26:26.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.752+0000 7f2bf259c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bf4100860 0x7f2bf4197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:26.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.752+0000 7f2bf259c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bf4100860 0x7f2bf4197500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52982/0 (socket says 172.21.15.88:52982) 2024-09-17T04:26:26.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.752+0000 7f2bf259c640 1 -- 172.21.15.88:0/1171118128 learned_addr learned my addr 172.21.15.88:0/1171118128 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:26:26.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.752+0000 7f2bf1d9b640 1 --2- 172.21.15.88:0/1171118128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2bf4101a60 0x7f2bf4197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:26.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.753+0000 7f2bf259c640 1 -- 172.21.15.88:0/1171118128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2bf4101a60 msgr2=0x7f2bf4197a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:26.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.753+0000 7f2bf259c640 1 --2- 172.21.15.88:0/1171118128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2bf4101a60 0x7f2bf4197a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:26.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.753+0000 7f2bf259c640 1 -- 172.21.15.88:0/1171118128 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bf41980c0 con 0x7f2bf4100860 2024-09-17T04:26:26.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.753+0000 7f2bf259c640 1 --2- 172.21.15.88:0/1171118128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bf4100860 0x7f2bf4197500 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2be400e940 tx=0x7f2be400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:26.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.753+0000 7f2beb7fe640 1 -- 172.21.15.88:0/1171118128 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2be400cac0 con 0x7f2bf4100860 2024-09-17T04:26:26.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.753+0000 7f2beb7fe640 1 -- 172.21.15.88:0/1171118128 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2be400cc60 con 0x7f2bf4100860 2024-09-17T04:26:26.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.753+0000 7f2bf8e6c640 1 -- 172.21.15.88:0/1171118128 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bf419cb00 con 0x7f2bf4100860 2024-09-17T04:26:26.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.753+0000 7f2beb7fe640 1 -- 172.21.15.88:0/1171118128 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2be4003de0 con 0x7f2bf4100860 2024-09-17T04:26:26.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.753+0000 7f2bf8e6c640 1 -- 172.21.15.88:0/1171118128 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bf419d060 con 0x7f2bf4100860 2024-09-17T04:26:26.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.754+0000 7f2bf8e6c640 1 -- 172.21.15.88:0/1171118128 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bf4109e60 con 0x7f2bf4100860 2024-09-17T04:26:26.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.755+0000 7f2beb7fe640 1 -- 172.21.15.88:0/1171118128 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f2be4003fa0 con 0x7f2bf4100860 2024-09-17T04:26:26.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.755+0000 7f2beb7fe640 1 --2- 172.21.15.88:0/1171118128 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f2be007af30 0x7f2be007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:26.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.755+0000 7f2beb7fe640 1 -- 172.21.15.88:0/1171118128 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6070+0+0 (secure 0 0 0) 0x7f2be409e6a0 con 0x7f2bf4100860 2024-09-17T04:26:26.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.755+0000 7f2bf1d9b640 1 --2- 172.21.15.88:0/1171118128 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f2be007af30 0x7f2be007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:26.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.756+0000 7f2bf1d9b640 1 --2- 172.21.15.88:0/1171118128 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f2be007af30 0x7f2be007d3f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc000c00 tx=0x7f2bdc0058d0 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:26.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.760+0000 7f2beb7fe640 1 -- 172.21.15.88:0/1171118128 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f2be4069cf0 con 0x7f2bf4100860 2024-09-17T04:26:26.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.950+0000 7f2bf8e6c640 1 -- 172.21.15.88:0/1171118128 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2bf406a970 con 0x7f2be007af30 2024-09-17T04:26:26.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.952+0000 7f2beb7fe640 1 -- 172.21.15.88:0/1171118128 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f2bf406a970 con 0x7f2be007af30 2024-09-17T04:26:26.952 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-17T04:26:26.952 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f", 2024-09-17T04:26:26.952 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-09-17T04:26:26.952 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T04:26:26.952 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [ 2024-09-17T04:26:26.952 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr", 2024-09-17T04:26:26.952 INFO:teuthology.orchestra.run.smithi088.stdout: "mon", 2024-09-17T04:26:26.953 INFO:teuthology.orchestra.run.smithi088.stdout: "crash" 2024-09-17T04:26:26.953 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-17T04:26:26.953 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "11/23 daemons upgraded", 2024-09-17T04:26:26.953 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading osd daemons", 2024-09-17T04:26:26.953 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-09-17T04:26:26.953 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-17T04:26:26.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.954+0000 7f2bf8e6c640 1 -- 172.21.15.88:0/1171118128 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f2be007af30 msgr2=0x7f2be007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:26.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.954+0000 7f2bf8e6c640 1 --2- 172.21.15.88:0/1171118128 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f2be007af30 0x7f2be007d3f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc000c00 tx=0x7f2bdc0058d0 comp rx=0 tx=0).stop 2024-09-17T04:26:26.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.954+0000 7f2bf8e6c640 1 -- 172.21.15.88:0/1171118128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bf4100860 msgr2=0x7f2bf4197500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:26.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.954+0000 7f2bf8e6c640 1 --2- 172.21.15.88:0/1171118128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bf4100860 0x7f2bf4197500 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2be400e940 tx=0x7f2be400ee00 comp rx=0 tx=0).stop 2024-09-17T04:26:26.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.954+0000 7f2bf8e6c640 1 -- 172.21.15.88:0/1171118128 shutdown_connections 2024-09-17T04:26:26.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.954+0000 7f2bf8e6c640 1 --2- 172.21.15.88:0/1171118128 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f2be007af30 0x7f2be007d3f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:26.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.954+0000 7f2bf8e6c640 1 --2- 172.21.15.88:0/1171118128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2bf4101a60 0x7f2bf4197a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:26.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.954+0000 7f2bf8e6c640 1 --2- 172.21.15.88:0/1171118128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bf4100860 0x7f2bf4197500 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:26.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.954+0000 7f2bf8e6c640 1 -- 172.21.15.88:0/1171118128 >> 172.21.15.88:0/1171118128 conn(0x7f2bf40fc010 msgr2=0x7f2bf406a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:26.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.954+0000 7f2bf8e6c640 1 -- 172.21.15.88:0/1171118128 shutdown_connections 2024-09-17T04:26:26.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:26.954+0000 7f2bf8e6c640 1 -- 172.21.15.88:0/1171118128 wait complete. 2024-09-17T04:26:27.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:27.036+0000 7fed42acb640 1 -- 172.21.15.88:0/3453314305 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed3c100860 msgr2=0x7fed3c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:27.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:27.036+0000 7fed42acb640 1 --2- 172.21.15.88:0/3453314305 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed3c100860 0x7fed3c100c60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fed30009880 tx=0x7fed3002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:26:27.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:27.036+0000 7fed42acb640 1 -- 172.21.15.88:0/3453314305 shutdown_connections 2024-09-17T04:26:27.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:27.036+0000 7fed42acb640 1 --2- 172.21.15.88:0/3453314305 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed3c101a60 0x7fed3c101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:27.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:27.036+0000 7fed42acb640 1 --2- 172.21.15.88:0/3453314305 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed3c100860 0x7fed3c100c60 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:27.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:27.036+0000 7fed42acb640 1 -- 172.21.15.88:0/3453314305 >> 172.21.15.88:0/3453314305 conn(0x7fed3c0fc010 msgr2=0x7fed3c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:27.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:27.036+0000 7fed42acb640 1 -- 172.21.15.88:0/3453314305 shutdown_connections 2024-09-17T04:26:27.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:27.036+0000 7fed42acb640 1 -- 172.21.15.88:0/3453314305 wait complete. 2024-09-17T04:26:27.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:27.037+0000 7fed42acb640 1 Processor -- start 2024-09-17T04:26:27.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:27.037+0000 7fed42acb640 1 -- start start 2024-09-17T04:26:27.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:27.037+0000 7fed42acb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed3c100860 0x7fed3c197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:27.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:27.037+0000 7fed42acb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed3c101a60 0x7fed3c197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:27.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:27.037+0000 7fed42acb640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fed3c1096a0 con 0x7fed3c101a60 2024-09-17T04:26:27.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:27.037+0000 7fed42acb640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fed3c109520 con 0x7fed3c100860 2024-09-17T04:26:27.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:27.037+0000 7fed3bfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed3c101a60 0x7fed3c197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:27.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:27.037+0000 7fed3bfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed3c101a60 0x7fed3c197a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53000/0 (socket says 172.21.15.88:53000) 2024-09-17T04:26:27.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:27.037+0000 7fed3bfff640 1 -- 172.21.15.88:0/1431296468 learned_addr learned my addr 172.21.15.88:0/1431296468 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:26:27.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:27.037+0000 7fed40867640 1 --2- 172.21.15.88:0/1431296468 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed3c100860 0x7fed3c197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:27.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:27.037+0000 7fed3bfff640 1 -- 172.21.15.88:0/1431296468 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed3c100860 msgr2=0x7fed3c197520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:27.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:27.037+0000 7fed3bfff640 1 --2- 172.21.15.88:0/1431296468 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed3c100860 0x7fed3c197520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:27.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:27.037+0000 7fed3bfff640 1 -- 172.21.15.88:0/1431296468 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed3c1980e0 con 0x7fed3c101a60 2024-09-17T04:26:27.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:27.038+0000 7fed3bfff640 1 --2- 172.21.15.88:0/1431296468 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed3c101a60 0x7fed3c197a60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fed2800c8f0 tx=0x7fed2800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:27.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:27.038+0000 7fed39ffb640 1 -- 172.21.15.88:0/1431296468 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fed280079b0 con 0x7fed3c101a60 2024-09-17T04:26:27.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:27.038+0000 7fed39ffb640 1 -- 172.21.15.88:0/1431296468 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fed280054e0 con 0x7fed3c101a60 2024-09-17T04:26:27.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:27.038+0000 7fed42acb640 1 -- 172.21.15.88:0/1431296468 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed3c19cb20 con 0x7fed3c101a60 2024-09-17T04:26:27.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:27.038+0000 7fed39ffb640 1 -- 172.21.15.88:0/1431296468 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fed28004dd0 con 0x7fed3c101a60 2024-09-17T04:26:27.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:27.038+0000 7fed42acb640 1 -- 172.21.15.88:0/1431296468 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed3c19d0b0 con 0x7fed3c101a60 2024-09-17T04:26:27.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:27.039+0000 7fed42acb640 1 -- 172.21.15.88:0/1431296468 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed3c100c60 con 0x7fed3c101a60 2024-09-17T04:26:27.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:27.040+0000 7fed39ffb640 1 -- 172.21.15.88:0/1431296468 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fed28005020 con 0x7fed3c101a60 2024-09-17T04:26:27.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:27.040+0000 7fed39ffb640 1 --2- 172.21.15.88:0/1431296468 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fed2c07af30 0x7fed2c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:27.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:27.040+0000 7fed39ffb640 1 -- 172.21.15.88:0/1431296468 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6070+0+0 (secure 0 0 0) 0x7fed2809df00 con 0x7fed3c101a60 2024-09-17T04:26:27.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:27.040+0000 7fed40867640 1 --2- 172.21.15.88:0/1431296468 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fed2c07af30 0x7fed2c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:27.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:27.041+0000 7fed40867640 1 --2- 172.21.15.88:0/1431296468 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fed2c07af30 0x7fed2c07d3f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fed30006010 tx=0x7fed30000bc0 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:27.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:27.045+0000 7fed39ffb640 1 -- 172.21.15.88:0/1431296468 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fed28014030 con 0x7fed3c101a60 2024-09-17T04:26:27.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:27.298+0000 7fed42acb640 1 -- 172.21.15.88:0/1431296468 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fed3c19d560 con 0x7fed3c101a60 2024-09-17T04:26:27.298 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:27 smithi088 ceph-mon[90867]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:26:27.298 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:27 smithi088 ceph-mon[90867]: from='client.34264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:26:27.298 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:27 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:27.298 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:27 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:26:27.299 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:27 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/3855721433' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:26:27.299 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:27 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/440129563' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T04:26:27.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:27.298+0000 7fed39ffb640 1 -- 172.21.15.88:0/1431296468 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+480 (secure 0 0 0) 0x7fed280695d0 con 0x7fed3c101a60 2024-09-17T04:26:27.299 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Degraded data redundancy: 5/276 objects degraded (1.812%), 2 pgs degraded 2024-09-17T04:26:27.299 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T04:26:27.299 INFO:teuthology.orchestra.run.smithi088.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T04:26:27.299 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 5/276 objects degraded (1.812%), 2 pgs degraded 2024-09-17T04:26:27.299 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.f is active+undersized+degraded, acting [0,5] 2024-09-17T04:26:27.299 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-09-17T04:26:27.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:27.301+0000 7fed42acb640 1 -- 172.21.15.88:0/1431296468 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fed2c07af30 msgr2=0x7fed2c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:27.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:27.301+0000 7fed42acb640 1 --2- 172.21.15.88:0/1431296468 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fed2c07af30 0x7fed2c07d3f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fed30006010 tx=0x7fed30000bc0 comp rx=0 tx=0).stop 2024-09-17T04:26:27.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:27.301+0000 7fed42acb640 1 -- 172.21.15.88:0/1431296468 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed3c101a60 msgr2=0x7fed3c197a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:27.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:27.301+0000 7fed42acb640 1 --2- 172.21.15.88:0/1431296468 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed3c101a60 0x7fed3c197a60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fed2800c8f0 tx=0x7fed2800cdb0 comp rx=0 tx=0).stop 2024-09-17T04:26:27.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:27.301+0000 7fed42acb640 1 -- 172.21.15.88:0/1431296468 shutdown_connections 2024-09-17T04:26:27.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:27.301+0000 7fed42acb640 1 --2- 172.21.15.88:0/1431296468 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fed2c07af30 0x7fed2c07d3f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:27.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:27.301+0000 7fed42acb640 1 --2- 172.21.15.88:0/1431296468 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed3c101a60 0x7fed3c197a60 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:27.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:27.301+0000 7fed42acb640 1 --2- 172.21.15.88:0/1431296468 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed3c100860 0x7fed3c197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:27.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:27.302+0000 7fed42acb640 1 -- 172.21.15.88:0/1431296468 >> 172.21.15.88:0/1431296468 conn(0x7fed3c0fc010 msgr2=0x7fed3c06a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:27.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:27.302+0000 7fed42acb640 1 -- 172.21.15.88:0/1431296468 shutdown_connections 2024-09-17T04:26:27.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:27.302+0000 7fed42acb640 1 -- 172.21.15.88:0/1431296468 wait complete. 2024-09-17T04:26:27.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:27 smithi134 ceph-mon[76677]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:26:27.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:27 smithi134 ceph-mon[76677]: from='client.34264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:26:27.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:27 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:27.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:27 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:26:27.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:27 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/3855721433' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:26:27.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:27 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/440129563' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T04:26:28.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:28 smithi088 ceph-mon[90867]: pgmap v156: 65 pgs: 6 peering, 4 active+undersized, 2 active+undersized+degraded, 53 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 1 op/s; 5/276 objects degraded (1.812%) 2024-09-17T04:26:28.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:28 smithi088 ceph-mon[90867]: from='client.34276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:26:28.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:28 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/1431296468' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T04:26:28.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:28 smithi134 ceph-mon[76677]: pgmap v156: 65 pgs: 6 peering, 4 active+undersized, 2 active+undersized+degraded, 53 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 1 op/s; 5/276 objects degraded (1.812%) 2024-09-17T04:26:28.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:28 smithi134 ceph-mon[76677]: from='client.34276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:26:28.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:28 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/1431296468' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T04:26:29.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:29 smithi088 ceph-mon[90867]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 5/276 objects degraded (1.812%), 2 pgs degraded) 2024-09-17T04:26:29.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:29 smithi134 ceph-mon[76677]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 5/276 objects degraded (1.812%), 2 pgs degraded) 2024-09-17T04:26:30.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:30 smithi088 ceph-mon[90867]: pgmap v157: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 438 B/s rd, 1 op/s 2024-09-17T04:26:30.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:30 smithi134 ceph-mon[76677]: pgmap v157: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 438 B/s rd, 1 op/s 2024-09-17T04:26:32.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:32 smithi088 ceph-mon[90867]: pgmap v158: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1022 B/s rd, 2 op/s 2024-09-17T04:26:32.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:32 smithi134 ceph-mon[76677]: pgmap v158: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1022 B/s rd, 2 op/s 2024-09-17T04:26:34.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:34 smithi088 ceph-mon[90867]: pgmap v159: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 818 B/s rd, 1 op/s 2024-09-17T04:26:34.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:34 smithi134 ceph-mon[76677]: pgmap v159: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 818 B/s rd, 1 op/s 2024-09-17T04:26:35.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:35 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-17T04:26:35.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:35 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-17T04:26:36.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:36 smithi088 ceph-mon[90867]: pgmap v160: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:26:36.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:36 smithi088 ceph-mon[90867]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-17T04:26:36.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:36 smithi088 ceph-mon[90867]: Upgrade: osd.5 is safe to restart 2024-09-17T04:26:36.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:36 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:36.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:36 smithi134 ceph-mon[76677]: pgmap v160: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:26:36.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:36 smithi134 ceph-mon[76677]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-17T04:26:36.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:36 smithi134 ceph-mon[76677]: Upgrade: osd.5 is safe to restart 2024-09-17T04:26:36.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:36 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:37.551 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:37 smithi134 ceph-mon[76677]: Upgrade: Updating osd.5 2024-09-17T04:26:37.551 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:37 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:37.551 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:37 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-17T04:26:37.551 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:37 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:26:37.551 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:37 smithi134 ceph-mon[76677]: Deploying daemon osd.5 on smithi134 2024-09-17T04:26:37.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:37 smithi088 ceph-mon[90867]: Upgrade: Updating osd.5 2024-09-17T04:26:37.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:37 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:37.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:37 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-17T04:26:37.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:37 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:26:37.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:37 smithi088 ceph-mon[90867]: Deploying daemon osd.5 on smithi134 2024-09-17T04:26:38.452 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:38 smithi134 ceph-mon[76677]: pgmap v161: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:26:38.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:38 smithi088 ceph-mon[90867]: pgmap v161: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:26:39.422 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:39 smithi134 systemd[1]: Stopping Ceph osd.5 for bf2b79a4-74aa-11ef-bceb-c7b262605968... 2024-09-17T04:26:39.896 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:39 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5[55013]: 2024-09-17T04:26:39.421+0000 7f3a4fe18640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T04:26:39.896 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:39 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5[55013]: 2024-09-17T04:26:39.421+0000 7f3a4fe18640 -1 osd.5 72 *** Got signal Terminated *** 2024-09-17T04:26:39.896 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:39 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5[55013]: 2024-09-17T04:26:39.421+0000 7f3a4fe18640 -1 osd.5 72 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T04:26:40.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:40 smithi088 ceph-mon[90867]: pgmap v162: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:26:40.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:40 smithi088 ceph-mon[90867]: osd.5 marked itself down and dead 2024-09-17T04:26:40.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:40 smithi134 ceph-mon[76677]: pgmap v162: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:26:40.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:40 smithi134 ceph-mon[76677]: osd.5 marked itself down and dead 2024-09-17T04:26:41.101 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:40 smithi134 podman[94344]: 2024-09-17 04:26:40.761744943 +0000 UTC m=+1.445674386 container died bc1b434a92a84a5191f9523994292cad3238e44ca60e8b3eadc26dd96827e0d6 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-17T04:26:41.396 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:41 smithi134 podman[94344]: 2024-09-17 04:26:41.204276015 +0000 UTC m=+1.888205459 container cleanup bc1b434a92a84a5191f9523994292cad3238e44ca60e8b3eadc26dd96827e0d6 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True) 2024-09-17T04:26:41.396 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:41 smithi134 bash[94344]: ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5 2024-09-17T04:26:41.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:41 smithi134 ceph-mon[76677]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T04:26:41.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:41 smithi134 ceph-mon[76677]: osdmap e73: 6 total, 5 up, 6 in 2024-09-17T04:26:41.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:41 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:41.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:41 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:26:41.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:41 smithi088 ceph-mon[90867]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T04:26:41.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:41 smithi088 ceph-mon[90867]: osdmap e73: 6 total, 5 up, 6 in 2024-09-17T04:26:41.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:41 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:41.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:41 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:26:41.824 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:41 smithi134 podman[94363]: 2024-09-17 04:26:41.397201111 +0000 UTC m=+0.633978790 container remove bc1b434a92a84a5191f9523994292cad3238e44ca60e8b3eadc26dd96827e0d6 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T04:26:42.100 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:41 smithi134 podman[94449]: 2024-09-17 04:26:41.727931273 +0000 UTC m=+0.015960830 image pull 8e039cb7fe1eece5854872e8884a61a26632c7691b2c85cbac9078a9c5c62fae quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f 2024-09-17T04:26:42.101 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:41 smithi134 podman[94449]: 2024-09-17 04:26:41.840373386 +0000 UTC m=+0.128402983 container create 456afe9030d7f2c15fbe9c8910f0328d1e64934661bd2e3ed5b3539682145e22 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5-deactivate, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-17T04:26:42.101 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:42 smithi134 podman[94449]: 2024-09-17 04:26:42.10135661 +0000 UTC m=+0.389386182 container init 456afe9030d7f2c15fbe9c8910f0328d1e64934661bd2e3ed5b3539682145e22 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.license=GPLv2) 2024-09-17T04:26:42.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:42 smithi134 ceph-mon[76677]: pgmap v164: 65 pgs: 3 peering, 12 stale+active+clean, 50 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s 2024-09-17T04:26:42.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:42 smithi134 ceph-mon[76677]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-17T04:26:42.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:42 smithi134 ceph-mon[76677]: osdmap e74: 6 total, 5 up, 6 in 2024-09-17T04:26:42.397 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:42 smithi134 podman[94449]: 2024-09-17 04:26:42.104877071 +0000 UTC m=+0.392906626 container start 456afe9030d7f2c15fbe9c8910f0328d1e64934661bd2e3ed5b3539682145e22 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-17T04:26:42.397 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:42 smithi134 podman[94449]: 2024-09-17 04:26:42.184560062 +0000 UTC m=+0.472589620 container attach 456afe9030d7f2c15fbe9c8910f0328d1e64934661bd2e3ed5b3539682145e22 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-17T04:26:42.397 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:42 smithi134 podman[94449]: 2024-09-17 04:26:42.295479728 +0000 UTC m=+0.583509288 container died 456afe9030d7f2c15fbe9c8910f0328d1e64934661bd2e3ed5b3539682145e22 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T04:26:42.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:42 smithi088 ceph-mon[90867]: pgmap v164: 65 pgs: 3 peering, 12 stale+active+clean, 50 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s 2024-09-17T04:26:42.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:42 smithi088 ceph-mon[90867]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-17T04:26:42.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:42 smithi088 ceph-mon[90867]: osdmap e74: 6 total, 5 up, 6 in 2024-09-17T04:26:43.282 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:42 smithi134 podman[94472]: 2024-09-17 04:26:42.912961854 +0000 UTC m=+0.611222099 container remove 456afe9030d7f2c15fbe9c8910f0328d1e64934661bd2e3ed5b3539682145e22 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-17T04:26:43.282 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:42 smithi134 systemd[1]: ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968@osd.5.service: Deactivated successfully. 2024-09-17T04:26:43.282 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:42 smithi134 systemd[1]: Stopped Ceph osd.5 for bf2b79a4-74aa-11ef-bceb-c7b262605968. 2024-09-17T04:26:43.282 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:42 smithi134 systemd[1]: ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968@osd.5.service: Consumed 49.573s CPU time. 2024-09-17T04:26:43.282 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:43 smithi134 systemd[1]: Starting Ceph osd.5 for bf2b79a4-74aa-11ef-bceb-c7b262605968... 2024-09-17T04:26:43.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:43 smithi088 ceph-mon[90867]: Health check failed: Degraded data redundancy: 10/276 objects degraded (3.623%), 3 pgs degraded (PG_DEGRADED) 2024-09-17T04:26:43.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:43 smithi134 ceph-mon[76677]: Health check failed: Degraded data redundancy: 10/276 objects degraded (3.623%), 3 pgs degraded (PG_DEGRADED) 2024-09-17T04:26:43.646 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:43 smithi134 podman[94569]: 2024-09-17 04:26:43.247747277 +0000 UTC m=+0.016028521 image pull 8e039cb7fe1eece5854872e8884a61a26632c7691b2c85cbac9078a9c5c62fae quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f 2024-09-17T04:26:43.646 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:43 smithi134 podman[94569]: 2024-09-17 04:26:43.389407664 +0000 UTC m=+0.157688941 container create 523fc2ef783a5660fb37c095999b841df34cc250ca83ecf12d1f7ed182ec15a5 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5-activate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T04:26:44.146 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:43 smithi134 podman[94569]: 2024-09-17 04:26:43.652616336 +0000 UTC m=+0.420897571 container init 523fc2ef783a5660fb37c095999b841df34cc250ca83ecf12d1f7ed182ec15a5 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5-activate, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-17T04:26:44.146 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:43 smithi134 podman[94569]: 2024-09-17 04:26:43.655995245 +0000 UTC m=+0.424276480 container start 523fc2ef783a5660fb37c095999b841df34cc250ca83ecf12d1f7ed182ec15a5 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5-activate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342) 2024-09-17T04:26:44.146 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:43 smithi134 podman[94569]: 2024-09-17 04:26:43.744315563 +0000 UTC m=+0.512596797 container attach 523fc2ef783a5660fb37c095999b841df34cc250ca83ecf12d1f7ed182ec15a5 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5-activate, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T04:26:44.146 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:43 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5-activate[94584]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T04:26:44.146 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:43 smithi134 bash[94569]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T04:26:44.146 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:43 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5-activate[94584]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T04:26:44.146 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:43 smithi134 bash[94569]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T04:26:44.615 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:44 smithi134 ceph-mon[76677]: pgmap v166: 65 pgs: 4 active+undersized, 3 peering, 8 stale+active+clean, 3 active+undersized+degraded, 47 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 10/276 objects degraded (3.623%) 2024-09-17T04:26:44.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:44 smithi088 ceph-mon[90867]: pgmap v166: 65 pgs: 4 active+undersized, 3 peering, 8 stale+active+clean, 3 active+undersized+degraded, 47 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 10/276 objects degraded (3.623%) 2024-09-17T04:26:44.896 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:44 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5-activate[94584]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-17T04:26:44.896 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:44 smithi134 bash[94569]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-17T04:26:44.896 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:44 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5-activate[94584]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-17T04:26:44.896 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:44 smithi134 bash[94569]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-17T04:26:45.250 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:44 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5-activate[94584]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-17T04:26:45.250 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:44 smithi134 bash[94569]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-17T04:26:45.250 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:44 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5-activate[94584]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-17T04:26:45.251 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:44 smithi134 bash[94569]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-17T04:26:45.251 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:44 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5-activate[94584]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-17T04:26:45.251 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:44 smithi134 bash[94569]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-17T04:26:45.251 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:44 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5-activate[94584]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-17T04:26:45.251 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:44 smithi134 bash[94569]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-17T04:26:45.251 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:44 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5-activate[94584]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-17T04:26:45.251 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:44 smithi134 bash[94569]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-17T04:26:45.251 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:44 smithi134 podman[94569]: 2024-09-17 04:26:44.953841889 +0000 UTC m=+1.722123128 container died 523fc2ef783a5660fb37c095999b841df34cc250ca83ecf12d1f7ed182ec15a5 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5-activate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T04:26:45.896 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:45 smithi134 podman[94715]: 2024-09-17 04:26:45.551952227 +0000 UTC m=+0.586630110 container remove 523fc2ef783a5660fb37c095999b841df34cc250ca83ecf12d1f7ed182ec15a5 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5-activate, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-17T04:26:45.896 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:45 smithi134 podman[94774]: 2024-09-17 04:26:45.661065963 +0000 UTC m=+0.016037437 image pull 8e039cb7fe1eece5854872e8884a61a26632c7691b2c85cbac9078a9c5c62fae quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f 2024-09-17T04:26:45.896 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:45 smithi134 podman[94774]: 2024-09-17 04:26:45.777863189 +0000 UTC m=+0.132834666 container create 5066799816d3d6044afdbeac0f5f5ac552cb476f20531419f7b32b83b76b9a17 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True) 2024-09-17T04:26:46.288 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:46 smithi134 podman[94774]: 2024-09-17 04:26:46.024643646 +0000 UTC m=+0.379615119 container init 5066799816d3d6044afdbeac0f5f5ac552cb476f20531419f7b32b83b76b9a17 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T04:26:46.288 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:46 smithi134 podman[94774]: 2024-09-17 04:26:46.027893714 +0000 UTC m=+0.382865187 container start 5066799816d3d6044afdbeac0f5f5ac552cb476f20531419f7b32b83b76b9a17 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True) 2024-09-17T04:26:46.288 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:46 smithi134 ceph-osd[94792]: -- 172.21.15.134:0/1207719920 <== mon.1 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b52a6381e0 con 0x55b5298c0d00 2024-09-17T04:26:46.288 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:46 smithi134 bash[94774]: 5066799816d3d6044afdbeac0f5f5ac552cb476f20531419f7b32b83b76b9a17 2024-09-17T04:26:46.288 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:46 smithi134 systemd[1]: Started Ceph osd.5 for bf2b79a4-74aa-11ef-bceb-c7b262605968. 2024-09-17T04:26:46.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:46 smithi088 ceph-mon[90867]: pgmap v167: 65 pgs: 14 active+undersized, 3 peering, 11 active+undersized+degraded, 37 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 38/276 objects degraded (13.768%) 2024-09-17T04:26:46.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:46 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:46.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:46 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:46.639 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:46 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:26:46.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:46 smithi134 ceph-mon[76677]: pgmap v167: 65 pgs: 14 active+undersized, 3 peering, 11 active+undersized+degraded, 37 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 38/276 objects degraded (13.768%) 2024-09-17T04:26:46.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:46 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:46.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:46 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:46.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:46 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:26:47.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:47 smithi134 ceph-mon[76677]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-17T04:26:47.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:47 smithi088 ceph-mon[90867]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-17T04:26:47.896 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:47 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5[94788]: 2024-09-17T04:26:47.705+0000 7f9a795cb640 -1 Falling back to public interface 2024-09-17T04:26:48.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:48 smithi088 ceph-mon[90867]: pgmap v168: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 42/276 objects degraded (15.217%) 2024-09-17T04:26:48.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:48 smithi134 ceph-mon[76677]: pgmap v168: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 42/276 objects degraded (15.217%) 2024-09-17T04:26:50.328 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:50 smithi134 ceph-mon[76677]: pgmap v169: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 42/276 objects degraded (15.217%) 2024-09-17T04:26:50.329 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:50 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:50.329 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:50 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:50.329 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:50 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:50.329 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:50 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:50.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:50 smithi088 ceph-mon[90867]: pgmap v169: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 42/276 objects degraded (15.217%) 2024-09-17T04:26:50.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:50 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:50.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:50 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:50.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:50 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:50.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:50 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:52.337 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:52 smithi134 ceph-mon[76677]: pgmap v170: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 818 B/s rd, 1 op/s; 42/276 objects degraded (15.217%) 2024-09-17T04:26:52.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:52 smithi088 ceph-mon[90867]: pgmap v170: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 818 B/s rd, 1 op/s; 42/276 objects degraded (15.217%) 2024-09-17T04:26:53.358 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:53 smithi134 ceph-mon[76677]: Health check update: Degraded data redundancy: 42/276 objects degraded (15.217%), 13 pgs degraded (PG_DEGRADED) 2024-09-17T04:26:53.358 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:53 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:53.358 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:53 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:53.358 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:53 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:26:53.358 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:53 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:26:53.358 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:53 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:53.359 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:53 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:26:53.359 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:53 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:26:53.359 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:53 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:26:53.359 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:53 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:26:53.359 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:53 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:26:53.359 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:53 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:53.359 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:53 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.0"} : dispatch 2024-09-17T04:26:53.359 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:53 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-17T04:26:53.359 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:53 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.1"} : dispatch 2024-09-17T04:26:53.359 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:53 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-17T04:26:53.359 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:53 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.2"} : dispatch 2024-09-17T04:26:53.359 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:53 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-17T04:26:53.359 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:53 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.3"} : dispatch 2024-09-17T04:26:53.359 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:53 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-17T04:26:53.359 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:53 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.4"} : dispatch 2024-09-17T04:26:53.360 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:53 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-17T04:26:53.360 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:53 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.5"} : dispatch 2024-09-17T04:26:53.360 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:53 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-17T04:26:53.360 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:53 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:53.360 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:53 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"} : dispatch 2024-09-17T04:26:53.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:53 smithi088 ceph-mon[90867]: Health check update: Degraded data redundancy: 42/276 objects degraded (15.217%), 13 pgs degraded (PG_DEGRADED) 2024-09-17T04:26:53.650 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:53 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:53.650 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:53 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:53.650 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:53 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:26:53.650 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:53 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:26:53.650 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:53 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:53.650 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:53 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:26:53.650 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:53 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:26:53.650 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:53 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:26:53.650 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:53 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:26:53.650 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:53 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:26:53.651 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:53 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:53.651 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:53 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.0"} : dispatch 2024-09-17T04:26:53.651 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:53 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-17T04:26:53.651 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:53 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.1"} : dispatch 2024-09-17T04:26:53.651 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:53 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-17T04:26:53.651 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:53 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.2"} : dispatch 2024-09-17T04:26:53.651 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:53 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-17T04:26:53.651 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:53 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.3"} : dispatch 2024-09-17T04:26:53.651 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:53 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-17T04:26:53.651 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:53 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.4"} : dispatch 2024-09-17T04:26:53.651 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:53 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-17T04:26:53.652 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:53 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.5"} : dispatch 2024-09-17T04:26:53.652 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:53 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-17T04:26:53.652 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:53 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:53.652 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:53 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"} : dispatch 2024-09-17T04:26:53.652 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:53 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5[94788]: 2024-09-17T04:26:53.357+0000 7f9a795cb640 -1 osd.5 72 log_to_monitors true 2024-09-17T04:26:54.596 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:54 smithi088 ceph-mon[90867]: pgmap v171: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 729 B/s rd, 1 op/s; 42/276 objects degraded (15.217%) 2024-09-17T04:26:54.597 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:54 smithi088 ceph-mon[90867]: Upgrade: Setting container_image for all osd 2024-09-17T04:26:54.597 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:54 smithi088 ceph-mon[90867]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-09-17T04:26:54.597 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:54 smithi088 ceph-mon[90867]: osdmap e75: 6 total, 5 up, 6 in 2024-09-17T04:26:54.597 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:54 smithi088 ceph-mon[90867]: from='osd.5 [v2:172.21.15.134:6816/1587694419,v1:172.21.15.134:6817/1587694419]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-17T04:26:54.597 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:54 smithi088 ceph-mon[90867]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-17T04:26:54.597 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:54 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-09-17T04:26:54.597 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:54 smithi088 ceph-mon[90867]: fsmap cephfs:1 {0=cephfs.smithi088.giqrgt=up:active} 2 up:standby 2024-09-17T04:26:54.597 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:54 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:26:54.597 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:54 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:26:54.597 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:54 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:26:54.597 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:54 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:54.646 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:26:54 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5[94788]: 2024-09-17T04:26:54.229+0000 7f9a6d343640 -1 osd.5 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T04:26:54.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:54 smithi134 ceph-mon[76677]: pgmap v171: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 729 B/s rd, 1 op/s; 42/276 objects degraded (15.217%) 2024-09-17T04:26:54.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:54 smithi134 ceph-mon[76677]: Upgrade: Setting container_image for all osd 2024-09-17T04:26:54.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:54 smithi134 ceph-mon[76677]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-09-17T04:26:54.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:54 smithi134 ceph-mon[76677]: osdmap e75: 6 total, 5 up, 6 in 2024-09-17T04:26:54.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:54 smithi134 ceph-mon[76677]: from='osd.5 [v2:172.21.15.134:6816/1587694419,v1:172.21.15.134:6817/1587694419]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-17T04:26:54.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:54 smithi134 ceph-mon[76677]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-17T04:26:54.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:54 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-09-17T04:26:54.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:54 smithi134 ceph-mon[76677]: fsmap cephfs:1 {0=cephfs.smithi088.giqrgt=up:active} 2 up:standby 2024-09-17T04:26:54.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:54 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:26:54.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:54 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:26:54.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:54 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:26:54.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:54 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:55.585 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:55 smithi088 ceph-mon[90867]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-17T04:26:55.585 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:55 smithi088 ceph-mon[90867]: osdmap e76: 6 total, 5 up, 6 in 2024-09-17T04:26:55.585 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:55 smithi088 ceph-mon[90867]: from='osd.5 [v2:172.21.15.134:6816/1587694419,v1:172.21.15.134:6817/1587694419]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-09-17T04:26:55.585 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:55 smithi088 ceph-mon[90867]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-09-17T04:26:55.585 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:55 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:26:55.585 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:55 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:26:55.585 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:55 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:26:55.586 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:55 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:26:55.586 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:55 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:26:55.586 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:55 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi088.lgavsv"]} : dispatch 2024-09-17T04:26:55.586 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:55 smithi088 ceph-mon[90867]: Upgrade: It appears safe to stop mds.cephfs.smithi088.lgavsv 2024-09-17T04:26:55.586 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:55 smithi088 ceph-mon[90867]: mds.? [v2:172.21.15.134:6826/584624515,v1:172.21.15.134:6827/584624515] up:boot 2024-09-17T04:26:55.586 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:55 smithi088 ceph-mon[90867]: fsmap cephfs:1 {0=cephfs.smithi088.giqrgt=up:active} 3 up:standby 2024-09-17T04:26:55.586 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:55 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "mds metadata", "who": "cephfs.smithi134.psnynp"} : dispatch 2024-09-17T04:26:55.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:55 smithi134 ceph-mon[76677]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-17T04:26:55.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:55 smithi134 ceph-mon[76677]: osdmap e76: 6 total, 5 up, 6 in 2024-09-17T04:26:55.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:55 smithi134 ceph-mon[76677]: from='osd.5 [v2:172.21.15.134:6816/1587694419,v1:172.21.15.134:6817/1587694419]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-09-17T04:26:55.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:55 smithi134 ceph-mon[76677]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-09-17T04:26:55.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:55 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:26:55.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:55 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:26:55.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:55 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:26:55.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:55 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:26:55.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:55 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:26:55.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:55 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi088.lgavsv"]} : dispatch 2024-09-17T04:26:55.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:55 smithi134 ceph-mon[76677]: Upgrade: It appears safe to stop mds.cephfs.smithi088.lgavsv 2024-09-17T04:26:55.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:55 smithi134 ceph-mon[76677]: mds.? [v2:172.21.15.134:6826/584624515,v1:172.21.15.134:6827/584624515] up:boot 2024-09-17T04:26:55.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:55 smithi134 ceph-mon[76677]: fsmap cephfs:1 {0=cephfs.smithi088.giqrgt=up:active} 3 up:standby 2024-09-17T04:26:55.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:55 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "mds metadata", "who": "cephfs.smithi134.psnynp"} : dispatch 2024-09-17T04:26:56.631 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:56 smithi088 ceph-mon[90867]: pgmap v174: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 42/276 objects degraded (15.217%) 2024-09-17T04:26:56.632 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:56 smithi088 ceph-mon[90867]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T04:26:56.632 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:56 smithi088 ceph-mon[90867]: osd.5 [v2:172.21.15.134:6816/1587694419,v1:172.21.15.134:6817/1587694419] boot 2024-09-17T04:26:56.632 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:56 smithi088 ceph-mon[90867]: osdmap e77: 6 total, 6 up, 6 in 2024-09-17T04:26:56.632 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:56 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-17T04:26:56.632 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:56 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:56.632 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:56 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi088.lgavsv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-17T04:26:56.632 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:56 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:26:56.632 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:56 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:56.632 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:56 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:26:56.632 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:56 smithi088 ceph-mon[90867]: osdmap e78: 6 total, 6 up, 6 in 2024-09-17T04:26:56.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:56 smithi134 ceph-mon[76677]: pgmap v174: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 42/276 objects degraded (15.217%) 2024-09-17T04:26:56.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:56 smithi134 ceph-mon[76677]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T04:26:56.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:56 smithi134 ceph-mon[76677]: osd.5 [v2:172.21.15.134:6816/1587694419,v1:172.21.15.134:6817/1587694419] boot 2024-09-17T04:26:56.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:56 smithi134 ceph-mon[76677]: osdmap e77: 6 total, 6 up, 6 in 2024-09-17T04:26:56.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:56 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-17T04:26:56.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:56 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:56.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:56 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi088.lgavsv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-17T04:26:56.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:56 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:26:56.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:56 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:26:56.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:56 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:26:56.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:56 smithi134 ceph-mon[76677]: osdmap e78: 6 total, 6 up, 6 in 2024-09-17T04:26:57.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.388+0000 7f965bba0640 1 -- 172.21.15.88:0/111847945 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9654102b60 msgr2=0x7f9654102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:57.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.388+0000 7f965bba0640 1 --2- 172.21.15.88:0/111847945 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9654102b60 0x7f9654102fe0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9648009880 tx=0x7f964802a4a0 comp rx=0 tx=0).stop 2024-09-17T04:26:57.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.388+0000 7f965bba0640 1 -- 172.21.15.88:0/111847945 shutdown_connections 2024-09-17T04:26:57.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.388+0000 7f965bba0640 1 --2- 172.21.15.88:0/111847945 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9654102b60 0x7f9654102fe0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:57.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.388+0000 7f965bba0640 1 --2- 172.21.15.88:0/111847945 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9654101960 0x7f9654101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:57.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.388+0000 7f965bba0640 1 -- 172.21.15.88:0/111847945 >> 172.21.15.88:0/111847945 conn(0x7f96540fd0f0 msgr2=0x7f96540ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:57.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.388+0000 7f965bba0640 1 -- 172.21.15.88:0/111847945 shutdown_connections 2024-09-17T04:26:57.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.388+0000 7f965bba0640 1 -- 172.21.15.88:0/111847945 wait complete. 2024-09-17T04:26:57.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.389+0000 7f965bba0640 1 Processor -- start 2024-09-17T04:26:57.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.389+0000 7f965bba0640 1 -- start start 2024-09-17T04:26:57.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.389+0000 7f965bba0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9654101960 0x7f9654197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:57.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.389+0000 7f965bba0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9654102b60 0x7f96541979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:57.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.389+0000 7f965bba0640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f965410a7a0 con 0x7f9654101960 2024-09-17T04:26:57.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.389+0000 7f965bba0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f965410a620 con 0x7f9654102b60 2024-09-17T04:26:57.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.389+0000 7f965993c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9654101960 0x7f9654197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:57.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.389+0000 7f965993c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9654101960 0x7f9654197490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45864/0 (socket says 172.21.15.88:45864) 2024-09-17T04:26:57.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.389+0000 7f965993c640 1 -- 172.21.15.88:0/3641505565 learned_addr learned my addr 172.21.15.88:0/3641505565 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:26:57.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.389+0000 7f965913b640 1 --2- 172.21.15.88:0/3641505565 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9654102b60 0x7f96541979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:57.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.390+0000 7f965993c640 1 -- 172.21.15.88:0/3641505565 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9654102b60 msgr2=0x7f96541979d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:57.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.390+0000 7f965993c640 1 --2- 172.21.15.88:0/3641505565 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9654102b60 0x7f96541979d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:57.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.390+0000 7f965993c640 1 -- 172.21.15.88:0/3641505565 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9654198050 con 0x7f9654101960 2024-09-17T04:26:57.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.390+0000 7f965993c640 1 --2- 172.21.15.88:0/3641505565 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9654101960 0x7f9654197490 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f964c00ea20 tx=0x7f964c00eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:57.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.390+0000 7f9652ffd640 1 -- 172.21.15.88:0/3641505565 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f964c016070 con 0x7f9654101960 2024-09-17T04:26:57.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.390+0000 7f9652ffd640 1 -- 172.21.15.88:0/3641505565 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f964c003e30 con 0x7f9654101960 2024-09-17T04:26:57.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.390+0000 7f965bba0640 1 -- 172.21.15.88:0/3641505565 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f965419ca90 con 0x7f9654101960 2024-09-17T04:26:57.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.390+0000 7f9652ffd640 1 -- 172.21.15.88:0/3641505565 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f964c011470 con 0x7f9654101960 2024-09-17T04:26:57.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.390+0000 7f965bba0640 1 -- 172.21.15.88:0/3641505565 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f965419cff0 con 0x7f9654101960 2024-09-17T04:26:57.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.391+0000 7f965bba0640 1 -- 172.21.15.88:0/3641505565 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9654101d60 con 0x7f9654101960 2024-09-17T04:26:57.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.392+0000 7f9652ffd640 1 -- 172.21.15.88:0/3641505565 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f964c019070 con 0x7f9654101960 2024-09-17T04:26:57.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.392+0000 7f9652ffd640 1 --2- 172.21.15.88:0/3641505565 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f963c07af90 0x7f963c07d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:57.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.393+0000 7f9652ffd640 1 -- 172.21.15.88:0/3641505565 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 6070+0+0 (secure 0 0 0) 0x7f964c09e120 con 0x7f9654101960 2024-09-17T04:26:57.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.393+0000 7f965913b640 1 --2- 172.21.15.88:0/3641505565 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f963c07af90 0x7f963c07d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:57.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.393+0000 7f965913b640 1 --2- 172.21.15.88:0/3641505565 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f963c07af90 0x7f963c07d450 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9648000c00 tx=0x7f9648005a20 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:57.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.397+0000 7f9652ffd640 1 -- 172.21.15.88:0/3641505565 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f964c0697f0 con 0x7f9654101960 2024-09-17T04:26:57.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.591+0000 7f965bba0640 1 -- 172.21.15.88:0/3641505565 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f96540626f0 con 0x7f963c07af90 2024-09-17T04:26:57.592 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:57 smithi088 ceph-mon[90867]: Upgrade: Updating mds.cephfs.smithi088.lgavsv 2024-09-17T04:26:57.592 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:57 smithi088 ceph-mon[90867]: Deploying daemon mds.cephfs.smithi088.lgavsv on smithi088 2024-09-17T04:26:57.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.592+0000 7f9652ffd640 1 -- 172.21.15.88:0/3641505565 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f96540626f0 con 0x7f963c07af90 2024-09-17T04:26:57.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.595+0000 7f965bba0640 1 -- 172.21.15.88:0/3641505565 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f963c07af90 msgr2=0x7f963c07d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:57.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.595+0000 7f965bba0640 1 --2- 172.21.15.88:0/3641505565 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f963c07af90 0x7f963c07d450 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9648000c00 tx=0x7f9648005a20 comp rx=0 tx=0).stop 2024-09-17T04:26:57.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.595+0000 7f965bba0640 1 -- 172.21.15.88:0/3641505565 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9654101960 msgr2=0x7f9654197490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:57.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.595+0000 7f965bba0640 1 --2- 172.21.15.88:0/3641505565 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9654101960 0x7f9654197490 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f964c00ea20 tx=0x7f964c00eee0 comp rx=0 tx=0).stop 2024-09-17T04:26:57.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.595+0000 7f965bba0640 1 -- 172.21.15.88:0/3641505565 shutdown_connections 2024-09-17T04:26:57.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.595+0000 7f965bba0640 1 --2- 172.21.15.88:0/3641505565 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f963c07af90 0x7f963c07d450 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:57.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.595+0000 7f965bba0640 1 --2- 172.21.15.88:0/3641505565 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9654102b60 0x7f96541979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:57.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.595+0000 7f965bba0640 1 --2- 172.21.15.88:0/3641505565 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9654101960 0x7f9654197490 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:57.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.595+0000 7f965bba0640 1 -- 172.21.15.88:0/3641505565 >> 172.21.15.88:0/3641505565 conn(0x7f96540fd0f0 msgr2=0x7f9654105fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:57.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.595+0000 7f965bba0640 1 -- 172.21.15.88:0/3641505565 shutdown_connections 2024-09-17T04:26:57.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.595+0000 7f965bba0640 1 -- 172.21.15.88:0/3641505565 wait complete. 2024-09-17T04:26:57.604 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-09-17T04:26:57.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:57 smithi134 ceph-mon[76677]: Upgrade: Updating mds.cephfs.smithi088.lgavsv 2024-09-17T04:26:57.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:57 smithi134 ceph-mon[76677]: Deploying daemon mds.cephfs.smithi088.lgavsv on smithi088 2024-09-17T04:26:57.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.677+0000 7feef9319640 1 -- 172.21.15.88:0/1996942150 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feef4100880 msgr2=0x7feef4100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:57.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.677+0000 7feef9319640 1 --2- 172.21.15.88:0/1996942150 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feef4100880 0x7feef4100c80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7feee4009c20 tx=0x7feee402a970 comp rx=0 tx=0).stop 2024-09-17T04:26:57.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.678+0000 7feef9319640 1 -- 172.21.15.88:0/1996942150 shutdown_connections 2024-09-17T04:26:57.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.678+0000 7feef9319640 1 --2- 172.21.15.88:0/1996942150 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feef4101a80 0x7feef4101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:57.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.678+0000 7feef9319640 1 --2- 172.21.15.88:0/1996942150 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feef4100880 0x7feef4100c80 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:57.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.678+0000 7feef9319640 1 -- 172.21.15.88:0/1996942150 >> 172.21.15.88:0/1996942150 conn(0x7feef40fc010 msgr2=0x7feef40fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:57.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.678+0000 7feef9319640 1 -- 172.21.15.88:0/1996942150 shutdown_connections 2024-09-17T04:26:57.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.678+0000 7feef9319640 1 -- 172.21.15.88:0/1996942150 wait complete. 2024-09-17T04:26:57.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.678+0000 7feef9319640 1 Processor -- start 2024-09-17T04:26:57.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.678+0000 7feef9319640 1 -- start start 2024-09-17T04:26:57.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.678+0000 7feef9319640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feef4100880 0x7feef4199710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:57.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.679+0000 7feef9319640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feef4101a80 0x7feef4199c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:57.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.679+0000 7feef9319640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7feef41096c0 con 0x7feef4101a80 2024-09-17T04:26:57.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.679+0000 7feef9319640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7feef4109540 con 0x7feef4100880 2024-09-17T04:26:57.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.679+0000 7feef27fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feef4101a80 0x7feef4199c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:57.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.679+0000 7feef27fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feef4101a80 0x7feef4199c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45890/0 (socket says 172.21.15.88:45890) 2024-09-17T04:26:57.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.679+0000 7feef27fc640 1 -- 172.21.15.88:0/2409391710 learned_addr learned my addr 172.21.15.88:0/2409391710 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:26:57.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.679+0000 7feef2ffd640 1 --2- 172.21.15.88:0/2409391710 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feef4100880 0x7feef4199710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:57.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.679+0000 7feef27fc640 1 -- 172.21.15.88:0/2409391710 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feef4100880 msgr2=0x7feef4199710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:57.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.679+0000 7feef27fc640 1 --2- 172.21.15.88:0/2409391710 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feef4100880 0x7feef4199710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:57.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.679+0000 7feef27fc640 1 -- 172.21.15.88:0/2409391710 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feef419a2d0 con 0x7feef4101a80 2024-09-17T04:26:57.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.679+0000 7feef2ffd640 1 --2- 172.21.15.88:0/2409391710 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feef4100880 0x7feef4199710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:26:57.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.679+0000 7feef27fc640 1 --2- 172.21.15.88:0/2409391710 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feef4101a80 0x7feef4199c50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7feee800d6f0 tx=0x7feee800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:57.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.679+0000 7feedbfff640 1 -- 172.21.15.88:0/2409391710 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feee8017070 con 0x7feef4101a80 2024-09-17T04:26:57.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.679+0000 7feef9319640 1 -- 172.21.15.88:0/2409391710 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feef419ed10 con 0x7feef4101a80 2024-09-17T04:26:57.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.679+0000 7feedbfff640 1 -- 172.21.15.88:0/2409391710 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7feee800de00 con 0x7feef4101a80 2024-09-17T04:26:57.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.679+0000 7feedbfff640 1 -- 172.21.15.88:0/2409391710 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feee8004bb0 con 0x7feef4101a80 2024-09-17T04:26:57.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.679+0000 7feef9319640 1 -- 172.21.15.88:0/2409391710 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feef419f2c0 con 0x7feef4101a80 2024-09-17T04:26:57.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.680+0000 7feef9319640 1 -- 172.21.15.88:0/2409391710 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feef4100c80 con 0x7feef4101a80 2024-09-17T04:26:57.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.681+0000 7feedbfff640 1 -- 172.21.15.88:0/2409391710 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7feee8009a30 con 0x7feef4101a80 2024-09-17T04:26:57.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.682+0000 7feedbfff640 1 --2- 172.21.15.88:0/2409391710 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7feedc07af80 0x7feedc07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:57.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.682+0000 7feedbfff640 1 -- 172.21.15.88:0/2409391710 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 6070+0+0 (secure 0 0 0) 0x7feee809db20 con 0x7feef4101a80 2024-09-17T04:26:57.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.682+0000 7feef2ffd640 1 --2- 172.21.15.88:0/2409391710 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7feedc07af80 0x7feedc07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:57.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.682+0000 7feef2ffd640 1 --2- 172.21.15.88:0/2409391710 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7feedc07af80 0x7feedc07d440 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7feee402fa30 tx=0x7feee4005ef0 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:57.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.686+0000 7feedbfff640 1 -- 172.21.15.88:0/2409391710 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7feee80691f0 con 0x7feef4101a80 2024-09-17T04:26:57.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.879+0000 7feef9319640 1 -- 172.21.15.88:0/2409391710 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7feef406ac00 con 0x7feedc07af80 2024-09-17T04:26:57.881 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.880+0000 7feedbfff640 1 -- 172.21.15.88:0/2409391710 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7feef406ac00 con 0x7feedc07af80 2024-09-17T04:26:57.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.883+0000 7feef9319640 1 -- 172.21.15.88:0/2409391710 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7feedc07af80 msgr2=0x7feedc07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:57.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.883+0000 7feef9319640 1 --2- 172.21.15.88:0/2409391710 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7feedc07af80 0x7feedc07d440 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7feee402fa30 tx=0x7feee4005ef0 comp rx=0 tx=0).stop 2024-09-17T04:26:57.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.883+0000 7feef9319640 1 -- 172.21.15.88:0/2409391710 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feef4101a80 msgr2=0x7feef4199c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:57.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.883+0000 7feef9319640 1 --2- 172.21.15.88:0/2409391710 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feef4101a80 0x7feef4199c50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7feee800d6f0 tx=0x7feee800dbb0 comp rx=0 tx=0).stop 2024-09-17T04:26:57.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.883+0000 7feef9319640 1 -- 172.21.15.88:0/2409391710 shutdown_connections 2024-09-17T04:26:57.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.883+0000 7feef9319640 1 --2- 172.21.15.88:0/2409391710 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7feedc07af80 0x7feedc07d440 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:57.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.883+0000 7feef9319640 1 --2- 172.21.15.88:0/2409391710 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feef4101a80 0x7feef4199c50 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:57.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.883+0000 7feef9319640 1 --2- 172.21.15.88:0/2409391710 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feef4100880 0x7feef4199710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:57.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.883+0000 7feef9319640 1 -- 172.21.15.88:0/2409391710 >> 172.21.15.88:0/2409391710 conn(0x7feef40fc010 msgr2=0x7feef406a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:57.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.883+0000 7feef9319640 1 -- 172.21.15.88:0/2409391710 shutdown_connections 2024-09-17T04:26:57.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.883+0000 7feef9319640 1 -- 172.21.15.88:0/2409391710 wait complete. 2024-09-17T04:26:57.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.965+0000 7f98d6d20640 1 -- 172.21.15.88:0/2256369145 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98d0100860 msgr2=0x7f98d0100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:57.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.965+0000 7f98d6d20640 1 --2- 172.21.15.88:0/2256369145 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98d0100860 0x7f98d0100c60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f98c4009880 tx=0x7f98c402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:26:57.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.965+0000 7f98d6d20640 1 -- 172.21.15.88:0/2256369145 shutdown_connections 2024-09-17T04:26:57.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.965+0000 7f98d6d20640 1 --2- 172.21.15.88:0/2256369145 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98d0101a60 0x7f98d0101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:57.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.965+0000 7f98d6d20640 1 --2- 172.21.15.88:0/2256369145 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98d0100860 0x7f98d0100c60 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:57.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.965+0000 7f98d6d20640 1 -- 172.21.15.88:0/2256369145 >> 172.21.15.88:0/2256369145 conn(0x7f98d00fc010 msgr2=0x7f98d00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:57.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.965+0000 7f98d6d20640 1 -- 172.21.15.88:0/2256369145 shutdown_connections 2024-09-17T04:26:57.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.965+0000 7f98d6d20640 1 -- 172.21.15.88:0/2256369145 wait complete. 2024-09-17T04:26:57.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.965+0000 7f98d6d20640 1 Processor -- start 2024-09-17T04:26:57.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.965+0000 7f98d6d20640 1 -- start start 2024-09-17T04:26:57.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.965+0000 7f98d6d20640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98d0100860 0x7f98d01963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:57.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.965+0000 7f98d6d20640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98d0101a60 0x7f98d0196910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:57.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.965+0000 7f98d6d20640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f98d01096a0 con 0x7f98d0101a60 2024-09-17T04:26:57.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.965+0000 7f98d6d20640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f98d0109520 con 0x7f98d0100860 2024-09-17T04:26:57.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.966+0000 7f98cffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98d0101a60 0x7f98d0196910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:57.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.966+0000 7f98cffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98d0101a60 0x7f98d0196910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45910/0 (socket says 172.21.15.88:45910) 2024-09-17T04:26:57.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.966+0000 7f98cffff640 1 -- 172.21.15.88:0/3145154760 learned_addr learned my addr 172.21.15.88:0/3145154760 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:26:57.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.966+0000 7f98cffff640 1 -- 172.21.15.88:0/3145154760 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98d0100860 msgr2=0x7f98d01963d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:57.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.966+0000 7f98d4abc640 1 --2- 172.21.15.88:0/3145154760 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98d0100860 0x7f98d01963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:57.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.966+0000 7f98cffff640 1 --2- 172.21.15.88:0/3145154760 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98d0100860 0x7f98d01963d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:57.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.966+0000 7f98cffff640 1 -- 172.21.15.88:0/3145154760 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98d0196f90 con 0x7f98d0101a60 2024-09-17T04:26:57.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.966+0000 7f98cffff640 1 --2- 172.21.15.88:0/3145154760 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98d0101a60 0x7f98d0196910 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f98bc00d6f0 tx=0x7f98bc00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:57.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.966+0000 7f98cdffb640 1 -- 172.21.15.88:0/3145154760 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f98bc017070 con 0x7f98d0101a60 2024-09-17T04:26:57.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.966+0000 7f98d6d20640 1 -- 172.21.15.88:0/3145154760 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98d019b9d0 con 0x7f98d0101a60 2024-09-17T04:26:57.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.966+0000 7f98cdffb640 1 -- 172.21.15.88:0/3145154760 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f98bc00de00 con 0x7f98d0101a60 2024-09-17T04:26:57.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.966+0000 7f98cdffb640 1 -- 172.21.15.88:0/3145154760 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f98bc004bb0 con 0x7f98d0101a60 2024-09-17T04:26:57.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.966+0000 7f98d6d20640 1 -- 172.21.15.88:0/3145154760 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98d019bf60 con 0x7f98d0101a60 2024-09-17T04:26:57.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.967+0000 7f98d6d20640 1 -- 172.21.15.88:0/3145154760 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98d0100c60 con 0x7f98d0101a60 2024-09-17T04:26:57.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.968+0000 7f98cdffb640 1 -- 172.21.15.88:0/3145154760 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f98bc004e60 con 0x7f98d0101a60 2024-09-17T04:26:57.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.968+0000 7f98cdffb640 1 --2- 172.21.15.88:0/3145154760 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f98c007af30 0x7f98c007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:57.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.968+0000 7f98cdffb640 1 -- 172.21.15.88:0/3145154760 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 6070+0+0 (secure 0 0 0) 0x7f98bc09dbe0 con 0x7f98d0101a60 2024-09-17T04:26:57.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.968+0000 7f98d4abc640 1 --2- 172.21.15.88:0/3145154760 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f98c007af30 0x7f98c007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:57.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.969+0000 7f98d4abc640 1 --2- 172.21.15.88:0/3145154760 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f98c007af30 0x7f98c007d3f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f98c4006010 tx=0x7f98c4000bc0 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:57.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:57.973+0000 7f98cdffb640 1 -- 172.21.15.88:0/3145154760 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f98bc069230 con 0x7f98d0101a60 2024-09-17T04:26:58.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.158+0000 7f98d6d20640 1 -- 172.21.15.88:0/3145154760 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f98d0062630 con 0x7f98c007af30 2024-09-17T04:26:58.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.168+0000 7f98cdffb640 1 -- 172.21.15.88:0/3145154760 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f98d0062630 con 0x7f98c007af30 2024-09-17T04:26:58.169 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T04:26:58.169 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (12m) 107s ago 14m 25.4M - 0.25.0 c8568f914cd2 f2dbac7e939f 2024-09-17T04:26:58.169 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi088 smithi088 running (5m) 107s ago 14m 8678k - 19.1.1-330-gc2ddf972 ebb0615149de 683e1826a1a5 2024-09-17T04:26:58.169 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi134 smithi134 running (5m) 8s ago 13m 8711k - 19.1.1-330-gc2ddf972 ebb0615149de 83afa4200c0e 2024-09-17T04:26:58.169 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (3m) 107s ago 14m 6891k - 19.3.0-4989-gce1b342b 8e039cb7fe1e 10355648c406 2024-09-17T04:26:58.169 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi134 smithi134 running (3m) 8s ago 13m 6899k - 19.3.0-4989-gce1b342b 8e039cb7fe1e d709085ffe5d 2024-09-17T04:26:58.169 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (12m) 107s ago 13m 79.3M - 9.4.12 2bacad6d85d8 a6cff57a23f9 2024-09-17T04:26:58.169 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.giqrgt smithi088 running (8m) 107s ago 8m 148M - 19.1.1-330-gc2ddf972 ebb0615149de f724660799a1 2024-09-17T04:26:58.169 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.lgavsv smithi088 running (8m) 107s ago 8m 16.2M - 19.1.1-330-gc2ddf972 ebb0615149de 6cc0fe8a6aa9 2024-09-17T04:26:58.169 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi134.ktuhce smithi134 running (8m) 8s ago 8m 16.3M - 19.1.1-330-gc2ddf972 ebb0615149de 7ff5b70ca9cb 2024-09-17T04:26:58.169 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi134.psnynp smithi134 running (8m) 8s ago 8m 90.4M - 19.1.1-330-gc2ddf972 ebb0615149de 5326974fa3dd 2024-09-17T04:26:58.170 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.wmndiv smithi088 *:8443,9283,8765 running (5m) 107s ago 15m 584M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 49eb47f7f14f 2024-09-17T04:26:58.170 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi134.vwdxcb smithi134 *:8443,9283,8765 running (4m) 8s ago 13m 522M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 8a6d45eb0595 2024-09-17T04:26:58.170 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (3m) 107s ago 15m 112M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e ac6332015243 2024-09-17T04:26:58.170 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi134 smithi134 running (3m) 8s ago 13m 105M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e ea49f690e26b 2024-09-17T04:26:58.170 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (14m) 107s ago 14m 16.4M - 1.5.0 0da6a335fe13 9ba03800993b 2024-09-17T04:26:58.170 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi134 smithi134 *:9100 running (13m) 8s ago 13m 17.2M - 1.5.0 0da6a335fe13 6deac483827f 2024-09-17T04:26:58.170 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (3m) 107s ago 12m 155M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 4ef267302248 2024-09-17T04:26:58.170 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (2m) 107s ago 11m 153M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 17b67c13c7aa 2024-09-17T04:26:58.170 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (112s) 107s ago 11m 79.4M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 83d38ad792c9 2024-09-17T04:26:58.170 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi134 running (78s) 8s ago 10m 157M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e 336a363ac39f 2024-09-17T04:26:58.170 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi134 running (45s) 8s ago 10m 155M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e 6df8a692310a 2024-09-17T04:26:58.170 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi134 running (12s) 8s ago 9m 81.6M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e 5066799816d3 2024-09-17T04:26:58.170 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (4m) 107s ago 13m 66.9M - 2.43.0 a07b618ecd1d b51d7899d341 2024-09-17T04:26:58.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.170+0000 7f98d6d20640 1 -- 172.21.15.88:0/3145154760 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f98c007af30 msgr2=0x7f98c007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:58.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.170+0000 7f98d6d20640 1 --2- 172.21.15.88:0/3145154760 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f98c007af30 0x7f98c007d3f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f98c4006010 tx=0x7f98c4000bc0 comp rx=0 tx=0).stop 2024-09-17T04:26:58.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.170+0000 7f98d6d20640 1 -- 172.21.15.88:0/3145154760 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98d0101a60 msgr2=0x7f98d0196910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:58.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.170+0000 7f98d6d20640 1 --2- 172.21.15.88:0/3145154760 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98d0101a60 0x7f98d0196910 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f98bc00d6f0 tx=0x7f98bc00dbb0 comp rx=0 tx=0).stop 2024-09-17T04:26:58.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.170+0000 7f98d6d20640 1 -- 172.21.15.88:0/3145154760 shutdown_connections 2024-09-17T04:26:58.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.170+0000 7f98d6d20640 1 --2- 172.21.15.88:0/3145154760 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f98c007af30 0x7f98c007d3f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:58.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.170+0000 7f98d6d20640 1 --2- 172.21.15.88:0/3145154760 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98d0101a60 0x7f98d0196910 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:58.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.170+0000 7f98d6d20640 1 --2- 172.21.15.88:0/3145154760 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98d0100860 0x7f98d01963d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:58.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.170+0000 7f98d6d20640 1 -- 172.21.15.88:0/3145154760 >> 172.21.15.88:0/3145154760 conn(0x7f98d00fc010 msgr2=0x7f98d0104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:58.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.170+0000 7f98d6d20640 1 -- 172.21.15.88:0/3145154760 shutdown_connections 2024-09-17T04:26:58.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.170+0000 7f98d6d20640 1 -- 172.21.15.88:0/3145154760 wait complete. 2024-09-17T04:26:58.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.252+0000 7f04768d3640 1 -- 172.21.15.88:0/2425520516 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0470102470 msgr2=0x7f0470104860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:58.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.252+0000 7f04768d3640 1 --2- 172.21.15.88:0/2425520516 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0470102470 0x7f0470104860 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0460009880 tx=0x7f046002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:26:58.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.252+0000 7f04768d3640 1 -- 172.21.15.88:0/2425520516 shutdown_connections 2024-09-17T04:26:58.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.252+0000 7f04768d3640 1 --2- 172.21.15.88:0/2425520516 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0470104da0 0x7f0470107190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:58.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.252+0000 7f04768d3640 1 --2- 172.21.15.88:0/2425520516 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0470102470 0x7f0470104860 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:58.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.252+0000 7f04768d3640 1 -- 172.21.15.88:0/2425520516 >> 172.21.15.88:0/2425520516 conn(0x7f04700fc010 msgr2=0x7f04700fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:58.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.252+0000 7f04768d3640 1 -- 172.21.15.88:0/2425520516 shutdown_connections 2024-09-17T04:26:58.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.252+0000 7f04768d3640 1 -- 172.21.15.88:0/2425520516 wait complete. 2024-09-17T04:26:58.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.253+0000 7f04768d3640 1 Processor -- start 2024-09-17T04:26:58.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.253+0000 7f04768d3640 1 -- start start 2024-09-17T04:26:58.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.253+0000 7f04768d3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0470102470 0x7f0470197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:58.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.253+0000 7f04768d3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0470104da0 0x7f0470197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:58.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.253+0000 7f04768d3640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f047010a7b0 con 0x7f0470104da0 2024-09-17T04:26:58.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.253+0000 7f04768d3640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f047010a630 con 0x7f0470102470 2024-09-17T04:26:58.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.254+0000 7f046f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0470104da0 0x7f0470197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:58.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.254+0000 7f046f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0470104da0 0x7f0470197a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45922/0 (socket says 172.21.15.88:45922) 2024-09-17T04:26:58.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.254+0000 7f046f7fe640 1 -- 172.21.15.88:0/4008253603 learned_addr learned my addr 172.21.15.88:0/4008253603 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:26:58.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.254+0000 7f046ffff640 1 --2- 172.21.15.88:0/4008253603 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0470102470 0x7f0470197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:58.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.254+0000 7f046f7fe640 1 -- 172.21.15.88:0/4008253603 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0470102470 msgr2=0x7f0470197500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:58.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.254+0000 7f046f7fe640 1 --2- 172.21.15.88:0/4008253603 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0470102470 0x7f0470197500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:58.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.254+0000 7f046f7fe640 1 -- 172.21.15.88:0/4008253603 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0470198030 con 0x7f0470104da0 2024-09-17T04:26:58.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.254+0000 7f046f7fe640 1 --2- 172.21.15.88:0/4008253603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0470104da0 0x7f0470197a40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f046400c8f0 tx=0x7f046400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:58.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.254+0000 7f046d7fa640 1 -- 172.21.15.88:0/4008253603 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0464014070 con 0x7f0470104da0 2024-09-17T04:26:58.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.254+0000 7f046d7fa640 1 -- 172.21.15.88:0/4008253603 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0464007c60 con 0x7f0470104da0 2024-09-17T04:26:58.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.254+0000 7f046d7fa640 1 -- 172.21.15.88:0/4008253603 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0464003c30 con 0x7f0470104da0 2024-09-17T04:26:58.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.254+0000 7f04768d3640 1 -- 172.21.15.88:0/4008253603 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f047019caa0 con 0x7f0470104da0 2024-09-17T04:26:58.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.254+0000 7f04768d3640 1 -- 172.21.15.88:0/4008253603 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f047019d000 con 0x7f0470104da0 2024-09-17T04:26:58.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.255+0000 7f04768d3640 1 -- 172.21.15.88:0/4008253603 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0470102850 con 0x7f0470104da0 2024-09-17T04:26:58.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.256+0000 7f046d7fa640 1 -- 172.21.15.88:0/4008253603 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f0464017070 con 0x7f0470104da0 2024-09-17T04:26:58.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.256+0000 7f046d7fa640 1 --2- 172.21.15.88:0/4008253603 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f045807af30 0x7f045807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:58.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.257+0000 7f046d7fa640 1 -- 172.21.15.88:0/4008253603 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6070+0+0 (secure 0 0 0) 0x7f046409dc90 con 0x7f0470104da0 2024-09-17T04:26:58.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.257+0000 7f046ffff640 1 --2- 172.21.15.88:0/4008253603 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f045807af30 0x7f045807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:58.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.257+0000 7f046ffff640 1 --2- 172.21.15.88:0/4008253603 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f045807af30 0x7f045807d3f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0460000c00 tx=0x7f04600058d0 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:58.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.261+0000 7f046d7fa640 1 -- 172.21.15.88:0/4008253603 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f04640692e0 con 0x7f0470104da0 2024-09-17T04:26:58.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.509+0000 7f04768d3640 1 -- 172.21.15.88:0/4008253603 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f047019da00 con 0x7f0470104da0 2024-09-17T04:26:58.510 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:58 smithi088 ceph-mon[90867]: pgmap v177: 65 pgs: 2 peering, 13 active+undersized, 10 active+undersized+degraded, 40 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 36/276 objects degraded (13.043%) 2024-09-17T04:26:58.510 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:58 smithi088 ceph-mon[90867]: Health check update: Degraded data redundancy: 36/276 objects degraded (13.043%), 10 pgs degraded (PG_DEGRADED) 2024-09-17T04:26:58.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.509+0000 7f046d7fa640 1 -- 172.21.15.88:0/4008253603 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+731 (secure 0 0 0) 0x7f046406e190 con 0x7f0470104da0 2024-09-17T04:26:58.511 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-17T04:26:58.511 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-09-17T04:26:58.511 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T04:26:58.511 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:26:58.511 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-09-17T04:26:58.511 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T04:26:58.511 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:26:58.511 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-09-17T04:26:58.511 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 6 2024-09-17T04:26:58.511 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:26:58.511 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2024-09-17T04:26:58.512 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 3 2024-09-17T04:26:58.512 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:26:58.512 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-09-17T04:26:58.512 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 3, 2024-09-17T04:26:58.512 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 10 2024-09-17T04:26:58.512 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-17T04:26:58.512 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-17T04:26:58.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.511+0000 7f04768d3640 1 -- 172.21.15.88:0/4008253603 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f045807af30 msgr2=0x7f045807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:58.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.511+0000 7f04768d3640 1 --2- 172.21.15.88:0/4008253603 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f045807af30 0x7f045807d3f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0460000c00 tx=0x7f04600058d0 comp rx=0 tx=0).stop 2024-09-17T04:26:58.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.511+0000 7f04768d3640 1 -- 172.21.15.88:0/4008253603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0470104da0 msgr2=0x7f0470197a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:58.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.511+0000 7f04768d3640 1 --2- 172.21.15.88:0/4008253603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0470104da0 0x7f0470197a40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f046400c8f0 tx=0x7f046400cdb0 comp rx=0 tx=0).stop 2024-09-17T04:26:58.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.512+0000 7f04768d3640 1 -- 172.21.15.88:0/4008253603 shutdown_connections 2024-09-17T04:26:58.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.512+0000 7f04768d3640 1 --2- 172.21.15.88:0/4008253603 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f045807af30 0x7f045807d3f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:58.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.512+0000 7f04768d3640 1 --2- 172.21.15.88:0/4008253603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0470104da0 0x7f0470197a40 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:58.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.512+0000 7f04768d3640 1 --2- 172.21.15.88:0/4008253603 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0470102470 0x7f0470197500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:58.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.512+0000 7f04768d3640 1 -- 172.21.15.88:0/4008253603 >> 172.21.15.88:0/4008253603 conn(0x7f04700fc010 msgr2=0x7f04700fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:58.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.512+0000 7f04768d3640 1 -- 172.21.15.88:0/4008253603 shutdown_connections 2024-09-17T04:26:58.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.512+0000 7f04768d3640 1 -- 172.21.15.88:0/4008253603 wait complete. 2024-09-17T04:26:58.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.593+0000 7f21e6103640 1 -- 172.21.15.88:0/3756399755 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21e0102b60 msgr2=0x7f21e0102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:58.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.593+0000 7f21e6103640 1 --2- 172.21.15.88:0/3756399755 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21e0102b60 0x7f21e0102fe0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f21d4009880 tx=0x7f21d402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:26:58.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.593+0000 7f21e6103640 1 -- 172.21.15.88:0/3756399755 shutdown_connections 2024-09-17T04:26:58.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.593+0000 7f21e6103640 1 --2- 172.21.15.88:0/3756399755 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21e0102b60 0x7f21e0102fe0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:58.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.593+0000 7f21e6103640 1 --2- 172.21.15.88:0/3756399755 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21e0101960 0x7f21e0101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:58.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.593+0000 7f21e6103640 1 -- 172.21.15.88:0/3756399755 >> 172.21.15.88:0/3756399755 conn(0x7f21e00fd0f0 msgr2=0x7f21e00ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:58.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.593+0000 7f21e6103640 1 -- 172.21.15.88:0/3756399755 shutdown_connections 2024-09-17T04:26:58.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.593+0000 7f21e6103640 1 -- 172.21.15.88:0/3756399755 wait complete. 2024-09-17T04:26:58.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.594+0000 7f21e6103640 1 Processor -- start 2024-09-17T04:26:58.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.594+0000 7f21e6103640 1 -- start start 2024-09-17T04:26:58.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.594+0000 7f21e6103640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21e0101960 0x7f21e0075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:58.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.594+0000 7f21e6103640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21e0102b60 0x7f21e00745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:58.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.594+0000 7f21e6103640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f21e010a7a0 con 0x7f21e0102b60 2024-09-17T04:26:58.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.594+0000 7f21e6103640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f21e010a620 con 0x7f21e0101960 2024-09-17T04:26:58.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.594+0000 7f21deffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21e0102b60 0x7f21e00745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:58.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.594+0000 7f21deffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21e0102b60 0x7f21e00745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45928/0 (socket says 172.21.15.88:45928) 2024-09-17T04:26:58.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.594+0000 7f21deffd640 1 -- 172.21.15.88:0/1795380185 learned_addr learned my addr 172.21.15.88:0/1795380185 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:26:58.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.594+0000 7f21df7fe640 1 --2- 172.21.15.88:0/1795380185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21e0101960 0x7f21e0075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:58.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.594+0000 7f21deffd640 1 -- 172.21.15.88:0/1795380185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21e0101960 msgr2=0x7f21e0075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:58.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.594+0000 7f21deffd640 1 --2- 172.21.15.88:0/1795380185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21e0101960 0x7f21e0075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:58.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.594+0000 7f21deffd640 1 -- 172.21.15.88:0/1795380185 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21e0074b20 con 0x7f21e0102b60 2024-09-17T04:26:58.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.595+0000 7f21deffd640 1 --2- 172.21.15.88:0/1795380185 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21e0102b60 0x7f21e00745e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f21d4006010 tx=0x7f21d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:58.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.595+0000 7f21dcff9640 1 -- 172.21.15.88:0/1795380185 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f21d403f070 con 0x7f21e0102b60 2024-09-17T04:26:58.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.595+0000 7f21e6103640 1 -- 172.21.15.88:0/1795380185 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21e0074db0 con 0x7f21e0102b60 2024-09-17T04:26:58.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.595+0000 7f21dcff9640 1 -- 172.21.15.88:0/1795380185 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f21d4004ac0 con 0x7f21e0102b60 2024-09-17T04:26:58.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.595+0000 7f21e6103640 1 -- 172.21.15.88:0/1795380185 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21e00752e0 con 0x7f21e0102b60 2024-09-17T04:26:58.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.595+0000 7f21dcff9640 1 -- 172.21.15.88:0/1795380185 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f21d4049060 con 0x7f21e0102b60 2024-09-17T04:26:58.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.596+0000 7f21e6103640 1 -- 172.21.15.88:0/1795380185 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21e0101d60 con 0x7f21e0102b60 2024-09-17T04:26:58.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.597+0000 7f21dcff9640 1 -- 172.21.15.88:0/1795380185 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f21d4042070 con 0x7f21e0102b60 2024-09-17T04:26:58.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.597+0000 7f21dcff9640 1 --2- 172.21.15.88:0/1795380185 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f21c807af30 0x7f21c807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:58.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.597+0000 7f21dcff9640 1 -- 172.21.15.88:0/1795380185 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6070+0+0 (secure 0 0 0) 0x7f21d40bedf0 con 0x7f21e0102b60 2024-09-17T04:26:58.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.597+0000 7f21df7fe640 1 --2- 172.21.15.88:0/1795380185 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f21c807af30 0x7f21c807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:58.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.598+0000 7f21df7fe640 1 --2- 172.21.15.88:0/1795380185 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f21c807af30 0x7f21c807d3f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f21d0005fd0 tx=0x7f21d0005850 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:58.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.602+0000 7f21dcff9640 1 -- 172.21.15.88:0/1795380185 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f21d408a440 con 0x7f21e0102b60 2024-09-17T04:26:58.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:58 smithi134 ceph-mon[76677]: pgmap v177: 65 pgs: 2 peering, 13 active+undersized, 10 active+undersized+degraded, 40 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 36/276 objects degraded (13.043%) 2024-09-17T04:26:58.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:58 smithi134 ceph-mon[76677]: Health check update: Degraded data redundancy: 36/276 objects degraded (13.043%), 10 pgs degraded (PG_DEGRADED) 2024-09-17T04:26:58.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.816+0000 7f21e6103640 1 -- 172.21.15.88:0/1795380185 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f21e0062df0 con 0x7f21e0102b60 2024-09-17T04:26:58.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.816+0000 7f21dcff9640 1 -- 172.21.15.88:0/1795380185 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) ==== 76+0+1838 (secure 0 0 0) 0x7f21d408f2f0 con 0x7f21e0102b60 2024-09-17T04:26:58.817 INFO:teuthology.orchestra.run.smithi088.stdout:e18 2024-09-17T04:26:58.817 INFO:teuthology.orchestra.run.smithi088.stdout:btime 2024-09-17T04:26:58:226312+0000 2024-09-17T04:26:58.818 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T04:26:58.818 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:26:58.818 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2024-09-17T04:26:58.818 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:26:58.818 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2024-09-17T04:26:58.818 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2024-09-17T04:26:58.818 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 16 2024-09-17T04:26:58.818 INFO:teuthology.orchestra.run.smithi088.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-17T04:26:58.818 INFO:teuthology.orchestra.run.smithi088.stdout:created 2024-09-17T04:18:10.480573+0000 2024-09-17T04:26:58.818 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2024-09-17T04:26:53.149451+0000 2024-09-17T04:26:58.818 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2024-09-17T04:26:58.818 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2024-09-17T04:26:58.818 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2024-09-17T04:26:58.819 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2024-09-17T04:26:58.819 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2024-09-17T04:26:58.819 INFO:teuthology.orchestra.run.smithi088.stdout:max_xattr_size 65536 2024-09-17T04:26:58.819 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2024-09-17T04:26:58.819 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2024-09-17T04:26:58.819 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 0 2024-09-17T04:26:58.819 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:26:58.819 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 1 2024-09-17T04:26:58.819 INFO:teuthology.orchestra.run.smithi088.stdout:in 0 2024-09-17T04:26:58.819 INFO:teuthology.orchestra.run.smithi088.stdout:up {0=14590} 2024-09-17T04:26:58.819 INFO:teuthology.orchestra.run.smithi088.stdout:failed 2024-09-17T04:26:58.819 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2024-09-17T04:26:58.819 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2024-09-17T04:26:58.819 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2024-09-17T04:26:58.820 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2024-09-17T04:26:58.820 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data enabled 2024-09-17T04:26:58.820 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2024-09-17T04:26:58.820 INFO:teuthology.orchestra.run.smithi088.stdout:bal_rank_mask -1 2024-09-17T04:26:58.820 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 1 2024-09-17T04:26:58.820 INFO:teuthology.orchestra.run.smithi088.stdout:qdb_cluster leader: 14590 members: 14590 2024-09-17T04:26:58.820 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.giqrgt{0:14590} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.88:6828/1714846518,v1:172.21.15.88:6829/1714846518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:26:58.820 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:26:58.820 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:26:58.820 INFO:teuthology.orchestra.run.smithi088.stdout:Standby daemons: 2024-09-17T04:26:58.820 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:26:58.820 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi134.ktuhce{-1:24325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/967997022,v1:172.21.15.134:6825/967997022] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:26:58.820 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi134.psnynp{-1:34223} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/584624515,v1:172.21.15.134:6827/584624515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:26:58.821 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 18 2024-09-17T04:26:58.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.818+0000 7f21e6103640 1 -- 172.21.15.88:0/1795380185 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f21c807af30 msgr2=0x7f21c807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:58.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.819+0000 7f21e6103640 1 --2- 172.21.15.88:0/1795380185 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f21c807af30 0x7f21c807d3f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f21d0005fd0 tx=0x7f21d0005850 comp rx=0 tx=0).stop 2024-09-17T04:26:58.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.819+0000 7f21e6103640 1 -- 172.21.15.88:0/1795380185 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21e0102b60 msgr2=0x7f21e00745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:58.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.819+0000 7f21e6103640 1 --2- 172.21.15.88:0/1795380185 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21e0102b60 0x7f21e00745e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f21d4006010 tx=0x7f21d40046c0 comp rx=0 tx=0).stop 2024-09-17T04:26:58.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.819+0000 7f21e6103640 1 -- 172.21.15.88:0/1795380185 shutdown_connections 2024-09-17T04:26:58.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.819+0000 7f21e6103640 1 --2- 172.21.15.88:0/1795380185 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f21c807af30 0x7f21c807d3f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:58.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.819+0000 7f21e6103640 1 --2- 172.21.15.88:0/1795380185 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21e0102b60 0x7f21e00745e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:58.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.819+0000 7f21e6103640 1 --2- 172.21.15.88:0/1795380185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21e0101960 0x7f21e0075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:58.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.819+0000 7f21e6103640 1 -- 172.21.15.88:0/1795380185 >> 172.21.15.88:0/1795380185 conn(0x7f21e00fd0f0 msgr2=0x7f21e0106040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:58.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.819+0000 7f21e6103640 1 -- 172.21.15.88:0/1795380185 shutdown_connections 2024-09-17T04:26:58.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.819+0000 7f21e6103640 1 -- 172.21.15.88:0/1795380185 wait complete. 2024-09-17T04:26:58.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.901+0000 7f598c4ec640 1 -- 172.21.15.88:0/1948828007 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5984100860 msgr2=0x7f5984100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:58.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.901+0000 7f598c4ec640 1 --2- 172.21.15.88:0/1948828007 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5984100860 0x7f5984100c60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5980009880 tx=0x7f598002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:26:58.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.901+0000 7f598c4ec640 1 -- 172.21.15.88:0/1948828007 shutdown_connections 2024-09-17T04:26:58.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.901+0000 7f598c4ec640 1 --2- 172.21.15.88:0/1948828007 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5984101a60 0x7f5984101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:58.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.901+0000 7f598c4ec640 1 --2- 172.21.15.88:0/1948828007 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5984100860 0x7f5984100c60 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:58.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.901+0000 7f598c4ec640 1 -- 172.21.15.88:0/1948828007 >> 172.21.15.88:0/1948828007 conn(0x7f59840fc010 msgr2=0x7f59840fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:58.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.901+0000 7f598c4ec640 1 -- 172.21.15.88:0/1948828007 shutdown_connections 2024-09-17T04:26:58.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.901+0000 7f598c4ec640 1 -- 172.21.15.88:0/1948828007 wait complete. 2024-09-17T04:26:58.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.902+0000 7f598c4ec640 1 Processor -- start 2024-09-17T04:26:58.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.902+0000 7f598c4ec640 1 -- start start 2024-09-17T04:26:58.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.902+0000 7f598c4ec640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5984100860 0x7f598406aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:58.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.902+0000 7f598c4ec640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5984101a60 0x7f598419c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:58.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.902+0000 7f598c4ec640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f5984109700 con 0x7f5984101a60 2024-09-17T04:26:58.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.902+0000 7f598c4ec640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5984109580 con 0x7f5984100860 2024-09-17T04:26:58.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.902+0000 7f5989a87640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5984101a60 0x7f598419c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:58.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.902+0000 7f5989a87640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5984101a60 0x7f598419c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45942/0 (socket says 172.21.15.88:45942) 2024-09-17T04:26:58.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.902+0000 7f5989a87640 1 -- 172.21.15.88:0/1809689235 learned_addr learned my addr 172.21.15.88:0/1809689235 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:26:58.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.902+0000 7f598a288640 1 --2- 172.21.15.88:0/1809689235 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5984100860 0x7f598406aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:58.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.902+0000 7f5989a87640 1 -- 172.21.15.88:0/1809689235 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5984100860 msgr2=0x7f598406aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:58.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.902+0000 7f5989a87640 1 --2- 172.21.15.88:0/1809689235 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5984100860 0x7f598406aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:58.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.902+0000 7f5989a87640 1 -- 172.21.15.88:0/1809689235 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f598419c850 con 0x7f5984101a60 2024-09-17T04:26:58.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.902+0000 7f598a288640 1 --2- 172.21.15.88:0/1809689235 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5984100860 0x7f598406aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:26:58.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.902+0000 7f5989a87640 1 --2- 172.21.15.88:0/1809689235 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5984101a60 0x7f598419c290 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f597400b420 tx=0x7f597400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:58.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.903+0000 7f597b7fe640 1 -- 172.21.15.88:0/1809689235 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5974011630 con 0x7f5984101a60 2024-09-17T04:26:58.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.903+0000 7f597b7fe640 1 -- 172.21.15.88:0/1809689235 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5974016070 con 0x7f5984101a60 2024-09-17T04:26:58.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.903+0000 7f598c4ec640 1 -- 172.21.15.88:0/1809689235 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f598419cb40 con 0x7f5984101a60 2024-09-17T04:26:58.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.903+0000 7f597b7fe640 1 -- 172.21.15.88:0/1809689235 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5974010d30 con 0x7f5984101a60 2024-09-17T04:26:58.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.903+0000 7f598c4ec640 1 -- 172.21.15.88:0/1809689235 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f598419d150 con 0x7f5984101a60 2024-09-17T04:26:58.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.904+0000 7f598c4ec640 1 -- 172.21.15.88:0/1809689235 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5984100c60 con 0x7f5984101a60 2024-09-17T04:26:58.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.904+0000 7f597b7fe640 1 -- 172.21.15.88:0/1809689235 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f597401b460 con 0x7f5984101a60 2024-09-17T04:26:58.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.905+0000 7f597b7fe640 1 --2- 172.21.15.88:0/1809689235 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f597007af30 0x7f597007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:58.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.905+0000 7f597b7fe640 1 -- 172.21.15.88:0/1809689235 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6070+0+0 (secure 0 0 0) 0x7f597409d7e0 con 0x7f5984101a60 2024-09-17T04:26:58.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.905+0000 7f598a288640 1 --2- 172.21.15.88:0/1809689235 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f597007af30 0x7f597007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:58.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.905+0000 7f598a288640 1 --2- 172.21.15.88:0/1809689235 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f597007af30 0x7f597007d3f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5980000c00 tx=0x7f5980005a20 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:58.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:58.909+0000 7f597b7fe640 1 -- 172.21.15.88:0/1809689235 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f5974068d00 con 0x7f5984101a60 2024-09-17T04:26:59.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.100+0000 7f598c4ec640 1 -- 172.21.15.88:0/1809689235 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5984062630 con 0x7f597007af30 2024-09-17T04:26:59.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.102+0000 7f597b7fe640 1 -- 172.21.15.88:0/1809689235 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f5984062630 con 0x7f597007af30 2024-09-17T04:26:59.103 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-17T04:26:59.103 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f", 2024-09-17T04:26:59.103 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-09-17T04:26:59.104 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T04:26:59.104 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [ 2024-09-17T04:26:59.104 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr", 2024-09-17T04:26:59.104 INFO:teuthology.orchestra.run.smithi088.stdout: "osd", 2024-09-17T04:26:59.104 INFO:teuthology.orchestra.run.smithi088.stdout: "mon", 2024-09-17T04:26:59.104 INFO:teuthology.orchestra.run.smithi088.stdout: "crash" 2024-09-17T04:26:59.105 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-17T04:26:59.105 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "12/23 daemons upgraded", 2024-09-17T04:26:59.105 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading mds daemons", 2024-09-17T04:26:59.105 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-09-17T04:26:59.105 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-17T04:26:59.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.105+0000 7f598c4ec640 1 -- 172.21.15.88:0/1809689235 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f597007af30 msgr2=0x7f597007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:59.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.105+0000 7f598c4ec640 1 --2- 172.21.15.88:0/1809689235 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f597007af30 0x7f597007d3f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5980000c00 tx=0x7f5980005a20 comp rx=0 tx=0).stop 2024-09-17T04:26:59.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.105+0000 7f598c4ec640 1 -- 172.21.15.88:0/1809689235 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5984101a60 msgr2=0x7f598419c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:59.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.105+0000 7f598c4ec640 1 --2- 172.21.15.88:0/1809689235 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5984101a60 0x7f598419c290 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f597400b420 tx=0x7f597400b8e0 comp rx=0 tx=0).stop 2024-09-17T04:26:59.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.105+0000 7f598c4ec640 1 -- 172.21.15.88:0/1809689235 shutdown_connections 2024-09-17T04:26:59.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.105+0000 7f598c4ec640 1 --2- 172.21.15.88:0/1809689235 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f597007af30 0x7f597007d3f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:59.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.105+0000 7f598c4ec640 1 --2- 172.21.15.88:0/1809689235 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5984101a60 0x7f598419c290 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:59.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.105+0000 7f598c4ec640 1 --2- 172.21.15.88:0/1809689235 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5984100860 0x7f598406aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:59.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.105+0000 7f598c4ec640 1 -- 172.21.15.88:0/1809689235 >> 172.21.15.88:0/1809689235 conn(0x7f59840fc010 msgr2=0x7f5984104f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:59.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.105+0000 7f598c4ec640 1 -- 172.21.15.88:0/1809689235 shutdown_connections 2024-09-17T04:26:59.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.105+0000 7f598c4ec640 1 -- 172.21.15.88:0/1809689235 wait complete. 2024-09-17T04:26:59.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.187+0000 7f6a04260640 1 -- 172.21.15.88:0/2909437862 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69fc101980 msgr2=0x7f69fc101d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:59.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.187+0000 7f6a04260640 1 --2- 172.21.15.88:0/2909437862 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69fc101980 0x7f69fc101d80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f69f8009880 tx=0x7f69f802a4a0 comp rx=0 tx=0).stop 2024-09-17T04:26:59.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.187+0000 7f6a04260640 1 -- 172.21.15.88:0/2909437862 shutdown_connections 2024-09-17T04:26:59.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.187+0000 7f6a04260640 1 --2- 172.21.15.88:0/2909437862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69fc102b80 0x7f69fc103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:59.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.187+0000 7f6a04260640 1 --2- 172.21.15.88:0/2909437862 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69fc101980 0x7f69fc101d80 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:59.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.187+0000 7f6a04260640 1 -- 172.21.15.88:0/2909437862 >> 172.21.15.88:0/2909437862 conn(0x7f69fc0fd110 msgr2=0x7f69fc0ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:59.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.187+0000 7f6a04260640 1 -- 172.21.15.88:0/2909437862 shutdown_connections 2024-09-17T04:26:59.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.187+0000 7f6a04260640 1 -- 172.21.15.88:0/2909437862 wait complete. 2024-09-17T04:26:59.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.188+0000 7f6a04260640 1 Processor -- start 2024-09-17T04:26:59.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.188+0000 7f6a04260640 1 -- start start 2024-09-17T04:26:59.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.188+0000 7f6a04260640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69fc101980 0x7f69fc075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:59.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.188+0000 7f6a04260640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69fc102b80 0x7f69fc0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:59.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.188+0000 7f6a04260640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f69fc10a7c0 con 0x7f69fc102b80 2024-09-17T04:26:59.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.188+0000 7f6a04260640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f69fc10a640 con 0x7f69fc101980 2024-09-17T04:26:59.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.188+0000 7f6a017fb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69fc102b80 0x7f69fc0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:59.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.188+0000 7f6a017fb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69fc102b80 0x7f69fc0745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45964/0 (socket says 172.21.15.88:45964) 2024-09-17T04:26:59.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.188+0000 7f6a017fb640 1 -- 172.21.15.88:0/3985993059 learned_addr learned my addr 172.21.15.88:0/3985993059 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:26:59.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.188+0000 7f6a01ffc640 1 --2- 172.21.15.88:0/3985993059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69fc101980 0x7f69fc075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:59.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.188+0000 7f6a017fb640 1 -- 172.21.15.88:0/3985993059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69fc101980 msgr2=0x7f69fc075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:59.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.189+0000 7f6a017fb640 1 --2- 172.21.15.88:0/3985993059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69fc101980 0x7f69fc075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:59.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.189+0000 7f6a017fb640 1 -- 172.21.15.88:0/3985993059 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69fc074b20 con 0x7f69fc102b80 2024-09-17T04:26:59.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.189+0000 7f6a017fb640 1 --2- 172.21.15.88:0/3985993059 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69fc102b80 0x7f69fc0745e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f69ec00d6f0 tx=0x7f69ec00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:59.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.189+0000 7f69f2ffd640 1 -- 172.21.15.88:0/3985993059 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f69ec017070 con 0x7f69fc102b80 2024-09-17T04:26:59.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.189+0000 7f6a04260640 1 -- 172.21.15.88:0/3985993059 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69fc074e10 con 0x7f69fc102b80 2024-09-17T04:26:59.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.189+0000 7f69f2ffd640 1 -- 172.21.15.88:0/3985993059 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f69ec00de00 con 0x7f69fc102b80 2024-09-17T04:26:59.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.189+0000 7f69f2ffd640 1 -- 172.21.15.88:0/3985993059 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f69ec004bb0 con 0x7f69fc102b80 2024-09-17T04:26:59.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.189+0000 7f6a04260640 1 -- 172.21.15.88:0/3985993059 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69fc0753a0 con 0x7f69fc102b80 2024-09-17T04:26:59.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.190+0000 7f6a04260640 1 -- 172.21.15.88:0/3985993059 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69fc101d80 con 0x7f69fc102b80 2024-09-17T04:26:59.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.190+0000 7f69f2ffd640 1 -- 172.21.15.88:0/3985993059 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f69ec004e60 con 0x7f69fc102b80 2024-09-17T04:26:59.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.191+0000 7f69f2ffd640 1 --2- 172.21.15.88:0/3985993059 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f69e807af30 0x7f69e807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:59.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.191+0000 7f69f2ffd640 1 -- 172.21.15.88:0/3985993059 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6070+0+0 (secure 0 0 0) 0x7f69ec09db50 con 0x7f69fc102b80 2024-09-17T04:26:59.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.191+0000 7f6a01ffc640 1 --2- 172.21.15.88:0/3985993059 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f69e807af30 0x7f69e807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:59.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.192+0000 7f6a01ffc640 1 --2- 172.21.15.88:0/3985993059 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f69e807af30 0x7f69e807d3f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f69f8009230 tx=0x7f69f80058d0 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:59.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.196+0000 7f69f2ffd640 1 -- 172.21.15.88:0/3985993059 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f69ec0691a0 con 0x7f69fc102b80 2024-09-17T04:26:59.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:59 smithi088 ceph-mon[90867]: from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:26:59.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:59 smithi088 ceph-mon[90867]: from='client.34294 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:26:59.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:59 smithi088 ceph-mon[90867]: from='client.34298 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:26:59.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:59 smithi088 ceph-mon[90867]: osdmap e79: 6 total, 6 up, 6 in 2024-09-17T04:26:59.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:59 smithi088 ceph-mon[90867]: fsmap cephfs:1 {0=cephfs.smithi088.giqrgt=up:active} 2 up:standby 2024-09-17T04:26:59.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:59 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/4008253603' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:26:59.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:26:59 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/1795380185' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T04:26:59.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.443+0000 7f6a04260640 1 -- 172.21.15.88:0/3985993059 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f69fc062df0 con 0x7f69fc102b80 2024-09-17T04:26:59.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.444+0000 7f69f2ffd640 1 -- 172.21.15.88:0/3985993059 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+931 (secure 0 0 0) 0x7f69ec06e050 con 0x7f69fc102b80 2024-09-17T04:26:59.445 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Degraded data redundancy: 36/276 objects degraded (13.043%), 10 pgs degraded 2024-09-17T04:26:59.445 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T04:26:59.445 INFO:teuthology.orchestra.run.smithi088.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T04:26:59.445 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 36/276 objects degraded (13.043%), 10 pgs degraded 2024-09-17T04:26:59.445 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.2 is active+undersized+degraded, acting [1,0] 2024-09-17T04:26:59.445 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.3 is active+undersized+degraded, acting [2,1] 2024-09-17T04:26:59.445 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.8 is active+undersized+degraded, acting [3,0] 2024-09-17T04:26:59.445 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.b is active+undersized+degraded, acting [3,4] 2024-09-17T04:26:59.445 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.14 is active+undersized+degraded, acting [3,4] 2024-09-17T04:26:59.445 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.16 is active+undersized+degraded, acting [3,2] 2024-09-17T04:26:59.446 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.18 is active+undersized+degraded, acting [4,3] 2024-09-17T04:26:59.446 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.1a is active+undersized+degraded, acting [3,4] 2024-09-17T04:26:59.446 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.1d is active+undersized+degraded, acting [3,0] 2024-09-17T04:26:59.446 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.1e is active+undersized+degraded, acting [2,0] 2024-09-17T04:26:59.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.446+0000 7f6a04260640 1 -- 172.21.15.88:0/3985993059 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f69e807af30 msgr2=0x7f69e807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:59.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.446+0000 7f6a04260640 1 --2- 172.21.15.88:0/3985993059 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f69e807af30 0x7f69e807d3f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f69f8009230 tx=0x7f69f80058d0 comp rx=0 tx=0).stop 2024-09-17T04:26:59.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.446+0000 7f6a04260640 1 -- 172.21.15.88:0/3985993059 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69fc102b80 msgr2=0x7f69fc0745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:59.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.446+0000 7f6a04260640 1 --2- 172.21.15.88:0/3985993059 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69fc102b80 0x7f69fc0745e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f69ec00d6f0 tx=0x7f69ec00dbb0 comp rx=0 tx=0).stop 2024-09-17T04:26:59.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.446+0000 7f6a04260640 1 -- 172.21.15.88:0/3985993059 shutdown_connections 2024-09-17T04:26:59.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.446+0000 7f6a04260640 1 --2- 172.21.15.88:0/3985993059 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f69e807af30 0x7f69e807d3f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:59.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.446+0000 7f6a04260640 1 --2- 172.21.15.88:0/3985993059 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69fc102b80 0x7f69fc0745e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:59.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.446+0000 7f6a04260640 1 --2- 172.21.15.88:0/3985993059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69fc101980 0x7f69fc075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:59.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.446+0000 7f6a04260640 1 -- 172.21.15.88:0/3985993059 >> 172.21.15.88:0/3985993059 conn(0x7f69fc0fd110 msgr2=0x7f69fc106090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:59.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.446+0000 7f6a04260640 1 -- 172.21.15.88:0/3985993059 shutdown_connections 2024-09-17T04:26:59.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:26:59.446+0000 7f6a04260640 1 -- 172.21.15.88:0/3985993059 wait complete. 2024-09-17T04:26:59.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:59 smithi134 ceph-mon[76677]: from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:26:59.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:59 smithi134 ceph-mon[76677]: from='client.34294 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:26:59.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:59 smithi134 ceph-mon[76677]: from='client.34298 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:26:59.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:59 smithi134 ceph-mon[76677]: osdmap e79: 6 total, 6 up, 6 in 2024-09-17T04:26:59.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:59 smithi134 ceph-mon[76677]: fsmap cephfs:1 {0=cephfs.smithi088.giqrgt=up:active} 2 up:standby 2024-09-17T04:26:59.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:59 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/4008253603' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:26:59.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:26:59 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/1795380185' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T04:27:00.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:00 smithi088 ceph-mon[90867]: pgmap v179: 65 pgs: 2 peering, 12 active+undersized, 10 active+undersized+degraded, 41 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s; 36/276 objects degraded (13.043%) 2024-09-17T04:27:00.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:00 smithi088 ceph-mon[90867]: from='client.34310 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:27:00.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:00 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/3985993059' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T04:27:00.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:00 smithi134 ceph-mon[76677]: pgmap v179: 65 pgs: 2 peering, 12 active+undersized, 10 active+undersized+degraded, 41 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s; 36/276 objects degraded (13.043%) 2024-09-17T04:27:00.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:00 smithi134 ceph-mon[76677]: from='client.34310 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:27:00.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:00 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/3985993059' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T04:27:01.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:01 smithi088 ceph-mon[90867]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 36/276 objects degraded (13.043%), 10 pgs degraded) 2024-09-17T04:27:01.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:01 smithi134 ceph-mon[76677]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 36/276 objects degraded (13.043%), 10 pgs degraded) 2024-09-17T04:27:02.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:02 smithi088 ceph-mon[90867]: pgmap v180: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T04:27:02.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:02 smithi134 ceph-mon[76677]: pgmap v180: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T04:27:03.811 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:03 smithi088 ceph-mon[90867]: pgmap v181: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T04:27:03.812 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:03 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:03.812 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:03 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:03.812 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:03 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:27:03.812 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:03 smithi088 ceph-mon[90867]: mds.? [v2:172.21.15.88:6826/3125957194,v1:172.21.15.88:6827/3125957194] up:boot 2024-09-17T04:27:03.812 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:03 smithi088 ceph-mon[90867]: fsmap cephfs:1 {0=cephfs.smithi088.giqrgt=up:active} 3 up:standby 2024-09-17T04:27:03.812 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:03 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "mds metadata", "who": "cephfs.smithi088.lgavsv"} : dispatch 2024-09-17T04:27:03.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:03 smithi134 ceph-mon[76677]: pgmap v181: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T04:27:03.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:03 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:03.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:03 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:03.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:03 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:27:03.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:03 smithi134 ceph-mon[76677]: mds.? [v2:172.21.15.88:6826/3125957194,v1:172.21.15.88:6827/3125957194] up:boot 2024-09-17T04:27:03.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:03 smithi134 ceph-mon[76677]: fsmap cephfs:1 {0=cephfs.smithi088.giqrgt=up:active} 3 up:standby 2024-09-17T04:27:03.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:03 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "mds metadata", "who": "cephfs.smithi088.lgavsv"} : dispatch 2024-09-17T04:27:05.566 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:05 smithi088 ceph-mon[90867]: pgmap v182: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T04:27:05.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:05 smithi134 ceph-mon[76677]: pgmap v182: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T04:27:07.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:07 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:07.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:07 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:08.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:08 smithi088 ceph-mon[90867]: pgmap v183: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T04:27:08.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:08 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:08.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:08 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:08.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:08 smithi134 ceph-mon[76677]: pgmap v183: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T04:27:08.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:08 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:08.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:08 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:09.605 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:09 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:09.605 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:09 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:09.606 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:09 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:09.606 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:09 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:10.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:10 smithi088 ceph-mon[90867]: pgmap v184: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T04:27:10.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:10 smithi134 ceph-mon[76677]: pgmap v184: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T04:27:12.259 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:12 smithi088 ceph-mon[90867]: pgmap v185: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T04:27:12.259 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:12.259 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:27:12.260 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:12.260 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:12.260 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:27:12.260 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:27:12.260 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:12.260 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:27:12.260 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:27:12.260 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:27:12.260 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:27:12.260 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:27:12.260 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi088.giqrgt"]} : dispatch 2024-09-17T04:27:12.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:12 smithi134 ceph-mon[76677]: pgmap v185: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T04:27:12.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:12.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:27:12.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:12.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:12.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:27:12.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:27:12.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:12.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:27:12.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:27:12.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:27:12.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:27:12.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:27:12.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi088.giqrgt"]} : dispatch 2024-09-17T04:27:13.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:13 smithi088 ceph-mon[90867]: Upgrade: It appears safe to stop mds.cephfs.smithi088.giqrgt 2024-09-17T04:27:13.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:13 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:13.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:13 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi088.giqrgt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-17T04:27:13.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:13 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:27:13.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:13 smithi134 ceph-mon[76677]: Upgrade: It appears safe to stop mds.cephfs.smithi088.giqrgt 2024-09-17T04:27:13.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:13 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:13.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:13 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi088.giqrgt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-17T04:27:13.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:13 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:27:14.269 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:14 smithi088 ceph-mon[90867]: pgmap v186: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T04:27:14.269 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:14 smithi088 ceph-mon[90867]: Upgrade: Updating mds.cephfs.smithi088.giqrgt 2024-09-17T04:27:14.269 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:14 smithi088 ceph-mon[90867]: Deploying daemon mds.cephfs.smithi088.giqrgt on smithi088 2024-09-17T04:27:14.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:14 smithi134 ceph-mon[76677]: pgmap v186: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T04:27:14.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:14 smithi134 ceph-mon[76677]: Upgrade: Updating mds.cephfs.smithi088.giqrgt 2024-09-17T04:27:14.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:14 smithi134 ceph-mon[76677]: Deploying daemon mds.cephfs.smithi088.giqrgt on smithi088 2024-09-17T04:27:15.073 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:14 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-mon-smithi088[90863]: 2024-09-17T04:27:14.741+0000 7fd96683a640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T04:27:15.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:15 smithi088 ceph-mon[90867]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-17T04:27:15.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:15 smithi088 ceph-mon[90867]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T04:27:15.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:15 smithi088 ceph-mon[90867]: osdmap e80: 6 total, 6 up, 6 in 2024-09-17T04:27:15.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:15 smithi088 ceph-mon[90867]: Standby daemon mds.cephfs.smithi134.ktuhce assigned to filesystem cephfs as rank 0 2024-09-17T04:27:15.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:15 smithi088 ceph-mon[90867]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-17T04:27:15.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:15 smithi088 ceph-mon[90867]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-17T04:27:15.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:15 smithi088 ceph-mon[90867]: fsmap cephfs:1/1 {0=cephfs.smithi134.ktuhce=up:replay} 2 up:standby 2024-09-17T04:27:15.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:15 smithi134 ceph-mon[76677]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-17T04:27:15.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:15 smithi134 ceph-mon[76677]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T04:27:15.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:15 smithi134 ceph-mon[76677]: osdmap e80: 6 total, 6 up, 6 in 2024-09-17T04:27:15.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:15 smithi134 ceph-mon[76677]: Standby daemon mds.cephfs.smithi134.ktuhce assigned to filesystem cephfs as rank 0 2024-09-17T04:27:15.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:15 smithi134 ceph-mon[76677]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-17T04:27:15.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:15 smithi134 ceph-mon[76677]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-17T04:27:15.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:15 smithi134 ceph-mon[76677]: fsmap cephfs:1/1 {0=cephfs.smithi134.ktuhce=up:replay} 2 up:standby 2024-09-17T04:27:16.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:16 smithi088 ceph-mon[90867]: pgmap v187: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T04:27:16.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:16 smithi134 ceph-mon[76677]: pgmap v187: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T04:27:17.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:17 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "mds metadata", "who": "cephfs.smithi088.giqrgt"} : dispatch 2024-09-17T04:27:17.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:17 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "mds metadata", "who": "cephfs.smithi088.giqrgt"} : dispatch 2024-09-17T04:27:18.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:18 smithi088 ceph-mon[90867]: pgmap v189: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 0 op/s 2024-09-17T04:27:18.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:18 smithi134 ceph-mon[76677]: pgmap v189: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 0 op/s 2024-09-17T04:27:20.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:20 smithi088 ceph-mon[90867]: pgmap v190: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 3.2 MiB/s rd, 1 op/s 2024-09-17T04:27:20.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:20 smithi134 ceph-mon[76677]: pgmap v190: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 3.2 MiB/s rd, 1 op/s 2024-09-17T04:27:22.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:22 smithi088 ceph-mon[90867]: pgmap v191: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 6 op/s 2024-09-17T04:27:22.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:22 smithi134 ceph-mon[76677]: pgmap v191: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 6 op/s 2024-09-17T04:27:24.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:24 smithi088 ceph-mon[90867]: pgmap v192: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 6 op/s 2024-09-17T04:27:24.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:24 smithi088 ceph-mon[90867]: reconnect by client.24347 192.168.0.1:0/981223485 after 0.000999976 2024-09-17T04:27:24.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:24 smithi088 ceph-mon[90867]: reconnect by client.14626 192.168.0.1:0/3146504306 after 0.000999976 2024-09-17T04:27:24.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:24 smithi088 ceph-mon[90867]: mds.? [v2:172.21.15.134:6824/967997022,v1:172.21.15.134:6825/967997022] up:reconnect 2024-09-17T04:27:24.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:24 smithi088 ceph-mon[90867]: fsmap cephfs:1/1 {0=cephfs.smithi134.ktuhce=up:reconnect} 2 up:standby 2024-09-17T04:27:24.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:24 smithi134 ceph-mon[76677]: pgmap v192: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 6 op/s 2024-09-17T04:27:24.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:24 smithi134 ceph-mon[76677]: reconnect by client.24347 192.168.0.1:0/981223485 after 0.000999976 2024-09-17T04:27:24.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:24 smithi134 ceph-mon[76677]: reconnect by client.14626 192.168.0.1:0/3146504306 after 0.000999976 2024-09-17T04:27:24.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:24 smithi134 ceph-mon[76677]: mds.? [v2:172.21.15.134:6824/967997022,v1:172.21.15.134:6825/967997022] up:reconnect 2024-09-17T04:27:24.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:24 smithi134 ceph-mon[76677]: fsmap cephfs:1/1 {0=cephfs.smithi134.ktuhce=up:reconnect} 2 up:standby 2024-09-17T04:27:25.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:25 smithi088 ceph-mon[90867]: mds.? [v2:172.21.15.134:6824/967997022,v1:172.21.15.134:6825/967997022] up:rejoin 2024-09-17T04:27:25.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:25 smithi088 ceph-mon[90867]: fsmap cephfs:1/1 {0=cephfs.smithi134.ktuhce=up:rejoin} 2 up:standby 2024-09-17T04:27:25.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:25 smithi088 ceph-mon[90867]: daemon mds.cephfs.smithi134.ktuhce is now active in filesystem cephfs as rank 0 2024-09-17T04:27:25.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:25 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:25.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:25 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:25.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:25 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:27:25.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:25 smithi134 ceph-mon[76677]: mds.? [v2:172.21.15.134:6824/967997022,v1:172.21.15.134:6825/967997022] up:rejoin 2024-09-17T04:27:25.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:25 smithi134 ceph-mon[76677]: fsmap cephfs:1/1 {0=cephfs.smithi134.ktuhce=up:rejoin} 2 up:standby 2024-09-17T04:27:25.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:25 smithi134 ceph-mon[76677]: daemon mds.cephfs.smithi134.ktuhce is now active in filesystem cephfs as rank 0 2024-09-17T04:27:25.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:25 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:25.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:25 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:25.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:25 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:27:26.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:26 smithi088 ceph-mon[90867]: pgmap v193: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 26 MiB/s rd, 102 B/s wr, 7 op/s 2024-09-17T04:27:26.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:26 smithi088 ceph-mon[90867]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-17T04:27:26.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:26 smithi088 ceph-mon[90867]: mds.? [v2:172.21.15.134:6824/967997022,v1:172.21.15.134:6825/967997022] up:active 2024-09-17T04:27:26.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:26 smithi088 ceph-mon[90867]: mds.? [v2:172.21.15.88:6828/2683662376,v1:172.21.15.88:6829/2683662376] up:boot 2024-09-17T04:27:26.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:26 smithi088 ceph-mon[90867]: fsmap cephfs:1 {0=cephfs.smithi134.ktuhce=up:active} 3 up:standby 2024-09-17T04:27:26.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:26 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "mds metadata", "who": "cephfs.smithi088.giqrgt"} : dispatch 2024-09-17T04:27:26.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:26 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:27:26.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:26 smithi134 ceph-mon[76677]: pgmap v193: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 26 MiB/s rd, 102 B/s wr, 7 op/s 2024-09-17T04:27:26.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:26 smithi134 ceph-mon[76677]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-17T04:27:26.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:26 smithi134 ceph-mon[76677]: mds.? [v2:172.21.15.134:6824/967997022,v1:172.21.15.134:6825/967997022] up:active 2024-09-17T04:27:26.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:26 smithi134 ceph-mon[76677]: mds.? [v2:172.21.15.88:6828/2683662376,v1:172.21.15.88:6829/2683662376] up:boot 2024-09-17T04:27:26.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:26 smithi134 ceph-mon[76677]: fsmap cephfs:1 {0=cephfs.smithi134.ktuhce=up:active} 3 up:standby 2024-09-17T04:27:26.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:26 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "mds metadata", "who": "cephfs.smithi088.giqrgt"} : dispatch 2024-09-17T04:27:26.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:26 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:27:28.336 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:28 smithi088 ceph-mon[90867]: pgmap v194: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 261 B/s wr, 7 op/s 2024-09-17T04:27:28.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:28 smithi134 ceph-mon[76677]: pgmap v194: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 261 B/s wr, 7 op/s 2024-09-17T04:27:29.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.532+0000 7fe0f764e640 1 -- 172.21.15.88:0/2880546179 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0f0100860 msgr2=0x7fe0f0100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:27:29.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.532+0000 7fe0f764e640 1 --2- 172.21.15.88:0/2880546179 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0f0100860 0x7fe0f0100c60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec009880 tx=0x7fe0ec02a4a0 comp rx=0 tx=0).stop 2024-09-17T04:27:29.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.532+0000 7fe0f764e640 1 -- 172.21.15.88:0/2880546179 shutdown_connections 2024-09-17T04:27:29.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.532+0000 7fe0f764e640 1 --2- 172.21.15.88:0/2880546179 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0f0101a60 0x7fe0f0101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:27:29.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.532+0000 7fe0f764e640 1 --2- 172.21.15.88:0/2880546179 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0f0100860 0x7fe0f0100c60 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:27:29.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.532+0000 7fe0f764e640 1 -- 172.21.15.88:0/2880546179 >> 172.21.15.88:0/2880546179 conn(0x7fe0f00fc010 msgr2=0x7fe0f00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:27:29.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.532+0000 7fe0f764e640 1 -- 172.21.15.88:0/2880546179 shutdown_connections 2024-09-17T04:27:29.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.532+0000 7fe0f764e640 1 -- 172.21.15.88:0/2880546179 wait complete. 2024-09-17T04:27:29.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.532+0000 7fe0f764e640 1 Processor -- start 2024-09-17T04:27:29.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.533+0000 7fe0f764e640 1 -- start start 2024-09-17T04:27:29.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.533+0000 7fe0f764e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0f0100860 0x7fe0f0104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:27:29.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.533+0000 7fe0f764e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0f0101a60 0x7fe0f0102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:27:29.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.533+0000 7fe0f764e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f01096a0 con 0x7fe0f0101a60 2024-09-17T04:27:29.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.533+0000 7fe0f764e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f0109520 con 0x7fe0f0100860 2024-09-17T04:27:29.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.533+0000 7fe0f4be9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0f0101a60 0x7fe0f0102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:27:29.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.533+0000 7fe0f4be9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0f0101a60 0x7fe0f0102e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47680/0 (socket says 172.21.15.88:47680) 2024-09-17T04:27:29.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.533+0000 7fe0f4be9640 1 -- 172.21.15.88:0/841232919 learned_addr learned my addr 172.21.15.88:0/841232919 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:27:29.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.533+0000 7fe0f53ea640 1 --2- 172.21.15.88:0/841232919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0f0100860 0x7fe0f0104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:27:29.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.533+0000 7fe0f4be9640 1 -- 172.21.15.88:0/841232919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0f0100860 msgr2=0x7fe0f0104780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:27:29.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.533+0000 7fe0f4be9640 1 --2- 172.21.15.88:0/841232919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0f0100860 0x7fe0f0104780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:27:29.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.533+0000 7fe0f4be9640 1 -- 172.21.15.88:0/841232919 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0f0103380 con 0x7fe0f0101a60 2024-09-17T04:27:29.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.533+0000 7fe0f4be9640 1 --2- 172.21.15.88:0/841232919 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0f0101a60 0x7fe0f0102e40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe0e000c8f0 tx=0x7fe0e000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:27:29.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.534+0000 7fe0e67fc640 1 -- 172.21.15.88:0/841232919 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe0e00079b0 con 0x7fe0f0101a60 2024-09-17T04:27:29.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.534+0000 7fe0f764e640 1 -- 172.21.15.88:0/841232919 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0f0103670 con 0x7fe0f0101a60 2024-09-17T04:27:29.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.534+0000 7fe0e67fc640 1 -- 172.21.15.88:0/841232919 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe0e00054e0 con 0x7fe0f0101a60 2024-09-17T04:27:29.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.534+0000 7fe0e67fc640 1 -- 172.21.15.88:0/841232919 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe0e0004dd0 con 0x7fe0f0101a60 2024-09-17T04:27:29.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.534+0000 7fe0f764e640 1 -- 172.21.15.88:0/841232919 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0f0103c00 con 0x7fe0f0101a60 2024-09-17T04:27:29.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.535+0000 7fe0f764e640 1 -- 172.21.15.88:0/841232919 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0f0100c60 con 0x7fe0f0101a60 2024-09-17T04:27:29.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.535+0000 7fe0e67fc640 1 -- 172.21.15.88:0/841232919 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fe0e0005020 con 0x7fe0f0101a60 2024-09-17T04:27:29.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.536+0000 7fe0e67fc640 1 --2- 172.21.15.88:0/841232919 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe0dc07aed0 0x7fe0dc07d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:27:29.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.536+0000 7fe0e67fc640 1 -- 172.21.15.88:0/841232919 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fe0e009df20 con 0x7fe0f0101a60 2024-09-17T04:27:29.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.536+0000 7fe0f53ea640 1 --2- 172.21.15.88:0/841232919 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe0dc07aed0 0x7fe0dc07d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:27:29.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.536+0000 7fe0f53ea640 1 --2- 172.21.15.88:0/841232919 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe0dc07aed0 0x7fe0dc07d390 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec009230 tx=0x7fe0ec0058d0 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:27:29.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.541+0000 7fe0e67fc640 1 -- 172.21.15.88:0/841232919 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fe0e0014030 con 0x7fe0f0101a60 2024-09-17T04:27:29.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.754+0000 7fe0f764e640 1 -- 172.21.15.88:0/841232919 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe0f006a420 con 0x7fe0dc07aed0 2024-09-17T04:27:29.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.756+0000 7fe0e67fc640 1 -- 172.21.15.88:0/841232919 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fe0f006a420 con 0x7fe0dc07aed0 2024-09-17T04:27:29.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.758+0000 7fe0f764e640 1 -- 172.21.15.88:0/841232919 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe0dc07aed0 msgr2=0x7fe0dc07d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:27:29.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.758+0000 7fe0f764e640 1 --2- 172.21.15.88:0/841232919 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe0dc07aed0 0x7fe0dc07d390 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec009230 tx=0x7fe0ec0058d0 comp rx=0 tx=0).stop 2024-09-17T04:27:29.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.758+0000 7fe0f764e640 1 -- 172.21.15.88:0/841232919 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0f0101a60 msgr2=0x7fe0f0102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:27:29.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.758+0000 7fe0f764e640 1 --2- 172.21.15.88:0/841232919 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0f0101a60 0x7fe0f0102e40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe0e000c8f0 tx=0x7fe0e000cdb0 comp rx=0 tx=0).stop 2024-09-17T04:27:29.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.758+0000 7fe0f764e640 1 -- 172.21.15.88:0/841232919 shutdown_connections 2024-09-17T04:27:29.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.758+0000 7fe0f764e640 1 --2- 172.21.15.88:0/841232919 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe0dc07aed0 0x7fe0dc07d390 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:27:29.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.758+0000 7fe0f764e640 1 --2- 172.21.15.88:0/841232919 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0f0101a60 0x7fe0f0102e40 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:27:29.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.758+0000 7fe0f764e640 1 --2- 172.21.15.88:0/841232919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0f0100860 0x7fe0f0104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:27:29.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.758+0000 7fe0f764e640 1 -- 172.21.15.88:0/841232919 >> 172.21.15.88:0/841232919 conn(0x7fe0f00fc010 msgr2=0x7fe0f0069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:27:29.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.758+0000 7fe0f764e640 1 -- 172.21.15.88:0/841232919 shutdown_connections 2024-09-17T04:27:29.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.758+0000 7fe0f764e640 1 -- 172.21.15.88:0/841232919 wait complete. 2024-09-17T04:27:29.769 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-09-17T04:27:29.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.858+0000 7f66cb549640 1 -- 172.21.15.88:0/3156696860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66c4104d20 msgr2=0x7f66c4107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:27:29.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.858+0000 7f66cb549640 1 --2- 172.21.15.88:0/3156696860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66c4104d20 0x7f66c4107110 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f66b40098b0 tx=0x7f66b402a4d0 comp rx=0 tx=0).stop 2024-09-17T04:27:29.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.858+0000 7f66cb549640 1 -- 172.21.15.88:0/3156696860 shutdown_connections 2024-09-17T04:27:29.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.858+0000 7f66cb549640 1 --2- 172.21.15.88:0/3156696860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66c4104d20 0x7f66c4107110 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:27:29.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.858+0000 7f66cb549640 1 --2- 172.21.15.88:0/3156696860 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66c41023f0 0x7f66c41047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:27:29.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.858+0000 7f66cb549640 1 -- 172.21.15.88:0/3156696860 >> 172.21.15.88:0/3156696860 conn(0x7f66c40fc010 msgr2=0x7f66c40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:27:29.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.858+0000 7f66cb549640 1 -- 172.21.15.88:0/3156696860 shutdown_connections 2024-09-17T04:27:29.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.858+0000 7f66cb549640 1 -- 172.21.15.88:0/3156696860 wait complete. 2024-09-17T04:27:29.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.859+0000 7f66cb549640 1 Processor -- start 2024-09-17T04:27:29.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.859+0000 7f66cb549640 1 -- start start 2024-09-17T04:27:29.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.859+0000 7f66cb549640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66c41023f0 0x7f66c4197570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:27:29.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.859+0000 7f66cb549640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66c4104d20 0x7f66c4197ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:27:29.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.859+0000 7f66cb549640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f66c410a7b0 con 0x7f66c4104d20 2024-09-17T04:27:29.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.859+0000 7f66cb549640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f66c410a630 con 0x7f66c41023f0 2024-09-17T04:27:29.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.859+0000 7f66c8ae4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66c4104d20 0x7f66c4197ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:27:29.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.859+0000 7f66c8ae4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66c4104d20 0x7f66c4197ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47698/0 (socket says 172.21.15.88:47698) 2024-09-17T04:27:29.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.859+0000 7f66c8ae4640 1 -- 172.21.15.88:0/2269164916 learned_addr learned my addr 172.21.15.88:0/2269164916 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:27:29.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.859+0000 7f66c92e5640 1 --2- 172.21.15.88:0/2269164916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66c41023f0 0x7f66c4197570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:27:29.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.859+0000 7f66c8ae4640 1 -- 172.21.15.88:0/2269164916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66c41023f0 msgr2=0x7f66c4197570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:27:29.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.859+0000 7f66c8ae4640 1 --2- 172.21.15.88:0/2269164916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66c41023f0 0x7f66c4197570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:27:29.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.859+0000 7f66c8ae4640 1 -- 172.21.15.88:0/2269164916 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66c4198130 con 0x7f66c4104d20 2024-09-17T04:27:29.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.860+0000 7f66c8ae4640 1 --2- 172.21.15.88:0/2269164916 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66c4104d20 0x7f66c4197ab0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f66b4009230 tx=0x7f66b40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:27:29.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.861+0000 7f66ba7fc640 1 -- 172.21.15.88:0/2269164916 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f66b403f070 con 0x7f66c4104d20 2024-09-17T04:27:29.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.861+0000 7f66cb549640 1 -- 172.21.15.88:0/2269164916 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66c419cb10 con 0x7f66c4104d20 2024-09-17T04:27:29.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.861+0000 7f66ba7fc640 1 -- 172.21.15.88:0/2269164916 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f66b4004a50 con 0x7f66c4104d20 2024-09-17T04:27:29.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.861+0000 7f66ba7fc640 1 -- 172.21.15.88:0/2269164916 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f66b4035030 con 0x7f66c4104d20 2024-09-17T04:27:29.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.861+0000 7f66cb549640 1 -- 172.21.15.88:0/2269164916 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66c419d0a0 con 0x7f66c4104d20 2024-09-17T04:27:29.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.862+0000 7f66cb549640 1 -- 172.21.15.88:0/2269164916 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66c41027d0 con 0x7f66c4104d20 2024-09-17T04:27:29.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.863+0000 7f66ba7fc640 1 -- 172.21.15.88:0/2269164916 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f66b4042070 con 0x7f66c4104d20 2024-09-17T04:27:29.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.863+0000 7f66ba7fc640 1 --2- 172.21.15.88:0/2269164916 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f66b007af30 0x7f66b007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:27:29.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.863+0000 7f66ba7fc640 1 -- 172.21.15.88:0/2269164916 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f66b40beb20 con 0x7f66c4104d20 2024-09-17T04:27:29.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.863+0000 7f66c92e5640 1 --2- 172.21.15.88:0/2269164916 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f66b007af30 0x7f66b007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:27:29.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.864+0000 7f66c92e5640 1 --2- 172.21.15.88:0/2269164916 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f66b007af30 0x7f66b007d3f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f66c0005fd0 tx=0x7f66c000b390 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:27:29.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:29.870+0000 7f66ba7fc640 1 -- 172.21.15.88:0/2269164916 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f66b408a120 con 0x7f66c4104d20 2024-09-17T04:27:30.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.069+0000 7f66cb549640 1 -- 172.21.15.88:0/2269164916 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f66c4105760 con 0x7f66b007af30 2024-09-17T04:27:30.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.070+0000 7f66ba7fc640 1 -- 172.21.15.88:0/2269164916 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f66c4105760 con 0x7f66b007af30 2024-09-17T04:27:30.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.072+0000 7f66cb549640 1 -- 172.21.15.88:0/2269164916 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f66b007af30 msgr2=0x7f66b007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:27:30.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.072+0000 7f66cb549640 1 --2- 172.21.15.88:0/2269164916 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f66b007af30 0x7f66b007d3f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f66c0005fd0 tx=0x7f66c000b390 comp rx=0 tx=0).stop 2024-09-17T04:27:30.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.072+0000 7f66cb549640 1 -- 172.21.15.88:0/2269164916 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66c4104d20 msgr2=0x7f66c4197ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:27:30.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.072+0000 7f66cb549640 1 --2- 172.21.15.88:0/2269164916 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66c4104d20 0x7f66c4197ab0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f66b4009230 tx=0x7f66b40045e0 comp rx=0 tx=0).stop 2024-09-17T04:27:30.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.073+0000 7f66cb549640 1 -- 172.21.15.88:0/2269164916 shutdown_connections 2024-09-17T04:27:30.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.073+0000 7f66cb549640 1 --2- 172.21.15.88:0/2269164916 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f66b007af30 0x7f66b007d3f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:27:30.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.073+0000 7f66cb549640 1 --2- 172.21.15.88:0/2269164916 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66c4104d20 0x7f66c4197ab0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:27:30.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.073+0000 7f66cb549640 1 --2- 172.21.15.88:0/2269164916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66c41023f0 0x7f66c4197570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:27:30.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.073+0000 7f66cb549640 1 -- 172.21.15.88:0/2269164916 >> 172.21.15.88:0/2269164916 conn(0x7f66c40fc010 msgr2=0x7f66c40fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:27:30.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.073+0000 7f66cb549640 1 -- 172.21.15.88:0/2269164916 shutdown_connections 2024-09-17T04:27:30.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.073+0000 7f66cb549640 1 -- 172.21.15.88:0/2269164916 wait complete. 2024-09-17T04:27:30.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.159+0000 7f4e814c9640 1 -- 172.21.15.88:0/2940572402 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e7c102b70 msgr2=0x7f4e7c102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:27:30.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.159+0000 7f4e814c9640 1 --2- 172.21.15.88:0/2940572402 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e7c102b70 0x7f4e7c102ff0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4e70009880 tx=0x7f4e7002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:27:30.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.159+0000 7f4e814c9640 1 -- 172.21.15.88:0/2940572402 shutdown_connections 2024-09-17T04:27:30.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.159+0000 7f4e814c9640 1 --2- 172.21.15.88:0/2940572402 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e7c102b70 0x7f4e7c102ff0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:27:30.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.159+0000 7f4e814c9640 1 --2- 172.21.15.88:0/2940572402 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e7c101970 0x7f4e7c101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:27:30.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.159+0000 7f4e814c9640 1 -- 172.21.15.88:0/2940572402 >> 172.21.15.88:0/2940572402 conn(0x7f4e7c0fd140 msgr2=0x7f4e7c0ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:27:30.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.159+0000 7f4e814c9640 1 -- 172.21.15.88:0/2940572402 shutdown_connections 2024-09-17T04:27:30.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.159+0000 7f4e814c9640 1 -- 172.21.15.88:0/2940572402 wait complete. 2024-09-17T04:27:30.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.159+0000 7f4e814c9640 1 Processor -- start 2024-09-17T04:27:30.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.160+0000 7f4e814c9640 1 -- start start 2024-09-17T04:27:30.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.160+0000 7f4e814c9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e7c101970 0x7f4e7c1974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:27:30.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.160+0000 7f4e814c9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e7c102b70 0x7f4e7c1979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:27:30.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.160+0000 7f4e814c9640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f4e7c10a790 con 0x7f4e7c101970 2024-09-17T04:27:30.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.160+0000 7f4e814c9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4e7c10a610 con 0x7f4e7c102b70 2024-09-17T04:27:30.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.160+0000 7f4e7affd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e7c101970 0x7f4e7c1974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:27:30.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.160+0000 7f4e7affd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e7c101970 0x7f4e7c1974a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47712/0 (socket says 172.21.15.88:47712) 2024-09-17T04:27:30.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.160+0000 7f4e7affd640 1 -- 172.21.15.88:0/2113589504 learned_addr learned my addr 172.21.15.88:0/2113589504 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:27:30.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.160+0000 7f4e7a7fc640 1 --2- 172.21.15.88:0/2113589504 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e7c102b70 0x7f4e7c1979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:27:30.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.160+0000 7f4e7affd640 1 -- 172.21.15.88:0/2113589504 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e7c102b70 msgr2=0x7f4e7c1979e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:27:30.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.160+0000 7f4e7affd640 1 --2- 172.21.15.88:0/2113589504 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e7c102b70 0x7f4e7c1979e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:27:30.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.160+0000 7f4e7affd640 1 -- 172.21.15.88:0/2113589504 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e7c198060 con 0x7f4e7c101970 2024-09-17T04:27:30.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.160+0000 7f4e7affd640 1 --2- 172.21.15.88:0/2113589504 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e7c101970 0x7f4e7c1974a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c00d6f0 tx=0x7f4e6c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:27:30.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.161+0000 7f4e63fff640 1 -- 172.21.15.88:0/2113589504 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4e6c017070 con 0x7f4e7c101970 2024-09-17T04:27:30.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.161+0000 7f4e814c9640 1 -- 172.21.15.88:0/2113589504 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e7c19caa0 con 0x7f4e7c101970 2024-09-17T04:27:30.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.161+0000 7f4e814c9640 1 -- 172.21.15.88:0/2113589504 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e7c19d000 con 0x7f4e7c101970 2024-09-17T04:27:30.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.161+0000 7f4e63fff640 1 -- 172.21.15.88:0/2113589504 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4e6c00de00 con 0x7f4e7c101970 2024-09-17T04:27:30.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.161+0000 7f4e63fff640 1 -- 172.21.15.88:0/2113589504 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4e6c003bc0 con 0x7f4e7c101970 2024-09-17T04:27:30.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.162+0000 7f4e814c9640 1 -- 172.21.15.88:0/2113589504 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e680052c0 con 0x7f4e7c101970 2024-09-17T04:27:30.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.163+0000 7f4e63fff640 1 -- 172.21.15.88:0/2113589504 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f4e6c009a30 con 0x7f4e7c101970 2024-09-17T04:27:30.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.163+0000 7f4e63fff640 1 --2- 172.21.15.88:0/2113589504 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f4e6407af80 0x7f4e6407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:27:30.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.163+0000 7f4e63fff640 1 -- 172.21.15.88:0/2113589504 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f4e6c09da00 con 0x7f4e7c101970 2024-09-17T04:27:30.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.163+0000 7f4e7a7fc640 1 --2- 172.21.15.88:0/2113589504 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f4e6407af80 0x7f4e6407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:27:30.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.164+0000 7f4e7a7fc640 1 --2- 172.21.15.88:0/2113589504 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f4e6407af80 0x7f4e6407d440 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4e70000c00 tx=0x7f4e700058d0 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:27:30.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.168+0000 7f4e63fff640 1 -- 172.21.15.88:0/2113589504 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f4e6c069080 con 0x7f4e7c101970 2024-09-17T04:27:30.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.360+0000 7f4e814c9640 1 -- 172.21.15.88:0/2113589504 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f4e68000bf0 con 0x7f4e6407af80 2024-09-17T04:27:30.370 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.370+0000 7f4e63fff640 1 -- 172.21.15.88:0/2113589504 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f4e68000bf0 con 0x7f4e6407af80 2024-09-17T04:27:30.370 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T04:27:30.370 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (13m) 0s ago 14m 25.5M - 0.25.0 c8568f914cd2 f2dbac7e939f 2024-09-17T04:27:30.370 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi088 smithi088 running (6m) 0s ago 14m 8870k - 19.1.1-330-gc2ddf972 ebb0615149de 683e1826a1a5 2024-09-17T04:27:30.370 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi134 smithi134 running (5m) 41s ago 13m 8711k - 19.1.1-330-gc2ddf972 ebb0615149de 83afa4200c0e 2024-09-17T04:27:30.370 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (4m) 0s ago 14m 6891k - 19.3.0-4989-gce1b342b 8e039cb7fe1e 10355648c406 2024-09-17T04:27:30.371 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi134 smithi134 running (3m) 41s ago 13m 6899k - 19.3.0-4989-gce1b342b 8e039cb7fe1e d709085ffe5d 2024-09-17T04:27:30.371 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (12m) 0s ago 14m 77.6M - 9.4.12 2bacad6d85d8 a6cff57a23f9 2024-09-17T04:27:30.371 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.giqrgt smithi088 running (6s) 0s ago 9m 81.6M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 3bb1d05b4476 2024-09-17T04:27:30.371 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.lgavsv smithi088 running (28s) 0s ago 9m 83.5M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 6fb9ba0a8ec3 2024-09-17T04:27:30.371 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi134.ktuhce smithi134 running (9m) 41s ago 9m 16.3M - 19.1.1-330-gc2ddf972 ebb0615149de 7ff5b70ca9cb 2024-09-17T04:27:30.371 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi134.psnynp smithi134 running (9m) 41s ago 9m 90.4M - 19.1.1-330-gc2ddf972 ebb0615149de 5326974fa3dd 2024-09-17T04:27:30.371 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.wmndiv smithi088 *:8443,9283,8765 running (5m) 0s ago 15m 588M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 49eb47f7f14f 2024-09-17T04:27:30.371 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi134.vwdxcb smithi134 *:8443,9283,8765 running (4m) 41s ago 13m 522M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 8a6d45eb0595 2024-09-17T04:27:30.371 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (4m) 0s ago 16m 117M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e ac6332015243 2024-09-17T04:27:30.371 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi134 smithi134 running (4m) 41s ago 13m 105M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e ea49f690e26b 2024-09-17T04:27:30.371 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (14m) 0s ago 14m 16.1M - 1.5.0 0da6a335fe13 9ba03800993b 2024-09-17T04:27:30.371 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi134 smithi134 *:9100 running (13m) 41s ago 13m 17.2M - 1.5.0 0da6a335fe13 6deac483827f 2024-09-17T04:27:30.371 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (3m) 0s ago 12m 163M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 4ef267302248 2024-09-17T04:27:30.371 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (2m) 0s ago 12m 165M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 17b67c13c7aa 2024-09-17T04:27:30.372 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (2m) 0s ago 11m 153M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 83d38ad792c9 2024-09-17T04:27:30.372 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi134 running (110s) 41s ago 11m 157M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e 336a363ac39f 2024-09-17T04:27:30.372 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi134 running (77s) 41s ago 10m 155M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e 6df8a692310a 2024-09-17T04:27:30.372 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi134 running (44s) 41s ago 10m 81.6M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e 5066799816d3 2024-09-17T04:27:30.372 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (4m) 0s ago 14m 71.3M - 2.43.0 a07b618ecd1d b51d7899d341 2024-09-17T04:27:30.372 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:30 smithi088 ceph-mon[90867]: pgmap v195: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 255 B/s wr, 7 op/s 2024-09-17T04:27:30.372 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:30 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:30.372 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:30 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:30.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.372+0000 7f4e814c9640 1 -- 172.21.15.88:0/2113589504 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f4e6407af80 msgr2=0x7f4e6407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:27:30.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.372+0000 7f4e814c9640 1 --2- 172.21.15.88:0/2113589504 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f4e6407af80 0x7f4e6407d440 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4e70000c00 tx=0x7f4e700058d0 comp rx=0 tx=0).stop 2024-09-17T04:27:30.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.372+0000 7f4e814c9640 1 -- 172.21.15.88:0/2113589504 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e7c101970 msgr2=0x7f4e7c1974a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:27:30.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.372+0000 7f4e814c9640 1 --2- 172.21.15.88:0/2113589504 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e7c101970 0x7f4e7c1974a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c00d6f0 tx=0x7f4e6c00dbb0 comp rx=0 tx=0).stop 2024-09-17T04:27:30.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.372+0000 7f4e814c9640 1 -- 172.21.15.88:0/2113589504 shutdown_connections 2024-09-17T04:27:30.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.372+0000 7f4e814c9640 1 --2- 172.21.15.88:0/2113589504 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f4e6407af80 0x7f4e6407d440 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:27:30.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.372+0000 7f4e814c9640 1 --2- 172.21.15.88:0/2113589504 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e7c102b70 0x7f4e7c1979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:27:30.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.372+0000 7f4e814c9640 1 --2- 172.21.15.88:0/2113589504 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e7c101970 0x7f4e7c1974a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:27:30.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.372+0000 7f4e814c9640 1 -- 172.21.15.88:0/2113589504 >> 172.21.15.88:0/2113589504 conn(0x7f4e7c0fd140 msgr2=0x7f4e7c105fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:27:30.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.372+0000 7f4e814c9640 1 -- 172.21.15.88:0/2113589504 shutdown_connections 2024-09-17T04:27:30.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.372+0000 7f4e814c9640 1 -- 172.21.15.88:0/2113589504 wait complete. 2024-09-17T04:27:30.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:30 smithi134 ceph-mon[76677]: pgmap v195: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 255 B/s wr, 7 op/s 2024-09-17T04:27:30.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:30 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:30.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:30 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:30.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.459+0000 7f4941b44640 1 -- 172.21.15.88:0/3632129334 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f493c101960 msgr2=0x7f493c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:27:30.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.459+0000 7f4941b44640 1 --2- 172.21.15.88:0/3632129334 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f493c101960 0x7f493c101d60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f492c009880 tx=0x7f492c02a4a0 comp rx=0 tx=0).stop 2024-09-17T04:27:30.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.459+0000 7f4941b44640 1 -- 172.21.15.88:0/3632129334 shutdown_connections 2024-09-17T04:27:30.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.459+0000 7f4941b44640 1 --2- 172.21.15.88:0/3632129334 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f493c102b60 0x7f493c102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:27:30.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.459+0000 7f4941b44640 1 --2- 172.21.15.88:0/3632129334 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f493c101960 0x7f493c101d60 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:27:30.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.459+0000 7f4941b44640 1 -- 172.21.15.88:0/3632129334 >> 172.21.15.88:0/3632129334 conn(0x7f493c0fd110 msgr2=0x7f493c0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:27:30.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.459+0000 7f4941b44640 1 -- 172.21.15.88:0/3632129334 shutdown_connections 2024-09-17T04:27:30.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.459+0000 7f4941b44640 1 -- 172.21.15.88:0/3632129334 wait complete. 2024-09-17T04:27:30.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.459+0000 7f4941b44640 1 Processor -- start 2024-09-17T04:27:30.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.460+0000 7f4941b44640 1 -- start start 2024-09-17T04:27:30.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.460+0000 7f4941b44640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f493c101960 0x7f493c1974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:27:30.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.460+0000 7f4941b44640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f493c102b60 0x7f493c197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:27:30.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.460+0000 7f4941b44640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f493c10a780 con 0x7f493c102b60 2024-09-17T04:27:30.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.460+0000 7f4941b44640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f493c10a600 con 0x7f493c101960 2024-09-17T04:27:30.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.460+0000 7f493affd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f493c102b60 0x7f493c197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:27:30.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.460+0000 7f493affd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f493c102b60 0x7f493c197a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47724/0 (socket says 172.21.15.88:47724) 2024-09-17T04:27:30.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.460+0000 7f493affd640 1 -- 172.21.15.88:0/1344880701 learned_addr learned my addr 172.21.15.88:0/1344880701 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:27:30.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.460+0000 7f493b7fe640 1 --2- 172.21.15.88:0/1344880701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f493c101960 0x7f493c1974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:27:30.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.460+0000 7f493affd640 1 -- 172.21.15.88:0/1344880701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f493c101960 msgr2=0x7f493c1974d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:27:30.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.460+0000 7f493affd640 1 --2- 172.21.15.88:0/1344880701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f493c101960 0x7f493c1974d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:27:30.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.460+0000 7f493affd640 1 -- 172.21.15.88:0/1344880701 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f493c198090 con 0x7f493c102b60 2024-09-17T04:27:30.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.461+0000 7f493affd640 1 --2- 172.21.15.88:0/1344880701 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f493c102b60 0x7f493c197a10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f493000d8d0 tx=0x7f493000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:27:30.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.462+0000 7f4938ff9640 1 -- 172.21.15.88:0/1344880701 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4930017070 con 0x7f493c102b60 2024-09-17T04:27:30.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.462+0000 7f4941b44640 1 -- 172.21.15.88:0/1344880701 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f493c19cad0 con 0x7f493c102b60 2024-09-17T04:27:30.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.462+0000 7f4938ff9640 1 -- 172.21.15.88:0/1344880701 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4930010460 con 0x7f493c102b60 2024-09-17T04:27:30.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.462+0000 7f4941b44640 1 -- 172.21.15.88:0/1344880701 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f493c19d060 con 0x7f493c102b60 2024-09-17T04:27:30.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.462+0000 7f4938ff9640 1 -- 172.21.15.88:0/1344880701 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f493000f5f0 con 0x7f493c102b60 2024-09-17T04:27:30.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.464+0000 7f4941b44640 1 -- 172.21.15.88:0/1344880701 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f493c101d60 con 0x7f493c102b60 2024-09-17T04:27:30.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.464+0000 7f4938ff9640 1 -- 172.21.15.88:0/1344880701 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f4930009a30 con 0x7f493c102b60 2024-09-17T04:27:30.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.465+0000 7f4938ff9640 1 --2- 172.21.15.88:0/1344880701 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f492407af80 0x7f492407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:27:30.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.465+0000 7f493b7fe640 1 --2- 172.21.15.88:0/1344880701 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f492407af80 0x7f492407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:27:30.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.465+0000 7f4938ff9640 1 -- 172.21.15.88:0/1344880701 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f493009dd90 con 0x7f493c102b60 2024-09-17T04:27:30.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.466+0000 7f493b7fe640 1 --2- 172.21.15.88:0/1344880701 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f492407af80 0x7f492407d440 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f492c009230 tx=0x7f492c0058d0 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:27:30.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.469+0000 7f4938ff9640 1 -- 172.21.15.88:0/1344880701 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f4930069410 con 0x7f493c102b60 2024-09-17T04:27:30.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.732+0000 7f4941b44640 1 -- 172.21.15.88:0/1344880701 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f493c19d8e0 con 0x7f493c102b60 2024-09-17T04:27:30.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.733+0000 7f4938ff9640 1 -- 172.21.15.88:0/1344880701 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7f493006e2c0 con 0x7f493c102b60 2024-09-17T04:27:30.733 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-17T04:27:30.733 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-09-17T04:27:30.733 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T04:27:30.733 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:27:30.733 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-09-17T04:27:30.733 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T04:27:30.733 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:27:30.734 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-09-17T04:27:30.734 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 6 2024-09-17T04:27:30.734 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:27:30.734 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2024-09-17T04:27:30.734 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2, 2024-09-17T04:27:30.734 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T04:27:30.734 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:27:30.734 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-09-17T04:27:30.734 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2, 2024-09-17T04:27:30.734 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 12 2024-09-17T04:27:30.734 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-17T04:27:30.734 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-17T04:27:30.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.736+0000 7f4941b44640 1 -- 172.21.15.88:0/1344880701 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f492407af80 msgr2=0x7f492407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:27:30.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.736+0000 7f4941b44640 1 --2- 172.21.15.88:0/1344880701 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f492407af80 0x7f492407d440 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f492c009230 tx=0x7f492c0058d0 comp rx=0 tx=0).stop 2024-09-17T04:27:30.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.736+0000 7f4941b44640 1 -- 172.21.15.88:0/1344880701 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f493c102b60 msgr2=0x7f493c197a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:27:30.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.736+0000 7f4941b44640 1 --2- 172.21.15.88:0/1344880701 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f493c102b60 0x7f493c197a10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f493000d8d0 tx=0x7f493000dd90 comp rx=0 tx=0).stop 2024-09-17T04:27:30.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.736+0000 7f4941b44640 1 -- 172.21.15.88:0/1344880701 shutdown_connections 2024-09-17T04:27:30.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.736+0000 7f4941b44640 1 --2- 172.21.15.88:0/1344880701 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f492407af80 0x7f492407d440 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:27:30.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.736+0000 7f4941b44640 1 --2- 172.21.15.88:0/1344880701 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f493c102b60 0x7f493c197a10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:27:30.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.736+0000 7f4941b44640 1 --2- 172.21.15.88:0/1344880701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f493c101960 0x7f493c1974d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:27:30.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.736+0000 7f4941b44640 1 -- 172.21.15.88:0/1344880701 >> 172.21.15.88:0/1344880701 conn(0x7f493c0fd110 msgr2=0x7f493c0ff330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:27:30.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.736+0000 7f4941b44640 1 -- 172.21.15.88:0/1344880701 shutdown_connections 2024-09-17T04:27:30.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.736+0000 7f4941b44640 1 -- 172.21.15.88:0/1344880701 wait complete. 2024-09-17T04:27:30.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.822+0000 7f9ce16c9640 1 -- 172.21.15.88:0/3040065756 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9cdc101960 msgr2=0x7f9cdc101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:27:30.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.822+0000 7f9ce16c9640 1 --2- 172.21.15.88:0/3040065756 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9cdc101960 0x7f9cdc101d60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc009880 tx=0x7f9ccc02a4a0 comp rx=0 tx=0).stop 2024-09-17T04:27:30.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.822+0000 7f9ce16c9640 1 -- 172.21.15.88:0/3040065756 shutdown_connections 2024-09-17T04:27:30.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.822+0000 7f9ce16c9640 1 --2- 172.21.15.88:0/3040065756 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9cdc102b60 0x7f9cdc102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:27:30.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.822+0000 7f9ce16c9640 1 --2- 172.21.15.88:0/3040065756 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9cdc101960 0x7f9cdc101d60 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:27:30.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.822+0000 7f9ce16c9640 1 -- 172.21.15.88:0/3040065756 >> 172.21.15.88:0/3040065756 conn(0x7f9cdc0fd0f0 msgr2=0x7f9cdc0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:27:30.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.822+0000 7f9ce16c9640 1 -- 172.21.15.88:0/3040065756 shutdown_connections 2024-09-17T04:27:30.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.822+0000 7f9ce16c9640 1 -- 172.21.15.88:0/3040065756 wait complete. 2024-09-17T04:27:30.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.823+0000 7f9ce16c9640 1 Processor -- start 2024-09-17T04:27:30.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.823+0000 7f9ce16c9640 1 -- start start 2024-09-17T04:27:30.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.823+0000 7f9ce16c9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9cdc101960 0x7f9cdc197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:27:30.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.823+0000 7f9ce16c9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9cdc102b60 0x7f9cdc1979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:27:30.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.823+0000 7f9ce16c9640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f9cdc10a780 con 0x7f9cdc102b60 2024-09-17T04:27:30.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.823+0000 7f9ce16c9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9cdc10a600 con 0x7f9cdc101960 2024-09-17T04:27:30.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.823+0000 7f9cd27fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9cdc102b60 0x7f9cdc1979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:27:30.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.823+0000 7f9cd27fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9cdc102b60 0x7f9cdc1979d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47740/0 (socket says 172.21.15.88:47740) 2024-09-17T04:27:30.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.823+0000 7f9cd27fc640 1 -- 172.21.15.88:0/73113184 learned_addr learned my addr 172.21.15.88:0/73113184 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:27:30.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.823+0000 7f9cdaffd640 1 --2- 172.21.15.88:0/73113184 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9cdc101960 0x7f9cdc197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:27:30.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.823+0000 7f9cd27fc640 1 -- 172.21.15.88:0/73113184 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9cdc101960 msgr2=0x7f9cdc197490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:27:30.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.823+0000 7f9cd27fc640 1 --2- 172.21.15.88:0/73113184 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9cdc101960 0x7f9cdc197490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:27:30.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.823+0000 7f9cd27fc640 1 -- 172.21.15.88:0/73113184 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cdc197fc0 con 0x7f9cdc102b60 2024-09-17T04:27:30.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.824+0000 7f9cd27fc640 1 --2- 172.21.15.88:0/73113184 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9cdc102b60 0x7f9cdc1979d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9cc400c8a0 tx=0x7f9cc400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:27:30.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.824+0000 7f9cd8ff9640 1 -- 172.21.15.88:0/73113184 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9cc40079b0 con 0x7f9cdc102b60 2024-09-17T04:27:30.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.824+0000 7f9cd8ff9640 1 -- 172.21.15.88:0/73113184 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9cc4007b50 con 0x7f9cdc102b60 2024-09-17T04:27:30.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.824+0000 7f9ce16c9640 1 -- 172.21.15.88:0/73113184 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cdc19ca30 con 0x7f9cdc102b60 2024-09-17T04:27:30.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.824+0000 7f9cd8ff9640 1 -- 172.21.15.88:0/73113184 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9cc4018700 con 0x7f9cdc102b60 2024-09-17T04:27:30.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.824+0000 7f9ce16c9640 1 -- 172.21.15.88:0/73113184 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cdc19cf90 con 0x7f9cdc102b60 2024-09-17T04:27:30.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.825+0000 7f9ce16c9640 1 -- 172.21.15.88:0/73113184 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cdc101d60 con 0x7f9cdc102b60 2024-09-17T04:27:30.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.825+0000 7f9cd8ff9640 1 -- 172.21.15.88:0/73113184 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f9cc4007d00 con 0x7f9cdc102b60 2024-09-17T04:27:30.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.826+0000 7f9cd8ff9640 1 --2- 172.21.15.88:0/73113184 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f9cc807af30 0x7f9cc807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:27:30.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.826+0000 7f9cd8ff9640 1 -- 172.21.15.88:0/73113184 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f9cc409e2a0 con 0x7f9cdc102b60 2024-09-17T04:27:30.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.826+0000 7f9cdaffd640 1 --2- 172.21.15.88:0/73113184 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f9cc807af30 0x7f9cc807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:27:30.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.827+0000 7f9cdaffd640 1 --2- 172.21.15.88:0/73113184 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f9cc807af30 0x7f9cc807d3f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc009230 tx=0x7f9ccc0058d0 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:27:30.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:30.831+0000 7f9cd8ff9640 1 -- 172.21.15.88:0/73113184 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f9cc4014030 con 0x7f9cdc102b60 2024-09-17T04:27:31.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.051+0000 7f9ce16c9640 1 -- 172.21.15.88:0/73113184 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f9cdc062df0 con 0x7f9cdc102b60 2024-09-17T04:27:31.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.052+0000 7f9cd8ff9640 1 -- 172.21.15.88:0/73113184 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+2018 (secure 0 0 0) 0x7f9cc4069840 con 0x7f9cdc102b60 2024-09-17T04:27:31.052 INFO:teuthology.orchestra.run.smithi088.stdout:e24 2024-09-17T04:27:31.052 INFO:teuthology.orchestra.run.smithi088.stdout:btime 2024-09-17T04:27:25:102565+0000 2024-09-17T04:27:31.052 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T04:27:31.053 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:27:31.053 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2024-09-17T04:27:31.053 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:27:31.053 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2024-09-17T04:27:31.053 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2024-09-17T04:27:31.053 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 24 2024-09-17T04:27:31.053 INFO:teuthology.orchestra.run.smithi088.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-17T04:27:31.053 INFO:teuthology.orchestra.run.smithi088.stdout:created 2024-09-17T04:18:10.480573+0000 2024-09-17T04:27:31.053 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2024-09-17T04:27:25.102558+0000 2024-09-17T04:27:31.053 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2024-09-17T04:27:31.053 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2024-09-17T04:27:31.053 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2024-09-17T04:27:31.053 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2024-09-17T04:27:31.053 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2024-09-17T04:27:31.054 INFO:teuthology.orchestra.run.smithi088.stdout:max_xattr_size 65536 2024-09-17T04:27:31.054 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2024-09-17T04:27:31.054 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2024-09-17T04:27:31.054 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 80 2024-09-17T04:27:31.054 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:27:31.054 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 1 2024-09-17T04:27:31.054 INFO:teuthology.orchestra.run.smithi088.stdout:in 0 2024-09-17T04:27:31.054 INFO:teuthology.orchestra.run.smithi088.stdout:up {0=24325} 2024-09-17T04:27:31.054 INFO:teuthology.orchestra.run.smithi088.stdout:failed 2024-09-17T04:27:31.054 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2024-09-17T04:27:31.054 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2024-09-17T04:27:31.054 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2024-09-17T04:27:31.054 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2024-09-17T04:27:31.054 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data enabled 2024-09-17T04:27:31.055 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2024-09-17T04:27:31.055 INFO:teuthology.orchestra.run.smithi088.stdout:bal_rank_mask -1 2024-09-17T04:27:31.055 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 1 2024-09-17T04:27:31.055 INFO:teuthology.orchestra.run.smithi088.stdout:qdb_cluster leader: 24325 members: 24325 2024-09-17T04:27:31.055 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi134.ktuhce{0:24325} state up:active seq 138 join_fscid=1 addr [v2:172.21.15.134:6824/967997022,v1:172.21.15.134:6825/967997022] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:27:31.055 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:27:31.055 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:27:31.055 INFO:teuthology.orchestra.run.smithi088.stdout:Standby daemons: 2024-09-17T04:27:31.055 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:27:31.055 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi134.psnynp{-1:34223} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/584624515,v1:172.21.15.134:6827/584624515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:27:31.055 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.lgavsv{-1:34318} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/3125957194,v1:172.21.15.88:6827/3125957194] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:27:31.055 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.giqrgt{-1:34322} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6828/2683662376,v1:172.21.15.88:6829/2683662376] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:27:31.056 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 24 2024-09-17T04:27:31.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.054+0000 7f9ce16c9640 1 -- 172.21.15.88:0/73113184 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f9cc807af30 msgr2=0x7f9cc807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:27:31.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.054+0000 7f9ce16c9640 1 --2- 172.21.15.88:0/73113184 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f9cc807af30 0x7f9cc807d3f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc009230 tx=0x7f9ccc0058d0 comp rx=0 tx=0).stop 2024-09-17T04:27:31.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.054+0000 7f9ce16c9640 1 -- 172.21.15.88:0/73113184 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9cdc102b60 msgr2=0x7f9cdc1979d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:27:31.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.054+0000 7f9ce16c9640 1 --2- 172.21.15.88:0/73113184 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9cdc102b60 0x7f9cdc1979d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9cc400c8a0 tx=0x7f9cc400cd60 comp rx=0 tx=0).stop 2024-09-17T04:27:31.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.054+0000 7f9ce16c9640 1 -- 172.21.15.88:0/73113184 shutdown_connections 2024-09-17T04:27:31.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.054+0000 7f9ce16c9640 1 --2- 172.21.15.88:0/73113184 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f9cc807af30 0x7f9cc807d3f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:27:31.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.054+0000 7f9ce16c9640 1 --2- 172.21.15.88:0/73113184 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9cdc102b60 0x7f9cdc1979d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:27:31.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.054+0000 7f9ce16c9640 1 --2- 172.21.15.88:0/73113184 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9cdc101960 0x7f9cdc197490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:27:31.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.054+0000 7f9ce16c9640 1 -- 172.21.15.88:0/73113184 >> 172.21.15.88:0/73113184 conn(0x7f9cdc0fd0f0 msgr2=0x7f9cdc105fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:27:31.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.054+0000 7f9ce16c9640 1 -- 172.21.15.88:0/73113184 shutdown_connections 2024-09-17T04:27:31.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.054+0000 7f9ce16c9640 1 -- 172.21.15.88:0/73113184 wait complete. 2024-09-17T04:27:31.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.139+0000 7fe02c729640 1 -- 172.21.15.88:0/3226244293 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe024100860 msgr2=0x7fe024100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:27:31.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.139+0000 7fe02c729640 1 --2- 172.21.15.88:0/3226244293 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe024100860 0x7fe024100c60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe020009880 tx=0x7fe02002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:27:31.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.140+0000 7fe02c729640 1 -- 172.21.15.88:0/3226244293 shutdown_connections 2024-09-17T04:27:31.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.140+0000 7fe02c729640 1 --2- 172.21.15.88:0/3226244293 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe024101a60 0x7fe024101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:27:31.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.140+0000 7fe02c729640 1 --2- 172.21.15.88:0/3226244293 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe024100860 0x7fe024100c60 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:27:31.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.140+0000 7fe02c729640 1 -- 172.21.15.88:0/3226244293 >> 172.21.15.88:0/3226244293 conn(0x7fe0240fc010 msgr2=0x7fe0240fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:27:31.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.140+0000 7fe02c729640 1 -- 172.21.15.88:0/3226244293 shutdown_connections 2024-09-17T04:27:31.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.140+0000 7fe02c729640 1 -- 172.21.15.88:0/3226244293 wait complete. 2024-09-17T04:27:31.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.140+0000 7fe02c729640 1 Processor -- start 2024-09-17T04:27:31.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.140+0000 7fe02c729640 1 -- start start 2024-09-17T04:27:31.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.140+0000 7fe02c729640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe024100860 0x7fe024197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:27:31.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.140+0000 7fe02c729640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe024101a60 0x7fe024197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:27:31.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.140+0000 7fe02c729640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fe0241096a0 con 0x7fe024100860 2024-09-17T04:27:31.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.140+0000 7fe02c729640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe024109520 con 0x7fe024101a60 2024-09-17T04:27:31.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.140+0000 7fe02a4c5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe024100860 0x7fe024197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:27:31.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.140+0000 7fe02a4c5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe024100860 0x7fe024197520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47756/0 (socket says 172.21.15.88:47756) 2024-09-17T04:27:31.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.140+0000 7fe02a4c5640 1 -- 172.21.15.88:0/339457787 learned_addr learned my addr 172.21.15.88:0/339457787 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:27:31.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.141+0000 7fe02a4c5640 1 -- 172.21.15.88:0/339457787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe024101a60 msgr2=0x7fe024197a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:27:31.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.141+0000 7fe02a4c5640 1 --2- 172.21.15.88:0/339457787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe024101a60 0x7fe024197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:27:31.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.141+0000 7fe02a4c5640 1 -- 172.21.15.88:0/339457787 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0241980e0 con 0x7fe024100860 2024-09-17T04:27:31.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.141+0000 7fe02a4c5640 1 --2- 172.21.15.88:0/339457787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe024100860 0x7fe024197520 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe020006010 tx=0x7fe0200045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:27:31.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.141+0000 7fe01b7fe640 1 -- 172.21.15.88:0/339457787 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe02003f070 con 0x7fe024100860 2024-09-17T04:27:31.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.141+0000 7fe02c729640 1 -- 172.21.15.88:0/339457787 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe02419cac0 con 0x7fe024100860 2024-09-17T04:27:31.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.141+0000 7fe01b7fe640 1 -- 172.21.15.88:0/339457787 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe020004a50 con 0x7fe024100860 2024-09-17T04:27:31.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.141+0000 7fe01b7fe640 1 -- 172.21.15.88:0/339457787 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe020035030 con 0x7fe024100860 2024-09-17T04:27:31.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.141+0000 7fe02c729640 1 -- 172.21.15.88:0/339457787 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe02419d050 con 0x7fe024100860 2024-09-17T04:27:31.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.142+0000 7fe02c729640 1 -- 172.21.15.88:0/339457787 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe024100c60 con 0x7fe024100860 2024-09-17T04:27:31.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.143+0000 7fe01b7fe640 1 -- 172.21.15.88:0/339457787 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fe020042070 con 0x7fe024100860 2024-09-17T04:27:31.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.143+0000 7fe01b7fe640 1 --2- 172.21.15.88:0/339457787 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe01007af30 0x7fe01007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:27:31.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.143+0000 7fe01b7fe640 1 -- 172.21.15.88:0/339457787 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fe0200bebc0 con 0x7fe024100860 2024-09-17T04:27:31.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.143+0000 7fe029cc4640 1 --2- 172.21.15.88:0/339457787 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe01007af30 0x7fe01007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:27:31.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.144+0000 7fe029cc4640 1 --2- 172.21.15.88:0/339457787 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe01007af30 0x7fe01007d3f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe014005fd0 tx=0x7fe014005850 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:27:31.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.148+0000 7fe01b7fe640 1 -- 172.21.15.88:0/339457787 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fe020004c00 con 0x7fe024100860 2024-09-17T04:27:31.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.341+0000 7fe02c729640 1 -- 172.21.15.88:0/339457787 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe02406a930 con 0x7fe01007af30 2024-09-17T04:27:31.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.342+0000 7fe01b7fe640 1 -- 172.21.15.88:0/339457787 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fe02406a930 con 0x7fe01007af30 2024-09-17T04:27:31.342 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-17T04:27:31.342 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f", 2024-09-17T04:27:31.342 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-09-17T04:27:31.343 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T04:27:31.343 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [ 2024-09-17T04:27:31.343 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr", 2024-09-17T04:27:31.343 INFO:teuthology.orchestra.run.smithi088.stdout: "osd", 2024-09-17T04:27:31.343 INFO:teuthology.orchestra.run.smithi088.stdout: "mon", 2024-09-17T04:27:31.343 INFO:teuthology.orchestra.run.smithi088.stdout: "crash" 2024-09-17T04:27:31.343 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-17T04:27:31.343 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "14/23 daemons upgraded", 2024-09-17T04:27:31.343 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading mds daemons", 2024-09-17T04:27:31.343 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-09-17T04:27:31.343 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-17T04:27:31.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.345+0000 7fe02c729640 1 -- 172.21.15.88:0/339457787 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe01007af30 msgr2=0x7fe01007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:27:31.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.345+0000 7fe02c729640 1 --2- 172.21.15.88:0/339457787 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe01007af30 0x7fe01007d3f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe014005fd0 tx=0x7fe014005850 comp rx=0 tx=0).stop 2024-09-17T04:27:31.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.345+0000 7fe02c729640 1 -- 172.21.15.88:0/339457787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe024100860 msgr2=0x7fe024197520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:27:31.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.345+0000 7fe02c729640 1 --2- 172.21.15.88:0/339457787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe024100860 0x7fe024197520 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe020006010 tx=0x7fe0200045e0 comp rx=0 tx=0).stop 2024-09-17T04:27:31.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.345+0000 7fe02c729640 1 -- 172.21.15.88:0/339457787 shutdown_connections 2024-09-17T04:27:31.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.345+0000 7fe02c729640 1 --2- 172.21.15.88:0/339457787 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe01007af30 0x7fe01007d3f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:27:31.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.345+0000 7fe02c729640 1 --2- 172.21.15.88:0/339457787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe024101a60 0x7fe024197a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:27:31.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.345+0000 7fe02c729640 1 --2- 172.21.15.88:0/339457787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe024100860 0x7fe024197520 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:27:31.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.345+0000 7fe02c729640 1 -- 172.21.15.88:0/339457787 >> 172.21.15.88:0/339457787 conn(0x7fe0240fc010 msgr2=0x7fe02406a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:27:31.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.345+0000 7fe02c729640 1 -- 172.21.15.88:0/339457787 shutdown_connections 2024-09-17T04:27:31.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.345+0000 7fe02c729640 1 -- 172.21.15.88:0/339457787 wait complete. 2024-09-17T04:27:31.429 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.429+0000 7f8f269c8640 1 -- 172.21.15.88:0/614447435 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f20102b60 msgr2=0x7f8f20102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:27:31.429 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.429+0000 7f8f269c8640 1 --2- 172.21.15.88:0/614447435 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f20102b60 0x7f8f20102fe0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8f14009880 tx=0x7f8f1402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:27:31.430 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.429+0000 7f8f269c8640 1 -- 172.21.15.88:0/614447435 shutdown_connections 2024-09-17T04:27:31.430 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.429+0000 7f8f269c8640 1 --2- 172.21.15.88:0/614447435 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f20102b60 0x7f8f20102fe0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:27:31.430 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.429+0000 7f8f269c8640 1 --2- 172.21.15.88:0/614447435 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f20101960 0x7f8f20101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:27:31.430 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.429+0000 7f8f269c8640 1 -- 172.21.15.88:0/614447435 >> 172.21.15.88:0/614447435 conn(0x7f8f200fd0f0 msgr2=0x7f8f200ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:27:31.430 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.429+0000 7f8f269c8640 1 -- 172.21.15.88:0/614447435 shutdown_connections 2024-09-17T04:27:31.430 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.429+0000 7f8f269c8640 1 -- 172.21.15.88:0/614447435 wait complete. 2024-09-17T04:27:31.430 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.430+0000 7f8f269c8640 1 Processor -- start 2024-09-17T04:27:31.430 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.430+0000 7f8f269c8640 1 -- start start 2024-09-17T04:27:31.432 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.430+0000 7f8f269c8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f20101960 0x7f8f20197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:27:31.432 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.430+0000 7f8f269c8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f20102b60 0x7f8f20197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:27:31.432 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.430+0000 7f8f269c8640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f8f2010a820 con 0x7f8f20101960 2024-09-17T04:27:31.432 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.430+0000 7f8f269c8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8f2010a6a0 con 0x7f8f20102b60 2024-09-17T04:27:31.432 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.430+0000 7f8f1ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f20101960 0x7f8f20197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:27:31.432 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.430+0000 7f8f1ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f20101960 0x7f8f20197510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47770/0 (socket says 172.21.15.88:47770) 2024-09-17T04:27:31.432 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.430+0000 7f8f1ffff640 1 -- 172.21.15.88:0/2780215733 learned_addr learned my addr 172.21.15.88:0/2780215733 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:27:31.432 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.430+0000 7f8f1f7fe640 1 --2- 172.21.15.88:0/2780215733 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f20102b60 0x7f8f20197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:27:31.432 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.430+0000 7f8f1ffff640 1 -- 172.21.15.88:0/2780215733 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f20102b60 msgr2=0x7f8f20197a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:27:31.432 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.430+0000 7f8f1ffff640 1 --2- 172.21.15.88:0/2780215733 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f20102b60 0x7f8f20197a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:27:31.432 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.430+0000 7f8f1ffff640 1 -- 172.21.15.88:0/2780215733 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f201980d0 con 0x7f8f20101960 2024-09-17T04:27:31.432 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.431+0000 7f8f1ffff640 1 --2- 172.21.15.88:0/2780215733 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f20101960 0x7f8f20197510 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8f1000b3d0 tx=0x7f8f1000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:27:31.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.431+0000 7f8f1d7fa640 1 -- 172.21.15.88:0/2780215733 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8f10015020 con 0x7f8f20101960 2024-09-17T04:27:31.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.431+0000 7f8f269c8640 1 -- 172.21.15.88:0/2780215733 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f2019cb10 con 0x7f8f20101960 2024-09-17T04:27:31.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.431+0000 7f8f1d7fa640 1 -- 172.21.15.88:0/2780215733 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8f10011af0 con 0x7f8f20101960 2024-09-17T04:27:31.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.431+0000 7f8f1d7fa640 1 -- 172.21.15.88:0/2780215733 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8f10010da0 con 0x7f8f20101960 2024-09-17T04:27:31.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.431+0000 7f8f269c8640 1 -- 172.21.15.88:0/2780215733 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f2019d0a0 con 0x7f8f20101960 2024-09-17T04:27:31.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.432+0000 7f8f269c8640 1 -- 172.21.15.88:0/2780215733 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f20101d60 con 0x7f8f20101960 2024-09-17T04:27:31.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.433+0000 7f8f1d7fa640 1 -- 172.21.15.88:0/2780215733 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f8f10018020 con 0x7f8f20101960 2024-09-17T04:27:31.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.433+0000 7f8f1d7fa640 1 --2- 172.21.15.88:0/2780215733 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f8f0807af30 0x7f8f0807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:27:31.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.433+0000 7f8f1d7fa640 1 -- 172.21.15.88:0/2780215733 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f8f1009dae0 con 0x7f8f20101960 2024-09-17T04:27:31.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.433+0000 7f8f1f7fe640 1 --2- 172.21.15.88:0/2780215733 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f8f0807af30 0x7f8f0807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:27:31.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.434+0000 7f8f1f7fe640 1 --2- 172.21.15.88:0/2780215733 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f8f0807af30 0x7f8f0807d3f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8f201989c0 tx=0x7f8f14005a20 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:27:31.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.438+0000 7f8f1d7fa640 1 -- 172.21.15.88:0/2780215733 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f8f1001f020 con 0x7f8f20101960 2024-09-17T04:27:31.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:31 smithi088 ceph-mon[90867]: from='client.34326 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:27:31.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:31 smithi088 ceph-mon[90867]: from='client.34330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:27:31.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:31 smithi088 ceph-mon[90867]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:27:31.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:31 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:31.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:31 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:31.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:31 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/1344880701' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:27:31.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:31 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/73113184' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T04:27:31.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.688+0000 7f8f269c8640 1 -- 172.21.15.88:0/2780215733 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f8f20191630 con 0x7f8f20101960 2024-09-17T04:27:31.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.688+0000 7f8f1d7fa640 1 -- 172.21.15.88:0/2780215733 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f8f100690e0 con 0x7f8f20101960 2024-09-17T04:27:31.688 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T04:27:31.688 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T04:27:31.688 INFO:teuthology.orchestra.run.smithi088.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T04:27:31.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.690+0000 7f8f269c8640 1 -- 172.21.15.88:0/2780215733 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f8f0807af30 msgr2=0x7f8f0807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:27:31.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.690+0000 7f8f269c8640 1 --2- 172.21.15.88:0/2780215733 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f8f0807af30 0x7f8f0807d3f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8f201989c0 tx=0x7f8f14005a20 comp rx=0 tx=0).stop 2024-09-17T04:27:31.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.690+0000 7f8f269c8640 1 -- 172.21.15.88:0/2780215733 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f20101960 msgr2=0x7f8f20197510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:27:31.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.690+0000 7f8f269c8640 1 --2- 172.21.15.88:0/2780215733 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f20101960 0x7f8f20197510 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8f1000b3d0 tx=0x7f8f1000b890 comp rx=0 tx=0).stop 2024-09-17T04:27:31.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.691+0000 7f8f269c8640 1 -- 172.21.15.88:0/2780215733 shutdown_connections 2024-09-17T04:27:31.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.691+0000 7f8f269c8640 1 --2- 172.21.15.88:0/2780215733 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f8f0807af30 0x7f8f0807d3f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:27:31.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.691+0000 7f8f269c8640 1 --2- 172.21.15.88:0/2780215733 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f20102b60 0x7f8f20197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:27:31.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.691+0000 7f8f269c8640 1 --2- 172.21.15.88:0/2780215733 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f20101960 0x7f8f20197510 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:27:31.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.691+0000 7f8f269c8640 1 -- 172.21.15.88:0/2780215733 >> 172.21.15.88:0/2780215733 conn(0x7f8f200fd0f0 msgr2=0x7f8f20106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:27:31.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.691+0000 7f8f269c8640 1 -- 172.21.15.88:0/2780215733 shutdown_connections 2024-09-17T04:27:31.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:27:31.691+0000 7f8f269c8640 1 -- 172.21.15.88:0/2780215733 wait complete. 2024-09-17T04:27:31.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:31 smithi134 ceph-mon[76677]: from='client.34326 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:27:31.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:31 smithi134 ceph-mon[76677]: from='client.34330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:27:31.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:31 smithi134 ceph-mon[76677]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:27:31.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:31 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:31.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:31 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:31.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:31 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/1344880701' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:27:31.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:31 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/73113184' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T04:27:32.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:32 smithi088 ceph-mon[90867]: pgmap v196: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 597 B/s wr, 9 op/s 2024-09-17T04:27:32.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:32 smithi088 ceph-mon[90867]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:27:32.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:32 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/2780215733' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T04:27:32.739 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:32 smithi134 ceph-mon[76677]: pgmap v196: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 597 B/s wr, 9 op/s 2024-09-17T04:27:32.739 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:32 smithi134 ceph-mon[76677]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:27:32.739 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:32 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/2780215733' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T04:27:34.538 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:34 smithi134 ceph-mon[76677]: pgmap v197: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 5.3 MiB/s rd, 597 B/s wr, 5 op/s 2024-09-17T04:27:34.539 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:34 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:34.539 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:34 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:34.539 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:34 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:27:34.539 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:34 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:27:34.539 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:34 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:34.539 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:34 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:27:34.539 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:34 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:27:34.539 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:34 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:27:34.539 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:34 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:27:34.539 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:34 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:27:34.539 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:34 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi134.ktuhce"]} : dispatch 2024-09-17T04:27:34.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:34 smithi088 ceph-mon[90867]: pgmap v197: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 5.3 MiB/s rd, 597 B/s wr, 5 op/s 2024-09-17T04:27:34.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:34 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:34.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:34 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:34.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:34 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:27:34.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:34 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:27:34.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:34 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:34.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:34 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:27:34.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:34 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:27:34.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:34 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:27:34.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:34 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:27:34.639 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:34 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:27:34.639 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:34 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi134.ktuhce"]} : dispatch 2024-09-17T04:27:35.723 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:35 smithi134 ceph-mon[76677]: Upgrade: It appears safe to stop mds.cephfs.smithi134.ktuhce 2024-09-17T04:27:35.724 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:35 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:35.724 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:35 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.ktuhce", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-17T04:27:35.724 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:35 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:27:35.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:35 smithi088 ceph-mon[90867]: Upgrade: It appears safe to stop mds.cephfs.smithi134.ktuhce 2024-09-17T04:27:35.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:35 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:35.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:35 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.ktuhce", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-17T04:27:35.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:35 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:27:36.536 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:36 smithi134 ceph-mon[76677]: pgmap v198: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 5.0 MiB/s rd, 4.6 KiB/s wr, 6 op/s 2024-09-17T04:27:36.536 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:36 smithi134 ceph-mon[76677]: Upgrade: Updating mds.cephfs.smithi134.ktuhce 2024-09-17T04:27:36.536 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:36 smithi134 ceph-mon[76677]: Deploying daemon mds.cephfs.smithi134.ktuhce on smithi134 2024-09-17T04:27:36.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:36 smithi088 ceph-mon[90867]: pgmap v198: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 5.0 MiB/s rd, 4.6 KiB/s wr, 6 op/s 2024-09-17T04:27:36.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:36 smithi088 ceph-mon[90867]: Upgrade: Updating mds.cephfs.smithi134.ktuhce 2024-09-17T04:27:36.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:36 smithi088 ceph-mon[90867]: Deploying daemon mds.cephfs.smithi134.ktuhce on smithi134 2024-09-17T04:27:37.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:37 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-mon-smithi088[90863]: 2024-09-17T04:27:37.001+0000 7fd96683a640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T04:27:37.826 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:37 smithi134 ceph-mon[76677]: pgmap v199: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 4.5 KiB/s wr, 5 op/s 2024-09-17T04:27:37.826 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:37 smithi134 ceph-mon[76677]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-17T04:27:37.826 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:37 smithi134 ceph-mon[76677]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T04:27:37.826 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:37 smithi134 ceph-mon[76677]: osdmap e81: 6 total, 6 up, 6 in 2024-09-17T04:27:37.827 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:37 smithi134 ceph-mon[76677]: Standby daemon mds.cephfs.smithi134.psnynp assigned to filesystem cephfs as rank 0 2024-09-17T04:27:37.827 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:37 smithi134 ceph-mon[76677]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-17T04:27:37.827 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:37 smithi134 ceph-mon[76677]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-17T04:27:37.827 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:37 smithi134 ceph-mon[76677]: fsmap cephfs:1/1 {0=cephfs.smithi134.psnynp=up:replay} 2 up:standby 2024-09-17T04:27:37.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:37 smithi088 ceph-mon[90867]: pgmap v199: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 4.5 KiB/s wr, 5 op/s 2024-09-17T04:27:37.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:37 smithi088 ceph-mon[90867]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-17T04:27:37.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:37 smithi088 ceph-mon[90867]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T04:27:37.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:37 smithi088 ceph-mon[90867]: osdmap e81: 6 total, 6 up, 6 in 2024-09-17T04:27:37.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:37 smithi088 ceph-mon[90867]: Standby daemon mds.cephfs.smithi134.psnynp assigned to filesystem cephfs as rank 0 2024-09-17T04:27:37.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:37 smithi088 ceph-mon[90867]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-17T04:27:37.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:37 smithi088 ceph-mon[90867]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-17T04:27:37.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:37 smithi088 ceph-mon[90867]: fsmap cephfs:1/1 {0=cephfs.smithi134.psnynp=up:replay} 2 up:standby 2024-09-17T04:27:39.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:39 smithi088 ceph-mon[90867]: pgmap v201: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 5.2 KiB/s wr, 5 op/s 2024-09-17T04:27:39.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:39 smithi134 ceph-mon[76677]: pgmap v201: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 5.2 KiB/s wr, 5 op/s 2024-09-17T04:27:42.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:42 smithi088 ceph-mon[90867]: pgmap v202: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 12 MiB/s rd, 4.8 KiB/s wr, 6 op/s 2024-09-17T04:27:42.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:42 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:42.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:42 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:27:42.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:42 smithi134 ceph-mon[76677]: pgmap v202: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 12 MiB/s rd, 4.8 KiB/s wr, 6 op/s 2024-09-17T04:27:42.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:42 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:42.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:42 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:27:44.323 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:44 smithi088 ceph-mon[90867]: pgmap v203: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 4.8 KiB/s wr, 6 op/s 2024-09-17T04:27:44.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:44 smithi134 ceph-mon[76677]: pgmap v203: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 4.8 KiB/s wr, 6 op/s 2024-09-17T04:27:46.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:46 smithi088 ceph-mon[90867]: pgmap v204: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 7 op/s 2024-09-17T04:27:46.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:46 smithi134 ceph-mon[76677]: pgmap v204: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 7 op/s 2024-09-17T04:27:47.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:47 smithi088 ceph-mon[90867]: mds.? [v2:172.21.15.134:6826/584624515,v1:172.21.15.134:6827/584624515] up:reconnect 2024-09-17T04:27:47.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:47 smithi088 ceph-mon[90867]: reconnect by client.24347 192.168.0.1:0/981223485 after 0 2024-09-17T04:27:47.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:47 smithi088 ceph-mon[90867]: fsmap cephfs:1/1 {0=cephfs.smithi134.psnynp=up:reconnect} 2 up:standby 2024-09-17T04:27:47.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:47 smithi088 ceph-mon[90867]: reconnect by client.14626 192.168.0.1:0/3146504306 after 0 2024-09-17T04:27:47.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:47 smithi134 ceph-mon[76677]: mds.? [v2:172.21.15.134:6826/584624515,v1:172.21.15.134:6827/584624515] up:reconnect 2024-09-17T04:27:47.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:47 smithi134 ceph-mon[76677]: reconnect by client.24347 192.168.0.1:0/981223485 after 0 2024-09-17T04:27:47.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:47 smithi134 ceph-mon[76677]: fsmap cephfs:1/1 {0=cephfs.smithi134.psnynp=up:reconnect} 2 up:standby 2024-09-17T04:27:47.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:47 smithi134 ceph-mon[76677]: reconnect by client.14626 192.168.0.1:0/3146504306 after 0 2024-09-17T04:27:48.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:48 smithi088 ceph-mon[90867]: pgmap v205: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 27 MiB/s rd, 8 op/s 2024-09-17T04:27:48.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:48 smithi088 ceph-mon[90867]: mds.? [v2:172.21.15.134:6826/584624515,v1:172.21.15.134:6827/584624515] up:rejoin 2024-09-17T04:27:48.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:48 smithi088 ceph-mon[90867]: fsmap cephfs:1/1 {0=cephfs.smithi134.psnynp=up:rejoin} 2 up:standby 2024-09-17T04:27:48.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:48 smithi088 ceph-mon[90867]: daemon mds.cephfs.smithi134.psnynp is now active in filesystem cephfs as rank 0 2024-09-17T04:27:48.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:48 smithi134 ceph-mon[76677]: pgmap v205: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 27 MiB/s rd, 8 op/s 2024-09-17T04:27:48.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:48 smithi134 ceph-mon[76677]: mds.? [v2:172.21.15.134:6826/584624515,v1:172.21.15.134:6827/584624515] up:rejoin 2024-09-17T04:27:48.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:48 smithi134 ceph-mon[76677]: fsmap cephfs:1/1 {0=cephfs.smithi134.psnynp=up:rejoin} 2 up:standby 2024-09-17T04:27:48.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:48 smithi134 ceph-mon[76677]: daemon mds.cephfs.smithi134.psnynp is now active in filesystem cephfs as rank 0 2024-09-17T04:27:49.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:49 smithi088 ceph-mon[90867]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-17T04:27:49.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:49 smithi088 ceph-mon[90867]: mds.? [v2:172.21.15.134:6826/584624515,v1:172.21.15.134:6827/584624515] up:active 2024-09-17T04:27:49.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:49 smithi088 ceph-mon[90867]: fsmap cephfs:1 {0=cephfs.smithi134.psnynp=up:active} 2 up:standby 2024-09-17T04:27:49.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:49 smithi134 ceph-mon[76677]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-17T04:27:49.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:49 smithi134 ceph-mon[76677]: mds.? [v2:172.21.15.134:6826/584624515,v1:172.21.15.134:6827/584624515] up:active 2024-09-17T04:27:49.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:49 smithi134 ceph-mon[76677]: fsmap cephfs:1 {0=cephfs.smithi134.psnynp=up:active} 2 up:standby 2024-09-17T04:27:50.354 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:50 smithi134 ceph-mon[76677]: pgmap v206: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 24 MiB/s rd, 7 op/s 2024-09-17T04:27:50.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:50 smithi088 ceph-mon[90867]: pgmap v206: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 24 MiB/s rd, 7 op/s 2024-09-17T04:27:52.279 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:51 smithi134 ceph-mon[76677]: pgmap v207: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 170 B/s wr, 9 op/s 2024-09-17T04:27:52.279 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:51 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:52.279 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:51 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:52.279 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:51 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:27:52.279 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:51 smithi134 ceph-mon[76677]: mds.? [v2:172.21.15.134:6824/3452154372,v1:172.21.15.134:6825/3452154372] up:boot 2024-09-17T04:27:52.280 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:51 smithi134 ceph-mon[76677]: fsmap cephfs:1 {0=cephfs.smithi134.psnynp=up:active} 3 up:standby 2024-09-17T04:27:52.280 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:51 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "mds metadata", "who": "cephfs.smithi134.ktuhce"} : dispatch 2024-09-17T04:27:52.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:51 smithi088 ceph-mon[90867]: pgmap v207: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 170 B/s wr, 9 op/s 2024-09-17T04:27:52.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:51 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:52.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:51 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:52.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:51 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:27:52.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:51 smithi088 ceph-mon[90867]: mds.? [v2:172.21.15.134:6824/3452154372,v1:172.21.15.134:6825/3452154372] up:boot 2024-09-17T04:27:52.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:51 smithi088 ceph-mon[90867]: fsmap cephfs:1 {0=cephfs.smithi134.psnynp=up:active} 3 up:standby 2024-09-17T04:27:52.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:51 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "mds metadata", "who": "cephfs.smithi134.ktuhce"} : dispatch 2024-09-17T04:27:54.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:53 smithi088 ceph-mon[90867]: pgmap v208: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 12 MiB/s rd, 170 B/s wr, 6 op/s 2024-09-17T04:27:54.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:53 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:54.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:53 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:54.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:53 smithi134 ceph-mon[76677]: pgmap v208: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 12 MiB/s rd, 170 B/s wr, 6 op/s 2024-09-17T04:27:54.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:53 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:54.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:53 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:55.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:55 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:55.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:55 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:55.638 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:55 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:55.638 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:55 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:56.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:56 smithi088 ceph-mon[90867]: pgmap v209: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 12 MiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-09-17T04:27:56.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:56 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:56.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:56 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:27:56.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:56 smithi134 ceph-mon[76677]: pgmap v209: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 12 MiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-09-17T04:27:56.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:56 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:56.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:56 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:27:58.329 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:58 smithi134 ceph-mon[76677]: pgmap v210: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 3.0 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-09-17T04:27:58.329 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:58 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:58.329 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:58 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:58.329 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:58 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:27:58.329 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:58 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:27:58.329 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:58 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:58.329 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:58 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:27:58.329 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:58 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:27:58.329 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:58 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:27:58.329 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:58 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:27:58.330 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:58 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:27:58.330 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:58 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi134.psnynp"]} : dispatch 2024-09-17T04:27:58.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:58 smithi088 ceph-mon[90867]: pgmap v210: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 3.0 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-09-17T04:27:58.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:58 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:58.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:58 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:58.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:58 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:27:58.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:58 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:27:58.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:58 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:58.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:58 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:27:58.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:58 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:27:58.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:58 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:27:58.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:58 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:27:58.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:58 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:27:58.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:58 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi134.psnynp"]} : dispatch 2024-09-17T04:27:59.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:59 smithi134 ceph-mon[76677]: Upgrade: It appears safe to stop mds.cephfs.smithi134.psnynp 2024-09-17T04:27:59.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:59 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:59.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:59 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.psnynp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-17T04:27:59.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:27:59 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:27:59.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:59 smithi088 ceph-mon[90867]: Upgrade: It appears safe to stop mds.cephfs.smithi134.psnynp 2024-09-17T04:27:59.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:59 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:27:59.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:59 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.psnynp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-17T04:27:59.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:27:59 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:28:00.581 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:00 smithi134 ceph-mon[76677]: pgmap v211: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 3.3 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-09-17T04:28:00.581 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:00 smithi134 ceph-mon[76677]: Upgrade: Updating mds.cephfs.smithi134.psnynp 2024-09-17T04:28:00.581 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:00 smithi134 ceph-mon[76677]: Deploying daemon mds.cephfs.smithi134.psnynp on smithi134 2024-09-17T04:28:00.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:00 smithi088 ceph-mon[90867]: pgmap v211: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 3.3 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-09-17T04:28:00.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:00 smithi088 ceph-mon[90867]: Upgrade: Updating mds.cephfs.smithi134.psnynp 2024-09-17T04:28:00.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:00 smithi088 ceph-mon[90867]: Deploying daemon mds.cephfs.smithi134.psnynp on smithi134 2024-09-17T04:28:01.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:01 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-mon-smithi088[90863]: 2024-09-17T04:28:01.120+0000 7fd96683a640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T04:28:01.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:01 smithi088 ceph-mon[90867]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-17T04:28:01.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:01 smithi088 ceph-mon[90867]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T04:28:01.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:01 smithi088 ceph-mon[90867]: osdmap e82: 6 total, 6 up, 6 in 2024-09-17T04:28:01.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:01 smithi088 ceph-mon[90867]: Standby daemon mds.cephfs.smithi134.ktuhce assigned to filesystem cephfs as rank 0 2024-09-17T04:28:01.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:01 smithi088 ceph-mon[90867]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-17T04:28:01.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:01 smithi088 ceph-mon[90867]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-17T04:28:01.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:01 smithi088 ceph-mon[90867]: fsmap cephfs:1/1 {0=cephfs.smithi134.ktuhce=up:replay} 2 up:standby 2024-09-17T04:28:01.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:01 smithi134 ceph-mon[76677]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-17T04:28:01.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:01 smithi134 ceph-mon[76677]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T04:28:01.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:01 smithi134 ceph-mon[76677]: osdmap e82: 6 total, 6 up, 6 in 2024-09-17T04:28:01.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:01 smithi134 ceph-mon[76677]: Standby daemon mds.cephfs.smithi134.ktuhce assigned to filesystem cephfs as rank 0 2024-09-17T04:28:01.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:01 smithi134 ceph-mon[76677]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-17T04:28:01.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:01 smithi134 ceph-mon[76677]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-17T04:28:01.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:01 smithi134 ceph-mon[76677]: fsmap cephfs:1/1 {0=cephfs.smithi134.ktuhce=up:replay} 2 up:standby 2024-09-17T04:28:01.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:01.785+0000 7f018b71e640 1 -- 172.21.15.88:0/4209032230 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0184102b30 msgr2=0x7f0184104fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:01.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:01.785+0000 7f018b71e640 1 --2- 172.21.15.88:0/4209032230 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0184102b30 0x7f0184104fa0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0174009880 tx=0x7f017402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:28:01.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:01.785+0000 7f018b71e640 1 -- 172.21.15.88:0/4209032230 shutdown_connections 2024-09-17T04:28:01.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:01.785+0000 7f018b71e640 1 --2- 172.21.15.88:0/4209032230 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0184102b30 0x7f0184104fa0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:01.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:01.785+0000 7f018b71e640 1 --2- 172.21.15.88:0/4209032230 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01841001e0 0x7f01841025f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:01.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:01.785+0000 7f018b71e640 1 -- 172.21.15.88:0/4209032230 >> 172.21.15.88:0/4209032230 conn(0x7f01840fc010 msgr2=0x7f01840fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:28:01.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:01.785+0000 7f018b71e640 1 -- 172.21.15.88:0/4209032230 shutdown_connections 2024-09-17T04:28:01.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:01.785+0000 7f018b71e640 1 -- 172.21.15.88:0/4209032230 wait complete. 2024-09-17T04:28:01.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:01.785+0000 7f018b71e640 1 Processor -- start 2024-09-17T04:28:01.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:01.785+0000 7f018b71e640 1 -- start start 2024-09-17T04:28:01.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:01.786+0000 7f018b71e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01841001e0 0x7f018419dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:28:01.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:01.786+0000 7f018b71e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0184102b30 0x7f018419e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:28:01.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:01.786+0000 7f018b71e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f0184110d70 con 0x7f0184102b30 2024-09-17T04:28:01.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:01.786+0000 7f018b71e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0184110bf0 con 0x7f01841001e0 2024-09-17T04:28:01.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:01.786+0000 7f0188cb9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0184102b30 0x7f018419e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:28:01.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:01.786+0000 7f0188cb9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0184102b30 0x7f018419e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44218/0 (socket says 172.21.15.88:44218) 2024-09-17T04:28:01.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:01.786+0000 7f0188cb9640 1 -- 172.21.15.88:0/24939229 learned_addr learned my addr 172.21.15.88:0/24939229 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:28:01.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:01.786+0000 7f01894ba640 1 --2- 172.21.15.88:0/24939229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01841001e0 0x7f018419dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:28:01.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:01.786+0000 7f0188cb9640 1 -- 172.21.15.88:0/24939229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01841001e0 msgr2=0x7f018419dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:01.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:01.786+0000 7f0188cb9640 1 --2- 172.21.15.88:0/24939229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01841001e0 0x7f018419dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:01.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:01.786+0000 7f0188cb9640 1 -- 172.21.15.88:0/24939229 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f018419e680 con 0x7f0184102b30 2024-09-17T04:28:01.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:01.786+0000 7f0188cb9640 1 --2- 172.21.15.88:0/24939229 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0184102b30 0x7f018419e000 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0174006010 tx=0x7f01740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:28:01.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:01.786+0000 7f017a7fc640 1 -- 172.21.15.88:0/24939229 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f017403f070 con 0x7f0184102b30 2024-09-17T04:28:01.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:01.787+0000 7f018b71e640 1 -- 172.21.15.88:0/24939229 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01841a3060 con 0x7f0184102b30 2024-09-17T04:28:01.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:01.787+0000 7f017a7fc640 1 -- 172.21.15.88:0/24939229 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0174004ac0 con 0x7f0184102b30 2024-09-17T04:28:01.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:01.787+0000 7f017a7fc640 1 -- 172.21.15.88:0/24939229 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0174035030 con 0x7f0184102b30 2024-09-17T04:28:01.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:01.787+0000 7f018b71e640 1 -- 172.21.15.88:0/24939229 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01841a35f0 con 0x7f0184102b30 2024-09-17T04:28:01.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:01.788+0000 7f018b71e640 1 -- 172.21.15.88:0/24939229 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01841005e0 con 0x7f0184102b30 2024-09-17T04:28:01.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:01.788+0000 7f017a7fc640 1 -- 172.21.15.88:0/24939229 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f0174042070 con 0x7f0184102b30 2024-09-17T04:28:01.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:01.789+0000 7f017a7fc640 1 --2- 172.21.15.88:0/24939229 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f017007af30 0x7f017007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:28:01.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:01.789+0000 7f017a7fc640 1 -- 172.21.15.88:0/24939229 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f01740bebd0 con 0x7f0184102b30 2024-09-17T04:28:01.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:01.789+0000 7f01894ba640 1 --2- 172.21.15.88:0/24939229 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f017007af30 0x7f017007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:28:01.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:01.789+0000 7f01894ba640 1 --2- 172.21.15.88:0/24939229 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f017007af30 0x7f017007d3f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0180005fd0 tx=0x7f0180009760 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:28:01.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:01.793+0000 7f017a7fc640 1 -- 172.21.15.88:0/24939229 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f017408a120 con 0x7f0184102b30 2024-09-17T04:28:01.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:01.986+0000 7f018b71e640 1 -- 172.21.15.88:0/24939229 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f01841035d0 con 0x7f017007af30 2024-09-17T04:28:01.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:01.987+0000 7f017a7fc640 1 -- 172.21.15.88:0/24939229 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f01841035d0 con 0x7f017007af30 2024-09-17T04:28:01.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:01.989+0000 7f018b71e640 1 -- 172.21.15.88:0/24939229 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f017007af30 msgr2=0x7f017007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:01.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:01.989+0000 7f018b71e640 1 --2- 172.21.15.88:0/24939229 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f017007af30 0x7f017007d3f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0180005fd0 tx=0x7f0180009760 comp rx=0 tx=0).stop 2024-09-17T04:28:01.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:01.989+0000 7f018b71e640 1 -- 172.21.15.88:0/24939229 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0184102b30 msgr2=0x7f018419e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:01.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:01.989+0000 7f018b71e640 1 --2- 172.21.15.88:0/24939229 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0184102b30 0x7f018419e000 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0174006010 tx=0x7f01740046c0 comp rx=0 tx=0).stop 2024-09-17T04:28:01.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:01.989+0000 7f018b71e640 1 -- 172.21.15.88:0/24939229 shutdown_connections 2024-09-17T04:28:01.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:01.989+0000 7f018b71e640 1 --2- 172.21.15.88:0/24939229 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f017007af30 0x7f017007d3f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:01.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:01.989+0000 7f018b71e640 1 --2- 172.21.15.88:0/24939229 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0184102b30 0x7f018419e000 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:01.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:01.989+0000 7f018b71e640 1 --2- 172.21.15.88:0/24939229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01841001e0 0x7f018419dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:01.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:01.989+0000 7f018b71e640 1 -- 172.21.15.88:0/24939229 >> 172.21.15.88:0/24939229 conn(0x7f01840fc010 msgr2=0x7f01840fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:28:01.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:01.990+0000 7f018b71e640 1 -- 172.21.15.88:0/24939229 shutdown_connections 2024-09-17T04:28:01.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:01.990+0000 7f018b71e640 1 -- 172.21.15.88:0/24939229 wait complete. 2024-09-17T04:28:02.000 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-09-17T04:28:02.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.073+0000 7f62065d2640 1 -- 172.21.15.88:0/2557052565 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6200104d20 msgr2=0x7f6200107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:02.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.073+0000 7f62065d2640 1 --2- 172.21.15.88:0/2557052565 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6200104d20 0x7f6200107110 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f61f40098b0 tx=0x7f61f402a4d0 comp rx=0 tx=0).stop 2024-09-17T04:28:02.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.073+0000 7f62065d2640 1 -- 172.21.15.88:0/2557052565 shutdown_connections 2024-09-17T04:28:02.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.073+0000 7f62065d2640 1 --2- 172.21.15.88:0/2557052565 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6200104d20 0x7f6200107110 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:02.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.073+0000 7f62065d2640 1 --2- 172.21.15.88:0/2557052565 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62001023f0 0x7f62001047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:02.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.073+0000 7f62065d2640 1 -- 172.21.15.88:0/2557052565 >> 172.21.15.88:0/2557052565 conn(0x7f62000fc010 msgr2=0x7f62000fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:28:02.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.073+0000 7f62065d2640 1 -- 172.21.15.88:0/2557052565 shutdown_connections 2024-09-17T04:28:02.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.073+0000 7f62065d2640 1 -- 172.21.15.88:0/2557052565 wait complete. 2024-09-17T04:28:02.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.073+0000 7f62065d2640 1 Processor -- start 2024-09-17T04:28:02.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.074+0000 7f62065d2640 1 -- start start 2024-09-17T04:28:02.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.074+0000 7f62065d2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62001023f0 0x7f6200197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:28:02.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.074+0000 7f62065d2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6200104d20 0x7f6200197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:28:02.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.074+0000 7f62065d2640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f620010a790 con 0x7f62001023f0 2024-09-17T04:28:02.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.074+0000 7f62065d2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f620010a610 con 0x7f6200104d20 2024-09-17T04:28:02.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.074+0000 7f61fffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62001023f0 0x7f6200197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:28:02.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.074+0000 7f61fffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62001023f0 0x7f6200197530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44236/0 (socket says 172.21.15.88:44236) 2024-09-17T04:28:02.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.074+0000 7f61fffff640 1 -- 172.21.15.88:0/3581974030 learned_addr learned my addr 172.21.15.88:0/3581974030 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:28:02.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.074+0000 7f61ff7fe640 1 --2- 172.21.15.88:0/3581974030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6200104d20 0x7f6200197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:28:02.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.074+0000 7f61fffff640 1 -- 172.21.15.88:0/3581974030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6200104d20 msgr2=0x7f6200197a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:02.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.074+0000 7f61fffff640 1 --2- 172.21.15.88:0/3581974030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6200104d20 0x7f6200197a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:02.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.074+0000 7f61fffff640 1 -- 172.21.15.88:0/3581974030 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62001980f0 con 0x7f62001023f0 2024-09-17T04:28:02.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.075+0000 7f61fffff640 1 --2- 172.21.15.88:0/3581974030 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62001023f0 0x7f6200197530 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f61f000d8d0 tx=0x7f61f000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:28:02.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.075+0000 7f61fd7fa640 1 -- 172.21.15.88:0/3581974030 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f61f0017070 con 0x7f62001023f0 2024-09-17T04:28:02.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.075+0000 7f61fd7fa640 1 -- 172.21.15.88:0/3581974030 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f61f0010460 con 0x7f62001023f0 2024-09-17T04:28:02.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.075+0000 7f62065d2640 1 -- 172.21.15.88:0/3581974030 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f620019cb30 con 0x7f62001023f0 2024-09-17T04:28:02.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.075+0000 7f61fd7fa640 1 -- 172.21.15.88:0/3581974030 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f61f000f5f0 con 0x7f62001023f0 2024-09-17T04:28:02.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.075+0000 7f62065d2640 1 -- 172.21.15.88:0/3581974030 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f620019d090 con 0x7f62001023f0 2024-09-17T04:28:02.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.076+0000 7f62065d2640 1 -- 172.21.15.88:0/3581974030 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62001027d0 con 0x7f62001023f0 2024-09-17T04:28:02.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.077+0000 7f61fd7fa640 1 -- 172.21.15.88:0/3581974030 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f61f0009a30 con 0x7f62001023f0 2024-09-17T04:28:02.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.078+0000 7f61fd7fa640 1 --2- 172.21.15.88:0/3581974030 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f61e807af30 0x7f61e807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:28:02.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.078+0000 7f61fd7fa640 1 -- 172.21.15.88:0/3581974030 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f61f009dee0 con 0x7f62001023f0 2024-09-17T04:28:02.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.078+0000 7f61ff7fe640 1 --2- 172.21.15.88:0/3581974030 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f61e807af30 0x7f61e807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:28:02.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.078+0000 7f61ff7fe640 1 --2- 172.21.15.88:0/3581974030 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f61e807af30 0x7f61e807d3f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f61f4009880 tx=0x7f61f40058d0 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:28:02.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.082+0000 7f61fd7fa640 1 -- 172.21.15.88:0/3581974030 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f61f0069430 con 0x7f62001023f0 2024-09-17T04:28:02.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.275+0000 7f62065d2640 1 -- 172.21.15.88:0/3581974030 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6200105740 con 0x7f61e807af30 2024-09-17T04:28:02.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.277+0000 7f61fd7fa640 1 -- 172.21.15.88:0/3581974030 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f6200105740 con 0x7f61e807af30 2024-09-17T04:28:02.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.279+0000 7f62065d2640 1 -- 172.21.15.88:0/3581974030 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f61e807af30 msgr2=0x7f61e807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:02.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.279+0000 7f62065d2640 1 --2- 172.21.15.88:0/3581974030 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f61e807af30 0x7f61e807d3f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f61f4009880 tx=0x7f61f40058d0 comp rx=0 tx=0).stop 2024-09-17T04:28:02.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.279+0000 7f62065d2640 1 -- 172.21.15.88:0/3581974030 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62001023f0 msgr2=0x7f6200197530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:02.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.279+0000 7f62065d2640 1 --2- 172.21.15.88:0/3581974030 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62001023f0 0x7f6200197530 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f61f000d8d0 tx=0x7f61f000dd90 comp rx=0 tx=0).stop 2024-09-17T04:28:02.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.279+0000 7f62065d2640 1 -- 172.21.15.88:0/3581974030 shutdown_connections 2024-09-17T04:28:02.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.279+0000 7f62065d2640 1 --2- 172.21.15.88:0/3581974030 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f61e807af30 0x7f61e807d3f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:02.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.279+0000 7f62065d2640 1 --2- 172.21.15.88:0/3581974030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6200104d20 0x7f6200197a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:02.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.279+0000 7f62065d2640 1 --2- 172.21.15.88:0/3581974030 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62001023f0 0x7f6200197530 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:02.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.279+0000 7f62065d2640 1 -- 172.21.15.88:0/3581974030 >> 172.21.15.88:0/3581974030 conn(0x7f62000fc010 msgr2=0x7f62000fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:28:02.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.279+0000 7f62065d2640 1 -- 172.21.15.88:0/3581974030 shutdown_connections 2024-09-17T04:28:02.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.279+0000 7f62065d2640 1 -- 172.21.15.88:0/3581974030 wait complete. 2024-09-17T04:28:02.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.362+0000 7f8d52125640 1 -- 172.21.15.88:0/1154405526 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d4c101a60 msgr2=0x7f8d4c101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:02.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.362+0000 7f8d52125640 1 --2- 172.21.15.88:0/1154405526 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d4c101a60 0x7f8d4c101ee0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8d34009880 tx=0x7f8d3402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:28:02.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.362+0000 7f8d52125640 1 -- 172.21.15.88:0/1154405526 shutdown_connections 2024-09-17T04:28:02.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.362+0000 7f8d52125640 1 --2- 172.21.15.88:0/1154405526 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d4c101a60 0x7f8d4c101ee0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:02.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.362+0000 7f8d52125640 1 --2- 172.21.15.88:0/1154405526 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d4c100860 0x7f8d4c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:02.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.362+0000 7f8d52125640 1 -- 172.21.15.88:0/1154405526 >> 172.21.15.88:0/1154405526 conn(0x7f8d4c0fc010 msgr2=0x7f8d4c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:28:02.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.362+0000 7f8d52125640 1 -- 172.21.15.88:0/1154405526 shutdown_connections 2024-09-17T04:28:02.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.362+0000 7f8d52125640 1 -- 172.21.15.88:0/1154405526 wait complete. 2024-09-17T04:28:02.363 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:02 smithi088 ceph-mon[90867]: pgmap v212: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4.2 KiB/s wr, 4 op/s 2024-09-17T04:28:02.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.363+0000 7f8d52125640 1 Processor -- start 2024-09-17T04:28:02.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.363+0000 7f8d52125640 1 -- start start 2024-09-17T04:28:02.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.363+0000 7f8d52125640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d4c100860 0x7f8d4c06a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:28:02.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.363+0000 7f8d52125640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d4c101a60 0x7f8d4c19c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:28:02.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.363+0000 7f8d52125640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f8d4c109680 con 0x7f8d4c100860 2024-09-17T04:28:02.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.363+0000 7f8d52125640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8d4c109500 con 0x7f8d4c101a60 2024-09-17T04:28:02.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.363+0000 7f8d4b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d4c100860 0x7f8d4c06a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:28:02.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.363+0000 7f8d4b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d4c100860 0x7f8d4c06a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51682/0 (socket says 172.21.15.88:51682) 2024-09-17T04:28:02.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.363+0000 7f8d4b7fe640 1 -- 172.21.15.88:0/979479801 learned_addr learned my addr 172.21.15.88:0/979479801 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:28:02.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.363+0000 7f8d43fff640 1 --2- 172.21.15.88:0/979479801 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d4c101a60 0x7f8d4c19c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:28:02.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.363+0000 7f8d4b7fe640 1 -- 172.21.15.88:0/979479801 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d4c101a60 msgr2=0x7f8d4c19c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:02.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.363+0000 7f8d4b7fe640 1 --2- 172.21.15.88:0/979479801 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d4c101a60 0x7f8d4c19c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:02.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.363+0000 7f8d4b7fe640 1 -- 172.21.15.88:0/979479801 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d4c19c7e0 con 0x7f8d4c100860 2024-09-17T04:28:02.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.363+0000 7f8d43fff640 1 --2- 172.21.15.88:0/979479801 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d4c101a60 0x7f8d4c19c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:28:02.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.364+0000 7f8d4b7fe640 1 --2- 172.21.15.88:0/979479801 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d4c100860 0x7f8d4c06a790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c00d8d0 tx=0x7f8d3c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:28:02.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.364+0000 7f8d497fa640 1 -- 172.21.15.88:0/979479801 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8d3c017020 con 0x7f8d4c100860 2024-09-17T04:28:02.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.364+0000 7f8d52125640 1 -- 172.21.15.88:0/979479801 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d4c19cad0 con 0x7f8d4c100860 2024-09-17T04:28:02.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.364+0000 7f8d497fa640 1 -- 172.21.15.88:0/979479801 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8d3c010460 con 0x7f8d4c100860 2024-09-17T04:28:02.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.364+0000 7f8d497fa640 1 -- 172.21.15.88:0/979479801 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8d3c00f5b0 con 0x7f8d4c100860 2024-09-17T04:28:02.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.364+0000 7f8d52125640 1 -- 172.21.15.88:0/979479801 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d4c19d060 con 0x7f8d4c100860 2024-09-17T04:28:02.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.365+0000 7f8d52125640 1 -- 172.21.15.88:0/979479801 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d4c100c60 con 0x7f8d4c100860 2024-09-17T04:28:02.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.366+0000 7f8d497fa640 1 -- 172.21.15.88:0/979479801 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f8d3c01a020 con 0x7f8d4c100860 2024-09-17T04:28:02.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.366+0000 7f8d497fa640 1 --2- 172.21.15.88:0/979479801 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f8d3807f390 0x7f8d38081850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:28:02.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.366+0000 7f8d497fa640 1 -- 172.21.15.88:0/979479801 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f8d3c09e390 con 0x7f8d4c100860 2024-09-17T04:28:02.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.366+0000 7f8d43fff640 1 --2- 172.21.15.88:0/979479801 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f8d3807f390 0x7f8d38081850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:28:02.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.367+0000 7f8d43fff640 1 --2- 172.21.15.88:0/979479801 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f8d3807f390 0x7f8d38081850 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c06a510 tx=0x7f8d34005a20 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:28:02.370 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.370+0000 7f8d497fa640 1 -- 172.21.15.88:0/979479801 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f8d3c021030 con 0x7f8d4c100860 2024-09-17T04:28:02.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.553+0000 7f8d52125640 1 -- 172.21.15.88:0/979479801 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f8d4c062630 con 0x7f8d3807f390 2024-09-17T04:28:02.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.563+0000 7f8d497fa640 1 -- 172.21.15.88:0/979479801 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f8d4c062630 con 0x7f8d3807f390 2024-09-17T04:28:02.563 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T04:28:02.563 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (13m) 32s ago 15m 25.5M - 0.25.0 c8568f914cd2 f2dbac7e939f 2024-09-17T04:28:02.563 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi088 smithi088 running (6m) 32s ago 15m 8870k - 19.1.1-330-gc2ddf972 ebb0615149de 683e1826a1a5 2024-09-17T04:28:02.563 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi134 smithi134 running (6m) 8s ago 14m 8862k - 19.1.1-330-gc2ddf972 ebb0615149de 83afa4200c0e 2024-09-17T04:28:02.563 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (4m) 32s ago 15m 6891k - 19.3.0-4989-gce1b342b 8e039cb7fe1e 10355648c406 2024-09-17T04:28:02.563 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi134 smithi134 running (4m) 8s ago 14m 6899k - 19.3.0-4989-gce1b342b 8e039cb7fe1e d709085ffe5d 2024-09-17T04:28:02.563 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (13m) 32s ago 14m 77.6M - 9.4.12 2bacad6d85d8 a6cff57a23f9 2024-09-17T04:28:02.563 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.giqrgt smithi088 running (38s) 32s ago 9m 81.6M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 3bb1d05b4476 2024-09-17T04:28:02.563 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.lgavsv smithi088 running (60s) 32s ago 9m 83.5M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 6fb9ba0a8ec3 2024-09-17T04:28:02.563 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi134.ktuhce smithi134 running (12s) 8s ago 9m 82.3M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 851c1f3a855a 2024-09-17T04:28:02.563 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi134.psnynp smithi134 running (9m) 8s ago 9m 86.9M - 19.1.1-330-gc2ddf972 ebb0615149de 5326974fa3dd 2024-09-17T04:28:02.563 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.wmndiv smithi088 *:8443,9283,8765 running (6m) 32s ago 16m 588M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 49eb47f7f14f 2024-09-17T04:28:02.563 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi134.vwdxcb smithi134 *:8443,9283,8765 running (5m) 8s ago 14m 522M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 8a6d45eb0595 2024-09-17T04:28:02.564 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (5m) 32s ago 16m 117M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e ac6332015243 2024-09-17T04:28:02.564 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi134 smithi134 running (4m) 8s ago 14m 104M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e ea49f690e26b 2024-09-17T04:28:02.564 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (15m) 32s ago 15m 16.1M - 1.5.0 0da6a335fe13 9ba03800993b 2024-09-17T04:28:02.564 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi134 smithi134 *:9100 running (14m) 8s ago 14m 17.8M - 1.5.0 0da6a335fe13 6deac483827f 2024-09-17T04:28:02.564 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (4m) 32s ago 13m 163M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 4ef267302248 2024-09-17T04:28:02.564 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (3m) 32s ago 12m 165M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 17b67c13c7aa 2024-09-17T04:28:02.564 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (2m) 32s ago 12m 153M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 83d38ad792c9 2024-09-17T04:28:02.564 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi134 running (2m) 8s ago 11m 169M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e 336a363ac39f 2024-09-17T04:28:02.564 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi134 running (110s) 8s ago 11m 160M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e 6df8a692310a 2024-09-17T04:28:02.564 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi134 running (76s) 8s ago 10m 154M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e 5066799816d3 2024-09-17T04:28:02.564 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (5m) 32s ago 14m 71.3M - 2.43.0 a07b618ecd1d b51d7899d341 2024-09-17T04:28:02.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.565+0000 7f8d52125640 1 -- 172.21.15.88:0/979479801 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f8d3807f390 msgr2=0x7f8d38081850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:02.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.565+0000 7f8d52125640 1 --2- 172.21.15.88:0/979479801 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f8d3807f390 0x7f8d38081850 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c06a510 tx=0x7f8d34005a20 comp rx=0 tx=0).stop 2024-09-17T04:28:02.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.565+0000 7f8d52125640 1 -- 172.21.15.88:0/979479801 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d4c100860 msgr2=0x7f8d4c06a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:02.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.565+0000 7f8d52125640 1 --2- 172.21.15.88:0/979479801 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d4c100860 0x7f8d4c06a790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c00d8d0 tx=0x7f8d3c00dd90 comp rx=0 tx=0).stop 2024-09-17T04:28:02.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.565+0000 7f8d52125640 1 -- 172.21.15.88:0/979479801 shutdown_connections 2024-09-17T04:28:02.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.565+0000 7f8d52125640 1 --2- 172.21.15.88:0/979479801 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f8d3807f390 0x7f8d38081850 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:02.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.565+0000 7f8d52125640 1 --2- 172.21.15.88:0/979479801 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d4c101a60 0x7f8d4c19c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:02.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.565+0000 7f8d52125640 1 --2- 172.21.15.88:0/979479801 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d4c100860 0x7f8d4c06a790 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:02.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.565+0000 7f8d52125640 1 -- 172.21.15.88:0/979479801 >> 172.21.15.88:0/979479801 conn(0x7f8d4c0fc010 msgr2=0x7f8d4c104f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:28:02.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.565+0000 7f8d52125640 1 -- 172.21.15.88:0/979479801 shutdown_connections 2024-09-17T04:28:02.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.565+0000 7f8d52125640 1 -- 172.21.15.88:0/979479801 wait complete. 2024-09-17T04:28:02.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:02 smithi134 ceph-mon[76677]: pgmap v212: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4.2 KiB/s wr, 4 op/s 2024-09-17T04:28:02.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.650+0000 7fe40107c640 1 -- 172.21.15.88:0/4255438007 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3fc100860 msgr2=0x7fe3fc100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:02.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.650+0000 7fe40107c640 1 --2- 172.21.15.88:0/4255438007 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3fc100860 0x7fe3fc100c60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe3f4009880 tx=0x7fe3f402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:28:02.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.651+0000 7fe40107c640 1 -- 172.21.15.88:0/4255438007 shutdown_connections 2024-09-17T04:28:02.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.651+0000 7fe40107c640 1 --2- 172.21.15.88:0/4255438007 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe3fc101a60 0x7fe3fc101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:02.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.651+0000 7fe40107c640 1 --2- 172.21.15.88:0/4255438007 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3fc100860 0x7fe3fc100c60 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:02.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.651+0000 7fe40107c640 1 -- 172.21.15.88:0/4255438007 >> 172.21.15.88:0/4255438007 conn(0x7fe3fc0fc010 msgr2=0x7fe3fc0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:28:02.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.651+0000 7fe40107c640 1 -- 172.21.15.88:0/4255438007 shutdown_connections 2024-09-17T04:28:02.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.651+0000 7fe40107c640 1 -- 172.21.15.88:0/4255438007 wait complete. 2024-09-17T04:28:02.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.651+0000 7fe40107c640 1 Processor -- start 2024-09-17T04:28:02.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.652+0000 7fe40107c640 1 -- start start 2024-09-17T04:28:02.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.652+0000 7fe40107c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3fc100860 0x7fe3fc1974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:28:02.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.652+0000 7fe40107c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe3fc101a60 0x7fe3fc197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:28:02.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.652+0000 7fe40107c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fe3fc109680 con 0x7fe3fc100860 2024-09-17T04:28:02.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.652+0000 7fe40107c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe3fc109500 con 0x7fe3fc101a60 2024-09-17T04:28:02.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.652+0000 7fe3fad9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3fc100860 0x7fe3fc1974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:28:02.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.652+0000 7fe3fad9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3fc100860 0x7fe3fc1974c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51700/0 (socket says 172.21.15.88:51700) 2024-09-17T04:28:02.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.652+0000 7fe3fad9d640 1 -- 172.21.15.88:0/200594509 learned_addr learned my addr 172.21.15.88:0/200594509 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:28:02.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.652+0000 7fe3fa59c640 1 --2- 172.21.15.88:0/200594509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe3fc101a60 0x7fe3fc197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:28:02.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.652+0000 7fe3fad9d640 1 -- 172.21.15.88:0/200594509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe3fc101a60 msgr2=0x7fe3fc197a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:02.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.652+0000 7fe3fad9d640 1 --2- 172.21.15.88:0/200594509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe3fc101a60 0x7fe3fc197a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:02.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.652+0000 7fe3fad9d640 1 -- 172.21.15.88:0/200594509 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3fc198080 con 0x7fe3fc100860 2024-09-17T04:28:02.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.652+0000 7fe3fad9d640 1 --2- 172.21.15.88:0/200594509 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3fc100860 0x7fe3fc1974c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe3f4006010 tx=0x7fe3f40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:28:02.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.653+0000 7fe3f3fff640 1 -- 172.21.15.88:0/200594509 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe3f403f070 con 0x7fe3fc100860 2024-09-17T04:28:02.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.653+0000 7fe40107c640 1 -- 172.21.15.88:0/200594509 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3fc19ca60 con 0x7fe3fc100860 2024-09-17T04:28:02.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.653+0000 7fe3f3fff640 1 -- 172.21.15.88:0/200594509 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe3f4004a50 con 0x7fe3fc100860 2024-09-17T04:28:02.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.653+0000 7fe3f3fff640 1 -- 172.21.15.88:0/200594509 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe3f4035030 con 0x7fe3fc100860 2024-09-17T04:28:02.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.653+0000 7fe40107c640 1 -- 172.21.15.88:0/200594509 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3fc19cff0 con 0x7fe3fc100860 2024-09-17T04:28:02.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.654+0000 7fe40107c640 1 -- 172.21.15.88:0/200594509 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3fc100c60 con 0x7fe3fc100860 2024-09-17T04:28:02.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.654+0000 7fe3f3fff640 1 -- 172.21.15.88:0/200594509 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fe3f4042070 con 0x7fe3fc100860 2024-09-17T04:28:02.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.655+0000 7fe3f3fff640 1 --2- 172.21.15.88:0/200594509 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe3e807af30 0x7fe3e807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:28:02.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.655+0000 7fe3f3fff640 1 -- 172.21.15.88:0/200594509 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fe3f40beb80 con 0x7fe3fc100860 2024-09-17T04:28:02.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.655+0000 7fe3fa59c640 1 --2- 172.21.15.88:0/200594509 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe3e807af30 0x7fe3e807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:28:02.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.656+0000 7fe3fa59c640 1 --2- 172.21.15.88:0/200594509 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe3e807af30 0x7fe3e807d3f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc198970 tx=0x7fe3e4009760 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:28:02.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.660+0000 7fe3f3fff640 1 -- 172.21.15.88:0/200594509 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fe3f4004c00 con 0x7fe3fc100860 2024-09-17T04:28:02.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.907+0000 7fe40107c640 1 -- 172.21.15.88:0/200594509 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fe3fc19d9c0 con 0x7fe3fc100860 2024-09-17T04:28:02.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.908+0000 7fe3f3fff640 1 -- 172.21.15.88:0/200594509 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fe3f408a0d0 con 0x7fe3fc100860 2024-09-17T04:28:02.908 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-17T04:28:02.908 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-09-17T04:28:02.908 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T04:28:02.908 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:28:02.908 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-09-17T04:28:02.908 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T04:28:02.909 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:28:02.909 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-09-17T04:28:02.909 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 6 2024-09-17T04:28:02.909 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:28:02.909 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2024-09-17T04:28:02.909 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 3 2024-09-17T04:28:02.909 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:28:02.909 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-09-17T04:28:02.909 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 13 2024-09-17T04:28:02.909 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-17T04:28:02.909 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-17T04:28:02.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.910+0000 7fe40107c640 1 -- 172.21.15.88:0/200594509 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe3e807af30 msgr2=0x7fe3e807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:02.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.910+0000 7fe40107c640 1 --2- 172.21.15.88:0/200594509 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe3e807af30 0x7fe3e807d3f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc198970 tx=0x7fe3e4009760 comp rx=0 tx=0).stop 2024-09-17T04:28:02.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.910+0000 7fe40107c640 1 -- 172.21.15.88:0/200594509 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3fc100860 msgr2=0x7fe3fc1974c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:02.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.910+0000 7fe40107c640 1 --2- 172.21.15.88:0/200594509 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3fc100860 0x7fe3fc1974c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe3f4006010 tx=0x7fe3f40045e0 comp rx=0 tx=0).stop 2024-09-17T04:28:02.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.910+0000 7fe40107c640 1 -- 172.21.15.88:0/200594509 shutdown_connections 2024-09-17T04:28:02.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.910+0000 7fe40107c640 1 --2- 172.21.15.88:0/200594509 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe3e807af30 0x7fe3e807d3f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:02.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.910+0000 7fe40107c640 1 --2- 172.21.15.88:0/200594509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe3fc101a60 0x7fe3fc197a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:02.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.910+0000 7fe40107c640 1 --2- 172.21.15.88:0/200594509 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3fc100860 0x7fe3fc1974c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:02.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.910+0000 7fe40107c640 1 -- 172.21.15.88:0/200594509 >> 172.21.15.88:0/200594509 conn(0x7fe3fc0fc010 msgr2=0x7fe3fc06a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:28:02.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.910+0000 7fe40107c640 1 -- 172.21.15.88:0/200594509 shutdown_connections 2024-09-17T04:28:02.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.910+0000 7fe40107c640 1 -- 172.21.15.88:0/200594509 wait complete. 2024-09-17T04:28:02.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.993+0000 7f4f4764b640 1 -- 172.21.15.88:0/681531362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f40101970 msgr2=0x7f4f40101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:02.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.993+0000 7f4f4764b640 1 --2- 172.21.15.88:0/681531362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f40101970 0x7f4f40101d70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c009880 tx=0x7f4f3c02a4a0 comp rx=0 tx=0).stop 2024-09-17T04:28:02.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.993+0000 7f4f4764b640 1 -- 172.21.15.88:0/681531362 shutdown_connections 2024-09-17T04:28:02.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.993+0000 7f4f4764b640 1 --2- 172.21.15.88:0/681531362 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f40102b70 0x7f4f40102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:02.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.993+0000 7f4f4764b640 1 --2- 172.21.15.88:0/681531362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f40101970 0x7f4f40101d70 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:02.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.993+0000 7f4f4764b640 1 -- 172.21.15.88:0/681531362 >> 172.21.15.88:0/681531362 conn(0x7f4f400fd140 msgr2=0x7f4f400ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:28:02.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.993+0000 7f4f4764b640 1 -- 172.21.15.88:0/681531362 shutdown_connections 2024-09-17T04:28:02.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.993+0000 7f4f4764b640 1 -- 172.21.15.88:0/681531362 wait complete. 2024-09-17T04:28:02.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.994+0000 7f4f4764b640 1 Processor -- start 2024-09-17T04:28:02.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.994+0000 7f4f4764b640 1 -- start start 2024-09-17T04:28:02.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.994+0000 7f4f4764b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f40101970 0x7f4f40075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:28:02.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.994+0000 7f4f4764b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f40102b70 0x7f4f400745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:28:02.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.994+0000 7f4f4764b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f4f4010a7b0 con 0x7f4f40101970 2024-09-17T04:28:02.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.994+0000 7f4f4764b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4f4010a630 con 0x7f4f40102b70 2024-09-17T04:28:02.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.994+0000 7f4f453e7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f40101970 0x7f4f40075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:28:02.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.994+0000 7f4f453e7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f40101970 0x7f4f40075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51716/0 (socket says 172.21.15.88:51716) 2024-09-17T04:28:02.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.994+0000 7f4f453e7640 1 -- 172.21.15.88:0/2745894705 learned_addr learned my addr 172.21.15.88:0/2745894705 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:28:02.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.994+0000 7f4f44be6640 1 --2- 172.21.15.88:0/2745894705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f40102b70 0x7f4f400745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:28:02.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.994+0000 7f4f453e7640 1 -- 172.21.15.88:0/2745894705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f40102b70 msgr2=0x7f4f400745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:02.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.994+0000 7f4f453e7640 1 --2- 172.21.15.88:0/2745894705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f40102b70 0x7f4f400745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:02.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.994+0000 7f4f453e7640 1 -- 172.21.15.88:0/2745894705 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f40074b20 con 0x7f4f40101970 2024-09-17T04:28:02.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.994+0000 7f4f44be6640 1 --2- 172.21.15.88:0/2745894705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f40102b70 0x7f4f400745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:28:02.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.994+0000 7f4f453e7640 1 --2- 172.21.15.88:0/2745894705 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f40101970 0x7f4f40075f20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c006010 tx=0x7f4f3c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:28:02.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.995+0000 7f4f367fc640 1 -- 172.21.15.88:0/2745894705 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4f3c03f070 con 0x7f4f40101970 2024-09-17T04:28:02.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.995+0000 7f4f367fc640 1 -- 172.21.15.88:0/2745894705 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4f3c0049d0 con 0x7f4f40101970 2024-09-17T04:28:02.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.995+0000 7f4f4764b640 1 -- 172.21.15.88:0/2745894705 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f40074db0 con 0x7f4f40101970 2024-09-17T04:28:02.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.995+0000 7f4f367fc640 1 -- 172.21.15.88:0/2745894705 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4f3c035030 con 0x7f4f40101970 2024-09-17T04:28:02.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.995+0000 7f4f4764b640 1 -- 172.21.15.88:0/2745894705 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f400752e0 con 0x7f4f40101970 2024-09-17T04:28:02.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.996+0000 7f4f4764b640 1 -- 172.21.15.88:0/2745894705 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f40101d70 con 0x7f4f40101970 2024-09-17T04:28:02.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.996+0000 7f4f367fc640 1 -- 172.21.15.88:0/2745894705 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f4f3c042070 con 0x7f4f40101970 2024-09-17T04:28:02.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.997+0000 7f4f367fc640 1 --2- 172.21.15.88:0/2745894705 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f4f2c07af30 0x7f4f2c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:28:02.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.997+0000 7f4f367fc640 1 -- 172.21.15.88:0/2745894705 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f4f3c0bec00 con 0x7f4f40101970 2024-09-17T04:28:02.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.997+0000 7f4f44be6640 1 --2- 172.21.15.88:0/2745894705 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f4f2c07af30 0x7f4f2c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:28:02.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:02.997+0000 7f4f44be6640 1 --2- 172.21.15.88:0/2745894705 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f4f2c07af30 0x7f4f2c07d3f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4f40075ca0 tx=0x7f4f30005f90 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:28:03.001 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.001+0000 7f4f367fc640 1 -- 172.21.15.88:0/2745894705 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f4f3c0c4020 con 0x7f4f40101970 2024-09-17T04:28:03.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.219+0000 7f4f4764b640 1 -- 172.21.15.88:0/2745894705 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f4f4019f650 con 0x7f4f40101970 2024-09-17T04:28:03.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.220+0000 7f4f367fc640 1 -- 172.21.15.88:0/2745894705 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 32 v32) ==== 76+0+1832 (secure 0 0 0) 0x7f4f3c08a150 con 0x7f4f40101970 2024-09-17T04:28:03.220 INFO:teuthology.orchestra.run.smithi088.stdout:e32 2024-09-17T04:28:03.220 INFO:teuthology.orchestra.run.smithi088.stdout:btime 2024-09-17T04:28:01:128719+0000 2024-09-17T04:28:03.220 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T04:28:03.220 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:28:03.220 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2024-09-17T04:28:03.220 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:28:03.221 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2024-09-17T04:28:03.221 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2024-09-17T04:28:03.221 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 32 2024-09-17T04:28:03.221 INFO:teuthology.orchestra.run.smithi088.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-17T04:28:03.221 INFO:teuthology.orchestra.run.smithi088.stdout:created 2024-09-17T04:18:10.480573+0000 2024-09-17T04:28:03.221 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2024-09-17T04:28:01.128702+0000 2024-09-17T04:28:03.221 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2024-09-17T04:28:03.221 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2024-09-17T04:28:03.221 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2024-09-17T04:28:03.221 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2024-09-17T04:28:03.221 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2024-09-17T04:28:03.221 INFO:teuthology.orchestra.run.smithi088.stdout:max_xattr_size 65536 2024-09-17T04:28:03.221 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2024-09-17T04:28:03.221 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2024-09-17T04:28:03.222 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 82 2024-09-17T04:28:03.222 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:28:03.222 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 1 2024-09-17T04:28:03.222 INFO:teuthology.orchestra.run.smithi088.stdout:in 0 2024-09-17T04:28:03.222 INFO:teuthology.orchestra.run.smithi088.stdout:up {0=34273} 2024-09-17T04:28:03.222 INFO:teuthology.orchestra.run.smithi088.stdout:failed 2024-09-17T04:28:03.222 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2024-09-17T04:28:03.222 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2024-09-17T04:28:03.222 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2024-09-17T04:28:03.222 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2024-09-17T04:28:03.222 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data enabled 2024-09-17T04:28:03.222 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2024-09-17T04:28:03.222 INFO:teuthology.orchestra.run.smithi088.stdout:bal_rank_mask -1 2024-09-17T04:28:03.222 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 1 2024-09-17T04:28:03.223 INFO:teuthology.orchestra.run.smithi088.stdout:qdb_cluster leader: 0 members: 2024-09-17T04:28:03.223 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi134.ktuhce{0:34273} state up:replay seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/3452154372,v1:172.21.15.134:6825/3452154372] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:28:03.223 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:28:03.223 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:28:03.223 INFO:teuthology.orchestra.run.smithi088.stdout:Standby daemons: 2024-09-17T04:28:03.223 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:28:03.223 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.lgavsv{-1:34318} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/3125957194,v1:172.21.15.88:6827/3125957194] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:28:03.223 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.giqrgt{-1:34322} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6828/2683662376,v1:172.21.15.88:6829/2683662376] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:28:03.224 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 32 2024-09-17T04:28:03.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.222+0000 7f4f4764b640 1 -- 172.21.15.88:0/2745894705 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f4f2c07af30 msgr2=0x7f4f2c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:03.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.222+0000 7f4f4764b640 1 --2- 172.21.15.88:0/2745894705 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f4f2c07af30 0x7f4f2c07d3f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4f40075ca0 tx=0x7f4f30005f90 comp rx=0 tx=0).stop 2024-09-17T04:28:03.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.222+0000 7f4f4764b640 1 -- 172.21.15.88:0/2745894705 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f40101970 msgr2=0x7f4f40075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:03.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.222+0000 7f4f4764b640 1 --2- 172.21.15.88:0/2745894705 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f40101970 0x7f4f40075f20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c006010 tx=0x7f4f3c0045e0 comp rx=0 tx=0).stop 2024-09-17T04:28:03.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.222+0000 7f4f4764b640 1 -- 172.21.15.88:0/2745894705 shutdown_connections 2024-09-17T04:28:03.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.222+0000 7f4f4764b640 1 --2- 172.21.15.88:0/2745894705 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f4f2c07af30 0x7f4f2c07d3f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:03.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.222+0000 7f4f4764b640 1 --2- 172.21.15.88:0/2745894705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f40102b70 0x7f4f400745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:03.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.222+0000 7f4f4764b640 1 --2- 172.21.15.88:0/2745894705 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f40101970 0x7f4f40075f20 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:03.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.222+0000 7f4f4764b640 1 -- 172.21.15.88:0/2745894705 >> 172.21.15.88:0/2745894705 conn(0x7f4f400fd140 msgr2=0x7f4f400ff360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:28:03.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.222+0000 7f4f4764b640 1 -- 172.21.15.88:0/2745894705 shutdown_connections 2024-09-17T04:28:03.225 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.222+0000 7f4f4764b640 1 -- 172.21.15.88:0/2745894705 wait complete. 2024-09-17T04:28:03.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.305+0000 7f12294e1640 1 -- 172.21.15.88:0/630357472 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1224101a60 msgr2=0x7f1224101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:03.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.305+0000 7f12294e1640 1 --2- 172.21.15.88:0/630357472 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1224101a60 0x7f1224101ee0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1218009880 tx=0x7f121802a4a0 comp rx=0 tx=0).stop 2024-09-17T04:28:03.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.305+0000 7f12294e1640 1 -- 172.21.15.88:0/630357472 shutdown_connections 2024-09-17T04:28:03.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.305+0000 7f12294e1640 1 --2- 172.21.15.88:0/630357472 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1224101a60 0x7f1224101ee0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:03.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.305+0000 7f12294e1640 1 --2- 172.21.15.88:0/630357472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1224100860 0x7f1224100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:03.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.305+0000 7f12294e1640 1 -- 172.21.15.88:0/630357472 >> 172.21.15.88:0/630357472 conn(0x7f12240fc010 msgr2=0x7f12240fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:28:03.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.306+0000 7f12294e1640 1 -- 172.21.15.88:0/630357472 shutdown_connections 2024-09-17T04:28:03.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.306+0000 7f12294e1640 1 -- 172.21.15.88:0/630357472 wait complete. 2024-09-17T04:28:03.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.306+0000 7f12294e1640 1 Processor -- start 2024-09-17T04:28:03.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.306+0000 7f12294e1640 1 -- start start 2024-09-17T04:28:03.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.306+0000 7f12294e1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1224100860 0x7f1224197540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:28:03.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.306+0000 7f12294e1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1224101a60 0x7f1224197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:28:03.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.306+0000 7f12294e1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f12241096a0 con 0x7f1224101a60 2024-09-17T04:28:03.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.307+0000 7f12294e1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1224109520 con 0x7f1224100860 2024-09-17T04:28:03.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.307+0000 7f12227fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1224101a60 0x7f1224197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:28:03.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.307+0000 7f12227fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1224101a60 0x7f1224197a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51736/0 (socket says 172.21.15.88:51736) 2024-09-17T04:28:03.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.307+0000 7f12227fc640 1 -- 172.21.15.88:0/418704991 learned_addr learned my addr 172.21.15.88:0/418704991 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:28:03.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.307+0000 7f1222ffd640 1 --2- 172.21.15.88:0/418704991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1224100860 0x7f1224197540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:28:03.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.307+0000 7f12227fc640 1 -- 172.21.15.88:0/418704991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1224100860 msgr2=0x7f1224197540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:03.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.307+0000 7f12227fc640 1 --2- 172.21.15.88:0/418704991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1224100860 0x7f1224197540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:03.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.307+0000 7f12227fc640 1 -- 172.21.15.88:0/418704991 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1224198100 con 0x7f1224101a60 2024-09-17T04:28:03.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.307+0000 7f12227fc640 1 --2- 172.21.15.88:0/418704991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1224101a60 0x7f1224197a80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1218006010 tx=0x7f12180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:28:03.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.307+0000 7f120bfff640 1 -- 172.21.15.88:0/418704991 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f121803f070 con 0x7f1224101a60 2024-09-17T04:28:03.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.307+0000 7f120bfff640 1 -- 172.21.15.88:0/418704991 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1218004ac0 con 0x7f1224101a60 2024-09-17T04:28:03.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.307+0000 7f12294e1640 1 -- 172.21.15.88:0/418704991 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f122419cae0 con 0x7f1224101a60 2024-09-17T04:28:03.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.307+0000 7f120bfff640 1 -- 172.21.15.88:0/418704991 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1218035030 con 0x7f1224101a60 2024-09-17T04:28:03.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.307+0000 7f12294e1640 1 -- 172.21.15.88:0/418704991 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f122419d070 con 0x7f1224101a60 2024-09-17T04:28:03.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.308+0000 7f12294e1640 1 -- 172.21.15.88:0/418704991 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1224100c60 con 0x7f1224101a60 2024-09-17T04:28:03.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.309+0000 7f120bfff640 1 -- 172.21.15.88:0/418704991 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f1218042070 con 0x7f1224101a60 2024-09-17T04:28:03.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.309+0000 7f120bfff640 1 --2- 172.21.15.88:0/418704991 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f120c07af80 0x7f120c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:28:03.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.310+0000 7f120bfff640 1 -- 172.21.15.88:0/418704991 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f12180beb70 con 0x7f1224101a60 2024-09-17T04:28:03.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.310+0000 7f1222ffd640 1 --2- 172.21.15.88:0/418704991 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f120c07af80 0x7f120c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:28:03.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.310+0000 7f1222ffd640 1 --2- 172.21.15.88:0/418704991 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f120c07af80 0x7f120c07d440 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1214005fd0 tx=0x7f121400b390 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:28:03.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.314+0000 7f120bfff640 1 -- 172.21.15.88:0/418704991 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f121808a140 con 0x7f1224101a60 2024-09-17T04:28:03.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.509+0000 7f12294e1640 1 -- 172.21.15.88:0/418704991 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f122406a460 con 0x7f120c07af80 2024-09-17T04:28:03.509 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:03 smithi088 ceph-mon[90867]: from='client.34354 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:28:03.510 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:03 smithi088 ceph-mon[90867]: from='client.34358 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:28:03.510 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:03 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/200594509' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:28:03.510 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:03 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/2745894705' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T04:28:03.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.511+0000 7f120bfff640 1 -- 172.21.15.88:0/418704991 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f122406a460 con 0x7f120c07af80 2024-09-17T04:28:03.510 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-17T04:28:03.510 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f", 2024-09-17T04:28:03.511 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-09-17T04:28:03.511 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T04:28:03.511 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [ 2024-09-17T04:28:03.511 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr", 2024-09-17T04:28:03.511 INFO:teuthology.orchestra.run.smithi088.stdout: "osd", 2024-09-17T04:28:03.511 INFO:teuthology.orchestra.run.smithi088.stdout: "mon", 2024-09-17T04:28:03.511 INFO:teuthology.orchestra.run.smithi088.stdout: "crash" 2024-09-17T04:28:03.511 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-17T04:28:03.511 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "15/23 daemons upgraded", 2024-09-17T04:28:03.511 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading mds daemons", 2024-09-17T04:28:03.511 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-09-17T04:28:03.511 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-17T04:28:03.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.513+0000 7f12294e1640 1 -- 172.21.15.88:0/418704991 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f120c07af80 msgr2=0x7f120c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:03.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.513+0000 7f12294e1640 1 --2- 172.21.15.88:0/418704991 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f120c07af80 0x7f120c07d440 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1214005fd0 tx=0x7f121400b390 comp rx=0 tx=0).stop 2024-09-17T04:28:03.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.513+0000 7f12294e1640 1 -- 172.21.15.88:0/418704991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1224101a60 msgr2=0x7f1224197a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:03.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.513+0000 7f12294e1640 1 --2- 172.21.15.88:0/418704991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1224101a60 0x7f1224197a80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1218006010 tx=0x7f12180046c0 comp rx=0 tx=0).stop 2024-09-17T04:28:03.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.513+0000 7f12294e1640 1 -- 172.21.15.88:0/418704991 shutdown_connections 2024-09-17T04:28:03.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.513+0000 7f12294e1640 1 --2- 172.21.15.88:0/418704991 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f120c07af80 0x7f120c07d440 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:03.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.513+0000 7f12294e1640 1 --2- 172.21.15.88:0/418704991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1224101a60 0x7f1224197a80 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:03.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.513+0000 7f12294e1640 1 --2- 172.21.15.88:0/418704991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1224100860 0x7f1224197540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:03.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.513+0000 7f12294e1640 1 -- 172.21.15.88:0/418704991 >> 172.21.15.88:0/418704991 conn(0x7f12240fc010 msgr2=0x7f1224069d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:28:03.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.513+0000 7f12294e1640 1 -- 172.21.15.88:0/418704991 shutdown_connections 2024-09-17T04:28:03.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.513+0000 7f12294e1640 1 -- 172.21.15.88:0/418704991 wait complete. 2024-09-17T04:28:03.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.598+0000 7fe2fdcfe640 1 -- 172.21.15.88:0/415560054 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2f8100860 msgr2=0x7fe2f8100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:03.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.598+0000 7fe2fdcfe640 1 --2- 172.21.15.88:0/415560054 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2f8100860 0x7fe2f8100c60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8009c20 tx=0x7fe2e802a970 comp rx=0 tx=0).stop 2024-09-17T04:28:03.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.598+0000 7fe2fdcfe640 1 -- 172.21.15.88:0/415560054 shutdown_connections 2024-09-17T04:28:03.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.598+0000 7fe2fdcfe640 1 --2- 172.21.15.88:0/415560054 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2f8101a60 0x7fe2f8101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:03.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.598+0000 7fe2fdcfe640 1 --2- 172.21.15.88:0/415560054 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2f8100860 0x7fe2f8100c60 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:03.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.598+0000 7fe2fdcfe640 1 -- 172.21.15.88:0/415560054 >> 172.21.15.88:0/415560054 conn(0x7fe2f80fc010 msgr2=0x7fe2f80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:28:03.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.598+0000 7fe2fdcfe640 1 -- 172.21.15.88:0/415560054 shutdown_connections 2024-09-17T04:28:03.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.598+0000 7fe2fdcfe640 1 -- 172.21.15.88:0/415560054 wait complete. 2024-09-17T04:28:03.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.599+0000 7fe2fdcfe640 1 Processor -- start 2024-09-17T04:28:03.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.599+0000 7fe2fdcfe640 1 -- start start 2024-09-17T04:28:03.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.599+0000 7fe2fdcfe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2f8100860 0x7fe2f8104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:28:03.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.599+0000 7fe2fdcfe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2f8101a60 0x7fe2f8102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:28:03.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.599+0000 7fe2fdcfe640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f8109680 con 0x7fe2f8101a60 2024-09-17T04:28:03.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.599+0000 7fe2fdcfe640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f8109500 con 0x7fe2f8100860 2024-09-17T04:28:03.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.599+0000 7fe2effff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2f8101a60 0x7fe2f8102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:28:03.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.599+0000 7fe2effff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2f8101a60 0x7fe2f8102e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51742/0 (socket says 172.21.15.88:51742) 2024-09-17T04:28:03.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.599+0000 7fe2effff640 1 -- 172.21.15.88:0/2110643069 learned_addr learned my addr 172.21.15.88:0/2110643069 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:28:03.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.599+0000 7fe2f77fe640 1 --2- 172.21.15.88:0/2110643069 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2f8100860 0x7fe2f8104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:28:03.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.599+0000 7fe2effff640 1 -- 172.21.15.88:0/2110643069 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2f8100860 msgr2=0x7fe2f8104780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:03.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.599+0000 7fe2effff640 1 --2- 172.21.15.88:0/2110643069 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2f8100860 0x7fe2f8104780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:03.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.599+0000 7fe2effff640 1 -- 172.21.15.88:0/2110643069 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2f8103380 con 0x7fe2f8101a60 2024-09-17T04:28:03.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.600+0000 7fe2effff640 1 --2- 172.21.15.88:0/2110643069 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2f8101a60 0x7fe2f8102e40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe2e000e970 tx=0x7fe2e000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:28:03.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.600+0000 7fe2f57fa640 1 -- 172.21.15.88:0/2110643069 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe2e000cac0 con 0x7fe2f8101a60 2024-09-17T04:28:03.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.600+0000 7fe2f57fa640 1 -- 172.21.15.88:0/2110643069 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe2e000cc60 con 0x7fe2f8101a60 2024-09-17T04:28:03.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.600+0000 7fe2fdcfe640 1 -- 172.21.15.88:0/2110643069 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2f8103670 con 0x7fe2f8101a60 2024-09-17T04:28:03.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.600+0000 7fe2f57fa640 1 -- 172.21.15.88:0/2110643069 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe2e0018720 con 0x7fe2f8101a60 2024-09-17T04:28:03.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.600+0000 7fe2fdcfe640 1 -- 172.21.15.88:0/2110643069 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2f8103c80 con 0x7fe2f8101a60 2024-09-17T04:28:03.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.601+0000 7fe2fdcfe640 1 -- 172.21.15.88:0/2110643069 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2f8100c60 con 0x7fe2f8101a60 2024-09-17T04:28:03.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.602+0000 7fe2f57fa640 1 -- 172.21.15.88:0/2110643069 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fe2e0010430 con 0x7fe2f8101a60 2024-09-17T04:28:03.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.602+0000 7fe2f57fa640 1 --2- 172.21.15.88:0/2110643069 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe2e407af30 0x7fe2e407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:28:03.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.602+0000 7fe2f77fe640 1 --2- 172.21.15.88:0/2110643069 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe2e407af30 0x7fe2e407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:28:03.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.603+0000 7fe2f57fa640 1 -- 172.21.15.88:0/2110643069 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fe2e009e740 con 0x7fe2f8101a60 2024-09-17T04:28:03.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.603+0000 7fe2f77fe640 1 --2- 172.21.15.88:0/2110643069 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe2e407af30 0x7fe2e407d3f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8000f80 tx=0x7fe2e802f9f0 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:28:03.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.607+0000 7fe2f57fa640 1 -- 172.21.15.88:0/2110643069 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fe2e0069c90 con 0x7fe2f8101a60 2024-09-17T04:28:03.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:03 smithi134 ceph-mon[76677]: from='client.34354 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:28:03.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:03 smithi134 ceph-mon[76677]: from='client.34358 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:28:03.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:03 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/200594509' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:28:03.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:03 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/2745894705' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T04:28:03.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.849+0000 7fe2fdcfe640 1 -- 172.21.15.88:0/2110643069 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fe2f819fc10 con 0x7fe2f8101a60 2024-09-17T04:28:03.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.849+0000 7fe2f57fa640 1 -- 172.21.15.88:0/2110643069 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+297 (secure 0 0 0) 0x7fe2e006ae20 con 0x7fe2f8101a60 2024-09-17T04:28:03.849 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_WARN 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data 2024-09-17T04:28:03.850 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-17T04:28:03.850 INFO:teuthology.orchestra.run.smithi088.stdout: fs cephfs is degraded 2024-09-17T04:28:03.850 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T04:28:03.850 INFO:teuthology.orchestra.run.smithi088.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T04:28:03.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.852+0000 7fe2fdcfe640 1 -- 172.21.15.88:0/2110643069 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe2e407af30 msgr2=0x7fe2e407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:03.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.852+0000 7fe2fdcfe640 1 --2- 172.21.15.88:0/2110643069 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe2e407af30 0x7fe2e407d3f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8000f80 tx=0x7fe2e802f9f0 comp rx=0 tx=0).stop 2024-09-17T04:28:03.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.852+0000 7fe2fdcfe640 1 -- 172.21.15.88:0/2110643069 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2f8101a60 msgr2=0x7fe2f8102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:03.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.852+0000 7fe2fdcfe640 1 --2- 172.21.15.88:0/2110643069 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2f8101a60 0x7fe2f8102e40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe2e000e970 tx=0x7fe2e000ee30 comp rx=0 tx=0).stop 2024-09-17T04:28:03.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.852+0000 7fe2fdcfe640 1 -- 172.21.15.88:0/2110643069 shutdown_connections 2024-09-17T04:28:03.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.852+0000 7fe2fdcfe640 1 --2- 172.21.15.88:0/2110643069 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe2e407af30 0x7fe2e407d3f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:03.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.852+0000 7fe2fdcfe640 1 --2- 172.21.15.88:0/2110643069 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2f8101a60 0x7fe2f8102e40 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:03.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.852+0000 7fe2fdcfe640 1 --2- 172.21.15.88:0/2110643069 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2f8100860 0x7fe2f8104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:03.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.852+0000 7fe2fdcfe640 1 -- 172.21.15.88:0/2110643069 >> 172.21.15.88:0/2110643069 conn(0x7fe2f80fc010 msgr2=0x7fe2f806a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:28:03.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.852+0000 7fe2fdcfe640 1 -- 172.21.15.88:0/2110643069 shutdown_connections 2024-09-17T04:28:03.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:03.852+0000 7fe2fdcfe640 1 -- 172.21.15.88:0/2110643069 wait complete. 2024-09-17T04:28:04.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:04 smithi088 ceph-mon[90867]: pgmap v214: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 410 KiB/s rd, 4.8 KiB/s wr, 2 op/s 2024-09-17T04:28:04.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:04 smithi088 ceph-mon[90867]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:28:04.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:04 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/2110643069' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T04:28:04.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:04 smithi134 ceph-mon[76677]: pgmap v214: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 410 KiB/s rd, 4.8 KiB/s wr, 2 op/s 2024-09-17T04:28:04.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:04 smithi134 ceph-mon[76677]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:28:04.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:04 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/2110643069' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T04:28:05.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:05 smithi088 ceph-mon[90867]: from='client.34374 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:28:05.645 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:05 smithi134 ceph-mon[76677]: from='client.34374 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:28:06.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:06 smithi088 ceph-mon[90867]: pgmap v215: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 11 MiB/s rd, 3 op/s 2024-09-17T04:28:06.645 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:06 smithi134 ceph-mon[76677]: pgmap v215: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 11 MiB/s rd, 3 op/s 2024-09-17T04:28:08.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:08 smithi134 ceph-mon[76677]: pgmap v216: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 4 op/s 2024-09-17T04:28:08.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:08 smithi088 ceph-mon[90867]: pgmap v216: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 4 op/s 2024-09-17T04:28:10.614 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:10 smithi134 ceph-mon[76677]: pgmap v217: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2024-09-17T04:28:10.614 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:10 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:10.614 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:10 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:10.614 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:10 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:28:10.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:10 smithi088 ceph-mon[90867]: pgmap v217: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2024-09-17T04:28:10.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:10 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:10.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:10 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:10.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:10 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:28:11.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:11 smithi088 ceph-mon[90867]: mds.? [v2:172.21.15.134:6826/3085319848,v1:172.21.15.134:6827/3085319848] up:boot 2024-09-17T04:28:11.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:11 smithi088 ceph-mon[90867]: fsmap cephfs:1/1 {0=cephfs.smithi134.ktuhce=up:replay} 3 up:standby 2024-09-17T04:28:11.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:11 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "mds metadata", "who": "cephfs.smithi134.psnynp"} : dispatch 2024-09-17T04:28:11.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:11 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:11.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:11 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:28:11.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:11 smithi134 ceph-mon[76677]: mds.? [v2:172.21.15.134:6826/3085319848,v1:172.21.15.134:6827/3085319848] up:boot 2024-09-17T04:28:11.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:11 smithi134 ceph-mon[76677]: fsmap cephfs:1/1 {0=cephfs.smithi134.ktuhce=up:replay} 3 up:standby 2024-09-17T04:28:11.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:11 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "mds metadata", "who": "cephfs.smithi134.psnynp"} : dispatch 2024-09-17T04:28:11.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:11 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:11.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:11 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:28:12.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:12 smithi088 ceph-mon[90867]: pgmap v218: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 27 MiB/s rd, 7 op/s 2024-09-17T04:28:12.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:12 smithi088 ceph-mon[90867]: reconnect by client.24347 192.168.0.1:0/981223485 after 0 2024-09-17T04:28:12.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:12 smithi088 ceph-mon[90867]: reconnect by client.14626 192.168.0.1:0/3146504306 after 0 2024-09-17T04:28:12.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:12 smithi088 ceph-mon[90867]: mds.? [v2:172.21.15.134:6824/3452154372,v1:172.21.15.134:6825/3452154372] up:reconnect 2024-09-17T04:28:12.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:12 smithi088 ceph-mon[90867]: fsmap cephfs:1/1 {0=cephfs.smithi134.ktuhce=up:reconnect} 3 up:standby 2024-09-17T04:28:12.645 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:12 smithi134 ceph-mon[76677]: pgmap v218: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 27 MiB/s rd, 7 op/s 2024-09-17T04:28:12.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:12 smithi134 ceph-mon[76677]: reconnect by client.24347 192.168.0.1:0/981223485 after 0 2024-09-17T04:28:12.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:12 smithi134 ceph-mon[76677]: reconnect by client.14626 192.168.0.1:0/3146504306 after 0 2024-09-17T04:28:12.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:12 smithi134 ceph-mon[76677]: mds.? [v2:172.21.15.134:6824/3452154372,v1:172.21.15.134:6825/3452154372] up:reconnect 2024-09-17T04:28:12.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:12 smithi134 ceph-mon[76677]: fsmap cephfs:1/1 {0=cephfs.smithi134.ktuhce=up:reconnect} 3 up:standby 2024-09-17T04:28:13.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:13 smithi088 ceph-mon[90867]: mds.? [v2:172.21.15.134:6824/3452154372,v1:172.21.15.134:6825/3452154372] up:rejoin 2024-09-17T04:28:13.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:13 smithi088 ceph-mon[90867]: fsmap cephfs:1/1 {0=cephfs.smithi134.ktuhce=up:rejoin} 3 up:standby 2024-09-17T04:28:13.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:13 smithi088 ceph-mon[90867]: daemon mds.cephfs.smithi134.ktuhce is now active in filesystem cephfs as rank 0 2024-09-17T04:28:13.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:13 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:13.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:13 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:13.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:13 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:13.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:13 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:13.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:13 smithi134 ceph-mon[76677]: mds.? [v2:172.21.15.134:6824/3452154372,v1:172.21.15.134:6825/3452154372] up:rejoin 2024-09-17T04:28:13.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:13 smithi134 ceph-mon[76677]: fsmap cephfs:1/1 {0=cephfs.smithi134.ktuhce=up:rejoin} 3 up:standby 2024-09-17T04:28:13.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:13 smithi134 ceph-mon[76677]: daemon mds.cephfs.smithi134.ktuhce is now active in filesystem cephfs as rank 0 2024-09-17T04:28:13.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:13 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:13.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:13 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:13.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:13 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:13.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:13 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:14.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:14 smithi088 ceph-mon[90867]: pgmap v219: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 24 MiB/s rd, 7 op/s 2024-09-17T04:28:14.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:14 smithi088 ceph-mon[90867]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-17T04:28:14.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:14 smithi088 ceph-mon[90867]: mds.? [v2:172.21.15.134:6824/3452154372,v1:172.21.15.134:6825/3452154372] up:active 2024-09-17T04:28:14.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:14 smithi088 ceph-mon[90867]: fsmap cephfs:1 {0=cephfs.smithi134.ktuhce=up:active} 3 up:standby 2024-09-17T04:28:14.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:14 smithi134 ceph-mon[76677]: pgmap v219: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 24 MiB/s rd, 7 op/s 2024-09-17T04:28:14.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:14 smithi134 ceph-mon[76677]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-17T04:28:14.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:14 smithi134 ceph-mon[76677]: mds.? [v2:172.21.15.134:6824/3452154372,v1:172.21.15.134:6825/3452154372] up:active 2024-09-17T04:28:14.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:14 smithi134 ceph-mon[76677]: fsmap cephfs:1 {0=cephfs.smithi134.ktuhce=up:active} 3 up:standby 2024-09-17T04:28:16.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:16 smithi134 ceph-mon[76677]: pgmap v220: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 170 B/s wr, 8 op/s 2024-09-17T04:28:16.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:16 smithi088 ceph-mon[90867]: pgmap v220: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 170 B/s wr, 8 op/s 2024-09-17T04:28:17.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:17 smithi088 ceph-mon[90867]: pgmap v221: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 170 B/s wr, 6 op/s 2024-09-17T04:28:17.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:17 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:17.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:17 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:17.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:17 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:28:17.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:17 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:28:17.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:17 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:17.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:17 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:28:17.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:17 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:28:17.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:17 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:28:17.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:17 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:28:17.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:17 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:28:17.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:17 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:28:17.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:17 smithi088 ceph-mon[90867]: Upgrade: Setting container_image for all mds 2024-09-17T04:28:17.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:17 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:17.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:17 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi088.giqrgt"} : dispatch 2024-09-17T04:28:17.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:17 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi088.giqrgt"}]': finished 2024-09-17T04:28:17.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:17 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi088.lgavsv"} : dispatch 2024-09-17T04:28:17.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:17 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi088.lgavsv"}]': finished 2024-09-17T04:28:17.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:17 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi134.ktuhce"} : dispatch 2024-09-17T04:28:17.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:17 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi134.ktuhce"}]': finished 2024-09-17T04:28:17.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:17 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi134.psnynp"} : dispatch 2024-09-17T04:28:17.890 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:17 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi134.psnynp"}]': finished 2024-09-17T04:28:17.890 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:17 smithi088 ceph-mon[90867]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-09-17T04:28:17.890 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:17 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"} : dispatch 2024-09-17T04:28:17.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:17 smithi134 ceph-mon[76677]: pgmap v221: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 170 B/s wr, 6 op/s 2024-09-17T04:28:17.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:17 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:17.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:17 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:17.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:17 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:28:17.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:17 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:28:17.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:17 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:17.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:17 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:28:17.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:17 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:28:17.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:17 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:28:17.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:17 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:28:17.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:17 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:28:17.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:17 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:28:17.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:17 smithi134 ceph-mon[76677]: Upgrade: Setting container_image for all mds 2024-09-17T04:28:17.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:17 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:17.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:17 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi088.giqrgt"} : dispatch 2024-09-17T04:28:17.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:17 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi088.giqrgt"}]': finished 2024-09-17T04:28:17.898 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:17 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi088.lgavsv"} : dispatch 2024-09-17T04:28:17.898 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:17 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi088.lgavsv"}]': finished 2024-09-17T04:28:17.898 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:17 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi134.ktuhce"} : dispatch 2024-09-17T04:28:17.898 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:17 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi134.ktuhce"}]': finished 2024-09-17T04:28:17.898 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:17 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi134.psnynp"} : dispatch 2024-09-17T04:28:17.898 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:17 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi134.psnynp"}]': finished 2024-09-17T04:28:17.898 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:17 smithi134 ceph-mon[76677]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-09-17T04:28:17.898 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:17 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"} : dispatch 2024-09-17T04:28:18.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:18 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-09-17T04:28:18.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:18 smithi088 ceph-mon[90867]: fsmap cephfs:1 {0=cephfs.smithi134.ktuhce=up:active} 3 up:standby 2024-09-17T04:28:18.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:18 smithi088 ceph-mon[90867]: fsmap cephfs:1 {0=cephfs.smithi134.ktuhce=up:active} 1 up:standby-replay 2 up:standby 2024-09-17T04:28:18.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:18 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:18.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:18 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:28:18.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:18 smithi088 ceph-mon[90867]: Upgrade: Setting container_image for all rgw 2024-09-17T04:28:18.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:18 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:18.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:18 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:28:18.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:18 smithi088 ceph-mon[90867]: Upgrade: Setting container_image for all rbd-mirror 2024-09-17T04:28:18.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:18 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:18.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:18 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:28:18.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:18 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-09-17T04:28:18.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:18 smithi134 ceph-mon[76677]: fsmap cephfs:1 {0=cephfs.smithi134.ktuhce=up:active} 3 up:standby 2024-09-17T04:28:18.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:18 smithi134 ceph-mon[76677]: fsmap cephfs:1 {0=cephfs.smithi134.ktuhce=up:active} 1 up:standby-replay 2 up:standby 2024-09-17T04:28:18.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:18 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:18.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:18 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:28:18.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:18 smithi134 ceph-mon[76677]: Upgrade: Setting container_image for all rgw 2024-09-17T04:28:18.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:18 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:18.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:18 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:28:18.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:18 smithi134 ceph-mon[76677]: Upgrade: Setting container_image for all rbd-mirror 2024-09-17T04:28:18.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:18 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:18.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:18 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:28:20.666 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:20 smithi088 ceph-mon[90867]: pgmap v222: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 11 MiB/s rd, 170 B/s wr, 6 op/s 2024-09-17T04:28:20.666 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:20 smithi088 ceph-mon[90867]: Upgrade: Updating ceph-exporter.smithi088 (1/2) 2024-09-17T04:28:20.666 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:20 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:20.666 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:20 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi088", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-17T04:28:20.666 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:20 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:28:20.666 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:20 smithi088 ceph-mon[90867]: Deploying daemon ceph-exporter.smithi088 on smithi088 2024-09-17T04:28:20.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:20 smithi134 ceph-mon[76677]: pgmap v222: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 11 MiB/s rd, 170 B/s wr, 6 op/s 2024-09-17T04:28:20.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:20 smithi134 ceph-mon[76677]: Upgrade: Updating ceph-exporter.smithi088 (1/2) 2024-09-17T04:28:20.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:20 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:20.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:20 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi088", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-17T04:28:20.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:20 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:28:20.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:20 smithi134 ceph-mon[76677]: Deploying daemon ceph-exporter.smithi088 on smithi088 2024-09-17T04:28:22.596 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:22 smithi088 ceph-mon[90867]: pgmap v223: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-09-17T04:28:22.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:22 smithi134 ceph-mon[76677]: pgmap v223: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-09-17T04:28:24.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:23 smithi088 ceph-mon[90867]: pgmap v224: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8.9 MiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-09-17T04:28:24.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:23 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:24.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:23 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:24.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:23 smithi134 ceph-mon[76677]: pgmap v224: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8.9 MiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-09-17T04:28:24.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:23 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:24.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:23 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:25.837 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:25 smithi134 ceph-mon[76677]: Upgrade: Updating ceph-exporter.smithi134 (2/2) 2024-09-17T04:28:25.837 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:25 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:25.837 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:25 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi134", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-17T04:28:25.837 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:25 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:28:25.837 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:25 smithi134 ceph-mon[76677]: Deploying daemon ceph-exporter.smithi134 on smithi134 2024-09-17T04:28:25.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:25 smithi088 ceph-mon[90867]: Upgrade: Updating ceph-exporter.smithi134 (2/2) 2024-09-17T04:28:25.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:25 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:25.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:25 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi134", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-17T04:28:25.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:25 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:28:25.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:25 smithi088 ceph-mon[90867]: Deploying daemon ceph-exporter.smithi134 on smithi134 2024-09-17T04:28:26.751 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:26 smithi134 ceph-mon[76677]: pgmap v225: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-09-17T04:28:26.751 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:26 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:26.751 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:26 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:28:26.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:26 smithi088 ceph-mon[90867]: pgmap v225: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-09-17T04:28:26.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:26 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:26.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:26 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:28:28.785 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:28 smithi134 ceph-mon[76677]: pgmap v226: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 4.0 KiB/s wr, 9 op/s 2024-09-17T04:28:28.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:28 smithi088 ceph-mon[90867]: pgmap v226: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 4.0 KiB/s wr, 9 op/s 2024-09-17T04:28:30.713 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:30 smithi134 ceph-mon[76677]: pgmap v227: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 4.0 KiB/s wr, 8 op/s 2024-09-17T04:28:30.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:30 smithi088 ceph-mon[90867]: pgmap v227: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 4.0 KiB/s wr, 8 op/s 2024-09-17T04:28:32.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:32 smithi088 ceph-mon[90867]: pgmap v228: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 4.0 KiB/s wr, 8 op/s 2024-09-17T04:28:32.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:32 smithi134 ceph-mon[76677]: pgmap v228: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 4.0 KiB/s wr, 8 op/s 2024-09-17T04:28:33.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:33.946+0000 7f9dbcb85640 1 -- 172.21.15.88:0/3199154897 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9db8100860 msgr2=0x7f9db8100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:33.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:33.946+0000 7f9dbcb85640 1 --2- 172.21.15.88:0/3199154897 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9db8100860 0x7f9db8100c60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9da8009880 tx=0x7f9da802a4a0 comp rx=0 tx=0).stop 2024-09-17T04:28:33.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:33.946+0000 7f9dbcb85640 1 -- 172.21.15.88:0/3199154897 shutdown_connections 2024-09-17T04:28:33.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:33.946+0000 7f9dbcb85640 1 --2- 172.21.15.88:0/3199154897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9db8101a60 0x7f9db8101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:33.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:33.946+0000 7f9dbcb85640 1 --2- 172.21.15.88:0/3199154897 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9db8100860 0x7f9db8100c60 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:33.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:33.946+0000 7f9dbcb85640 1 -- 172.21.15.88:0/3199154897 >> 172.21.15.88:0/3199154897 conn(0x7f9db80fc010 msgr2=0x7f9db80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:28:33.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:33.946+0000 7f9dbcb85640 1 -- 172.21.15.88:0/3199154897 shutdown_connections 2024-09-17T04:28:33.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:33.947+0000 7f9dbcb85640 1 -- 172.21.15.88:0/3199154897 wait complete. 2024-09-17T04:28:33.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:33.947+0000 7f9dbcb85640 1 Processor -- start 2024-09-17T04:28:33.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:33.947+0000 7f9dbcb85640 1 -- start start 2024-09-17T04:28:33.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:33.948+0000 7f9dbcb85640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9db8100860 0x7f9db81963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:28:33.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:33.948+0000 7f9dbcb85640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9db8101a60 0x7f9db8196910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:28:33.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:33.948+0000 7f9dbcb85640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f9db81096a0 con 0x7f9db8100860 2024-09-17T04:28:33.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:33.948+0000 7f9dbcb85640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9db8109520 con 0x7f9db8101a60 2024-09-17T04:28:33.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:33.948+0000 7f9db659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9db8100860 0x7f9db81963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:28:33.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:33.948+0000 7f9db659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9db8100860 0x7f9db81963d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38594/0 (socket says 172.21.15.88:38594) 2024-09-17T04:28:33.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:33.948+0000 7f9db659c640 1 -- 172.21.15.88:0/832890358 learned_addr learned my addr 172.21.15.88:0/832890358 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:28:33.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:33.948+0000 7f9db5d9b640 1 --2- 172.21.15.88:0/832890358 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9db8101a60 0x7f9db8196910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:28:33.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:33.948+0000 7f9db659c640 1 -- 172.21.15.88:0/832890358 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9db8101a60 msgr2=0x7f9db8196910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:33.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:33.948+0000 7f9db659c640 1 --2- 172.21.15.88:0/832890358 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9db8101a60 0x7f9db8196910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:33.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:33.948+0000 7f9db659c640 1 -- 172.21.15.88:0/832890358 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9db8196f90 con 0x7f9db8100860 2024-09-17T04:28:33.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:33.948+0000 7f9db659c640 1 --2- 172.21.15.88:0/832890358 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9db8100860 0x7f9db81963d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9da8006010 tx=0x7f9da80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:28:33.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:33.949+0000 7f9da77fe640 1 -- 172.21.15.88:0/832890358 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9da803f070 con 0x7f9db8100860 2024-09-17T04:28:33.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:33.949+0000 7f9dbcb85640 1 -- 172.21.15.88:0/832890358 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9db819b970 con 0x7f9db8100860 2024-09-17T04:28:33.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:33.949+0000 7f9da77fe640 1 -- 172.21.15.88:0/832890358 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9da80049d0 con 0x7f9db8100860 2024-09-17T04:28:33.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:33.949+0000 7f9dbcb85640 1 -- 172.21.15.88:0/832890358 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9db819bf00 con 0x7f9db8100860 2024-09-17T04:28:33.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:33.949+0000 7f9da77fe640 1 -- 172.21.15.88:0/832890358 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9da8049060 con 0x7f9db8100860 2024-09-17T04:28:33.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:33.950+0000 7f9dbcb85640 1 -- 172.21.15.88:0/832890358 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9db8100c60 con 0x7f9db8100860 2024-09-17T04:28:33.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:33.951+0000 7f9da77fe640 1 -- 172.21.15.88:0/832890358 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f9da8042070 con 0x7f9db8100860 2024-09-17T04:28:33.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:33.951+0000 7f9da77fe640 1 --2- 172.21.15.88:0/832890358 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f9da007af30 0x7f9da007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:28:33.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:33.951+0000 7f9da77fe640 1 -- 172.21.15.88:0/832890358 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f9da80becf0 con 0x7f9db8100860 2024-09-17T04:28:33.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:33.951+0000 7f9db5d9b640 1 --2- 172.21.15.88:0/832890358 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f9da007af30 0x7f9da007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:28:33.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:33.952+0000 7f9db5d9b640 1 --2- 172.21.15.88:0/832890358 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f9da007af30 0x7f9da007d3f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9db8197880 tx=0x7f9dac005f90 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:28:33.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:33.956+0000 7f9da77fe640 1 -- 172.21.15.88:0/832890358 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f9da808a240 con 0x7f9db8100860 2024-09-17T04:28:34.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.157+0000 7f9dbcb85640 1 -- 172.21.15.88:0/832890358 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9db8062630 con 0x7f9da007af30 2024-09-17T04:28:34.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.159+0000 7f9da77fe640 1 -- 172.21.15.88:0/832890358 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+441 (secure 0 0 0) 0x7f9db8062630 con 0x7f9da007af30 2024-09-17T04:28:34.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.161+0000 7f9dbcb85640 1 -- 172.21.15.88:0/832890358 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f9da007af30 msgr2=0x7f9da007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:34.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.161+0000 7f9dbcb85640 1 --2- 172.21.15.88:0/832890358 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f9da007af30 0x7f9da007d3f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9db8197880 tx=0x7f9dac005f90 comp rx=0 tx=0).stop 2024-09-17T04:28:34.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.161+0000 7f9dbcb85640 1 -- 172.21.15.88:0/832890358 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9db8100860 msgr2=0x7f9db81963d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:34.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.161+0000 7f9dbcb85640 1 --2- 172.21.15.88:0/832890358 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9db8100860 0x7f9db81963d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9da8006010 tx=0x7f9da80045e0 comp rx=0 tx=0).stop 2024-09-17T04:28:34.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.161+0000 7f9dbcb85640 1 -- 172.21.15.88:0/832890358 shutdown_connections 2024-09-17T04:28:34.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.161+0000 7f9dbcb85640 1 --2- 172.21.15.88:0/832890358 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f9da007af30 0x7f9da007d3f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:34.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.161+0000 7f9dbcb85640 1 --2- 172.21.15.88:0/832890358 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9db8101a60 0x7f9db8196910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:34.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.161+0000 7f9dbcb85640 1 --2- 172.21.15.88:0/832890358 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9db8100860 0x7f9db81963d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:34.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.161+0000 7f9dbcb85640 1 -- 172.21.15.88:0/832890358 >> 172.21.15.88:0/832890358 conn(0x7f9db80fc010 msgr2=0x7f9db8104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:28:34.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.161+0000 7f9dbcb85640 1 -- 172.21.15.88:0/832890358 shutdown_connections 2024-09-17T04:28:34.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.161+0000 7f9dbcb85640 1 -- 172.21.15.88:0/832890358 wait complete. 2024-09-17T04:28:34.171 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-09-17T04:28:34.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.255+0000 7f07c9bd7640 1 -- 172.21.15.88:0/2199118397 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07c4104d80 msgr2=0x7f07c4107170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:34.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.255+0000 7f07c9bd7640 1 --2- 172.21.15.88:0/2199118397 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07c4104d80 0x7f07c4107170 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f07b8009880 tx=0x7f07b802a4a0 comp rx=0 tx=0).stop 2024-09-17T04:28:34.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.255+0000 7f07c9bd7640 1 -- 172.21.15.88:0/2199118397 shutdown_connections 2024-09-17T04:28:34.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.255+0000 7f07c9bd7640 1 --2- 172.21.15.88:0/2199118397 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07c4104d80 0x7f07c4107170 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:34.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.255+0000 7f07c9bd7640 1 --2- 172.21.15.88:0/2199118397 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07c4102450 0x7f07c4104840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:34.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.255+0000 7f07c9bd7640 1 -- 172.21.15.88:0/2199118397 >> 172.21.15.88:0/2199118397 conn(0x7f07c40fc010 msgr2=0x7f07c40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:28:34.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.255+0000 7f07c9bd7640 1 -- 172.21.15.88:0/2199118397 shutdown_connections 2024-09-17T04:28:34.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.255+0000 7f07c9bd7640 1 -- 172.21.15.88:0/2199118397 wait complete. 2024-09-17T04:28:34.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.256+0000 7f07c9bd7640 1 Processor -- start 2024-09-17T04:28:34.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.256+0000 7f07c9bd7640 1 -- start start 2024-09-17T04:28:34.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.256+0000 7f07c9bd7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07c4102450 0x7f07c4101d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:28:34.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.256+0000 7f07c9bd7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07c4104d80 0x7f07c4100400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:28:34.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.256+0000 7f07c9bd7640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f07c410a740 con 0x7f07c4102450 2024-09-17T04:28:34.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.256+0000 7f07c9bd7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f07c410a5c0 con 0x7f07c4104d80 2024-09-17T04:28:34.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.256+0000 7f07c37fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07c4102450 0x7f07c4101d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:28:34.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.256+0000 7f07c37fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07c4102450 0x7f07c4101d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38608/0 (socket says 172.21.15.88:38608) 2024-09-17T04:28:34.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.256+0000 7f07c37fe640 1 -- 172.21.15.88:0/540153124 learned_addr learned my addr 172.21.15.88:0/540153124 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:28:34.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.256+0000 7f07c2ffd640 1 --2- 172.21.15.88:0/540153124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07c4104d80 0x7f07c4100400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:28:34.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.257+0000 7f07c37fe640 1 -- 172.21.15.88:0/540153124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07c4104d80 msgr2=0x7f07c4100400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:34.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.257+0000 7f07c37fe640 1 --2- 172.21.15.88:0/540153124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07c4104d80 0x7f07c4100400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:34.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.257+0000 7f07c37fe640 1 -- 172.21.15.88:0/540153124 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07c4100940 con 0x7f07c4102450 2024-09-17T04:28:34.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.257+0000 7f07c37fe640 1 --2- 172.21.15.88:0/540153124 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07c4102450 0x7f07c4101d40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f07b400d6f0 tx=0x7f07b400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:28:34.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.257+0000 7f07c0ff9640 1 -- 172.21.15.88:0/540153124 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f07b4017070 con 0x7f07c4102450 2024-09-17T04:28:34.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.257+0000 7f07c0ff9640 1 -- 172.21.15.88:0/540153124 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f07b400de00 con 0x7f07c4102450 2024-09-17T04:28:34.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.257+0000 7f07c9bd7640 1 -- 172.21.15.88:0/540153124 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07c4100c30 con 0x7f07c4102450 2024-09-17T04:28:34.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.258+0000 7f07c0ff9640 1 -- 172.21.15.88:0/540153124 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f07b4004bb0 con 0x7f07c4102450 2024-09-17T04:28:34.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.258+0000 7f07c9bd7640 1 -- 172.21.15.88:0/540153124 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07c4101190 con 0x7f07c4102450 2024-09-17T04:28:34.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.259+0000 7f07c9bd7640 1 -- 172.21.15.88:0/540153124 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07c4102830 con 0x7f07c4102450 2024-09-17T04:28:34.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.259+0000 7f07c0ff9640 1 -- 172.21.15.88:0/540153124 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f07b4009a30 con 0x7f07c4102450 2024-09-17T04:28:34.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.260+0000 7f07c0ff9640 1 --2- 172.21.15.88:0/540153124 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f07ac07af30 0x7f07ac07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:28:34.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.260+0000 7f07c0ff9640 1 -- 172.21.15.88:0/540153124 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f07b409dc60 con 0x7f07c4102450 2024-09-17T04:28:34.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.260+0000 7f07c2ffd640 1 --2- 172.21.15.88:0/540153124 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f07ac07af30 0x7f07ac07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:28:34.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.261+0000 7f07c2ffd640 1 --2- 172.21.15.88:0/540153124 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f07ac07af30 0x7f07ac07d3f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f07b8009230 tx=0x7f07b80058d0 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:28:34.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.266+0000 7f07c0ff9640 1 -- 172.21.15.88:0/540153124 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f07b40691b0 con 0x7f07c4102450 2024-09-17T04:28:34.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.489+0000 7f07c9bd7640 1 -- 172.21.15.88:0/540153124 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f07c4105700 con 0x7f07ac07af30 2024-09-17T04:28:34.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.490+0000 7f07c0ff9640 1 -- 172.21.15.88:0/540153124 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+441 (secure 0 0 0) 0x7f07c4105700 con 0x7f07ac07af30 2024-09-17T04:28:34.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.493+0000 7f07c9bd7640 1 -- 172.21.15.88:0/540153124 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f07ac07af30 msgr2=0x7f07ac07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:34.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.493+0000 7f07c9bd7640 1 --2- 172.21.15.88:0/540153124 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f07ac07af30 0x7f07ac07d3f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f07b8009230 tx=0x7f07b80058d0 comp rx=0 tx=0).stop 2024-09-17T04:28:34.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.493+0000 7f07c9bd7640 1 -- 172.21.15.88:0/540153124 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07c4102450 msgr2=0x7f07c4101d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:34.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.493+0000 7f07c9bd7640 1 --2- 172.21.15.88:0/540153124 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07c4102450 0x7f07c4101d40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f07b400d6f0 tx=0x7f07b400dbb0 comp rx=0 tx=0).stop 2024-09-17T04:28:34.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.493+0000 7f07c9bd7640 1 -- 172.21.15.88:0/540153124 shutdown_connections 2024-09-17T04:28:34.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.493+0000 7f07c9bd7640 1 --2- 172.21.15.88:0/540153124 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f07ac07af30 0x7f07ac07d3f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:34.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.493+0000 7f07c9bd7640 1 --2- 172.21.15.88:0/540153124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07c4104d80 0x7f07c4100400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:34.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.493+0000 7f07c9bd7640 1 --2- 172.21.15.88:0/540153124 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07c4102450 0x7f07c4101d40 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:34.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.493+0000 7f07c9bd7640 1 -- 172.21.15.88:0/540153124 >> 172.21.15.88:0/540153124 conn(0x7f07c40fc010 msgr2=0x7f07c40fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:28:34.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.493+0000 7f07c9bd7640 1 -- 172.21.15.88:0/540153124 shutdown_connections 2024-09-17T04:28:34.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.493+0000 7f07c9bd7640 1 -- 172.21.15.88:0/540153124 wait complete. 2024-09-17T04:28:34.537 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:34 smithi134 ceph-mon[76677]: pgmap v229: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 3 op/s 2024-09-17T04:28:34.537 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:34 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:34.537 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:34 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:34.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.577+0000 7fa467869640 1 -- 172.21.15.88:0/1077459522 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa460102b50 msgr2=0x7fa460104fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:34.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.577+0000 7fa467869640 1 --2- 172.21.15.88:0/1077459522 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa460102b50 0x7fa460104fc0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa450009880 tx=0x7fa45002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:28:34.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.577+0000 7fa467869640 1 -- 172.21.15.88:0/1077459522 shutdown_connections 2024-09-17T04:28:34.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.577+0000 7fa467869640 1 --2- 172.21.15.88:0/1077459522 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa460102b50 0x7fa460104fc0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:34.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.577+0000 7fa467869640 1 --2- 172.21.15.88:0/1077459522 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa460100200 0x7fa460102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:34.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.577+0000 7fa467869640 1 -- 172.21.15.88:0/1077459522 >> 172.21.15.88:0/1077459522 conn(0x7fa4600fc010 msgr2=0x7fa4600fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:28:34.579 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:34 smithi088 ceph-mon[90867]: pgmap v229: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 3 op/s 2024-09-17T04:28:34.579 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:34 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:34.579 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:34 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:34.579 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:34 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:28:34.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.577+0000 7fa467869640 1 -- 172.21.15.88:0/1077459522 shutdown_connections 2024-09-17T04:28:34.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.577+0000 7fa467869640 1 -- 172.21.15.88:0/1077459522 wait complete. 2024-09-17T04:28:34.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.578+0000 7fa467869640 1 Processor -- start 2024-09-17T04:28:34.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.578+0000 7fa467869640 1 -- start start 2024-09-17T04:28:34.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.578+0000 7fa467869640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa460100200 0x7fa46019daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:28:34.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.578+0000 7fa467869640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa460102b50 0x7fa46019dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:28:34.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.578+0000 7fa467869640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa460110db0 con 0x7fa460102b50 2024-09-17T04:28:34.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.578+0000 7fa467869640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa460110c30 con 0x7fa460100200 2024-09-17T04:28:34.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.578+0000 7fa464e04640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa460102b50 0x7fa46019dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:28:34.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.578+0000 7fa464e04640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa460102b50 0x7fa46019dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38630/0 (socket says 172.21.15.88:38630) 2024-09-17T04:28:34.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.578+0000 7fa464e04640 1 -- 172.21.15.88:0/3686935803 learned_addr learned my addr 172.21.15.88:0/3686935803 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:28:34.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.578+0000 7fa465605640 1 --2- 172.21.15.88:0/3686935803 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa460100200 0x7fa46019daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:28:34.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.579+0000 7fa464e04640 1 -- 172.21.15.88:0/3686935803 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa460100200 msgr2=0x7fa46019daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:34.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.579+0000 7fa464e04640 1 --2- 172.21.15.88:0/3686935803 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa460100200 0x7fa46019daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:34.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.579+0000 7fa464e04640 1 -- 172.21.15.88:0/3686935803 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa46019e660 con 0x7fa460102b50 2024-09-17T04:28:34.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.579+0000 7fa464e04640 1 --2- 172.21.15.88:0/3686935803 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa460102b50 0x7fa46019dfe0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa450006010 tx=0x7fa4500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:28:34.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.579+0000 7fa4567fc640 1 -- 172.21.15.88:0/3686935803 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa45003f070 con 0x7fa460102b50 2024-09-17T04:28:34.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.579+0000 7fa4567fc640 1 -- 172.21.15.88:0/3686935803 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa450004ac0 con 0x7fa460102b50 2024-09-17T04:28:34.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.579+0000 7fa467869640 1 -- 172.21.15.88:0/3686935803 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4601a3040 con 0x7fa460102b50 2024-09-17T04:28:34.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.579+0000 7fa4567fc640 1 -- 172.21.15.88:0/3686935803 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa450035030 con 0x7fa460102b50 2024-09-17T04:28:34.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.579+0000 7fa467869640 1 -- 172.21.15.88:0/3686935803 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4601a35d0 con 0x7fa460102b50 2024-09-17T04:28:34.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.581+0000 7fa467869640 1 -- 172.21.15.88:0/3686935803 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa460100600 con 0x7fa460102b50 2024-09-17T04:28:34.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.581+0000 7fa4567fc640 1 -- 172.21.15.88:0/3686935803 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fa450042070 con 0x7fa460102b50 2024-09-17T04:28:34.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.582+0000 7fa4567fc640 1 --2- 172.21.15.88:0/3686935803 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fa44c07af30 0x7fa44c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:28:34.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.582+0000 7fa4567fc640 1 -- 172.21.15.88:0/3686935803 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fa4500bed20 con 0x7fa460102b50 2024-09-17T04:28:34.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.582+0000 7fa465605640 1 --2- 172.21.15.88:0/3686935803 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fa44c07af30 0x7fa44c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:28:34.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.583+0000 7fa465605640 1 --2- 172.21.15.88:0/3686935803 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fa44c07af30 0x7fa44c07d3f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa45c005fd0 tx=0x7fa45c005850 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:28:34.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.589+0000 7fa4567fc640 1 -- 172.21.15.88:0/3686935803 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fa45008a270 con 0x7fa460102b50 2024-09-17T04:28:34.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.780+0000 7fa467869640 1 -- 172.21.15.88:0/3686935803 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fa460103510 con 0x7fa44c07af30 2024-09-17T04:28:34.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.790+0000 7fa4567fc640 1 -- 172.21.15.88:0/3686935803 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7fa460103510 con 0x7fa44c07af30 2024-09-17T04:28:34.791 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T04:28:34.791 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (14m) 64s ago 15m 25.5M - 0.25.0 c8568f914cd2 f2dbac7e939f 2024-09-17T04:28:34.791 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi088 smithi088 starting - - - - 2024-09-17T04:28:34.791 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi134 smithi134 starting - - - - 2024-09-17T04:28:34.791 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (5m) 64s ago 15m 6891k - 19.3.0-4989-gce1b342b 8e039cb7fe1e 10355648c406 2024-09-17T04:28:34.791 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi134 smithi134 running (5m) 22s ago 15m 6899k - 19.3.0-4989-gce1b342b 8e039cb7fe1e d709085ffe5d 2024-09-17T04:28:34.791 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (13m) 64s ago 15m 77.6M - 9.4.12 2bacad6d85d8 a6cff57a23f9 2024-09-17T04:28:34.791 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.giqrgt smithi088 running (70s) 64s ago 10m 81.6M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 3bb1d05b4476 2024-09-17T04:28:34.791 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.lgavsv smithi088 running (92s) 64s ago 10m 83.5M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 6fb9ba0a8ec3 2024-09-17T04:28:34.791 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi134.ktuhce smithi134 running (44s) 22s ago 10m 198M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 851c1f3a855a 2024-09-17T04:28:34.791 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi134.psnynp smithi134 running (25s) 22s ago 10m 79.1M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 966e092b224e 2024-09-17T04:28:34.792 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.wmndiv smithi088 *:8443,9283,8765 running (6m) 64s ago 16m 588M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 49eb47f7f14f 2024-09-17T04:28:34.792 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi134.vwdxcb smithi134 *:8443,9283,8765 running (5m) 22s ago 14m 522M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 8a6d45eb0595 2024-09-17T04:28:34.792 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (5m) 64s ago 17m 117M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e ac6332015243 2024-09-17T04:28:34.792 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi134 smithi134 running (5m) 22s ago 14m 105M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e ea49f690e26b 2024-09-17T04:28:34.792 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (15m) 64s ago 15m 16.1M - 1.5.0 0da6a335fe13 9ba03800993b 2024-09-17T04:28:34.792 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi134 smithi134 *:9100 running (14m) 22s ago 14m 17.5M - 1.5.0 0da6a335fe13 6deac483827f 2024-09-17T04:28:34.792 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (4m) 64s ago 13m 163M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 4ef267302248 2024-09-17T04:28:34.792 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (4m) 64s ago 13m 165M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 17b67c13c7aa 2024-09-17T04:28:34.792 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (3m) 64s ago 12m 153M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 83d38ad792c9 2024-09-17T04:28:34.792 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi134 running (2m) 22s ago 12m 170M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e 336a363ac39f 2024-09-17T04:28:34.792 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi134 running (2m) 22s ago 11m 160M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e 6df8a692310a 2024-09-17T04:28:34.792 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi134 running (109s) 22s ago 11m 155M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e 5066799816d3 2024-09-17T04:28:34.792 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (5m) 64s ago 15m 71.3M - 2.43.0 a07b618ecd1d b51d7899d341 2024-09-17T04:28:34.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.792+0000 7fa467869640 1 -- 172.21.15.88:0/3686935803 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fa44c07af30 msgr2=0x7fa44c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:34.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.792+0000 7fa467869640 1 --2- 172.21.15.88:0/3686935803 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fa44c07af30 0x7fa44c07d3f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa45c005fd0 tx=0x7fa45c005850 comp rx=0 tx=0).stop 2024-09-17T04:28:34.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.792+0000 7fa467869640 1 -- 172.21.15.88:0/3686935803 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa460102b50 msgr2=0x7fa46019dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:34.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.792+0000 7fa467869640 1 --2- 172.21.15.88:0/3686935803 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa460102b50 0x7fa46019dfe0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa450006010 tx=0x7fa4500046c0 comp rx=0 tx=0).stop 2024-09-17T04:28:34.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.792+0000 7fa467869640 1 -- 172.21.15.88:0/3686935803 shutdown_connections 2024-09-17T04:28:34.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.792+0000 7fa467869640 1 --2- 172.21.15.88:0/3686935803 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fa44c07af30 0x7fa44c07d3f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:34.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.792+0000 7fa467869640 1 --2- 172.21.15.88:0/3686935803 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa460102b50 0x7fa46019dfe0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:34.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.792+0000 7fa467869640 1 --2- 172.21.15.88:0/3686935803 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa460100200 0x7fa46019daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:34.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.792+0000 7fa467869640 1 -- 172.21.15.88:0/3686935803 >> 172.21.15.88:0/3686935803 conn(0x7fa4600fc010 msgr2=0x7fa4600fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:28:34.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.792+0000 7fa467869640 1 -- 172.21.15.88:0/3686935803 shutdown_connections 2024-09-17T04:28:34.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.792+0000 7fa467869640 1 -- 172.21.15.88:0/3686935803 wait complete. 2024-09-17T04:28:34.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.872+0000 7efcb24bd640 1 -- 172.21.15.88:0/1683349413 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcac101a60 msgr2=0x7efcac101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:34.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.872+0000 7efcb24bd640 1 --2- 172.21.15.88:0/1683349413 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcac101a60 0x7efcac101ee0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7efc94009880 tx=0x7efc9402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:28:34.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.873+0000 7efcb24bd640 1 -- 172.21.15.88:0/1683349413 shutdown_connections 2024-09-17T04:28:34.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.873+0000 7efcb24bd640 1 --2- 172.21.15.88:0/1683349413 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcac101a60 0x7efcac101ee0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:34.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.873+0000 7efcb24bd640 1 --2- 172.21.15.88:0/1683349413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efcac100860 0x7efcac100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:34.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.873+0000 7efcb24bd640 1 -- 172.21.15.88:0/1683349413 >> 172.21.15.88:0/1683349413 conn(0x7efcac0fc010 msgr2=0x7efcac0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:28:34.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.873+0000 7efcb24bd640 1 -- 172.21.15.88:0/1683349413 shutdown_connections 2024-09-17T04:28:34.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.873+0000 7efcb24bd640 1 -- 172.21.15.88:0/1683349413 wait complete. 2024-09-17T04:28:34.879 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.874+0000 7efcb24bd640 1 Processor -- start 2024-09-17T04:28:34.879 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.874+0000 7efcb24bd640 1 -- start start 2024-09-17T04:28:34.879 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.874+0000 7efcb24bd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcac100860 0x7efcac06aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:28:34.879 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.874+0000 7efcb24bd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efcac101a60 0x7efcac19c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:28:34.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.874+0000 7efcb24bd640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7efcac1096a0 con 0x7efcac100860 2024-09-17T04:28:34.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.874+0000 7efcb24bd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7efcac109520 con 0x7efcac101a60 2024-09-17T04:28:34.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.874+0000 7efcabfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcac100860 0x7efcac06aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:28:34.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.874+0000 7efcabfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcac100860 0x7efcac06aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38648/0 (socket says 172.21.15.88:38648) 2024-09-17T04:28:34.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.874+0000 7efcabfff640 1 -- 172.21.15.88:0/1666956603 learned_addr learned my addr 172.21.15.88:0/1666956603 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:28:34.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.874+0000 7efcabfff640 1 -- 172.21.15.88:0/1666956603 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efcac101a60 msgr2=0x7efcac19c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:34.881 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.874+0000 7efcabfff640 1 --2- 172.21.15.88:0/1666956603 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efcac101a60 0x7efcac19c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:34.881 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.875+0000 7efcabfff640 1 -- 172.21.15.88:0/1666956603 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcac19c7e0 con 0x7efcac100860 2024-09-17T04:28:34.881 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.875+0000 7efcabfff640 1 --2- 172.21.15.88:0/1666956603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcac100860 0x7efcac06aca0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7efc9c00d8d0 tx=0x7efc9c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:28:34.881 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.875+0000 7efca9ffb640 1 -- 172.21.15.88:0/1666956603 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efc9c017070 con 0x7efcac100860 2024-09-17T04:28:34.881 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.875+0000 7efca9ffb640 1 -- 172.21.15.88:0/1666956603 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efc9c00be10 con 0x7efcac100860 2024-09-17T04:28:34.881 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.875+0000 7efcb24bd640 1 -- 172.21.15.88:0/1666956603 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcac19cad0 con 0x7efcac100860 2024-09-17T04:28:34.882 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.875+0000 7efca9ffb640 1 -- 172.21.15.88:0/1666956603 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efc9c00f3c0 con 0x7efcac100860 2024-09-17T04:28:34.882 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.875+0000 7efcb24bd640 1 -- 172.21.15.88:0/1666956603 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcac19d060 con 0x7efcac100860 2024-09-17T04:28:34.882 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.876+0000 7efcb24bd640 1 -- 172.21.15.88:0/1666956603 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcac100c60 con 0x7efcac100860 2024-09-17T04:28:34.882 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.877+0000 7efca9ffb640 1 -- 172.21.15.88:0/1666956603 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7efc9c01a070 con 0x7efcac100860 2024-09-17T04:28:34.882 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.878+0000 7efca9ffb640 1 --2- 172.21.15.88:0/1666956603 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7efc9807af40 0x7efc9807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:28:34.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.878+0000 7efca9ffb640 1 -- 172.21.15.88:0/1666956603 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7efc9c09dd10 con 0x7efcac100860 2024-09-17T04:28:34.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.878+0000 7efca3fff640 1 --2- 172.21.15.88:0/1666956603 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7efc9807af40 0x7efc9807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:28:34.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.879+0000 7efca3fff640 1 --2- 172.21.15.88:0/1666956603 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7efc9807af40 0x7efc9807d400 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7efc9402a9c0 tx=0x7efc94000bc0 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:28:34.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:34.883+0000 7efca9ffb640 1 -- 172.21.15.88:0/1666956603 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7efc9c0691d0 con 0x7efcac100860 2024-09-17T04:28:34.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:34 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:28:35.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.134+0000 7efcb24bd640 1 -- 172.21.15.88:0/1666956603 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7efcac062df0 con 0x7efcac100860 2024-09-17T04:28:35.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.135+0000 7efca9ffb640 1 -- 172.21.15.88:0/1666956603 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7efc9c06e080 con 0x7efcac100860 2024-09-17T04:28:35.137 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-17T04:28:35.137 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-09-17T04:28:35.137 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T04:28:35.137 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:28:35.137 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-09-17T04:28:35.137 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T04:28:35.138 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:28:35.138 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-09-17T04:28:35.138 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 6 2024-09-17T04:28:35.138 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:28:35.138 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2024-09-17T04:28:35.138 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 4 2024-09-17T04:28:35.138 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:28:35.138 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-09-17T04:28:35.138 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 14 2024-09-17T04:28:35.138 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-17T04:28:35.138 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-17T04:28:35.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.137+0000 7efcb24bd640 1 -- 172.21.15.88:0/1666956603 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7efc9807af40 msgr2=0x7efc9807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:35.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.137+0000 7efcb24bd640 1 --2- 172.21.15.88:0/1666956603 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7efc9807af40 0x7efc9807d400 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7efc9402a9c0 tx=0x7efc94000bc0 comp rx=0 tx=0).stop 2024-09-17T04:28:35.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.137+0000 7efcb24bd640 1 -- 172.21.15.88:0/1666956603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcac100860 msgr2=0x7efcac06aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:35.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.137+0000 7efcb24bd640 1 --2- 172.21.15.88:0/1666956603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcac100860 0x7efcac06aca0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7efc9c00d8d0 tx=0x7efc9c00dd90 comp rx=0 tx=0).stop 2024-09-17T04:28:35.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.137+0000 7efcb24bd640 1 -- 172.21.15.88:0/1666956603 shutdown_connections 2024-09-17T04:28:35.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.137+0000 7efcb24bd640 1 --2- 172.21.15.88:0/1666956603 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7efc9807af40 0x7efc9807d400 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:35.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.137+0000 7efcb24bd640 1 --2- 172.21.15.88:0/1666956603 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efcac101a60 0x7efcac19c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:35.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.137+0000 7efcb24bd640 1 --2- 172.21.15.88:0/1666956603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcac100860 0x7efcac06aca0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:35.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.137+0000 7efcb24bd640 1 -- 172.21.15.88:0/1666956603 >> 172.21.15.88:0/1666956603 conn(0x7efcac0fc010 msgr2=0x7efcac104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:28:35.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.138+0000 7efcb24bd640 1 -- 172.21.15.88:0/1666956603 shutdown_connections 2024-09-17T04:28:35.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.138+0000 7efcb24bd640 1 -- 172.21.15.88:0/1666956603 wait complete. 2024-09-17T04:28:35.227 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.226+0000 7f8935435640 1 -- 172.21.15.88:0/2747505532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8930100860 msgr2=0x7f8930100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:35.227 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.226+0000 7f8935435640 1 --2- 172.21.15.88:0/2747505532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8930100860 0x7f8930100c60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8920009880 tx=0x7f892002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:28:35.227 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.226+0000 7f8935435640 1 -- 172.21.15.88:0/2747505532 shutdown_connections 2024-09-17T04:28:35.227 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.226+0000 7f8935435640 1 --2- 172.21.15.88:0/2747505532 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8930101a60 0x7f8930101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:35.227 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.226+0000 7f8935435640 1 --2- 172.21.15.88:0/2747505532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8930100860 0x7f8930100c60 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:35.227 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.226+0000 7f8935435640 1 -- 172.21.15.88:0/2747505532 >> 172.21.15.88:0/2747505532 conn(0x7f89300fc010 msgr2=0x7f89300fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:28:35.227 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.226+0000 7f8935435640 1 -- 172.21.15.88:0/2747505532 shutdown_connections 2024-09-17T04:28:35.227 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.226+0000 7f8935435640 1 -- 172.21.15.88:0/2747505532 wait complete. 2024-09-17T04:28:35.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.226+0000 7f8935435640 1 Processor -- start 2024-09-17T04:28:35.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.227+0000 7f8935435640 1 -- start start 2024-09-17T04:28:35.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.227+0000 7f8935435640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8930100860 0x7f8930199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:28:35.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.227+0000 7f8935435640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8930101a60 0x7f8930199c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:28:35.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.227+0000 7f8935435640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f89301096a0 con 0x7f8930101a60 2024-09-17T04:28:35.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.227+0000 7f8935435640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8930109520 con 0x7f8930100860 2024-09-17T04:28:35.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.227+0000 7f892e7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8930101a60 0x7f8930199c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:28:35.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.227+0000 7f892e7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8930101a60 0x7f8930199c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38662/0 (socket says 172.21.15.88:38662) 2024-09-17T04:28:35.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.227+0000 7f892e7fc640 1 -- 172.21.15.88:0/1680678157 learned_addr learned my addr 172.21.15.88:0/1680678157 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:28:35.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.227+0000 7f892effd640 1 --2- 172.21.15.88:0/1680678157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8930100860 0x7f8930199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:28:35.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.227+0000 7f892e7fc640 1 -- 172.21.15.88:0/1680678157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8930100860 msgr2=0x7f8930199720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:35.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.227+0000 7f892e7fc640 1 --2- 172.21.15.88:0/1680678157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8930100860 0x7f8930199720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:35.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.227+0000 7f892e7fc640 1 -- 172.21.15.88:0/1680678157 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f893019a2e0 con 0x7f8930101a60 2024-09-17T04:28:35.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.227+0000 7f892e7fc640 1 --2- 172.21.15.88:0/1680678157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8930101a60 0x7f8930199c60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f892400d6f0 tx=0x7f892400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:28:35.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.228+0000 7f8917fff640 1 -- 172.21.15.88:0/1680678157 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8924017070 con 0x7f8930101a60 2024-09-17T04:28:35.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.228+0000 7f8917fff640 1 -- 172.21.15.88:0/1680678157 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f892400de00 con 0x7f8930101a60 2024-09-17T04:28:35.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.228+0000 7f8935435640 1 -- 172.21.15.88:0/1680678157 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f893019ed20 con 0x7f8930101a60 2024-09-17T04:28:35.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.228+0000 7f8917fff640 1 -- 172.21.15.88:0/1680678157 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8924004b90 con 0x7f8930101a60 2024-09-17T04:28:35.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.228+0000 7f8935435640 1 -- 172.21.15.88:0/1680678157 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f893019f250 con 0x7f8930101a60 2024-09-17T04:28:35.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.229+0000 7f8935435640 1 -- 172.21.15.88:0/1680678157 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8930100c60 con 0x7f8930101a60 2024-09-17T04:28:35.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.230+0000 7f8917fff640 1 -- 172.21.15.88:0/1680678157 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f8924009a30 con 0x7f8930101a60 2024-09-17T04:28:35.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.231+0000 7f8917fff640 1 --2- 172.21.15.88:0/1680678157 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f891807af80 0x7f891807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:28:35.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.231+0000 7f8917fff640 1 -- 172.21.15.88:0/1680678157 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f892409db80 con 0x7f8930101a60 2024-09-17T04:28:35.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.231+0000 7f892effd640 1 --2- 172.21.15.88:0/1680678157 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f891807af80 0x7f891807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:28:35.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.231+0000 7f892effd640 1 --2- 172.21.15.88:0/1680678157 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f891807af80 0x7f891807d440 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8920009230 tx=0x7f89200058d0 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:28:35.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.235+0000 7f8917fff640 1 -- 172.21.15.88:0/1680678157 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f8924069150 con 0x7f8930101a60 2024-09-17T04:28:35.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.469+0000 7f8935435640 1 -- 172.21.15.88:0/1680678157 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f893019fc70 con 0x7f8930101a60 2024-09-17T04:28:35.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.470+0000 7f8917fff640 1 -- 172.21.15.88:0/1680678157 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 38 v38) ==== 76+0+2047 (secure 0 0 0) 0x7f892405ee20 con 0x7f8930101a60 2024-09-17T04:28:35.471 INFO:teuthology.orchestra.run.smithi088.stdout:e38 2024-09-17T04:28:35.471 INFO:teuthology.orchestra.run.smithi088.stdout:btime 2024-09-17T04:28:17:685888+0000 2024-09-17T04:28:35.471 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T04:28:35.472 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:28:35.472 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2024-09-17T04:28:35.472 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:28:35.472 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2024-09-17T04:28:35.472 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2024-09-17T04:28:35.472 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 38 2024-09-17T04:28:35.472 INFO:teuthology.orchestra.run.smithi088.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T04:28:35.472 INFO:teuthology.orchestra.run.smithi088.stdout:created 2024-09-17T04:18:10.480573+0000 2024-09-17T04:28:35.472 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2024-09-17T04:28:17.685877+0000 2024-09-17T04:28:35.472 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2024-09-17T04:28:35.472 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2024-09-17T04:28:35.472 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2024-09-17T04:28:35.473 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2024-09-17T04:28:35.473 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2024-09-17T04:28:35.473 INFO:teuthology.orchestra.run.smithi088.stdout:max_xattr_size 65536 2024-09-17T04:28:35.473 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2024-09-17T04:28:35.473 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2024-09-17T04:28:35.473 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 82 2024-09-17T04:28:35.473 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:28:35.473 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 1 2024-09-17T04:28:35.473 INFO:teuthology.orchestra.run.smithi088.stdout:in 0 2024-09-17T04:28:35.473 INFO:teuthology.orchestra.run.smithi088.stdout:up {0=34273} 2024-09-17T04:28:35.473 INFO:teuthology.orchestra.run.smithi088.stdout:failed 2024-09-17T04:28:35.473 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2024-09-17T04:28:35.473 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2024-09-17T04:28:35.474 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2024-09-17T04:28:35.474 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2024-09-17T04:28:35.474 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data enabled 2024-09-17T04:28:35.474 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2024-09-17T04:28:35.474 INFO:teuthology.orchestra.run.smithi088.stdout:bal_rank_mask -1 2024-09-17T04:28:35.474 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 1 2024-09-17T04:28:35.474 INFO:teuthology.orchestra.run.smithi088.stdout:qdb_cluster leader: 34273 members: 34273 2024-09-17T04:28:35.474 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi134.ktuhce{0:34273} state up:active seq 8 join_fscid=1 addr [v2:172.21.15.134:6824/3452154372,v1:172.21.15.134:6825/3452154372] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:28:35.474 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi134.psnynp{0:34305} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/3085319848,v1:172.21.15.134:6827/3085319848] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:28:35.474 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:28:35.474 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:28:35.474 INFO:teuthology.orchestra.run.smithi088.stdout:Standby daemons: 2024-09-17T04:28:35.475 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:28:35.475 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.lgavsv{-1:34318} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/3125957194,v1:172.21.15.88:6827/3125957194] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:28:35.475 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.giqrgt{-1:34322} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6828/2683662376,v1:172.21.15.88:6829/2683662376] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:28:35.475 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 38 2024-09-17T04:28:35.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.472+0000 7f8935435640 1 -- 172.21.15.88:0/1680678157 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f891807af80 msgr2=0x7f891807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:35.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.472+0000 7f8935435640 1 --2- 172.21.15.88:0/1680678157 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f891807af80 0x7f891807d440 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8920009230 tx=0x7f89200058d0 comp rx=0 tx=0).stop 2024-09-17T04:28:35.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.472+0000 7f8935435640 1 -- 172.21.15.88:0/1680678157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8930101a60 msgr2=0x7f8930199c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:35.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.472+0000 7f8935435640 1 --2- 172.21.15.88:0/1680678157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8930101a60 0x7f8930199c60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f892400d6f0 tx=0x7f892400dbb0 comp rx=0 tx=0).stop 2024-09-17T04:28:35.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.472+0000 7f8935435640 1 -- 172.21.15.88:0/1680678157 shutdown_connections 2024-09-17T04:28:35.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.472+0000 7f8935435640 1 --2- 172.21.15.88:0/1680678157 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f891807af80 0x7f891807d440 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:35.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.472+0000 7f8935435640 1 --2- 172.21.15.88:0/1680678157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8930101a60 0x7f8930199c60 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:35.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.472+0000 7f8935435640 1 --2- 172.21.15.88:0/1680678157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8930100860 0x7f8930199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:35.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.472+0000 7f8935435640 1 -- 172.21.15.88:0/1680678157 >> 172.21.15.88:0/1680678157 conn(0x7f89300fc010 msgr2=0x7f893006a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:28:35.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.473+0000 7f8935435640 1 -- 172.21.15.88:0/1680678157 shutdown_connections 2024-09-17T04:28:35.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.473+0000 7f8935435640 1 -- 172.21.15.88:0/1680678157 wait complete. 2024-09-17T04:28:35.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.555+0000 7f5a3ded0640 1 -- 172.21.15.88:0/2424480432 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a38102c00 msgr2=0x7f5a38103080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:35.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.555+0000 7f5a3ded0640 1 --2- 172.21.15.88:0/2424480432 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a38102c00 0x7f5a38103080 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c009880 tx=0x7f5a2c02a4a0 comp rx=0 tx=0).stop 2024-09-17T04:28:35.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.555+0000 7f5a3ded0640 1 -- 172.21.15.88:0/2424480432 shutdown_connections 2024-09-17T04:28:35.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.555+0000 7f5a3ded0640 1 --2- 172.21.15.88:0/2424480432 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a38102c00 0x7f5a38103080 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:35.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.555+0000 7f5a3ded0640 1 --2- 172.21.15.88:0/2424480432 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a380ffc20 0x7f5a38100020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:35.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.555+0000 7f5a3ded0640 1 -- 172.21.15.88:0/2424480432 >> 172.21.15.88:0/2424480432 conn(0x7f5a380fb770 msgr2=0x7f5a380fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:28:35.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.555+0000 7f5a3ded0640 1 -- 172.21.15.88:0/2424480432 shutdown_connections 2024-09-17T04:28:35.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.555+0000 7f5a3ded0640 1 -- 172.21.15.88:0/2424480432 wait complete. 2024-09-17T04:28:35.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.556+0000 7f5a3ded0640 1 Processor -- start 2024-09-17T04:28:35.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.556+0000 7f5a3ded0640 1 -- start start 2024-09-17T04:28:35.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.556+0000 7f5a3ded0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a380ffc20 0x7f5a381974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:28:35.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.556+0000 7f5a3ded0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a38102c00 0x7f5a38197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:28:35.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.556+0000 7f5a3ded0640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3810a7a0 con 0x7f5a38102c00 2024-09-17T04:28:35.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.556+0000 7f5a3ded0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3810a620 con 0x7f5a380ffc20 2024-09-17T04:28:35.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.556+0000 7f5a36ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a38102c00 0x7f5a38197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:28:35.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.556+0000 7f5a36ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a38102c00 0x7f5a38197a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38680/0 (socket says 172.21.15.88:38680) 2024-09-17T04:28:35.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.556+0000 7f5a36ffd640 1 -- 172.21.15.88:0/855640895 learned_addr learned my addr 172.21.15.88:0/855640895 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:28:35.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.557+0000 7f5a377fe640 1 --2- 172.21.15.88:0/855640895 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a380ffc20 0x7f5a381974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:28:35.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.557+0000 7f5a36ffd640 1 -- 172.21.15.88:0/855640895 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a380ffc20 msgr2=0x7f5a381974c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:35.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.557+0000 7f5a36ffd640 1 --2- 172.21.15.88:0/855640895 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a380ffc20 0x7f5a381974c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:35.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.557+0000 7f5a36ffd640 1 -- 172.21.15.88:0/855640895 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a38198080 con 0x7f5a38102c00 2024-09-17T04:28:35.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.557+0000 7f5a36ffd640 1 --2- 172.21.15.88:0/855640895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a38102c00 0x7f5a38197a00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c006010 tx=0x7f5a2c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:28:35.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.557+0000 7f5a34ff9640 1 -- 172.21.15.88:0/855640895 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5a2c03f070 con 0x7f5a38102c00 2024-09-17T04:28:35.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.557+0000 7f5a3ded0640 1 -- 172.21.15.88:0/855640895 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a3819ca60 con 0x7f5a38102c00 2024-09-17T04:28:35.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.557+0000 7f5a34ff9640 1 -- 172.21.15.88:0/855640895 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5a2c0044d0 con 0x7f5a38102c00 2024-09-17T04:28:35.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.557+0000 7f5a34ff9640 1 -- 172.21.15.88:0/855640895 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5a2c035030 con 0x7f5a38102c00 2024-09-17T04:28:35.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.557+0000 7f5a3ded0640 1 -- 172.21.15.88:0/855640895 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a3819cff0 con 0x7f5a38102c00 2024-09-17T04:28:35.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.558+0000 7f5a3ded0640 1 -- 172.21.15.88:0/855640895 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a38100020 con 0x7f5a38102c00 2024-09-17T04:28:35.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.559+0000 7f5a34ff9640 1 -- 172.21.15.88:0/855640895 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f5a2c042070 con 0x7f5a38102c00 2024-09-17T04:28:35.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.559+0000 7f5a34ff9640 1 --2- 172.21.15.88:0/855640895 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f5a2007af80 0x7f5a2007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:28:35.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.559+0000 7f5a34ff9640 1 -- 172.21.15.88:0/855640895 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f5a2c0bed50 con 0x7f5a38102c00 2024-09-17T04:28:35.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.559+0000 7f5a377fe640 1 --2- 172.21.15.88:0/855640895 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f5a2007af80 0x7f5a2007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:28:35.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.560+0000 7f5a377fe640 1 --2- 172.21.15.88:0/855640895 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f5a2007af80 0x7f5a2007d440 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5a280058c0 tx=0x7f5a28005c80 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:28:35.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.564+0000 7f5a34ff9640 1 -- 172.21.15.88:0/855640895 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f5a2c08a320 con 0x7f5a38102c00 2024-09-17T04:28:35.713 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:35 smithi088 ceph-mon[90867]: from='client.34388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:28:35.713 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:35 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/1666956603' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:28:35.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.765+0000 7f5a3ded0640 1 -- 172.21.15.88:0/855640895 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5a381071b0 con 0x7f5a2007af80 2024-09-17T04:28:35.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.766+0000 7f5a34ff9640 1 -- 172.21.15.88:0/855640895 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+441 (secure 0 0 0) 0x7f5a381071b0 con 0x7f5a2007af80 2024-09-17T04:28:35.767 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-17T04:28:35.767 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f", 2024-09-17T04:28:35.767 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-09-17T04:28:35.768 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T04:28:35.768 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [ 2024-09-17T04:28:35.768 INFO:teuthology.orchestra.run.smithi088.stdout: "osd", 2024-09-17T04:28:35.768 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr", 2024-09-17T04:28:35.768 INFO:teuthology.orchestra.run.smithi088.stdout: "crash", 2024-09-17T04:28:35.768 INFO:teuthology.orchestra.run.smithi088.stdout: "mon", 2024-09-17T04:28:35.768 INFO:teuthology.orchestra.run.smithi088.stdout: "mds" 2024-09-17T04:28:35.768 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-17T04:28:35.768 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "16/23 daemons upgraded", 2024-09-17T04:28:35.768 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading ceph-exporter daemons", 2024-09-17T04:28:35.768 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-09-17T04:28:35.768 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-17T04:28:35.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.768+0000 7f5a3ded0640 1 -- 172.21.15.88:0/855640895 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f5a2007af80 msgr2=0x7f5a2007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:35.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.768+0000 7f5a3ded0640 1 --2- 172.21.15.88:0/855640895 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f5a2007af80 0x7f5a2007d440 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5a280058c0 tx=0x7f5a28005c80 comp rx=0 tx=0).stop 2024-09-17T04:28:35.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.768+0000 7f5a3ded0640 1 -- 172.21.15.88:0/855640895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a38102c00 msgr2=0x7f5a38197a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:35.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.768+0000 7f5a3ded0640 1 --2- 172.21.15.88:0/855640895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a38102c00 0x7f5a38197a00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c006010 tx=0x7f5a2c0048f0 comp rx=0 tx=0).stop 2024-09-17T04:28:35.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.769+0000 7f5a3ded0640 1 -- 172.21.15.88:0/855640895 shutdown_connections 2024-09-17T04:28:35.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.769+0000 7f5a3ded0640 1 --2- 172.21.15.88:0/855640895 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f5a2007af80 0x7f5a2007d440 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:35.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.769+0000 7f5a3ded0640 1 --2- 172.21.15.88:0/855640895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a38102c00 0x7f5a38197a00 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:35.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.769+0000 7f5a3ded0640 1 --2- 172.21.15.88:0/855640895 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a380ffc20 0x7f5a381974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:35.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.769+0000 7f5a3ded0640 1 -- 172.21.15.88:0/855640895 >> 172.21.15.88:0/855640895 conn(0x7f5a380fb770 msgr2=0x7f5a380fd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:28:35.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.769+0000 7f5a3ded0640 1 -- 172.21.15.88:0/855640895 shutdown_connections 2024-09-17T04:28:35.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.769+0000 7f5a3ded0640 1 -- 172.21.15.88:0/855640895 wait complete. 2024-09-17T04:28:35.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.852+0000 7fb85a5d6640 1 -- 172.21.15.88:0/3396997354 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb854104de0 msgr2=0x7fb8541071d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:35.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.852+0000 7fb85a5d6640 1 --2- 172.21.15.88:0/3396997354 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb854104de0 0x7fb8541071d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb848009880 tx=0x7fb84802a4a0 comp rx=0 tx=0).stop 2024-09-17T04:28:35.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.852+0000 7fb85a5d6640 1 -- 172.21.15.88:0/3396997354 shutdown_connections 2024-09-17T04:28:35.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.852+0000 7fb85a5d6640 1 --2- 172.21.15.88:0/3396997354 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb854104de0 0x7fb8541071d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:35.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.852+0000 7fb85a5d6640 1 --2- 172.21.15.88:0/3396997354 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8541024b0 0x7fb8541048a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:35.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.852+0000 7fb85a5d6640 1 -- 172.21.15.88:0/3396997354 >> 172.21.15.88:0/3396997354 conn(0x7fb8540fc010 msgr2=0x7fb8540fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:28:35.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.852+0000 7fb85a5d6640 1 -- 172.21.15.88:0/3396997354 shutdown_connections 2024-09-17T04:28:35.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.852+0000 7fb85a5d6640 1 -- 172.21.15.88:0/3396997354 wait complete. 2024-09-17T04:28:35.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.853+0000 7fb85a5d6640 1 Processor -- start 2024-09-17T04:28:35.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.853+0000 7fb85a5d6640 1 -- start start 2024-09-17T04:28:35.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.853+0000 7fb85a5d6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8541024b0 0x7fb854101da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:28:35.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.853+0000 7fb85a5d6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb854104de0 0x7fb854100460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:28:35.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.853+0000 7fb85a5d6640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fb85410a7a0 con 0x7fb8541024b0 2024-09-17T04:28:35.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.853+0000 7fb85a5d6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb85410a620 con 0x7fb854104de0 2024-09-17T04:28:35.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.853+0000 7fb853fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8541024b0 0x7fb854101da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:28:35.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.853+0000 7fb853fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8541024b0 0x7fb854101da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38692/0 (socket says 172.21.15.88:38692) 2024-09-17T04:28:35.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.853+0000 7fb853fff640 1 -- 172.21.15.88:0/845725888 learned_addr learned my addr 172.21.15.88:0/845725888 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:28:35.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.853+0000 7fb853fff640 1 -- 172.21.15.88:0/845725888 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb854104de0 msgr2=0x7fb854100460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:35.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.854+0000 7fb853fff640 1 --2- 172.21.15.88:0/845725888 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb854104de0 0x7fb854100460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:35.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.854+0000 7fb853fff640 1 -- 172.21.15.88:0/845725888 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8541009a0 con 0x7fb8541024b0 2024-09-17T04:28:35.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.854+0000 7fb853fff640 1 --2- 172.21.15.88:0/845725888 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8541024b0 0x7fb854101da0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb84400c8f0 tx=0x7fb84400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:28:35.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.854+0000 7fb8517fa640 1 -- 172.21.15.88:0/845725888 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb8440079b0 con 0x7fb8541024b0 2024-09-17T04:28:35.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.854+0000 7fb85a5d6640 1 -- 172.21.15.88:0/845725888 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb854100c90 con 0x7fb8541024b0 2024-09-17T04:28:35.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.854+0000 7fb8517fa640 1 -- 172.21.15.88:0/845725888 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb8440054e0 con 0x7fb8541024b0 2024-09-17T04:28:35.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.854+0000 7fb8517fa640 1 -- 172.21.15.88:0/845725888 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb844004dd0 con 0x7fb8541024b0 2024-09-17T04:28:35.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.854+0000 7fb85a5d6640 1 -- 172.21.15.88:0/845725888 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb854101220 con 0x7fb8541024b0 2024-09-17T04:28:35.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.855+0000 7fb85a5d6640 1 -- 172.21.15.88:0/845725888 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb854102890 con 0x7fb8541024b0 2024-09-17T04:28:35.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.856+0000 7fb8517fa640 1 -- 172.21.15.88:0/845725888 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fb844005020 con 0x7fb8541024b0 2024-09-17T04:28:35.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.856+0000 7fb8517fa640 1 --2- 172.21.15.88:0/845725888 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fb83c07aed0 0x7fb83c07d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:28:35.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.856+0000 7fb8517fa640 1 -- 172.21.15.88:0/845725888 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fb84409e120 con 0x7fb8541024b0 2024-09-17T04:28:35.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.856+0000 7fb8537fe640 1 --2- 172.21.15.88:0/845725888 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fb83c07aed0 0x7fb83c07d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:28:35.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.857+0000 7fb8537fe640 1 --2- 172.21.15.88:0/845725888 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fb83c07aed0 0x7fb83c07d390 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb8480096c0 tx=0x7fb848000bc0 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:28:35.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:35.861+0000 7fb8517fa640 1 -- 172.21.15.88:0/845725888 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fb844014030 con 0x7fb8541024b0 2024-09-17T04:28:35.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:35 smithi134 ceph-mon[76677]: from='client.34388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:28:35.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:35 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/1666956603' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:28:36.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:36.116+0000 7fb85a5d6640 1 -- 172.21.15.88:0/845725888 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fb85419fcb0 con 0x7fb8541024b0 2024-09-17T04:28:36.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:36.116+0000 7fb8517fa640 1 -- 172.21.15.88:0/845725888 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7fb8440880e0 con 0x7fb8541024b0 2024-09-17T04:28:36.117 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T04:28:36.117 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T04:28:36.117 INFO:teuthology.orchestra.run.smithi088.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T04:28:36.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:36.120+0000 7fb85a5d6640 1 -- 172.21.15.88:0/845725888 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fb83c07aed0 msgr2=0x7fb83c07d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:36.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:36.120+0000 7fb85a5d6640 1 --2- 172.21.15.88:0/845725888 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fb83c07aed0 0x7fb83c07d390 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb8480096c0 tx=0x7fb848000bc0 comp rx=0 tx=0).stop 2024-09-17T04:28:36.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:36.120+0000 7fb85a5d6640 1 -- 172.21.15.88:0/845725888 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8541024b0 msgr2=0x7fb854101da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:28:36.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:36.120+0000 7fb85a5d6640 1 --2- 172.21.15.88:0/845725888 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8541024b0 0x7fb854101da0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb84400c8f0 tx=0x7fb84400cdb0 comp rx=0 tx=0).stop 2024-09-17T04:28:36.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:36.120+0000 7fb85a5d6640 1 -- 172.21.15.88:0/845725888 shutdown_connections 2024-09-17T04:28:36.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:36.120+0000 7fb85a5d6640 1 --2- 172.21.15.88:0/845725888 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fb83c07aed0 0x7fb83c07d390 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:36.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:36.120+0000 7fb85a5d6640 1 --2- 172.21.15.88:0/845725888 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb854104de0 0x7fb854100460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:36.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:36.120+0000 7fb85a5d6640 1 --2- 172.21.15.88:0/845725888 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8541024b0 0x7fb854101da0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:28:36.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:36.120+0000 7fb85a5d6640 1 -- 172.21.15.88:0/845725888 >> 172.21.15.88:0/845725888 conn(0x7fb8540fc010 msgr2=0x7fb8540fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:28:36.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:36.120+0000 7fb85a5d6640 1 -- 172.21.15.88:0/845725888 shutdown_connections 2024-09-17T04:28:36.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:28:36.120+0000 7fb85a5d6640 1 -- 172.21.15.88:0/845725888 wait complete. 2024-09-17T04:28:36.706 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:36 smithi134 ceph-mon[76677]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:28:36.707 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:36 smithi134 ceph-mon[76677]: pgmap v230: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-09-17T04:28:36.707 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:36 smithi134 ceph-mon[76677]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:28:36.707 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:36 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/1680678157' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T04:28:36.707 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:36 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/845725888' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T04:28:36.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:36 smithi088 ceph-mon[90867]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:28:36.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:36 smithi088 ceph-mon[90867]: pgmap v230: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-09-17T04:28:36.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:36 smithi088 ceph-mon[90867]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:28:36.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:36 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/1680678157' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T04:28:36.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:36 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/845725888' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T04:28:37.752 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:37 smithi134 ceph-mon[76677]: from='client.34408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:28:37.793 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:37 smithi088 ceph-mon[90867]: from='client.34408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:28:38.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:38 smithi088 ceph-mon[90867]: pgmap v231: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 5.3 MiB/s rd, 2 op/s 2024-09-17T04:28:38.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:38 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:38.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:38 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:38.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:38 smithi134 ceph-mon[76677]: pgmap v231: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 5.3 MiB/s rd, 2 op/s 2024-09-17T04:28:38.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:38 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:38.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:38 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:39.585 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:39 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:39.585 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:39 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:39.586 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:39 smithi134 ceph-mon[76677]: pgmap v232: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 1 op/s 2024-09-17T04:28:39.586 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:39 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:39.586 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:39 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:39.586 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:39 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:39.586 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:39 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:39.824 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:39 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:39.824 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:39 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:39.824 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:39 smithi088 ceph-mon[90867]: pgmap v232: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 1 op/s 2024-09-17T04:28:39.824 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:39 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:39.824 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:39 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:39.824 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:39 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:39.825 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:39 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:41.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:41 smithi088 ceph-mon[90867]: pgmap v233: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2 op/s 2024-09-17T04:28:41.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:41 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:28:41.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:41 smithi134 ceph-mon[76677]: pgmap v233: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2 op/s 2024-09-17T04:28:41.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:41 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:28:43.569 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:43 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:43.569 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:43 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:43.569 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:43 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:43.570 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:43 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:43.570 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:43 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:28:43.570 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:43 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:28:43.570 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:43 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:43.570 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:43 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:28:43.570 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:43 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:28:43.570 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:43 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:28:43.570 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:43 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:28:43.570 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:43 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:28:43.570 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:43 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:28:43.570 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:43 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:28:43.570 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:43 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:28:43.570 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:43 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:28:43.570 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:43 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:28:43.571 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:43 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:43.571 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:43 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi088"} : dispatch 2024-09-17T04:28:43.571 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:43 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi088"}]': finished 2024-09-17T04:28:43.571 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:43 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi134"} : dispatch 2024-09-17T04:28:43.571 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:43 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi134"}]': finished 2024-09-17T04:28:43.571 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:43 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:28:43.571 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:43 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:43.571 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:43 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:28:43.571 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:43 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:43.571 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:43 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:28:43.571 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:43 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:43.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:43 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:43.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:43 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:43.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:43 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:43.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:43 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:43.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:43 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:28:43.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:43 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:28:43.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:43 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:43.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:43 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:28:43.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:43 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:28:43.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:43 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:28:43.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:43 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:28:43.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:43 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:28:43.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:43 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:28:43.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:43 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:28:43.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:43 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:28:43.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:43 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:28:43.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:43 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:28:43.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:43 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:43.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:43 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi088"} : dispatch 2024-09-17T04:28:43.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:43 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi088"}]': finished 2024-09-17T04:28:43.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:43 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi134"} : dispatch 2024-09-17T04:28:43.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:43 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi134"}]': finished 2024-09-17T04:28:43.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:43 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:28:43.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:43 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:43.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:43 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:28:43.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:43 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:43.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:43 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:28:43.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:43 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:44.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:44 smithi088 ceph-mon[90867]: pgmap v234: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-17T04:28:44.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:44 smithi088 ceph-mon[90867]: Upgrade: Setting container_image for all ceph-exporter 2024-09-17T04:28:44.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:44 smithi088 ceph-mon[90867]: Upgrade: Setting container_image for all iscsi 2024-09-17T04:28:44.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:44 smithi088 ceph-mon[90867]: Upgrade: Setting container_image for all nfs 2024-09-17T04:28:44.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:44 smithi088 ceph-mon[90867]: Upgrade: Setting container_image for all nvmeof 2024-09-17T04:28:44.645 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:44 smithi134 ceph-mon[76677]: pgmap v234: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-17T04:28:44.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:44 smithi134 ceph-mon[76677]: Upgrade: Setting container_image for all ceph-exporter 2024-09-17T04:28:44.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:44 smithi134 ceph-mon[76677]: Upgrade: Setting container_image for all iscsi 2024-09-17T04:28:44.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:44 smithi134 ceph-mon[76677]: Upgrade: Setting container_image for all nfs 2024-09-17T04:28:44.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:44 smithi134 ceph-mon[76677]: Upgrade: Setting container_image for all nvmeof 2024-09-17T04:28:45.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:45 smithi088 ceph-mon[90867]: Upgrade: Updating node-exporter.smithi088 (1/2) 2024-09-17T04:28:45.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:45 smithi088 ceph-mon[90867]: Deploying daemon node-exporter.smithi088 on smithi088 2024-09-17T04:28:45.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:45 smithi134 ceph-mon[76677]: Upgrade: Updating node-exporter.smithi088 (1/2) 2024-09-17T04:28:45.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:45 smithi134 ceph-mon[76677]: Deploying daemon node-exporter.smithi088 on smithi088 2024-09-17T04:28:46.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:46 smithi088 ceph-mon[90867]: pgmap v235: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:28:46.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:46 smithi134 ceph-mon[76677]: pgmap v235: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:28:48.589 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:48 smithi088 ceph-mon[90867]: pgmap v236: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-17T04:28:48.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:48 smithi134 ceph-mon[76677]: pgmap v236: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-17T04:28:50.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:50 smithi088 ceph-mon[90867]: pgmap v237: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-17T04:28:50.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:50 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:50.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:50 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:50.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:50 smithi134 ceph-mon[76677]: pgmap v237: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-17T04:28:50.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:50 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:50.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:50 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:52.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:52 smithi088 ceph-mon[90867]: pgmap v238: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:28:52.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:52 smithi088 ceph-mon[90867]: Upgrade: Updating node-exporter.smithi134 (2/2) 2024-09-17T04:28:52.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:52 smithi088 ceph-mon[90867]: Deploying daemon node-exporter.smithi134 on smithi134 2024-09-17T04:28:52.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:52 smithi134 ceph-mon[76677]: pgmap v238: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:28:52.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:52 smithi134 ceph-mon[76677]: Upgrade: Updating node-exporter.smithi134 (2/2) 2024-09-17T04:28:52.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:52 smithi134 ceph-mon[76677]: Deploying daemon node-exporter.smithi134 on smithi134 2024-09-17T04:28:54.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:54 smithi134 ceph-mon[76677]: pgmap v239: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:28:54.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:54 smithi088 ceph-mon[90867]: pgmap v239: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:28:56.765 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:56 smithi134 ceph-mon[76677]: pgmap v240: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:28:56.765 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:56 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:56.765 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:56 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:56.765 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:56 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:28:56.765 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:56 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:28:56.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:56 smithi088 ceph-mon[90867]: pgmap v240: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:28:56.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:56 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:56.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:56 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:56.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:56 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:28:56.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:56 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:28:58.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:58 smithi088 ceph-mon[90867]: pgmap v241: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:28:58.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:58 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:58.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:58 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:58.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:58 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:58.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:28:58 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:58.788 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:58 smithi134 ceph-mon[76677]: pgmap v241: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:28:58.788 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:58 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:58.788 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:58 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:58.788 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:58 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:28:58.788 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:28:58 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:00.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:00 smithi134 ceph-mon[76677]: pgmap v242: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:29:00.649 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:00 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:00.649 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:00 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:00.649 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:00 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:00.649 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:00 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:00.747 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:00 smithi088 ceph-mon[90867]: pgmap v242: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:29:00.747 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:00 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:00.747 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:00 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:00.748 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:00 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:00.748 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:00 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:02.131 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:02 smithi088 ceph-mon[90867]: pgmap v243: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:29:02.131 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:02 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:02.131 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:02 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:02.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:02 smithi134 ceph-mon[76677]: pgmap v243: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:29:02.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:02 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:02.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:02 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:04.263 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:04 smithi088 ceph-mon[90867]: pgmap v244: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:29:04.263 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:04 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:04.263 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:04 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:04.263 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:04 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:29:04.264 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:04 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:29:04.264 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:04 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:04.264 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:04 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:29:04.264 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:04 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:04.264 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:04 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:04.264 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:04 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:04.264 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:04 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:04.264 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:04 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:04.264 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:04 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:04.264 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:04 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:04.265 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:04 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:04.265 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:04 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:04.265 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:04 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:04.265 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:04 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:04.265 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:04 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:04.265 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:04 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:04.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:04 smithi134 ceph-mon[76677]: pgmap v244: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:29:04.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:04 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:04.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:04 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:04.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:04 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:29:04.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:04 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:29:04.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:04 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:04.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:04 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:29:04.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:04 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:04.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:04 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:04.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:04 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:04.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:04 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:04.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:04 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:04.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:04 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:04.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:04 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:04.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:04 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:04.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:04 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:04.398 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:04 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:04.398 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:04 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:04.398 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:04 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:04.398 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:04 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:06.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.209+0000 7f6317794640 1 -- 172.21.15.88:0/2700259848 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6310102b30 msgr2=0x7f6310104fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:06.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.209+0000 7f6317794640 1 --2- 172.21.15.88:0/2700259848 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6310102b30 0x7f6310104fa0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6300009880 tx=0x7f630002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:29:06.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.209+0000 7f6317794640 1 -- 172.21.15.88:0/2700259848 shutdown_connections 2024-09-17T04:29:06.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.209+0000 7f6317794640 1 --2- 172.21.15.88:0/2700259848 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6310102b30 0x7f6310104fa0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:06.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.209+0000 7f6317794640 1 --2- 172.21.15.88:0/2700259848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63101001e0 0x7f63101025f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:06.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.209+0000 7f6317794640 1 -- 172.21.15.88:0/2700259848 >> 172.21.15.88:0/2700259848 conn(0x7f63100fc010 msgr2=0x7f63100fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:29:06.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.209+0000 7f6317794640 1 -- 172.21.15.88:0/2700259848 shutdown_connections 2024-09-17T04:29:06.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.209+0000 7f6317794640 1 -- 172.21.15.88:0/2700259848 wait complete. 2024-09-17T04:29:06.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.210+0000 7f6317794640 1 Processor -- start 2024-09-17T04:29:06.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.210+0000 7f6317794640 1 -- start start 2024-09-17T04:29:06.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.210+0000 7f6317794640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63101001e0 0x7f631019daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:29:06.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.210+0000 7f6317794640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6310102b30 0x7f631019e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:29:06.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.210+0000 7f6317794640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f6310110d90 con 0x7f63101001e0 2024-09-17T04:29:06.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.210+0000 7f6317794640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6310110c10 con 0x7f6310102b30 2024-09-17T04:29:06.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.210+0000 7f6315530640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63101001e0 0x7f631019daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:29:06.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.210+0000 7f6315530640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63101001e0 0x7f631019daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41158/0 (socket says 172.21.15.88:41158) 2024-09-17T04:29:06.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.210+0000 7f6315530640 1 -- 172.21.15.88:0/2414354923 learned_addr learned my addr 172.21.15.88:0/2414354923 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:29:06.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.210+0000 7f6314d2f640 1 --2- 172.21.15.88:0/2414354923 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6310102b30 0x7f631019e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:29:06.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.211+0000 7f6315530640 1 -- 172.21.15.88:0/2414354923 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6310102b30 msgr2=0x7f631019e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:06.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.211+0000 7f6315530640 1 --2- 172.21.15.88:0/2414354923 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6310102b30 0x7f631019e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:06.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.211+0000 7f6315530640 1 -- 172.21.15.88:0/2414354923 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f631019e6b0 con 0x7f63101001e0 2024-09-17T04:29:06.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.211+0000 7f6314d2f640 1 --2- 172.21.15.88:0/2414354923 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6310102b30 0x7f631019e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:29:06.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.211+0000 7f6315530640 1 --2- 172.21.15.88:0/2414354923 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63101001e0 0x7f631019daf0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f630c00d6f0 tx=0x7f630c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:29:06.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.211+0000 7f63067fc640 1 -- 172.21.15.88:0/2414354923 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f630c017070 con 0x7f63101001e0 2024-09-17T04:29:06.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.211+0000 7f63067fc640 1 -- 172.21.15.88:0/2414354923 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f630c00de00 con 0x7f63101001e0 2024-09-17T04:29:06.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.211+0000 7f63067fc640 1 -- 172.21.15.88:0/2414354923 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f630c004bb0 con 0x7f63101001e0 2024-09-17T04:29:06.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.211+0000 7f6317794640 1 -- 172.21.15.88:0/2414354923 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63101a30f0 con 0x7f63101001e0 2024-09-17T04:29:06.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.211+0000 7f6317794640 1 -- 172.21.15.88:0/2414354923 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63101a3680 con 0x7f63101001e0 2024-09-17T04:29:06.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.212+0000 7f6317794640 1 -- 172.21.15.88:0/2414354923 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63101005e0 con 0x7f63101001e0 2024-09-17T04:29:06.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.213+0000 7f63067fc640 1 -- 172.21.15.88:0/2414354923 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f630c009a30 con 0x7f63101001e0 2024-09-17T04:29:06.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.213+0000 7f63067fc640 1 --2- 172.21.15.88:0/2414354923 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f62fc07af80 0x7f62fc07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:29:06.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.213+0000 7f63067fc640 1 -- 172.21.15.88:0/2414354923 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f630c09dc30 con 0x7f63101001e0 2024-09-17T04:29:06.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.213+0000 7f6314d2f640 1 --2- 172.21.15.88:0/2414354923 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f62fc07af80 0x7f62fc07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:29:06.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.214+0000 7f6314d2f640 1 --2- 172.21.15.88:0/2414354923 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f62fc07af80 0x7f62fc07d440 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f631019efa0 tx=0x7f6300005a20 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:29:06.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.218+0000 7f63067fc640 1 -- 172.21.15.88:0/2414354923 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f630c069200 con 0x7f63101001e0 2024-09-17T04:29:06.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:06 smithi088 ceph-mon[90867]: pgmap v245: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:29:06.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:06 smithi088 ceph-mon[90867]: Upgrade: Updating prometheus.smithi088 2024-09-17T04:29:06.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:06 smithi088 ceph-mon[90867]: Deploying daemon prometheus.smithi088 on smithi088 2024-09-17T04:29:06.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:06 smithi134 ceph-mon[76677]: pgmap v245: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:29:06.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:06 smithi134 ceph-mon[76677]: Upgrade: Updating prometheus.smithi088 2024-09-17T04:29:06.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:06 smithi134 ceph-mon[76677]: Deploying daemon prometheus.smithi088 on smithi088 2024-09-17T04:29:06.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.423+0000 7f6317794640 1 -- 172.21.15.88:0/2414354923 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6310103590 con 0x7f62fc07af80 2024-09-17T04:29:06.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.425+0000 7f63067fc640 1 -- 172.21.15.88:0/2414354923 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+463 (secure 0 0 0) 0x7f6310103590 con 0x7f62fc07af80 2024-09-17T04:29:06.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.427+0000 7f6317794640 1 -- 172.21.15.88:0/2414354923 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f62fc07af80 msgr2=0x7f62fc07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:06.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.427+0000 7f6317794640 1 --2- 172.21.15.88:0/2414354923 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f62fc07af80 0x7f62fc07d440 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f631019efa0 tx=0x7f6300005a20 comp rx=0 tx=0).stop 2024-09-17T04:29:06.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.427+0000 7f6317794640 1 -- 172.21.15.88:0/2414354923 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63101001e0 msgr2=0x7f631019daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:06.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.427+0000 7f6317794640 1 --2- 172.21.15.88:0/2414354923 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63101001e0 0x7f631019daf0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f630c00d6f0 tx=0x7f630c00dbb0 comp rx=0 tx=0).stop 2024-09-17T04:29:06.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.427+0000 7f6317794640 1 -- 172.21.15.88:0/2414354923 shutdown_connections 2024-09-17T04:29:06.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.427+0000 7f6317794640 1 --2- 172.21.15.88:0/2414354923 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f62fc07af80 0x7f62fc07d440 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:06.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.427+0000 7f6317794640 1 --2- 172.21.15.88:0/2414354923 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6310102b30 0x7f631019e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:06.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.427+0000 7f6317794640 1 --2- 172.21.15.88:0/2414354923 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63101001e0 0x7f631019daf0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:06.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.427+0000 7f6317794640 1 -- 172.21.15.88:0/2414354923 >> 172.21.15.88:0/2414354923 conn(0x7f63100fc010 msgr2=0x7f63100fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:29:06.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.427+0000 7f6317794640 1 -- 172.21.15.88:0/2414354923 shutdown_connections 2024-09-17T04:29:06.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.427+0000 7f6317794640 1 -- 172.21.15.88:0/2414354923 wait complete. 2024-09-17T04:29:06.436 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-09-17T04:29:06.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.517+0000 7ff0d38db640 1 -- 172.21.15.88:0/1106420853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0cc102b60 msgr2=0x7ff0cc102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:06.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.517+0000 7ff0d38db640 1 --2- 172.21.15.88:0/1106420853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0cc102b60 0x7ff0cc102fe0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc009880 tx=0x7ff0bc02a4a0 comp rx=0 tx=0).stop 2024-09-17T04:29:06.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.517+0000 7ff0d38db640 1 -- 172.21.15.88:0/1106420853 shutdown_connections 2024-09-17T04:29:06.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.517+0000 7ff0d38db640 1 --2- 172.21.15.88:0/1106420853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0cc102b60 0x7ff0cc102fe0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:06.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.517+0000 7ff0d38db640 1 --2- 172.21.15.88:0/1106420853 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0cc101960 0x7ff0cc101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:06.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.517+0000 7ff0d38db640 1 -- 172.21.15.88:0/1106420853 >> 172.21.15.88:0/1106420853 conn(0x7ff0cc0fd0f0 msgr2=0x7ff0cc0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:29:06.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.517+0000 7ff0d38db640 1 -- 172.21.15.88:0/1106420853 shutdown_connections 2024-09-17T04:29:06.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.517+0000 7ff0d38db640 1 -- 172.21.15.88:0/1106420853 wait complete. 2024-09-17T04:29:06.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.518+0000 7ff0d38db640 1 Processor -- start 2024-09-17T04:29:06.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.518+0000 7ff0d38db640 1 -- start start 2024-09-17T04:29:06.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.518+0000 7ff0d38db640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0cc101960 0x7ff0cc075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:29:06.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.518+0000 7ff0d38db640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0cc102b60 0x7ff0cc0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:29:06.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.518+0000 7ff0d38db640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ff0cc10a7a0 con 0x7ff0cc102b60 2024-09-17T04:29:06.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.518+0000 7ff0d38db640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff0cc10a620 con 0x7ff0cc101960 2024-09-17T04:29:06.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.518+0000 7ff0d0e76640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0cc102b60 0x7ff0cc0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:29:06.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.519+0000 7ff0d0e76640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0cc102b60 0x7ff0cc0745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41178/0 (socket says 172.21.15.88:41178) 2024-09-17T04:29:06.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.519+0000 7ff0d0e76640 1 -- 172.21.15.88:0/3394605920 learned_addr learned my addr 172.21.15.88:0/3394605920 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:29:06.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.519+0000 7ff0d1677640 1 --2- 172.21.15.88:0/3394605920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0cc101960 0x7ff0cc075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:29:06.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.519+0000 7ff0d0e76640 1 -- 172.21.15.88:0/3394605920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0cc101960 msgr2=0x7ff0cc075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:06.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.519+0000 7ff0d0e76640 1 --2- 172.21.15.88:0/3394605920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0cc101960 0x7ff0cc075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:06.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.519+0000 7ff0d0e76640 1 -- 172.21.15.88:0/3394605920 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0cc074b20 con 0x7ff0cc102b60 2024-09-17T04:29:06.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.519+0000 7ff0d0e76640 1 --2- 172.21.15.88:0/3394605920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0cc102b60 0x7ff0cc0745e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc006010 tx=0x7ff0bc004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:29:06.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.519+0000 7ff0c27fc640 1 -- 172.21.15.88:0/3394605920 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff0bc03f070 con 0x7ff0cc102b60 2024-09-17T04:29:06.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.519+0000 7ff0d38db640 1 -- 172.21.15.88:0/3394605920 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0cc074db0 con 0x7ff0cc102b60 2024-09-17T04:29:06.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.519+0000 7ff0c27fc640 1 -- 172.21.15.88:0/3394605920 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff0bc0049d0 con 0x7ff0cc102b60 2024-09-17T04:29:06.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.519+0000 7ff0c27fc640 1 -- 172.21.15.88:0/3394605920 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff0bc035030 con 0x7ff0cc102b60 2024-09-17T04:29:06.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.519+0000 7ff0d38db640 1 -- 172.21.15.88:0/3394605920 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0cc0752e0 con 0x7ff0cc102b60 2024-09-17T04:29:06.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.521+0000 7ff0d38db640 1 -- 172.21.15.88:0/3394605920 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0cc101d60 con 0x7ff0cc102b60 2024-09-17T04:29:06.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.521+0000 7ff0c27fc640 1 -- 172.21.15.88:0/3394605920 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7ff0bc042070 con 0x7ff0cc102b60 2024-09-17T04:29:06.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.522+0000 7ff0c27fc640 1 --2- 172.21.15.88:0/3394605920 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7ff0b807af30 0x7ff0b807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:29:06.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.522+0000 7ff0c27fc640 1 -- 172.21.15.88:0/3394605920 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7ff0bc0bed40 con 0x7ff0cc102b60 2024-09-17T04:29:06.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.522+0000 7ff0d1677640 1 --2- 172.21.15.88:0/3394605920 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7ff0b807af30 0x7ff0b807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:29:06.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.523+0000 7ff0d1677640 1 --2- 172.21.15.88:0/3394605920 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7ff0b807af30 0x7ff0b807d3f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc1029c0 tx=0x7ff0c8005f90 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:29:06.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.527+0000 7ff0c27fc640 1 -- 172.21.15.88:0/3394605920 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7ff0bc08a290 con 0x7ff0cc102b60 2024-09-17T04:29:06.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.841+0000 7ff0d38db640 1 -- 172.21.15.88:0/3394605920 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff0cc062630 con 0x7ff0b807af30 2024-09-17T04:29:06.843 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.843+0000 7ff0c27fc640 1 -- 172.21.15.88:0/3394605920 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+463 (secure 0 0 0) 0x7ff0cc062630 con 0x7ff0b807af30 2024-09-17T04:29:06.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.846+0000 7ff0d38db640 1 -- 172.21.15.88:0/3394605920 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7ff0b807af30 msgr2=0x7ff0b807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:06.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.846+0000 7ff0d38db640 1 --2- 172.21.15.88:0/3394605920 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7ff0b807af30 0x7ff0b807d3f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc1029c0 tx=0x7ff0c8005f90 comp rx=0 tx=0).stop 2024-09-17T04:29:06.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.846+0000 7ff0d38db640 1 -- 172.21.15.88:0/3394605920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0cc102b60 msgr2=0x7ff0cc0745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:06.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.846+0000 7ff0d38db640 1 --2- 172.21.15.88:0/3394605920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0cc102b60 0x7ff0cc0745e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc006010 tx=0x7ff0bc004570 comp rx=0 tx=0).stop 2024-09-17T04:29:06.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.846+0000 7ff0d38db640 1 -- 172.21.15.88:0/3394605920 shutdown_connections 2024-09-17T04:29:06.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.846+0000 7ff0d38db640 1 --2- 172.21.15.88:0/3394605920 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7ff0b807af30 0x7ff0b807d3f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:06.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.846+0000 7ff0d38db640 1 --2- 172.21.15.88:0/3394605920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0cc102b60 0x7ff0cc0745e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:06.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.846+0000 7ff0d38db640 1 --2- 172.21.15.88:0/3394605920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0cc101960 0x7ff0cc075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:06.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.846+0000 7ff0d38db640 1 -- 172.21.15.88:0/3394605920 >> 172.21.15.88:0/3394605920 conn(0x7ff0cc0fd0f0 msgr2=0x7ff0cc1060c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:29:06.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.846+0000 7ff0d38db640 1 -- 172.21.15.88:0/3394605920 shutdown_connections 2024-09-17T04:29:06.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.846+0000 7ff0d38db640 1 -- 172.21.15.88:0/3394605920 wait complete. 2024-09-17T04:29:06.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.966+0000 7fa85a959640 1 -- 172.21.15.88:0/465487316 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa854100b20 msgr2=0x7fa854100f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:06.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.966+0000 7fa85a959640 1 --2- 172.21.15.88:0/465487316 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa854100b20 0x7fa854100f80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa848009880 tx=0x7fa84802a4a0 comp rx=0 tx=0).stop 2024-09-17T04:29:06.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.966+0000 7fa85a959640 1 -- 172.21.15.88:0/465487316 shutdown_connections 2024-09-17T04:29:06.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.966+0000 7fa85a959640 1 --2- 172.21.15.88:0/465487316 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa854100b20 0x7fa854100f80 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:06.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.966+0000 7fa85a959640 1 --2- 172.21.15.88:0/465487316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8541001e0 0x7fa8541005e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:06.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.966+0000 7fa85a959640 1 -- 172.21.15.88:0/465487316 >> 172.21.15.88:0/465487316 conn(0x7fa8540fc010 msgr2=0x7fa8540fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:29:06.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.966+0000 7fa85a959640 1 -- 172.21.15.88:0/465487316 shutdown_connections 2024-09-17T04:29:06.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.966+0000 7fa85a959640 1 -- 172.21.15.88:0/465487316 wait complete. 2024-09-17T04:29:06.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.967+0000 7fa85a959640 1 Processor -- start 2024-09-17T04:29:06.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.967+0000 7fa85a959640 1 -- start start 2024-09-17T04:29:06.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.968+0000 7fa85a959640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8541001e0 0x7fa85419da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:29:06.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.968+0000 7fa85a959640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa854100b20 0x7fa85419dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:29:06.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.968+0000 7fa85a959640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa85410c970 con 0x7fa8541001e0 2024-09-17T04:29:06.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.968+0000 7fa85a959640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa85410c7f0 con 0x7fa854100b20 2024-09-17T04:29:06.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.968+0000 7fa853fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8541001e0 0x7fa85419da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:29:06.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.968+0000 7fa853fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8541001e0 0x7fa85419da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41198/0 (socket says 172.21.15.88:41198) 2024-09-17T04:29:06.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.968+0000 7fa853fff640 1 -- 172.21.15.88:0/3973380157 learned_addr learned my addr 172.21.15.88:0/3973380157 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:29:06.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.968+0000 7fa8537fe640 1 --2- 172.21.15.88:0/3973380157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa854100b20 0x7fa85419dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:29:06.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.968+0000 7fa853fff640 1 -- 172.21.15.88:0/3973380157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa854100b20 msgr2=0x7fa85419dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:06.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.968+0000 7fa853fff640 1 --2- 172.21.15.88:0/3973380157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa854100b20 0x7fa85419dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:06.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.968+0000 7fa853fff640 1 -- 172.21.15.88:0/3973380157 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa85419e640 con 0x7fa8541001e0 2024-09-17T04:29:06.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.968+0000 7fa853fff640 1 --2- 172.21.15.88:0/3973380157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8541001e0 0x7fa85419da80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa84400e9e0 tx=0x7fa84400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:29:06.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.969+0000 7fa8517fa640 1 -- 172.21.15.88:0/3973380157 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa84400cb50 con 0x7fa8541001e0 2024-09-17T04:29:06.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.969+0000 7fa8517fa640 1 -- 172.21.15.88:0/3973380157 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa84400ccf0 con 0x7fa8541001e0 2024-09-17T04:29:06.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.969+0000 7fa85a959640 1 -- 172.21.15.88:0/3973380157 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8541a3080 con 0x7fa8541001e0 2024-09-17T04:29:06.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.969+0000 7fa85a959640 1 -- 172.21.15.88:0/3973380157 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8541a3610 con 0x7fa8541001e0 2024-09-17T04:29:06.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.969+0000 7fa8517fa640 1 -- 172.21.15.88:0/3973380157 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa8440049d0 con 0x7fa8541001e0 2024-09-17T04:29:06.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.970+0000 7fa85a959640 1 -- 172.21.15.88:0/3973380157 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8400052c0 con 0x7fa8541001e0 2024-09-17T04:29:06.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.972+0000 7fa8517fa640 1 -- 172.21.15.88:0/3973380157 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fa844005190 con 0x7fa8541001e0 2024-09-17T04:29:06.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.972+0000 7fa8517fa640 1 --2- 172.21.15.88:0/3973380157 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fa83c07b0b0 0x7fa83c07d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:29:06.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.972+0000 7fa8517fa640 1 -- 172.21.15.88:0/3973380157 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fa84409e1e0 con 0x7fa8541001e0 2024-09-17T04:29:06.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.973+0000 7fa8537fe640 1 --2- 172.21.15.88:0/3973380157 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fa83c07b0b0 0x7fa83c07d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:29:06.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.974+0000 7fa8537fe640 1 --2- 172.21.15.88:0/3973380157 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fa83c07b0b0 0x7fa83c07d570 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa84802a9c0 tx=0x7fa848000bc0 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:29:06.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:06.978+0000 7fa8517fa640 1 -- 172.21.15.88:0/3973380157 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fa844069790 con 0x7fa8541001e0 2024-09-17T04:29:07.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:07 smithi088 ceph-mon[90867]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:29:07.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.281+0000 7fa85a959640 1 -- 172.21.15.88:0/3973380157 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fa840000bf0 con 0x7fa83c07b0b0 2024-09-17T04:29:07.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.297+0000 7fa8517fa640 1 -- 172.21.15.88:0/3973380157 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7fa840000bf0 con 0x7fa83c07b0b0 2024-09-17T04:29:07.297 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T04:29:07.297 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (14m) 7s ago 16m 25.2M - 0.25.0 c8568f914cd2 f2dbac7e939f 2024-09-17T04:29:07.297 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi088 smithi088 running (44s) 7s ago 16m 75.2M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 855ea59f1895 2024-09-17T04:29:07.297 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi134 smithi134 running (37s) 9s ago 15m 75.5M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 0e2d1095af7f 2024-09-17T04:29:07.297 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (5m) 7s ago 16m 6891k - 19.3.0-4989-gce1b342b 8e039cb7fe1e 10355648c406 2024-09-17T04:29:07.297 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi134 smithi134 running (5m) 9s ago 15m 6899k - 19.3.0-4989-gce1b342b 8e039cb7fe1e d709085ffe5d 2024-09-17T04:29:07.297 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (14m) 7s ago 16m 79.9M - 9.4.12 2bacad6d85d8 a6cff57a23f9 2024-09-17T04:29:07.298 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.giqrgt smithi088 running (103s) 7s ago 10m 84.2M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 3bb1d05b4476 2024-09-17T04:29:07.298 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.lgavsv smithi088 running (2m) 7s ago 10m 84.2M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 6fb9ba0a8ec3 2024-09-17T04:29:07.298 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi134.ktuhce smithi134 running (76s) 9s ago 10m 155M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 851c1f3a855a 2024-09-17T04:29:07.298 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi134.psnynp smithi134 running (57s) 9s ago 10m 155M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 966e092b224e 2024-09-17T04:29:07.298 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.wmndiv smithi088 *:8443,9283,8765 running (7m) 7s ago 17m 590M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 49eb47f7f14f 2024-09-17T04:29:07.298 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi134.vwdxcb smithi134 *:8443,9283,8765 running (6m) 9s ago 15m 523M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 8a6d45eb0595 2024-09-17T04:29:07.298 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (6m) 7s ago 17m 121M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e ac6332015243 2024-09-17T04:29:07.298 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi134 smithi134 running (5m) 9s ago 15m 105M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e ea49f690e26b 2024-09-17T04:29:07.298 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (18s) 7s ago 16m 8144k - 1.7.0 72c9c2088986 071e9be71e51 2024-09-17T04:29:07.299 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi134 smithi134 *:9100 running (12s) 9s ago 15m 3309k - 1.7.0 72c9c2088986 b5597a275b46 2024-09-17T04:29:07.299 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (5m) 7s ago 14m 166M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 4ef267302248 2024-09-17T04:29:07.299 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (4m) 7s ago 13m 169M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 17b67c13c7aa 2024-09-17T04:29:07.299 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (4m) 7s ago 13m 156M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 83d38ad792c9 2024-09-17T04:29:07.299 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi134 running (3m) 9s ago 12m 170M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e 336a363ac39f 2024-09-17T04:29:07.299 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi134 running (2m) 9s ago 12m 161M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e 6df8a692310a 2024-09-17T04:29:07.299 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi134 running (2m) 9s ago 11m 156M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e 5066799816d3 2024-09-17T04:29:07.299 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (6m) 7s ago 15m 67.9M - 2.43.0 a07b618ecd1d b51d7899d341 2024-09-17T04:29:07.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.299+0000 7fa85a959640 1 -- 172.21.15.88:0/3973380157 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fa83c07b0b0 msgr2=0x7fa83c07d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:07.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.299+0000 7fa85a959640 1 --2- 172.21.15.88:0/3973380157 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fa83c07b0b0 0x7fa83c07d570 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa84802a9c0 tx=0x7fa848000bc0 comp rx=0 tx=0).stop 2024-09-17T04:29:07.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.299+0000 7fa85a959640 1 -- 172.21.15.88:0/3973380157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8541001e0 msgr2=0x7fa85419da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:07.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.299+0000 7fa85a959640 1 --2- 172.21.15.88:0/3973380157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8541001e0 0x7fa85419da80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa84400e9e0 tx=0x7fa84400eea0 comp rx=0 tx=0).stop 2024-09-17T04:29:07.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.299+0000 7fa85a959640 1 -- 172.21.15.88:0/3973380157 shutdown_connections 2024-09-17T04:29:07.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.299+0000 7fa85a959640 1 --2- 172.21.15.88:0/3973380157 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fa83c07b0b0 0x7fa83c07d570 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:07.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.299+0000 7fa85a959640 1 --2- 172.21.15.88:0/3973380157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa854100b20 0x7fa85419dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:07.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.299+0000 7fa85a959640 1 --2- 172.21.15.88:0/3973380157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8541001e0 0x7fa85419da80 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:07.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.299+0000 7fa85a959640 1 -- 172.21.15.88:0/3973380157 >> 172.21.15.88:0/3973380157 conn(0x7fa8540fc010 msgr2=0x7fa854108a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:29:07.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.300+0000 7fa85a959640 1 -- 172.21.15.88:0/3973380157 shutdown_connections 2024-09-17T04:29:07.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.300+0000 7fa85a959640 1 -- 172.21.15.88:0/3973380157 wait complete. 2024-09-17T04:29:07.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.392+0000 7f445a57b640 1 -- 172.21.15.88:0/909344487 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4454104dc0 msgr2=0x7f44541071b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:07.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.392+0000 7f445a57b640 1 --2- 172.21.15.88:0/909344487 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4454104dc0 0x7f44541071b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4448009880 tx=0x7f444802a4a0 comp rx=0 tx=0).stop 2024-09-17T04:29:07.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.392+0000 7f445a57b640 1 -- 172.21.15.88:0/909344487 shutdown_connections 2024-09-17T04:29:07.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.392+0000 7f445a57b640 1 --2- 172.21.15.88:0/909344487 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4454104dc0 0x7f44541071b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:07.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.392+0000 7f445a57b640 1 --2- 172.21.15.88:0/909344487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4454102490 0x7f4454104880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:07.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.392+0000 7f445a57b640 1 -- 172.21.15.88:0/909344487 >> 172.21.15.88:0/909344487 conn(0x7f44540fc010 msgr2=0x7f44540fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:29:07.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.393+0000 7f445a57b640 1 -- 172.21.15.88:0/909344487 shutdown_connections 2024-09-17T04:29:07.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.393+0000 7f445a57b640 1 -- 172.21.15.88:0/909344487 wait complete. 2024-09-17T04:29:07.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.393+0000 7f445a57b640 1 Processor -- start 2024-09-17T04:29:07.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.393+0000 7f445a57b640 1 -- start start 2024-09-17T04:29:07.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.394+0000 7f445a57b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4454102490 0x7f4454197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:29:07.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.394+0000 7f445a57b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4454104dc0 0x7f4454197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:29:07.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.394+0000 7f445a57b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f445410a7a0 con 0x7f4454102490 2024-09-17T04:29:07.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.394+0000 7f445a57b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f445410a620 con 0x7f4454104dc0 2024-09-17T04:29:07.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.394+0000 7f4453fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4454102490 0x7f4454197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:29:07.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.394+0000 7f4453fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4454102490 0x7f4454197500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41216/0 (socket says 172.21.15.88:41216) 2024-09-17T04:29:07.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.394+0000 7f4453fff640 1 -- 172.21.15.88:0/709328632 learned_addr learned my addr 172.21.15.88:0/709328632 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:29:07.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.394+0000 7f44537fe640 1 --2- 172.21.15.88:0/709328632 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4454104dc0 0x7f4454197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:29:07.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.394+0000 7f4453fff640 1 -- 172.21.15.88:0/709328632 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4454104dc0 msgr2=0x7f4454197a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:07.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.394+0000 7f4453fff640 1 --2- 172.21.15.88:0/709328632 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4454104dc0 0x7f4454197a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:07.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.394+0000 7f4453fff640 1 -- 172.21.15.88:0/709328632 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44541980c0 con 0x7f4454102490 2024-09-17T04:29:07.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.394+0000 7f4453fff640 1 --2- 172.21.15.88:0/709328632 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4454102490 0x7f4454197500 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f444400e970 tx=0x7f444400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:29:07.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.395+0000 7f44517fa640 1 -- 172.21.15.88:0/709328632 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f444400cac0 con 0x7f4454102490 2024-09-17T04:29:07.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.395+0000 7f445a57b640 1 -- 172.21.15.88:0/709328632 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f445419cb00 con 0x7f4454102490 2024-09-17T04:29:07.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.395+0000 7f44517fa640 1 -- 172.21.15.88:0/709328632 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f44440054e0 con 0x7f4454102490 2024-09-17T04:29:07.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.395+0000 7f44517fa640 1 -- 172.21.15.88:0/709328632 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4444010430 con 0x7f4454102490 2024-09-17T04:29:07.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.395+0000 7f445a57b640 1 -- 172.21.15.88:0/709328632 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f445419d060 con 0x7f4454102490 2024-09-17T04:29:07.400 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:07 smithi134 ceph-mon[76677]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:29:07.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.396+0000 7f445a57b640 1 -- 172.21.15.88:0/709328632 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4454102870 con 0x7f4454102490 2024-09-17T04:29:07.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.397+0000 7f44517fa640 1 -- 172.21.15.88:0/709328632 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f4444004e80 con 0x7f4454102490 2024-09-17T04:29:07.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.397+0000 7f44517fa640 1 --2- 172.21.15.88:0/709328632 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f443c07af30 0x7f443c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:29:07.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.398+0000 7f44517fa640 1 -- 172.21.15.88:0/709328632 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f444409e7a0 con 0x7f4454102490 2024-09-17T04:29:07.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.398+0000 7f44537fe640 1 --2- 172.21.15.88:0/709328632 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f443c07af30 0x7f443c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:29:07.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.398+0000 7f44537fe640 1 --2- 172.21.15.88:0/709328632 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f443c07af30 0x7f443c07d3f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4448009230 tx=0x7f44480058d0 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:29:07.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.405+0000 7f44517fa640 1 -- 172.21.15.88:0/709328632 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f4444069cf0 con 0x7f4454102490 2024-09-17T04:29:07.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.700+0000 7f445a57b640 1 -- 172.21.15.88:0/709328632 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f445419d470 con 0x7f4454102490 2024-09-17T04:29:07.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.700+0000 7f44517fa640 1 -- 172.21.15.88:0/709328632 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f444406eba0 con 0x7f4454102490 2024-09-17T04:29:07.701 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-17T04:29:07.701 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-09-17T04:29:07.701 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T04:29:07.701 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:29:07.701 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-09-17T04:29:07.701 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T04:29:07.701 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:29:07.701 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-09-17T04:29:07.701 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 6 2024-09-17T04:29:07.701 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:29:07.701 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2024-09-17T04:29:07.702 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 4 2024-09-17T04:29:07.702 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:29:07.702 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-09-17T04:29:07.702 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 14 2024-09-17T04:29:07.702 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-17T04:29:07.702 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-17T04:29:07.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.703+0000 7f445a57b640 1 -- 172.21.15.88:0/709328632 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f443c07af30 msgr2=0x7f443c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:07.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.703+0000 7f445a57b640 1 --2- 172.21.15.88:0/709328632 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f443c07af30 0x7f443c07d3f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4448009230 tx=0x7f44480058d0 comp rx=0 tx=0).stop 2024-09-17T04:29:07.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.703+0000 7f445a57b640 1 -- 172.21.15.88:0/709328632 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4454102490 msgr2=0x7f4454197500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:07.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.703+0000 7f445a57b640 1 --2- 172.21.15.88:0/709328632 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4454102490 0x7f4454197500 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f444400e970 tx=0x7f444400ed70 comp rx=0 tx=0).stop 2024-09-17T04:29:07.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.703+0000 7f445a57b640 1 -- 172.21.15.88:0/709328632 shutdown_connections 2024-09-17T04:29:07.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.703+0000 7f445a57b640 1 --2- 172.21.15.88:0/709328632 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f443c07af30 0x7f443c07d3f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:07.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.703+0000 7f445a57b640 1 --2- 172.21.15.88:0/709328632 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4454104dc0 0x7f4454197a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:07.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.703+0000 7f445a57b640 1 --2- 172.21.15.88:0/709328632 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4454102490 0x7f4454197500 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:07.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.703+0000 7f445a57b640 1 -- 172.21.15.88:0/709328632 >> 172.21.15.88:0/709328632 conn(0x7f44540fc010 msgr2=0x7f44540fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:29:07.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.703+0000 7f445a57b640 1 -- 172.21.15.88:0/709328632 shutdown_connections 2024-09-17T04:29:07.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.703+0000 7f445a57b640 1 -- 172.21.15.88:0/709328632 wait complete. 2024-09-17T04:29:07.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.785+0000 7f1094929640 1 -- 172.21.15.88:0/3105749338 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10901023f0 msgr2=0x7f10901047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:07.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.785+0000 7f1094929640 1 --2- 172.21.15.88:0/3105749338 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10901023f0 0x7f10901047e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f10800098b0 tx=0x7f108002a4d0 comp rx=0 tx=0).stop 2024-09-17T04:29:07.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.785+0000 7f1094929640 1 -- 172.21.15.88:0/3105749338 shutdown_connections 2024-09-17T04:29:07.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.785+0000 7f1094929640 1 --2- 172.21.15.88:0/3105749338 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1090104d20 0x7f1090107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:07.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.785+0000 7f1094929640 1 --2- 172.21.15.88:0/3105749338 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10901023f0 0x7f10901047e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:07.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.785+0000 7f1094929640 1 -- 172.21.15.88:0/3105749338 >> 172.21.15.88:0/3105749338 conn(0x7f10900fc010 msgr2=0x7f10900fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:29:07.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.785+0000 7f1094929640 1 -- 172.21.15.88:0/3105749338 shutdown_connections 2024-09-17T04:29:07.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.785+0000 7f1094929640 1 -- 172.21.15.88:0/3105749338 wait complete. 2024-09-17T04:29:07.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.786+0000 7f1094929640 1 Processor -- start 2024-09-17T04:29:07.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.786+0000 7f1094929640 1 -- start start 2024-09-17T04:29:07.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.786+0000 7f1094929640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10901023f0 0x7f1090197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:29:07.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.786+0000 7f1094929640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1090104d20 0x7f1090197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:29:07.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.786+0000 7f1094929640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f109010a7e0 con 0x7f1090104d20 2024-09-17T04:29:07.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.786+0000 7f1094929640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f109010a660 con 0x7f10901023f0 2024-09-17T04:29:07.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.786+0000 7f1087fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1090104d20 0x7f1090197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:29:07.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.786+0000 7f1087fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1090104d20 0x7f1090197a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41238/0 (socket says 172.21.15.88:41238) 2024-09-17T04:29:07.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.786+0000 7f1087fff640 1 -- 172.21.15.88:0/3999519343 learned_addr learned my addr 172.21.15.88:0/3999519343 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:29:07.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.787+0000 7f108e59c640 1 --2- 172.21.15.88:0/3999519343 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10901023f0 0x7f1090197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:29:07.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.787+0000 7f1087fff640 1 -- 172.21.15.88:0/3999519343 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10901023f0 msgr2=0x7f1090197500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:07.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.787+0000 7f1087fff640 1 --2- 172.21.15.88:0/3999519343 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10901023f0 0x7f1090197500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:07.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.787+0000 7f1087fff640 1 -- 172.21.15.88:0/3999519343 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10901980c0 con 0x7f1090104d20 2024-09-17T04:29:07.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.787+0000 7f1087fff640 1 --2- 172.21.15.88:0/3999519343 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1090104d20 0x7f1090197a40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f107800c8f0 tx=0x7f107800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:29:07.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.787+0000 7f10877fe640 1 -- 172.21.15.88:0/3999519343 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f10780079b0 con 0x7f1090104d20 2024-09-17T04:29:07.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.787+0000 7f10877fe640 1 -- 172.21.15.88:0/3999519343 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1078007b50 con 0x7f1090104d20 2024-09-17T04:29:07.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.787+0000 7f10877fe640 1 -- 172.21.15.88:0/3999519343 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1078018630 con 0x7f1090104d20 2024-09-17T04:29:07.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.787+0000 7f1094929640 1 -- 172.21.15.88:0/3999519343 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f109019cb00 con 0x7f1090104d20 2024-09-17T04:29:07.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.787+0000 7f1094929640 1 -- 172.21.15.88:0/3999519343 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f109019d090 con 0x7f1090104d20 2024-09-17T04:29:07.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.788+0000 7f1094929640 1 -- 172.21.15.88:0/3999519343 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10901027d0 con 0x7f1090104d20 2024-09-17T04:29:07.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.789+0000 7f10877fe640 1 -- 172.21.15.88:0/3999519343 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f107800f9a0 con 0x7f1090104d20 2024-09-17T04:29:07.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.789+0000 7f10877fe640 1 --2- 172.21.15.88:0/3999519343 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f107c07af30 0x7f107c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:29:07.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.789+0000 7f10877fe640 1 -- 172.21.15.88:0/3999519343 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f107809e360 con 0x7f1090104d20 2024-09-17T04:29:07.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.789+0000 7f108e59c640 1 --2- 172.21.15.88:0/3999519343 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f107c07af30 0x7f107c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:29:07.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.790+0000 7f108e59c640 1 --2- 172.21.15.88:0/3999519343 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f107c07af30 0x7f107c07d3f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1080000c00 tx=0x7f1080005a20 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:29:07.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:07.794+0000 7f10877fe640 1 -- 172.21.15.88:0/3999519343 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f1078014030 con 0x7f1090104d20 2024-09-17T04:29:08.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.064+0000 7f1094929640 1 -- 172.21.15.88:0/3999519343 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f109019d8f0 con 0x7f1090104d20 2024-09-17T04:29:08.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.065+0000 7f10877fe640 1 -- 172.21.15.88:0/3999519343 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 38 v38) ==== 76+0+2047 (secure 0 0 0) 0x7f10780698b0 con 0x7f1090104d20 2024-09-17T04:29:08.065 INFO:teuthology.orchestra.run.smithi088.stdout:e38 2024-09-17T04:29:08.065 INFO:teuthology.orchestra.run.smithi088.stdout:btime 2024-09-17T04:28:17:685888+0000 2024-09-17T04:29:08.065 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T04:29:08.065 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:29:08.065 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2024-09-17T04:29:08.065 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:29:08.065 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2024-09-17T04:29:08.065 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2024-09-17T04:29:08.066 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 38 2024-09-17T04:29:08.066 INFO:teuthology.orchestra.run.smithi088.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T04:29:08.066 INFO:teuthology.orchestra.run.smithi088.stdout:created 2024-09-17T04:18:10.480573+0000 2024-09-17T04:29:08.066 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2024-09-17T04:28:17.685877+0000 2024-09-17T04:29:08.066 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2024-09-17T04:29:08.066 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2024-09-17T04:29:08.066 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2024-09-17T04:29:08.066 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2024-09-17T04:29:08.066 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2024-09-17T04:29:08.066 INFO:teuthology.orchestra.run.smithi088.stdout:max_xattr_size 65536 2024-09-17T04:29:08.066 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2024-09-17T04:29:08.066 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2024-09-17T04:29:08.066 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 82 2024-09-17T04:29:08.067 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:29:08.067 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 1 2024-09-17T04:29:08.067 INFO:teuthology.orchestra.run.smithi088.stdout:in 0 2024-09-17T04:29:08.067 INFO:teuthology.orchestra.run.smithi088.stdout:up {0=34273} 2024-09-17T04:29:08.067 INFO:teuthology.orchestra.run.smithi088.stdout:failed 2024-09-17T04:29:08.067 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2024-09-17T04:29:08.067 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2024-09-17T04:29:08.067 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2024-09-17T04:29:08.067 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2024-09-17T04:29:08.067 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data enabled 2024-09-17T04:29:08.067 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2024-09-17T04:29:08.068 INFO:teuthology.orchestra.run.smithi088.stdout:bal_rank_mask -1 2024-09-17T04:29:08.068 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 1 2024-09-17T04:29:08.068 INFO:teuthology.orchestra.run.smithi088.stdout:qdb_cluster leader: 34273 members: 34273 2024-09-17T04:29:08.068 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi134.ktuhce{0:34273} state up:active seq 8 join_fscid=1 addr [v2:172.21.15.134:6824/3452154372,v1:172.21.15.134:6825/3452154372] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:29:08.068 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi134.psnynp{0:34305} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/3085319848,v1:172.21.15.134:6827/3085319848] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:29:08.068 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:29:08.068 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:29:08.068 INFO:teuthology.orchestra.run.smithi088.stdout:Standby daemons: 2024-09-17T04:29:08.068 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:29:08.068 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.lgavsv{-1:34318} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/3125957194,v1:172.21.15.88:6827/3125957194] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:29:08.068 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.giqrgt{-1:34322} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6828/2683662376,v1:172.21.15.88:6829/2683662376] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:29:08.069 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 38 2024-09-17T04:29:08.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.067+0000 7f1094929640 1 -- 172.21.15.88:0/3999519343 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f107c07af30 msgr2=0x7f107c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:08.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.067+0000 7f1094929640 1 --2- 172.21.15.88:0/3999519343 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f107c07af30 0x7f107c07d3f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1080000c00 tx=0x7f1080005a20 comp rx=0 tx=0).stop 2024-09-17T04:29:08.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.067+0000 7f1094929640 1 -- 172.21.15.88:0/3999519343 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1090104d20 msgr2=0x7f1090197a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:08.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.067+0000 7f1094929640 1 --2- 172.21.15.88:0/3999519343 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1090104d20 0x7f1090197a40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f107800c8f0 tx=0x7f107800cdb0 comp rx=0 tx=0).stop 2024-09-17T04:29:08.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.067+0000 7f1094929640 1 -- 172.21.15.88:0/3999519343 shutdown_connections 2024-09-17T04:29:08.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.067+0000 7f1094929640 1 --2- 172.21.15.88:0/3999519343 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f107c07af30 0x7f107c07d3f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:08.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.067+0000 7f1094929640 1 --2- 172.21.15.88:0/3999519343 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1090104d20 0x7f1090197a40 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:08.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.067+0000 7f1094929640 1 --2- 172.21.15.88:0/3999519343 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10901023f0 0x7f1090197500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:08.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.067+0000 7f1094929640 1 -- 172.21.15.88:0/3999519343 >> 172.21.15.88:0/3999519343 conn(0x7f10900fc010 msgr2=0x7f10900fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:29:08.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.067+0000 7f1094929640 1 -- 172.21.15.88:0/3999519343 shutdown_connections 2024-09-17T04:29:08.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.068+0000 7f1094929640 1 -- 172.21.15.88:0/3999519343 wait complete. 2024-09-17T04:29:08.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.174+0000 7f64b5f73640 1 -- 172.21.15.88:0/2908064491 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64b0101970 msgr2=0x7f64b0101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:08.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.174+0000 7f64b5f73640 1 --2- 172.21.15.88:0/2908064491 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64b0101970 0x7f64b0101d70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f64a0009880 tx=0x7f64a002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:29:08.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.174+0000 7f64b5f73640 1 -- 172.21.15.88:0/2908064491 shutdown_connections 2024-09-17T04:29:08.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.174+0000 7f64b5f73640 1 --2- 172.21.15.88:0/2908064491 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64b0102b70 0x7f64b0102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:08.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.174+0000 7f64b5f73640 1 --2- 172.21.15.88:0/2908064491 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64b0101970 0x7f64b0101d70 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:08.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.174+0000 7f64b5f73640 1 -- 172.21.15.88:0/2908064491 >> 172.21.15.88:0/2908064491 conn(0x7f64b00fd140 msgr2=0x7f64b00ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:29:08.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.174+0000 7f64b5f73640 1 -- 172.21.15.88:0/2908064491 shutdown_connections 2024-09-17T04:29:08.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.174+0000 7f64b5f73640 1 -- 172.21.15.88:0/2908064491 wait complete. 2024-09-17T04:29:08.176 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.175+0000 7f64b5f73640 1 Processor -- start 2024-09-17T04:29:08.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.175+0000 7f64b5f73640 1 -- start start 2024-09-17T04:29:08.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.175+0000 7f64b5f73640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64b0101970 0x7f64b0075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:29:08.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.176+0000 7f64b5f73640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64b0102b70 0x7f64b00745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:29:08.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.176+0000 7f64b5f73640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f64b010a7b0 con 0x7f64b0102b70 2024-09-17T04:29:08.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.176+0000 7f64b5f73640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f64b010a630 con 0x7f64b0101970 2024-09-17T04:29:08.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.176+0000 7f64aeffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64b0102b70 0x7f64b00745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:29:08.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.176+0000 7f64aeffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64b0102b70 0x7f64b00745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41248/0 (socket says 172.21.15.88:41248) 2024-09-17T04:29:08.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.176+0000 7f64aeffd640 1 -- 172.21.15.88:0/2426521418 learned_addr learned my addr 172.21.15.88:0/2426521418 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:29:08.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.176+0000 7f64af7fe640 1 --2- 172.21.15.88:0/2426521418 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64b0101970 0x7f64b0075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:29:08.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.176+0000 7f64aeffd640 1 -- 172.21.15.88:0/2426521418 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64b0101970 msgr2=0x7f64b0075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:08.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.176+0000 7f64aeffd640 1 --2- 172.21.15.88:0/2426521418 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64b0101970 0x7f64b0075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:08.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.176+0000 7f64aeffd640 1 -- 172.21.15.88:0/2426521418 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64b0074b20 con 0x7f64b0102b70 2024-09-17T04:29:08.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.176+0000 7f64aeffd640 1 --2- 172.21.15.88:0/2426521418 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64b0102b70 0x7f64b00745e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f64a400c8f0 tx=0x7f64a400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:29:08.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.177+0000 7f64acff9640 1 -- 172.21.15.88:0/2426521418 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f64a40079b0 con 0x7f64b0102b70 2024-09-17T04:29:08.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.177+0000 7f64acff9640 1 -- 172.21.15.88:0/2426521418 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f64a40054e0 con 0x7f64b0102b70 2024-09-17T04:29:08.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.177+0000 7f64acff9640 1 -- 172.21.15.88:0/2426521418 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f64a4004dd0 con 0x7f64b0102b70 2024-09-17T04:29:08.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.177+0000 7f64b5f73640 1 -- 172.21.15.88:0/2426521418 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64b0074e10 con 0x7f64b0102b70 2024-09-17T04:29:08.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.177+0000 7f64b5f73640 1 -- 172.21.15.88:0/2426521418 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64b00753a0 con 0x7f64b0102b70 2024-09-17T04:29:08.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.178+0000 7f64b5f73640 1 -- 172.21.15.88:0/2426521418 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64b0101d70 con 0x7f64b0102b70 2024-09-17T04:29:08.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.179+0000 7f64acff9640 1 -- 172.21.15.88:0/2426521418 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f64a4005020 con 0x7f64b0102b70 2024-09-17T04:29:08.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.179+0000 7f64acff9640 1 --2- 172.21.15.88:0/2426521418 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f649807af30 0x7f649807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:29:08.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.180+0000 7f64acff9640 1 -- 172.21.15.88:0/2426521418 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f64a409dea0 con 0x7f64b0102b70 2024-09-17T04:29:08.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.180+0000 7f64af7fe640 1 --2- 172.21.15.88:0/2426521418 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f649807af30 0x7f649807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:29:08.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.180+0000 7f64af7fe640 1 --2- 172.21.15.88:0/2426521418 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f649807af30 0x7f649807d3f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f64a0009230 tx=0x7f64a00058d0 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:29:08.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.186+0000 7f64acff9640 1 -- 172.21.15.88:0/2426521418 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f64a4014030 con 0x7f64b0102b70 2024-09-17T04:29:08.297 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:08 smithi134 ceph-mon[76677]: pgmap v246: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:29:08.297 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:08 smithi134 ceph-mon[76677]: from='client.34420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:29:08.297 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:08 smithi134 ceph-mon[76677]: from='client.34424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:29:08.297 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:08 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/709328632' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:08.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:08 smithi088 ceph-mon[90867]: pgmap v246: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:29:08.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:08 smithi088 ceph-mon[90867]: from='client.34420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:29:08.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:08 smithi088 ceph-mon[90867]: from='client.34424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:29:08.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:08 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/709328632' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:08.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.396+0000 7f64b5f73640 1 -- 172.21.15.88:0/2426521418 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f64b0062630 con 0x7f649807af30 2024-09-17T04:29:08.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.397+0000 7f64acff9640 1 -- 172.21.15.88:0/2426521418 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+463 (secure 0 0 0) 0x7f64b0062630 con 0x7f649807af30 2024-09-17T04:29:08.397 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-17T04:29:08.397 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f", 2024-09-17T04:29:08.397 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-09-17T04:29:08.397 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T04:29:08.397 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [ 2024-09-17T04:29:08.398 INFO:teuthology.orchestra.run.smithi088.stdout: "osd", 2024-09-17T04:29:08.398 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr", 2024-09-17T04:29:08.398 INFO:teuthology.orchestra.run.smithi088.stdout: "crash", 2024-09-17T04:29:08.398 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph-exporter", 2024-09-17T04:29:08.398 INFO:teuthology.orchestra.run.smithi088.stdout: "mon", 2024-09-17T04:29:08.398 INFO:teuthology.orchestra.run.smithi088.stdout: "mds" 2024-09-17T04:29:08.398 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-17T04:29:08.398 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "18/23 daemons upgraded", 2024-09-17T04:29:08.398 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading prometheus daemons", 2024-09-17T04:29:08.398 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-09-17T04:29:08.398 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-17T04:29:08.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.400+0000 7f64b5f73640 1 -- 172.21.15.88:0/2426521418 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f649807af30 msgr2=0x7f649807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:08.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.400+0000 7f64b5f73640 1 --2- 172.21.15.88:0/2426521418 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f649807af30 0x7f649807d3f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f64a0009230 tx=0x7f64a00058d0 comp rx=0 tx=0).stop 2024-09-17T04:29:08.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.400+0000 7f64b5f73640 1 -- 172.21.15.88:0/2426521418 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64b0102b70 msgr2=0x7f64b00745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:08.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.400+0000 7f64b5f73640 1 --2- 172.21.15.88:0/2426521418 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64b0102b70 0x7f64b00745e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f64a400c8f0 tx=0x7f64a400cdb0 comp rx=0 tx=0).stop 2024-09-17T04:29:08.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.400+0000 7f64b5f73640 1 -- 172.21.15.88:0/2426521418 shutdown_connections 2024-09-17T04:29:08.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.400+0000 7f64b5f73640 1 --2- 172.21.15.88:0/2426521418 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f649807af30 0x7f649807d3f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:08.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.400+0000 7f64b5f73640 1 --2- 172.21.15.88:0/2426521418 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64b0102b70 0x7f64b00745e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:08.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.400+0000 7f64b5f73640 1 --2- 172.21.15.88:0/2426521418 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64b0101970 0x7f64b0075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:08.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.400+0000 7f64b5f73640 1 -- 172.21.15.88:0/2426521418 >> 172.21.15.88:0/2426521418 conn(0x7f64b00fd140 msgr2=0x7f64b0106080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:29:08.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.400+0000 7f64b5f73640 1 -- 172.21.15.88:0/2426521418 shutdown_connections 2024-09-17T04:29:08.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.400+0000 7f64b5f73640 1 -- 172.21.15.88:0/2426521418 wait complete. 2024-09-17T04:29:08.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.481+0000 7fc0a442f640 1 -- 172.21.15.88:0/3951219979 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc09c100860 msgr2=0x7fc09c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:08.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.481+0000 7fc0a442f640 1 --2- 172.21.15.88:0/3951219979 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc09c100860 0x7fc09c100c60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc098009880 tx=0x7fc09802a4a0 comp rx=0 tx=0).stop 2024-09-17T04:29:08.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.481+0000 7fc0a442f640 1 -- 172.21.15.88:0/3951219979 shutdown_connections 2024-09-17T04:29:08.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.481+0000 7fc0a442f640 1 --2- 172.21.15.88:0/3951219979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc09c101a60 0x7fc09c101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:08.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.481+0000 7fc0a442f640 1 --2- 172.21.15.88:0/3951219979 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc09c100860 0x7fc09c100c60 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:08.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.481+0000 7fc0a442f640 1 -- 172.21.15.88:0/3951219979 >> 172.21.15.88:0/3951219979 conn(0x7fc09c0fc010 msgr2=0x7fc09c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:29:08.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.481+0000 7fc0a442f640 1 -- 172.21.15.88:0/3951219979 shutdown_connections 2024-09-17T04:29:08.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.481+0000 7fc0a442f640 1 -- 172.21.15.88:0/3951219979 wait complete. 2024-09-17T04:29:08.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.482+0000 7fc0a442f640 1 Processor -- start 2024-09-17T04:29:08.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.482+0000 7fc0a442f640 1 -- start start 2024-09-17T04:29:08.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.482+0000 7fc0a442f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc09c100860 0x7fc09c197540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:29:08.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.482+0000 7fc0a442f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc09c101a60 0x7fc09c197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:29:08.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.482+0000 7fc0a442f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc09c109700 con 0x7fc09c101a60 2024-09-17T04:29:08.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.482+0000 7fc0a442f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc09c109580 con 0x7fc09c100860 2024-09-17T04:29:08.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.482+0000 7fc0a19ca640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc09c101a60 0x7fc09c197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:29:08.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.482+0000 7fc0a19ca640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc09c101a60 0x7fc09c197a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41264/0 (socket says 172.21.15.88:41264) 2024-09-17T04:29:08.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.482+0000 7fc0a19ca640 1 -- 172.21.15.88:0/4260798422 learned_addr learned my addr 172.21.15.88:0/4260798422 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:29:08.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.482+0000 7fc0a21cb640 1 --2- 172.21.15.88:0/4260798422 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc09c100860 0x7fc09c197540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:29:08.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.482+0000 7fc0a19ca640 1 -- 172.21.15.88:0/4260798422 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc09c100860 msgr2=0x7fc09c197540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:08.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.482+0000 7fc0a19ca640 1 --2- 172.21.15.88:0/4260798422 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc09c100860 0x7fc09c197540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:08.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.482+0000 7fc0a19ca640 1 -- 172.21.15.88:0/4260798422 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc09c198100 con 0x7fc09c101a60 2024-09-17T04:29:08.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.483+0000 7fc0a19ca640 1 --2- 172.21.15.88:0/4260798422 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc09c101a60 0x7fc09c197a80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc08c00b420 tx=0x7fc08c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:29:08.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.483+0000 7fc0937fe640 1 -- 172.21.15.88:0/4260798422 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc08c011630 con 0x7fc09c101a60 2024-09-17T04:29:08.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.483+0000 7fc0937fe640 1 -- 172.21.15.88:0/4260798422 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc08c016070 con 0x7fc09c101a60 2024-09-17T04:29:08.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.483+0000 7fc0a442f640 1 -- 172.21.15.88:0/4260798422 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc09c19cb40 con 0x7fc09c101a60 2024-09-17T04:29:08.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.483+0000 7fc0937fe640 1 -- 172.21.15.88:0/4260798422 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc08c010d40 con 0x7fc09c101a60 2024-09-17T04:29:08.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.483+0000 7fc0a442f640 1 -- 172.21.15.88:0/4260798422 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc09c19d150 con 0x7fc09c101a60 2024-09-17T04:29:08.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.484+0000 7fc0a442f640 1 -- 172.21.15.88:0/4260798422 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc09c100c60 con 0x7fc09c101a60 2024-09-17T04:29:08.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.485+0000 7fc0937fe640 1 -- 172.21.15.88:0/4260798422 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fc08c01b460 con 0x7fc09c101a60 2024-09-17T04:29:08.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.485+0000 7fc0937fe640 1 --2- 172.21.15.88:0/4260798422 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fc08807af30 0x7fc08807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:29:08.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.485+0000 7fc0a21cb640 1 --2- 172.21.15.88:0/4260798422 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fc08807af30 0x7fc08807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:29:08.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.485+0000 7fc0937fe640 1 -- 172.21.15.88:0/4260798422 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fc08c09d900 con 0x7fc09c101a60 2024-09-17T04:29:08.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.486+0000 7fc0a21cb640 1 --2- 172.21.15.88:0/4260798422 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fc08807af30 0x7fc08807d3f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc098000c00 tx=0x7fc098005a20 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:29:08.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.490+0000 7fc0937fe640 1 -- 172.21.15.88:0/4260798422 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fc08c068db0 con 0x7fc09c101a60 2024-09-17T04:29:08.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.762+0000 7fc0a442f640 1 -- 172.21.15.88:0/4260798422 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fc09c19d600 con 0x7fc09c101a60 2024-09-17T04:29:08.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.763+0000 7fc0937fe640 1 -- 172.21.15.88:0/4260798422 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7fc08c06dc60 con 0x7fc09c101a60 2024-09-17T04:29:08.763 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T04:29:08.763 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T04:29:08.763 INFO:teuthology.orchestra.run.smithi088.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T04:29:08.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.765+0000 7fc0a442f640 1 -- 172.21.15.88:0/4260798422 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fc08807af30 msgr2=0x7fc08807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:08.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.765+0000 7fc0a442f640 1 --2- 172.21.15.88:0/4260798422 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fc08807af30 0x7fc08807d3f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc098000c00 tx=0x7fc098005a20 comp rx=0 tx=0).stop 2024-09-17T04:29:08.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.765+0000 7fc0a442f640 1 -- 172.21.15.88:0/4260798422 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc09c101a60 msgr2=0x7fc09c197a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:08.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.765+0000 7fc0a442f640 1 --2- 172.21.15.88:0/4260798422 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc09c101a60 0x7fc09c197a80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc08c00b420 tx=0x7fc08c00b8e0 comp rx=0 tx=0).stop 2024-09-17T04:29:08.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.766+0000 7fc0a442f640 1 -- 172.21.15.88:0/4260798422 shutdown_connections 2024-09-17T04:29:08.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.766+0000 7fc0a442f640 1 --2- 172.21.15.88:0/4260798422 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fc08807af30 0x7fc08807d3f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:08.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.766+0000 7fc0a442f640 1 --2- 172.21.15.88:0/4260798422 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc09c101a60 0x7fc09c197a80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:08.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.766+0000 7fc0a442f640 1 --2- 172.21.15.88:0/4260798422 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc09c100860 0x7fc09c197540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:08.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.766+0000 7fc0a442f640 1 -- 172.21.15.88:0/4260798422 >> 172.21.15.88:0/4260798422 conn(0x7fc09c0fc010 msgr2=0x7fc09c06a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:29:08.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.766+0000 7fc0a442f640 1 -- 172.21.15.88:0/4260798422 shutdown_connections 2024-09-17T04:29:08.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:08.766+0000 7fc0a442f640 1 -- 172.21.15.88:0/4260798422 wait complete. 2024-09-17T04:29:09.314 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:09 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/3999519343' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T04:29:09.314 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:09 smithi134 ceph-mon[76677]: from='client.34436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:29:09.314 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:09 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/4260798422' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T04:29:09.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:09 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/3999519343' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T04:29:09.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:09 smithi088 ceph-mon[90867]: from='client.34436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:29:09.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:09 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/4260798422' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T04:29:10.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:10 smithi088 ceph-mon[90867]: pgmap v247: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:29:10.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:10 smithi134 ceph-mon[76677]: pgmap v247: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:29:12.378 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:12 smithi088 ceph-mon[90867]: pgmap v248: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:29:12.378 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:29:12.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:12 smithi134 ceph-mon[76677]: pgmap v248: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:29:12.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:29:14.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:14 smithi088 ceph-mon[90867]: pgmap v249: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:29:14.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:14 smithi134 ceph-mon[76677]: pgmap v249: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:29:16.172 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:16 smithi088 ceph-mon[90867]: pgmap v250: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:29:16.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:16 smithi134 ceph-mon[76677]: pgmap v250: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:29:18.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:18 smithi088 ceph-mon[90867]: pgmap v251: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:29:18.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:18 smithi134 ceph-mon[76677]: pgmap v251: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:29:19.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:19 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:19.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:19 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:19.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:19 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:29:19.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:19 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:19.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:19 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:19.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:19 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:29:20.601 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:20 smithi088 ceph-mon[90867]: pgmap v252: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:29:20.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:20 smithi134 ceph-mon[76677]: pgmap v252: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:29:22.404 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:22 smithi088 ceph-mon[90867]: pgmap v253: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:29:22.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:22 smithi134 ceph-mon[76677]: pgmap v253: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:29:24.092 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:23 smithi088 ceph-mon[90867]: pgmap v254: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:29:24.092 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:23 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:24.092 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:23 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:24.092 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:23 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:24.092 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:23 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:24.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:23 smithi134 ceph-mon[76677]: pgmap v254: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:29:24.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:23 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:24.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:23 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:24.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:23 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:24.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:23 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:26.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:25 smithi088 ceph-mon[90867]: pgmap v255: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:29:26.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:25 smithi134 ceph-mon[76677]: pgmap v255: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:29:27.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:26 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:29:27.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:26 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:27.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:26 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:27.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:26 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:29:27.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:26 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:29:27.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:26 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:27.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:26 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:29:27.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:26 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:27.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:26 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:27.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:26 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:29:27.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:26 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:29:27.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:26 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:28.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:27 smithi088 ceph-mon[90867]: pgmap v256: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:29:28.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:27 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "dashboard get-prometheus-api-host"} : dispatch 2024-09-17T04:29:28.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:27 smithi088 ceph-mon[90867]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T04:29:28.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:27 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:29:28.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:27 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:28.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:27 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:28.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:27 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:28.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:27 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:28.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:27 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:28.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:27 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:28.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:27 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:28.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:27 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:28.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:27 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:28.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:27 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:28.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:27 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:28.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:27 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:28.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:27 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:28.139 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:27 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:28.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:27 smithi134 ceph-mon[76677]: pgmap v256: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:29:28.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:27 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "dashboard get-prometheus-api-host"} : dispatch 2024-09-17T04:29:28.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:27 smithi134 ceph-mon[76677]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T04:29:28.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:27 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:29:28.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:27 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:28.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:27 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:28.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:27 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:28.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:27 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:28.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:27 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:28.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:27 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:28.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:27 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:28.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:27 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:28.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:27 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:28.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:27 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:28.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:27 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:28.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:27 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:28.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:27 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:28.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:27 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:29.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:28 smithi088 ceph-mon[90867]: Upgrade: Updating alertmanager.smithi088 2024-09-17T04:29:29.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:28 smithi088 ceph-mon[90867]: Deploying daemon alertmanager.smithi088 on smithi088 2024-09-17T04:29:29.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:28 smithi134 ceph-mon[76677]: Upgrade: Updating alertmanager.smithi088 2024-09-17T04:29:29.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:28 smithi134 ceph-mon[76677]: Deploying daemon alertmanager.smithi088 on smithi088 2024-09-17T04:29:30.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:29 smithi088 ceph-mon[90867]: pgmap v257: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:29:30.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:29 smithi134 ceph-mon[76677]: pgmap v257: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:29:32.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:31 smithi088 ceph-mon[90867]: pgmap v258: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:29:32.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:31 smithi134 ceph-mon[76677]: pgmap v258: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:29:34.012 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:33 smithi088 ceph-mon[90867]: pgmap v259: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:29:34.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:33 smithi134 ceph-mon[76677]: pgmap v259: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:29:36.133 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:35 smithi088 ceph-mon[90867]: pgmap v260: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:29:36.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:35 smithi134 ceph-mon[76677]: pgmap v260: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:29:38.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:37 smithi088 ceph-mon[90867]: pgmap v261: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:29:38.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:37 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:38.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:37 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:38.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:37 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:29:38.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:37 smithi134 ceph-mon[76677]: pgmap v261: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:29:38.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:37 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:38.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:37 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:38.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:37 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:29:38.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:38.857+0000 7f66c2186640 1 -- 172.21.15.88:0/1926944585 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66bc101a60 msgr2=0x7f66bc101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:38.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:38.857+0000 7f66c2186640 1 --2- 172.21.15.88:0/1926944585 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66bc101a60 0x7f66bc101ee0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f66b0009880 tx=0x7f66b002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:29:38.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:38.857+0000 7f66c2186640 1 -- 172.21.15.88:0/1926944585 shutdown_connections 2024-09-17T04:29:38.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:38.857+0000 7f66c2186640 1 --2- 172.21.15.88:0/1926944585 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66bc101a60 0x7f66bc101ee0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:38.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:38.857+0000 7f66c2186640 1 --2- 172.21.15.88:0/1926944585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66bc100860 0x7f66bc100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:38.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:38.857+0000 7f66c2186640 1 -- 172.21.15.88:0/1926944585 >> 172.21.15.88:0/1926944585 conn(0x7f66bc0fbff0 msgr2=0x7f66bc0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:29:38.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:38.857+0000 7f66c2186640 1 -- 172.21.15.88:0/1926944585 shutdown_connections 2024-09-17T04:29:38.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:38.857+0000 7f66c2186640 1 -- 172.21.15.88:0/1926944585 wait complete. 2024-09-17T04:29:38.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:38.857+0000 7f66c2186640 1 Processor -- start 2024-09-17T04:29:38.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:38.858+0000 7f66c2186640 1 -- start start 2024-09-17T04:29:38.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:38.858+0000 7f66c2186640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66bc100860 0x7f66bc1972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:29:38.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:38.858+0000 7f66c2186640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66bc101a60 0x7f66bc1977f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:29:38.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:38.858+0000 7f66c2186640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f66bc109680 con 0x7f66bc101a60 2024-09-17T04:29:38.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:38.858+0000 7f66c2186640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f66bc109500 con 0x7f66bc100860 2024-09-17T04:29:38.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:38.858+0000 7f66baffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66bc101a60 0x7f66bc1977f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:29:38.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:38.858+0000 7f66bb7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66bc100860 0x7f66bc1972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:29:38.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:38.858+0000 7f66baffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66bc101a60 0x7f66bc1977f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35580/0 (socket says 172.21.15.88:35580) 2024-09-17T04:29:38.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:38.858+0000 7f66baffd640 1 -- 172.21.15.88:0/1866413521 learned_addr learned my addr 172.21.15.88:0/1866413521 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:29:38.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:38.858+0000 7f66baffd640 1 -- 172.21.15.88:0/1866413521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66bc100860 msgr2=0x7f66bc1972b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:38.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:38.858+0000 7f66baffd640 1 --2- 172.21.15.88:0/1866413521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66bc100860 0x7f66bc1972b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:38.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:38.858+0000 7f66baffd640 1 -- 172.21.15.88:0/1866413521 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66bc197e70 con 0x7f66bc101a60 2024-09-17T04:29:38.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:38.859+0000 7f66baffd640 1 --2- 172.21.15.88:0/1866413521 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66bc101a60 0x7f66bc1977f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f66b0005710 tx=0x7f66b0005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:29:38.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:38.859+0000 7f66b8ff9640 1 -- 172.21.15.88:0/1866413521 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f66b003f030 con 0x7f66bc101a60 2024-09-17T04:29:38.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:38.859+0000 7f66c2186640 1 -- 172.21.15.88:0/1866413521 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66bc19c850 con 0x7f66bc101a60 2024-09-17T04:29:38.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:38.859+0000 7f66c2186640 1 -- 172.21.15.88:0/1866413521 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66bc19cde0 con 0x7f66bc101a60 2024-09-17T04:29:38.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:38.859+0000 7f66b8ff9640 1 -- 172.21.15.88:0/1866413521 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f66b0004b80 con 0x7f66bc101a60 2024-09-17T04:29:38.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:38.859+0000 7f66b8ff9640 1 -- 172.21.15.88:0/1866413521 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f66b0035070 con 0x7f66bc101a60 2024-09-17T04:29:38.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:38.860+0000 7f66c2186640 1 -- 172.21.15.88:0/1866413521 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66a80052c0 con 0x7f66bc101a60 2024-09-17T04:29:38.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:38.861+0000 7f66b8ff9640 1 -- 172.21.15.88:0/1866413521 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f66b0042030 con 0x7f66bc101a60 2024-09-17T04:29:38.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:38.861+0000 7f66b8ff9640 1 --2- 172.21.15.88:0/1866413521 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f66a407af80 0x7f66a407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:29:38.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:38.862+0000 7f66b8ff9640 1 -- 172.21.15.88:0/1866413521 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f66b0040070 con 0x7f66bc101a60 2024-09-17T04:29:38.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:38.862+0000 7f66bb7fe640 1 --2- 172.21.15.88:0/1866413521 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f66a407af80 0x7f66a407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:29:38.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:38.862+0000 7f66bb7fe640 1 --2- 172.21.15.88:0/1866413521 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f66a407af80 0x7f66a407d440 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f66bc1018c0 tx=0x7f66ac00b390 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:29:38.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:38.866+0000 7f66b8ff9640 1 -- 172.21.15.88:0/1866413521 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f66b008a050 con 0x7f66bc101a60 2024-09-17T04:29:39.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.129+0000 7f66c2186640 1 -- 172.21.15.88:0/1866413521 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f66a8000bf0 con 0x7f66a407af80 2024-09-17T04:29:39.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.131+0000 7f66b8ff9640 1 -- 172.21.15.88:0/1866413521 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+465 (secure 0 0 0) 0x7f66a8000bf0 con 0x7f66a407af80 2024-09-17T04:29:39.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.133+0000 7f66c2186640 1 -- 172.21.15.88:0/1866413521 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f66a407af80 msgr2=0x7f66a407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:39.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.133+0000 7f66c2186640 1 --2- 172.21.15.88:0/1866413521 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f66a407af80 0x7f66a407d440 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f66bc1018c0 tx=0x7f66ac00b390 comp rx=0 tx=0).stop 2024-09-17T04:29:39.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.133+0000 7f66c2186640 1 -- 172.21.15.88:0/1866413521 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66bc101a60 msgr2=0x7f66bc1977f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:39.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.133+0000 7f66c2186640 1 --2- 172.21.15.88:0/1866413521 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66bc101a60 0x7f66bc1977f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f66b0005710 tx=0x7f66b0005dc0 comp rx=0 tx=0).stop 2024-09-17T04:29:39.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.134+0000 7f66c2186640 1 -- 172.21.15.88:0/1866413521 shutdown_connections 2024-09-17T04:29:39.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.134+0000 7f66c2186640 1 --2- 172.21.15.88:0/1866413521 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f66a407af80 0x7f66a407d440 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:39.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.134+0000 7f66c2186640 1 --2- 172.21.15.88:0/1866413521 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66bc101a60 0x7f66bc1977f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:39.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.134+0000 7f66c2186640 1 --2- 172.21.15.88:0/1866413521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66bc100860 0x7f66bc1972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:39.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.134+0000 7f66c2186640 1 -- 172.21.15.88:0/1866413521 >> 172.21.15.88:0/1866413521 conn(0x7f66bc0fbff0 msgr2=0x7f66bc0fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:29:39.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.134+0000 7f66c2186640 1 -- 172.21.15.88:0/1866413521 shutdown_connections 2024-09-17T04:29:39.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.134+0000 7f66c2186640 1 -- 172.21.15.88:0/1866413521 wait complete. 2024-09-17T04:29:39.143 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-09-17T04:29:39.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.220+0000 7f63b30cb640 1 -- 172.21.15.88:0/2750101919 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63ac100860 msgr2=0x7f63ac100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:39.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.220+0000 7f63b30cb640 1 --2- 172.21.15.88:0/2750101919 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63ac100860 0x7f63ac100c60 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f63a0009880 tx=0x7f63a002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:29:39.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.220+0000 7f63b30cb640 1 -- 172.21.15.88:0/2750101919 shutdown_connections 2024-09-17T04:29:39.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.220+0000 7f63b30cb640 1 --2- 172.21.15.88:0/2750101919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63ac101a60 0x7f63ac101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:39.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.220+0000 7f63b30cb640 1 --2- 172.21.15.88:0/2750101919 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63ac100860 0x7f63ac100c60 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:39.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.220+0000 7f63b30cb640 1 -- 172.21.15.88:0/2750101919 >> 172.21.15.88:0/2750101919 conn(0x7f63ac0fc010 msgr2=0x7f63ac0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:29:39.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.220+0000 7f63b30cb640 1 -- 172.21.15.88:0/2750101919 shutdown_connections 2024-09-17T04:29:39.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.220+0000 7f63b30cb640 1 -- 172.21.15.88:0/2750101919 wait complete. 2024-09-17T04:29:39.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.221+0000 7f63b30cb640 1 Processor -- start 2024-09-17T04:29:39.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.221+0000 7f63b30cb640 1 -- start start 2024-09-17T04:29:39.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.221+0000 7f63b30cb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63ac100860 0x7f63ac196410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:29:39.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.221+0000 7f63b30cb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63ac101a60 0x7f63ac196950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:29:39.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.221+0000 7f63b30cb640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f63ac109700 con 0x7f63ac100860 2024-09-17T04:29:39.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.221+0000 7f63b30cb640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f63ac109580 con 0x7f63ac101a60 2024-09-17T04:29:39.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.221+0000 7f63b0e67640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63ac100860 0x7f63ac196410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:29:39.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.221+0000 7f63b0e67640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63ac100860 0x7f63ac196410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35608/0 (socket says 172.21.15.88:35608) 2024-09-17T04:29:39.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.221+0000 7f63b0e67640 1 -- 172.21.15.88:0/3845996634 learned_addr learned my addr 172.21.15.88:0/3845996634 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:29:39.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.221+0000 7f63abfff640 1 --2- 172.21.15.88:0/3845996634 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63ac101a60 0x7f63ac196950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:29:39.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.222+0000 7f63b0e67640 1 -- 172.21.15.88:0/3845996634 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63ac101a60 msgr2=0x7f63ac196950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:39.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.222+0000 7f63b0e67640 1 --2- 172.21.15.88:0/3845996634 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63ac101a60 0x7f63ac196950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:39.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.222+0000 7f63b0e67640 1 -- 172.21.15.88:0/3845996634 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63ac196fd0 con 0x7f63ac100860 2024-09-17T04:29:39.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.222+0000 7f63abfff640 1 --2- 172.21.15.88:0/3845996634 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63ac101a60 0x7f63ac196950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:29:39.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.222+0000 7f63b0e67640 1 --2- 172.21.15.88:0/3845996634 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63ac100860 0x7f63ac196410 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f63a0006010 tx=0x7f63a00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:29:39.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.222+0000 7f63a9ffb640 1 -- 172.21.15.88:0/3845996634 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f63a003f070 con 0x7f63ac100860 2024-09-17T04:29:39.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.222+0000 7f63b30cb640 1 -- 172.21.15.88:0/3845996634 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63ac19b9b0 con 0x7f63ac100860 2024-09-17T04:29:39.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.222+0000 7f63a9ffb640 1 -- 172.21.15.88:0/3845996634 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f63a00044d0 con 0x7f63ac100860 2024-09-17T04:29:39.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.222+0000 7f63a9ffb640 1 -- 172.21.15.88:0/3845996634 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f63a0035030 con 0x7f63ac100860 2024-09-17T04:29:39.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.222+0000 7f63b30cb640 1 -- 172.21.15.88:0/3845996634 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63ac19bfc0 con 0x7f63ac100860 2024-09-17T04:29:39.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.223+0000 7f63b30cb640 1 -- 172.21.15.88:0/3845996634 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63ac100c60 con 0x7f63ac100860 2024-09-17T04:29:39.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.224+0000 7f63a9ffb640 1 -- 172.21.15.88:0/3845996634 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f63a0042070 con 0x7f63ac100860 2024-09-17T04:29:39.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.225+0000 7f63a9ffb640 1 --2- 172.21.15.88:0/3845996634 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f639c07af30 0x7f639c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:29:39.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.225+0000 7f63a9ffb640 1 -- 172.21.15.88:0/3845996634 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f63a00bed90 con 0x7f63ac100860 2024-09-17T04:29:39.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.225+0000 7f63abfff640 1 --2- 172.21.15.88:0/3845996634 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f639c07af30 0x7f639c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:29:39.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.225+0000 7f63abfff640 1 --2- 172.21.15.88:0/3845996634 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f639c07af30 0x7f639c07d3f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6398006fd0 tx=0x7f6398008040 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:29:39.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.229+0000 7f63a9ffb640 1 -- 172.21.15.88:0/3845996634 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f63a008a2e0 con 0x7f63ac100860 2024-09-17T04:29:39.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.436+0000 7f63b30cb640 1 -- 172.21.15.88:0/3845996634 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f63ac062630 con 0x7f639c07af30 2024-09-17T04:29:39.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.437+0000 7f63a9ffb640 1 -- 172.21.15.88:0/3845996634 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+465 (secure 0 0 0) 0x7f63ac062630 con 0x7f639c07af30 2024-09-17T04:29:39.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.440+0000 7f63b30cb640 1 -- 172.21.15.88:0/3845996634 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f639c07af30 msgr2=0x7f639c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:39.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.440+0000 7f63b30cb640 1 --2- 172.21.15.88:0/3845996634 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f639c07af30 0x7f639c07d3f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6398006fd0 tx=0x7f6398008040 comp rx=0 tx=0).stop 2024-09-17T04:29:39.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.440+0000 7f63b30cb640 1 -- 172.21.15.88:0/3845996634 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63ac100860 msgr2=0x7f63ac196410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:39.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.440+0000 7f63b30cb640 1 --2- 172.21.15.88:0/3845996634 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63ac100860 0x7f63ac196410 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f63a0006010 tx=0x7f63a00048f0 comp rx=0 tx=0).stop 2024-09-17T04:29:39.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.440+0000 7f63b30cb640 1 -- 172.21.15.88:0/3845996634 shutdown_connections 2024-09-17T04:29:39.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.440+0000 7f63b30cb640 1 --2- 172.21.15.88:0/3845996634 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f639c07af30 0x7f639c07d3f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:39.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.440+0000 7f63b30cb640 1 --2- 172.21.15.88:0/3845996634 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63ac101a60 0x7f63ac196950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:39.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.440+0000 7f63b30cb640 1 --2- 172.21.15.88:0/3845996634 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63ac100860 0x7f63ac196410 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:39.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.440+0000 7f63b30cb640 1 -- 172.21.15.88:0/3845996634 >> 172.21.15.88:0/3845996634 conn(0x7f63ac0fc010 msgr2=0x7f63ac104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:29:39.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.440+0000 7f63b30cb640 1 -- 172.21.15.88:0/3845996634 shutdown_connections 2024-09-17T04:29:39.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.440+0000 7f63b30cb640 1 -- 172.21.15.88:0/3845996634 wait complete. 2024-09-17T04:29:39.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.525+0000 7fe833a14640 1 -- 172.21.15.88:0/1573758266 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe82c100860 msgr2=0x7fe82c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:39.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.525+0000 7fe833a14640 1 --2- 172.21.15.88:0/1573758266 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe82c100860 0x7fe82c100c60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe828009880 tx=0x7fe82802a4a0 comp rx=0 tx=0).stop 2024-09-17T04:29:39.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.525+0000 7fe833a14640 1 -- 172.21.15.88:0/1573758266 shutdown_connections 2024-09-17T04:29:39.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.525+0000 7fe833a14640 1 --2- 172.21.15.88:0/1573758266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe82c101a60 0x7fe82c101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:39.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.525+0000 7fe833a14640 1 --2- 172.21.15.88:0/1573758266 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe82c100860 0x7fe82c100c60 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:39.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.525+0000 7fe833a14640 1 -- 172.21.15.88:0/1573758266 >> 172.21.15.88:0/1573758266 conn(0x7fe82c0fc010 msgr2=0x7fe82c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:29:39.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.525+0000 7fe833a14640 1 -- 172.21.15.88:0/1573758266 shutdown_connections 2024-09-17T04:29:39.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.525+0000 7fe833a14640 1 -- 172.21.15.88:0/1573758266 wait complete. 2024-09-17T04:29:39.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.526+0000 7fe833a14640 1 Processor -- start 2024-09-17T04:29:39.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.526+0000 7fe833a14640 1 -- start start 2024-09-17T04:29:39.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.526+0000 7fe833a14640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe82c100860 0x7fe82c197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:29:39.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.526+0000 7fe833a14640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe82c101a60 0x7fe82c197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:29:39.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.526+0000 7fe833a14640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fe82c1096a0 con 0x7fe82c100860 2024-09-17T04:29:39.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.526+0000 7fe833a14640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe82c109520 con 0x7fe82c101a60 2024-09-17T04:29:39.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.526+0000 7fe8317b0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe82c100860 0x7fe82c197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:29:39.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.526+0000 7fe8317b0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe82c100860 0x7fe82c197520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35632/0 (socket says 172.21.15.88:35632) 2024-09-17T04:29:39.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.526+0000 7fe8317b0640 1 -- 172.21.15.88:0/1588874195 learned_addr learned my addr 172.21.15.88:0/1588874195 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:29:39.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.526+0000 7fe830faf640 1 --2- 172.21.15.88:0/1588874195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe82c101a60 0x7fe82c197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:29:39.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.526+0000 7fe8317b0640 1 -- 172.21.15.88:0/1588874195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe82c101a60 msgr2=0x7fe82c197a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:39.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.526+0000 7fe8317b0640 1 --2- 172.21.15.88:0/1588874195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe82c101a60 0x7fe82c197a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:39.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.526+0000 7fe8317b0640 1 -- 172.21.15.88:0/1588874195 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe82c1980e0 con 0x7fe82c100860 2024-09-17T04:29:39.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.527+0000 7fe8317b0640 1 --2- 172.21.15.88:0/1588874195 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe82c100860 0x7fe82c197520 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe828006010 tx=0x7fe8280045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:29:39.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.527+0000 7fe8227fc640 1 -- 172.21.15.88:0/1588874195 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe82803f070 con 0x7fe82c100860 2024-09-17T04:29:39.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.527+0000 7fe8227fc640 1 -- 172.21.15.88:0/1588874195 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe8280049d0 con 0x7fe82c100860 2024-09-17T04:29:39.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.527+0000 7fe833a14640 1 -- 172.21.15.88:0/1588874195 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe82c19cac0 con 0x7fe82c100860 2024-09-17T04:29:39.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.527+0000 7fe8227fc640 1 -- 172.21.15.88:0/1588874195 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe828035030 con 0x7fe82c100860 2024-09-17T04:29:39.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.527+0000 7fe833a14640 1 -- 172.21.15.88:0/1588874195 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe82c19d050 con 0x7fe82c100860 2024-09-17T04:29:39.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.528+0000 7fe833a14640 1 -- 172.21.15.88:0/1588874195 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe82c100c60 con 0x7fe82c100860 2024-09-17T04:29:39.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.529+0000 7fe8227fc640 1 -- 172.21.15.88:0/1588874195 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fe828042070 con 0x7fe82c100860 2024-09-17T04:29:39.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.529+0000 7fe8227fc640 1 --2- 172.21.15.88:0/1588874195 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe81807af30 0x7fe81807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:29:39.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.529+0000 7fe8227fc640 1 -- 172.21.15.88:0/1588874195 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fe8280be860 con 0x7fe82c100860 2024-09-17T04:29:39.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.529+0000 7fe830faf640 1 --2- 172.21.15.88:0/1588874195 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe81807af30 0x7fe81807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:29:39.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.530+0000 7fe830faf640 1 --2- 172.21.15.88:0/1588874195 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe81807af30 0x7fe81807d3f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe82c1989d0 tx=0x7fe81c005f90 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:29:39.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.534+0000 7fe8227fc640 1 -- 172.21.15.88:0/1588874195 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fe828089db0 con 0x7fe82c100860 2024-09-17T04:29:39.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.727+0000 7fe833a14640 1 -- 172.21.15.88:0/1588874195 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fe82c06a460 con 0x7fe81807af30 2024-09-17T04:29:39.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.737+0000 7fe8227fc640 1 -- 172.21.15.88:0/1588874195 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7fe82c06a460 con 0x7fe81807af30 2024-09-17T04:29:39.737 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T04:29:39.737 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 starting - - - - 2024-09-17T04:29:39.738 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi088 smithi088 running (77s) 16s ago 16m 75.4M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 855ea59f1895 2024-09-17T04:29:39.738 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi134 smithi134 running (70s) 42s ago 16m 75.5M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 0e2d1095af7f 2024-09-17T04:29:39.738 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (6m) 16s ago 16m 6891k - 19.3.0-4989-gce1b342b 8e039cb7fe1e 10355648c406 2024-09-17T04:29:39.738 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi134 smithi134 running (6m) 42s ago 16m 6899k - 19.3.0-4989-gce1b342b 8e039cb7fe1e d709085ffe5d 2024-09-17T04:29:39.738 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (15m) 16s ago 16m 79.9M - 9.4.12 2bacad6d85d8 a6cff57a23f9 2024-09-17T04:29:39.738 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.giqrgt smithi088 running (2m) 16s ago 11m 84.4M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 3bb1d05b4476 2024-09-17T04:29:39.738 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.lgavsv smithi088 running (2m) 16s ago 11m 84.4M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 6fb9ba0a8ec3 2024-09-17T04:29:39.738 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi134.ktuhce smithi134 running (109s) 42s ago 11m 155M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 851c1f3a855a 2024-09-17T04:29:39.738 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi134.psnynp smithi134 running (90s) 42s ago 11m 155M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 966e092b224e 2024-09-17T04:29:39.738 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.wmndiv smithi088 *:8443,9283,8765 running (7m) 16s ago 18m 592M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 49eb47f7f14f 2024-09-17T04:29:39.738 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi134.vwdxcb smithi134 *:8443,9283,8765 running (6m) 42s ago 15m 523M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 8a6d45eb0595 2024-09-17T04:29:39.738 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (6m) 16s ago 18m 120M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e ac6332015243 2024-09-17T04:29:39.738 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi134 smithi134 running (6m) 42s ago 15m 105M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e ea49f690e26b 2024-09-17T04:29:39.738 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (50s) 16s ago 16m 8228k - 1.7.0 72c9c2088986 071e9be71e51 2024-09-17T04:29:39.739 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi134 smithi134 *:9100 running (44s) 42s ago 16m 3309k - 1.7.0 72c9c2088986 b5597a275b46 2024-09-17T04:29:39.739 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (5m) 16s ago 14m 166M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 4ef267302248 2024-09-17T04:29:39.739 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (5m) 16s ago 14m 169M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 17b67c13c7aa 2024-09-17T04:29:39.739 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (4m) 16s ago 13m 156M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 83d38ad792c9 2024-09-17T04:29:39.739 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi134 running (3m) 42s ago 13m 170M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e 336a363ac39f 2024-09-17T04:29:39.739 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi134 running (3m) 42s ago 12m 161M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e 6df8a692310a 2024-09-17T04:29:39.739 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi134 running (2m) 42s ago 12m 156M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e 5066799816d3 2024-09-17T04:29:39.739 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (23s) 16s ago 16m 41.4M - 2.51.0 1d3b7f56885b dbff76a1573c 2024-09-17T04:29:39.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.740+0000 7fe833a14640 1 -- 172.21.15.88:0/1588874195 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe81807af30 msgr2=0x7fe81807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:39.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.740+0000 7fe833a14640 1 --2- 172.21.15.88:0/1588874195 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe81807af30 0x7fe81807d3f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe82c1989d0 tx=0x7fe81c005f90 comp rx=0 tx=0).stop 2024-09-17T04:29:39.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.740+0000 7fe833a14640 1 -- 172.21.15.88:0/1588874195 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe82c100860 msgr2=0x7fe82c197520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:39.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.740+0000 7fe833a14640 1 --2- 172.21.15.88:0/1588874195 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe82c100860 0x7fe82c197520 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe828006010 tx=0x7fe8280045e0 comp rx=0 tx=0).stop 2024-09-17T04:29:39.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.740+0000 7fe833a14640 1 -- 172.21.15.88:0/1588874195 shutdown_connections 2024-09-17T04:29:39.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.740+0000 7fe833a14640 1 --2- 172.21.15.88:0/1588874195 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe81807af30 0x7fe81807d3f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:39.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.740+0000 7fe833a14640 1 --2- 172.21.15.88:0/1588874195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe82c101a60 0x7fe82c197a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:39.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.740+0000 7fe833a14640 1 --2- 172.21.15.88:0/1588874195 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe82c100860 0x7fe82c197520 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:39.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.740+0000 7fe833a14640 1 -- 172.21.15.88:0/1588874195 >> 172.21.15.88:0/1588874195 conn(0x7fe82c0fc010 msgr2=0x7fe82c069d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:29:39.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.740+0000 7fe833a14640 1 -- 172.21.15.88:0/1588874195 shutdown_connections 2024-09-17T04:29:39.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.740+0000 7fe833a14640 1 -- 172.21.15.88:0/1588874195 wait complete. 2024-09-17T04:29:39.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.836+0000 7f6155c59640 1 -- 172.21.15.88:0/704356659 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6150102b60 msgr2=0x7f6150102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:39.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.836+0000 7f6155c59640 1 --2- 172.21.15.88:0/704356659 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6150102b60 0x7f6150102fe0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6144009880 tx=0x7f614402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:29:39.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.836+0000 7f6155c59640 1 -- 172.21.15.88:0/704356659 shutdown_connections 2024-09-17T04:29:39.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.836+0000 7f6155c59640 1 --2- 172.21.15.88:0/704356659 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6150102b60 0x7f6150102fe0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:39.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.836+0000 7f6155c59640 1 --2- 172.21.15.88:0/704356659 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6150101960 0x7f6150101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:39.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.836+0000 7f6155c59640 1 -- 172.21.15.88:0/704356659 >> 172.21.15.88:0/704356659 conn(0x7f61500fd0f0 msgr2=0x7f61500ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:29:39.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.836+0000 7f6155c59640 1 -- 172.21.15.88:0/704356659 shutdown_connections 2024-09-17T04:29:39.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.836+0000 7f6155c59640 1 -- 172.21.15.88:0/704356659 wait complete. 2024-09-17T04:29:39.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.837+0000 7f6155c59640 1 Processor -- start 2024-09-17T04:29:39.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.837+0000 7f6155c59640 1 -- start start 2024-09-17T04:29:39.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.837+0000 7f6155c59640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6150101960 0x7f6150197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:29:39.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.837+0000 7f6155c59640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6150102b60 0x7f61501979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:29:39.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.837+0000 7f6155c59640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f615010a7a0 con 0x7f6150101960 2024-09-17T04:29:39.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.837+0000 7f6155c59640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f615010a620 con 0x7f6150102b60 2024-09-17T04:29:39.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.837+0000 7f614f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6150101960 0x7f6150197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:29:39.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.837+0000 7f614f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6150101960 0x7f6150197490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35654/0 (socket says 172.21.15.88:35654) 2024-09-17T04:29:39.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.837+0000 7f614f7fe640 1 -- 172.21.15.88:0/1043431252 learned_addr learned my addr 172.21.15.88:0/1043431252 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:29:39.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.837+0000 7f614effd640 1 --2- 172.21.15.88:0/1043431252 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6150102b60 0x7f61501979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:29:39.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.838+0000 7f614f7fe640 1 -- 172.21.15.88:0/1043431252 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6150102b60 msgr2=0x7f61501979d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:39.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.838+0000 7f614f7fe640 1 --2- 172.21.15.88:0/1043431252 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6150102b60 0x7f61501979d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:39.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.838+0000 7f614f7fe640 1 -- 172.21.15.88:0/1043431252 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6150198050 con 0x7f6150101960 2024-09-17T04:29:39.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.838+0000 7f614f7fe640 1 --2- 172.21.15.88:0/1043431252 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6150101960 0x7f6150197490 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f614000e940 tx=0x7f614000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:29:39.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.838+0000 7f614cff9640 1 -- 172.21.15.88:0/1043431252 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f614000cac0 con 0x7f6150101960 2024-09-17T04:29:39.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.838+0000 7f614cff9640 1 -- 172.21.15.88:0/1043431252 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f614000cc60 con 0x7f6150101960 2024-09-17T04:29:39.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.838+0000 7f614cff9640 1 -- 172.21.15.88:0/1043431252 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6140003e30 con 0x7f6150101960 2024-09-17T04:29:39.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.838+0000 7f6155c59640 1 -- 172.21.15.88:0/1043431252 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f615019ca90 con 0x7f6150101960 2024-09-17T04:29:39.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.838+0000 7f6155c59640 1 -- 172.21.15.88:0/1043431252 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f615019cff0 con 0x7f6150101960 2024-09-17T04:29:39.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.839+0000 7f6155c59640 1 -- 172.21.15.88:0/1043431252 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6150101d60 con 0x7f6150101960 2024-09-17T04:29:39.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.840+0000 7f614cff9640 1 -- 172.21.15.88:0/1043431252 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f6140004000 con 0x7f6150101960 2024-09-17T04:29:39.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.841+0000 7f614cff9640 1 --2- 172.21.15.88:0/1043431252 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f613807afd0 0x7f613807d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:29:39.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.841+0000 7f614effd640 1 --2- 172.21.15.88:0/1043431252 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f613807afd0 0x7f613807d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:29:39.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.841+0000 7f614cff9640 1 -- 172.21.15.88:0/1043431252 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f614009e700 con 0x7f6150101960 2024-09-17T04:29:39.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.841+0000 7f614effd640 1 --2- 172.21.15.88:0/1043431252 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f613807afd0 0x7f613807d490 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6144000c00 tx=0x7f61440058d0 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:29:39.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:39.849+0000 7f614cff9640 1 -- 172.21.15.88:0/1043431252 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f6140069cb0 con 0x7f6150101960 2024-09-17T04:29:40.027 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:39 smithi088 ceph-mon[90867]: pgmap v262: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:29:40.028 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:39 smithi088 ceph-mon[90867]: from='client.34444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:29:40.028 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:39 smithi088 ceph-mon[90867]: from='client.34448 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:29:40.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.110+0000 7f6155c59640 1 -- 172.21.15.88:0/1043431252 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f6150062df0 con 0x7f6150101960 2024-09-17T04:29:40.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.111+0000 7f614cff9640 1 -- 172.21.15.88:0/1043431252 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f614006eb60 con 0x7f6150101960 2024-09-17T04:29:40.111 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-17T04:29:40.111 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-09-17T04:29:40.111 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T04:29:40.111 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:29:40.111 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-09-17T04:29:40.111 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T04:29:40.111 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:29:40.112 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-09-17T04:29:40.112 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 6 2024-09-17T04:29:40.112 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:29:40.112 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2024-09-17T04:29:40.112 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 4 2024-09-17T04:29:40.112 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:29:40.112 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-09-17T04:29:40.112 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 14 2024-09-17T04:29:40.112 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-17T04:29:40.112 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-17T04:29:40.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.114+0000 7f6155c59640 1 -- 172.21.15.88:0/1043431252 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f613807afd0 msgr2=0x7f613807d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:40.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.114+0000 7f6155c59640 1 --2- 172.21.15.88:0/1043431252 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f613807afd0 0x7f613807d490 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6144000c00 tx=0x7f61440058d0 comp rx=0 tx=0).stop 2024-09-17T04:29:40.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.114+0000 7f6155c59640 1 -- 172.21.15.88:0/1043431252 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6150101960 msgr2=0x7f6150197490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:40.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.114+0000 7f6155c59640 1 --2- 172.21.15.88:0/1043431252 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6150101960 0x7f6150197490 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f614000e940 tx=0x7f614000ee00 comp rx=0 tx=0).stop 2024-09-17T04:29:40.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.114+0000 7f6155c59640 1 -- 172.21.15.88:0/1043431252 shutdown_connections 2024-09-17T04:29:40.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.114+0000 7f6155c59640 1 --2- 172.21.15.88:0/1043431252 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f613807afd0 0x7f613807d490 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:40.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.114+0000 7f6155c59640 1 --2- 172.21.15.88:0/1043431252 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6150102b60 0x7f61501979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:40.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.114+0000 7f6155c59640 1 --2- 172.21.15.88:0/1043431252 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6150101960 0x7f6150197490 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:40.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.114+0000 7f6155c59640 1 -- 172.21.15.88:0/1043431252 >> 172.21.15.88:0/1043431252 conn(0x7f61500fd0f0 msgr2=0x7f6150106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:29:40.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.114+0000 7f6155c59640 1 -- 172.21.15.88:0/1043431252 shutdown_connections 2024-09-17T04:29:40.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.114+0000 7f6155c59640 1 -- 172.21.15.88:0/1043431252 wait complete. 2024-09-17T04:29:40.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:39 smithi134 ceph-mon[76677]: pgmap v262: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:29:40.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:39 smithi134 ceph-mon[76677]: from='client.34444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:29:40.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:39 smithi134 ceph-mon[76677]: from='client.34448 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:29:40.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.200+0000 7f28d838b640 1 -- 172.21.15.88:0/362643896 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28d0102410 msgr2=0x7f28d0104800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:40.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.200+0000 7f28d838b640 1 --2- 172.21.15.88:0/362643896 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28d0102410 0x7f28d0104800 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f28cc0098b0 tx=0x7f28cc02a4d0 comp rx=0 tx=0).stop 2024-09-17T04:29:40.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.200+0000 7f28d838b640 1 -- 172.21.15.88:0/362643896 shutdown_connections 2024-09-17T04:29:40.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.200+0000 7f28d838b640 1 --2- 172.21.15.88:0/362643896 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28d0104d40 0x7f28d0107130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:40.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.200+0000 7f28d838b640 1 --2- 172.21.15.88:0/362643896 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28d0102410 0x7f28d0104800 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:40.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.200+0000 7f28d838b640 1 -- 172.21.15.88:0/362643896 >> 172.21.15.88:0/362643896 conn(0x7f28d00fc010 msgr2=0x7f28d00fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:29:40.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.200+0000 7f28d838b640 1 -- 172.21.15.88:0/362643896 shutdown_connections 2024-09-17T04:29:40.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.200+0000 7f28d838b640 1 -- 172.21.15.88:0/362643896 wait complete. 2024-09-17T04:29:40.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.201+0000 7f28d838b640 1 Processor -- start 2024-09-17T04:29:40.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.201+0000 7f28d838b640 1 -- start start 2024-09-17T04:29:40.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.201+0000 7f28d838b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28d0102410 0x7f28d0197560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:29:40.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.201+0000 7f28d838b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28d0104d40 0x7f28d0197aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:29:40.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.201+0000 7f28d838b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f28d010a800 con 0x7f28d0102410 2024-09-17T04:29:40.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.201+0000 7f28d838b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f28d010a680 con 0x7f28d0104d40 2024-09-17T04:29:40.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.201+0000 7f28d6127640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28d0102410 0x7f28d0197560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:29:40.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.201+0000 7f28d6127640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28d0102410 0x7f28d0197560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35682/0 (socket says 172.21.15.88:35682) 2024-09-17T04:29:40.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.201+0000 7f28d6127640 1 -- 172.21.15.88:0/2889461133 learned_addr learned my addr 172.21.15.88:0/2889461133 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:29:40.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.201+0000 7f28d5926640 1 --2- 172.21.15.88:0/2889461133 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28d0104d40 0x7f28d0197aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:29:40.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.201+0000 7f28d6127640 1 -- 172.21.15.88:0/2889461133 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28d0104d40 msgr2=0x7f28d0197aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:40.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.201+0000 7f28d6127640 1 --2- 172.21.15.88:0/2889461133 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28d0104d40 0x7f28d0197aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:40.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.201+0000 7f28d6127640 1 -- 172.21.15.88:0/2889461133 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28d0198120 con 0x7f28d0102410 2024-09-17T04:29:40.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.202+0000 7f28d6127640 1 --2- 172.21.15.88:0/2889461133 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28d0102410 0x7f28d0197560 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f28cc0099d0 tx=0x7f28cc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:29:40.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.202+0000 7f28c77fe640 1 -- 172.21.15.88:0/2889461133 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f28cc03f070 con 0x7f28d0102410 2024-09-17T04:29:40.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.202+0000 7f28d838b640 1 -- 172.21.15.88:0/2889461133 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28d019cb00 con 0x7f28d0102410 2024-09-17T04:29:40.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.202+0000 7f28c77fe640 1 -- 172.21.15.88:0/2889461133 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f28cc004c70 con 0x7f28d0102410 2024-09-17T04:29:40.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.202+0000 7f28c77fe640 1 -- 172.21.15.88:0/2889461133 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f28cc035030 con 0x7f28d0102410 2024-09-17T04:29:40.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.202+0000 7f28d838b640 1 -- 172.21.15.88:0/2889461133 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28d019d090 con 0x7f28d0102410 2024-09-17T04:29:40.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.203+0000 7f28d838b640 1 -- 172.21.15.88:0/2889461133 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28d01027f0 con 0x7f28d0102410 2024-09-17T04:29:40.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.204+0000 7f28c77fe640 1 -- 172.21.15.88:0/2889461133 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f28cc042070 con 0x7f28d0102410 2024-09-17T04:29:40.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.205+0000 7f28c77fe640 1 --2- 172.21.15.88:0/2889461133 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f28bc07af30 0x7f28bc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:29:40.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.205+0000 7f28c77fe640 1 -- 172.21.15.88:0/2889461133 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f28cc0bece0 con 0x7f28d0102410 2024-09-17T04:29:40.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.205+0000 7f28d5926640 1 --2- 172.21.15.88:0/2889461133 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f28bc07af30 0x7f28bc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:29:40.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.205+0000 7f28d5926640 1 --2- 172.21.15.88:0/2889461133 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f28bc07af30 0x7f28bc07d3f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f28d0198a10 tx=0x7f28c000a250 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:29:40.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.209+0000 7f28c77fe640 1 -- 172.21.15.88:0/2889461133 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f28cc08a230 con 0x7f28d0102410 2024-09-17T04:29:40.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.426+0000 7f28d838b640 1 -- 172.21.15.88:0/2889461133 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f28d019d960 con 0x7f28d0102410 2024-09-17T04:29:40.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.427+0000 7f28c77fe640 1 -- 172.21.15.88:0/2889461133 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 38 v38) ==== 76+0+2047 (secure 0 0 0) 0x7f28cc08f0e0 con 0x7f28d0102410 2024-09-17T04:29:40.427 INFO:teuthology.orchestra.run.smithi088.stdout:e38 2024-09-17T04:29:40.427 INFO:teuthology.orchestra.run.smithi088.stdout:btime 2024-09-17T04:28:17:685888+0000 2024-09-17T04:29:40.427 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T04:29:40.427 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:29:40.427 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2024-09-17T04:29:40.427 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:29:40.427 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2024-09-17T04:29:40.428 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2024-09-17T04:29:40.428 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 38 2024-09-17T04:29:40.428 INFO:teuthology.orchestra.run.smithi088.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T04:29:40.428 INFO:teuthology.orchestra.run.smithi088.stdout:created 2024-09-17T04:18:10.480573+0000 2024-09-17T04:29:40.428 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2024-09-17T04:28:17.685877+0000 2024-09-17T04:29:40.428 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2024-09-17T04:29:40.428 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2024-09-17T04:29:40.428 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2024-09-17T04:29:40.428 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2024-09-17T04:29:40.428 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2024-09-17T04:29:40.428 INFO:teuthology.orchestra.run.smithi088.stdout:max_xattr_size 65536 2024-09-17T04:29:40.428 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2024-09-17T04:29:40.428 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2024-09-17T04:29:40.428 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 82 2024-09-17T04:29:40.429 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:29:40.429 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 1 2024-09-17T04:29:40.429 INFO:teuthology.orchestra.run.smithi088.stdout:in 0 2024-09-17T04:29:40.429 INFO:teuthology.orchestra.run.smithi088.stdout:up {0=34273} 2024-09-17T04:29:40.429 INFO:teuthology.orchestra.run.smithi088.stdout:failed 2024-09-17T04:29:40.429 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2024-09-17T04:29:40.429 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2024-09-17T04:29:40.429 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2024-09-17T04:29:40.429 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2024-09-17T04:29:40.429 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data enabled 2024-09-17T04:29:40.429 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2024-09-17T04:29:40.429 INFO:teuthology.orchestra.run.smithi088.stdout:bal_rank_mask -1 2024-09-17T04:29:40.429 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 1 2024-09-17T04:29:40.429 INFO:teuthology.orchestra.run.smithi088.stdout:qdb_cluster leader: 34273 members: 34273 2024-09-17T04:29:40.430 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi134.ktuhce{0:34273} state up:active seq 8 join_fscid=1 addr [v2:172.21.15.134:6824/3452154372,v1:172.21.15.134:6825/3452154372] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:29:40.430 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi134.psnynp{0:34305} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/3085319848,v1:172.21.15.134:6827/3085319848] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:29:40.430 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:29:40.430 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:29:40.430 INFO:teuthology.orchestra.run.smithi088.stdout:Standby daemons: 2024-09-17T04:29:40.430 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:29:40.430 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.lgavsv{-1:34318} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/3125957194,v1:172.21.15.88:6827/3125957194] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:29:40.430 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.giqrgt{-1:34322} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6828/2683662376,v1:172.21.15.88:6829/2683662376] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:29:40.431 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 38 2024-09-17T04:29:40.431 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.429+0000 7f28d838b640 1 -- 172.21.15.88:0/2889461133 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f28bc07af30 msgr2=0x7f28bc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:40.431 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.429+0000 7f28d838b640 1 --2- 172.21.15.88:0/2889461133 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f28bc07af30 0x7f28bc07d3f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f28d0198a10 tx=0x7f28c000a250 comp rx=0 tx=0).stop 2024-09-17T04:29:40.431 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.429+0000 7f28d838b640 1 -- 172.21.15.88:0/2889461133 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28d0102410 msgr2=0x7f28d0197560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:40.431 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.429+0000 7f28d838b640 1 --2- 172.21.15.88:0/2889461133 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28d0102410 0x7f28d0197560 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f28cc0099d0 tx=0x7f28cc0048f0 comp rx=0 tx=0).stop 2024-09-17T04:29:40.431 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.429+0000 7f28d838b640 1 -- 172.21.15.88:0/2889461133 shutdown_connections 2024-09-17T04:29:40.431 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.429+0000 7f28d838b640 1 --2- 172.21.15.88:0/2889461133 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f28bc07af30 0x7f28bc07d3f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:40.431 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.429+0000 7f28d838b640 1 --2- 172.21.15.88:0/2889461133 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28d0104d40 0x7f28d0197aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:40.431 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.429+0000 7f28d838b640 1 --2- 172.21.15.88:0/2889461133 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28d0102410 0x7f28d0197560 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:40.431 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.429+0000 7f28d838b640 1 -- 172.21.15.88:0/2889461133 >> 172.21.15.88:0/2889461133 conn(0x7f28d00fc010 msgr2=0x7f28d00fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:29:40.431 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.429+0000 7f28d838b640 1 -- 172.21.15.88:0/2889461133 shutdown_connections 2024-09-17T04:29:40.432 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.429+0000 7f28d838b640 1 -- 172.21.15.88:0/2889461133 wait complete. 2024-09-17T04:29:40.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.512+0000 7f03f4444640 1 -- 172.21.15.88:0/961265898 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03ec102b60 msgr2=0x7f03ec102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:40.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.512+0000 7f03f4444640 1 --2- 172.21.15.88:0/961265898 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03ec102b60 0x7f03ec102fe0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f03dc009880 tx=0x7f03dc02a4a0 comp rx=0 tx=0).stop 2024-09-17T04:29:40.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.513+0000 7f03f4444640 1 -- 172.21.15.88:0/961265898 shutdown_connections 2024-09-17T04:29:40.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.513+0000 7f03f4444640 1 --2- 172.21.15.88:0/961265898 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03ec102b60 0x7f03ec102fe0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:40.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.513+0000 7f03f4444640 1 --2- 172.21.15.88:0/961265898 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03ec101960 0x7f03ec101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:40.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.513+0000 7f03f4444640 1 -- 172.21.15.88:0/961265898 >> 172.21.15.88:0/961265898 conn(0x7f03ec0fd0f0 msgr2=0x7f03ec0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:29:40.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.513+0000 7f03f4444640 1 -- 172.21.15.88:0/961265898 shutdown_connections 2024-09-17T04:29:40.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.513+0000 7f03f4444640 1 -- 172.21.15.88:0/961265898 wait complete. 2024-09-17T04:29:40.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.513+0000 7f03f4444640 1 Processor -- start 2024-09-17T04:29:40.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.513+0000 7f03f4444640 1 -- start start 2024-09-17T04:29:40.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.513+0000 7f03f4444640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03ec101960 0x7f03ec075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:29:40.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.514+0000 7f03f4444640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03ec102b60 0x7f03ec0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:29:40.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.514+0000 7f03f4444640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f03ec10a780 con 0x7f03ec102b60 2024-09-17T04:29:40.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.514+0000 7f03f4444640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f03ec10a600 con 0x7f03ec101960 2024-09-17T04:29:40.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.514+0000 7f03f19df640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03ec102b60 0x7f03ec0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:29:40.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.514+0000 7f03f19df640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03ec102b60 0x7f03ec0745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35702/0 (socket says 172.21.15.88:35702) 2024-09-17T04:29:40.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.514+0000 7f03f19df640 1 -- 172.21.15.88:0/1659876112 learned_addr learned my addr 172.21.15.88:0/1659876112 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:29:40.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.514+0000 7f03f21e0640 1 --2- 172.21.15.88:0/1659876112 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03ec101960 0x7f03ec075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:29:40.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.514+0000 7f03f19df640 1 -- 172.21.15.88:0/1659876112 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03ec101960 msgr2=0x7f03ec075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:40.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.514+0000 7f03f19df640 1 --2- 172.21.15.88:0/1659876112 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03ec101960 0x7f03ec075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:40.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.514+0000 7f03f19df640 1 -- 172.21.15.88:0/1659876112 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03ec074b20 con 0x7f03ec102b60 2024-09-17T04:29:40.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.514+0000 7f03f19df640 1 --2- 172.21.15.88:0/1659876112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03ec102b60 0x7f03ec0745e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f03dc009230 tx=0x7f03dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:29:40.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.515+0000 7f03e37fe640 1 -- 172.21.15.88:0/1659876112 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f03dc03f070 con 0x7f03ec102b60 2024-09-17T04:29:40.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.515+0000 7f03f4444640 1 -- 172.21.15.88:0/1659876112 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03ec074db0 con 0x7f03ec102b60 2024-09-17T04:29:40.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.515+0000 7f03f4444640 1 -- 172.21.15.88:0/1659876112 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03ec0752e0 con 0x7f03ec102b60 2024-09-17T04:29:40.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.515+0000 7f03e37fe640 1 -- 172.21.15.88:0/1659876112 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f03dc004b80 con 0x7f03ec102b60 2024-09-17T04:29:40.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.515+0000 7f03e37fe640 1 -- 172.21.15.88:0/1659876112 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f03dc035030 con 0x7f03ec102b60 2024-09-17T04:29:40.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.516+0000 7f03f4444640 1 -- 172.21.15.88:0/1659876112 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03ec101d60 con 0x7f03ec102b60 2024-09-17T04:29:40.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.517+0000 7f03e37fe640 1 -- 172.21.15.88:0/1659876112 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f03dc042070 con 0x7f03ec102b60 2024-09-17T04:29:40.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.517+0000 7f03e37fe640 1 --2- 172.21.15.88:0/1659876112 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f03d807af90 0x7f03d807d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:29:40.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.518+0000 7f03e37fe640 1 -- 172.21.15.88:0/1659876112 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f03dc0bef60 con 0x7f03ec102b60 2024-09-17T04:29:40.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.518+0000 7f03f21e0640 1 --2- 172.21.15.88:0/1659876112 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f03d807af90 0x7f03d807d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:29:40.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.518+0000 7f03f21e0640 1 --2- 172.21.15.88:0/1659876112 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f03d807af90 0x7f03d807d450 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f03e8005fd0 tx=0x7f03e800b410 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:29:40.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.521+0000 7f03e37fe640 1 -- 172.21.15.88:0/1659876112 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f03dc08a5d0 con 0x7f03ec102b60 2024-09-17T04:29:40.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.727+0000 7f03f4444640 1 -- 172.21.15.88:0/1659876112 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f03ec062630 con 0x7f03d807af90 2024-09-17T04:29:40.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.728+0000 7f03e37fe640 1 -- 172.21.15.88:0/1659876112 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+465 (secure 0 0 0) 0x7f03ec062630 con 0x7f03d807af90 2024-09-17T04:29:40.728 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-17T04:29:40.728 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f", 2024-09-17T04:29:40.728 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-09-17T04:29:40.728 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T04:29:40.728 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [ 2024-09-17T04:29:40.728 INFO:teuthology.orchestra.run.smithi088.stdout: "osd", 2024-09-17T04:29:40.728 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr", 2024-09-17T04:29:40.728 INFO:teuthology.orchestra.run.smithi088.stdout: "crash", 2024-09-17T04:29:40.729 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph-exporter", 2024-09-17T04:29:40.729 INFO:teuthology.orchestra.run.smithi088.stdout: "mon", 2024-09-17T04:29:40.729 INFO:teuthology.orchestra.run.smithi088.stdout: "mds" 2024-09-17T04:29:40.729 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-17T04:29:40.729 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "18/23 daemons upgraded", 2024-09-17T04:29:40.729 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading alertmanager daemons", 2024-09-17T04:29:40.729 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-09-17T04:29:40.729 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-17T04:29:40.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.730+0000 7f03f4444640 1 -- 172.21.15.88:0/1659876112 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f03d807af90 msgr2=0x7f03d807d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:40.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.730+0000 7f03f4444640 1 --2- 172.21.15.88:0/1659876112 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f03d807af90 0x7f03d807d450 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f03e8005fd0 tx=0x7f03e800b410 comp rx=0 tx=0).stop 2024-09-17T04:29:40.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.730+0000 7f03f4444640 1 -- 172.21.15.88:0/1659876112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03ec102b60 msgr2=0x7f03ec0745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:40.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.730+0000 7f03f4444640 1 --2- 172.21.15.88:0/1659876112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03ec102b60 0x7f03ec0745e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f03dc009230 tx=0x7f03dc0046c0 comp rx=0 tx=0).stop 2024-09-17T04:29:40.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.730+0000 7f03f4444640 1 -- 172.21.15.88:0/1659876112 shutdown_connections 2024-09-17T04:29:40.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.730+0000 7f03f4444640 1 --2- 172.21.15.88:0/1659876112 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f03d807af90 0x7f03d807d450 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:40.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.730+0000 7f03f4444640 1 --2- 172.21.15.88:0/1659876112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03ec102b60 0x7f03ec0745e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:40.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.730+0000 7f03f4444640 1 --2- 172.21.15.88:0/1659876112 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03ec101960 0x7f03ec075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:40.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.730+0000 7f03f4444640 1 -- 172.21.15.88:0/1659876112 >> 172.21.15.88:0/1659876112 conn(0x7f03ec0fd0f0 msgr2=0x7f03ec106070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:29:40.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.731+0000 7f03f4444640 1 -- 172.21.15.88:0/1659876112 shutdown_connections 2024-09-17T04:29:40.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.731+0000 7f03f4444640 1 -- 172.21.15.88:0/1659876112 wait complete. 2024-09-17T04:29:40.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.814+0000 7f3f72bab640 1 -- 172.21.15.88:0/1843429343 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f6c102b70 msgr2=0x7f3f6c102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:40.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.814+0000 7f3f72bab640 1 --2- 172.21.15.88:0/1843429343 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f6c102b70 0x7f3f6c102ff0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3f58009880 tx=0x7f3f5802a4a0 comp rx=0 tx=0).stop 2024-09-17T04:29:40.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.815+0000 7f3f72bab640 1 -- 172.21.15.88:0/1843429343 shutdown_connections 2024-09-17T04:29:40.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.815+0000 7f3f72bab640 1 --2- 172.21.15.88:0/1843429343 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f6c102b70 0x7f3f6c102ff0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:40.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.815+0000 7f3f72bab640 1 --2- 172.21.15.88:0/1843429343 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f6c101970 0x7f3f6c101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:40.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.815+0000 7f3f72bab640 1 -- 172.21.15.88:0/1843429343 >> 172.21.15.88:0/1843429343 conn(0x7f3f6c0fd140 msgr2=0x7f3f6c0ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:29:40.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.815+0000 7f3f72bab640 1 -- 172.21.15.88:0/1843429343 shutdown_connections 2024-09-17T04:29:40.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.815+0000 7f3f72bab640 1 -- 172.21.15.88:0/1843429343 wait complete. 2024-09-17T04:29:40.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.815+0000 7f3f72bab640 1 Processor -- start 2024-09-17T04:29:40.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.815+0000 7f3f72bab640 1 -- start start 2024-09-17T04:29:40.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.815+0000 7f3f72bab640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f6c101970 0x7f3f6c1974b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:29:40.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.815+0000 7f3f72bab640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f6c102b70 0x7f3f6c1979f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:29:40.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.815+0000 7f3f72bab640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f3f6c10a790 con 0x7f3f6c102b70 2024-09-17T04:29:40.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.815+0000 7f3f72bab640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3f6c10a610 con 0x7f3f6c101970 2024-09-17T04:29:40.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.816+0000 7f3f6bfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f6c102b70 0x7f3f6c1979f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:29:40.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.816+0000 7f3f6bfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f6c102b70 0x7f3f6c1979f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35728/0 (socket says 172.21.15.88:35728) 2024-09-17T04:29:40.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.816+0000 7f3f6bfff640 1 -- 172.21.15.88:0/2373485266 learned_addr learned my addr 172.21.15.88:0/2373485266 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:29:40.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.816+0000 7f3f70947640 1 --2- 172.21.15.88:0/2373485266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f6c101970 0x7f3f6c1974b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:29:40.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.816+0000 7f3f6bfff640 1 -- 172.21.15.88:0/2373485266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f6c101970 msgr2=0x7f3f6c1974b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:40.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.816+0000 7f3f6bfff640 1 --2- 172.21.15.88:0/2373485266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f6c101970 0x7f3f6c1974b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:40.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.816+0000 7f3f6bfff640 1 -- 172.21.15.88:0/2373485266 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f6c198070 con 0x7f3f6c102b70 2024-09-17T04:29:40.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.816+0000 7f3f70947640 1 --2- 172.21.15.88:0/2373485266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f6c101970 0x7f3f6c1974b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:29:40.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.816+0000 7f3f6bfff640 1 --2- 172.21.15.88:0/2373485266 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f6c102b70 0x7f3f6c1979f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3f58006010 tx=0x7f3f58004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:29:40.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.816+0000 7f3f69ffb640 1 -- 172.21.15.88:0/2373485266 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3f5803f070 con 0x7f3f6c102b70 2024-09-17T04:29:40.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.816+0000 7f3f72bab640 1 -- 172.21.15.88:0/2373485266 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f6c19ca50 con 0x7f3f6c102b70 2024-09-17T04:29:40.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.816+0000 7f3f69ffb640 1 -- 172.21.15.88:0/2373485266 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3f580049d0 con 0x7f3f6c102b70 2024-09-17T04:29:40.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.816+0000 7f3f69ffb640 1 -- 172.21.15.88:0/2373485266 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3f58035030 con 0x7f3f6c102b70 2024-09-17T04:29:40.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.817+0000 7f3f72bab640 1 -- 172.21.15.88:0/2373485266 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f6c19cfe0 con 0x7f3f6c102b70 2024-09-17T04:29:40.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.818+0000 7f3f72bab640 1 -- 172.21.15.88:0/2373485266 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f6c101d70 con 0x7f3f6c102b70 2024-09-17T04:29:40.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.819+0000 7f3f69ffb640 1 -- 172.21.15.88:0/2373485266 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f3f58042070 con 0x7f3f6c102b70 2024-09-17T04:29:40.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.819+0000 7f3f69ffb640 1 --2- 172.21.15.88:0/2373485266 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f3f5c07af30 0x7f3f5c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:29:40.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.819+0000 7f3f69ffb640 1 -- 172.21.15.88:0/2373485266 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f3f580bed00 con 0x7f3f6c102b70 2024-09-17T04:29:40.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.819+0000 7f3f70947640 1 --2- 172.21.15.88:0/2373485266 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f3f5c07af30 0x7f3f5c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:29:40.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.820+0000 7f3f70947640 1 --2- 172.21.15.88:0/2373485266 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f3f5c07af30 0x7f3f5c07d3f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c1029d0 tx=0x7f3f60005f90 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:29:40.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:40.824+0000 7f3f69ffb640 1 -- 172.21.15.88:0/2373485266 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f3f580c2030 con 0x7f3f6c102b70 2024-09-17T04:29:41.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:41.093+0000 7f3f72bab640 1 -- 172.21.15.88:0/2373485266 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f3f6c062df0 con 0x7f3f6c102b70 2024-09-17T04:29:41.093 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:40 smithi088 ceph-mon[90867]: from='client.34452 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:29:41.093 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:40 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/1043431252' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:41.093 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:40 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/2889461133' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T04:29:41.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:41.093+0000 7f3f69ffb640 1 -- 172.21.15.88:0/2373485266 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f3f5808a250 con 0x7f3f6c102b70 2024-09-17T04:29:41.094 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T04:29:41.094 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T04:29:41.094 INFO:teuthology.orchestra.run.smithi088.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T04:29:41.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:41.095+0000 7f3f72bab640 1 -- 172.21.15.88:0/2373485266 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f3f5c07af30 msgr2=0x7f3f5c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:41.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:41.095+0000 7f3f72bab640 1 --2- 172.21.15.88:0/2373485266 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f3f5c07af30 0x7f3f5c07d3f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c1029d0 tx=0x7f3f60005f90 comp rx=0 tx=0).stop 2024-09-17T04:29:41.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:41.095+0000 7f3f72bab640 1 -- 172.21.15.88:0/2373485266 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f6c102b70 msgr2=0x7f3f6c1979f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:29:41.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:41.095+0000 7f3f72bab640 1 --2- 172.21.15.88:0/2373485266 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f6c102b70 0x7f3f6c1979f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3f58006010 tx=0x7f3f58004570 comp rx=0 tx=0).stop 2024-09-17T04:29:41.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:41.095+0000 7f3f72bab640 1 -- 172.21.15.88:0/2373485266 shutdown_connections 2024-09-17T04:29:41.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:41.095+0000 7f3f72bab640 1 --2- 172.21.15.88:0/2373485266 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f3f5c07af30 0x7f3f5c07d3f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:41.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:41.095+0000 7f3f72bab640 1 --2- 172.21.15.88:0/2373485266 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f6c102b70 0x7f3f6c1979f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:41.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:41.095+0000 7f3f72bab640 1 --2- 172.21.15.88:0/2373485266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f6c101970 0x7f3f6c1974b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:29:41.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:41.095+0000 7f3f72bab640 1 -- 172.21.15.88:0/2373485266 >> 172.21.15.88:0/2373485266 conn(0x7f3f6c0fd140 msgr2=0x7f3f6c106000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:29:41.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:41.095+0000 7f3f72bab640 1 -- 172.21.15.88:0/2373485266 shutdown_connections 2024-09-17T04:29:41.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:29:41.095+0000 7f3f72bab640 1 -- 172.21.15.88:0/2373485266 wait complete. 2024-09-17T04:29:41.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:40 smithi134 ceph-mon[76677]: from='client.34452 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:29:41.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:40 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/1043431252' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:41.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:40 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/2889461133' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T04:29:42.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:41 smithi088 ceph-mon[90867]: pgmap v263: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:29:42.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:41 smithi088 ceph-mon[90867]: from='client.34464 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:29:42.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:41 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:29:42.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:41 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/2373485266' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T04:29:42.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:41 smithi134 ceph-mon[76677]: pgmap v263: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:29:42.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:41 smithi134 ceph-mon[76677]: from='client.34464 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:29:42.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:41 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:29:42.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:41 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/2373485266' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T04:29:43.430 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:43 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:43.430 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:43 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:43.430 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:43 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:43.430 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:43 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:43.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:43 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:43.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:43 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:43.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:43 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:43.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:43 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:44.460 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:44 smithi088 ceph-mon[90867]: pgmap v264: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:29:44.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:44 smithi134 ceph-mon[76677]: pgmap v264: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:29:46.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:46 smithi088 ceph-mon[90867]: pgmap v265: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:29:46.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:46 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:46.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:46 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:46.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:46 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:29:46.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:46 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:29:46.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:46 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:46.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:46 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "dashboard get-alertmanager-api-host"} : dispatch 2024-09-17T04:29:46.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:46 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:29:46.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:46 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:46.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:46 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:46.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:46 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:46.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:46 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:46.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:46 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:46.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:46 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:46.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:46 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:46.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:46 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:46.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:46 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:46.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:46 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:46.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:46 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:46.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:46 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:46.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:46 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:46.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:46 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:46.390 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:46 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:46.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:46 smithi134 ceph-mon[76677]: pgmap v265: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:29:46.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:46 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:46.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:46 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:46.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:46 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:29:46.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:46 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:29:46.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:46 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:29:46.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:46 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "dashboard get-alertmanager-api-host"} : dispatch 2024-09-17T04:29:46.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:46 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:29:46.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:46 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:46.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:46 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:46.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:46 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:46.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:46 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:46.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:46 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:46.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:46 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:46.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:46 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:46.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:46 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:46.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:46 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:46.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:46 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:46.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:46 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:46.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:46 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:46.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:46 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:46.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:46 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:46.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:46 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:29:47.504 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:47 smithi088 ceph-mon[90867]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T04:29:47.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:47 smithi134 ceph-mon[76677]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T04:29:48.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:48 smithi088 ceph-mon[90867]: pgmap v266: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:29:48.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:48 smithi088 ceph-mon[90867]: Upgrade: Updating grafana.smithi088 2024-09-17T04:29:48.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:48 smithi088 ceph-mon[90867]: Deploying daemon grafana.smithi088 on smithi088 2024-09-17T04:29:48.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:48 smithi134 ceph-mon[76677]: pgmap v266: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:29:48.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:48 smithi134 ceph-mon[76677]: Upgrade: Updating grafana.smithi088 2024-09-17T04:29:48.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:48 smithi134 ceph-mon[76677]: Deploying daemon grafana.smithi088 on smithi088 2024-09-17T04:29:50.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:50 smithi088 ceph-mon[90867]: pgmap v267: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:29:50.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:50 smithi134 ceph-mon[76677]: pgmap v267: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:29:52.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:52 smithi088 ceph-mon[90867]: pgmap v268: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:29:52.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:52 smithi134 ceph-mon[76677]: pgmap v268: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:29:54.597 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:54 smithi134 ceph-mon[76677]: pgmap v269: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:29:54.619 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:54 smithi088 ceph-mon[90867]: pgmap v269: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:29:56.296 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:56 smithi088 ceph-mon[90867]: pgmap v270: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:29:56.296 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:56 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:29:56.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:56 smithi134 ceph-mon[76677]: pgmap v270: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:29:56.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:56 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:29:58.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:29:58 smithi088 ceph-mon[90867]: pgmap v271: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:29:58.645 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:29:58 smithi134 ceph-mon[76677]: pgmap v271: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:30:00.481 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:00 smithi088 ceph-mon[90867]: pgmap v272: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:30:00.481 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:00 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:30:00.481 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:00 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:30:00.481 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:00 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:30:00.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:00 smithi088 ceph-mon[90867]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T04:30:00.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:00 smithi134 ceph-mon[76677]: pgmap v272: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:30:00.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:00 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:30:00.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:00 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:30:00.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:00 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:30:00.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:00 smithi134 ceph-mon[76677]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T04:30:02.532 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:02 smithi088 ceph-mon[90867]: pgmap v273: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:30:02.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:02 smithi134 ceph-mon[76677]: pgmap v273: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:30:04.517 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:04 smithi088 ceph-mon[90867]: pgmap v274: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:30:04.518 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:04 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:30:04.518 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:04 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:30:04.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:04 smithi134 ceph-mon[76677]: pgmap v274: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:30:04.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:04 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:30:04.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:04 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:30:05.548 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:05 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:30:05.548 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:05 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:30:05.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:05 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:30:05.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:05 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:30:06.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:06 smithi088 ceph-mon[90867]: pgmap v275: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:30:06.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:06 smithi134 ceph-mon[76677]: pgmap v275: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:30:08.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:08 smithi088 ceph-mon[90867]: pgmap v276: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:30:08.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:08 smithi134 ceph-mon[76677]: pgmap v276: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:30:10.406 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:10 smithi088 ceph-mon[90867]: pgmap v277: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:30:10.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:10 smithi134 ceph-mon[76677]: pgmap v277: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:30:11.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.180+0000 7f05f8ff1640 1 -- 172.21.15.88:0/3813813467 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05f4101a60 msgr2=0x7f05f4101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:30:11.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.180+0000 7f05f8ff1640 1 --2- 172.21.15.88:0/3813813467 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05f4101a60 0x7f05f4101ee0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f05e8009880 tx=0x7f05e802a4a0 comp rx=0 tx=0).stop 2024-09-17T04:30:11.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.180+0000 7f05f8ff1640 1 -- 172.21.15.88:0/3813813467 shutdown_connections 2024-09-17T04:30:11.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.180+0000 7f05f8ff1640 1 --2- 172.21.15.88:0/3813813467 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05f4101a60 0x7f05f4101ee0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:11.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.180+0000 7f05f8ff1640 1 --2- 172.21.15.88:0/3813813467 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05f4100860 0x7f05f4100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:11.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.180+0000 7f05f8ff1640 1 -- 172.21.15.88:0/3813813467 >> 172.21.15.88:0/3813813467 conn(0x7f05f40fc010 msgr2=0x7f05f40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:30:11.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.180+0000 7f05f8ff1640 1 -- 172.21.15.88:0/3813813467 shutdown_connections 2024-09-17T04:30:11.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.180+0000 7f05f8ff1640 1 -- 172.21.15.88:0/3813813467 wait complete. 2024-09-17T04:30:11.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.181+0000 7f05f8ff1640 1 Processor -- start 2024-09-17T04:30:11.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.181+0000 7f05f8ff1640 1 -- start start 2024-09-17T04:30:11.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.182+0000 7f05f8ff1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05f4100860 0x7f05f41963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:30:11.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.182+0000 7f05f8ff1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05f4101a60 0x7f05f4196920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:30:11.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.182+0000 7f05f8ff1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f05f41096a0 con 0x7f05f4101a60 2024-09-17T04:30:11.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.182+0000 7f05f8ff1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f05f4109520 con 0x7f05f4100860 2024-09-17T04:30:11.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.182+0000 7f05f1d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05f4101a60 0x7f05f4196920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:30:11.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.182+0000 7f05f1d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05f4101a60 0x7f05f4196920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36504/0 (socket says 172.21.15.88:36504) 2024-09-17T04:30:11.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.182+0000 7f05f1d9b640 1 -- 172.21.15.88:0/552924988 learned_addr learned my addr 172.21.15.88:0/552924988 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:30:11.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.182+0000 7f05f259c640 1 --2- 172.21.15.88:0/552924988 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05f4100860 0x7f05f41963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:30:11.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.182+0000 7f05f1d9b640 1 -- 172.21.15.88:0/552924988 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05f4100860 msgr2=0x7f05f41963e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:30:11.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.182+0000 7f05f1d9b640 1 --2- 172.21.15.88:0/552924988 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05f4100860 0x7f05f41963e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:11.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.182+0000 7f05f1d9b640 1 -- 172.21.15.88:0/552924988 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05f4196fa0 con 0x7f05f4101a60 2024-09-17T04:30:11.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.182+0000 7f05f1d9b640 1 --2- 172.21.15.88:0/552924988 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05f4101a60 0x7f05f4196920 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f05e8006010 tx=0x7f05e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:30:11.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.182+0000 7f05e37fe640 1 -- 172.21.15.88:0/552924988 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f05e803f070 con 0x7f05f4101a60 2024-09-17T04:30:11.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.183+0000 7f05f8ff1640 1 -- 172.21.15.88:0/552924988 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05f419b980 con 0x7f05f4101a60 2024-09-17T04:30:11.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.183+0000 7f05e37fe640 1 -- 172.21.15.88:0/552924988 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f05e8004ac0 con 0x7f05f4101a60 2024-09-17T04:30:11.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.183+0000 7f05e37fe640 1 -- 172.21.15.88:0/552924988 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f05e8035030 con 0x7f05f4101a60 2024-09-17T04:30:11.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.183+0000 7f05f8ff1640 1 -- 172.21.15.88:0/552924988 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05f419bf10 con 0x7f05f4101a60 2024-09-17T04:30:11.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.184+0000 7f05f8ff1640 1 -- 172.21.15.88:0/552924988 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05f4100c60 con 0x7f05f4101a60 2024-09-17T04:30:11.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.184+0000 7f05e37fe640 1 -- 172.21.15.88:0/552924988 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f05e8042070 con 0x7f05f4101a60 2024-09-17T04:30:11.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.185+0000 7f05e37fe640 1 --2- 172.21.15.88:0/552924988 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f05dc07af30 0x7f05dc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:30:11.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.185+0000 7f05e37fe640 1 -- 172.21.15.88:0/552924988 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f05e80bed20 con 0x7f05f4101a60 2024-09-17T04:30:11.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.185+0000 7f05f259c640 1 --2- 172.21.15.88:0/552924988 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f05dc07af30 0x7f05dc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:30:11.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.186+0000 7f05f259c640 1 --2- 172.21.15.88:0/552924988 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f05dc07af30 0x7f05dc07d3f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f05ec005fd0 tx=0x7f05ec005850 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:30:11.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.190+0000 7f05e37fe640 1 -- 172.21.15.88:0/552924988 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f05e808a270 con 0x7f05f4101a60 2024-09-17T04:30:11.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:11 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:30:11.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.394+0000 7f05f8ff1640 1 -- 172.21.15.88:0/552924988 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f05f4062630 con 0x7f05dc07af30 2024-09-17T04:30:11.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.395+0000 7f05e37fe640 1 -- 172.21.15.88:0/552924988 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+460 (secure 0 0 0) 0x7f05f4062630 con 0x7f05dc07af30 2024-09-17T04:30:11.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.397+0000 7f05f8ff1640 1 -- 172.21.15.88:0/552924988 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f05dc07af30 msgr2=0x7f05dc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:30:11.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.397+0000 7f05f8ff1640 1 --2- 172.21.15.88:0/552924988 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f05dc07af30 0x7f05dc07d3f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f05ec005fd0 tx=0x7f05ec005850 comp rx=0 tx=0).stop 2024-09-17T04:30:11.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.397+0000 7f05f8ff1640 1 -- 172.21.15.88:0/552924988 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05f4101a60 msgr2=0x7f05f4196920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:30:11.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.397+0000 7f05f8ff1640 1 --2- 172.21.15.88:0/552924988 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05f4101a60 0x7f05f4196920 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f05e8006010 tx=0x7f05e80046c0 comp rx=0 tx=0).stop 2024-09-17T04:30:11.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.397+0000 7f05f8ff1640 1 -- 172.21.15.88:0/552924988 shutdown_connections 2024-09-17T04:30:11.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.397+0000 7f05f8ff1640 1 --2- 172.21.15.88:0/552924988 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f05dc07af30 0x7f05dc07d3f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:11.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.397+0000 7f05f8ff1640 1 --2- 172.21.15.88:0/552924988 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05f4101a60 0x7f05f4196920 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:11.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.397+0000 7f05f8ff1640 1 --2- 172.21.15.88:0/552924988 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05f4100860 0x7f05f41963e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:11.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.397+0000 7f05f8ff1640 1 -- 172.21.15.88:0/552924988 >> 172.21.15.88:0/552924988 conn(0x7f05f40fc010 msgr2=0x7f05f4104f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:30:11.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.397+0000 7f05f8ff1640 1 -- 172.21.15.88:0/552924988 shutdown_connections 2024-09-17T04:30:11.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.397+0000 7f05f8ff1640 1 -- 172.21.15.88:0/552924988 wait complete. 2024-09-17T04:30:11.407 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-09-17T04:30:11.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.482+0000 7fc6a8695640 1 -- 172.21.15.88:0/436306687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6a0102b60 msgr2=0x7fc6a0102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:30:11.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.482+0000 7fc6a8695640 1 --2- 172.21.15.88:0/436306687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6a0102b60 0x7fc6a0102fe0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc690009880 tx=0x7fc69002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:30:11.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.482+0000 7fc6a8695640 1 -- 172.21.15.88:0/436306687 shutdown_connections 2024-09-17T04:30:11.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.482+0000 7fc6a8695640 1 --2- 172.21.15.88:0/436306687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6a0102b60 0x7fc6a0102fe0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:11.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.482+0000 7fc6a8695640 1 --2- 172.21.15.88:0/436306687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6a0101960 0x7fc6a0101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:11.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.482+0000 7fc6a8695640 1 -- 172.21.15.88:0/436306687 >> 172.21.15.88:0/436306687 conn(0x7fc6a00fd0f0 msgr2=0x7fc6a00ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:30:11.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.482+0000 7fc6a8695640 1 -- 172.21.15.88:0/436306687 shutdown_connections 2024-09-17T04:30:11.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.482+0000 7fc6a8695640 1 -- 172.21.15.88:0/436306687 wait complete. 2024-09-17T04:30:11.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.482+0000 7fc6a8695640 1 Processor -- start 2024-09-17T04:30:11.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.483+0000 7fc6a8695640 1 -- start start 2024-09-17T04:30:11.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.483+0000 7fc6a8695640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6a0101960 0x7fc6a01996b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:30:11.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.483+0000 7fc6a8695640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6a0102b60 0x7fc6a0199bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:30:11.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.483+0000 7fc6a8695640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a010a7a0 con 0x7fc6a0102b60 2024-09-17T04:30:11.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.483+0000 7fc6a8695640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a010a620 con 0x7fc6a0101960 2024-09-17T04:30:11.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.483+0000 7fc6a5c30640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6a0102b60 0x7fc6a0199bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:30:11.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.483+0000 7fc6a5c30640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6a0102b60 0x7fc6a0199bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36530/0 (socket says 172.21.15.88:36530) 2024-09-17T04:30:11.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.483+0000 7fc6a5c30640 1 -- 172.21.15.88:0/1110775750 learned_addr learned my addr 172.21.15.88:0/1110775750 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:30:11.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.483+0000 7fc6a6431640 1 --2- 172.21.15.88:0/1110775750 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6a0101960 0x7fc6a01996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:30:11.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.483+0000 7fc6a5c30640 1 -- 172.21.15.88:0/1110775750 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6a0101960 msgr2=0x7fc6a01996b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:30:11.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.483+0000 7fc6a5c30640 1 --2- 172.21.15.88:0/1110775750 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6a0101960 0x7fc6a01996b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:11.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.483+0000 7fc6a5c30640 1 -- 172.21.15.88:0/1110775750 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6a019a270 con 0x7fc6a0102b60 2024-09-17T04:30:11.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.483+0000 7fc6a5c30640 1 --2- 172.21.15.88:0/1110775750 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6a0102b60 0x7fc6a0199bf0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc690006010 tx=0x7fc6900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:30:11.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.483+0000 7fc6977fe640 1 -- 172.21.15.88:0/1110775750 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc69003f070 con 0x7fc6a0102b60 2024-09-17T04:30:11.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.483+0000 7fc6a8695640 1 -- 172.21.15.88:0/1110775750 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6a019ec50 con 0x7fc6a0102b60 2024-09-17T04:30:11.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.483+0000 7fc6977fe640 1 -- 172.21.15.88:0/1110775750 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc690004ac0 con 0x7fc6a0102b60 2024-09-17T04:30:11.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.484+0000 7fc6977fe640 1 -- 172.21.15.88:0/1110775750 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc690035030 con 0x7fc6a0102b60 2024-09-17T04:30:11.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.484+0000 7fc6a8695640 1 -- 172.21.15.88:0/1110775750 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6a019f190 con 0x7fc6a0102b60 2024-09-17T04:30:11.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.484+0000 7fc6a8695640 1 -- 172.21.15.88:0/1110775750 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6a0101d60 con 0x7fc6a0102b60 2024-09-17T04:30:11.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.485+0000 7fc6977fe640 1 -- 172.21.15.88:0/1110775750 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fc690042070 con 0x7fc6a0102b60 2024-09-17T04:30:11.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.486+0000 7fc6977fe640 1 --2- 172.21.15.88:0/1110775750 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fc68c07af30 0x7fc68c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:30:11.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.486+0000 7fc6a6431640 1 --2- 172.21.15.88:0/1110775750 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fc68c07af30 0x7fc68c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:30:11.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.486+0000 7fc6977fe640 1 -- 172.21.15.88:0/1110775750 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fc6900bed20 con 0x7fc6a0102b60 2024-09-17T04:30:11.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.486+0000 7fc6a6431640 1 --2- 172.21.15.88:0/1110775750 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fc68c07af30 0x7fc68c07d3f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc69c005fd0 tx=0x7fc69c005850 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:30:11.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.491+0000 7fc6977fe640 1 -- 172.21.15.88:0/1110775750 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fc69008a270 con 0x7fc6a0102b60 2024-09-17T04:30:11.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:11 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:30:11.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.695+0000 7fc6a8695640 1 -- 172.21.15.88:0/1110775750 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc6a0075dd0 con 0x7fc68c07af30 2024-09-17T04:30:11.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.697+0000 7fc6977fe640 1 -- 172.21.15.88:0/1110775750 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+460 (secure 0 0 0) 0x7fc6a0075dd0 con 0x7fc68c07af30 2024-09-17T04:30:11.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.700+0000 7fc6a8695640 1 -- 172.21.15.88:0/1110775750 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fc68c07af30 msgr2=0x7fc68c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:30:11.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.700+0000 7fc6a8695640 1 --2- 172.21.15.88:0/1110775750 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fc68c07af30 0x7fc68c07d3f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc69c005fd0 tx=0x7fc69c005850 comp rx=0 tx=0).stop 2024-09-17T04:30:11.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.700+0000 7fc6a8695640 1 -- 172.21.15.88:0/1110775750 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6a0102b60 msgr2=0x7fc6a0199bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:30:11.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.700+0000 7fc6a8695640 1 --2- 172.21.15.88:0/1110775750 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6a0102b60 0x7fc6a0199bf0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc690006010 tx=0x7fc6900046c0 comp rx=0 tx=0).stop 2024-09-17T04:30:11.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.700+0000 7fc6a8695640 1 -- 172.21.15.88:0/1110775750 shutdown_connections 2024-09-17T04:30:11.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.700+0000 7fc6a8695640 1 --2- 172.21.15.88:0/1110775750 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fc68c07af30 0x7fc68c07d3f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:11.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.700+0000 7fc6a8695640 1 --2- 172.21.15.88:0/1110775750 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6a0102b60 0x7fc6a0199bf0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:11.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.700+0000 7fc6a8695640 1 --2- 172.21.15.88:0/1110775750 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6a0101960 0x7fc6a01996b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:11.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.700+0000 7fc6a8695640 1 -- 172.21.15.88:0/1110775750 >> 172.21.15.88:0/1110775750 conn(0x7fc6a00fd0f0 msgr2=0x7fc6a00746b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:30:11.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.700+0000 7fc6a8695640 1 -- 172.21.15.88:0/1110775750 shutdown_connections 2024-09-17T04:30:11.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.700+0000 7fc6a8695640 1 -- 172.21.15.88:0/1110775750 wait complete. 2024-09-17T04:30:11.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.790+0000 7f9e7cd89640 1 -- 172.21.15.88:0/2443386636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e781023f0 msgr2=0x7f9e781047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:30:11.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.790+0000 7f9e7cd89640 1 --2- 172.21.15.88:0/2443386636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e781023f0 0x7f9e781047e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9e680098b0 tx=0x7f9e6802a4d0 comp rx=0 tx=0).stop 2024-09-17T04:30:11.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.790+0000 7f9e7cd89640 1 -- 172.21.15.88:0/2443386636 shutdown_connections 2024-09-17T04:30:11.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.790+0000 7f9e7cd89640 1 --2- 172.21.15.88:0/2443386636 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e78104d20 0x7f9e78107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:11.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.790+0000 7f9e7cd89640 1 --2- 172.21.15.88:0/2443386636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e781023f0 0x7f9e781047e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:11.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.790+0000 7f9e7cd89640 1 -- 172.21.15.88:0/2443386636 >> 172.21.15.88:0/2443386636 conn(0x7f9e780fc010 msgr2=0x7f9e780fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:30:11.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.790+0000 7f9e7cd89640 1 -- 172.21.15.88:0/2443386636 shutdown_connections 2024-09-17T04:30:11.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.790+0000 7f9e7cd89640 1 -- 172.21.15.88:0/2443386636 wait complete. 2024-09-17T04:30:11.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.791+0000 7f9e7cd89640 1 Processor -- start 2024-09-17T04:30:11.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.791+0000 7f9e7cd89640 1 -- start start 2024-09-17T04:30:11.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.791+0000 7f9e7cd89640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e781023f0 0x7f9e78197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:30:11.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.791+0000 7f9e7cd89640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e78104d20 0x7f9e78197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:30:11.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.791+0000 7f9e7cd89640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f9e7810a7e0 con 0x7f9e781023f0 2024-09-17T04:30:11.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.791+0000 7f9e7cd89640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9e7810a660 con 0x7f9e78104d20 2024-09-17T04:30:11.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.791+0000 7f9e7659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e781023f0 0x7f9e78197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:30:11.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.791+0000 7f9e7659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e781023f0 0x7f9e78197500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36550/0 (socket says 172.21.15.88:36550) 2024-09-17T04:30:11.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.791+0000 7f9e7659c640 1 -- 172.21.15.88:0/1639268470 learned_addr learned my addr 172.21.15.88:0/1639268470 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:30:11.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.791+0000 7f9e75d9b640 1 --2- 172.21.15.88:0/1639268470 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e78104d20 0x7f9e78197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:30:11.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.792+0000 7f9e7659c640 1 -- 172.21.15.88:0/1639268470 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e78104d20 msgr2=0x7f9e78197a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:30:11.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.792+0000 7f9e7659c640 1 --2- 172.21.15.88:0/1639268470 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e78104d20 0x7f9e78197a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:11.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.792+0000 7f9e7659c640 1 -- 172.21.15.88:0/1639268470 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e781980c0 con 0x7f9e781023f0 2024-09-17T04:30:11.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.792+0000 7f9e75d9b640 1 --2- 172.21.15.88:0/1639268470 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e78104d20 0x7f9e78197a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:30:11.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.792+0000 7f9e7659c640 1 --2- 172.21.15.88:0/1639268470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e781023f0 0x7f9e78197500 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9e680099d0 tx=0x7f9e680045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:30:11.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.792+0000 7f9e677fe640 1 -- 172.21.15.88:0/1639268470 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9e6803f070 con 0x7f9e781023f0 2024-09-17T04:30:11.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.792+0000 7f9e7cd89640 1 -- 172.21.15.88:0/1639268470 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e7819caa0 con 0x7f9e781023f0 2024-09-17T04:30:11.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.792+0000 7f9e677fe640 1 -- 172.21.15.88:0/1639268470 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9e680049d0 con 0x7f9e781023f0 2024-09-17T04:30:11.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.792+0000 7f9e677fe640 1 -- 172.21.15.88:0/1639268470 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9e68035030 con 0x7f9e781023f0 2024-09-17T04:30:11.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.792+0000 7f9e7cd89640 1 -- 172.21.15.88:0/1639268470 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e7819d030 con 0x7f9e781023f0 2024-09-17T04:30:11.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.793+0000 7f9e7cd89640 1 -- 172.21.15.88:0/1639268470 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e781027d0 con 0x7f9e781023f0 2024-09-17T04:30:11.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.794+0000 7f9e677fe640 1 -- 172.21.15.88:0/1639268470 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f9e68042070 con 0x7f9e781023f0 2024-09-17T04:30:11.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.794+0000 7f9e677fe640 1 --2- 172.21.15.88:0/1639268470 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f9e6007af30 0x7f9e6007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:30:11.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.795+0000 7f9e677fe640 1 -- 172.21.15.88:0/1639268470 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f9e680beb80 con 0x7f9e781023f0 2024-09-17T04:30:11.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.795+0000 7f9e75d9b640 1 --2- 172.21.15.88:0/1639268470 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f9e6007af30 0x7f9e6007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:30:11.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.795+0000 7f9e75d9b640 1 --2- 172.21.15.88:0/1639268470 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f9e6007af30 0x7f9e6007d3f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9e781989b0 tx=0x7f9e6c005f90 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:30:11.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:11.799+0000 7f9e677fe640 1 -- 172.21.15.88:0/1639268470 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f9e6808a0d0 con 0x7f9e781023f0 2024-09-17T04:30:12.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.002+0000 7f9e7cd89640 1 -- 172.21.15.88:0/1639268470 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f9e78105680 con 0x7f9e6007af30 2024-09-17T04:30:12.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.012+0000 7f9e677fe640 1 -- 172.21.15.88:0/1639268470 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f9e78105680 con 0x7f9e6007af30 2024-09-17T04:30:12.013 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T04:30:12.013 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (34s) 8s ago 17m 17.5M - 0.27.0 11f11916f8cd 5e15bd0ae38c 2024-09-17T04:30:12.013 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi088 smithi088 running (109s) 8s ago 17m 75.4M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 855ea59f1895 2024-09-17T04:30:12.013 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi134 smithi134 running (102s) 74s ago 16m 75.5M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 0e2d1095af7f 2024-09-17T04:30:12.013 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (6m) 8s ago 17m 6891k - 19.3.0-4989-gce1b342b 8e039cb7fe1e 10355648c406 2024-09-17T04:30:12.013 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi134 smithi134 running (6m) 74s ago 16m 6899k - 19.3.0-4989-gce1b342b 8e039cb7fe1e d709085ffe5d 2024-09-17T04:30:12.014 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (13s) 8s ago 17m 44.3M - 10.4.0 c8b91775d855 728b8d3377b1 2024-09-17T04:30:12.014 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.giqrgt smithi088 running (2m) 8s ago 11m 84.7M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 3bb1d05b4476 2024-09-17T04:30:12.014 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.lgavsv smithi088 running (3m) 8s ago 11m 84.8M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 6fb9ba0a8ec3 2024-09-17T04:30:12.014 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi134.ktuhce smithi134 running (2m) 74s ago 11m 155M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 851c1f3a855a 2024-09-17T04:30:12.014 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi134.psnynp smithi134 running (2m) 74s ago 11m 155M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 966e092b224e 2024-09-17T04:30:12.014 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.wmndiv smithi088 *:8443,9283,8765 running (8m) 8s ago 18m 600M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 49eb47f7f14f 2024-09-17T04:30:12.014 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi134.vwdxcb smithi134 *:8443,9283,8765 running (7m) 74s ago 16m 523M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 8a6d45eb0595 2024-09-17T04:30:12.014 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (7m) 8s ago 18m 124M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e ac6332015243 2024-09-17T04:30:12.014 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi134 smithi134 running (6m) 74s ago 16m 105M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e ea49f690e26b 2024-09-17T04:30:12.014 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (83s) 8s ago 17m 11.9M - 1.7.0 72c9c2088986 071e9be71e51 2024-09-17T04:30:12.014 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi134 smithi134 *:9100 running (77s) 74s ago 16m 3309k - 1.7.0 72c9c2088986 b5597a275b46 2024-09-17T04:30:12.014 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (6m) 8s ago 15m 166M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 4ef267302248 2024-09-17T04:30:12.014 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (5m) 8s ago 14m 170M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 17b67c13c7aa 2024-09-17T04:30:12.014 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (5m) 8s ago 14m 157M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 83d38ad792c9 2024-09-17T04:30:12.015 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi134 running (4m) 74s ago 13m 170M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e 336a363ac39f 2024-09-17T04:30:12.015 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi134 running (3m) 74s ago 13m 161M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e 6df8a692310a 2024-09-17T04:30:12.015 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi134 running (3m) 74s ago 12m 156M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e 5066799816d3 2024-09-17T04:30:12.015 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (55s) 8s ago 16m 45.7M - 2.51.0 1d3b7f56885b dbff76a1573c 2024-09-17T04:30:12.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.014+0000 7f9e7cd89640 1 -- 172.21.15.88:0/1639268470 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f9e6007af30 msgr2=0x7f9e6007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:30:12.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.014+0000 7f9e7cd89640 1 --2- 172.21.15.88:0/1639268470 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f9e6007af30 0x7f9e6007d3f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9e781989b0 tx=0x7f9e6c005f90 comp rx=0 tx=0).stop 2024-09-17T04:30:12.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.014+0000 7f9e7cd89640 1 -- 172.21.15.88:0/1639268470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e781023f0 msgr2=0x7f9e78197500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:30:12.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.014+0000 7f9e7cd89640 1 --2- 172.21.15.88:0/1639268470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e781023f0 0x7f9e78197500 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9e680099d0 tx=0x7f9e680045e0 comp rx=0 tx=0).stop 2024-09-17T04:30:12.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.014+0000 7f9e7cd89640 1 -- 172.21.15.88:0/1639268470 shutdown_connections 2024-09-17T04:30:12.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.014+0000 7f9e7cd89640 1 --2- 172.21.15.88:0/1639268470 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f9e6007af30 0x7f9e6007d3f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:12.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.014+0000 7f9e7cd89640 1 --2- 172.21.15.88:0/1639268470 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e78104d20 0x7f9e78197a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:12.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.014+0000 7f9e7cd89640 1 --2- 172.21.15.88:0/1639268470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e781023f0 0x7f9e78197500 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:12.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.014+0000 7f9e7cd89640 1 -- 172.21.15.88:0/1639268470 >> 172.21.15.88:0/1639268470 conn(0x7f9e780fc010 msgr2=0x7f9e780fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:30:12.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.015+0000 7f9e7cd89640 1 -- 172.21.15.88:0/1639268470 shutdown_connections 2024-09-17T04:30:12.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.015+0000 7f9e7cd89640 1 -- 172.21.15.88:0/1639268470 wait complete. 2024-09-17T04:30:12.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.095+0000 7fddb727e640 1 -- 172.21.15.88:0/611309372 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddb0101960 msgr2=0x7fddb0101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:30:12.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.095+0000 7fddb727e640 1 --2- 172.21.15.88:0/611309372 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddb0101960 0x7fddb0101d60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fddac009880 tx=0x7fddac02a4a0 comp rx=0 tx=0).stop 2024-09-17T04:30:12.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.095+0000 7fddb727e640 1 -- 172.21.15.88:0/611309372 shutdown_connections 2024-09-17T04:30:12.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.095+0000 7fddb727e640 1 --2- 172.21.15.88:0/611309372 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddb0102b60 0x7fddb0102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:12.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.095+0000 7fddb727e640 1 --2- 172.21.15.88:0/611309372 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddb0101960 0x7fddb0101d60 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:12.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.095+0000 7fddb727e640 1 -- 172.21.15.88:0/611309372 >> 172.21.15.88:0/611309372 conn(0x7fddb00fd0f0 msgr2=0x7fddb00ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:30:12.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.095+0000 7fddb727e640 1 -- 172.21.15.88:0/611309372 shutdown_connections 2024-09-17T04:30:12.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.095+0000 7fddb727e640 1 -- 172.21.15.88:0/611309372 wait complete. 2024-09-17T04:30:12.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.096+0000 7fddb727e640 1 Processor -- start 2024-09-17T04:30:12.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.096+0000 7fddb727e640 1 -- start start 2024-09-17T04:30:12.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.096+0000 7fddb727e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddb0101960 0x7fddb0075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:30:12.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.096+0000 7fddb727e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddb0102b60 0x7fddb00745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:30:12.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.096+0000 7fddb727e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fddb010a800 con 0x7fddb0102b60 2024-09-17T04:30:12.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.096+0000 7fddb727e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fddb010a680 con 0x7fddb0101960 2024-09-17T04:30:12.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.096+0000 7fddb4819640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddb0102b60 0x7fddb00745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:30:12.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.096+0000 7fddb4819640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddb0102b60 0x7fddb00745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36570/0 (socket says 172.21.15.88:36570) 2024-09-17T04:30:12.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.096+0000 7fddb4819640 1 -- 172.21.15.88:0/3129466710 learned_addr learned my addr 172.21.15.88:0/3129466710 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:30:12.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.097+0000 7fddb501a640 1 --2- 172.21.15.88:0/3129466710 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddb0101960 0x7fddb0075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:30:12.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.097+0000 7fddb4819640 1 -- 172.21.15.88:0/3129466710 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddb0101960 msgr2=0x7fddb0075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:30:12.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.097+0000 7fddb4819640 1 --2- 172.21.15.88:0/3129466710 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddb0101960 0x7fddb0075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:12.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.097+0000 7fddb4819640 1 -- 172.21.15.88:0/3129466710 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddb0074b20 con 0x7fddb0102b60 2024-09-17T04:30:12.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.097+0000 7fddb4819640 1 --2- 172.21.15.88:0/3129466710 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddb0102b60 0x7fddb00745e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdda400b420 tx=0x7fdda400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:30:12.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.097+0000 7fdda27fc640 1 -- 172.21.15.88:0/3129466710 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdda4011630 con 0x7fddb0102b60 2024-09-17T04:30:12.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.097+0000 7fddb727e640 1 -- 172.21.15.88:0/3129466710 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddb0074e10 con 0x7fddb0102b60 2024-09-17T04:30:12.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.097+0000 7fdda27fc640 1 -- 172.21.15.88:0/3129466710 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdda4016070 con 0x7fddb0102b60 2024-09-17T04:30:12.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.097+0000 7fdda27fc640 1 -- 172.21.15.88:0/3129466710 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdda4010d40 con 0x7fddb0102b60 2024-09-17T04:30:12.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.097+0000 7fddb727e640 1 -- 172.21.15.88:0/3129466710 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddb0075420 con 0x7fddb0102b60 2024-09-17T04:30:12.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.098+0000 7fddb727e640 1 -- 172.21.15.88:0/3129466710 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddb0101d60 con 0x7fddb0102b60 2024-09-17T04:30:12.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.099+0000 7fdda27fc640 1 -- 172.21.15.88:0/3129466710 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fdda401b460 con 0x7fddb0102b60 2024-09-17T04:30:12.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.099+0000 7fdda27fc640 1 --2- 172.21.15.88:0/3129466710 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fdd9c07af30 0x7fdd9c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:30:12.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.099+0000 7fddb501a640 1 --2- 172.21.15.88:0/3129466710 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fdd9c07af30 0x7fdd9c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:30:12.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.100+0000 7fdda27fc640 1 -- 172.21.15.88:0/3129466710 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fdda409d8a0 con 0x7fddb0102b60 2024-09-17T04:30:12.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.100+0000 7fddb501a640 1 --2- 172.21.15.88:0/3129466710 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fdd9c07af30 0x7fdd9c07d3f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fddac000c00 tx=0x7fddac005a20 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:30:12.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.104+0000 7fdda27fc640 1 -- 172.21.15.88:0/3129466710 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fdda4068d90 con 0x7fddb0102b60 2024-09-17T04:30:12.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.350+0000 7fddb727e640 1 -- 172.21.15.88:0/3129466710 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fddb0062df0 con 0x7fddb0102b60 2024-09-17T04:30:12.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.350+0000 7fdda27fc640 1 -- 172.21.15.88:0/3129466710 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fdda406dc40 con 0x7fddb0102b60 2024-09-17T04:30:12.351 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-17T04:30:12.351 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-09-17T04:30:12.351 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T04:30:12.352 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:30:12.352 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-09-17T04:30:12.352 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T04:30:12.352 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:30:12.352 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-09-17T04:30:12.352 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 6 2024-09-17T04:30:12.352 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:30:12.352 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2024-09-17T04:30:12.352 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 4 2024-09-17T04:30:12.352 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:30:12.352 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-09-17T04:30:12.352 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 14 2024-09-17T04:30:12.352 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-17T04:30:12.352 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-17T04:30:12.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.352+0000 7fddb727e640 1 -- 172.21.15.88:0/3129466710 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fdd9c07af30 msgr2=0x7fdd9c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:30:12.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.352+0000 7fddb727e640 1 --2- 172.21.15.88:0/3129466710 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fdd9c07af30 0x7fdd9c07d3f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fddac000c00 tx=0x7fddac005a20 comp rx=0 tx=0).stop 2024-09-17T04:30:12.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.352+0000 7fddb727e640 1 -- 172.21.15.88:0/3129466710 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddb0102b60 msgr2=0x7fddb00745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:30:12.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.352+0000 7fddb727e640 1 --2- 172.21.15.88:0/3129466710 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddb0102b60 0x7fddb00745e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdda400b420 tx=0x7fdda400b8e0 comp rx=0 tx=0).stop 2024-09-17T04:30:12.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.352+0000 7fddb727e640 1 -- 172.21.15.88:0/3129466710 shutdown_connections 2024-09-17T04:30:12.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.352+0000 7fddb727e640 1 --2- 172.21.15.88:0/3129466710 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fdd9c07af30 0x7fdd9c07d3f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:12.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.352+0000 7fddb727e640 1 --2- 172.21.15.88:0/3129466710 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddb0102b60 0x7fddb00745e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:12.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.352+0000 7fddb727e640 1 --2- 172.21.15.88:0/3129466710 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddb0101960 0x7fddb0075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:12.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.352+0000 7fddb727e640 1 -- 172.21.15.88:0/3129466710 >> 172.21.15.88:0/3129466710 conn(0x7fddb00fd0f0 msgr2=0x7fddb0105fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:30:12.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.352+0000 7fddb727e640 1 -- 172.21.15.88:0/3129466710 shutdown_connections 2024-09-17T04:30:12.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.353+0000 7fddb727e640 1 -- 172.21.15.88:0/3129466710 wait complete. 2024-09-17T04:30:12.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.434+0000 7faeeec11640 1 -- 172.21.15.88:0/481649804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faee8101960 msgr2=0x7faee8101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:30:12.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.434+0000 7faeeec11640 1 --2- 172.21.15.88:0/481649804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faee8101960 0x7faee8101d60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7faedc009880 tx=0x7faedc02a4a0 comp rx=0 tx=0).stop 2024-09-17T04:30:12.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.434+0000 7faeeec11640 1 -- 172.21.15.88:0/481649804 shutdown_connections 2024-09-17T04:30:12.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.434+0000 7faeeec11640 1 --2- 172.21.15.88:0/481649804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faee8102b60 0x7faee8102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:12.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.434+0000 7faeeec11640 1 --2- 172.21.15.88:0/481649804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faee8101960 0x7faee8101d60 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:12.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.434+0000 7faeeec11640 1 -- 172.21.15.88:0/481649804 >> 172.21.15.88:0/481649804 conn(0x7faee80fd0f0 msgr2=0x7faee80ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:30:12.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.434+0000 7faeeec11640 1 -- 172.21.15.88:0/481649804 shutdown_connections 2024-09-17T04:30:12.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.434+0000 7faeeec11640 1 -- 172.21.15.88:0/481649804 wait complete. 2024-09-17T04:30:12.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.435+0000 7faeeec11640 1 Processor -- start 2024-09-17T04:30:12.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.435+0000 7faeeec11640 1 -- start start 2024-09-17T04:30:12.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.435+0000 7faeeec11640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faee8101960 0x7faee8197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:30:12.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.435+0000 7faeeec11640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faee8102b60 0x7faee81979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:30:12.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.435+0000 7faeeec11640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7faee810a780 con 0x7faee8101960 2024-09-17T04:30:12.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.435+0000 7faeeec11640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7faee810a600 con 0x7faee8102b60 2024-09-17T04:30:12.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.435+0000 7faeec9ad640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faee8101960 0x7faee8197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:30:12.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.435+0000 7faeec9ad640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faee8101960 0x7faee8197490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53032/0 (socket says 172.21.15.88:53032) 2024-09-17T04:30:12.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.435+0000 7faeec9ad640 1 -- 172.21.15.88:0/1199515632 learned_addr learned my addr 172.21.15.88:0/1199515632 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:30:12.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.435+0000 7faee7fff640 1 --2- 172.21.15.88:0/1199515632 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faee8102b60 0x7faee81979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:30:12.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.435+0000 7faeec9ad640 1 -- 172.21.15.88:0/1199515632 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faee8102b60 msgr2=0x7faee81979d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:30:12.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.435+0000 7faeec9ad640 1 --2- 172.21.15.88:0/1199515632 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faee8102b60 0x7faee81979d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:12.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.435+0000 7faeec9ad640 1 -- 172.21.15.88:0/1199515632 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faee8197fc0 con 0x7faee8101960 2024-09-17T04:30:12.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.435+0000 7faee7fff640 1 --2- 172.21.15.88:0/1199515632 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faee8102b60 0x7faee81979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:30:12.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.435+0000 7faeec9ad640 1 --2- 172.21.15.88:0/1199515632 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faee8101960 0x7faee8197490 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7faedc006010 tx=0x7faedc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:30:12.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.436+0000 7faee5ffb640 1 -- 172.21.15.88:0/1199515632 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faedc03f070 con 0x7faee8101960 2024-09-17T04:30:12.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.436+0000 7faeeec11640 1 -- 172.21.15.88:0/1199515632 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faee819c9d0 con 0x7faee8101960 2024-09-17T04:30:12.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.436+0000 7faee5ffb640 1 -- 172.21.15.88:0/1199515632 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faedc0044d0 con 0x7faee8101960 2024-09-17T04:30:12.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.436+0000 7faee5ffb640 1 -- 172.21.15.88:0/1199515632 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faedc035030 con 0x7faee8101960 2024-09-17T04:30:12.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.436+0000 7faeeec11640 1 -- 172.21.15.88:0/1199515632 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faee819ced0 con 0x7faee8101960 2024-09-17T04:30:12.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.437+0000 7faeeec11640 1 -- 172.21.15.88:0/1199515632 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faee8101d60 con 0x7faee8101960 2024-09-17T04:30:12.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.438+0000 7faee5ffb640 1 -- 172.21.15.88:0/1199515632 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7faedc042070 con 0x7faee8101960 2024-09-17T04:30:12.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.438+0000 7faee5ffb640 1 --2- 172.21.15.88:0/1199515632 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7faed807af80 0x7faed807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:30:12.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.438+0000 7faee5ffb640 1 -- 172.21.15.88:0/1199515632 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7faedc0becf0 con 0x7faee8101960 2024-09-17T04:30:12.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.438+0000 7faee7fff640 1 --2- 172.21.15.88:0/1199515632 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7faed807af80 0x7faed807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:30:12.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.439+0000 7faee7fff640 1 --2- 172.21.15.88:0/1199515632 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7faed807af80 0x7faed807d440 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7faee8198940 tx=0x7faed4005d90 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:30:12.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.443+0000 7faee5ffb640 1 -- 172.21.15.88:0/1199515632 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7faedc08a260 con 0x7faee8101960 2024-09-17T04:30:12.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: pgmap v278: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:30:12.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='client.34472 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:30:12.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:30:12.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:30:12.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:30:12.639 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:30:12.639 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:30:12.639 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "dashboard get-grafana-api-url"} : dispatch 2024-09-17T04:30:12.639 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:30:12.639 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:30:12.639 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:30:12.639 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:30:12.639 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:30:12.639 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:30:12.639 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:30:12.640 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:30:12.640 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:30:12.640 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:30:12.640 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:30:12.640 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:30:12.640 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:30:12.640 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:30:12.640 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:30:12.640 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:30:12.640 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:30:12.640 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:30:12.640 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:30:12.641 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:30:12.641 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-17T04:30:12.641 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-17T04:30:12.641 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-17T04:30:12.641 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-17T04:30:12.641 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-17T04:30:12.641 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-17T04:30:12.641 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-17T04:30:12.641 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-17T04:30:12.641 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-17T04:30:12.641 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-17T04:30:12.642 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-17T04:30:12.642 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-17T04:30:12.642 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-17T04:30:12.642 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-17T04:30:12.642 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-17T04:30:12.642 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-17T04:30:12.642 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-17T04:30:12.642 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-17T04:30:12.642 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-17T04:30:12.642 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-17T04:30:12.642 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-17T04:30:12.643 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-17T04:30:12.643 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-17T04:30:12.643 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-17T04:30:12.643 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-17T04:30:12.643 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-17T04:30:12.643 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-17T04:30:12.643 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-17T04:30:12.643 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-17T04:30:12.643 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-17T04:30:12.643 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-17T04:30:12.643 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:30:12.643 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:30:12.644 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:30:12.644 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:30:12.644 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:30:12.644 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:30:12.644 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:30:12.644 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:30:12.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: pgmap v278: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:30:12.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='client.34472 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:30:12.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:30:12.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:30:12.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:30:12.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:30:12.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:30:12.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "dashboard get-grafana-api-url"} : dispatch 2024-09-17T04:30:12.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:30:12.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:30:12.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:30:12.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:30:12.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:30:12.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:30:12.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:30:12.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:30:12.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:30:12.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:30:12.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:30:12.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:30:12.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:30:12.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:30:12.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:30:12.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:30:12.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:30:12.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:30:12.649 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:30:12.649 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:30:12.649 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-17T04:30:12.649 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-17T04:30:12.649 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-17T04:30:12.649 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-17T04:30:12.649 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-17T04:30:12.650 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-17T04:30:12.650 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-17T04:30:12.650 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-17T04:30:12.650 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-17T04:30:12.650 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-17T04:30:12.650 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-17T04:30:12.650 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-17T04:30:12.650 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-17T04:30:12.650 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-17T04:30:12.650 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-17T04:30:12.650 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-17T04:30:12.651 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-17T04:30:12.651 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-17T04:30:12.651 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-17T04:30:12.651 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-17T04:30:12.651 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-17T04:30:12.651 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-17T04:30:12.651 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-17T04:30:12.651 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-17T04:30:12.651 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-17T04:30:12.651 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-17T04:30:12.651 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-17T04:30:12.652 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-17T04:30:12.652 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-17T04:30:12.652 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-17T04:30:12.652 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-17T04:30:12.652 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:30:12.652 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:30:12.652 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:30:12.652 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:30:12.652 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:30:12.652 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:30:12.652 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:30:12.653 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:30:12.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.656+0000 7faeeec11640 1 -- 172.21.15.88:0/1199515632 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7faee8191590 con 0x7faee8101960 2024-09-17T04:30:12.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.656+0000 7faee5ffb640 1 -- 172.21.15.88:0/1199515632 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 38 v38) ==== 76+0+2047 (secure 0 0 0) 0x7faedc08f110 con 0x7faee8101960 2024-09-17T04:30:12.657 INFO:teuthology.orchestra.run.smithi088.stdout:e38 2024-09-17T04:30:12.657 INFO:teuthology.orchestra.run.smithi088.stdout:btime 2024-09-17T04:28:17:685888+0000 2024-09-17T04:30:12.657 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T04:30:12.657 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:30:12.658 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2024-09-17T04:30:12.658 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:30:12.658 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2024-09-17T04:30:12.658 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2024-09-17T04:30:12.658 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 38 2024-09-17T04:30:12.658 INFO:teuthology.orchestra.run.smithi088.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T04:30:12.658 INFO:teuthology.orchestra.run.smithi088.stdout:created 2024-09-17T04:18:10.480573+0000 2024-09-17T04:30:12.658 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2024-09-17T04:28:17.685877+0000 2024-09-17T04:30:12.658 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2024-09-17T04:30:12.658 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2024-09-17T04:30:12.658 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2024-09-17T04:30:12.659 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2024-09-17T04:30:12.659 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2024-09-17T04:30:12.659 INFO:teuthology.orchestra.run.smithi088.stdout:max_xattr_size 65536 2024-09-17T04:30:12.659 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2024-09-17T04:30:12.659 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2024-09-17T04:30:12.659 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 82 2024-09-17T04:30:12.659 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:30:12.659 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 1 2024-09-17T04:30:12.659 INFO:teuthology.orchestra.run.smithi088.stdout:in 0 2024-09-17T04:30:12.659 INFO:teuthology.orchestra.run.smithi088.stdout:up {0=34273} 2024-09-17T04:30:12.659 INFO:teuthology.orchestra.run.smithi088.stdout:failed 2024-09-17T04:30:12.659 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2024-09-17T04:30:12.660 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2024-09-17T04:30:12.660 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2024-09-17T04:30:12.660 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2024-09-17T04:30:12.660 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data enabled 2024-09-17T04:30:12.660 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2024-09-17T04:30:12.660 INFO:teuthology.orchestra.run.smithi088.stdout:bal_rank_mask -1 2024-09-17T04:30:12.660 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 1 2024-09-17T04:30:12.660 INFO:teuthology.orchestra.run.smithi088.stdout:qdb_cluster leader: 34273 members: 34273 2024-09-17T04:30:12.660 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi134.ktuhce{0:34273} state up:active seq 8 join_fscid=1 addr [v2:172.21.15.134:6824/3452154372,v1:172.21.15.134:6825/3452154372] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:30:12.660 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi134.psnynp{0:34305} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/3085319848,v1:172.21.15.134:6827/3085319848] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:30:12.660 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:30:12.661 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:30:12.661 INFO:teuthology.orchestra.run.smithi088.stdout:Standby daemons: 2024-09-17T04:30:12.661 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:30:12.661 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.lgavsv{-1:34318} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/3125957194,v1:172.21.15.88:6827/3125957194] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:30:12.661 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.giqrgt{-1:34322} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6828/2683662376,v1:172.21.15.88:6829/2683662376] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:30:12.662 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 38 2024-09-17T04:30:12.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.658+0000 7faeeec11640 1 -- 172.21.15.88:0/1199515632 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7faed807af80 msgr2=0x7faed807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:30:12.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.658+0000 7faeeec11640 1 --2- 172.21.15.88:0/1199515632 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7faed807af80 0x7faed807d440 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7faee8198940 tx=0x7faed4005d90 comp rx=0 tx=0).stop 2024-09-17T04:30:12.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.658+0000 7faeeec11640 1 -- 172.21.15.88:0/1199515632 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faee8101960 msgr2=0x7faee8197490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:30:12.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.658+0000 7faeeec11640 1 --2- 172.21.15.88:0/1199515632 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faee8101960 0x7faee8197490 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7faedc006010 tx=0x7faedc0048f0 comp rx=0 tx=0).stop 2024-09-17T04:30:12.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.658+0000 7faeeec11640 1 -- 172.21.15.88:0/1199515632 shutdown_connections 2024-09-17T04:30:12.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.658+0000 7faeeec11640 1 --2- 172.21.15.88:0/1199515632 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7faed807af80 0x7faed807d440 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:12.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.658+0000 7faeeec11640 1 --2- 172.21.15.88:0/1199515632 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faee8102b60 0x7faee81979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:12.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.658+0000 7faeeec11640 1 --2- 172.21.15.88:0/1199515632 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faee8101960 0x7faee8197490 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:12.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.658+0000 7faeeec11640 1 -- 172.21.15.88:0/1199515632 >> 172.21.15.88:0/1199515632 conn(0x7faee80fd0f0 msgr2=0x7faee8105fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:30:12.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.658+0000 7faeeec11640 1 -- 172.21.15.88:0/1199515632 shutdown_connections 2024-09-17T04:30:12.663 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.658+0000 7faeeec11640 1 -- 172.21.15.88:0/1199515632 wait complete. 2024-09-17T04:30:12.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.741+0000 7f5f71446640 1 -- 172.21.15.88:0/4003012273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f6c101960 msgr2=0x7f5f6c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:30:12.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.741+0000 7f5f71446640 1 --2- 172.21.15.88:0/4003012273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f6c101960 0x7f5f6c101d60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c009880 tx=0x7f5f5c02a4a0 comp rx=0 tx=0).stop 2024-09-17T04:30:12.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.741+0000 7f5f71446640 1 -- 172.21.15.88:0/4003012273 shutdown_connections 2024-09-17T04:30:12.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.741+0000 7f5f71446640 1 --2- 172.21.15.88:0/4003012273 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f6c102b60 0x7f5f6c102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:12.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.741+0000 7f5f71446640 1 --2- 172.21.15.88:0/4003012273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f6c101960 0x7f5f6c101d60 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:12.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.741+0000 7f5f71446640 1 -- 172.21.15.88:0/4003012273 >> 172.21.15.88:0/4003012273 conn(0x7f5f6c0fd0f0 msgr2=0x7f5f6c0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:30:12.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.741+0000 7f5f71446640 1 -- 172.21.15.88:0/4003012273 shutdown_connections 2024-09-17T04:30:12.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.741+0000 7f5f71446640 1 -- 172.21.15.88:0/4003012273 wait complete. 2024-09-17T04:30:12.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.742+0000 7f5f71446640 1 Processor -- start 2024-09-17T04:30:12.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.742+0000 7f5f71446640 1 -- start start 2024-09-17T04:30:12.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.742+0000 7f5f71446640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f6c101960 0x7f5f6c075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:30:12.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.742+0000 7f5f71446640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f6c102b60 0x7f5f6c0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:30:12.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.742+0000 7f5f71446640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f5f6c10a780 con 0x7f5f6c102b60 2024-09-17T04:30:12.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.742+0000 7f5f71446640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5f6c10a600 con 0x7f5f6c101960 2024-09-17T04:30:12.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.742+0000 7f5f63fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f6c102b60 0x7f5f6c0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:30:12.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.742+0000 7f5f63fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f6c102b60 0x7f5f6c0745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53048/0 (socket says 172.21.15.88:53048) 2024-09-17T04:30:12.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.742+0000 7f5f63fff640 1 -- 172.21.15.88:0/431970973 learned_addr learned my addr 172.21.15.88:0/431970973 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:30:12.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.742+0000 7f5f6affd640 1 --2- 172.21.15.88:0/431970973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f6c101960 0x7f5f6c075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:30:12.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.743+0000 7f5f63fff640 1 -- 172.21.15.88:0/431970973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f6c101960 msgr2=0x7f5f6c075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:30:12.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.743+0000 7f5f63fff640 1 --2- 172.21.15.88:0/431970973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f6c101960 0x7f5f6c075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:12.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.743+0000 7f5f63fff640 1 -- 172.21.15.88:0/431970973 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f6c074b20 con 0x7f5f6c102b60 2024-09-17T04:30:12.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.743+0000 7f5f63fff640 1 --2- 172.21.15.88:0/431970973 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f6c102b60 0x7f5f6c0745e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5f5400c810 tx=0x7f5f5400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:30:12.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.743+0000 7f5f68ff9640 1 -- 172.21.15.88:0/431970973 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5f54004020 con 0x7f5f6c102b60 2024-09-17T04:30:12.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.743+0000 7f5f71446640 1 -- 172.21.15.88:0/431970973 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f6c074e10 con 0x7f5f6c102b60 2024-09-17T04:30:12.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.743+0000 7f5f68ff9640 1 -- 172.21.15.88:0/431970973 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5f540041c0 con 0x7f5f6c102b60 2024-09-17T04:30:12.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.743+0000 7f5f71446640 1 -- 172.21.15.88:0/431970973 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f6c0753a0 con 0x7f5f6c102b60 2024-09-17T04:30:12.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.743+0000 7f5f68ff9640 1 -- 172.21.15.88:0/431970973 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5f540047a0 con 0x7f5f6c102b60 2024-09-17T04:30:12.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.744+0000 7f5f71446640 1 -- 172.21.15.88:0/431970973 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f6c101d60 con 0x7f5f6c102b60 2024-09-17T04:30:12.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.745+0000 7f5f68ff9640 1 -- 172.21.15.88:0/431970973 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f5f540079b0 con 0x7f5f6c102b60 2024-09-17T04:30:12.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.745+0000 7f5f68ff9640 1 --2- 172.21.15.88:0/431970973 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f5f5807af30 0x7f5f5807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:30:12.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.746+0000 7f5f68ff9640 1 -- 172.21.15.88:0/431970973 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f5f5409dfc0 con 0x7f5f6c102b60 2024-09-17T04:30:12.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.746+0000 7f5f6affd640 1 --2- 172.21.15.88:0/431970973 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f5f5807af30 0x7f5f5807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:30:12.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.746+0000 7f5f6affd640 1 --2- 172.21.15.88:0/431970973 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f5f5807af30 0x7f5f5807d3f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c009230 tx=0x7f5f5c0058d0 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:30:12.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.750+0000 7f5f68ff9640 1 -- 172.21.15.88:0/431970973 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f5f54014030 con 0x7f5f6c102b60 2024-09-17T04:30:12.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.942+0000 7f5f71446640 1 -- 172.21.15.88:0/431970973 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5f6c062630 con 0x7f5f5807af30 2024-09-17T04:30:12.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.944+0000 7f5f68ff9640 1 -- 172.21.15.88:0/431970973 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+175 (secure 0 0 0) 0x7f5f6c062630 con 0x7f5f5807af30 2024-09-17T04:30:12.945 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-17T04:30:12.945 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": null, 2024-09-17T04:30:12.945 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": false, 2024-09-17T04:30:12.945 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "", 2024-09-17T04:30:12.945 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [], 2024-09-17T04:30:12.945 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": null, 2024-09-17T04:30:12.945 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "", 2024-09-17T04:30:12.945 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-09-17T04:30:12.945 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-17T04:30:12.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.946+0000 7f5f71446640 1 -- 172.21.15.88:0/431970973 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f5f5807af30 msgr2=0x7f5f5807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:30:12.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.946+0000 7f5f71446640 1 --2- 172.21.15.88:0/431970973 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f5f5807af30 0x7f5f5807d3f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c009230 tx=0x7f5f5c0058d0 comp rx=0 tx=0).stop 2024-09-17T04:30:12.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.946+0000 7f5f71446640 1 -- 172.21.15.88:0/431970973 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f6c102b60 msgr2=0x7f5f6c0745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:30:12.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.946+0000 7f5f71446640 1 --2- 172.21.15.88:0/431970973 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f6c102b60 0x7f5f6c0745e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5f5400c810 tx=0x7f5f5400ccd0 comp rx=0 tx=0).stop 2024-09-17T04:30:12.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.946+0000 7f5f71446640 1 -- 172.21.15.88:0/431970973 shutdown_connections 2024-09-17T04:30:12.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.946+0000 7f5f71446640 1 --2- 172.21.15.88:0/431970973 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f5f5807af30 0x7f5f5807d3f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:12.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.946+0000 7f5f71446640 1 --2- 172.21.15.88:0/431970973 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f6c102b60 0x7f5f6c0745e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:12.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.946+0000 7f5f71446640 1 --2- 172.21.15.88:0/431970973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f6c101960 0x7f5f6c075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:12.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.946+0000 7f5f71446640 1 -- 172.21.15.88:0/431970973 >> 172.21.15.88:0/431970973 conn(0x7f5f6c0fd0f0 msgr2=0x7f5f6c105fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:30:12.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.946+0000 7f5f71446640 1 -- 172.21.15.88:0/431970973 shutdown_connections 2024-09-17T04:30:12.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:12.946+0000 7f5f71446640 1 -- 172.21.15.88:0/431970973 wait complete. 2024-09-17T04:30:13.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:13.028+0000 7f7cf4c65640 1 -- 172.21.15.88:0/4192608532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7cf0100af0 msgr2=0x7f7cf0100f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:30:13.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:13.028+0000 7f7cf4c65640 1 --2- 172.21.15.88:0/4192608532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7cf0100af0 0x7f7cf0100f70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8009880 tx=0x7f7cd802a4a0 comp rx=0 tx=0).stop 2024-09-17T04:30:13.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:13.028+0000 7f7cf4c65640 1 -- 172.21.15.88:0/4192608532 shutdown_connections 2024-09-17T04:30:13.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:13.028+0000 7f7cf4c65640 1 --2- 172.21.15.88:0/4192608532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7cf0100af0 0x7f7cf0100f70 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:13.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:13.028+0000 7f7cf4c65640 1 --2- 172.21.15.88:0/4192608532 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cf0101e40 0x7f7cf0102240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:13.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:13.028+0000 7f7cf4c65640 1 -- 172.21.15.88:0/4192608532 >> 172.21.15.88:0/4192608532 conn(0x7f7cf00fb770 msgr2=0x7f7cf00fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:30:13.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:13.028+0000 7f7cf4c65640 1 -- 172.21.15.88:0/4192608532 shutdown_connections 2024-09-17T04:30:13.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:13.028+0000 7f7cf4c65640 1 -- 172.21.15.88:0/4192608532 wait complete. 2024-09-17T04:30:13.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:13.029+0000 7f7cf4c65640 1 Processor -- start 2024-09-17T04:30:13.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:13.029+0000 7f7cf4c65640 1 -- start start 2024-09-17T04:30:13.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:13.029+0000 7f7cf4c65640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cf0100af0 0x7f7cf0104820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:30:13.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:13.029+0000 7f7cf4c65640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7cf0101e40 0x7f7cf0102ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:30:13.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:13.029+0000 7f7cf4c65640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf01096a0 con 0x7f7cf0101e40 2024-09-17T04:30:13.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:13.029+0000 7f7cf4c65640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf0109520 con 0x7f7cf0100af0 2024-09-17T04:30:13.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:13.029+0000 7f7cedd9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7cf0101e40 0x7f7cf0102ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:30:13.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:13.029+0000 7f7cedd9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7cf0101e40 0x7f7cf0102ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53072/0 (socket says 172.21.15.88:53072) 2024-09-17T04:30:13.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:13.029+0000 7f7cedd9b640 1 -- 172.21.15.88:0/698845824 learned_addr learned my addr 172.21.15.88:0/698845824 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:30:13.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:13.029+0000 7f7cee59c640 1 --2- 172.21.15.88:0/698845824 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cf0100af0 0x7f7cf0104820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:30:13.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:13.029+0000 7f7cedd9b640 1 -- 172.21.15.88:0/698845824 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cf0100af0 msgr2=0x7f7cf0104820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:30:13.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:13.029+0000 7f7cedd9b640 1 --2- 172.21.15.88:0/698845824 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cf0100af0 0x7f7cf0104820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:13.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:13.029+0000 7f7cedd9b640 1 -- 172.21.15.88:0/698845824 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf0103420 con 0x7f7cf0101e40 2024-09-17T04:30:13.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:13.029+0000 7f7cedd9b640 1 --2- 172.21.15.88:0/698845824 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7cf0101e40 0x7f7cf0102ee0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8006010 tx=0x7f7cd80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:30:13.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:13.030+0000 7f7ce77fe640 1 -- 172.21.15.88:0/698845824 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7cd803f070 con 0x7f7cf0101e40 2024-09-17T04:30:13.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:13.030+0000 7f7ce77fe640 1 -- 172.21.15.88:0/698845824 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7cd8004ac0 con 0x7f7cf0101e40 2024-09-17T04:30:13.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:13.030+0000 7f7cf4c65640 1 -- 172.21.15.88:0/698845824 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cf01036b0 con 0x7f7cf0101e40 2024-09-17T04:30:13.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:13.030+0000 7f7ce77fe640 1 -- 172.21.15.88:0/698845824 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7cd8035030 con 0x7f7cf0101e40 2024-09-17T04:30:13.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:13.030+0000 7f7cf4c65640 1 -- 172.21.15.88:0/698845824 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cf0103be0 con 0x7f7cf0101e40 2024-09-17T04:30:13.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:13.031+0000 7f7cf4c65640 1 -- 172.21.15.88:0/698845824 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cf0100f70 con 0x7f7cf0101e40 2024-09-17T04:30:13.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:13.031+0000 7f7ce77fe640 1 -- 172.21.15.88:0/698845824 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f7cd8042070 con 0x7f7cf0101e40 2024-09-17T04:30:13.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:13.032+0000 7f7ce77fe640 1 --2- 172.21.15.88:0/698845824 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f7cdc07af80 0x7f7cdc07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:30:13.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:13.032+0000 7f7ce77fe640 1 -- 172.21.15.88:0/698845824 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f7cd80bec90 con 0x7f7cf0101e40 2024-09-17T04:30:13.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:13.032+0000 7f7cee59c640 1 --2- 172.21.15.88:0/698845824 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f7cdc07af80 0x7f7cdc07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:30:13.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:13.033+0000 7f7cee59c640 1 --2- 172.21.15.88:0/698845824 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f7cdc07af80 0x7f7cdc07d440 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7ce0005fd0 tx=0x7f7ce0005850 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:30:13.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:13.037+0000 7f7ce77fe640 1 -- 172.21.15.88:0/698845824 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f7cd808a260 con 0x7f7cf0101e40 2024-09-17T04:30:13.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:13.281+0000 7f7cf4c65640 1 -- 172.21.15.88:0/698845824 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f7cf019f710 con 0x7f7cf0101e40 2024-09-17T04:30:13.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:13.281+0000 7f7ce77fe640 1 -- 172.21.15.88:0/698845824 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f7cd808f110 con 0x7f7cf0101e40 2024-09-17T04:30:13.283 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T04:30:13.283 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T04:30:13.283 INFO:teuthology.orchestra.run.smithi088.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T04:30:13.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:13.284+0000 7f7cf4c65640 1 -- 172.21.15.88:0/698845824 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f7cdc07af80 msgr2=0x7f7cdc07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:30:13.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:13.284+0000 7f7cf4c65640 1 --2- 172.21.15.88:0/698845824 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f7cdc07af80 0x7f7cdc07d440 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7ce0005fd0 tx=0x7f7ce0005850 comp rx=0 tx=0).stop 2024-09-17T04:30:13.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:13.284+0000 7f7cf4c65640 1 -- 172.21.15.88:0/698845824 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7cf0101e40 msgr2=0x7f7cf0102ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:30:13.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:13.284+0000 7f7cf4c65640 1 --2- 172.21.15.88:0/698845824 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7cf0101e40 0x7f7cf0102ee0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8006010 tx=0x7f7cd80046c0 comp rx=0 tx=0).stop 2024-09-17T04:30:13.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:13.284+0000 7f7cf4c65640 1 -- 172.21.15.88:0/698845824 shutdown_connections 2024-09-17T04:30:13.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:13.284+0000 7f7cf4c65640 1 --2- 172.21.15.88:0/698845824 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f7cdc07af80 0x7f7cdc07d440 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:13.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:13.284+0000 7f7cf4c65640 1 --2- 172.21.15.88:0/698845824 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7cf0101e40 0x7f7cf0102ee0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:13.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:13.284+0000 7f7cf4c65640 1 --2- 172.21.15.88:0/698845824 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cf0100af0 0x7f7cf0104820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:13.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:13.284+0000 7f7cf4c65640 1 -- 172.21.15.88:0/698845824 >> 172.21.15.88:0/698845824 conn(0x7f7cf00fb770 msgr2=0x7f7cf00ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:30:13.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:13.284+0000 7f7cf4c65640 1 -- 172.21.15.88:0/698845824 shutdown_connections 2024-09-17T04:30:13.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:13.284+0000 7f7cf4c65640 1 -- 172.21.15.88:0/698845824 wait complete. 2024-09-17T04:30:13.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:13 smithi088 ceph-mon[90867]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T04:30:13.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:13 smithi088 ceph-mon[90867]: from='client.34476 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:30:13.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:13 smithi088 ceph-mon[90867]: Upgrade: Finalizing container_image settings 2024-09-17T04:30:13.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:13 smithi088 ceph-mon[90867]: Upgrade: Complete! 2024-09-17T04:30:13.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:13 smithi088 ceph-mon[90867]: from='client.34480 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:30:13.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:13 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/3129466710' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:30:13.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:13 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/1199515632' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T04:30:13.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:13 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/698845824' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T04:30:13.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:13 smithi134 ceph-mon[76677]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T04:30:13.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:13 smithi134 ceph-mon[76677]: from='client.34476 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:30:13.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:13 smithi134 ceph-mon[76677]: Upgrade: Finalizing container_image settings 2024-09-17T04:30:13.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:13 smithi134 ceph-mon[76677]: Upgrade: Complete! 2024-09-17T04:30:13.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:13 smithi134 ceph-mon[76677]: from='client.34480 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:30:13.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:13 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/3129466710' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:30:13.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:13 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/1199515632' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T04:30:13.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:13 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/698845824' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T04:30:14.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:14 smithi088 ceph-mon[90867]: pgmap v279: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:30:14.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:14 smithi088 ceph-mon[90867]: from='client.34492 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:30:14.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:14 smithi134 ceph-mon[76677]: pgmap v279: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:30:14.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:14 smithi134 ceph-mon[76677]: from='client.34492 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:30:16.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:16 smithi088 ceph-mon[90867]: pgmap v280: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:30:16.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:16 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:30:16.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:16 smithi134 ceph-mon[76677]: pgmap v280: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:30:16.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:16 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:30:18.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:18 smithi088 ceph-mon[90867]: pgmap v281: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:30:18.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:18 smithi134 ceph-mon[76677]: pgmap v281: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:30:20.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:20 smithi134 ceph-mon[76677]: pgmap v282: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:30:20.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:20 smithi088 ceph-mon[90867]: pgmap v282: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:30:22.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:22 smithi088 ceph-mon[90867]: pgmap v283: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:30:22.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:22 smithi134 ceph-mon[76677]: pgmap v283: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:30:24.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:24 smithi088 ceph-mon[90867]: pgmap v284: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:30:24.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:24 smithi134 ceph-mon[76677]: pgmap v284: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:30:26.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:26 smithi088 ceph-mon[90867]: pgmap v285: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:30:26.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:26 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:30:26.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:26 smithi134 ceph-mon[76677]: pgmap v285: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:30:26.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:26 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:30:28.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:28 smithi088 ceph-mon[90867]: pgmap v286: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:30:28.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:28 smithi134 ceph-mon[76677]: pgmap v286: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:30:30.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:30 smithi088 ceph-mon[90867]: pgmap v287: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:30:30.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:30 smithi134 ceph-mon[76677]: pgmap v287: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:30:32.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:32 smithi088 ceph-mon[90867]: pgmap v288: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:30:32.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:32 smithi134 ceph-mon[76677]: pgmap v288: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:30:34.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:34 smithi088 ceph-mon[90867]: pgmap v289: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:30:34.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:34 smithi134 ceph-mon[76677]: pgmap v289: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:30:36.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:36 smithi088 ceph-mon[90867]: pgmap v290: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:30:36.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:36 smithi134 ceph-mon[76677]: pgmap v290: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:30:38.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:38 smithi088 ceph-mon[90867]: pgmap v291: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:30:38.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:38 smithi134 ceph-mon[76677]: pgmap v291: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:30:40.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:40 smithi088 ceph-mon[90867]: pgmap v292: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:30:40.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:40 smithi134 ceph-mon[76677]: pgmap v292: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:30:41.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:41 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:30:41.645 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:41 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:30:42.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:42 smithi088 ceph-mon[90867]: pgmap v293: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:30:42.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:42 smithi134 ceph-mon[76677]: pgmap v293: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:30:43.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:43.380+0000 7fee86d8d640 1 -- 172.21.15.88:0/1275123507 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee80100860 msgr2=0x7fee80100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:30:43.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:43.380+0000 7fee86d8d640 1 --2- 172.21.15.88:0/1275123507 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee80100860 0x7fee80100c60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fee70009880 tx=0x7fee7002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:30:43.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:43.380+0000 7fee86d8d640 1 -- 172.21.15.88:0/1275123507 shutdown_connections 2024-09-17T04:30:43.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:43.380+0000 7fee86d8d640 1 --2- 172.21.15.88:0/1275123507 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee80101a60 0x7fee80101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:43.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:43.380+0000 7fee86d8d640 1 --2- 172.21.15.88:0/1275123507 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee80100860 0x7fee80100c60 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:43.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:43.380+0000 7fee86d8d640 1 -- 172.21.15.88:0/1275123507 >> 172.21.15.88:0/1275123507 conn(0x7fee800fc010 msgr2=0x7fee800fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:30:43.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:43.380+0000 7fee86d8d640 1 -- 172.21.15.88:0/1275123507 shutdown_connections 2024-09-17T04:30:43.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:43.380+0000 7fee86d8d640 1 -- 172.21.15.88:0/1275123507 wait complete. 2024-09-17T04:30:43.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:43.380+0000 7fee86d8d640 1 Processor -- start 2024-09-17T04:30:43.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:43.380+0000 7fee86d8d640 1 -- start start 2024-09-17T04:30:43.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:43.380+0000 7fee86d8d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee80100860 0x7fee801963b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:30:43.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:43.380+0000 7fee86d8d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee80101a60 0x7fee801968f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:30:43.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:43.380+0000 7fee86d8d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fee80109680 con 0x7fee80101a60 2024-09-17T04:30:43.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:43.380+0000 7fee86d8d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fee80109500 con 0x7fee80100860 2024-09-17T04:30:43.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:43.381+0000 7fee7ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee80101a60 0x7fee801968f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:30:43.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:43.381+0000 7fee7ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee80101a60 0x7fee801968f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52808/0 (socket says 172.21.15.88:52808) 2024-09-17T04:30:43.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:43.381+0000 7fee7ffff640 1 -- 172.21.15.88:0/3938452934 learned_addr learned my addr 172.21.15.88:0/3938452934 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:30:43.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:43.381+0000 7fee84b29640 1 --2- 172.21.15.88:0/3938452934 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee80100860 0x7fee801963b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:30:43.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:43.381+0000 7fee7ffff640 1 -- 172.21.15.88:0/3938452934 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee80100860 msgr2=0x7fee801963b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:30:43.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:43.381+0000 7fee7ffff640 1 --2- 172.21.15.88:0/3938452934 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee80100860 0x7fee801963b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:43.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:43.381+0000 7fee7ffff640 1 -- 172.21.15.88:0/3938452934 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee80196f70 con 0x7fee80101a60 2024-09-17T04:30:43.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:43.381+0000 7fee84b29640 1 --2- 172.21.15.88:0/3938452934 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee80100860 0x7fee801963b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:30:43.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:43.381+0000 7fee7ffff640 1 --2- 172.21.15.88:0/3938452934 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee80101a60 0x7fee801968f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fee7400c810 tx=0x7fee7400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:30:43.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:43.381+0000 7fee7dffb640 1 -- 172.21.15.88:0/3938452934 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fee74004020 con 0x7fee80101a60 2024-09-17T04:30:43.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:43.381+0000 7fee7dffb640 1 -- 172.21.15.88:0/3938452934 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fee740041c0 con 0x7fee80101a60 2024-09-17T04:30:43.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:43.381+0000 7fee7dffb640 1 -- 172.21.15.88:0/3938452934 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fee740047a0 con 0x7fee80101a60 2024-09-17T04:30:43.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:43.381+0000 7fee86d8d640 1 -- 172.21.15.88:0/3938452934 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee8019b9b0 con 0x7fee80101a60 2024-09-17T04:30:43.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:43.382+0000 7fee86d8d640 1 -- 172.21.15.88:0/3938452934 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee8019bf40 con 0x7fee80101a60 2024-09-17T04:30:43.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:43.383+0000 7fee86d8d640 1 -- 172.21.15.88:0/3938452934 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee80100c60 con 0x7fee80101a60 2024-09-17T04:30:43.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:43.383+0000 7fee7dffb640 1 -- 172.21.15.88:0/3938452934 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fee740079b0 con 0x7fee80101a60 2024-09-17T04:30:43.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:43.384+0000 7fee7dffb640 1 --2- 172.21.15.88:0/3938452934 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fee6807af90 0x7fee6807d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:30:43.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:43.384+0000 7fee7dffb640 1 -- 172.21.15.88:0/3938452934 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fee7409df70 con 0x7fee80101a60 2024-09-17T04:30:43.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:43.384+0000 7fee84b29640 1 --2- 172.21.15.88:0/3938452934 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fee6807af90 0x7fee6807d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:30:43.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:43.384+0000 7fee84b29640 1 --2- 172.21.15.88:0/3938452934 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fee6807af90 0x7fee6807d450 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fee70006010 tx=0x7fee70000bc0 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:30:43.388 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:43.388+0000 7fee7dffb640 1 -- 172.21.15.88:0/3938452934 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fee74014030 con 0x7fee80101a60 2024-09-17T04:30:43.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:43.582+0000 7fee86d8d640 1 -- 172.21.15.88:0/3938452934 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fee80106030 con 0x7fee6807af90 2024-09-17T04:30:43.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:43.583+0000 7fee7dffb640 1 -- 172.21.15.88:0/3938452934 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+175 (secure 0 0 0) 0x7fee80106030 con 0x7fee6807af90 2024-09-17T04:30:43.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:43.586+0000 7fee86d8d640 1 -- 172.21.15.88:0/3938452934 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fee6807af90 msgr2=0x7fee6807d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:30:43.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:43.586+0000 7fee86d8d640 1 --2- 172.21.15.88:0/3938452934 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fee6807af90 0x7fee6807d450 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fee70006010 tx=0x7fee70000bc0 comp rx=0 tx=0).stop 2024-09-17T04:30:43.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:43.586+0000 7fee86d8d640 1 -- 172.21.15.88:0/3938452934 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee80101a60 msgr2=0x7fee801968f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:30:43.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:43.586+0000 7fee86d8d640 1 --2- 172.21.15.88:0/3938452934 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee80101a60 0x7fee801968f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fee7400c810 tx=0x7fee7400ccd0 comp rx=0 tx=0).stop 2024-09-17T04:30:43.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:43.586+0000 7fee86d8d640 1 -- 172.21.15.88:0/3938452934 shutdown_connections 2024-09-17T04:30:43.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:43.586+0000 7fee86d8d640 1 --2- 172.21.15.88:0/3938452934 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fee6807af90 0x7fee6807d450 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:43.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:43.586+0000 7fee86d8d640 1 --2- 172.21.15.88:0/3938452934 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee80101a60 0x7fee801968f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:43.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:43.586+0000 7fee86d8d640 1 --2- 172.21.15.88:0/3938452934 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee80100860 0x7fee801963b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:43.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:43.586+0000 7fee86d8d640 1 -- 172.21.15.88:0/3938452934 >> 172.21.15.88:0/3938452934 conn(0x7fee800fc010 msgr2=0x7fee800fe210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:30:43.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:43.586+0000 7fee86d8d640 1 -- 172.21.15.88:0/3938452934 shutdown_connections 2024-09-17T04:30:43.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:43.586+0000 7fee86d8d640 1 -- 172.21.15.88:0/3938452934 wait complete. 2024-09-17T04:30:44.371 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -e sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf -- bash -c 'ceph orch ps' 2024-09-17T04:30:44.622 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:30:44.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:44 smithi088 ceph-mon[90867]: pgmap v294: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:30:44.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:44 smithi134 ceph-mon[76677]: pgmap v294: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:30:45.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:45.032+0000 7f2a6fa09640 1 -- 172.21.15.88:0/3698734164 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a68107900 msgr2=0x7f2a68107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:30:45.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:45.032+0000 7f2a6fa09640 1 --2- 172.21.15.88:0/3698734164 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a68107900 0x7f2a68107ce0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2a64009880 tx=0x7f2a6402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:30:45.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:45.032+0000 7f2a6fa09640 1 -- 172.21.15.88:0/3698734164 shutdown_connections 2024-09-17T04:30:45.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:45.032+0000 7f2a6fa09640 1 --2- 172.21.15.88:0/3698734164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a68101900 0x7f2a68101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:45.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:45.032+0000 7f2a6fa09640 1 --2- 172.21.15.88:0/3698734164 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a68107900 0x7f2a68107ce0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:45.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:45.032+0000 7f2a6fa09640 1 -- 172.21.15.88:0/3698734164 >> 172.21.15.88:0/3698734164 conn(0x7f2a680fd620 msgr2=0x7f2a680ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:30:45.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:45.032+0000 7f2a6fa09640 1 -- 172.21.15.88:0/3698734164 shutdown_connections 2024-09-17T04:30:45.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:45.032+0000 7f2a6fa09640 1 -- 172.21.15.88:0/3698734164 wait complete. 2024-09-17T04:30:45.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:45.032+0000 7f2a6fa09640 1 Processor -- start 2024-09-17T04:30:45.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:45.033+0000 7f2a6fa09640 1 -- start start 2024-09-17T04:30:45.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:45.033+0000 7f2a6fa09640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a68101900 0x7f2a6819d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:30:45.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:45.033+0000 7f2a6fa09640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a68107900 0x7f2a6819dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:30:45.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:45.033+0000 7f2a6fa09640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f2a6810edb0 con 0x7f2a68107900 2024-09-17T04:30:45.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:45.033+0000 7f2a6fa09640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2a6810ec30 con 0x7f2a68101900 2024-09-17T04:30:45.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:45.033+0000 7f2a6cfa4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a68107900 0x7f2a6819dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:30:45.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:45.033+0000 7f2a6cfa4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a68107900 0x7f2a6819dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52840/0 (socket says 172.21.15.88:52840) 2024-09-17T04:30:45.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:45.033+0000 7f2a6cfa4640 1 -- 172.21.15.88:0/3084175004 learned_addr learned my addr 172.21.15.88:0/3084175004 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:30:45.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:45.033+0000 7f2a6d7a5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a68101900 0x7f2a6819d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:30:45.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:45.033+0000 7f2a6cfa4640 1 -- 172.21.15.88:0/3084175004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a68101900 msgr2=0x7f2a6819d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:30:45.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:45.033+0000 7f2a6cfa4640 1 --2- 172.21.15.88:0/3084175004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a68101900 0x7f2a6819d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:45.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:45.033+0000 7f2a6cfa4640 1 -- 172.21.15.88:0/3084175004 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a68197760 con 0x7f2a68107900 2024-09-17T04:30:45.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:45.034+0000 7f2a6cfa4640 1 --2- 172.21.15.88:0/3084175004 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a68107900 0x7f2a6819dbd0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2a5800c8a0 tx=0x7f2a5800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:30:45.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:45.034+0000 7f2a5e7fc640 1 -- 172.21.15.88:0/3084175004 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2a580079b0 con 0x7f2a68107900 2024-09-17T04:30:45.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:45.034+0000 7f2a6fa09640 1 -- 172.21.15.88:0/3084175004 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a68197a50 con 0x7f2a68107900 2024-09-17T04:30:45.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:45.034+0000 7f2a5e7fc640 1 -- 172.21.15.88:0/3084175004 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2a58007b50 con 0x7f2a68107900 2024-09-17T04:30:45.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:45.034+0000 7f2a5e7fc640 1 -- 172.21.15.88:0/3084175004 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2a58018700 con 0x7f2a68107900 2024-09-17T04:30:45.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:45.034+0000 7f2a6fa09640 1 -- 172.21.15.88:0/3084175004 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a68197ea0 con 0x7f2a68107900 2024-09-17T04:30:45.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:45.035+0000 7f2a6fa09640 1 -- 172.21.15.88:0/3084175004 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a68103040 con 0x7f2a68107900 2024-09-17T04:30:45.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:45.037+0000 7f2a5e7fc640 1 -- 172.21.15.88:0/3084175004 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f2a58007d00 con 0x7f2a68107900 2024-09-17T04:30:45.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:45.037+0000 7f2a5e7fc640 1 --2- 172.21.15.88:0/3084175004 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f2a5407af30 0x7f2a5407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:30:45.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:45.037+0000 7f2a5e7fc640 1 -- 172.21.15.88:0/3084175004 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f2a5809e420 con 0x7f2a68107900 2024-09-17T04:30:45.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:45.037+0000 7f2a6d7a5640 1 --2- 172.21.15.88:0/3084175004 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f2a5407af30 0x7f2a5407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:30:45.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:45.038+0000 7f2a6d7a5640 1 --2- 172.21.15.88:0/3084175004 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f2a5407af30 0x7f2a5407d3f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2a64000c00 tx=0x7f2a64031400 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:30:45.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:45.041+0000 7f2a5e7fc640 1 -- 172.21.15.88:0/3084175004 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f2a58014030 con 0x7f2a68107900 2024-09-17T04:30:45.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:45.236+0000 7f2a6fa09640 1 -- 172.21.15.88:0/3084175004 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f2a68104b80 con 0x7f2a5407af30 2024-09-17T04:30:45.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:45.245+0000 7f2a5e7fc640 1 -- 172.21.15.88:0/3084175004 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f2a64004340 con 0x7f2a5407af30 2024-09-17T04:30:45.245 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T04:30:45.245 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (68s) 41s ago 17m 17.5M - 0.27.0 11f11916f8cd 5e15bd0ae38c 2024-09-17T04:30:45.246 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi088 smithi088 running (2m) 41s ago 18m 75.4M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 855ea59f1895 2024-09-17T04:30:45.246 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi134 smithi134 running (2m) 107s ago 17m 75.5M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 0e2d1095af7f 2024-09-17T04:30:45.246 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (7m) 41s ago 18m 6891k - 19.3.0-4989-gce1b342b 8e039cb7fe1e 10355648c406 2024-09-17T04:30:45.246 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi134 smithi134 running (7m) 107s ago 17m 6899k - 19.3.0-4989-gce1b342b 8e039cb7fe1e d709085ffe5d 2024-09-17T04:30:45.246 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (46s) 41s ago 17m 44.3M - 10.4.0 c8b91775d855 728b8d3377b1 2024-09-17T04:30:45.246 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.giqrgt smithi088 running (3m) 41s ago 12m 84.7M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 3bb1d05b4476 2024-09-17T04:30:45.246 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.lgavsv smithi088 running (3m) 41s ago 12m 84.8M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 6fb9ba0a8ec3 2024-09-17T04:30:45.246 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi134.ktuhce smithi134 running (2m) 107s ago 12m 155M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 851c1f3a855a 2024-09-17T04:30:45.246 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi134.psnynp smithi134 running (2m) 107s ago 12m 155M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 966e092b224e 2024-09-17T04:30:45.246 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.wmndiv smithi088 *:8443,9283,8765 running (9m) 41s ago 19m 600M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 49eb47f7f14f 2024-09-17T04:30:45.246 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi134.vwdxcb smithi134 *:8443,9283,8765 running (7m) 107s ago 17m 523M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 8a6d45eb0595 2024-09-17T04:30:45.246 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (7m) 41s ago 19m 124M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e ac6332015243 2024-09-17T04:30:45.246 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi134 smithi134 running (7m) 107s ago 16m 105M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e ea49f690e26b 2024-09-17T04:30:45.246 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (116s) 41s ago 17m 11.9M - 1.7.0 72c9c2088986 071e9be71e51 2024-09-17T04:30:45.247 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi134 smithi134 *:9100 running (110s) 107s ago 17m 3309k - 1.7.0 72c9c2088986 b5597a275b46 2024-09-17T04:30:45.247 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (6m) 41s ago 15m 166M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 4ef267302248 2024-09-17T04:30:45.247 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (6m) 41s ago 15m 170M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 17b67c13c7aa 2024-09-17T04:30:45.247 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (5m) 41s ago 14m 157M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 83d38ad792c9 2024-09-17T04:30:45.247 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi134 running (5m) 107s ago 14m 170M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e 336a363ac39f 2024-09-17T04:30:45.247 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi134 running (4m) 107s ago 13m 161M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e 6df8a692310a 2024-09-17T04:30:45.247 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi134 running (3m) 107s ago 13m 156M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e 5066799816d3 2024-09-17T04:30:45.247 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (88s) 41s ago 17m 45.7M - 2.51.0 1d3b7f56885b dbff76a1573c 2024-09-17T04:30:45.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:45.248+0000 7f2a6fa09640 1 -- 172.21.15.88:0/3084175004 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f2a5407af30 msgr2=0x7f2a5407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:30:45.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:45.248+0000 7f2a6fa09640 1 --2- 172.21.15.88:0/3084175004 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f2a5407af30 0x7f2a5407d3f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2a64000c00 tx=0x7f2a64031400 comp rx=0 tx=0).stop 2024-09-17T04:30:45.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:45.248+0000 7f2a6fa09640 1 -- 172.21.15.88:0/3084175004 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a68107900 msgr2=0x7f2a6819dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:30:45.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:45.248+0000 7f2a6fa09640 1 --2- 172.21.15.88:0/3084175004 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a68107900 0x7f2a6819dbd0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2a5800c8a0 tx=0x7f2a5800cd60 comp rx=0 tx=0).stop 2024-09-17T04:30:45.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:45.248+0000 7f2a6fa09640 1 -- 172.21.15.88:0/3084175004 shutdown_connections 2024-09-17T04:30:45.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:45.248+0000 7f2a6fa09640 1 --2- 172.21.15.88:0/3084175004 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f2a5407af30 0x7f2a5407d3f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:45.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:45.248+0000 7f2a6fa09640 1 --2- 172.21.15.88:0/3084175004 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a68107900 0x7f2a6819dbd0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:45.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:45.248+0000 7f2a6fa09640 1 --2- 172.21.15.88:0/3084175004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a68101900 0x7f2a6819d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:45.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:45.248+0000 7f2a6fa09640 1 -- 172.21.15.88:0/3084175004 >> 172.21.15.88:0/3084175004 conn(0x7f2a680fd620 msgr2=0x7f2a680feef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:30:45.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:45.248+0000 7f2a6fa09640 1 -- 172.21.15.88:0/3084175004 shutdown_connections 2024-09-17T04:30:45.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:45.248+0000 7f2a6fa09640 1 -- 172.21.15.88:0/3084175004 wait complete. 2024-09-17T04:30:45.596 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:45 smithi088 ceph-mon[90867]: from='client.34500 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:30:45.623 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:45 smithi134 ceph-mon[76677]: from='client.34500 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:30:45.943 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -e sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf -- bash -c 'ceph orch upgrade status' 2024-09-17T04:30:46.198 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:30:46.617 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:46 smithi088 ceph-mon[90867]: pgmap v295: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:30:46.617 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:46 smithi088 ceph-mon[90867]: from='client.34504 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:30:46.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:46 smithi134 ceph-mon[76677]: pgmap v295: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:30:46.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:46 smithi134 ceph-mon[76677]: from='client.34504 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:30:46.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:46.700+0000 7fd8418ce640 1 -- 172.21.15.88:0/3815524739 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd83c103430 msgr2=0x7fd83c10b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:30:46.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:46.700+0000 7fd8418ce640 1 --2- 172.21.15.88:0/3815524739 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd83c103430 0x7fd83c10b920 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd8240098b0 tx=0x7fd82402a560 comp rx=0 tx=0).stop 2024-09-17T04:30:46.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:46.700+0000 7fd8418ce640 1 -- 172.21.15.88:0/3815524739 shutdown_connections 2024-09-17T04:30:46.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:46.700+0000 7fd8418ce640 1 --2- 172.21.15.88:0/3815524739 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd83c103430 0x7fd83c10b920 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:46.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:46.700+0000 7fd8418ce640 1 --2- 172.21.15.88:0/3815524739 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd83c102b10 0x7fd83c102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:46.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:46.700+0000 7fd8418ce640 1 -- 172.21.15.88:0/3815524739 >> 172.21.15.88:0/3815524739 conn(0x7fd83c0fc550 msgr2=0x7fd83c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:30:46.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:46.700+0000 7fd8418ce640 1 -- 172.21.15.88:0/3815524739 shutdown_connections 2024-09-17T04:30:46.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:46.700+0000 7fd8418ce640 1 -- 172.21.15.88:0/3815524739 wait complete. 2024-09-17T04:30:46.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:46.700+0000 7fd8418ce640 1 Processor -- start 2024-09-17T04:30:46.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:46.701+0000 7fd8418ce640 1 -- start start 2024-09-17T04:30:46.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:46.701+0000 7fd8418ce640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd83c102b10 0x7fd83c19d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:30:46.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:46.701+0000 7fd8418ce640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd83c103430 0x7fd83c19dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:30:46.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:46.701+0000 7fd8418ce640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fd83c10edc0 con 0x7fd83c103430 2024-09-17T04:30:46.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:46.701+0000 7fd8418ce640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd83c10ec40 con 0x7fd83c102b10 2024-09-17T04:30:46.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:46.701+0000 7fd83a7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd83c103430 0x7fd83c19dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:30:46.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:46.701+0000 7fd83a7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd83c103430 0x7fd83c19dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52856/0 (socket says 172.21.15.88:52856) 2024-09-17T04:30:46.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:46.701+0000 7fd83a7fc640 1 -- 172.21.15.88:0/456727054 learned_addr learned my addr 172.21.15.88:0/456727054 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:30:46.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:46.701+0000 7fd83affd640 1 --2- 172.21.15.88:0/456727054 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd83c102b10 0x7fd83c19d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:30:46.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:46.701+0000 7fd83a7fc640 1 -- 172.21.15.88:0/456727054 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd83c102b10 msgr2=0x7fd83c19d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:30:46.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:46.701+0000 7fd83a7fc640 1 --2- 172.21.15.88:0/456727054 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd83c102b10 0x7fd83c19d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:46.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:46.702+0000 7fd83a7fc640 1 -- 172.21.15.88:0/456727054 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd83c1977f0 con 0x7fd83c103430 2024-09-17T04:30:46.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:46.702+0000 7fd83a7fc640 1 --2- 172.21.15.88:0/456727054 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd83c103430 0x7fd83c19dbb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd824031460 tx=0x7fd8240045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:30:46.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:46.702+0000 7fd8408cc640 1 -- 172.21.15.88:0/456727054 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd82403f070 con 0x7fd83c103430 2024-09-17T04:30:46.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:46.702+0000 7fd8418ce640 1 -- 172.21.15.88:0/456727054 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd83c197a80 con 0x7fd83c103430 2024-09-17T04:30:46.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:46.702+0000 7fd8408cc640 1 -- 172.21.15.88:0/456727054 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd8240035f0 con 0x7fd83c103430 2024-09-17T04:30:46.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:46.702+0000 7fd8408cc640 1 -- 172.21.15.88:0/456727054 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd824035030 con 0x7fd83c103430 2024-09-17T04:30:46.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:46.702+0000 7fd8418ce640 1 -- 172.21.15.88:0/456727054 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd83c197fb0 con 0x7fd83c103430 2024-09-17T04:30:46.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:46.703+0000 7fd8418ce640 1 -- 172.21.15.88:0/456727054 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd83c06a520 con 0x7fd83c103430 2024-09-17T04:30:46.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:46.704+0000 7fd8408cc640 1 -- 172.21.15.88:0/456727054 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fd824042070 con 0x7fd83c103430 2024-09-17T04:30:46.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:46.704+0000 7fd8408cc640 1 --2- 172.21.15.88:0/456727054 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fd82807af30 0x7fd82807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:30:46.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:46.704+0000 7fd8408cc640 1 -- 172.21.15.88:0/456727054 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fd8240bea60 con 0x7fd83c103430 2024-09-17T04:30:46.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:46.704+0000 7fd83affd640 1 --2- 172.21.15.88:0/456727054 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fd82807af30 0x7fd82807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:30:46.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:46.705+0000 7fd83affd640 1 --2- 172.21.15.88:0/456727054 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fd82807af30 0x7fd82807d3f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd82c005fd0 tx=0x7fd82c005850 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:30:46.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:46.709+0000 7fd8408cc640 1 -- 172.21.15.88:0/456727054 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fd824089fb0 con 0x7fd83c103430 2024-09-17T04:30:46.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:46.900+0000 7fd8418ce640 1 -- 172.21.15.88:0/456727054 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fd83c198260 con 0x7fd82807af30 2024-09-17T04:30:46.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:46.901+0000 7fd8408cc640 1 -- 172.21.15.88:0/456727054 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+175 (secure 0 0 0) 0x7fd83c198260 con 0x7fd82807af30 2024-09-17T04:30:46.902 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-17T04:30:46.902 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": null, 2024-09-17T04:30:46.902 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": false, 2024-09-17T04:30:46.903 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "", 2024-09-17T04:30:46.903 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [], 2024-09-17T04:30:46.903 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": null, 2024-09-17T04:30:46.903 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "", 2024-09-17T04:30:46.903 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-09-17T04:30:46.903 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-17T04:30:46.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:46.903+0000 7fd8418ce640 1 -- 172.21.15.88:0/456727054 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fd82807af30 msgr2=0x7fd82807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:30:46.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:46.903+0000 7fd8418ce640 1 --2- 172.21.15.88:0/456727054 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fd82807af30 0x7fd82807d3f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd82c005fd0 tx=0x7fd82c005850 comp rx=0 tx=0).stop 2024-09-17T04:30:46.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:46.903+0000 7fd8418ce640 1 -- 172.21.15.88:0/456727054 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd83c103430 msgr2=0x7fd83c19dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:30:46.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:46.903+0000 7fd8418ce640 1 --2- 172.21.15.88:0/456727054 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd83c103430 0x7fd83c19dbb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd824031460 tx=0x7fd8240045c0 comp rx=0 tx=0).stop 2024-09-17T04:30:46.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:46.903+0000 7fd8418ce640 1 -- 172.21.15.88:0/456727054 shutdown_connections 2024-09-17T04:30:46.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:46.903+0000 7fd8418ce640 1 --2- 172.21.15.88:0/456727054 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fd82807af30 0x7fd82807d3f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:46.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:46.903+0000 7fd8418ce640 1 --2- 172.21.15.88:0/456727054 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd83c103430 0x7fd83c19dbb0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:46.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:46.903+0000 7fd8418ce640 1 --2- 172.21.15.88:0/456727054 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd83c102b10 0x7fd83c19d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:46.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:46.903+0000 7fd8418ce640 1 -- 172.21.15.88:0/456727054 >> 172.21.15.88:0/456727054 conn(0x7fd83c0fc550 msgr2=0x7fd83c103d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:30:46.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:46.904+0000 7fd8418ce640 1 -- 172.21.15.88:0/456727054 shutdown_connections 2024-09-17T04:30:46.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:46.904+0000 7fd8418ce640 1 -- 172.21.15.88:0/456727054 wait complete. 2024-09-17T04:30:47.532 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -e sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf -- bash -c 'ceph health detail' 2024-09-17T04:30:47.784 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:30:48.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:48.255+0000 7fe17a75d640 1 -- 172.21.15.88:0/961850264 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1741007f0 msgr2=0x7fe174100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:30:48.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:48.255+0000 7fe17a75d640 1 --2- 172.21.15.88:0/961850264 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1741007f0 0x7fe174100c50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe168009880 tx=0x7fe16802a4a0 comp rx=0 tx=0).stop 2024-09-17T04:30:48.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:48.255+0000 7fe17a75d640 1 -- 172.21.15.88:0/961850264 shutdown_connections 2024-09-17T04:30:48.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:48.255+0000 7fe17a75d640 1 --2- 172.21.15.88:0/961850264 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1741007f0 0x7fe174100c50 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:48.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:48.255+0000 7fe17a75d640 1 --2- 172.21.15.88:0/961850264 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1741067f0 0x7fe174106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:48.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:48.255+0000 7fe17a75d640 1 -- 172.21.15.88:0/961850264 >> 172.21.15.88:0/961850264 conn(0x7fe1740fc550 msgr2=0x7fe1740fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:30:48.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:48.256+0000 7fe17a75d640 1 -- 172.21.15.88:0/961850264 shutdown_connections 2024-09-17T04:30:48.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:48.256+0000 7fe17a75d640 1 -- 172.21.15.88:0/961850264 wait complete. 2024-09-17T04:30:48.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:48.256+0000 7fe17a75d640 1 Processor -- start 2024-09-17T04:30:48.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:48.256+0000 7fe17a75d640 1 -- start start 2024-09-17T04:30:48.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:48.256+0000 7fe17a75d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1741007f0 0x7fe1741987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:30:48.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:48.256+0000 7fe17a75d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1741067f0 0x7fe174198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:30:48.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:48.256+0000 7fe17a75d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fe17410dcc0 con 0x7fe1741007f0 2024-09-17T04:30:48.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:48.256+0000 7fe17a75d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe17410db40 con 0x7fe1741067f0 2024-09-17T04:30:48.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:48.257+0000 7fe173fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1741007f0 0x7fe1741987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:30:48.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:48.257+0000 7fe173fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1741007f0 0x7fe1741987b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52868/0 (socket says 172.21.15.88:52868) 2024-09-17T04:30:48.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:48.257+0000 7fe173fff640 1 -- 172.21.15.88:0/2264786216 learned_addr learned my addr 172.21.15.88:0/2264786216 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:30:48.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:48.257+0000 7fe1737fe640 1 --2- 172.21.15.88:0/2264786216 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1741067f0 0x7fe174198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:30:48.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:48.257+0000 7fe173fff640 1 -- 172.21.15.88:0/2264786216 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1741067f0 msgr2=0x7fe174198cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:30:48.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:48.257+0000 7fe173fff640 1 --2- 172.21.15.88:0/2264786216 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1741067f0 0x7fe174198cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:48.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:48.257+0000 7fe173fff640 1 -- 172.21.15.88:0/2264786216 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe174199340 con 0x7fe1741007f0 2024-09-17T04:30:48.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:48.257+0000 7fe173fff640 1 --2- 172.21.15.88:0/2264786216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1741007f0 0x7fe1741987b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe16400d6f0 tx=0x7fe16400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:30:48.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:48.257+0000 7fe1717fa640 1 -- 172.21.15.88:0/2264786216 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe164017070 con 0x7fe1741007f0 2024-09-17T04:30:48.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:48.257+0000 7fe1717fa640 1 -- 172.21.15.88:0/2264786216 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe16400de00 con 0x7fe1741007f0 2024-09-17T04:30:48.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:48.257+0000 7fe17a75d640 1 -- 172.21.15.88:0/2264786216 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1741a1820 con 0x7fe1741007f0 2024-09-17T04:30:48.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:48.257+0000 7fe1717fa640 1 -- 172.21.15.88:0/2264786216 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe164004bb0 con 0x7fe1741007f0 2024-09-17T04:30:48.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:48.257+0000 7fe17a75d640 1 -- 172.21.15.88:0/2264786216 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1741a1c20 con 0x7fe1741007f0 2024-09-17T04:30:48.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:48.258+0000 7fe17a75d640 1 -- 172.21.15.88:0/2264786216 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe174101f30 con 0x7fe1741007f0 2024-09-17T04:30:48.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:48.259+0000 7fe1717fa640 1 -- 172.21.15.88:0/2264786216 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fe164004e60 con 0x7fe1741007f0 2024-09-17T04:30:48.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:48.259+0000 7fe1717fa640 1 --2- 172.21.15.88:0/2264786216 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe15c07af30 0x7fe15c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:30:48.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:48.259+0000 7fe1717fa640 1 -- 172.21.15.88:0/2264786216 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fe16409dcf0 con 0x7fe1741007f0 2024-09-17T04:30:48.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:48.260+0000 7fe1737fe640 1 --2- 172.21.15.88:0/2264786216 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe15c07af30 0x7fe15c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:30:48.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:48.260+0000 7fe1737fe640 1 --2- 172.21.15.88:0/2264786216 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe15c07af30 0x7fe15c07d3f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe17406a830 tx=0x7fe168031400 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:30:48.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:48.264+0000 7fe1717fa640 1 -- 172.21.15.88:0/2264786216 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fe164069240 con 0x7fe1741007f0 2024-09-17T04:30:48.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:48.507+0000 7fe17a75d640 1 -- 172.21.15.88:0/2264786216 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fe17402d7c0 con 0x7fe1741007f0 2024-09-17T04:30:48.508 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:48 smithi088 ceph-mon[90867]: pgmap v296: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:30:48.508 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:48 smithi088 ceph-mon[90867]: from='client.34508 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:30:48.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:48.508+0000 7fe1717fa640 1 -- 172.21.15.88:0/2264786216 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7fe16406e0f0 con 0x7fe1741007f0 2024-09-17T04:30:48.508 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T04:30:48.508 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T04:30:48.509 INFO:teuthology.orchestra.run.smithi088.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T04:30:48.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:48.510+0000 7fe17a75d640 1 -- 172.21.15.88:0/2264786216 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe15c07af30 msgr2=0x7fe15c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:30:48.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:48.510+0000 7fe17a75d640 1 --2- 172.21.15.88:0/2264786216 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe15c07af30 0x7fe15c07d3f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe17406a830 tx=0x7fe168031400 comp rx=0 tx=0).stop 2024-09-17T04:30:48.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:48.510+0000 7fe17a75d640 1 -- 172.21.15.88:0/2264786216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1741007f0 msgr2=0x7fe1741987b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:30:48.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:48.510+0000 7fe17a75d640 1 --2- 172.21.15.88:0/2264786216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1741007f0 0x7fe1741987b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe16400d6f0 tx=0x7fe16400dbb0 comp rx=0 tx=0).stop 2024-09-17T04:30:48.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:48.510+0000 7fe17a75d640 1 -- 172.21.15.88:0/2264786216 shutdown_connections 2024-09-17T04:30:48.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:48.510+0000 7fe17a75d640 1 --2- 172.21.15.88:0/2264786216 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fe15c07af30 0x7fe15c07d3f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:48.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:48.510+0000 7fe17a75d640 1 --2- 172.21.15.88:0/2264786216 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1741067f0 0x7fe174198cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:48.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:48.510+0000 7fe17a75d640 1 --2- 172.21.15.88:0/2264786216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1741007f0 0x7fe1741987b0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:48.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:48.510+0000 7fe17a75d640 1 -- 172.21.15.88:0/2264786216 >> 172.21.15.88:0/2264786216 conn(0x7fe1740fc550 msgr2=0x7fe1740fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:30:48.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:48.511+0000 7fe17a75d640 1 -- 172.21.15.88:0/2264786216 shutdown_connections 2024-09-17T04:30:48.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:48.511+0000 7fe17a75d640 1 -- 172.21.15.88:0/2264786216 wait complete. 2024-09-17T04:30:48.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:48 smithi134 ceph-mon[76677]: pgmap v296: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:30:48.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:48 smithi134 ceph-mon[76677]: from='client.34508 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:30:49.164 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -e sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf -- bash -c 'ceph versions' 2024-09-17T04:30:49.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:49 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/2264786216' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T04:30:49.414 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:30:49.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:49 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/2264786216' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T04:30:49.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:49.844+0000 7f5196cd6640 1 -- 172.21.15.88:0/3288649085 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51901008b0 msgr2=0x7f5190100c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:30:49.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:49.844+0000 7f5196cd6640 1 --2- 172.21.15.88:0/3288649085 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51901008b0 0x7f5190100c90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f518c009880 tx=0x7f518c02a530 comp rx=0 tx=0).stop 2024-09-17T04:30:49.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:49.844+0000 7f5196cd6640 1 -- 172.21.15.88:0/3288649085 shutdown_connections 2024-09-17T04:30:49.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:49.844+0000 7f5196cd6640 1 --2- 172.21.15.88:0/3288649085 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51901011d0 0x7f51901056a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:49.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:49.844+0000 7f5196cd6640 1 --2- 172.21.15.88:0/3288649085 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51901008b0 0x7f5190100c90 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:49.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:49.844+0000 7f5196cd6640 1 -- 172.21.15.88:0/3288649085 >> 172.21.15.88:0/3288649085 conn(0x7f51900fc520 msgr2=0x7f51900fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:30:49.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:49.845+0000 7f5196cd6640 1 -- 172.21.15.88:0/3288649085 shutdown_connections 2024-09-17T04:30:49.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:49.845+0000 7f5196cd6640 1 -- 172.21.15.88:0/3288649085 wait complete. 2024-09-17T04:30:49.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:49.845+0000 7f5196cd6640 1 Processor -- start 2024-09-17T04:30:49.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:49.845+0000 7f5196cd6640 1 -- start start 2024-09-17T04:30:49.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:49.845+0000 7f5196cd6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51901008b0 0x7f519019e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:30:49.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:49.845+0000 7f5196cd6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51901011d0 0x7f519019e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:30:49.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:49.845+0000 7f5196cd6640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f5190115450 con 0x7f51901008b0 2024-09-17T04:30:49.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:49.845+0000 7f5196cd6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f51901152d0 con 0x7f51901011d0 2024-09-17T04:30:49.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:49.845+0000 7f5194a72640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51901008b0 0x7f519019e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:30:49.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:49.845+0000 7f5194a72640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51901008b0 0x7f519019e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52874/0 (socket says 172.21.15.88:52874) 2024-09-17T04:30:49.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:49.845+0000 7f5194a72640 1 -- 172.21.15.88:0/1984692112 learned_addr learned my addr 172.21.15.88:0/1984692112 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:30:49.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:49.846+0000 7f5187fff640 1 --2- 172.21.15.88:0/1984692112 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51901011d0 0x7f519019e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:30:49.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:49.846+0000 7f5194a72640 1 -- 172.21.15.88:0/1984692112 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51901011d0 msgr2=0x7f519019e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:30:49.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:49.846+0000 7f5194a72640 1 --2- 172.21.15.88:0/1984692112 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51901011d0 0x7f519019e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:49.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:49.846+0000 7f5194a72640 1 -- 172.21.15.88:0/1984692112 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51901a2900 con 0x7f51901008b0 2024-09-17T04:30:49.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:49.846+0000 7f5187fff640 1 --2- 172.21.15.88:0/1984692112 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51901011d0 0x7f519019e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:30:49.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:49.846+0000 7f5194a72640 1 --2- 172.21.15.88:0/1984692112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51901008b0 0x7f519019e030 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f518c031460 tx=0x7f518c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:30:49.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:49.846+0000 7f5185ffb640 1 -- 172.21.15.88:0/1984692112 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f518c03f070 con 0x7f51901008b0 2024-09-17T04:30:49.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:49.846+0000 7f5185ffb640 1 -- 172.21.15.88:0/1984692112 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f518c004cf0 con 0x7f51901008b0 2024-09-17T04:30:49.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:49.846+0000 7f5196cd6640 1 -- 172.21.15.88:0/1984692112 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51901a2b90 con 0x7f51901008b0 2024-09-17T04:30:49.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:49.846+0000 7f5185ffb640 1 -- 172.21.15.88:0/1984692112 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f518c035030 con 0x7f51901008b0 2024-09-17T04:30:49.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:49.846+0000 7f5196cd6640 1 -- 172.21.15.88:0/1984692112 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51901a30c0 con 0x7f51901008b0 2024-09-17T04:30:49.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:49.848+0000 7f5196cd6640 1 -- 172.21.15.88:0/1984692112 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f519006aa90 con 0x7f51901008b0 2024-09-17T04:30:49.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:49.848+0000 7f5185ffb640 1 -- 172.21.15.88:0/1984692112 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f518c042070 con 0x7f51901008b0 2024-09-17T04:30:49.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:49.849+0000 7f5185ffb640 1 --2- 172.21.15.88:0/1984692112 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f517807af30 0x7f517807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:30:49.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:49.849+0000 7f5185ffb640 1 -- 172.21.15.88:0/1984692112 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f518c0bebf0 con 0x7f51901008b0 2024-09-17T04:30:49.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:49.849+0000 7f5187fff640 1 --2- 172.21.15.88:0/1984692112 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f517807af30 0x7f517807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:30:49.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:49.849+0000 7f5187fff640 1 --2- 172.21.15.88:0/1984692112 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f517807af30 0x7f517807d3f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5180006fd0 tx=0x7f5180008040 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:30:49.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:49.853+0000 7f5185ffb640 1 -- 172.21.15.88:0/1984692112 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f518c08a140 con 0x7f51901008b0 2024-09-17T04:30:50.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:50.097+0000 7f5196cd6640 1 -- 172.21.15.88:0/1984692112 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f5190102d70 con 0x7f51901008b0 2024-09-17T04:30:50.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:50.098+0000 7f5185ffb640 1 -- 172.21.15.88:0/1984692112 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f518c08eff0 con 0x7f51901008b0 2024-09-17T04:30:50.098 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-17T04:30:50.098 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-09-17T04:30:50.098 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T04:30:50.098 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:30:50.098 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-09-17T04:30:50.098 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T04:30:50.098 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:30:50.098 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-09-17T04:30:50.098 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 6 2024-09-17T04:30:50.099 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:30:50.099 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2024-09-17T04:30:50.099 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 4 2024-09-17T04:30:50.099 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:30:50.099 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-09-17T04:30:50.099 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 14 2024-09-17T04:30:50.099 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-17T04:30:50.099 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-17T04:30:50.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:50.100+0000 7f5196cd6640 1 -- 172.21.15.88:0/1984692112 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f517807af30 msgr2=0x7f517807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:30:50.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:50.100+0000 7f5196cd6640 1 --2- 172.21.15.88:0/1984692112 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f517807af30 0x7f517807d3f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5180006fd0 tx=0x7f5180008040 comp rx=0 tx=0).stop 2024-09-17T04:30:50.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:50.100+0000 7f5196cd6640 1 -- 172.21.15.88:0/1984692112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51901008b0 msgr2=0x7f519019e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:30:50.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:50.100+0000 7f5196cd6640 1 --2- 172.21.15.88:0/1984692112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51901008b0 0x7f519019e030 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f518c031460 tx=0x7f518c0048f0 comp rx=0 tx=0).stop 2024-09-17T04:30:50.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:50.100+0000 7f5196cd6640 1 -- 172.21.15.88:0/1984692112 shutdown_connections 2024-09-17T04:30:50.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:50.100+0000 7f5196cd6640 1 --2- 172.21.15.88:0/1984692112 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f517807af30 0x7f517807d3f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:50.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:50.100+0000 7f5196cd6640 1 --2- 172.21.15.88:0/1984692112 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51901011d0 0x7f519019e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:50.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:50.100+0000 7f5196cd6640 1 --2- 172.21.15.88:0/1984692112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51901008b0 0x7f519019e030 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:30:50.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:50.100+0000 7f5196cd6640 1 -- 172.21.15.88:0/1984692112 >> 172.21.15.88:0/1984692112 conn(0x7f51900fc520 msgr2=0x7f5190112b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:30:50.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:50.100+0000 7f5196cd6640 1 -- 172.21.15.88:0/1984692112 shutdown_connections 2024-09-17T04:30:50.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:30:50.100+0000 7f5196cd6640 1 -- 172.21.15.88:0/1984692112 wait complete. 2024-09-17T04:30:50.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:50 smithi088 ceph-mon[90867]: pgmap v297: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:30:50.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:50 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/1984692112' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:30:50.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:50 smithi134 ceph-mon[76677]: pgmap v297: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:30:50.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:50 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/1984692112' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:30:50.833 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -e sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-09-17T04:30:51.085 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:30:51.580 INFO:teuthology.orchestra.run.smithi088.stdout:wait for servicemap items w/ changing names to refresh 2024-09-17T04:30:52.170 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -e sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf -- bash -c 'sleep 60' 2024-09-17T04:30:52.416 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:30:52.537 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:52 smithi088 ceph-mon[90867]: pgmap v298: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:30:52.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:52 smithi134 ceph-mon[76677]: pgmap v298: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:30:54.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:54 smithi088 ceph-mon[90867]: pgmap v299: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:30:54.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:54 smithi134 ceph-mon[76677]: pgmap v299: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:30:56.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:56 smithi088 ceph-mon[90867]: pgmap v300: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:30:56.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:56 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:30:56.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:56 smithi134 ceph-mon[76677]: pgmap v300: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:30:56.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:56 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:30:58.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:30:58 smithi088 ceph-mon[90867]: pgmap v301: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:30:58.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:30:58 smithi134 ceph-mon[76677]: pgmap v301: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:31:00.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:31:00 smithi088 ceph-mon[90867]: pgmap v302: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:31:00.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:31:00 smithi134 ceph-mon[76677]: pgmap v302: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:31:02.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:31:02 smithi088 ceph-mon[90867]: pgmap v303: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:31:02.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:31:02 smithi134 ceph-mon[76677]: pgmap v303: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:31:04.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:31:04 smithi088 ceph-mon[90867]: pgmap v304: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:31:04.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:31:04 smithi134 ceph-mon[76677]: pgmap v304: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:31:06.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:31:06 smithi088 ceph-mon[90867]: pgmap v305: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:31:06.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:31:06 smithi134 ceph-mon[76677]: pgmap v305: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:31:08.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:31:08 smithi088 ceph-mon[90867]: pgmap v306: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:31:08.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:31:08 smithi134 ceph-mon[76677]: pgmap v306: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:31:10.698 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:31:10 smithi134 ceph-mon[76677]: pgmap v307: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:31:10.889 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:31:10 smithi088 ceph-mon[90867]: pgmap v307: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:31:11.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:31:11 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:31:11.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:31:11 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:31:12.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:31:12 smithi088 ceph-mon[90867]: pgmap v308: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:31:12.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:31:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:31:12.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:31:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:31:12.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:31:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:31:12.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:31:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:31:12.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:31:12 smithi134 ceph-mon[76677]: pgmap v308: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:31:12.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:31:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:31:12.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:31:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:31:12.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:31:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:31:12.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:31:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:31:14.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:31:14 smithi088 ceph-mon[90867]: pgmap v309: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:31:14.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:31:14 smithi134 ceph-mon[76677]: pgmap v309: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:31:16.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:31:16 smithi134 ceph-mon[76677]: pgmap v310: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:31:16.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:31:16 smithi088 ceph-mon[90867]: pgmap v310: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:31:18.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:31:18 smithi088 ceph-mon[90867]: pgmap v311: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:31:18.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:31:18 smithi134 ceph-mon[76677]: pgmap v311: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:31:20.772 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:31:20 smithi088 ceph-mon[90867]: pgmap v312: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:31:20.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:31:20 smithi134 ceph-mon[76677]: pgmap v312: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:31:22.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:31:22 smithi088 ceph-mon[90867]: pgmap v313: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:31:22.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:31:22 smithi134 ceph-mon[76677]: pgmap v313: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:31:24.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:31:24 smithi088 ceph-mon[90867]: pgmap v314: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:31:24.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:31:24 smithi134 ceph-mon[76677]: pgmap v314: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:31:26.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:31:26 smithi088 ceph-mon[90867]: pgmap v315: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:31:26.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:31:26 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:31:26.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:31:26 smithi134 ceph-mon[76677]: pgmap v315: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:31:26.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:31:26 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:31:28.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:31:28 smithi088 ceph-mon[90867]: pgmap v316: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:31:28.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:31:28 smithi134 ceph-mon[76677]: pgmap v316: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:31:30.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:31:30 smithi088 ceph-mon[90867]: pgmap v317: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:31:30.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:31:30 smithi134 ceph-mon[76677]: pgmap v317: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:31:32.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:31:32 smithi088 ceph-mon[90867]: pgmap v318: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:31:32.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:31:32 smithi134 ceph-mon[76677]: pgmap v318: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:31:34.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:31:34 smithi088 ceph-mon[90867]: pgmap v319: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:31:34.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:31:34 smithi134 ceph-mon[76677]: pgmap v319: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:31:36.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:31:36 smithi088 ceph-mon[90867]: pgmap v320: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:31:36.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:31:36 smithi134 ceph-mon[76677]: pgmap v320: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:31:38.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:31:38 smithi088 ceph-mon[90867]: pgmap v321: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:31:38.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:31:38 smithi134 ceph-mon[76677]: pgmap v321: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:31:40.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:31:40 smithi088 ceph-mon[90867]: pgmap v322: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:31:40.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:31:40 smithi134 ceph-mon[76677]: pgmap v322: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:31:41.742 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:31:41 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:31:41.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:31:41 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:31:42.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:31:42 smithi088 ceph-mon[90867]: pgmap v323: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:31:42.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:31:42 smithi134 ceph-mon[76677]: pgmap v323: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:31:44.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:31:44 smithi088 ceph-mon[90867]: pgmap v324: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:31:44.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:31:44 smithi134 ceph-mon[76677]: pgmap v324: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:31:46.754 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:31:46 smithi088 ceph-mon[90867]: pgmap v325: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:31:46.844 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:31:46 smithi134 ceph-mon[76677]: pgmap v325: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:31:48.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:31:48 smithi088 ceph-mon[90867]: pgmap v326: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:31:48.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:31:48 smithi134 ceph-mon[76677]: pgmap v326: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:31:50.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:31:50 smithi088 ceph-mon[90867]: pgmap v327: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:31:50.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:31:50 smithi134 ceph-mon[76677]: pgmap v327: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:31:52.777 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:31:52 smithi088 ceph-mon[90867]: pgmap v328: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:31:52.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:31:52 smithi134 ceph-mon[76677]: pgmap v328: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:31:53.386 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -e sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf -- bash -c 'ceph orch ps' 2024-09-17T04:31:53.643 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:31:54.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:54.095+0000 7f05a2939640 1 -- 172.21.15.88:0/687893948 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f059c100800 msgr2=0x7f059c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:31:54.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:54.095+0000 7f05a2939640 1 --2- 172.21.15.88:0/687893948 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f059c100800 0x7f059c100c60 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0590009880 tx=0x7f059002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:31:54.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:54.095+0000 7f05a2939640 1 -- 172.21.15.88:0/687893948 shutdown_connections 2024-09-17T04:31:54.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:54.095+0000 7f05a2939640 1 --2- 172.21.15.88:0/687893948 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f059c100800 0x7f059c100c60 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:31:54.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:54.095+0000 7f05a2939640 1 --2- 172.21.15.88:0/687893948 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f059c106800 0x7f059c106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:31:54.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:54.095+0000 7f05a2939640 1 -- 172.21.15.88:0/687893948 >> 172.21.15.88:0/687893948 conn(0x7f059c0fc520 msgr2=0x7f059c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:31:54.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:54.095+0000 7f05a2939640 1 -- 172.21.15.88:0/687893948 shutdown_connections 2024-09-17T04:31:54.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:54.095+0000 7f05a2939640 1 -- 172.21.15.88:0/687893948 wait complete. 2024-09-17T04:31:54.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:54.096+0000 7f05a2939640 1 Processor -- start 2024-09-17T04:31:54.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:54.096+0000 7f05a2939640 1 -- start start 2024-09-17T04:31:54.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:54.096+0000 7f05a2939640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f059c100800 0x7f059c19d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:31:54.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:54.096+0000 7f05a2939640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f059c106800 0x7f059c19dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:31:54.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:54.096+0000 7f05a2939640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f059c10dd30 con 0x7f059c106800 2024-09-17T04:31:54.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:54.096+0000 7f05a2939640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f059c10dbb0 con 0x7f059c100800 2024-09-17T04:31:54.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:54.097+0000 7f059b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f059c106800 0x7f059c19dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:31:54.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:54.097+0000 7f059b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f059c106800 0x7f059c19dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53282/0 (socket says 172.21.15.88:53282) 2024-09-17T04:31:54.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:54.097+0000 7f059b7fe640 1 -- 172.21.15.88:0/3133067219 learned_addr learned my addr 172.21.15.88:0/3133067219 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:31:54.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:54.097+0000 7f059bfff640 1 --2- 172.21.15.88:0/3133067219 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f059c100800 0x7f059c19d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:31:54.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:54.097+0000 7f059b7fe640 1 -- 172.21.15.88:0/3133067219 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f059c100800 msgr2=0x7f059c19d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:31:54.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:54.097+0000 7f059b7fe640 1 --2- 172.21.15.88:0/3133067219 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f059c100800 0x7f059c19d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:31:54.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:54.097+0000 7f059b7fe640 1 -- 172.21.15.88:0/3133067219 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f059c197870 con 0x7f059c106800 2024-09-17T04:31:54.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:54.097+0000 7f059b7fe640 1 --2- 172.21.15.88:0/3133067219 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f059c106800 0x7f059c19dbf0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0590031460 tx=0x7f05900048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:31:54.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:54.097+0000 7f05997fa640 1 -- 172.21.15.88:0/3133067219 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f059003f070 con 0x7f059c106800 2024-09-17T04:31:54.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:54.097+0000 7f05a2939640 1 -- 172.21.15.88:0/3133067219 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f059c197b00 con 0x7f059c106800 2024-09-17T04:31:54.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:54.097+0000 7f05997fa640 1 -- 172.21.15.88:0/3133067219 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0590004cf0 con 0x7f059c106800 2024-09-17T04:31:54.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:54.097+0000 7f05997fa640 1 -- 172.21.15.88:0/3133067219 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0590035030 con 0x7f059c106800 2024-09-17T04:31:54.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:54.097+0000 7f05a2939640 1 -- 172.21.15.88:0/3133067219 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f059c198030 con 0x7f059c106800 2024-09-17T04:31:54.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:54.098+0000 7f05a2939640 1 -- 172.21.15.88:0/3133067219 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f059c101f40 con 0x7f059c106800 2024-09-17T04:31:54.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:54.099+0000 7f05997fa640 1 -- 172.21.15.88:0/3133067219 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f0590042070 con 0x7f059c106800 2024-09-17T04:31:54.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:54.100+0000 7f05997fa640 1 --2- 172.21.15.88:0/3133067219 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f058407af30 0x7f058407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:31:54.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:54.100+0000 7f05997fa640 1 -- 172.21.15.88:0/3133067219 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f05900beb40 con 0x7f059c106800 2024-09-17T04:31:54.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:54.100+0000 7f059bfff640 1 --2- 172.21.15.88:0/3133067219 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f058407af30 0x7f058407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:31:54.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:54.100+0000 7f059bfff640 1 --2- 172.21.15.88:0/3133067219 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f058407af30 0x7f058407d3f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f059c1989b0 tx=0x7f058c009110 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:31:54.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:54.104+0000 7f05997fa640 1 -- 172.21.15.88:0/3133067219 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f059008a090 con 0x7f059c106800 2024-09-17T04:31:54.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:54.288+0000 7f05a2939640 1 -- 172.21.15.88:0/3133067219 --> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f059c198da0 con 0x7f058407af30 2024-09-17T04:31:54.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:54.298+0000 7f05997fa640 1 -- 172.21.15.88:0/3133067219 <== mgr.14858 v2:172.21.15.88:6800/2105377518 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f059c198da0 con 0x7f058407af30 2024-09-17T04:31:54.298 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T04:31:54.298 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (2m) 110s ago 18m 17.5M - 0.27.0 11f11916f8cd 5e15bd0ae38c 2024-09-17T04:31:54.299 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi088 smithi088 running (3m) 110s ago 19m 75.4M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 855ea59f1895 2024-09-17T04:31:54.299 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi134 smithi134 running (3m) 2m ago 18m 75.5M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 0e2d1095af7f 2024-09-17T04:31:54.299 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (8m) 110s ago 19m 6891k - 19.3.0-4989-gce1b342b 8e039cb7fe1e 10355648c406 2024-09-17T04:31:54.299 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi134 smithi134 running (8m) 2m ago 18m 6899k - 19.3.0-4989-gce1b342b 8e039cb7fe1e d709085ffe5d 2024-09-17T04:31:54.299 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (115s) 110s ago 18m 44.3M - 10.4.0 c8b91775d855 728b8d3377b1 2024-09-17T04:31:54.299 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.giqrgt smithi088 running (4m) 110s ago 13m 84.7M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 3bb1d05b4476 2024-09-17T04:31:54.299 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.lgavsv smithi088 running (4m) 110s ago 13m 84.8M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 6fb9ba0a8ec3 2024-09-17T04:31:54.299 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi134.ktuhce smithi134 running (4m) 2m ago 13m 155M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 851c1f3a855a 2024-09-17T04:31:54.299 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi134.psnynp smithi134 running (3m) 2m ago 13m 155M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 966e092b224e 2024-09-17T04:31:54.299 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.wmndiv smithi088 *:8443,9283,8765 running (10m) 110s ago 20m 600M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 49eb47f7f14f 2024-09-17T04:31:54.299 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi134.vwdxcb smithi134 *:8443,9283,8765 running (9m) 2m ago 18m 523M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 8a6d45eb0595 2024-09-17T04:31:54.299 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (8m) 110s ago 20m 124M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e ac6332015243 2024-09-17T04:31:54.299 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi134 smithi134 running (8m) 2m ago 18m 105M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e ea49f690e26b 2024-09-17T04:31:54.299 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (3m) 110s ago 19m 11.9M - 1.7.0 72c9c2088986 071e9be71e51 2024-09-17T04:31:54.300 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi134 smithi134 *:9100 running (2m) 2m ago 18m 3309k - 1.7.0 72c9c2088986 b5597a275b46 2024-09-17T04:31:54.300 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (7m) 110s ago 16m 166M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 4ef267302248 2024-09-17T04:31:54.300 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (7m) 110s ago 16m 170M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 17b67c13c7aa 2024-09-17T04:31:54.300 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (6m) 110s ago 15m 157M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 83d38ad792c9 2024-09-17T04:31:54.300 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi134 running (6m) 2m ago 15m 170M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e 336a363ac39f 2024-09-17T04:31:54.300 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi134 running (5m) 2m ago 15m 161M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e 6df8a692310a 2024-09-17T04:31:54.300 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi134 running (5m) 2m ago 14m 156M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e 5066799816d3 2024-09-17T04:31:54.300 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (2m) 110s ago 18m 45.7M - 2.51.0 1d3b7f56885b dbff76a1573c 2024-09-17T04:31:54.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:54.301+0000 7f05a2939640 1 -- 172.21.15.88:0/3133067219 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f058407af30 msgr2=0x7f058407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:31:54.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:54.301+0000 7f05a2939640 1 --2- 172.21.15.88:0/3133067219 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f058407af30 0x7f058407d3f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f059c1989b0 tx=0x7f058c009110 comp rx=0 tx=0).stop 2024-09-17T04:31:54.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:54.301+0000 7f05a2939640 1 -- 172.21.15.88:0/3133067219 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f059c106800 msgr2=0x7f059c19dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:31:54.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:54.301+0000 7f05a2939640 1 --2- 172.21.15.88:0/3133067219 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f059c106800 0x7f059c19dbf0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0590031460 tx=0x7f05900048f0 comp rx=0 tx=0).stop 2024-09-17T04:31:54.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:54.301+0000 7f05a2939640 1 -- 172.21.15.88:0/3133067219 shutdown_connections 2024-09-17T04:31:54.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:54.301+0000 7f05a2939640 1 --2- 172.21.15.88:0/3133067219 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f058407af30 0x7f058407d3f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:31:54.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:54.301+0000 7f05a2939640 1 --2- 172.21.15.88:0/3133067219 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f059c106800 0x7f059c19dbf0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:31:54.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:54.301+0000 7f05a2939640 1 --2- 172.21.15.88:0/3133067219 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f059c100800 0x7f059c19d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:31:54.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:54.301+0000 7f05a2939640 1 -- 172.21.15.88:0/3133067219 >> 172.21.15.88:0/3133067219 conn(0x7f059c0fc520 msgr2=0x7f059c06a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:31:54.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:54.301+0000 7f05a2939640 1 -- 172.21.15.88:0/3133067219 shutdown_connections 2024-09-17T04:31:54.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:54.301+0000 7f05a2939640 1 -- 172.21.15.88:0/3133067219 wait complete. 2024-09-17T04:31:54.618 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:31:54 smithi088 ceph-mon[90867]: pgmap v329: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:31:54.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:31:54 smithi134 ceph-mon[76677]: pgmap v329: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:31:55.015 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -e sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf -- bash -c 'ceph versions' 2024-09-17T04:31:55.263 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:31:55.634 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:31:55 smithi088 ceph-mon[90867]: from='client.34520 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:31:55.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:55.710+0000 7fbdac79d640 1 -- 172.21.15.88:0/222986876 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbda41067f0 msgr2=0x7fbda4106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:31:55.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:55.710+0000 7fbdac79d640 1 --2- 172.21.15.88:0/222986876 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbda41067f0 0x7fbda4106bd0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fbda0009880 tx=0x7fbda002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:31:55.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:55.710+0000 7fbdac79d640 1 -- 172.21.15.88:0/222986876 shutdown_connections 2024-09-17T04:31:55.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:55.710+0000 7fbdac79d640 1 --2- 172.21.15.88:0/222986876 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbda41007f0 0x7fbda4100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:31:55.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:55.710+0000 7fbdac79d640 1 --2- 172.21.15.88:0/222986876 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbda41067f0 0x7fbda4106bd0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:31:55.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:55.710+0000 7fbdac79d640 1 -- 172.21.15.88:0/222986876 >> 172.21.15.88:0/222986876 conn(0x7fbda40fc550 msgr2=0x7fbda40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:31:55.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:55.710+0000 7fbdac79d640 1 -- 172.21.15.88:0/222986876 shutdown_connections 2024-09-17T04:31:55.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:55.710+0000 7fbdac79d640 1 -- 172.21.15.88:0/222986876 wait complete. 2024-09-17T04:31:55.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:55.711+0000 7fbdac79d640 1 Processor -- start 2024-09-17T04:31:55.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:55.711+0000 7fbdac79d640 1 -- start start 2024-09-17T04:31:55.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:55.711+0000 7fbdac79d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbda41007f0 0x7fbda419f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:31:55.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:55.711+0000 7fbdac79d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbda41067f0 0x7fbda419fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:31:55.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:55.711+0000 7fbdac79d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fbda410dcc0 con 0x7fbda41067f0 2024-09-17T04:31:55.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:55.711+0000 7fbdac79d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbda410db40 con 0x7fbda41007f0 2024-09-17T04:31:55.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:55.711+0000 7fbda9d38640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbda41067f0 0x7fbda419fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:31:55.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:55.711+0000 7fbda9d38640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbda41067f0 0x7fbda419fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53286/0 (socket says 172.21.15.88:53286) 2024-09-17T04:31:55.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:55.711+0000 7fbda9d38640 1 -- 172.21.15.88:0/3809707464 learned_addr learned my addr 172.21.15.88:0/3809707464 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:31:55.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:55.712+0000 7fbdaa539640 1 --2- 172.21.15.88:0/3809707464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbda41007f0 0x7fbda419f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:31:55.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:55.712+0000 7fbda9d38640 1 -- 172.21.15.88:0/3809707464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbda41007f0 msgr2=0x7fbda419f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:31:55.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:55.712+0000 7fbda9d38640 1 --2- 172.21.15.88:0/3809707464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbda41007f0 0x7fbda419f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:31:55.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:55.712+0000 7fbda9d38640 1 -- 172.21.15.88:0/3809707464 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbda41999b0 con 0x7fbda41067f0 2024-09-17T04:31:55.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:55.712+0000 7fbda9d38640 1 --2- 172.21.15.88:0/3809707464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbda41067f0 0x7fbda419fd30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbd9400c8f0 tx=0x7fbd9400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:31:55.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:55.712+0000 7fbd9b7fe640 1 -- 172.21.15.88:0/3809707464 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbd940079b0 con 0x7fbda41067f0 2024-09-17T04:31:55.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:55.712+0000 7fbdac79d640 1 -- 172.21.15.88:0/3809707464 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbda4199ca0 con 0x7fbda41067f0 2024-09-17T04:31:55.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:55.712+0000 7fbdac79d640 1 -- 172.21.15.88:0/3809707464 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbda419a230 con 0x7fbda41067f0 2024-09-17T04:31:55.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:55.712+0000 7fbd9b7fe640 1 -- 172.21.15.88:0/3809707464 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbd940054e0 con 0x7fbda41067f0 2024-09-17T04:31:55.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:55.712+0000 7fbd9b7fe640 1 -- 172.21.15.88:0/3809707464 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbd94004dd0 con 0x7fbda41067f0 2024-09-17T04:31:55.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:55.713+0000 7fbdac79d640 1 -- 172.21.15.88:0/3809707464 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd88005290 con 0x7fbda41067f0 2024-09-17T04:31:55.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:55.714+0000 7fbd9b7fe640 1 -- 172.21.15.88:0/3809707464 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fbd94007b50 con 0x7fbda41067f0 2024-09-17T04:31:55.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:55.714+0000 7fbd9b7fe640 1 --2- 172.21.15.88:0/3809707464 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fbd9007aed0 0x7fbd9007d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:31:55.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:55.714+0000 7fbd9b7fe640 1 -- 172.21.15.88:0/3809707464 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fbd9409df20 con 0x7fbda41067f0 2024-09-17T04:31:55.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:55.714+0000 7fbdaa539640 1 --2- 172.21.15.88:0/3809707464 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fbd9007aed0 0x7fbd9007d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:31:55.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:55.715+0000 7fbdaa539640 1 --2- 172.21.15.88:0/3809707464 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fbd9007aed0 0x7fbd9007d390 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbda0031460 tx=0x7fbda0009560 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:31:55.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:55.719+0000 7fbd9b7fe640 1 -- 172.21.15.88:0/3809707464 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fbd94014030 con 0x7fbda41067f0 2024-09-17T04:31:55.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:31:55 smithi134 ceph-mon[76677]: from='client.34520 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T04:31:55.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:55.964+0000 7fbdac79d640 1 -- 172.21.15.88:0/3809707464 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fbd88005d90 con 0x7fbda41067f0 2024-09-17T04:31:55.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:55.965+0000 7fbd9b7fe640 1 -- 172.21.15.88:0/3809707464 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fbd94069470 con 0x7fbda41067f0 2024-09-17T04:31:55.965 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-17T04:31:55.965 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-09-17T04:31:55.965 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T04:31:55.965 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:31:55.965 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-09-17T04:31:55.965 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T04:31:55.965 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:31:55.965 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-09-17T04:31:55.965 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 6 2024-09-17T04:31:55.965 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:31:55.966 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2024-09-17T04:31:55.966 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 4 2024-09-17T04:31:55.966 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-17T04:31:55.966 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-09-17T04:31:55.966 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 14 2024-09-17T04:31:55.966 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-17T04:31:55.966 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-17T04:31:55.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:55.967+0000 7fbdac79d640 1 -- 172.21.15.88:0/3809707464 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fbd9007aed0 msgr2=0x7fbd9007d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:31:55.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:55.967+0000 7fbdac79d640 1 --2- 172.21.15.88:0/3809707464 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fbd9007aed0 0x7fbd9007d390 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbda0031460 tx=0x7fbda0009560 comp rx=0 tx=0).stop 2024-09-17T04:31:55.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:55.967+0000 7fbdac79d640 1 -- 172.21.15.88:0/3809707464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbda41067f0 msgr2=0x7fbda419fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:31:55.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:55.967+0000 7fbdac79d640 1 --2- 172.21.15.88:0/3809707464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbda41067f0 0x7fbda419fd30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbd9400c8f0 tx=0x7fbd9400cdb0 comp rx=0 tx=0).stop 2024-09-17T04:31:55.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:55.967+0000 7fbdac79d640 1 -- 172.21.15.88:0/3809707464 shutdown_connections 2024-09-17T04:31:55.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:55.967+0000 7fbdac79d640 1 --2- 172.21.15.88:0/3809707464 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fbd9007aed0 0x7fbd9007d390 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:31:55.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:55.967+0000 7fbdac79d640 1 --2- 172.21.15.88:0/3809707464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbda41067f0 0x7fbda419fd30 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:31:55.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:55.967+0000 7fbdac79d640 1 --2- 172.21.15.88:0/3809707464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbda41007f0 0x7fbda419f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:31:55.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:55.967+0000 7fbdac79d640 1 -- 172.21.15.88:0/3809707464 >> 172.21.15.88:0/3809707464 conn(0x7fbda40fc550 msgr2=0x7fbda4069da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:31:55.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:55.967+0000 7fbdac79d640 1 -- 172.21.15.88:0/3809707464 shutdown_connections 2024-09-17T04:31:55.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:55.967+0000 7fbdac79d640 1 -- 172.21.15.88:0/3809707464 wait complete. 2024-09-17T04:31:56.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:31:56 smithi088 ceph-mon[90867]: pgmap v330: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:31:56.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:31:56 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/3809707464' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:31:56.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:31:56 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:31:56.721 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -e sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-09-17T04:31:56.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:31:56 smithi134 ceph-mon[76677]: pgmap v330: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:31:56.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:31:56 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/3809707464' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:31:56.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:31:56 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:31:56.967 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:31:57.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:57.435+0000 7fcf9159e640 1 -- 172.21.15.88:0/1750312793 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf8c107900 msgr2=0x7fcf8c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:31:57.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:57.435+0000 7fcf9159e640 1 --2- 172.21.15.88:0/1750312793 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf8c107900 0x7fcf8c107ce0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c009c20 tx=0x7fcf7c02a970 comp rx=0 tx=0).stop 2024-09-17T04:31:57.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:57.435+0000 7fcf9159e640 1 -- 172.21.15.88:0/1750312793 shutdown_connections 2024-09-17T04:31:57.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:57.435+0000 7fcf9159e640 1 --2- 172.21.15.88:0/1750312793 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf8c101900 0x7fcf8c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:31:57.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:57.435+0000 7fcf9159e640 1 --2- 172.21.15.88:0/1750312793 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf8c107900 0x7fcf8c107ce0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:31:57.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:57.435+0000 7fcf9159e640 1 -- 172.21.15.88:0/1750312793 >> 172.21.15.88:0/1750312793 conn(0x7fcf8c0fd600 msgr2=0x7fcf8c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:31:57.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:57.435+0000 7fcf9159e640 1 -- 172.21.15.88:0/1750312793 shutdown_connections 2024-09-17T04:31:57.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:57.435+0000 7fcf9159e640 1 -- 172.21.15.88:0/1750312793 wait complete. 2024-09-17T04:31:57.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:57.436+0000 7fcf9159e640 1 Processor -- start 2024-09-17T04:31:57.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:57.436+0000 7fcf9159e640 1 -- start start 2024-09-17T04:31:57.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:57.436+0000 7fcf9159e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf8c101900 0x7fcf8c19d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:31:57.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:57.436+0000 7fcf9159e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf8c107900 0x7fcf8c19db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:31:57.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:57.436+0000 7fcf9159e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fcf8c10edd0 con 0x7fcf8c107900 2024-09-17T04:31:57.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:57.436+0000 7fcf9159e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcf8c10ec50 con 0x7fcf8c101900 2024-09-17T04:31:57.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:57.436+0000 7fcf8a7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf8c107900 0x7fcf8c19db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:31:57.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:57.436+0000 7fcf8a7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf8c107900 0x7fcf8c19db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53308/0 (socket says 172.21.15.88:53308) 2024-09-17T04:31:57.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:57.436+0000 7fcf8a7fc640 1 -- 172.21.15.88:0/686599067 learned_addr learned my addr 172.21.15.88:0/686599067 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:31:57.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:57.437+0000 7fcf8affd640 1 --2- 172.21.15.88:0/686599067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf8c101900 0x7fcf8c19d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:31:57.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:57.437+0000 7fcf8a7fc640 1 -- 172.21.15.88:0/686599067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf8c101900 msgr2=0x7fcf8c19d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:31:57.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:57.437+0000 7fcf8a7fc640 1 --2- 172.21.15.88:0/686599067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf8c101900 0x7fcf8c19d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:31:57.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:57.437+0000 7fcf8a7fc640 1 -- 172.21.15.88:0/686599067 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf8c1977a0 con 0x7fcf8c107900 2024-09-17T04:31:57.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:57.437+0000 7fcf8affd640 1 --2- 172.21.15.88:0/686599067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf8c101900 0x7fcf8c19d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:31:57.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:57.437+0000 7fcf8a7fc640 1 --2- 172.21.15.88:0/686599067 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf8c107900 0x7fcf8c19db60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fcf8000c8f0 tx=0x7fcf8000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:31:57.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:57.437+0000 7fcf73fff640 1 -- 172.21.15.88:0/686599067 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcf800079b0 con 0x7fcf8c107900 2024-09-17T04:31:57.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:57.437+0000 7fcf73fff640 1 -- 172.21.15.88:0/686599067 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcf800054e0 con 0x7fcf8c107900 2024-09-17T04:31:57.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:57.437+0000 7fcf9159e640 1 -- 172.21.15.88:0/686599067 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf8c197a90 con 0x7fcf8c107900 2024-09-17T04:31:57.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:57.437+0000 7fcf73fff640 1 -- 172.21.15.88:0/686599067 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcf80004dd0 con 0x7fcf8c107900 2024-09-17T04:31:57.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:57.437+0000 7fcf9159e640 1 -- 172.21.15.88:0/686599067 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf8c198020 con 0x7fcf8c107900 2024-09-17T04:31:57.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:57.438+0000 7fcf9159e640 1 -- 172.21.15.88:0/686599067 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf8c103040 con 0x7fcf8c107900 2024-09-17T04:31:57.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:57.439+0000 7fcf73fff640 1 -- 172.21.15.88:0/686599067 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fcf80005020 con 0x7fcf8c107900 2024-09-17T04:31:57.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:57.439+0000 7fcf73fff640 1 --2- 172.21.15.88:0/686599067 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fcf7407aed0 0x7fcf7407d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:31:57.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:57.439+0000 7fcf73fff640 1 -- 172.21.15.88:0/686599067 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fcf8009e0f0 con 0x7fcf8c107900 2024-09-17T04:31:57.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:57.439+0000 7fcf8affd640 1 --2- 172.21.15.88:0/686599067 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fcf7407aed0 0x7fcf7407d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:31:57.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:57.440+0000 7fcf8affd640 1 --2- 172.21.15.88:0/686599067 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fcf7407aed0 0x7fcf7407d390 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c006010 tx=0x7fcf7c02f9d0 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:31:57.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:57.444+0000 7fcf73fff640 1 -- 172.21.15.88:0/686599067 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fcf80014030 con 0x7fcf8c107900 2024-09-17T04:31:57.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:57.696+0000 7fcf9159e640 1 -- 172.21.15.88:0/686599067 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fcf8c109e70 con 0x7fcf8c107900 2024-09-17T04:31:57.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:57.697+0000 7fcf73fff640 1 -- 172.21.15.88:0/686599067 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fcf800695e0 con 0x7fcf8c107900 2024-09-17T04:31:57.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:57.699+0000 7fcf9159e640 1 -- 172.21.15.88:0/686599067 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fcf7407aed0 msgr2=0x7fcf7407d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:31:57.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:57.699+0000 7fcf9159e640 1 --2- 172.21.15.88:0/686599067 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fcf7407aed0 0x7fcf7407d390 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c006010 tx=0x7fcf7c02f9d0 comp rx=0 tx=0).stop 2024-09-17T04:31:57.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:57.699+0000 7fcf9159e640 1 -- 172.21.15.88:0/686599067 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf8c107900 msgr2=0x7fcf8c19db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:31:57.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:57.699+0000 7fcf9159e640 1 --2- 172.21.15.88:0/686599067 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf8c107900 0x7fcf8c19db60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fcf8000c8f0 tx=0x7fcf8000cdb0 comp rx=0 tx=0).stop 2024-09-17T04:31:57.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:57.699+0000 7fcf9159e640 1 -- 172.21.15.88:0/686599067 shutdown_connections 2024-09-17T04:31:57.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:57.699+0000 7fcf9159e640 1 --2- 172.21.15.88:0/686599067 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fcf7407aed0 0x7fcf7407d390 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:31:57.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:57.699+0000 7fcf9159e640 1 --2- 172.21.15.88:0/686599067 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf8c107900 0x7fcf8c19db60 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:31:57.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:57.699+0000 7fcf9159e640 1 --2- 172.21.15.88:0/686599067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf8c101900 0x7fcf8c19d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:31:57.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:57.699+0000 7fcf9159e640 1 -- 172.21.15.88:0/686599067 >> 172.21.15.88:0/686599067 conn(0x7fcf8c0fd600 msgr2=0x7fcf8c0fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:31:57.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:57.699+0000 7fcf9159e640 1 -- 172.21.15.88:0/686599067 shutdown_connections 2024-09-17T04:31:57.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:57.699+0000 7fcf9159e640 1 -- 172.21.15.88:0/686599067 wait complete. 2024-09-17T04:31:57.707 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-09-17T04:31:58.338 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -e sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-09-17T04:31:58.589 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:31:58.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:31:58 smithi088 ceph-mon[90867]: pgmap v331: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:31:58.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:31:58 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/686599067' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:31:58.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:31:58 smithi134 ceph-mon[76677]: pgmap v331: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:31:58.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:31:58 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/686599067' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:31:59.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:59.033+0000 7f7c0e5c3640 1 -- 172.21.15.88:0/3618611554 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c081034a0 msgr2=0x7f7c0810b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:31:59.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:59.033+0000 7f7c0e5c3640 1 --2- 172.21.15.88:0/3618611554 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c081034a0 0x7f7c0810b990 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc009880 tx=0x7f7bfc02a530 comp rx=0 tx=0).stop 2024-09-17T04:31:59.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:59.033+0000 7f7c0e5c3640 1 -- 172.21.15.88:0/3618611554 shutdown_connections 2024-09-17T04:31:59.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:59.033+0000 7f7c0e5c3640 1 --2- 172.21.15.88:0/3618611554 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c081034a0 0x7f7c0810b990 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:31:59.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:59.033+0000 7f7c0e5c3640 1 --2- 172.21.15.88:0/3618611554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c08102b80 0x7f7c08102f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:31:59.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:59.033+0000 7f7c0e5c3640 1 -- 172.21.15.88:0/3618611554 >> 172.21.15.88:0/3618611554 conn(0x7f7c080fc520 msgr2=0x7f7c080fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:31:59.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:59.033+0000 7f7c0e5c3640 1 -- 172.21.15.88:0/3618611554 shutdown_connections 2024-09-17T04:31:59.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:59.033+0000 7f7c0e5c3640 1 -- 172.21.15.88:0/3618611554 wait complete. 2024-09-17T04:31:59.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:59.034+0000 7f7c0e5c3640 1 Processor -- start 2024-09-17T04:31:59.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:59.034+0000 7f7c0e5c3640 1 -- start start 2024-09-17T04:31:59.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:59.034+0000 7f7c0e5c3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c08102b80 0x7f7c081007e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:31:59.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:59.034+0000 7f7c0e5c3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c081034a0 0x7f7c08100d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:31:59.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:59.034+0000 7f7c0e5c3640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f7c0810edd0 con 0x7f7c081034a0 2024-09-17T04:31:59.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:59.034+0000 7f7c0e5c3640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7c0810ec50 con 0x7f7c08102b80 2024-09-17T04:31:59.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:59.034+0000 7f7c077fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c081034a0 0x7f7c08100d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:31:59.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:59.034+0000 7f7c077fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c081034a0 0x7f7c08100d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53326/0 (socket says 172.21.15.88:53326) 2024-09-17T04:31:59.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:59.034+0000 7f7c077fe640 1 -- 172.21.15.88:0/1353341419 learned_addr learned my addr 172.21.15.88:0/1353341419 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:31:59.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:59.034+0000 7f7c07fff640 1 --2- 172.21.15.88:0/1353341419 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c08102b80 0x7f7c081007e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:31:59.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:59.034+0000 7f7c077fe640 1 -- 172.21.15.88:0/1353341419 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c08102b80 msgr2=0x7f7c081007e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:31:59.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:59.034+0000 7f7c077fe640 1 --2- 172.21.15.88:0/1353341419 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c08102b80 0x7f7c081007e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:31:59.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:59.035+0000 7f7c077fe640 1 -- 172.21.15.88:0/1353341419 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c08101260 con 0x7f7c081034a0 2024-09-17T04:31:59.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:59.035+0000 7f7c077fe640 1 --2- 172.21.15.88:0/1353341419 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c081034a0 0x7f7c08100d20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc004f90 tx=0x7f7bfc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:31:59.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:59.035+0000 7f7c057fa640 1 -- 172.21.15.88:0/1353341419 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7bfc03f070 con 0x7f7c081034a0 2024-09-17T04:31:59.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:59.035+0000 7f7c057fa640 1 -- 172.21.15.88:0/1353341419 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7bfc004cf0 con 0x7f7c081034a0 2024-09-17T04:31:59.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:59.035+0000 7f7c0e5c3640 1 -- 172.21.15.88:0/1353341419 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c081014f0 con 0x7f7c081034a0 2024-09-17T04:31:59.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:59.035+0000 7f7c057fa640 1 -- 172.21.15.88:0/1353341419 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7bfc035030 con 0x7f7c081034a0 2024-09-17T04:31:59.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:59.035+0000 7f7c0e5c3640 1 -- 172.21.15.88:0/1353341419 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c081a3d30 con 0x7f7c081034a0 2024-09-17T04:31:59.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:59.036+0000 7f7c0e5c3640 1 -- 172.21.15.88:0/1353341419 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c0806a9d0 con 0x7f7c081034a0 2024-09-17T04:31:59.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:59.037+0000 7f7c057fa640 1 -- 172.21.15.88:0/1353341419 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f7bfc042070 con 0x7f7c081034a0 2024-09-17T04:31:59.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:59.037+0000 7f7c057fa640 1 --2- 172.21.15.88:0/1353341419 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f7bf007af30 0x7f7bf007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:31:59.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:59.037+0000 7f7c057fa640 1 -- 172.21.15.88:0/1353341419 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f7bfc0beae0 con 0x7f7c081034a0 2024-09-17T04:31:59.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:59.037+0000 7f7c07fff640 1 --2- 172.21.15.88:0/1353341419 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f7bf007af30 0x7f7bf007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:31:59.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:59.038+0000 7f7c07fff640 1 --2- 172.21.15.88:0/1353341419 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f7bf007af30 0x7f7bf007d3f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7bf800abe0 tx=0x7f7bf800a2d0 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:31:59.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:59.042+0000 7f7c057fa640 1 -- 172.21.15.88:0/1353341419 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f7bfc08a030 con 0x7f7c081034a0 2024-09-17T04:31:59.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:59.291+0000 7f7c0e5c3640 1 -- 172.21.15.88:0/1353341419 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f7c08104f90 con 0x7f7c081034a0 2024-09-17T04:31:59.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:59.291+0000 7f7c057fa640 1 -- 172.21.15.88:0/1353341419 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f7bfc08eee0 con 0x7f7c081034a0 2024-09-17T04:31:59.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:59.293+0000 7f7c0e5c3640 1 -- 172.21.15.88:0/1353341419 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f7bf007af30 msgr2=0x7f7bf007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:31:59.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:59.293+0000 7f7c0e5c3640 1 --2- 172.21.15.88:0/1353341419 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f7bf007af30 0x7f7bf007d3f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7bf800abe0 tx=0x7f7bf800a2d0 comp rx=0 tx=0).stop 2024-09-17T04:31:59.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:59.293+0000 7f7c0e5c3640 1 -- 172.21.15.88:0/1353341419 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c081034a0 msgr2=0x7f7c08100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:31:59.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:59.293+0000 7f7c0e5c3640 1 --2- 172.21.15.88:0/1353341419 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c081034a0 0x7f7c08100d20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc004f90 tx=0x7f7bfc0048f0 comp rx=0 tx=0).stop 2024-09-17T04:31:59.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:59.293+0000 7f7c0e5c3640 1 -- 172.21.15.88:0/1353341419 shutdown_connections 2024-09-17T04:31:59.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:59.293+0000 7f7c0e5c3640 1 --2- 172.21.15.88:0/1353341419 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f7bf007af30 0x7f7bf007d3f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:31:59.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:59.293+0000 7f7c0e5c3640 1 --2- 172.21.15.88:0/1353341419 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c081034a0 0x7f7c08100d20 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:31:59.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:59.293+0000 7f7c0e5c3640 1 --2- 172.21.15.88:0/1353341419 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c08102b80 0x7f7c081007e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:31:59.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:59.293+0000 7f7c0e5c3640 1 -- 172.21.15.88:0/1353341419 >> 172.21.15.88:0/1353341419 conn(0x7f7c080fc520 msgr2=0x7f7c08107e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:31:59.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:59.293+0000 7f7c0e5c3640 1 -- 172.21.15.88:0/1353341419 shutdown_connections 2024-09-17T04:31:59.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:31:59.293+0000 7f7c0e5c3640 1 -- 172.21.15.88:0/1353341419 wait complete. 2024-09-17T04:31:59.302 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)" 2024-09-17T04:31:59.600 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:31:59 smithi088 ceph-mon[90867]: pgmap v332: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:31:59.600 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:31:59 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/1353341419' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:31:59.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:31:59 smithi134 ceph-mon[76677]: pgmap v332: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:31:59.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:31:59 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/1353341419' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T04:31:59.903 DEBUG:teuthology.parallel:result is None 2024-09-17T04:31:59.903 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T04:31:59.918 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi088.front.sepia.ceph.com 2024-09-17T04:31:59.918 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-17T04:32:00.166 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:32:00.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:00.611+0000 7f9f878c2640 1 -- 172.21.15.88:0/1234095267 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f801033d0 msgr2=0x7f9f8010b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:00.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:00.611+0000 7f9f878c2640 1 --2- 172.21.15.88:0/1234095267 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f801033d0 0x7f9f8010b8c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9f74009880 tx=0x7f9f7402a530 comp rx=0 tx=0).stop 2024-09-17T04:32:00.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:00.611+0000 7f9f878c2640 1 -- 172.21.15.88:0/1234095267 shutdown_connections 2024-09-17T04:32:00.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:00.611+0000 7f9f878c2640 1 --2- 172.21.15.88:0/1234095267 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f801033d0 0x7f9f8010b8c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:00.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:00.611+0000 7f9f878c2640 1 --2- 172.21.15.88:0/1234095267 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f80102ab0 0x7f9f80102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:00.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:00.611+0000 7f9f878c2640 1 -- 172.21.15.88:0/1234095267 >> 172.21.15.88:0/1234095267 conn(0x7f9f800fc550 msgr2=0x7f9f800fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:32:00.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:00.611+0000 7f9f878c2640 1 -- 172.21.15.88:0/1234095267 shutdown_connections 2024-09-17T04:32:00.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:00.611+0000 7f9f878c2640 1 -- 172.21.15.88:0/1234095267 wait complete. 2024-09-17T04:32:00.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:00.611+0000 7f9f878c2640 1 Processor -- start 2024-09-17T04:32:00.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:00.612+0000 7f9f878c2640 1 -- start start 2024-09-17T04:32:00.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:00.612+0000 7f9f878c2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f80102ab0 0x7f9f80100710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:00.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:00.612+0000 7f9f878c2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f801033d0 0x7f9f80100c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:00.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:00.612+0000 7f9f878c2640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f9f8010edc0 con 0x7f9f80102ab0 2024-09-17T04:32:00.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:00.612+0000 7f9f878c2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9f8010ec40 con 0x7f9f801033d0 2024-09-17T04:32:00.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:00.612+0000 7f9f8565e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f80102ab0 0x7f9f80100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:00.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:00.612+0000 7f9f8565e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f80102ab0 0x7f9f80100710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53354/0 (socket says 172.21.15.88:53354) 2024-09-17T04:32:00.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:00.612+0000 7f9f8565e640 1 -- 172.21.15.88:0/1184687929 learned_addr learned my addr 172.21.15.88:0/1184687929 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:32:00.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:00.612+0000 7f9f84e5d640 1 --2- 172.21.15.88:0/1184687929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f801033d0 0x7f9f80100c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:00.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:00.612+0000 7f9f8565e640 1 -- 172.21.15.88:0/1184687929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f801033d0 msgr2=0x7f9f80100c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:00.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:00.612+0000 7f9f8565e640 1 --2- 172.21.15.88:0/1184687929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f801033d0 0x7f9f80100c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:00.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:00.612+0000 7f9f8565e640 1 -- 172.21.15.88:0/1184687929 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f80101190 con 0x7f9f80102ab0 2024-09-17T04:32:00.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:00.612+0000 7f9f84e5d640 1 --2- 172.21.15.88:0/1184687929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f801033d0 0x7f9f80100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:32:00.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:00.612+0000 7f9f8565e640 1 --2- 172.21.15.88:0/1184687929 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f80102ab0 0x7f9f80100710 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9f7800c810 tx=0x7f9f7800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:32:00.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:00.612+0000 7f9f7e7fc640 1 -- 172.21.15.88:0/1184687929 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9f78004020 con 0x7f9f80102ab0 2024-09-17T04:32:00.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:00.613+0000 7f9f7e7fc640 1 -- 172.21.15.88:0/1184687929 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9f780041c0 con 0x7f9f80102ab0 2024-09-17T04:32:00.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:00.613+0000 7f9f7e7fc640 1 -- 172.21.15.88:0/1184687929 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9f780047a0 con 0x7f9f80102ab0 2024-09-17T04:32:00.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:00.613+0000 7f9f878c2640 1 -- 172.21.15.88:0/1184687929 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f80101480 con 0x7f9f80102ab0 2024-09-17T04:32:00.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:00.613+0000 7f9f878c2640 1 -- 172.21.15.88:0/1184687929 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f801a3e10 con 0x7f9f80102ab0 2024-09-17T04:32:00.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:00.613+0000 7f9f878c2640 1 -- 172.21.15.88:0/1184687929 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f8006a580 con 0x7f9f80102ab0 2024-09-17T04:32:00.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:00.614+0000 7f9f7e7fc640 1 -- 172.21.15.88:0/1184687929 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f9f780079b0 con 0x7f9f80102ab0 2024-09-17T04:32:00.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:00.615+0000 7f9f7e7fc640 1 --2- 172.21.15.88:0/1184687929 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f9f6807af80 0x7f9f6807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:00.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:00.615+0000 7f9f7e7fc640 1 -- 172.21.15.88:0/1184687929 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f9f7809df10 con 0x7f9f80102ab0 2024-09-17T04:32:00.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:00.615+0000 7f9f84e5d640 1 --2- 172.21.15.88:0/1184687929 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f9f6807af80 0x7f9f6807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:00.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:00.615+0000 7f9f84e5d640 1 --2- 172.21.15.88:0/1184687929 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f9f6807af80 0x7f9f6807d440 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9f801021a0 tx=0x7f9f74009560 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:32:00.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:00.619+0000 7f9f7e7fc640 1 -- 172.21.15.88:0/1184687929 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f9f78014030 con 0x7f9f80102ab0 2024-09-17T04:32:00.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:00.831+0000 7f9f878c2640 1 -- 172.21.15.88:0/1184687929 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f9f801a4130 con 0x7f9f80102ab0 2024-09-17T04:32:00.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:00.831+0000 7f9f7e7fc640 1 -- 172.21.15.88:0/1184687929 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 38 v38) ==== 76+0+2047 (secure 0 0 0) 0x7f9f780694e0 con 0x7f9f80102ab0 2024-09-17T04:32:00.832 INFO:teuthology.orchestra.run.smithi088.stdout:e38 2024-09-17T04:32:00.832 INFO:teuthology.orchestra.run.smithi088.stdout:btime 2024-09-17T04:28:17:685888+0000 2024-09-17T04:32:00.832 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T04:32:00.832 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:32:00.832 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2024-09-17T04:32:00.832 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:32:00.832 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2024-09-17T04:32:00.832 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2024-09-17T04:32:00.832 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 38 2024-09-17T04:32:00.832 INFO:teuthology.orchestra.run.smithi088.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T04:32:00.832 INFO:teuthology.orchestra.run.smithi088.stdout:created 2024-09-17T04:18:10.480573+0000 2024-09-17T04:32:00.832 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2024-09-17T04:28:17.685877+0000 2024-09-17T04:32:00.833 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2024-09-17T04:32:00.833 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2024-09-17T04:32:00.833 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2024-09-17T04:32:00.833 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2024-09-17T04:32:00.833 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2024-09-17T04:32:00.833 INFO:teuthology.orchestra.run.smithi088.stdout:max_xattr_size 65536 2024-09-17T04:32:00.833 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2024-09-17T04:32:00.833 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2024-09-17T04:32:00.833 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 82 2024-09-17T04:32:00.833 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T04:32:00.833 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 1 2024-09-17T04:32:00.833 INFO:teuthology.orchestra.run.smithi088.stdout:in 0 2024-09-17T04:32:00.833 INFO:teuthology.orchestra.run.smithi088.stdout:up {0=34273} 2024-09-17T04:32:00.834 INFO:teuthology.orchestra.run.smithi088.stdout:failed 2024-09-17T04:32:00.834 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2024-09-17T04:32:00.834 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2024-09-17T04:32:00.834 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2024-09-17T04:32:00.834 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2024-09-17T04:32:00.834 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data enabled 2024-09-17T04:32:00.834 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2024-09-17T04:32:00.834 INFO:teuthology.orchestra.run.smithi088.stdout:bal_rank_mask -1 2024-09-17T04:32:00.834 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 1 2024-09-17T04:32:00.834 INFO:teuthology.orchestra.run.smithi088.stdout:qdb_cluster leader: 34273 members: 34273 2024-09-17T04:32:00.834 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi134.ktuhce{0:34273} state up:active seq 8 join_fscid=1 addr [v2:172.21.15.134:6824/3452154372,v1:172.21.15.134:6825/3452154372] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:32:00.834 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi134.psnynp{0:34305} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/3085319848,v1:172.21.15.134:6827/3085319848] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:32:00.834 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:32:00.834 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:32:00.835 INFO:teuthology.orchestra.run.smithi088.stdout:Standby daemons: 2024-09-17T04:32:00.835 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:32:00.835 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.lgavsv{-1:34318} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/3125957194,v1:172.21.15.88:6827/3125957194] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:32:00.835 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.giqrgt{-1:34322} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6828/2683662376,v1:172.21.15.88:6829/2683662376] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T04:32:00.835 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 38 2024-09-17T04:32:00.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:00.834+0000 7f9f878c2640 1 -- 172.21.15.88:0/1184687929 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f9f6807af80 msgr2=0x7f9f6807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:00.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:00.834+0000 7f9f878c2640 1 --2- 172.21.15.88:0/1184687929 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f9f6807af80 0x7f9f6807d440 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9f801021a0 tx=0x7f9f74009560 comp rx=0 tx=0).stop 2024-09-17T04:32:00.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:00.834+0000 7f9f878c2640 1 -- 172.21.15.88:0/1184687929 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f80102ab0 msgr2=0x7f9f80100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:00.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:00.834+0000 7f9f878c2640 1 --2- 172.21.15.88:0/1184687929 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f80102ab0 0x7f9f80100710 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9f7800c810 tx=0x7f9f7800ccd0 comp rx=0 tx=0).stop 2024-09-17T04:32:00.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:00.834+0000 7f9f878c2640 1 -- 172.21.15.88:0/1184687929 shutdown_connections 2024-09-17T04:32:00.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:00.834+0000 7f9f878c2640 1 --2- 172.21.15.88:0/1184687929 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f9f6807af80 0x7f9f6807d440 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:00.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:00.834+0000 7f9f878c2640 1 --2- 172.21.15.88:0/1184687929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f801033d0 0x7f9f80100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:00.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:00.834+0000 7f9f878c2640 1 --2- 172.21.15.88:0/1184687929 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f80102ab0 0x7f9f80100710 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:00.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:00.834+0000 7f9f878c2640 1 -- 172.21.15.88:0/1184687929 >> 172.21.15.88:0/1184687929 conn(0x7f9f800fc550 msgr2=0x7f9f8010aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:32:00.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:00.835+0000 7f9f878c2640 1 -- 172.21.15.88:0/1184687929 shutdown_connections 2024-09-17T04:32:00.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:00.835+0000 7f9f878c2640 1 -- 172.21.15.88:0/1184687929 wait complete. 2024-09-17T04:32:01.611 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-09-17T04:32:01.630 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-17T04:32:01.880 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:32:01.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:01 smithi088 ceph-mon[90867]: pgmap v333: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:32:01.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:01 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/1184687929' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T04:32:01.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:01 smithi134 ceph-mon[76677]: pgmap v333: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:32:01.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:01 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/1184687929' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T04:32:02.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:02.298+0000 7ff8b508d640 1 -- 172.21.15.88:0/2025332653 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8b01067f0 msgr2=0x7ff8b0106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:02.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:02.298+0000 7ff8b508d640 1 --2- 172.21.15.88:0/2025332653 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8b01067f0 0x7ff8b0106bd0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0009880 tx=0x7ff8a002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:32:02.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:02.298+0000 7ff8b508d640 1 -- 172.21.15.88:0/2025332653 shutdown_connections 2024-09-17T04:32:02.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:02.298+0000 7ff8b508d640 1 --2- 172.21.15.88:0/2025332653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8b01007f0 0x7ff8b0100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:02.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:02.298+0000 7ff8b508d640 1 --2- 172.21.15.88:0/2025332653 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8b01067f0 0x7ff8b0106bd0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:02.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:02.298+0000 7ff8b508d640 1 -- 172.21.15.88:0/2025332653 >> 172.21.15.88:0/2025332653 conn(0x7ff8b00fc550 msgr2=0x7ff8b00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:32:02.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:02.298+0000 7ff8b508d640 1 -- 172.21.15.88:0/2025332653 shutdown_connections 2024-09-17T04:32:02.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:02.298+0000 7ff8b508d640 1 -- 172.21.15.88:0/2025332653 wait complete. 2024-09-17T04:32:02.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:02.299+0000 7ff8b508d640 1 Processor -- start 2024-09-17T04:32:02.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:02.299+0000 7ff8b508d640 1 -- start start 2024-09-17T04:32:02.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:02.299+0000 7ff8b508d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8b01007f0 0x7ff8b0198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:02.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:02.299+0000 7ff8b508d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8b01067f0 0x7ff8b0198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:02.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:02.299+0000 7ff8b508d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b010dcc0 con 0x7ff8b01007f0 2024-09-17T04:32:02.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:02.299+0000 7ff8b508d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b010db40 con 0x7ff8b01067f0 2024-09-17T04:32:02.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:02.300+0000 7ff8aed9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8b01007f0 0x7ff8b0198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:02.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:02.300+0000 7ff8ae59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8b01067f0 0x7ff8b0198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:02.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:02.300+0000 7ff8ae59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8b01067f0 0x7ff8b0198d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.88:54072/0 (socket says 172.21.15.88:54072) 2024-09-17T04:32:02.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:02.300+0000 7ff8ae59c640 1 -- 172.21.15.88:0/2719000365 learned_addr learned my addr 172.21.15.88:0/2719000365 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:32:02.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:02.300+0000 7ff8aed9d640 1 -- 172.21.15.88:0/2719000365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8b01067f0 msgr2=0x7ff8b0198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:02.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:02.300+0000 7ff8aed9d640 1 --2- 172.21.15.88:0/2719000365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8b01067f0 0x7ff8b0198d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:02.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:02.300+0000 7ff8aed9d640 1 -- 172.21.15.88:0/2719000365 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8b0199350 con 0x7ff8b01007f0 2024-09-17T04:32:02.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:02.300+0000 7ff8ae59c640 1 --2- 172.21.15.88:0/2719000365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8b01067f0 0x7ff8b0198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:32:02.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:02.300+0000 7ff8aed9d640 1 --2- 172.21.15.88:0/2719000365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8b01007f0 0x7ff8b0198810 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0006010 tx=0x7ff8a00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:32:02.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:02.300+0000 7ff897fff640 1 -- 172.21.15.88:0/2719000365 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff8a003f070 con 0x7ff8b01007f0 2024-09-17T04:32:02.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:02.300+0000 7ff8b508d640 1 -- 172.21.15.88:0/2719000365 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8b01995e0 con 0x7ff8b01007f0 2024-09-17T04:32:02.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:02.300+0000 7ff897fff640 1 -- 172.21.15.88:0/2719000365 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff8a00035f0 con 0x7ff8b01007f0 2024-09-17T04:32:02.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:02.300+0000 7ff897fff640 1 -- 172.21.15.88:0/2719000365 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff8a0035030 con 0x7ff8b01007f0 2024-09-17T04:32:02.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:02.300+0000 7ff8b508d640 1 -- 172.21.15.88:0/2719000365 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8b01a1b90 con 0x7ff8b01007f0 2024-09-17T04:32:02.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:02.301+0000 7ff8b508d640 1 -- 172.21.15.88:0/2719000365 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8b0101f30 con 0x7ff8b01007f0 2024-09-17T04:32:02.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:02.302+0000 7ff897fff640 1 -- 172.21.15.88:0/2719000365 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7ff8a0042070 con 0x7ff8b01007f0 2024-09-17T04:32:02.304 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:02.303+0000 7ff897fff640 1 --2- 172.21.15.88:0/2719000365 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7ff89807af30 0x7ff89807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:02.304 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:02.303+0000 7ff897fff640 1 -- 172.21.15.88:0/2719000365 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7ff8a00be9e0 con 0x7ff8b01007f0 2024-09-17T04:32:02.304 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:02.303+0000 7ff8ae59c640 1 --2- 172.21.15.88:0/2719000365 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7ff89807af30 0x7ff89807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:02.304 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:02.303+0000 7ff8ae59c640 1 --2- 172.21.15.88:0/2719000365 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7ff89807af30 0x7ff89807d3f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff8b006a7f0 tx=0x7ff8a400b410 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:32:02.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:02.307+0000 7ff897fff640 1 -- 172.21.15.88:0/2719000365 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7ff8a0089f30 con 0x7ff8b01007f0 2024-09-17T04:32:02.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:02.515+0000 7ff8b508d640 1 -- 172.21.15.88:0/2719000365 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff8b0108d60 con 0x7ff8b01007f0 2024-09-17T04:32:02.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:02.515+0000 7ff897fff640 1 -- 172.21.15.88:0/2719000365 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5330 (secure 0 0 0) 0x7ff8a008ede0 con 0x7ff8b01007f0 2024-09-17T04:32:02.516 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:32:02.516 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":38,"btime":"2024-09-17T04:28:17:685888+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34318,"name":"cephfs.smithi088.lgavsv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6827/3125957194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":3125957194},{"type":"v1","addr":"172.21.15.88:6827","nonce":3125957194}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":34322,"name":"cephfs.smithi088.giqrgt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6829/2683662376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2683662376},{"type":"v1","addr":"172.21.15.88:6829","nonce":2683662376}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":38,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T04:18:10.480573+0000","modified":"2024-09-17T04:28:17.685877+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34273":{"gid":34273,"name":"cephfs.smithi134.ktuhce","rank":0,"incarnation":32,"state":"up:active","state_seq":8,"addr":"172.21.15.134:6825/3452154372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":3452154372},{"type":"v1","addr":"172.21.15.134:6825","nonce":3452154372}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34305":{"gid":34305,"name":"cephfs.smithi134.psnynp","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6827/3085319848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3085319848},{"type":"v1","addr":"172.21.15.134:6827","nonce":3085319848}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34273,"qdb_cluster":[34273]},"id":1}]} 2024-09-17T04:32:02.516 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 38 2024-09-17T04:32:02.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:02.518+0000 7ff8b508d640 1 -- 172.21.15.88:0/2719000365 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7ff89807af30 msgr2=0x7ff89807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:02.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:02.518+0000 7ff8b508d640 1 --2- 172.21.15.88:0/2719000365 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7ff89807af30 0x7ff89807d3f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff8b006a7f0 tx=0x7ff8a400b410 comp rx=0 tx=0).stop 2024-09-17T04:32:02.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:02.518+0000 7ff8b508d640 1 -- 172.21.15.88:0/2719000365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8b01007f0 msgr2=0x7ff8b0198810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:02.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:02.518+0000 7ff8b508d640 1 --2- 172.21.15.88:0/2719000365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8b01007f0 0x7ff8b0198810 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0006010 tx=0x7ff8a00045e0 comp rx=0 tx=0).stop 2024-09-17T04:32:02.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:02.518+0000 7ff8b508d640 1 -- 172.21.15.88:0/2719000365 shutdown_connections 2024-09-17T04:32:02.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:02.518+0000 7ff8b508d640 1 --2- 172.21.15.88:0/2719000365 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7ff89807af30 0x7ff89807d3f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:02.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:02.518+0000 7ff8b508d640 1 --2- 172.21.15.88:0/2719000365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8b01067f0 0x7ff8b0198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:02.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:02.518+0000 7ff8b508d640 1 --2- 172.21.15.88:0/2719000365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8b01007f0 0x7ff8b0198810 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:02.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:02.518+0000 7ff8b508d640 1 -- 172.21.15.88:0/2719000365 >> 172.21.15.88:0/2719000365 conn(0x7ff8b00fc550 msgr2=0x7ff8b00fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:32:02.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:02.518+0000 7ff8b508d640 1 -- 172.21.15.88:0/2719000365 shutdown_connections 2024-09-17T04:32:02.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:02.518+0000 7ff8b508d640 1 -- 172.21.15.88:0/2719000365 wait complete. 2024-09-17T04:32:02.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:02 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/2719000365' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-17T04:32:02.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:02 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/2719000365' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-17T04:32:03.150 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 15, 'max_mds': 1, 'flags': 50} 2024-09-17T04:32:03.151 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 16 2024-09-17T04:32:03.399 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:32:03.810 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:03 smithi088 ceph-mon[90867]: pgmap v334: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:32:03.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:03.817+0000 7f415e8dc640 1 -- 172.21.15.88:0/793710141 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41581067f0 msgr2=0x7f4158106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:03.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:03.817+0000 7f415e8dc640 1 --2- 172.21.15.88:0/793710141 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41581067f0 0x7f4158106bd0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4148009880 tx=0x7f414802a4a0 comp rx=0 tx=0).stop 2024-09-17T04:32:03.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:03.817+0000 7f415e8dc640 1 -- 172.21.15.88:0/793710141 shutdown_connections 2024-09-17T04:32:03.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:03.817+0000 7f415e8dc640 1 --2- 172.21.15.88:0/793710141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41581007f0 0x7f4158100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:03.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:03.817+0000 7f415e8dc640 1 --2- 172.21.15.88:0/793710141 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41581067f0 0x7f4158106bd0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:03.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:03.817+0000 7f415e8dc640 1 -- 172.21.15.88:0/793710141 >> 172.21.15.88:0/793710141 conn(0x7f41580fc550 msgr2=0x7f41580fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:32:03.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:03.817+0000 7f415e8dc640 1 -- 172.21.15.88:0/793710141 shutdown_connections 2024-09-17T04:32:03.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:03.817+0000 7f415e8dc640 1 -- 172.21.15.88:0/793710141 wait complete. 2024-09-17T04:32:03.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:03.818+0000 7f415e8dc640 1 Processor -- start 2024-09-17T04:32:03.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:03.818+0000 7f415e8dc640 1 -- start start 2024-09-17T04:32:03.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:03.818+0000 7f415e8dc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41581007f0 0x7f415819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:03.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:03.818+0000 7f415e8dc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41581067f0 0x7f415819dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:03.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:03.818+0000 7f415e8dc640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f415810dd20 con 0x7f41581067f0 2024-09-17T04:32:03.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:03.818+0000 7f415e8dc640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f415810dba0 con 0x7f41581007f0 2024-09-17T04:32:03.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:03.819+0000 7f41577fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41581067f0 0x7f415819dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:03.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:03.819+0000 7f41577fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41581067f0 0x7f415819dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52958/0 (socket says 172.21.15.88:52958) 2024-09-17T04:32:03.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:03.819+0000 7f41577fe640 1 -- 172.21.15.88:0/518178669 learned_addr learned my addr 172.21.15.88:0/518178669 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:32:03.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:03.819+0000 7f4157fff640 1 --2- 172.21.15.88:0/518178669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41581007f0 0x7f415819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:03.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:03.819+0000 7f41577fe640 1 -- 172.21.15.88:0/518178669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41581007f0 msgr2=0x7f415819d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:03.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:03.819+0000 7f41577fe640 1 --2- 172.21.15.88:0/518178669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41581007f0 0x7f415819d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:03.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:03.819+0000 7f41577fe640 1 -- 172.21.15.88:0/518178669 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4158197800 con 0x7f41581067f0 2024-09-17T04:32:03.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:03.819+0000 7f41577fe640 1 --2- 172.21.15.88:0/518178669 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41581067f0 0x7f415819dbc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f414c00b420 tx=0x7f414c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:32:03.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:03.819+0000 7f41557fa640 1 -- 172.21.15.88:0/518178669 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f414c011630 con 0x7f41581067f0 2024-09-17T04:32:03.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:03.819+0000 7f415e8dc640 1 -- 172.21.15.88:0/518178669 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4158197af0 con 0x7f41581067f0 2024-09-17T04:32:03.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:03.819+0000 7f41557fa640 1 -- 172.21.15.88:0/518178669 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f414c016070 con 0x7f41581067f0 2024-09-17T04:32:03.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:03.819+0000 7f41557fa640 1 -- 172.21.15.88:0/518178669 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f414c010d40 con 0x7f41581067f0 2024-09-17T04:32:03.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:03.820+0000 7f415e8dc640 1 -- 172.21.15.88:0/518178669 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4158198080 con 0x7f41581067f0 2024-09-17T04:32:03.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:03.821+0000 7f415e8dc640 1 -- 172.21.15.88:0/518178669 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4158101f30 con 0x7f41581067f0 2024-09-17T04:32:03.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:03.821+0000 7f41557fa640 1 -- 172.21.15.88:0/518178669 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f414c01b460 con 0x7f41581067f0 2024-09-17T04:32:03.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:03.822+0000 7f41557fa640 1 --2- 172.21.15.88:0/518178669 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f414007af30 0x7f414007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:03.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:03.822+0000 7f4157fff640 1 --2- 172.21.15.88:0/518178669 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f414007af30 0x7f414007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:03.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:03.822+0000 7f41557fa640 1 -- 172.21.15.88:0/518178669 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f414c09d790 con 0x7f41581067f0 2024-09-17T04:32:03.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:03.823+0000 7f4157fff640 1 --2- 172.21.15.88:0/518178669 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f414007af30 0x7f414007d3f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f41480096c0 tx=0x7f4148031400 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:32:03.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:03.827+0000 7f41557fa640 1 -- 172.21.15.88:0/518178669 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f414c068ce0 con 0x7f41581067f0 2024-09-17T04:32:03.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:03 smithi134 ceph-mon[76677]: pgmap v334: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:32:04.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:04.038+0000 7f415e8dc640 1 -- 172.21.15.88:0/518178669 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 16, "format": "json"} v 0) -- 0x7f4158109d70 con 0x7f41581067f0 2024-09-17T04:32:04.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:04.039+0000 7f41557fa640 1 -- 172.21.15.88:0/518178669 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 16, "format": "json"}]=0 dumped fsmap epoch 16 v38) ==== 107+0+4470 (secure 0 0 0) 0x7f414c06db90 con 0x7f41581067f0 2024-09-17T04:32:04.039 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:32:04.039 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":16,"btime":"2024-09-17T04:26:54:147131+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24325,"name":"cephfs.smithi134.ktuhce","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6825/967997022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":967997022},{"type":"v1","addr":"172.21.15.134:6825","nonce":967997022}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24329,"name":"cephfs.smithi088.lgavsv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6827/1425146180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1425146180},{"type":"v1","addr":"172.21.15.88:6827","nonce":1425146180}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T04:18:10.480573+0000","modified":"2024-09-17T04:26:53.149451+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14590},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14590":{"gid":14590,"name":"cephfs.smithi088.giqrgt","rank":0,"incarnation":11,"state":"up:active","state_seq":5,"addr":"172.21.15.88:6829/1714846518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1714846518},{"type":"v1","addr":"172.21.15.88:6829","nonce":1714846518}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14590,"qdb_cluster":[14590]},"id":1}]} 2024-09-17T04:32:04.039 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 16 2024-09-17T04:32:04.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:04.041+0000 7f415e8dc640 1 -- 172.21.15.88:0/518178669 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f414007af30 msgr2=0x7f414007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:04.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:04.041+0000 7f415e8dc640 1 --2- 172.21.15.88:0/518178669 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f414007af30 0x7f414007d3f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f41480096c0 tx=0x7f4148031400 comp rx=0 tx=0).stop 2024-09-17T04:32:04.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:04.041+0000 7f415e8dc640 1 -- 172.21.15.88:0/518178669 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41581067f0 msgr2=0x7f415819dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:04.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:04.041+0000 7f415e8dc640 1 --2- 172.21.15.88:0/518178669 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41581067f0 0x7f415819dbc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f414c00b420 tx=0x7f414c00b8e0 comp rx=0 tx=0).stop 2024-09-17T04:32:04.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:04.041+0000 7f415e8dc640 1 -- 172.21.15.88:0/518178669 shutdown_connections 2024-09-17T04:32:04.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:04.041+0000 7f415e8dc640 1 --2- 172.21.15.88:0/518178669 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f414007af30 0x7f414007d3f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:04.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:04.041+0000 7f415e8dc640 1 --2- 172.21.15.88:0/518178669 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41581067f0 0x7f415819dbc0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:04.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:04.041+0000 7f415e8dc640 1 --2- 172.21.15.88:0/518178669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41581007f0 0x7f415819d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:04.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:04.041+0000 7f415e8dc640 1 -- 172.21.15.88:0/518178669 >> 172.21.15.88:0/518178669 conn(0x7f41580fc550 msgr2=0x7f4158069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:32:04.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:04.041+0000 7f415e8dc640 1 -- 172.21.15.88:0/518178669 shutdown_connections 2024-09-17T04:32:04.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:04.041+0000 7f415e8dc640 1 -- 172.21.15.88:0/518178669 wait complete. 2024-09-17T04:32:04.689 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:04 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/518178669' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 16, "format": "json"} : dispatch 2024-09-17T04:32:04.715 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 16 2024-09-17T04:32:04.716 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 17 2024-09-17T04:32:04.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:04 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/518178669' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 16, "format": "json"} : dispatch 2024-09-17T04:32:04.962 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:32:05.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:05.399+0000 7f282577c640 1 -- 172.21.15.88:0/1946977210 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2820102b40 msgr2=0x7f2820102f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:05.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:05.399+0000 7f282577c640 1 --2- 172.21.15.88:0/1946977210 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2820102b40 0x7f2820102f20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2810009880 tx=0x7f281002a530 comp rx=0 tx=0).stop 2024-09-17T04:32:05.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:05.399+0000 7f282577c640 1 -- 172.21.15.88:0/1946977210 shutdown_connections 2024-09-17T04:32:05.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:05.399+0000 7f282577c640 1 --2- 172.21.15.88:0/1946977210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2820103460 0x7f282010b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:05.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:05.399+0000 7f282577c640 1 --2- 172.21.15.88:0/1946977210 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2820102b40 0x7f2820102f20 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:05.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:05.399+0000 7f282577c640 1 -- 172.21.15.88:0/1946977210 >> 172.21.15.88:0/1946977210 conn(0x7f28200fc520 msgr2=0x7f28200fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:32:05.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:05.399+0000 7f282577c640 1 -- 172.21.15.88:0/1946977210 shutdown_connections 2024-09-17T04:32:05.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:05.399+0000 7f282577c640 1 -- 172.21.15.88:0/1946977210 wait complete. 2024-09-17T04:32:05.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:05.399+0000 7f282577c640 1 Processor -- start 2024-09-17T04:32:05.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:05.399+0000 7f282577c640 1 -- start start 2024-09-17T04:32:05.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:05.400+0000 7f282577c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2820102b40 0x7f282019d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:05.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:05.400+0000 7f282577c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2820103460 0x7f282019dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:05.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:05.400+0000 7f282577c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f282010ee50 con 0x7f2820103460 2024-09-17T04:32:05.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:05.400+0000 7f282577c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f282010ecd0 con 0x7f2820102b40 2024-09-17T04:32:05.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:05.400+0000 7f281e7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2820103460 0x7f282019dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:05.402 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:05.400+0000 7f281e7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2820103460 0x7f282019dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52988/0 (socket says 172.21.15.88:52988) 2024-09-17T04:32:05.402 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:05.400+0000 7f281e7fc640 1 -- 172.21.15.88:0/3344117857 learned_addr learned my addr 172.21.15.88:0/3344117857 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:32:05.402 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:05.400+0000 7f281effd640 1 --2- 172.21.15.88:0/3344117857 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2820102b40 0x7f282019d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:05.402 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:05.400+0000 7f281e7fc640 1 -- 172.21.15.88:0/3344117857 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2820102b40 msgr2=0x7f282019d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:05.402 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:05.400+0000 7f281e7fc640 1 --2- 172.21.15.88:0/3344117857 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2820102b40 0x7f282019d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:05.402 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:05.400+0000 7f281e7fc640 1 -- 172.21.15.88:0/3344117857 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2820197860 con 0x7f2820103460 2024-09-17T04:32:05.402 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:05.400+0000 7f281e7fc640 1 --2- 172.21.15.88:0/3344117857 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2820103460 0x7f282019dbe0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f280800b420 tx=0x7f280800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:32:05.402 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:05.401+0000 7f2817fff640 1 -- 172.21.15.88:0/3344117857 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2808011630 con 0x7f2820103460 2024-09-17T04:32:05.402 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:05.401+0000 7f2817fff640 1 -- 172.21.15.88:0/3344117857 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2808016070 con 0x7f2820103460 2024-09-17T04:32:05.402 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:05.401+0000 7f282577c640 1 -- 172.21.15.88:0/3344117857 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2820197b50 con 0x7f2820103460 2024-09-17T04:32:05.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:05.401+0000 7f2817fff640 1 -- 172.21.15.88:0/3344117857 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2808010d40 con 0x7f2820103460 2024-09-17T04:32:05.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:05.401+0000 7f282577c640 1 -- 172.21.15.88:0/3344117857 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28201980e0 con 0x7f2820103460 2024-09-17T04:32:05.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:05.402+0000 7f282577c640 1 -- 172.21.15.88:0/3344117857 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f282006aa10 con 0x7f2820103460 2024-09-17T04:32:05.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:05.402+0000 7f2817fff640 1 -- 172.21.15.88:0/3344117857 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f280801b460 con 0x7f2820103460 2024-09-17T04:32:05.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:05.403+0000 7f2817fff640 1 --2- 172.21.15.88:0/3344117857 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f280c07af30 0x7f280c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:05.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:05.403+0000 7f2817fff640 1 -- 172.21.15.88:0/3344117857 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f280809d770 con 0x7f2820103460 2024-09-17T04:32:05.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:05.403+0000 7f281effd640 1 --2- 172.21.15.88:0/3344117857 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f280c07af30 0x7f280c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:05.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:05.403+0000 7f281effd640 1 --2- 172.21.15.88:0/3344117857 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f280c07af30 0x7f280c07d3f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2810000c00 tx=0x7f2810004f30 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:32:05.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:05.408+0000 7f2817fff640 1 -- 172.21.15.88:0/3344117857 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f2808068cc0 con 0x7f2820103460 2024-09-17T04:32:05.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:05.618+0000 7f282577c640 1 -- 172.21.15.88:0/3344117857 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) -- 0x7f2820198d90 con 0x7f2820103460 2024-09-17T04:32:05.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:05.619+0000 7f2817fff640 1 -- 172.21.15.88:0/3344117857 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v38) ==== 107+0+5317 (secure 0 0 0) 0x7f280806db70 con 0x7f2820103460 2024-09-17T04:32:05.619 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:32:05.619 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":17,"btime":"2024-09-17T04:26:55:159668+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24325,"name":"cephfs.smithi134.ktuhce","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6825/967997022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":967997022},{"type":"v1","addr":"172.21.15.134:6825","nonce":967997022}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24329,"name":"cephfs.smithi088.lgavsv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6827/1425146180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1425146180},{"type":"v1","addr":"172.21.15.88:6827","nonce":1425146180}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":34223,"name":"cephfs.smithi134.psnynp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/584624515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":584624515},{"type":"v1","addr":"172.21.15.134:6827","nonce":584624515}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T04:18:10.480573+0000","modified":"2024-09-17T04:26:53.149451+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14590},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14590":{"gid":14590,"name":"cephfs.smithi088.giqrgt","rank":0,"incarnation":11,"state":"up:active","state_seq":5,"addr":"172.21.15.88:6829/1714846518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1714846518},{"type":"v1","addr":"172.21.15.88:6829","nonce":1714846518}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14590,"qdb_cluster":[14590]},"id":1}]} 2024-09-17T04:32:05.620 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 17 2024-09-17T04:32:05.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:05.622+0000 7f282577c640 1 -- 172.21.15.88:0/3344117857 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f280c07af30 msgr2=0x7f280c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:05.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:05.622+0000 7f282577c640 1 --2- 172.21.15.88:0/3344117857 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f280c07af30 0x7f280c07d3f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2810000c00 tx=0x7f2810004f30 comp rx=0 tx=0).stop 2024-09-17T04:32:05.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:05.622+0000 7f282577c640 1 -- 172.21.15.88:0/3344117857 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2820103460 msgr2=0x7f282019dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:05.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:05.622+0000 7f282577c640 1 --2- 172.21.15.88:0/3344117857 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2820103460 0x7f282019dbe0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f280800b420 tx=0x7f280800b8e0 comp rx=0 tx=0).stop 2024-09-17T04:32:05.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:05.622+0000 7f282577c640 1 -- 172.21.15.88:0/3344117857 shutdown_connections 2024-09-17T04:32:05.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:05.622+0000 7f282577c640 1 --2- 172.21.15.88:0/3344117857 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f280c07af30 0x7f280c07d3f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:05.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:05.622+0000 7f282577c640 1 --2- 172.21.15.88:0/3344117857 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2820103460 0x7f282019dbe0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:05.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:05.622+0000 7f282577c640 1 --2- 172.21.15.88:0/3344117857 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2820102b40 0x7f282019d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:05.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:05.622+0000 7f282577c640 1 -- 172.21.15.88:0/3344117857 >> 172.21.15.88:0/3344117857 conn(0x7f28200fc520 msgr2=0x7f2820108f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:32:05.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:05.622+0000 7f282577c640 1 -- 172.21.15.88:0/3344117857 shutdown_connections 2024-09-17T04:32:05.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:05.622+0000 7f282577c640 1 -- 172.21.15.88:0/3344117857 wait complete. 2024-09-17T04:32:05.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:05 smithi088 ceph-mon[90867]: pgmap v335: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:32:05.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:05 smithi134 ceph-mon[76677]: pgmap v335: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:32:06.223 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 17 2024-09-17T04:32:06.223 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 18 2024-09-17T04:32:06.470 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:32:06.825 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:06 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/3344117857' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 17, "format": "json"} : dispatch 2024-09-17T04:32:06.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:06 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/3344117857' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 17, "format": "json"} : dispatch 2024-09-17T04:32:06.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:06.905+0000 7f1e2503f640 1 -- 172.21.15.88:0/3654500414 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e20106810 msgr2=0x7f1e20106bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:06.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:06.905+0000 7f1e2503f640 1 --2- 172.21.15.88:0/3654500414 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e20106810 0x7f1e20106bf0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1e14009880 tx=0x7f1e1402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:32:06.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:06.906+0000 7f1e2503f640 1 -- 172.21.15.88:0/3654500414 shutdown_connections 2024-09-17T04:32:06.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:06.906+0000 7f1e2503f640 1 --2- 172.21.15.88:0/3654500414 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e20100810 0x7f1e20100c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:06.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:06.906+0000 7f1e2503f640 1 --2- 172.21.15.88:0/3654500414 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e20106810 0x7f1e20106bf0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:06.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:06.906+0000 7f1e2503f640 1 -- 172.21.15.88:0/3654500414 >> 172.21.15.88:0/3654500414 conn(0x7f1e200fc510 msgr2=0x7f1e200fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:32:06.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:06.906+0000 7f1e2503f640 1 -- 172.21.15.88:0/3654500414 shutdown_connections 2024-09-17T04:32:06.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:06.906+0000 7f1e2503f640 1 -- 172.21.15.88:0/3654500414 wait complete. 2024-09-17T04:32:06.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:06.906+0000 7f1e2503f640 1 Processor -- start 2024-09-17T04:32:06.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:06.906+0000 7f1e2503f640 1 -- start start 2024-09-17T04:32:06.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:06.907+0000 7f1e2503f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e20100810 0x7f1e2019c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:06.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:06.907+0000 7f1e2503f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e20106810 0x7f1e2019cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:06.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:06.907+0000 7f1e2503f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f1e2010dce0 con 0x7f1e20106810 2024-09-17T04:32:06.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:06.907+0000 7f1e2503f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1e2010db60 con 0x7f1e20100810 2024-09-17T04:32:06.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:06.907+0000 7f1e1e59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e20106810 0x7f1e2019cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:06.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:06.907+0000 7f1e1e59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e20106810 0x7f1e2019cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53014/0 (socket says 172.21.15.88:53014) 2024-09-17T04:32:06.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:06.907+0000 7f1e1e59c640 1 -- 172.21.15.88:0/2585307906 learned_addr learned my addr 172.21.15.88:0/2585307906 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:32:06.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:06.907+0000 7f1e1ed9d640 1 --2- 172.21.15.88:0/2585307906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e20100810 0x7f1e2019c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:06.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:06.907+0000 7f1e1e59c640 1 -- 172.21.15.88:0/2585307906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e20100810 msgr2=0x7f1e2019c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:06.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:06.907+0000 7f1e1e59c640 1 --2- 172.21.15.88:0/2585307906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e20100810 0x7f1e2019c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:06.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:06.907+0000 7f1e1e59c640 1 -- 172.21.15.88:0/2585307906 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e20196710 con 0x7f1e20106810 2024-09-17T04:32:06.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:06.907+0000 7f1e1e59c640 1 --2- 172.21.15.88:0/2585307906 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e20106810 0x7f1e2019cb80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1e1000ea00 tx=0x7f1e1000eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:32:06.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:06.907+0000 7f1e07fff640 1 -- 172.21.15.88:0/2585307906 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1e1000cb80 con 0x7f1e20106810 2024-09-17T04:32:06.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:06.908+0000 7f1e2503f640 1 -- 172.21.15.88:0/2585307906 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e20196a00 con 0x7f1e20106810 2024-09-17T04:32:06.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:06.908+0000 7f1e07fff640 1 -- 172.21.15.88:0/2585307906 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1e1000cd20 con 0x7f1e20106810 2024-09-17T04:32:06.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:06.908+0000 7f1e07fff640 1 -- 172.21.15.88:0/2585307906 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1e10011470 con 0x7f1e20106810 2024-09-17T04:32:06.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:06.908+0000 7f1e2503f640 1 -- 172.21.15.88:0/2585307906 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e20196f60 con 0x7f1e20106810 2024-09-17T04:32:06.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:06.909+0000 7f1e2503f640 1 -- 172.21.15.88:0/2585307906 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e20101f50 con 0x7f1e20106810 2024-09-17T04:32:06.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:06.909+0000 7f1e07fff640 1 -- 172.21.15.88:0/2585307906 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f1e10011750 con 0x7f1e20106810 2024-09-17T04:32:06.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:06.910+0000 7f1e07fff640 1 --2- 172.21.15.88:0/2585307906 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f1e0807d140 0x7f1e0807f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:06.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:06.910+0000 7f1e07fff640 1 -- 172.21.15.88:0/2585307906 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f1e1009e4e0 con 0x7f1e20106810 2024-09-17T04:32:06.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:06.910+0000 7f1e1ed9d640 1 --2- 172.21.15.88:0/2585307906 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f1e0807d140 0x7f1e0807f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:06.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:06.910+0000 7f1e1ed9d640 1 --2- 172.21.15.88:0/2585307906 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f1e0807d140 0x7f1e0807f600 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1e140096c0 tx=0x7f1e14031400 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:32:06.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:06.914+0000 7f1e07fff640 1 -- 172.21.15.88:0/2585307906 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f1e10016030 con 0x7f1e20106810 2024-09-17T04:32:07.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:07.122+0000 7f1e2503f640 1 -- 172.21.15.88:0/2585307906 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) -- 0x7f1e20197270 con 0x7f1e20106810 2024-09-17T04:32:07.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:07.123+0000 7f1e07fff640 1 -- 172.21.15.88:0/2585307906 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v38) ==== 107+0+4470 (secure 0 0 0) 0x7f1e10069a30 con 0x7f1e20106810 2024-09-17T04:32:07.123 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:32:07.123 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":18,"btime":"2024-09-17T04:26:58:226312+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24325,"name":"cephfs.smithi134.ktuhce","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6825/967997022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":967997022},{"type":"v1","addr":"172.21.15.134:6825","nonce":967997022}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":34223,"name":"cephfs.smithi134.psnynp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/584624515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":584624515},{"type":"v1","addr":"172.21.15.134:6827","nonce":584624515}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T04:18:10.480573+0000","modified":"2024-09-17T04:26:53.149451+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14590},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14590":{"gid":14590,"name":"cephfs.smithi088.giqrgt","rank":0,"incarnation":11,"state":"up:active","state_seq":5,"addr":"172.21.15.88:6829/1714846518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1714846518},{"type":"v1","addr":"172.21.15.88:6829","nonce":1714846518}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14590,"qdb_cluster":[14590]},"id":1}]} 2024-09-17T04:32:07.123 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 18 2024-09-17T04:32:07.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:07.125+0000 7f1e2503f640 1 -- 172.21.15.88:0/2585307906 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f1e0807d140 msgr2=0x7f1e0807f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:07.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:07.125+0000 7f1e2503f640 1 --2- 172.21.15.88:0/2585307906 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f1e0807d140 0x7f1e0807f600 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1e140096c0 tx=0x7f1e14031400 comp rx=0 tx=0).stop 2024-09-17T04:32:07.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:07.125+0000 7f1e2503f640 1 -- 172.21.15.88:0/2585307906 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e20106810 msgr2=0x7f1e2019cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:07.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:07.125+0000 7f1e2503f640 1 --2- 172.21.15.88:0/2585307906 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e20106810 0x7f1e2019cb80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1e1000ea00 tx=0x7f1e1000eec0 comp rx=0 tx=0).stop 2024-09-17T04:32:07.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:07.126+0000 7f1e2503f640 1 -- 172.21.15.88:0/2585307906 shutdown_connections 2024-09-17T04:32:07.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:07.126+0000 7f1e2503f640 1 --2- 172.21.15.88:0/2585307906 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f1e0807d140 0x7f1e0807f600 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:07.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:07.126+0000 7f1e2503f640 1 --2- 172.21.15.88:0/2585307906 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e20106810 0x7f1e2019cb80 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:07.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:07.126+0000 7f1e2503f640 1 --2- 172.21.15.88:0/2585307906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e20100810 0x7f1e2019c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:07.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:07.126+0000 7f1e2503f640 1 -- 172.21.15.88:0/2585307906 >> 172.21.15.88:0/2585307906 conn(0x7f1e200fc510 msgr2=0x7f1e200fce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:32:07.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:07.126+0000 7f1e2503f640 1 -- 172.21.15.88:0/2585307906 shutdown_connections 2024-09-17T04:32:07.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:07.126+0000 7f1e2503f640 1 -- 172.21.15.88:0/2585307906 wait complete. 2024-09-17T04:32:07.720 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:07 smithi088 ceph-mon[90867]: pgmap v336: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:32:07.721 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:07 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/2585307906' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 18, "format": "json"} : dispatch 2024-09-17T04:32:07.749 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 18 2024-09-17T04:32:07.750 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 19 2024-09-17T04:32:07.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:07 smithi134 ceph-mon[76677]: pgmap v336: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:32:07.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:07 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/2585307906' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 18, "format": "json"} : dispatch 2024-09-17T04:32:07.996 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:32:08.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:08.488+0000 7fa9ff926640 1 -- 172.21.15.88:0/3713731683 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9f8106800 msgr2=0x7fa9f8106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:08.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:08.488+0000 7fa9ff926640 1 --2- 172.21.15.88:0/3713731683 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9f8106800 0x7fa9f8106be0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec009880 tx=0x7fa9ec02a4a0 comp rx=0 tx=0).stop 2024-09-17T04:32:08.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:08.488+0000 7fa9ff926640 1 -- 172.21.15.88:0/3713731683 shutdown_connections 2024-09-17T04:32:08.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:08.488+0000 7fa9ff926640 1 --2- 172.21.15.88:0/3713731683 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9f8100800 0x7fa9f8100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:08.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:08.488+0000 7fa9ff926640 1 --2- 172.21.15.88:0/3713731683 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9f8106800 0x7fa9f8106be0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:08.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:08.488+0000 7fa9ff926640 1 -- 172.21.15.88:0/3713731683 >> 172.21.15.88:0/3713731683 conn(0x7fa9f80fc520 msgr2=0x7fa9f80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:32:08.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:08.488+0000 7fa9ff926640 1 -- 172.21.15.88:0/3713731683 shutdown_connections 2024-09-17T04:32:08.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:08.488+0000 7fa9ff926640 1 -- 172.21.15.88:0/3713731683 wait complete. 2024-09-17T04:32:08.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:08.489+0000 7fa9ff926640 1 Processor -- start 2024-09-17T04:32:08.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:08.489+0000 7fa9ff926640 1 -- start start 2024-09-17T04:32:08.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:08.489+0000 7fa9ff926640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9f8100800 0x7fa9f819c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:08.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:08.489+0000 7fa9ff926640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9f8106800 0x7fa9f819cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:08.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:08.489+0000 7fa9ff926640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f810dd30 con 0x7fa9f8100800 2024-09-17T04:32:08.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:08.489+0000 7fa9ff926640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f810dbb0 con 0x7fa9f8106800 2024-09-17T04:32:08.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:08.489+0000 7fa9fd6c2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9f8100800 0x7fa9f819c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:08.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:08.489+0000 7fa9fd6c2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9f8100800 0x7fa9f819c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53034/0 (socket says 172.21.15.88:53034) 2024-09-17T04:32:08.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:08.489+0000 7fa9fd6c2640 1 -- 172.21.15.88:0/3414242909 learned_addr learned my addr 172.21.15.88:0/3414242909 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:32:08.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:08.489+0000 7fa9fcec1640 1 --2- 172.21.15.88:0/3414242909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9f8106800 0x7fa9f819cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:08.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:08.489+0000 7fa9fd6c2640 1 -- 172.21.15.88:0/3414242909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9f8106800 msgr2=0x7fa9f819cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:08.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:08.489+0000 7fa9fd6c2640 1 --2- 172.21.15.88:0/3414242909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9f8106800 0x7fa9f819cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:08.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:08.489+0000 7fa9fd6c2640 1 -- 172.21.15.88:0/3414242909 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9f8196740 con 0x7fa9f8100800 2024-09-17T04:32:08.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:08.490+0000 7fa9fd6c2640 1 --2- 172.21.15.88:0/3414242909 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9f8100800 0x7fa9f819c670 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec031460 tx=0x7fa9ec0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:32:08.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:08.490+0000 7fa9ea7fc640 1 -- 172.21.15.88:0/3414242909 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa9ec03f070 con 0x7fa9f8100800 2024-09-17T04:32:08.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:08.490+0000 7fa9ea7fc640 1 -- 172.21.15.88:0/3414242909 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa9ec004cf0 con 0x7fa9f8100800 2024-09-17T04:32:08.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:08.490+0000 7fa9ff926640 1 -- 172.21.15.88:0/3414242909 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9f81969d0 con 0x7fa9f8100800 2024-09-17T04:32:08.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:08.490+0000 7fa9ea7fc640 1 -- 172.21.15.88:0/3414242909 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa9ec035030 con 0x7fa9f8100800 2024-09-17T04:32:08.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:08.490+0000 7fa9ff926640 1 -- 172.21.15.88:0/3414242909 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9f8196ed0 con 0x7fa9f8100800 2024-09-17T04:32:08.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:08.491+0000 7fa9ff926640 1 -- 172.21.15.88:0/3414242909 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9f8101f40 con 0x7fa9f8100800 2024-09-17T04:32:08.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:08.492+0000 7fa9ea7fc640 1 -- 172.21.15.88:0/3414242909 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fa9ec042070 con 0x7fa9f8100800 2024-09-17T04:32:08.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:08.492+0000 7fa9ea7fc640 1 --2- 172.21.15.88:0/3414242909 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fa9e407af80 0x7fa9e407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:08.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:08.492+0000 7fa9fcec1640 1 --2- 172.21.15.88:0/3414242909 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fa9e407af80 0x7fa9e407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:08.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:08.492+0000 7fa9ea7fc640 1 -- 172.21.15.88:0/3414242909 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fa9ec0bea50 con 0x7fa9f8100800 2024-09-17T04:32:08.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:08.493+0000 7fa9fcec1640 1 --2- 172.21.15.88:0/3414242909 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fa9e407af80 0x7fa9e407d440 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8197f90 tx=0x7fa9f4009110 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:32:08.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:08.497+0000 7fa9ea7fc640 1 -- 172.21.15.88:0/3414242909 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fa9ec08a020 con 0x7fa9f8100800 2024-09-17T04:32:08.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:08.705+0000 7fa9ff926640 1 -- 172.21.15.88:0/3414242909 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) -- 0x7fa9f8197c70 con 0x7fa9f8100800 2024-09-17T04:32:08.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:08.706+0000 7fa9ea7fc640 1 -- 172.21.15.88:0/3414242909 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v38) ==== 107+0+5317 (secure 0 0 0) 0x7fa9ec08c020 con 0x7fa9f8100800 2024-09-17T04:32:08.706 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:32:08.707 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":19,"btime":"2024-09-17T04:27:03:293772+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24325,"name":"cephfs.smithi134.ktuhce","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6825/967997022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":967997022},{"type":"v1","addr":"172.21.15.134:6825","nonce":967997022}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":34223,"name":"cephfs.smithi134.psnynp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/584624515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":584624515},{"type":"v1","addr":"172.21.15.134:6827","nonce":584624515}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34318,"name":"cephfs.smithi088.lgavsv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6827/3125957194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":3125957194},{"type":"v1","addr":"172.21.15.88:6827","nonce":3125957194}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T04:18:10.480573+0000","modified":"2024-09-17T04:26:53.149451+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14590},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14590":{"gid":14590,"name":"cephfs.smithi088.giqrgt","rank":0,"incarnation":11,"state":"up:active","state_seq":5,"addr":"172.21.15.88:6829/1714846518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1714846518},{"type":"v1","addr":"172.21.15.88:6829","nonce":1714846518}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14590,"qdb_cluster":[14590]},"id":1}]} 2024-09-17T04:32:08.707 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 19 2024-09-17T04:32:08.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:08.708+0000 7fa9ff926640 1 -- 172.21.15.88:0/3414242909 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fa9e407af80 msgr2=0x7fa9e407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:08.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:08.708+0000 7fa9ff926640 1 --2- 172.21.15.88:0/3414242909 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fa9e407af80 0x7fa9e407d440 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8197f90 tx=0x7fa9f4009110 comp rx=0 tx=0).stop 2024-09-17T04:32:08.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:08.708+0000 7fa9ff926640 1 -- 172.21.15.88:0/3414242909 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9f8100800 msgr2=0x7fa9f819c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:08.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:08.708+0000 7fa9ff926640 1 --2- 172.21.15.88:0/3414242909 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9f8100800 0x7fa9f819c670 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec031460 tx=0x7fa9ec0048f0 comp rx=0 tx=0).stop 2024-09-17T04:32:08.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:08.708+0000 7fa9ff926640 1 -- 172.21.15.88:0/3414242909 shutdown_connections 2024-09-17T04:32:08.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:08.708+0000 7fa9ff926640 1 --2- 172.21.15.88:0/3414242909 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fa9e407af80 0x7fa9e407d440 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:08.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:08.708+0000 7fa9ff926640 1 --2- 172.21.15.88:0/3414242909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9f8106800 0x7fa9f819cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:08.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:08.708+0000 7fa9ff926640 1 --2- 172.21.15.88:0/3414242909 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9f8100800 0x7fa9f819c670 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:08.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:08.708+0000 7fa9ff926640 1 -- 172.21.15.88:0/3414242909 >> 172.21.15.88:0/3414242909 conn(0x7fa9f80fc520 msgr2=0x7fa9f80fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:32:08.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:08.708+0000 7fa9ff926640 1 -- 172.21.15.88:0/3414242909 shutdown_connections 2024-09-17T04:32:08.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:08.708+0000 7fa9ff926640 1 -- 172.21.15.88:0/3414242909 wait complete. 2024-09-17T04:32:09.516 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 19 2024-09-17T04:32:09.516 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 20 2024-09-17T04:32:09.768 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:32:09.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:09 smithi088 ceph-mon[90867]: pgmap v337: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:32:09.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:09 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/3414242909' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 19, "format": "json"} : dispatch 2024-09-17T04:32:09.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:09 smithi134 ceph-mon[76677]: pgmap v337: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:32:09.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:09 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/3414242909' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 19, "format": "json"} : dispatch 2024-09-17T04:32:10.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:10.195+0000 7f69f823b640 1 -- 172.21.15.88:0/3199385282 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69f01007f0 msgr2=0x7f69f0100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:10.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:10.195+0000 7f69f823b640 1 --2- 172.21.15.88:0/3199385282 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69f01007f0 0x7f69f0100c50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f69e0009880 tx=0x7f69e002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:32:10.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:10.195+0000 7f69f823b640 1 -- 172.21.15.88:0/3199385282 shutdown_connections 2024-09-17T04:32:10.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:10.195+0000 7f69f823b640 1 --2- 172.21.15.88:0/3199385282 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69f01007f0 0x7f69f0100c50 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:10.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:10.195+0000 7f69f823b640 1 --2- 172.21.15.88:0/3199385282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69f01067f0 0x7f69f0106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:10.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:10.195+0000 7f69f823b640 1 -- 172.21.15.88:0/3199385282 >> 172.21.15.88:0/3199385282 conn(0x7f69f00fc550 msgr2=0x7f69f00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:32:10.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:10.195+0000 7f69f823b640 1 -- 172.21.15.88:0/3199385282 shutdown_connections 2024-09-17T04:32:10.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:10.195+0000 7f69f823b640 1 -- 172.21.15.88:0/3199385282 wait complete. 2024-09-17T04:32:10.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:10.196+0000 7f69f823b640 1 Processor -- start 2024-09-17T04:32:10.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:10.196+0000 7f69f823b640 1 -- start start 2024-09-17T04:32:10.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:10.196+0000 7f69f823b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69f01007f0 0x7f69f019f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:10.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:10.196+0000 7f69f823b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69f01067f0 0x7f69f019fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:10.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:10.196+0000 7f69f823b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f69f010dd20 con 0x7f69f01067f0 2024-09-17T04:32:10.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:10.196+0000 7f69f823b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f69f010dba0 con 0x7f69f01007f0 2024-09-17T04:32:10.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:10.196+0000 7f69f57d6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69f01067f0 0x7f69f019fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:10.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:10.196+0000 7f69f57d6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69f01067f0 0x7f69f019fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53058/0 (socket says 172.21.15.88:53058) 2024-09-17T04:32:10.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:10.196+0000 7f69f57d6640 1 -- 172.21.15.88:0/3789005933 learned_addr learned my addr 172.21.15.88:0/3789005933 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:32:10.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:10.196+0000 7f69f5fd7640 1 --2- 172.21.15.88:0/3789005933 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69f01007f0 0x7f69f019f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:10.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:10.196+0000 7f69f57d6640 1 -- 172.21.15.88:0/3789005933 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69f01007f0 msgr2=0x7f69f019f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:10.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:10.196+0000 7f69f57d6640 1 --2- 172.21.15.88:0/3789005933 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69f01007f0 0x7f69f019f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:10.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:10.196+0000 7f69f57d6640 1 -- 172.21.15.88:0/3789005933 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69f0199a50 con 0x7f69f01067f0 2024-09-17T04:32:10.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:10.196+0000 7f69f5fd7640 1 --2- 172.21.15.88:0/3789005933 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69f01007f0 0x7f69f019f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:32:10.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:10.197+0000 7f69f57d6640 1 --2- 172.21.15.88:0/3789005933 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69f01067f0 0x7f69f019fdd0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f69e0031460 tx=0x7f69e00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:32:10.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:10.197+0000 7f69e6ffd640 1 -- 172.21.15.88:0/3789005933 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f69e003f070 con 0x7f69f01067f0 2024-09-17T04:32:10.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:10.197+0000 7f69e6ffd640 1 -- 172.21.15.88:0/3789005933 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f69e0004cf0 con 0x7f69f01067f0 2024-09-17T04:32:10.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:10.197+0000 7f69f823b640 1 -- 172.21.15.88:0/3789005933 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69f0199ce0 con 0x7f69f01067f0 2024-09-17T04:32:10.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:10.197+0000 7f69e6ffd640 1 -- 172.21.15.88:0/3789005933 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f69e0035030 con 0x7f69f01067f0 2024-09-17T04:32:10.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:10.197+0000 7f69f823b640 1 -- 172.21.15.88:0/3789005933 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69f019a210 con 0x7f69f01067f0 2024-09-17T04:32:10.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:10.198+0000 7f69f823b640 1 -- 172.21.15.88:0/3789005933 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69f0101f30 con 0x7f69f01067f0 2024-09-17T04:32:10.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:10.199+0000 7f69e6ffd640 1 -- 172.21.15.88:0/3789005933 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f69e0042070 con 0x7f69f01067f0 2024-09-17T04:32:10.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:10.199+0000 7f69e6ffd640 1 --2- 172.21.15.88:0/3789005933 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f69dc07af30 0x7f69dc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:10.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:10.199+0000 7f69e6ffd640 1 -- 172.21.15.88:0/3789005933 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f69e00bebb0 con 0x7f69f01067f0 2024-09-17T04:32:10.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:10.199+0000 7f69f5fd7640 1 --2- 172.21.15.88:0/3789005933 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f69dc07af30 0x7f69dc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:10.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:10.200+0000 7f69f5fd7640 1 --2- 172.21.15.88:0/3789005933 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f69dc07af30 0x7f69dc07d3f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f69f019ab90 tx=0x7f69ec008040 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:32:10.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:10.204+0000 7f69e6ffd640 1 -- 172.21.15.88:0/3789005933 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f69e00c5080 con 0x7f69f01067f0 2024-09-17T04:32:10.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:10.412+0000 7f69f823b640 1 -- 172.21.15.88:0/3789005933 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) -- 0x7f69f019b050 con 0x7f69f01067f0 2024-09-17T04:32:10.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:10.413+0000 7f69e6ffd640 1 -- 172.21.15.88:0/3789005933 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v38) ==== 107+0+4451 (secure 0 0 0) 0x7f69e008a100 con 0x7f69f01067f0 2024-09-17T04:32:10.413 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:32:10.413 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"btime":"2024-09-17T04:27:14:742562+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24325,"name":"cephfs.smithi134.ktuhce","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6825/967997022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":967997022},{"type":"v1","addr":"172.21.15.134:6825","nonce":967997022}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":34223,"name":"cephfs.smithi134.psnynp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/584624515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":584624515},{"type":"v1","addr":"172.21.15.134:6827","nonce":584624515}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34318,"name":"cephfs.smithi088.lgavsv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6827/3125957194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":3125957194},{"type":"v1","addr":"172.21.15.88:6827","nonce":3125957194}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T04:18:10.480573+0000","modified":"2024-09-17T04:27:14.742558+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T04:32:10.413 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 20 2024-09-17T04:32:10.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:10.415+0000 7f69f823b640 1 -- 172.21.15.88:0/3789005933 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f69dc07af30 msgr2=0x7f69dc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:10.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:10.415+0000 7f69f823b640 1 --2- 172.21.15.88:0/3789005933 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f69dc07af30 0x7f69dc07d3f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f69f019ab90 tx=0x7f69ec008040 comp rx=0 tx=0).stop 2024-09-17T04:32:10.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:10.415+0000 7f69f823b640 1 -- 172.21.15.88:0/3789005933 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69f01067f0 msgr2=0x7f69f019fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:10.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:10.415+0000 7f69f823b640 1 --2- 172.21.15.88:0/3789005933 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69f01067f0 0x7f69f019fdd0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f69e0031460 tx=0x7f69e00048f0 comp rx=0 tx=0).stop 2024-09-17T04:32:10.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:10.415+0000 7f69f823b640 1 -- 172.21.15.88:0/3789005933 shutdown_connections 2024-09-17T04:32:10.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:10.415+0000 7f69f823b640 1 --2- 172.21.15.88:0/3789005933 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f69dc07af30 0x7f69dc07d3f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:10.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:10.415+0000 7f69f823b640 1 --2- 172.21.15.88:0/3789005933 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69f01067f0 0x7f69f019fdd0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:10.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:10.415+0000 7f69f823b640 1 --2- 172.21.15.88:0/3789005933 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69f01007f0 0x7f69f019f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:10.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:10.415+0000 7f69f823b640 1 -- 172.21.15.88:0/3789005933 >> 172.21.15.88:0/3789005933 conn(0x7f69f00fc550 msgr2=0x7f69f0069c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:32:10.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:10.415+0000 7f69f823b640 1 -- 172.21.15.88:0/3789005933 shutdown_connections 2024-09-17T04:32:10.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:10.415+0000 7f69f823b640 1 -- 172.21.15.88:0/3789005933 wait complete. 2024-09-17T04:32:10.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:10 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/3789005933' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 20, "format": "json"} : dispatch 2024-09-17T04:32:10.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:10 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/3789005933' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 20, "format": "json"} : dispatch 2024-09-17T04:32:11.122 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 20 2024-09-17T04:32:11.123 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 21 2024-09-17T04:32:11.370 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:32:11.757 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:11 smithi088 ceph-mon[90867]: pgmap v338: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:32:11.757 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:11 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:32:11.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:11.838+0000 7f981d472640 1 -- 172.21.15.88:0/1123165885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9818100800 msgr2=0x7f9818100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:11.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:11.838+0000 7f981d472640 1 --2- 172.21.15.88:0/1123165885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9818100800 0x7f9818100c60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9800009880 tx=0x7f980002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:32:11.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:11.838+0000 7f981d472640 1 -- 172.21.15.88:0/1123165885 shutdown_connections 2024-09-17T04:32:11.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:11.838+0000 7f981d472640 1 --2- 172.21.15.88:0/1123165885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9818100800 0x7f9818100c60 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:11.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:11.838+0000 7f981d472640 1 --2- 172.21.15.88:0/1123165885 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9818106800 0x7f9818106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:11.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:11.838+0000 7f981d472640 1 -- 172.21.15.88:0/1123165885 >> 172.21.15.88:0/1123165885 conn(0x7f98180fc520 msgr2=0x7f98180fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:32:11.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:11.838+0000 7f981d472640 1 -- 172.21.15.88:0/1123165885 shutdown_connections 2024-09-17T04:32:11.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:11.838+0000 7f981d472640 1 -- 172.21.15.88:0/1123165885 wait complete. 2024-09-17T04:32:11.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:11.839+0000 7f981d472640 1 Processor -- start 2024-09-17T04:32:11.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:11.839+0000 7f981d472640 1 -- start start 2024-09-17T04:32:12.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:11.839+0000 7f981d472640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9818100800 0x7f981819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:12.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:11.839+0000 7f981d472640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9818106800 0x7f981819dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:12.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:11.839+0000 7f981d472640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f981810dcd0 con 0x7f9818106800 2024-09-17T04:32:12.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:11.839+0000 7f981d472640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f981810db50 con 0x7f9818100800 2024-09-17T04:32:12.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:11.839+0000 7f98167fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9818106800 0x7f981819dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:12.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:11.839+0000 7f98167fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9818106800 0x7f981819dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53074/0 (socket says 172.21.15.88:53074) 2024-09-17T04:32:12.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:11.839+0000 7f98167fc640 1 -- 172.21.15.88:0/3941534723 learned_addr learned my addr 172.21.15.88:0/3941534723 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:32:12.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:11.839+0000 7f98167fc640 1 -- 172.21.15.88:0/3941534723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9818100800 msgr2=0x7f981819d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:12.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:11.839+0000 7f9816ffd640 1 --2- 172.21.15.88:0/3941534723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9818100800 0x7f981819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:12.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:11.839+0000 7f98167fc640 1 --2- 172.21.15.88:0/3941534723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9818100800 0x7f981819d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:12.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:11.839+0000 7f98167fc640 1 -- 172.21.15.88:0/3941534723 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9818197800 con 0x7f9818106800 2024-09-17T04:32:12.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:11.840+0000 7f98167fc640 1 --2- 172.21.15.88:0/3941534723 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9818106800 0x7f981819dbc0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9800031460 tx=0x7f98000048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:32:12.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:11.840+0000 7f980ffff640 1 -- 172.21.15.88:0/3941534723 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f980003f070 con 0x7f9818106800 2024-09-17T04:32:12.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:11.840+0000 7f981d472640 1 -- 172.21.15.88:0/3941534723 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9818197a90 con 0x7f9818106800 2024-09-17T04:32:12.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:11.840+0000 7f980ffff640 1 -- 172.21.15.88:0/3941534723 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9800004cf0 con 0x7f9818106800 2024-09-17T04:32:12.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:11.840+0000 7f980ffff640 1 -- 172.21.15.88:0/3941534723 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9800035030 con 0x7f9818106800 2024-09-17T04:32:12.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:11.840+0000 7f981d472640 1 -- 172.21.15.88:0/3941534723 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9818197fc0 con 0x7f9818106800 2024-09-17T04:32:12.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:11.841+0000 7f981d472640 1 -- 172.21.15.88:0/3941534723 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9818101f40 con 0x7f9818106800 2024-09-17T04:32:12.189 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:11 smithi134 ceph-mon[76677]: pgmap v338: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:32:12.189 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:11 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:32:12.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:11.842+0000 7f980ffff640 1 -- 172.21.15.88:0/3941534723 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f9800042070 con 0x7f9818106800 2024-09-17T04:32:12.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:11.842+0000 7f980ffff640 1 --2- 172.21.15.88:0/3941534723 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f980407af30 0x7f980407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:12.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:11.842+0000 7f980ffff640 1 -- 172.21.15.88:0/3941534723 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f98000beb70 con 0x7f9818106800 2024-09-17T04:32:12.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:11.842+0000 7f9816ffd640 1 --2- 172.21.15.88:0/3941534723 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f980407af30 0x7f980407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:12.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:11.843+0000 7f9816ffd640 1 --2- 172.21.15.88:0/3941534723 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f980407af30 0x7f980407d3f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f98080058c0 tx=0x7f9808005c60 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:32:12.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:11.847+0000 7f980ffff640 1 -- 172.21.15.88:0/3941534723 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f980008a0c0 con 0x7f9818106800 2024-09-17T04:32:12.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:12.058+0000 7f981d472640 1 -- 172.21.15.88:0/3941534723 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) -- 0x7f9818109d80 con 0x7f9818106800 2024-09-17T04:32:12.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:12.059+0000 7f980ffff640 1 -- 172.21.15.88:0/3941534723 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v38) ==== 107+0+4462 (secure 0 0 0) 0x7f980008ef70 con 0x7f9818106800 2024-09-17T04:32:12.190 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:32:12.190 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":21,"btime":"2024-09-17T04:27:14:748056+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34223,"name":"cephfs.smithi134.psnynp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/584624515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":584624515},{"type":"v1","addr":"172.21.15.134:6827","nonce":584624515}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34318,"name":"cephfs.smithi088.lgavsv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6827/3125957194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":3125957194},{"type":"v1","addr":"172.21.15.88:6827","nonce":3125957194}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T04:18:10.480573+0000","modified":"2024-09-17T04:27:14.748044+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24325},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24325":{"gid":24325,"name":"cephfs.smithi134.ktuhce","rank":0,"incarnation":21,"state":"up:replay","state_seq":1,"addr":"172.21.15.134:6825/967997022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":967997022},{"type":"v1","addr":"172.21.15.134:6825","nonce":967997022}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T04:32:12.191 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 21 2024-09-17T04:32:12.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:12.061+0000 7f981d472640 1 -- 172.21.15.88:0/3941534723 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f980407af30 msgr2=0x7f980407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:12.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:12.061+0000 7f981d472640 1 --2- 172.21.15.88:0/3941534723 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f980407af30 0x7f980407d3f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f98080058c0 tx=0x7f9808005c60 comp rx=0 tx=0).stop 2024-09-17T04:32:12.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:12.061+0000 7f981d472640 1 -- 172.21.15.88:0/3941534723 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9818106800 msgr2=0x7f981819dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:12.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:12.061+0000 7f981d472640 1 --2- 172.21.15.88:0/3941534723 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9818106800 0x7f981819dbc0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9800031460 tx=0x7f98000048f0 comp rx=0 tx=0).stop 2024-09-17T04:32:12.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:12.061+0000 7f981d472640 1 -- 172.21.15.88:0/3941534723 shutdown_connections 2024-09-17T04:32:12.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:12.061+0000 7f981d472640 1 --2- 172.21.15.88:0/3941534723 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f980407af30 0x7f980407d3f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:12.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:12.061+0000 7f981d472640 1 --2- 172.21.15.88:0/3941534723 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9818106800 0x7f981819dbc0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:12.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:12.061+0000 7f981d472640 1 --2- 172.21.15.88:0/3941534723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9818100800 0x7f981819d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:12.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:12.061+0000 7f981d472640 1 -- 172.21.15.88:0/3941534723 >> 172.21.15.88:0/3941534723 conn(0x7f98180fc520 msgr2=0x7f981806a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:32:12.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:12.061+0000 7f981d472640 1 -- 172.21.15.88:0/3941534723 shutdown_connections 2024-09-17T04:32:12.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:12.061+0000 7f981d472640 1 -- 172.21.15.88:0/3941534723 wait complete. 2024-09-17T04:32:12.827 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:12 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/3941534723' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 21, "format": "json"} : dispatch 2024-09-17T04:32:12.828 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:32:12.859 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 21 2024-09-17T04:32:12.859 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 22 2024-09-17T04:32:13.120 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:32:13.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:12 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/3941534723' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 21, "format": "json"} : dispatch 2024-09-17T04:32:13.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:32:13.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:13.613+0000 7f278c807640 1 -- 172.21.15.88:0/1289280384 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2788107900 msgr2=0x7f2788107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:13.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:13.613+0000 7f278c807640 1 --2- 172.21.15.88:0/1289280384 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2788107900 0x7f2788107ce0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2778009880 tx=0x7f277802a4a0 comp rx=0 tx=0).stop 2024-09-17T04:32:13.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:13.613+0000 7f278c807640 1 -- 172.21.15.88:0/1289280384 shutdown_connections 2024-09-17T04:32:13.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:13.613+0000 7f278c807640 1 --2- 172.21.15.88:0/1289280384 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2788101900 0x7f2788101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:13.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:13.613+0000 7f278c807640 1 --2- 172.21.15.88:0/1289280384 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2788107900 0x7f2788107ce0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:13.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:13.613+0000 7f278c807640 1 -- 172.21.15.88:0/1289280384 >> 172.21.15.88:0/1289280384 conn(0x7f27880fd600 msgr2=0x7f27880ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:32:13.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:13.613+0000 7f278c807640 1 -- 172.21.15.88:0/1289280384 shutdown_connections 2024-09-17T04:32:13.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:13.613+0000 7f278c807640 1 -- 172.21.15.88:0/1289280384 wait complete. 2024-09-17T04:32:13.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:13.614+0000 7f278c807640 1 Processor -- start 2024-09-17T04:32:13.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:13.614+0000 7f278c807640 1 -- start start 2024-09-17T04:32:13.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:13.614+0000 7f278c807640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2788101900 0x7f27880744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:13.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:13.614+0000 7f278c807640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2788107900 0x7f2788074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:13.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:13.614+0000 7f278c807640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f278810edb0 con 0x7f2788101900 2024-09-17T04:32:13.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:13.614+0000 7f278c807640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f278810ec30 con 0x7f2788107900 2024-09-17T04:32:13.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:13.614+0000 7f278659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2788101900 0x7f27880744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:13.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:13.614+0000 7f278659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2788101900 0x7f27880744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49428/0 (socket says 172.21.15.88:49428) 2024-09-17T04:32:13.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:13.614+0000 7f278659c640 1 -- 172.21.15.88:0/946708546 learned_addr learned my addr 172.21.15.88:0/946708546 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:32:13.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:13.614+0000 7f2785d9b640 1 --2- 172.21.15.88:0/946708546 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2788107900 0x7f2788074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:13.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:13.615+0000 7f278659c640 1 -- 172.21.15.88:0/946708546 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2788107900 msgr2=0x7f2788074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:13.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:13.615+0000 7f278659c640 1 --2- 172.21.15.88:0/946708546 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2788107900 0x7f2788074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:13.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:13.615+0000 7f278659c640 1 -- 172.21.15.88:0/946708546 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2788074f70 con 0x7f2788101900 2024-09-17T04:32:13.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:13.615+0000 7f278659c640 1 --2- 172.21.15.88:0/946708546 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2788101900 0x7f27880744f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2778031460 tx=0x7f27780045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:32:13.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:13.615+0000 7f27777fe640 1 -- 172.21.15.88:0/946708546 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f277803f070 con 0x7f2788101900 2024-09-17T04:32:13.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:13.615+0000 7f278c807640 1 -- 172.21.15.88:0/946708546 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2788075200 con 0x7f2788101900 2024-09-17T04:32:13.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:13.615+0000 7f27777fe640 1 -- 172.21.15.88:0/946708546 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f27780035f0 con 0x7f2788101900 2024-09-17T04:32:13.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:13.615+0000 7f27777fe640 1 -- 172.21.15.88:0/946708546 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2778035030 con 0x7f2788101900 2024-09-17T04:32:13.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:13.615+0000 7f278c807640 1 -- 172.21.15.88:0/946708546 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27881a3da0 con 0x7f2788101900 2024-09-17T04:32:13.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:13.616+0000 7f278c807640 1 -- 172.21.15.88:0/946708546 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2788103040 con 0x7f2788101900 2024-09-17T04:32:13.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:13.617+0000 7f27777fe640 1 -- 172.21.15.88:0/946708546 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f2778042070 con 0x7f2788101900 2024-09-17T04:32:13.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:13.617+0000 7f27777fe640 1 --2- 172.21.15.88:0/946708546 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f277007af30 0x7f277007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:13.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:13.618+0000 7f2785d9b640 1 --2- 172.21.15.88:0/946708546 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f277007af30 0x7f277007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:13.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:13.618+0000 7f27777fe640 1 -- 172.21.15.88:0/946708546 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f27780bea20 con 0x7f2788101900 2024-09-17T04:32:13.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:13.618+0000 7f2785d9b640 1 --2- 172.21.15.88:0/946708546 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f277007af30 0x7f277007d3f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2788075f80 tx=0x7f277c00b390 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:32:13.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:13.622+0000 7f27777fe640 1 -- 172.21.15.88:0/946708546 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f2778089f70 con 0x7f2788101900 2024-09-17T04:32:13.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:13.836+0000 7f278c807640 1 -- 172.21.15.88:0/946708546 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) -- 0x7f2788104b10 con 0x7f2788101900 2024-09-17T04:32:13.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:13.837+0000 7f27777fe640 1 -- 172.21.15.88:0/946708546 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v38) ==== 107+0+4467 (secure 0 0 0) 0x7f277808ee20 con 0x7f2788101900 2024-09-17T04:32:13.837 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:32:13.837 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":22,"btime":"2024-09-17T04:27:23:089019+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34223,"name":"cephfs.smithi134.psnynp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/584624515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":584624515},{"type":"v1","addr":"172.21.15.134:6827","nonce":584624515}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34318,"name":"cephfs.smithi088.lgavsv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6827/3125957194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":3125957194},{"type":"v1","addr":"172.21.15.88:6827","nonce":3125957194}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T04:18:10.480573+0000","modified":"2024-09-17T04:27:23.022666+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24325},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24325":{"gid":24325,"name":"cephfs.smithi134.ktuhce","rank":0,"incarnation":21,"state":"up:reconnect","state_seq":136,"addr":"172.21.15.134:6825/967997022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":967997022},{"type":"v1","addr":"172.21.15.134:6825","nonce":967997022}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T04:32:13.837 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 22 2024-09-17T04:32:13.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:13.839+0000 7f278c807640 1 -- 172.21.15.88:0/946708546 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f277007af30 msgr2=0x7f277007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:13.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:13.839+0000 7f278c807640 1 --2- 172.21.15.88:0/946708546 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f277007af30 0x7f277007d3f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2788075f80 tx=0x7f277c00b390 comp rx=0 tx=0).stop 2024-09-17T04:32:13.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:13.839+0000 7f278c807640 1 -- 172.21.15.88:0/946708546 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2788101900 msgr2=0x7f27880744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:13.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:13.839+0000 7f278c807640 1 --2- 172.21.15.88:0/946708546 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2788101900 0x7f27880744f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2778031460 tx=0x7f27780045e0 comp rx=0 tx=0).stop 2024-09-17T04:32:13.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:13.839+0000 7f278c807640 1 -- 172.21.15.88:0/946708546 shutdown_connections 2024-09-17T04:32:13.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:13.839+0000 7f278c807640 1 --2- 172.21.15.88:0/946708546 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f277007af30 0x7f277007d3f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:13.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:13.839+0000 7f278c807640 1 --2- 172.21.15.88:0/946708546 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2788107900 0x7f2788074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:13.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:13.839+0000 7f278c807640 1 --2- 172.21.15.88:0/946708546 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2788101900 0x7f27880744f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:13.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:13.839+0000 7f278c807640 1 -- 172.21.15.88:0/946708546 >> 172.21.15.88:0/946708546 conn(0x7f27880fd600 msgr2=0x7f27880fef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:32:13.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:13.839+0000 7f278c807640 1 -- 172.21.15.88:0/946708546 shutdown_connections 2024-09-17T04:32:13.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:13.839+0000 7f278c807640 1 -- 172.21.15.88:0/946708546 wait complete. 2024-09-17T04:32:14.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:13 smithi088 ceph-mon[90867]: pgmap v339: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:32:14.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:13 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:32:14.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:13 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:32:14.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:13 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:32:14.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:13 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:32:14.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:13 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:32:14.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:13 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/946708546' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 22, "format": "json"} : dispatch 2024-09-17T04:32:14.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:13 smithi134 ceph-mon[76677]: pgmap v339: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:32:14.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:13 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:32:14.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:13 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:32:14.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:13 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:32:14.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:13 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:32:14.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:13 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:32:14.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:13 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/946708546' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 22, "format": "json"} : dispatch 2024-09-17T04:32:14.568 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 22 2024-09-17T04:32:14.568 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 23 2024-09-17T04:32:14.822 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:32:15.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:15.228+0000 7fed5b627640 1 -- 172.21.15.88:0/2437450044 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed54100800 msgr2=0x7fed54100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:15.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:15.228+0000 7fed5b627640 1 --2- 172.21.15.88:0/2437450044 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed54100800 0x7fed54100c60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fed44009880 tx=0x7fed4402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:32:15.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:15.229+0000 7fed5b627640 1 -- 172.21.15.88:0/2437450044 shutdown_connections 2024-09-17T04:32:15.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:15.229+0000 7fed5b627640 1 --2- 172.21.15.88:0/2437450044 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed54100800 0x7fed54100c60 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:15.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:15.229+0000 7fed5b627640 1 --2- 172.21.15.88:0/2437450044 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed54106800 0x7fed54106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:15.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:15.229+0000 7fed5b627640 1 -- 172.21.15.88:0/2437450044 >> 172.21.15.88:0/2437450044 conn(0x7fed540fc520 msgr2=0x7fed540fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:32:15.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:15.229+0000 7fed5b627640 1 -- 172.21.15.88:0/2437450044 shutdown_connections 2024-09-17T04:32:15.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:15.229+0000 7fed5b627640 1 -- 172.21.15.88:0/2437450044 wait complete. 2024-09-17T04:32:15.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:15.230+0000 7fed5b627640 1 Processor -- start 2024-09-17T04:32:15.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:15.230+0000 7fed5b627640 1 -- start start 2024-09-17T04:32:15.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:15.230+0000 7fed5b627640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed54100800 0x7fed540fcbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:15.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:15.230+0000 7fed5b627640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed54106800 0x7fed540fd130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:15.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:15.230+0000 7fed5b627640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fed5410dcd0 con 0x7fed54100800 2024-09-17T04:32:15.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:15.230+0000 7fed5b627640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fed5410db50 con 0x7fed54106800 2024-09-17T04:32:15.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:15.230+0000 7fed593c3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed54100800 0x7fed540fcbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:15.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:15.230+0000 7fed593c3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed54100800 0x7fed540fcbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49444/0 (socket says 172.21.15.88:49444) 2024-09-17T04:32:15.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:15.230+0000 7fed593c3640 1 -- 172.21.15.88:0/2785900445 learned_addr learned my addr 172.21.15.88:0/2785900445 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:32:15.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:15.230+0000 7fed58bc2640 1 --2- 172.21.15.88:0/2785900445 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed54106800 0x7fed540fd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:15.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:15.230+0000 7fed593c3640 1 -- 172.21.15.88:0/2785900445 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed54106800 msgr2=0x7fed540fd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:15.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:15.230+0000 7fed593c3640 1 --2- 172.21.15.88:0/2785900445 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed54106800 0x7fed540fd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:15.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:15.230+0000 7fed593c3640 1 -- 172.21.15.88:0/2785900445 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed540fd670 con 0x7fed54100800 2024-09-17T04:32:15.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:15.231+0000 7fed593c3640 1 --2- 172.21.15.88:0/2785900445 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed54100800 0x7fed540fcbf0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fed5000d6f0 tx=0x7fed5000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:32:15.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:15.231+0000 7fed4a7fc640 1 -- 172.21.15.88:0/2785900445 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fed50017070 con 0x7fed54100800 2024-09-17T04:32:15.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:15.231+0000 7fed5b627640 1 -- 172.21.15.88:0/2785900445 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed540fd960 con 0x7fed54100800 2024-09-17T04:32:15.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:15.231+0000 7fed4a7fc640 1 -- 172.21.15.88:0/2785900445 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fed5000de00 con 0x7fed54100800 2024-09-17T04:32:15.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:15.231+0000 7fed4a7fc640 1 -- 172.21.15.88:0/2785900445 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fed50004bb0 con 0x7fed54100800 2024-09-17T04:32:15.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:15.231+0000 7fed5b627640 1 -- 172.21.15.88:0/2785900445 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed541a3e70 con 0x7fed54100800 2024-09-17T04:32:15.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:15.232+0000 7fed5b627640 1 -- 172.21.15.88:0/2785900445 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed54101f40 con 0x7fed54100800 2024-09-17T04:32:15.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:15.232+0000 7fed4a7fc640 1 -- 172.21.15.88:0/2785900445 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fed50004e60 con 0x7fed54100800 2024-09-17T04:32:15.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:15.233+0000 7fed4a7fc640 1 --2- 172.21.15.88:0/2785900445 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fed4007af30 0x7fed4007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:15.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:15.233+0000 7fed58bc2640 1 --2- 172.21.15.88:0/2785900445 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fed4007af30 0x7fed4007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:15.234 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:15.233+0000 7fed4a7fc640 1 -- 172.21.15.88:0/2785900445 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fed5009dc30 con 0x7fed54100800 2024-09-17T04:32:15.234 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:15.233+0000 7fed58bc2640 1 --2- 172.21.15.88:0/2785900445 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fed4007af30 0x7fed4007d3f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fed540fe680 tx=0x7fed44031400 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:32:15.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:15.238+0000 7fed4a7fc640 1 -- 172.21.15.88:0/2785900445 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fed50069180 con 0x7fed54100800 2024-09-17T04:32:15.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:15.446+0000 7fed5b627640 1 -- 172.21.15.88:0/2785900445 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) -- 0x7fed54100c60 con 0x7fed54100800 2024-09-17T04:32:15.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:15.447+0000 7fed4a7fc640 1 -- 172.21.15.88:0/2785900445 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v38) ==== 107+0+4464 (secure 0 0 0) 0x7fed5006e030 con 0x7fed54100800 2024-09-17T04:32:15.447 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:32:15.447 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":23,"btime":"2024-09-17T04:27:24:094183+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34223,"name":"cephfs.smithi134.psnynp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/584624515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":584624515},{"type":"v1","addr":"172.21.15.134:6827","nonce":584624515}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34318,"name":"cephfs.smithi088.lgavsv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6827/3125957194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":3125957194},{"type":"v1","addr":"172.21.15.88:6827","nonce":3125957194}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T04:18:10.480573+0000","modified":"2024-09-17T04:27:23.096788+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24325},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24325":{"gid":24325,"name":"cephfs.smithi134.ktuhce","rank":0,"incarnation":21,"state":"up:rejoin","state_seq":137,"addr":"172.21.15.134:6825/967997022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":967997022},{"type":"v1","addr":"172.21.15.134:6825","nonce":967997022}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T04:32:15.447 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 23 2024-09-17T04:32:15.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:15.449+0000 7fed5b627640 1 -- 172.21.15.88:0/2785900445 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fed4007af30 msgr2=0x7fed4007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:15.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:15.449+0000 7fed5b627640 1 --2- 172.21.15.88:0/2785900445 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fed4007af30 0x7fed4007d3f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fed540fe680 tx=0x7fed44031400 comp rx=0 tx=0).stop 2024-09-17T04:32:15.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:15.449+0000 7fed5b627640 1 -- 172.21.15.88:0/2785900445 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed54100800 msgr2=0x7fed540fcbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:15.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:15.449+0000 7fed5b627640 1 --2- 172.21.15.88:0/2785900445 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed54100800 0x7fed540fcbf0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fed5000d6f0 tx=0x7fed5000dbb0 comp rx=0 tx=0).stop 2024-09-17T04:32:15.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:15.449+0000 7fed5b627640 1 -- 172.21.15.88:0/2785900445 shutdown_connections 2024-09-17T04:32:15.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:15.449+0000 7fed5b627640 1 --2- 172.21.15.88:0/2785900445 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fed4007af30 0x7fed4007d3f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:15.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:15.449+0000 7fed5b627640 1 --2- 172.21.15.88:0/2785900445 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed54106800 0x7fed540fd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:15.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:15.449+0000 7fed5b627640 1 --2- 172.21.15.88:0/2785900445 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed54100800 0x7fed540fcbf0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:15.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:15.449+0000 7fed5b627640 1 -- 172.21.15.88:0/2785900445 >> 172.21.15.88:0/2785900445 conn(0x7fed540fc520 msgr2=0x7fed5406a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:32:15.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:15.450+0000 7fed5b627640 1 -- 172.21.15.88:0/2785900445 shutdown_connections 2024-09-17T04:32:15.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:15.450+0000 7fed5b627640 1 -- 172.21.15.88:0/2785900445 wait complete. 2024-09-17T04:32:16.113 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 23 2024-09-17T04:32:16.113 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 24 2024-09-17T04:32:16.360 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:32:16.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:15 smithi088 ceph-mon[90867]: pgmap v340: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:32:16.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:15 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/2785900445' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 23, "format": "json"} : dispatch 2024-09-17T04:32:16.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:15 smithi134 ceph-mon[76677]: pgmap v340: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:32:16.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:15 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/2785900445' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 23, "format": "json"} : dispatch 2024-09-17T04:32:16.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:16.794+0000 7f80c9ddb640 1 -- 172.21.15.88:0/3368452306 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80c4101900 msgr2=0x7f80c4101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:16.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:16.794+0000 7f80c9ddb640 1 --2- 172.21.15.88:0/3368452306 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80c4101900 0x7f80c4101d60 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f80ac009880 tx=0x7f80ac02a4a0 comp rx=0 tx=0).stop 2024-09-17T04:32:16.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:16.794+0000 7f80c9ddb640 1 -- 172.21.15.88:0/3368452306 shutdown_connections 2024-09-17T04:32:16.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:16.794+0000 7f80c9ddb640 1 --2- 172.21.15.88:0/3368452306 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80c4101900 0x7f80c4101d60 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:16.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:16.795+0000 7f80c9ddb640 1 --2- 172.21.15.88:0/3368452306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80c4107900 0x7f80c4107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:16.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:16.795+0000 7f80c9ddb640 1 -- 172.21.15.88:0/3368452306 >> 172.21.15.88:0/3368452306 conn(0x7f80c40fd600 msgr2=0x7f80c40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:32:16.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:16.795+0000 7f80c9ddb640 1 -- 172.21.15.88:0/3368452306 shutdown_connections 2024-09-17T04:32:16.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:16.795+0000 7f80c9ddb640 1 -- 172.21.15.88:0/3368452306 wait complete. 2024-09-17T04:32:16.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:16.795+0000 7f80c9ddb640 1 Processor -- start 2024-09-17T04:32:16.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:16.795+0000 7f80c9ddb640 1 -- start start 2024-09-17T04:32:16.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:16.796+0000 7f80c9ddb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80c4101900 0x7f80c419d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:16.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:16.796+0000 7f80c9ddb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80c4107900 0x7f80c419db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:16.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:16.796+0000 7f80c9ddb640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f80c410edb0 con 0x7f80c4107900 2024-09-17T04:32:16.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:16.796+0000 7f80c9ddb640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f80c410ec30 con 0x7f80c4101900 2024-09-17T04:32:16.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:16.796+0000 7f80bbfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80c4107900 0x7f80c419db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:16.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:16.796+0000 7f80bbfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80c4107900 0x7f80c419db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49474/0 (socket says 172.21.15.88:49474) 2024-09-17T04:32:16.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:16.796+0000 7f80bbfff640 1 -- 172.21.15.88:0/2632100827 learned_addr learned my addr 172.21.15.88:0/2632100827 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:32:16.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:16.796+0000 7f80c37fe640 1 --2- 172.21.15.88:0/2632100827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80c4101900 0x7f80c419d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:16.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:16.796+0000 7f80bbfff640 1 -- 172.21.15.88:0/2632100827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80c4101900 msgr2=0x7f80c419d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:16.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:16.796+0000 7f80bbfff640 1 --2- 172.21.15.88:0/2632100827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80c4101900 0x7f80c419d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:16.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:16.796+0000 7f80bbfff640 1 -- 172.21.15.88:0/2632100827 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80c41977d0 con 0x7f80c4107900 2024-09-17T04:32:16.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:16.796+0000 7f80c37fe640 1 --2- 172.21.15.88:0/2632100827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80c4101900 0x7f80c419d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:32:16.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:16.796+0000 7f80bbfff640 1 --2- 172.21.15.88:0/2632100827 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80c4107900 0x7f80c419db90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f80ac031460 tx=0x7f80ac0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:32:16.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:16.796+0000 7f80c17fa640 1 -- 172.21.15.88:0/2632100827 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f80ac03f070 con 0x7f80c4107900 2024-09-17T04:32:16.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:16.796+0000 7f80c17fa640 1 -- 172.21.15.88:0/2632100827 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f80ac0035f0 con 0x7f80c4107900 2024-09-17T04:32:16.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:16.796+0000 7f80c9ddb640 1 -- 172.21.15.88:0/2632100827 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80c4197a60 con 0x7f80c4107900 2024-09-17T04:32:16.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:16.796+0000 7f80c17fa640 1 -- 172.21.15.88:0/2632100827 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f80ac035030 con 0x7f80c4107900 2024-09-17T04:32:16.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:16.796+0000 7f80c9ddb640 1 -- 172.21.15.88:0/2632100827 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80c4197f90 con 0x7f80c4107900 2024-09-17T04:32:16.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:16.797+0000 7f80c9ddb640 1 -- 172.21.15.88:0/2632100827 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80c4103040 con 0x7f80c4107900 2024-09-17T04:32:16.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:16.798+0000 7f80c17fa640 1 -- 172.21.15.88:0/2632100827 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f80ac042070 con 0x7f80c4107900 2024-09-17T04:32:16.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:16.798+0000 7f80c17fa640 1 --2- 172.21.15.88:0/2632100827 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f80b007af30 0x7f80b007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:16.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:16.799+0000 7f80c17fa640 1 -- 172.21.15.88:0/2632100827 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f80ac0bead0 con 0x7f80c4107900 2024-09-17T04:32:16.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:16.799+0000 7f80c37fe640 1 --2- 172.21.15.88:0/2632100827 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f80b007af30 0x7f80b007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:16.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:16.799+0000 7f80c37fe640 1 --2- 172.21.15.88:0/2632100827 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f80b007af30 0x7f80b007d3f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f80b40058c0 tx=0x7f80b4005850 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:32:16.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:16.803+0000 7f80c17fa640 1 -- 172.21.15.88:0/2632100827 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f80ac08a020 con 0x7f80c4107900 2024-09-17T04:32:17.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:17.012+0000 7f80c9ddb640 1 -- 172.21.15.88:0/2632100827 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) -- 0x7f80c4109e90 con 0x7f80c4107900 2024-09-17T04:32:17.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:17.013+0000 7f80c17fa640 1 -- 172.21.15.88:0/2632100827 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v38) ==== 107+0+5320 (secure 0 0 0) 0x7f80ac08c020 con 0x7f80c4107900 2024-09-17T04:32:17.014 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:32:17.014 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":24,"btime":"2024-09-17T04:27:25:102565+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34223,"name":"cephfs.smithi134.psnynp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/584624515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":584624515},{"type":"v1","addr":"172.21.15.134:6827","nonce":584624515}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34318,"name":"cephfs.smithi088.lgavsv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6827/3125957194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":3125957194},{"type":"v1","addr":"172.21.15.88:6827","nonce":3125957194}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":34322,"name":"cephfs.smithi088.giqrgt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6829/2683662376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2683662376},{"type":"v1","addr":"172.21.15.88:6829","nonce":2683662376}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T04:18:10.480573+0000","modified":"2024-09-17T04:27:25.102558+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24325},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24325":{"gid":24325,"name":"cephfs.smithi134.ktuhce","rank":0,"incarnation":21,"state":"up:active","state_seq":138,"addr":"172.21.15.134:6825/967997022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":967997022},{"type":"v1","addr":"172.21.15.134:6825","nonce":967997022}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24325,"qdb_cluster":[24325]},"id":1}]} 2024-09-17T04:32:17.015 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 24 2024-09-17T04:32:17.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:17.015+0000 7f80c9ddb640 1 -- 172.21.15.88:0/2632100827 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f80b007af30 msgr2=0x7f80b007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:17.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:17.015+0000 7f80c9ddb640 1 --2- 172.21.15.88:0/2632100827 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f80b007af30 0x7f80b007d3f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f80b40058c0 tx=0x7f80b4005850 comp rx=0 tx=0).stop 2024-09-17T04:32:17.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:17.015+0000 7f80c9ddb640 1 -- 172.21.15.88:0/2632100827 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80c4107900 msgr2=0x7f80c419db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:17.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:17.015+0000 7f80c9ddb640 1 --2- 172.21.15.88:0/2632100827 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80c4107900 0x7f80c419db90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f80ac031460 tx=0x7f80ac0045e0 comp rx=0 tx=0).stop 2024-09-17T04:32:17.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:17.015+0000 7f80c9ddb640 1 -- 172.21.15.88:0/2632100827 shutdown_connections 2024-09-17T04:32:17.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:17.015+0000 7f80c9ddb640 1 --2- 172.21.15.88:0/2632100827 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f80b007af30 0x7f80b007d3f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:17.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:17.015+0000 7f80c9ddb640 1 --2- 172.21.15.88:0/2632100827 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80c4107900 0x7f80c419db90 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:17.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:17.015+0000 7f80c9ddb640 1 --2- 172.21.15.88:0/2632100827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80c4101900 0x7f80c419d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:17.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:17.015+0000 7f80c9ddb640 1 -- 172.21.15.88:0/2632100827 >> 172.21.15.88:0/2632100827 conn(0x7f80c40fd600 msgr2=0x7f80c40fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:32:17.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:17.015+0000 7f80c9ddb640 1 -- 172.21.15.88:0/2632100827 shutdown_connections 2024-09-17T04:32:17.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:17.015+0000 7f80c9ddb640 1 -- 172.21.15.88:0/2632100827 wait complete. 2024-09-17T04:32:17.671 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 24 2024-09-17T04:32:17.671 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 25 2024-09-17T04:32:17.927 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:32:18.190 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:17 smithi088 ceph-mon[90867]: pgmap v341: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:32:18.190 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:17 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/2632100827' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 24, "format": "json"} : dispatch 2024-09-17T04:32:18.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:18.376+0000 7fd72b6af640 1 -- 172.21.15.88:0/2632062536 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd724100800 msgr2=0x7fd724100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:18.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:18.376+0000 7fd72b6af640 1 --2- 172.21.15.88:0/2632062536 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd724100800 0x7fd724100c60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd720009880 tx=0x7fd72002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:32:18.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:18.376+0000 7fd72b6af640 1 -- 172.21.15.88:0/2632062536 shutdown_connections 2024-09-17T04:32:18.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:18.376+0000 7fd72b6af640 1 --2- 172.21.15.88:0/2632062536 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd724100800 0x7fd724100c60 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:18.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:18.376+0000 7fd72b6af640 1 --2- 172.21.15.88:0/2632062536 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd724106800 0x7fd724106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:18.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:18.376+0000 7fd72b6af640 1 -- 172.21.15.88:0/2632062536 >> 172.21.15.88:0/2632062536 conn(0x7fd7240fc520 msgr2=0x7fd7240fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:32:18.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:18.376+0000 7fd72b6af640 1 -- 172.21.15.88:0/2632062536 shutdown_connections 2024-09-17T04:32:18.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:18.377+0000 7fd72b6af640 1 -- 172.21.15.88:0/2632062536 wait complete. 2024-09-17T04:32:18.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:18.377+0000 7fd72b6af640 1 Processor -- start 2024-09-17T04:32:18.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:18.377+0000 7fd72b6af640 1 -- start start 2024-09-17T04:32:18.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:18.377+0000 7fd72b6af640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd724100800 0x7fd7240fcc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:18.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:18.377+0000 7fd72b6af640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd724106800 0x7fd7240fd150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:18.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:18.377+0000 7fd72b6af640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fd72410dcd0 con 0x7fd724100800 2024-09-17T04:32:18.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:18.377+0000 7fd72b6af640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd72410db50 con 0x7fd724106800 2024-09-17T04:32:18.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:18.377+0000 7fd72944b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd724100800 0x7fd7240fcc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:18.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:18.377+0000 7fd72944b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd724100800 0x7fd7240fcc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49506/0 (socket says 172.21.15.88:49506) 2024-09-17T04:32:18.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:18.377+0000 7fd72944b640 1 -- 172.21.15.88:0/87071022 learned_addr learned my addr 172.21.15.88:0/87071022 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:32:18.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:18.378+0000 7fd728c4a640 1 --2- 172.21.15.88:0/87071022 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd724106800 0x7fd7240fd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:18.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:18.378+0000 7fd72944b640 1 -- 172.21.15.88:0/87071022 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd724106800 msgr2=0x7fd7240fd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:18.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:18.378+0000 7fd72944b640 1 --2- 172.21.15.88:0/87071022 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd724106800 0x7fd7240fd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:18.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:18.378+0000 7fd72944b640 1 -- 172.21.15.88:0/87071022 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7240fd690 con 0x7fd724100800 2024-09-17T04:32:18.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:18.378+0000 7fd72944b640 1 --2- 172.21.15.88:0/87071022 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd724100800 0x7fd7240fcc10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd71800d6f0 tx=0x7fd71800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:32:18.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:18.378+0000 7fd7167fc640 1 -- 172.21.15.88:0/87071022 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd718017070 con 0x7fd724100800 2024-09-17T04:32:18.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:18.378+0000 7fd72b6af640 1 -- 172.21.15.88:0/87071022 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7240fd980 con 0x7fd724100800 2024-09-17T04:32:18.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:18.378+0000 7fd7167fc640 1 -- 172.21.15.88:0/87071022 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd71800de00 con 0x7fd724100800 2024-09-17T04:32:18.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:18.378+0000 7fd7167fc640 1 -- 172.21.15.88:0/87071022 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd718004bb0 con 0x7fd724100800 2024-09-17T04:32:18.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:18.378+0000 7fd72b6af640 1 -- 172.21.15.88:0/87071022 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7241a3e70 con 0x7fd724100800 2024-09-17T04:32:18.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:18.379+0000 7fd72b6af640 1 -- 172.21.15.88:0/87071022 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd724101f40 con 0x7fd724100800 2024-09-17T04:32:18.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:18.380+0000 7fd7167fc640 1 -- 172.21.15.88:0/87071022 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fd718009a30 con 0x7fd724100800 2024-09-17T04:32:18.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:18.380+0000 7fd7167fc640 1 --2- 172.21.15.88:0/87071022 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fd71007af80 0x7fd71007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:18.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:18.380+0000 7fd7167fc640 1 -- 172.21.15.88:0/87071022 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fd71809dc30 con 0x7fd724100800 2024-09-17T04:32:18.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:18.380+0000 7fd728c4a640 1 --2- 172.21.15.88:0/87071022 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fd71007af80 0x7fd71007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:18.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:18.381+0000 7fd728c4a640 1 --2- 172.21.15.88:0/87071022 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fd71007af80 0x7fd71007d440 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd7240fe6a0 tx=0x7fd720031400 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:32:18.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:18.385+0000 7fd7167fc640 1 -- 172.21.15.88:0/87071022 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fd718069200 con 0x7fd724100800 2024-09-17T04:32:18.398 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:17 smithi134 ceph-mon[76677]: pgmap v341: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:32:18.399 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:17 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/2632100827' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 24, "format": "json"} : dispatch 2024-09-17T04:32:18.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:18.594+0000 7fd72b6af640 1 -- 172.21.15.88:0/87071022 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) -- 0x7fd724100c60 con 0x7fd724100800 2024-09-17T04:32:18.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:18.594+0000 7fd7167fc640 1 -- 172.21.15.88:0/87071022 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v38) ==== 107+0+4451 (secure 0 0 0) 0x7fd71805ee20 con 0x7fd724100800 2024-09-17T04:32:18.595 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:32:18.595 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":25,"btime":"2024-09-17T04:27:37:002490+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34223,"name":"cephfs.smithi134.psnynp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/584624515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":584624515},{"type":"v1","addr":"172.21.15.134:6827","nonce":584624515}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34318,"name":"cephfs.smithi088.lgavsv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6827/3125957194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":3125957194},{"type":"v1","addr":"172.21.15.88:6827","nonce":3125957194}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":34322,"name":"cephfs.smithi088.giqrgt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6829/2683662376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2683662376},{"type":"v1","addr":"172.21.15.88:6829","nonce":2683662376}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T04:18:10.480573+0000","modified":"2024-09-17T04:27:37.002485+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T04:32:18.596 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 25 2024-09-17T04:32:18.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:18.596+0000 7fd72b6af640 1 -- 172.21.15.88:0/87071022 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fd71007af80 msgr2=0x7fd71007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:18.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:18.596+0000 7fd72b6af640 1 --2- 172.21.15.88:0/87071022 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fd71007af80 0x7fd71007d440 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd7240fe6a0 tx=0x7fd720031400 comp rx=0 tx=0).stop 2024-09-17T04:32:18.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:18.597+0000 7fd72b6af640 1 -- 172.21.15.88:0/87071022 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd724100800 msgr2=0x7fd7240fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:18.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:18.597+0000 7fd72b6af640 1 --2- 172.21.15.88:0/87071022 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd724100800 0x7fd7240fcc10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd71800d6f0 tx=0x7fd71800dbb0 comp rx=0 tx=0).stop 2024-09-17T04:32:18.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:18.597+0000 7fd72b6af640 1 -- 172.21.15.88:0/87071022 shutdown_connections 2024-09-17T04:32:18.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:18.597+0000 7fd72b6af640 1 --2- 172.21.15.88:0/87071022 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fd71007af80 0x7fd71007d440 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:18.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:18.597+0000 7fd72b6af640 1 --2- 172.21.15.88:0/87071022 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd724106800 0x7fd7240fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:18.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:18.597+0000 7fd72b6af640 1 --2- 172.21.15.88:0/87071022 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd724100800 0x7fd7240fcc10 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:18.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:18.597+0000 7fd72b6af640 1 -- 172.21.15.88:0/87071022 >> 172.21.15.88:0/87071022 conn(0x7fd7240fc520 msgr2=0x7fd72406a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:32:18.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:18.597+0000 7fd72b6af640 1 -- 172.21.15.88:0/87071022 shutdown_connections 2024-09-17T04:32:18.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:18.597+0000 7fd72b6af640 1 -- 172.21.15.88:0/87071022 wait complete. 2024-09-17T04:32:19.199 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:18 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/87071022' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 25, "format": "json"} : dispatch 2024-09-17T04:32:19.226 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 25 2024-09-17T04:32:19.227 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 26 2024-09-17T04:32:19.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:18 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/87071022' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 25, "format": "json"} : dispatch 2024-09-17T04:32:19.476 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:32:19.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:19.919+0000 7efdc560f640 1 -- 172.21.15.88:0/3785835525 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efdc01007f0 msgr2=0x7efdc0100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:19.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:19.919+0000 7efdc560f640 1 --2- 172.21.15.88:0/3785835525 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efdc01007f0 0x7efdc0100c50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7efda8009880 tx=0x7efda802a4a0 comp rx=0 tx=0).stop 2024-09-17T04:32:19.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:19.919+0000 7efdc560f640 1 -- 172.21.15.88:0/3785835525 shutdown_connections 2024-09-17T04:32:19.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:19.919+0000 7efdc560f640 1 --2- 172.21.15.88:0/3785835525 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efdc01007f0 0x7efdc0100c50 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:19.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:19.919+0000 7efdc560f640 1 --2- 172.21.15.88:0/3785835525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdc01067f0 0x7efdc0106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:19.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:19.919+0000 7efdc560f640 1 -- 172.21.15.88:0/3785835525 >> 172.21.15.88:0/3785835525 conn(0x7efdc00fc550 msgr2=0x7efdc00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:32:19.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:19.919+0000 7efdc560f640 1 -- 172.21.15.88:0/3785835525 shutdown_connections 2024-09-17T04:32:19.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:19.919+0000 7efdc560f640 1 -- 172.21.15.88:0/3785835525 wait complete. 2024-09-17T04:32:19.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:19.920+0000 7efdc560f640 1 Processor -- start 2024-09-17T04:32:19.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:19.920+0000 7efdc560f640 1 -- start start 2024-09-17T04:32:19.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:19.920+0000 7efdc560f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efdc01007f0 0x7efdc00fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:19.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:19.920+0000 7efdc560f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdc01067f0 0x7efdc00fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:19.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:19.920+0000 7efdc560f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7efdc010dca0 con 0x7efdc01007f0 2024-09-17T04:32:19.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:19.920+0000 7efdc560f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7efdc010db20 con 0x7efdc01067f0 2024-09-17T04:32:19.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:19.920+0000 7efdbeffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efdc01007f0 0x7efdc00fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:19.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:19.920+0000 7efdbeffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efdc01007f0 0x7efdc00fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49532/0 (socket says 172.21.15.88:49532) 2024-09-17T04:32:19.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:19.920+0000 7efdbeffd640 1 -- 172.21.15.88:0/1337037250 learned_addr learned my addr 172.21.15.88:0/1337037250 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:32:19.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:19.920+0000 7efdb67fc640 1 --2- 172.21.15.88:0/1337037250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdc01067f0 0x7efdc00fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:19.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:19.921+0000 7efdbeffd640 1 -- 172.21.15.88:0/1337037250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdc01067f0 msgr2=0x7efdc00fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:19.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:19.921+0000 7efdbeffd640 1 --2- 172.21.15.88:0/1337037250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdc01067f0 0x7efdc00fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:19.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:19.921+0000 7efdbeffd640 1 -- 172.21.15.88:0/1337037250 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdc00fd700 con 0x7efdc01007f0 2024-09-17T04:32:19.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:19.921+0000 7efdbeffd640 1 --2- 172.21.15.88:0/1337037250 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efdc01007f0 0x7efdc00fcc80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7efdb000d8d0 tx=0x7efdb000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:32:19.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:19.921+0000 7efdbcff9640 1 -- 172.21.15.88:0/1337037250 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efdb0017070 con 0x7efdc01007f0 2024-09-17T04:32:19.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:19.921+0000 7efdbcff9640 1 -- 172.21.15.88:0/1337037250 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efdb0010460 con 0x7efdc01007f0 2024-09-17T04:32:19.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:19.921+0000 7efdc560f640 1 -- 172.21.15.88:0/1337037250 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdc00fd9f0 con 0x7efdc01007f0 2024-09-17T04:32:19.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:19.921+0000 7efdbcff9640 1 -- 172.21.15.88:0/1337037250 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efdb000f5f0 con 0x7efdc01007f0 2024-09-17T04:32:19.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:19.921+0000 7efdc560f640 1 -- 172.21.15.88:0/1337037250 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdc01a3e00 con 0x7efdc01007f0 2024-09-17T04:32:19.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:19.922+0000 7efdc560f640 1 -- 172.21.15.88:0/1337037250 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdc0101f30 con 0x7efdc01007f0 2024-09-17T04:32:19.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:19.923+0000 7efdbcff9640 1 -- 172.21.15.88:0/1337037250 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7efdb0009a30 con 0x7efdc01007f0 2024-09-17T04:32:19.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:19.923+0000 7efdbcff9640 1 --2- 172.21.15.88:0/1337037250 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7efdac07af80 0x7efdac07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:19.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:19.924+0000 7efdbcff9640 1 -- 172.21.15.88:0/1337037250 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7efdb009de10 con 0x7efdc01007f0 2024-09-17T04:32:19.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:19.924+0000 7efdb67fc640 1 --2- 172.21.15.88:0/1337037250 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7efdac07af80 0x7efdac07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:19.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:19.924+0000 7efdb67fc640 1 --2- 172.21.15.88:0/1337037250 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7efdac07af80 0x7efdac07d440 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7efdc00fe710 tx=0x7efda8031400 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:32:19.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:19.928+0000 7efdbcff9640 1 -- 172.21.15.88:0/1337037250 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7efdb00693e0 con 0x7efdc01007f0 2024-09-17T04:32:20.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:20.141+0000 7efdc560f640 1 -- 172.21.15.88:0/1337037250 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) -- 0x7efdc0109d90 con 0x7efdc01007f0 2024-09-17T04:32:20.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:20.141+0000 7efdbcff9640 1 -- 172.21.15.88:0/1337037250 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v38) ==== 107+0+4462 (secure 0 0 0) 0x7efdb006e290 con 0x7efdc01007f0 2024-09-17T04:32:20.141 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:32:20.142 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":26,"btime":"2024-09-17T04:27:37:008695+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34318,"name":"cephfs.smithi088.lgavsv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6827/3125957194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":3125957194},{"type":"v1","addr":"172.21.15.88:6827","nonce":3125957194}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":34322,"name":"cephfs.smithi088.giqrgt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6829/2683662376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2683662376},{"type":"v1","addr":"172.21.15.88:6829","nonce":2683662376}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T04:18:10.480573+0000","modified":"2024-09-17T04:27:37.008679+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34223},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34223":{"gid":34223,"name":"cephfs.smithi134.psnynp","rank":0,"incarnation":26,"state":"up:replay","state_seq":1,"addr":"172.21.15.134:6827/584624515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":584624515},{"type":"v1","addr":"172.21.15.134:6827","nonce":584624515}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T04:32:20.142 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 26 2024-09-17T04:32:20.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:20.144+0000 7efdc560f640 1 -- 172.21.15.88:0/1337037250 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7efdac07af80 msgr2=0x7efdac07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:20.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:20.144+0000 7efdc560f640 1 --2- 172.21.15.88:0/1337037250 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7efdac07af80 0x7efdac07d440 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7efdc00fe710 tx=0x7efda8031400 comp rx=0 tx=0).stop 2024-09-17T04:32:20.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:20.144+0000 7efdc560f640 1 -- 172.21.15.88:0/1337037250 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efdc01007f0 msgr2=0x7efdc00fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:20.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:20.144+0000 7efdc560f640 1 --2- 172.21.15.88:0/1337037250 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efdc01007f0 0x7efdc00fcc80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7efdb000d8d0 tx=0x7efdb000dd90 comp rx=0 tx=0).stop 2024-09-17T04:32:20.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:20.144+0000 7efdc560f640 1 -- 172.21.15.88:0/1337037250 shutdown_connections 2024-09-17T04:32:20.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:20.144+0000 7efdc560f640 1 --2- 172.21.15.88:0/1337037250 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7efdac07af80 0x7efdac07d440 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:20.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:20.144+0000 7efdc560f640 1 --2- 172.21.15.88:0/1337037250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdc01067f0 0x7efdc00fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:20.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:20.144+0000 7efdc560f640 1 --2- 172.21.15.88:0/1337037250 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efdc01007f0 0x7efdc00fcc80 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:20.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:20.144+0000 7efdc560f640 1 -- 172.21.15.88:0/1337037250 >> 172.21.15.88:0/1337037250 conn(0x7efdc00fc550 msgr2=0x7efdc0069e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:32:20.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:20.144+0000 7efdc560f640 1 -- 172.21.15.88:0/1337037250 shutdown_connections 2024-09-17T04:32:20.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:20.144+0000 7efdc560f640 1 -- 172.21.15.88:0/1337037250 wait complete. 2024-09-17T04:32:20.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:19 smithi088 ceph-mon[90867]: pgmap v342: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:32:20.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:19 smithi134 ceph-mon[76677]: pgmap v342: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:32:20.786 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 26 2024-09-17T04:32:20.787 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 27 2024-09-17T04:32:21.042 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:32:21.191 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:20 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/1337037250' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 26, "format": "json"} : dispatch 2024-09-17T04:32:21.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:20 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/1337037250' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 26, "format": "json"} : dispatch 2024-09-17T04:32:21.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:21.516+0000 7fbeab2f0640 1 -- 172.21.15.88:0/2311441501 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbea4107900 msgr2=0x7fbea4107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:21.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:21.516+0000 7fbeab2f0640 1 --2- 172.21.15.88:0/2311441501 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbea4107900 0x7fbea4107ce0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fbea0009880 tx=0x7fbea002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:32:21.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:21.516+0000 7fbeab2f0640 1 -- 172.21.15.88:0/2311441501 shutdown_connections 2024-09-17T04:32:21.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:21.516+0000 7fbeab2f0640 1 --2- 172.21.15.88:0/2311441501 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbea4101900 0x7fbea4101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:21.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:21.516+0000 7fbeab2f0640 1 --2- 172.21.15.88:0/2311441501 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbea4107900 0x7fbea4107ce0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:21.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:21.516+0000 7fbeab2f0640 1 -- 172.21.15.88:0/2311441501 >> 172.21.15.88:0/2311441501 conn(0x7fbea40fd600 msgr2=0x7fbea40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:32:21.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:21.516+0000 7fbeab2f0640 1 -- 172.21.15.88:0/2311441501 shutdown_connections 2024-09-17T04:32:21.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:21.517+0000 7fbeab2f0640 1 -- 172.21.15.88:0/2311441501 wait complete. 2024-09-17T04:32:21.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:21.517+0000 7fbeab2f0640 1 Processor -- start 2024-09-17T04:32:21.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:21.517+0000 7fbeab2f0640 1 -- start start 2024-09-17T04:32:21.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:21.517+0000 7fbeab2f0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbea4101900 0x7fbea419d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:21.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:21.517+0000 7fbeab2f0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbea4107900 0x7fbea419dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:21.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:21.517+0000 7fbeab2f0640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fbea410ee30 con 0x7fbea4107900 2024-09-17T04:32:21.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:21.517+0000 7fbeab2f0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbea410ecb0 con 0x7fbea4101900 2024-09-17T04:32:21.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:21.518+0000 7fbea888b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbea4107900 0x7fbea419dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:21.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:21.518+0000 7fbea888b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbea4107900 0x7fbea419dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49552/0 (socket says 172.21.15.88:49552) 2024-09-17T04:32:21.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:21.518+0000 7fbea888b640 1 -- 172.21.15.88:0/1736968450 learned_addr learned my addr 172.21.15.88:0/1736968450 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:32:21.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:21.518+0000 7fbea908c640 1 --2- 172.21.15.88:0/1736968450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbea4101900 0x7fbea419d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:21.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:21.518+0000 7fbea888b640 1 -- 172.21.15.88:0/1736968450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbea4101900 msgr2=0x7fbea419d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:21.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:21.518+0000 7fbea888b640 1 --2- 172.21.15.88:0/1736968450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbea4101900 0x7fbea419d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:21.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:21.518+0000 7fbea888b640 1 -- 172.21.15.88:0/1736968450 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbea4197810 con 0x7fbea4107900 2024-09-17T04:32:21.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:21.518+0000 7fbea888b640 1 --2- 172.21.15.88:0/1736968450 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbea4107900 0x7fbea419dbd0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fbe9400b420 tx=0x7fbe9400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:32:21.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:21.518+0000 7fbe9a7fc640 1 -- 172.21.15.88:0/1736968450 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbe94011630 con 0x7fbea4107900 2024-09-17T04:32:21.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:21.518+0000 7fbeab2f0640 1 -- 172.21.15.88:0/1736968450 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbea4197b00 con 0x7fbea4107900 2024-09-17T04:32:21.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:21.518+0000 7fbeab2f0640 1 -- 172.21.15.88:0/1736968450 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbea4198090 con 0x7fbea4107900 2024-09-17T04:32:21.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:21.518+0000 7fbe9a7fc640 1 -- 172.21.15.88:0/1736968450 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbe94016070 con 0x7fbea4107900 2024-09-17T04:32:21.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:21.518+0000 7fbe9a7fc640 1 -- 172.21.15.88:0/1736968450 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbe94010d40 con 0x7fbea4107900 2024-09-17T04:32:21.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:21.519+0000 7fbeab2f0640 1 -- 172.21.15.88:0/1736968450 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbea4103040 con 0x7fbea4107900 2024-09-17T04:32:21.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:21.520+0000 7fbe9a7fc640 1 -- 172.21.15.88:0/1736968450 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fbe9401b460 con 0x7fbea4107900 2024-09-17T04:32:21.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:21.521+0000 7fbe9a7fc640 1 --2- 172.21.15.88:0/1736968450 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fbe9007af30 0x7fbe9007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:21.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:21.521+0000 7fbe9a7fc640 1 -- 172.21.15.88:0/1736968450 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fbe9409d790 con 0x7fbea4107900 2024-09-17T04:32:21.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:21.521+0000 7fbea908c640 1 --2- 172.21.15.88:0/1736968450 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fbe9007af30 0x7fbe9007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:21.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:21.521+0000 7fbea908c640 1 --2- 172.21.15.88:0/1736968450 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fbe9007af30 0x7fbe9007d3f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbea00096c0 tx=0x7fbea0031400 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:32:21.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:21.525+0000 7fbe9a7fc640 1 -- 172.21.15.88:0/1736968450 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fbe94068ce0 con 0x7fbea4107900 2024-09-17T04:32:21.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:21.735+0000 7fbeab2f0640 1 -- 172.21.15.88:0/1736968450 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) -- 0x7fbea4109e70 con 0x7fbea4107900 2024-09-17T04:32:21.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:21.735+0000 7fbe9a7fc640 1 -- 172.21.15.88:0/1736968450 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v38) ==== 107+0+4466 (secure 0 0 0) 0x7fbe9406db90 con 0x7fbea4107900 2024-09-17T04:32:21.735 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:32:21.736 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":27,"btime":"2024-09-17T04:27:46:060605+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34318,"name":"cephfs.smithi088.lgavsv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6827/3125957194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":3125957194},{"type":"v1","addr":"172.21.15.88:6827","nonce":3125957194}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":34322,"name":"cephfs.smithi088.giqrgt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6829/2683662376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2683662376},{"type":"v1","addr":"172.21.15.88:6829","nonce":2683662376}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T04:18:10.480573+0000","modified":"2024-09-17T04:27:45.263764+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34223},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34223":{"gid":34223,"name":"cephfs.smithi134.psnynp","rank":0,"incarnation":26,"state":"up:reconnect","state_seq":14,"addr":"172.21.15.134:6827/584624515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":584624515},{"type":"v1","addr":"172.21.15.134:6827","nonce":584624515}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T04:32:21.736 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 27 2024-09-17T04:32:21.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:21.738+0000 7fbeab2f0640 1 -- 172.21.15.88:0/1736968450 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fbe9007af30 msgr2=0x7fbe9007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:21.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:21.738+0000 7fbeab2f0640 1 --2- 172.21.15.88:0/1736968450 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fbe9007af30 0x7fbe9007d3f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbea00096c0 tx=0x7fbea0031400 comp rx=0 tx=0).stop 2024-09-17T04:32:21.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:21.738+0000 7fbeab2f0640 1 -- 172.21.15.88:0/1736968450 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbea4107900 msgr2=0x7fbea419dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:21.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:21.738+0000 7fbeab2f0640 1 --2- 172.21.15.88:0/1736968450 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbea4107900 0x7fbea419dbd0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fbe9400b420 tx=0x7fbe9400b8e0 comp rx=0 tx=0).stop 2024-09-17T04:32:21.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:21.738+0000 7fbeab2f0640 1 -- 172.21.15.88:0/1736968450 shutdown_connections 2024-09-17T04:32:21.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:21.738+0000 7fbeab2f0640 1 --2- 172.21.15.88:0/1736968450 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fbe9007af30 0x7fbe9007d3f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:21.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:21.738+0000 7fbeab2f0640 1 --2- 172.21.15.88:0/1736968450 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbea4107900 0x7fbea419dbd0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:21.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:21.738+0000 7fbeab2f0640 1 --2- 172.21.15.88:0/1736968450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbea4101900 0x7fbea419d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:21.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:21.738+0000 7fbeab2f0640 1 -- 172.21.15.88:0/1736968450 >> 172.21.15.88:0/1736968450 conn(0x7fbea40fd600 msgr2=0x7fbea40fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:32:21.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:21.738+0000 7fbeab2f0640 1 -- 172.21.15.88:0/1736968450 shutdown_connections 2024-09-17T04:32:21.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:21.738+0000 7fbeab2f0640 1 -- 172.21.15.88:0/1736968450 wait complete. 2024-09-17T04:32:22.097 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:21 smithi088 ceph-mon[90867]: pgmap v343: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:32:22.098 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:21 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/1736968450' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 27, "format": "json"} : dispatch 2024-09-17T04:32:22.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:21 smithi134 ceph-mon[76677]: pgmap v343: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:32:22.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:21 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/1736968450' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 27, "format": "json"} : dispatch 2024-09-17T04:32:22.469 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 27 2024-09-17T04:32:22.470 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 28 2024-09-17T04:32:22.718 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:32:23.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:23.324+0000 7fbba0d3a640 1 -- 172.21.15.88:0/1662734346 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb9c101900 msgr2=0x7fbb9c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:23.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:23.324+0000 7fbba0d3a640 1 --2- 172.21.15.88:0/1662734346 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb9c101900 0x7fbb9c101d60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fbb84009880 tx=0x7fbb8402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:32:23.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:23.324+0000 7fbba0d3a640 1 -- 172.21.15.88:0/1662734346 shutdown_connections 2024-09-17T04:32:23.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:23.324+0000 7fbba0d3a640 1 --2- 172.21.15.88:0/1662734346 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb9c101900 0x7fbb9c101d60 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:23.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:23.324+0000 7fbba0d3a640 1 --2- 172.21.15.88:0/1662734346 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb9c107900 0x7fbb9c107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:23.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:23.324+0000 7fbba0d3a640 1 -- 172.21.15.88:0/1662734346 >> 172.21.15.88:0/1662734346 conn(0x7fbb9c0fd600 msgr2=0x7fbb9c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:32:23.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:23.324+0000 7fbba0d3a640 1 -- 172.21.15.88:0/1662734346 shutdown_connections 2024-09-17T04:32:23.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:23.324+0000 7fbba0d3a640 1 -- 172.21.15.88:0/1662734346 wait complete. 2024-09-17T04:32:23.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:23.325+0000 7fbba0d3a640 1 Processor -- start 2024-09-17T04:32:23.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:23.325+0000 7fbba0d3a640 1 -- start start 2024-09-17T04:32:23.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:23.325+0000 7fbba0d3a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb9c101900 0x7fbb9c19d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:23.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:23.325+0000 7fbba0d3a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb9c107900 0x7fbb9c19db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:23.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:23.325+0000 7fbba0d3a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fbb9c10edd0 con 0x7fbb9c107900 2024-09-17T04:32:23.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:23.325+0000 7fbba0d3a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbb9c10ec50 con 0x7fbb9c101900 2024-09-17T04:32:23.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:23.325+0000 7fbb93fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb9c107900 0x7fbb9c19db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:23.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:23.325+0000 7fbb93fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb9c107900 0x7fbb9c19db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55348/0 (socket says 172.21.15.88:55348) 2024-09-17T04:32:23.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:23.325+0000 7fbb93fff640 1 -- 172.21.15.88:0/6905128 learned_addr learned my addr 172.21.15.88:0/6905128 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:32:23.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:23.325+0000 7fbb9a59c640 1 --2- 172.21.15.88:0/6905128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb9c101900 0x7fbb9c19d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:23.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:23.325+0000 7fbb93fff640 1 -- 172.21.15.88:0/6905128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb9c101900 msgr2=0x7fbb9c19d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:23.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:23.325+0000 7fbb93fff640 1 --2- 172.21.15.88:0/6905128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb9c101900 0x7fbb9c19d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:23.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:23.325+0000 7fbb93fff640 1 -- 172.21.15.88:0/6905128 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb9c1977a0 con 0x7fbb9c107900 2024-09-17T04:32:23.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:23.326+0000 7fbb93fff640 1 --2- 172.21.15.88:0/6905128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb9c107900 0x7fbb9c19db60 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fbb84031460 tx=0x7fbb840045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:32:23.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:23.326+0000 7fbb937fe640 1 -- 172.21.15.88:0/6905128 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbb8403f070 con 0x7fbb9c107900 2024-09-17T04:32:23.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:23.326+0000 7fbba0d3a640 1 -- 172.21.15.88:0/6905128 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb9c197a30 con 0x7fbb9c107900 2024-09-17T04:32:23.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:23.326+0000 7fbb937fe640 1 -- 172.21.15.88:0/6905128 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbb840035f0 con 0x7fbb9c107900 2024-09-17T04:32:23.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:23.326+0000 7fbb937fe640 1 -- 172.21.15.88:0/6905128 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbb84035030 con 0x7fbb9c107900 2024-09-17T04:32:23.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:23.326+0000 7fbba0d3a640 1 -- 172.21.15.88:0/6905128 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb9c197f60 con 0x7fbb9c107900 2024-09-17T04:32:23.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:23.327+0000 7fbba0d3a640 1 -- 172.21.15.88:0/6905128 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb9c103040 con 0x7fbb9c107900 2024-09-17T04:32:23.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:23.327+0000 7fbb937fe640 1 -- 172.21.15.88:0/6905128 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fbb84042070 con 0x7fbb9c107900 2024-09-17T04:32:23.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:23.328+0000 7fbb937fe640 1 --2- 172.21.15.88:0/6905128 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fbb8807af30 0x7fbb8807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:23.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:23.328+0000 7fbb937fe640 1 -- 172.21.15.88:0/6905128 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fbb840bead0 con 0x7fbb9c107900 2024-09-17T04:32:23.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:23.328+0000 7fbb9a59c640 1 --2- 172.21.15.88:0/6905128 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fbb8807af30 0x7fbb8807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:23.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:23.328+0000 7fbb9a59c640 1 --2- 172.21.15.88:0/6905128 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fbb8807af30 0x7fbb8807d3f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c005fd0 tx=0x7fbb8c005850 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:32:23.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:23.333+0000 7fbb937fe640 1 -- 172.21.15.88:0/6905128 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fbb8408a020 con 0x7fbb9c107900 2024-09-17T04:32:23.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:23.545+0000 7fbba0d3a640 1 -- 172.21.15.88:0/6905128 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) -- 0x7fbb9c109e70 con 0x7fbb9c107900 2024-09-17T04:32:23.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:23.546+0000 7fbb937fe640 1 -- 172.21.15.88:0/6905128 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v38) ==== 107+0+4463 (secure 0 0 0) 0x7fbb8408c020 con 0x7fbb9c107900 2024-09-17T04:32:23.546 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:32:23.546 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":28,"btime":"2024-09-17T04:27:47:069121+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34318,"name":"cephfs.smithi088.lgavsv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6827/3125957194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":3125957194},{"type":"v1","addr":"172.21.15.88:6827","nonce":3125957194}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":34322,"name":"cephfs.smithi088.giqrgt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6829/2683662376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2683662376},{"type":"v1","addr":"172.21.15.88:6829","nonce":2683662376}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T04:18:10.480573+0000","modified":"2024-09-17T04:27:46.074445+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34223},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34223":{"gid":34223,"name":"cephfs.smithi134.psnynp","rank":0,"incarnation":26,"state":"up:rejoin","state_seq":15,"addr":"172.21.15.134:6827/584624515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":584624515},{"type":"v1","addr":"172.21.15.134:6827","nonce":584624515}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T04:32:23.546 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 28 2024-09-17T04:32:23.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:23.548+0000 7fbba0d3a640 1 -- 172.21.15.88:0/6905128 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fbb8807af30 msgr2=0x7fbb8807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:23.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:23.548+0000 7fbba0d3a640 1 --2- 172.21.15.88:0/6905128 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fbb8807af30 0x7fbb8807d3f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c005fd0 tx=0x7fbb8c005850 comp rx=0 tx=0).stop 2024-09-17T04:32:23.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:23.548+0000 7fbba0d3a640 1 -- 172.21.15.88:0/6905128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb9c107900 msgr2=0x7fbb9c19db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:23.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:23.548+0000 7fbba0d3a640 1 --2- 172.21.15.88:0/6905128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb9c107900 0x7fbb9c19db60 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fbb84031460 tx=0x7fbb840045e0 comp rx=0 tx=0).stop 2024-09-17T04:32:23.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:23.548+0000 7fbba0d3a640 1 -- 172.21.15.88:0/6905128 shutdown_connections 2024-09-17T04:32:23.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:23.548+0000 7fbba0d3a640 1 --2- 172.21.15.88:0/6905128 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fbb8807af30 0x7fbb8807d3f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:23.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:23.548+0000 7fbba0d3a640 1 --2- 172.21.15.88:0/6905128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb9c107900 0x7fbb9c19db60 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:23.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:23.548+0000 7fbba0d3a640 1 --2- 172.21.15.88:0/6905128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb9c101900 0x7fbb9c19d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:23.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:23.548+0000 7fbba0d3a640 1 -- 172.21.15.88:0/6905128 >> 172.21.15.88:0/6905128 conn(0x7fbb9c0fd600 msgr2=0x7fbb9c0fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:32:23.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:23.548+0000 7fbba0d3a640 1 -- 172.21.15.88:0/6905128 shutdown_connections 2024-09-17T04:32:23.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:23.548+0000 7fbba0d3a640 1 -- 172.21.15.88:0/6905128 wait complete. 2024-09-17T04:32:24.131 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:23 smithi088 ceph-mon[90867]: pgmap v344: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:32:24.131 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:23 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/6905128' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 28, "format": "json"} : dispatch 2024-09-17T04:32:24.158 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 28 2024-09-17T04:32:24.158 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 29 2024-09-17T04:32:24.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:23 smithi134 ceph-mon[76677]: pgmap v344: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:32:24.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:23 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/6905128' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 28, "format": "json"} : dispatch 2024-09-17T04:32:24.408 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:32:24.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:24.864+0000 7f4c014ae640 1 -- 172.21.15.88:0/2875558932 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4bfc1007f0 msgr2=0x7f4bfc100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:24.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:24.864+0000 7f4c014ae640 1 --2- 172.21.15.88:0/2875558932 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4bfc1007f0 0x7f4bfc100c50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4be4009880 tx=0x7f4be402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:32:24.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:24.864+0000 7f4c014ae640 1 -- 172.21.15.88:0/2875558932 shutdown_connections 2024-09-17T04:32:24.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:24.864+0000 7f4c014ae640 1 --2- 172.21.15.88:0/2875558932 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4bfc1007f0 0x7f4bfc100c50 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:24.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:24.864+0000 7f4c014ae640 1 --2- 172.21.15.88:0/2875558932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4bfc1067f0 0x7f4bfc106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:24.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:24.864+0000 7f4c014ae640 1 -- 172.21.15.88:0/2875558932 >> 172.21.15.88:0/2875558932 conn(0x7f4bfc0fc550 msgr2=0x7f4bfc0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:32:24.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:24.864+0000 7f4c014ae640 1 -- 172.21.15.88:0/2875558932 shutdown_connections 2024-09-17T04:32:24.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:24.864+0000 7f4c014ae640 1 -- 172.21.15.88:0/2875558932 wait complete. 2024-09-17T04:32:24.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:24.865+0000 7f4c014ae640 1 Processor -- start 2024-09-17T04:32:24.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:24.865+0000 7f4c014ae640 1 -- start start 2024-09-17T04:32:24.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:24.865+0000 7f4c014ae640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4bfc1007f0 0x7f4bfc1987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:24.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:24.865+0000 7f4c014ae640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4bfc1067f0 0x7f4bfc198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:24.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:24.865+0000 7f4c014ae640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f4bfc10dcc0 con 0x7f4bfc1067f0 2024-09-17T04:32:24.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:24.865+0000 7f4c014ae640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4bfc10db40 con 0x7f4bfc1007f0 2024-09-17T04:32:24.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:24.865+0000 7f4bfa7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4bfc1067f0 0x7f4bfc198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:24.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:24.865+0000 7f4bfa7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4bfc1067f0 0x7f4bfc198d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55370/0 (socket says 172.21.15.88:55370) 2024-09-17T04:32:24.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:24.865+0000 7f4bfa7fc640 1 -- 172.21.15.88:0/1703931647 learned_addr learned my addr 172.21.15.88:0/1703931647 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:32:24.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:24.865+0000 7f4bfaffd640 1 --2- 172.21.15.88:0/1703931647 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4bfc1007f0 0x7f4bfc1987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:24.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:24.866+0000 7f4bfa7fc640 1 -- 172.21.15.88:0/1703931647 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4bfc1007f0 msgr2=0x7f4bfc1987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:24.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:24.866+0000 7f4bfa7fc640 1 --2- 172.21.15.88:0/1703931647 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4bfc1007f0 0x7f4bfc1987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:24.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:24.866+0000 7f4bfa7fc640 1 -- 172.21.15.88:0/1703931647 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bfc199330 con 0x7f4bfc1067f0 2024-09-17T04:32:24.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:24.866+0000 7f4bfa7fc640 1 --2- 172.21.15.88:0/1703931647 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4bfc1067f0 0x7f4bfc198d30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4be4031460 tx=0x7f4be40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:32:24.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:24.866+0000 7f4bf3fff640 1 -- 172.21.15.88:0/1703931647 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4be403f070 con 0x7f4bfc1067f0 2024-09-17T04:32:24.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:24.866+0000 7f4c014ae640 1 -- 172.21.15.88:0/1703931647 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bfc1995c0 con 0x7f4bfc1067f0 2024-09-17T04:32:24.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:24.866+0000 7f4bf3fff640 1 -- 172.21.15.88:0/1703931647 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4be40035f0 con 0x7f4bfc1067f0 2024-09-17T04:32:24.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:24.866+0000 7f4bf3fff640 1 -- 172.21.15.88:0/1703931647 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4be4035030 con 0x7f4bfc1067f0 2024-09-17T04:32:24.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:24.866+0000 7f4c014ae640 1 -- 172.21.15.88:0/1703931647 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bfc1a1b70 con 0x7f4bfc1067f0 2024-09-17T04:32:24.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:24.867+0000 7f4c014ae640 1 -- 172.21.15.88:0/1703931647 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bfc101f30 con 0x7f4bfc1067f0 2024-09-17T04:32:24.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:24.868+0000 7f4bf3fff640 1 -- 172.21.15.88:0/1703931647 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f4be4042070 con 0x7f4bfc1067f0 2024-09-17T04:32:24.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:24.868+0000 7f4bf3fff640 1 --2- 172.21.15.88:0/1703931647 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f4be807af30 0x7f4be807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:24.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:24.868+0000 7f4bf3fff640 1 -- 172.21.15.88:0/1703931647 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f4be40bea20 con 0x7f4bfc1067f0 2024-09-17T04:32:24.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:24.868+0000 7f4bfaffd640 1 --2- 172.21.15.88:0/1703931647 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f4be807af30 0x7f4be807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:24.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:24.869+0000 7f4bfaffd640 1 --2- 172.21.15.88:0/1703931647 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f4be807af30 0x7f4be807d3f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4bf4005fd0 tx=0x7f4bf400b390 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:32:24.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:24.873+0000 7f4bf3fff640 1 -- 172.21.15.88:0/1703931647 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f4be4089f70 con 0x7f4bfc1067f0 2024-09-17T04:32:25.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:25.085+0000 7f4c014ae640 1 -- 172.21.15.88:0/1703931647 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) -- 0x7f4bfc108d60 con 0x7f4bfc1067f0 2024-09-17T04:32:25.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:25.085+0000 7f4bf3fff640 1 -- 172.21.15.88:0/1703931647 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v38) ==== 107+0+4472 (secure 0 0 0) 0x7f4be408ee20 con 0x7f4bfc1067f0 2024-09-17T04:32:25.085 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:32:25.086 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":29,"btime":"2024-09-17T04:27:48:074305+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34318,"name":"cephfs.smithi088.lgavsv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6827/3125957194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":3125957194},{"type":"v1","addr":"172.21.15.88:6827","nonce":3125957194}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":34322,"name":"cephfs.smithi088.giqrgt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6829/2683662376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2683662376},{"type":"v1","addr":"172.21.15.88:6829","nonce":2683662376}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T04:18:10.480573+0000","modified":"2024-09-17T04:27:48.074298+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34223},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34223":{"gid":34223,"name":"cephfs.smithi134.psnynp","rank":0,"incarnation":26,"state":"up:active","state_seq":16,"addr":"172.21.15.134:6827/584624515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":584624515},{"type":"v1","addr":"172.21.15.134:6827","nonce":584624515}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34223,"qdb_cluster":[34223]},"id":1}]} 2024-09-17T04:32:25.086 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 29 2024-09-17T04:32:25.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:25.088+0000 7f4c014ae640 1 -- 172.21.15.88:0/1703931647 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f4be807af30 msgr2=0x7f4be807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:25.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:25.088+0000 7f4c014ae640 1 --2- 172.21.15.88:0/1703931647 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f4be807af30 0x7f4be807d3f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4bf4005fd0 tx=0x7f4bf400b390 comp rx=0 tx=0).stop 2024-09-17T04:32:25.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:25.088+0000 7f4c014ae640 1 -- 172.21.15.88:0/1703931647 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4bfc1067f0 msgr2=0x7f4bfc198d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:25.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:25.088+0000 7f4c014ae640 1 --2- 172.21.15.88:0/1703931647 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4bfc1067f0 0x7f4bfc198d30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4be4031460 tx=0x7f4be40045e0 comp rx=0 tx=0).stop 2024-09-17T04:32:25.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:25.088+0000 7f4c014ae640 1 -- 172.21.15.88:0/1703931647 shutdown_connections 2024-09-17T04:32:25.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:25.088+0000 7f4c014ae640 1 --2- 172.21.15.88:0/1703931647 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f4be807af30 0x7f4be807d3f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:25.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:25.088+0000 7f4c014ae640 1 --2- 172.21.15.88:0/1703931647 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4bfc1067f0 0x7f4bfc198d30 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:25.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:25.088+0000 7f4c014ae640 1 --2- 172.21.15.88:0/1703931647 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4bfc1007f0 0x7f4bfc1987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:25.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:25.088+0000 7f4c014ae640 1 -- 172.21.15.88:0/1703931647 >> 172.21.15.88:0/1703931647 conn(0x7f4bfc0fc550 msgr2=0x7f4bfc0fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:32:25.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:25.088+0000 7f4c014ae640 1 -- 172.21.15.88:0/1703931647 shutdown_connections 2024-09-17T04:32:25.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:25.088+0000 7f4c014ae640 1 -- 172.21.15.88:0/1703931647 wait complete. 2024-09-17T04:32:25.735 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 29 2024-09-17T04:32:25.735 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 30 2024-09-17T04:32:25.984 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:32:26.255 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:25 smithi088 ceph-mon[90867]: pgmap v345: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:32:26.255 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:25 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/1703931647' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 29, "format": "json"} : dispatch 2024-09-17T04:32:26.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:25 smithi134 ceph-mon[76677]: pgmap v345: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:32:26.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:25 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/1703931647' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 29, "format": "json"} : dispatch 2024-09-17T04:32:26.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:26.473+0000 7f8ec82f3640 1 -- 172.21.15.88:0/1137567215 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ec00ffdc0 msgr2=0x7f8ec0100200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:26.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:26.473+0000 7f8ec82f3640 1 --2- 172.21.15.88:0/1137567215 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ec00ffdc0 0x7f8ec0100200 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8eb0009880 tx=0x7f8eb002a530 comp rx=0 tx=0).stop 2024-09-17T04:32:26.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:26.473+0000 7f8ec82f3640 1 -- 172.21.15.88:0/1137567215 shutdown_connections 2024-09-17T04:32:26.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:26.473+0000 7f8ec82f3640 1 --2- 172.21.15.88:0/1137567215 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ec00ffdc0 0x7f8ec0100200 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:26.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:26.473+0000 7f8ec82f3640 1 --2- 172.21.15.88:0/1137567215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ec01068f0 0x7f8ec0106cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:26.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:26.473+0000 7f8ec82f3640 1 -- 172.21.15.88:0/1137567215 >> 172.21.15.88:0/1137567215 conn(0x7f8ec00fbc90 msgr2=0x7f8ec00fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:32:26.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:26.473+0000 7f8ec82f3640 1 -- 172.21.15.88:0/1137567215 shutdown_connections 2024-09-17T04:32:26.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:26.473+0000 7f8ec82f3640 1 -- 172.21.15.88:0/1137567215 wait complete. 2024-09-17T04:32:26.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:26.473+0000 7f8ec82f3640 1 Processor -- start 2024-09-17T04:32:26.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:26.473+0000 7f8ec82f3640 1 -- start start 2024-09-17T04:32:26.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:26.473+0000 7f8ec82f3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ec00ffdc0 0x7f8ec019e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:26.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:26.474+0000 7f8ec82f3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ec01068f0 0x7f8ec019e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:26.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:26.474+0000 7f8ec82f3640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f8ec0115430 con 0x7f8ec00ffdc0 2024-09-17T04:32:26.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:26.474+0000 7f8ec82f3640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8ec01152b0 con 0x7f8ec01068f0 2024-09-17T04:32:26.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:26.474+0000 7f8ec608f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ec00ffdc0 0x7f8ec019e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:26.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:26.474+0000 7f8ec608f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ec00ffdc0 0x7f8ec019e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55390/0 (socket says 172.21.15.88:55390) 2024-09-17T04:32:26.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:26.474+0000 7f8ec608f640 1 -- 172.21.15.88:0/1544780307 learned_addr learned my addr 172.21.15.88:0/1544780307 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:32:26.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:26.474+0000 7f8ec588e640 1 --2- 172.21.15.88:0/1544780307 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ec01068f0 0x7f8ec019e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:26.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:26.474+0000 7f8ec608f640 1 -- 172.21.15.88:0/1544780307 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ec01068f0 msgr2=0x7f8ec019e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:26.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:26.474+0000 7f8ec608f640 1 --2- 172.21.15.88:0/1544780307 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ec01068f0 0x7f8ec019e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:26.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:26.474+0000 7f8ec608f640 1 -- 172.21.15.88:0/1544780307 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ec019ec00 con 0x7f8ec00ffdc0 2024-09-17T04:32:26.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:26.474+0000 7f8ec588e640 1 --2- 172.21.15.88:0/1544780307 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ec01068f0 0x7f8ec019e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:32:26.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:26.474+0000 7f8ec608f640 1 --2- 172.21.15.88:0/1544780307 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ec00ffdc0 0x7f8ec019e010 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc00c8a0 tx=0x7f8ebc00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:32:26.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:26.474+0000 7f8eb77fe640 1 -- 172.21.15.88:0/1544780307 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8ebc0079b0 con 0x7f8ec00ffdc0 2024-09-17T04:32:26.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:26.474+0000 7f8ec82f3640 1 -- 172.21.15.88:0/1544780307 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ec01a29a0 con 0x7f8ec00ffdc0 2024-09-17T04:32:26.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:26.474+0000 7f8eb77fe640 1 -- 172.21.15.88:0/1544780307 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8ebc007b50 con 0x7f8ec00ffdc0 2024-09-17T04:32:26.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:26.474+0000 7f8eb77fe640 1 -- 172.21.15.88:0/1544780307 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8ebc018700 con 0x7f8ec00ffdc0 2024-09-17T04:32:26.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:26.474+0000 7f8ec82f3640 1 -- 172.21.15.88:0/1544780307 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ec01a2f30 con 0x7f8ec00ffdc0 2024-09-17T04:32:26.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:26.475+0000 7f8ec82f3640 1 -- 172.21.15.88:0/1544780307 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ec0100fe0 con 0x7f8ec00ffdc0 2024-09-17T04:32:26.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:26.476+0000 7f8eb77fe640 1 -- 172.21.15.88:0/1544780307 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f8ebc007d00 con 0x7f8ec00ffdc0 2024-09-17T04:32:26.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:26.477+0000 7f8eb77fe640 1 --2- 172.21.15.88:0/1544780307 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f8eac07af30 0x7f8eac07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:26.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:26.477+0000 7f8eb77fe640 1 -- 172.21.15.88:0/1544780307 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f8ebc09e540 con 0x7f8ec00ffdc0 2024-09-17T04:32:26.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:26.477+0000 7f8ec588e640 1 --2- 172.21.15.88:0/1544780307 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f8eac07af30 0x7f8eac07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:26.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:26.477+0000 7f8ec588e640 1 --2- 172.21.15.88:0/1544780307 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f8eac07af30 0x7f8eac07d3f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8eb0006010 tx=0x7f8eb00095f0 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:32:26.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:26.481+0000 7f8eb77fe640 1 -- 172.21.15.88:0/1544780307 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f8ebc014030 con 0x7f8ec00ffdc0 2024-09-17T04:32:26.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:26.692+0000 7f8ec82f3640 1 -- 172.21.15.88:0/1544780307 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) -- 0x7f8ec0102cc0 con 0x7f8ec00ffdc0 2024-09-17T04:32:26.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:26.693+0000 7f8eb77fe640 1 -- 172.21.15.88:0/1544780307 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v38) ==== 107+0+5322 (secure 0 0 0) 0x7f8ebc069bb0 con 0x7f8ec00ffdc0 2024-09-17T04:32:26.693 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:32:26.693 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":30,"btime":"2024-09-17T04:27:51:087595+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34273,"name":"cephfs.smithi134.ktuhce","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6825/3452154372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":3452154372},{"type":"v1","addr":"172.21.15.134:6825","nonce":3452154372}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":34318,"name":"cephfs.smithi088.lgavsv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6827/3125957194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":3125957194},{"type":"v1","addr":"172.21.15.88:6827","nonce":3125957194}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":34322,"name":"cephfs.smithi088.giqrgt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6829/2683662376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2683662376},{"type":"v1","addr":"172.21.15.88:6829","nonce":2683662376}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T04:18:10.480573+0000","modified":"2024-09-17T04:27:48.074298+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34223},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34223":{"gid":34223,"name":"cephfs.smithi134.psnynp","rank":0,"incarnation":26,"state":"up:active","state_seq":16,"addr":"172.21.15.134:6827/584624515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":584624515},{"type":"v1","addr":"172.21.15.134:6827","nonce":584624515}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34223,"qdb_cluster":[34223]},"id":1}]} 2024-09-17T04:32:26.693 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 30 2024-09-17T04:32:26.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:26.695+0000 7f8ec82f3640 1 -- 172.21.15.88:0/1544780307 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f8eac07af30 msgr2=0x7f8eac07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:26.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:26.695+0000 7f8ec82f3640 1 --2- 172.21.15.88:0/1544780307 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f8eac07af30 0x7f8eac07d3f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8eb0006010 tx=0x7f8eb00095f0 comp rx=0 tx=0).stop 2024-09-17T04:32:26.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:26.695+0000 7f8ec82f3640 1 -- 172.21.15.88:0/1544780307 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ec00ffdc0 msgr2=0x7f8ec019e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:26.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:26.695+0000 7f8ec82f3640 1 --2- 172.21.15.88:0/1544780307 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ec00ffdc0 0x7f8ec019e010 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc00c8a0 tx=0x7f8ebc00cd60 comp rx=0 tx=0).stop 2024-09-17T04:32:26.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:26.695+0000 7f8ec82f3640 1 -- 172.21.15.88:0/1544780307 shutdown_connections 2024-09-17T04:32:26.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:26.695+0000 7f8ec82f3640 1 --2- 172.21.15.88:0/1544780307 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f8eac07af30 0x7f8eac07d3f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:26.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:26.695+0000 7f8ec82f3640 1 --2- 172.21.15.88:0/1544780307 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ec01068f0 0x7f8ec019e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:26.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:26.695+0000 7f8ec82f3640 1 --2- 172.21.15.88:0/1544780307 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ec00ffdc0 0x7f8ec019e010 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:26.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:26.695+0000 7f8ec82f3640 1 -- 172.21.15.88:0/1544780307 >> 172.21.15.88:0/1544780307 conn(0x7f8ec00fbc90 msgr2=0x7f8ec00fd460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:32:26.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:26.695+0000 7f8ec82f3640 1 -- 172.21.15.88:0/1544780307 shutdown_connections 2024-09-17T04:32:26.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:26.695+0000 7f8ec82f3640 1 -- 172.21.15.88:0/1544780307 wait complete. 2024-09-17T04:32:27.005 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:26 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:32:27.005 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:26 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/1544780307' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 30, "format": "json"} : dispatch 2024-09-17T04:32:27.323 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 30 2024-09-17T04:32:27.323 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 31 2024-09-17T04:32:27.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:26 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:32:27.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:26 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/1544780307' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 30, "format": "json"} : dispatch 2024-09-17T04:32:27.570 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:32:28.014 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:27 smithi088 ceph-mon[90867]: pgmap v346: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:32:28.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:28.014+0000 7faf8e908640 1 -- 172.21.15.88:0/1809089129 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf88102ac0 msgr2=0x7faf88102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:28.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:28.014+0000 7faf8e908640 1 --2- 172.21.15.88:0/1809089129 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf88102ac0 0x7faf88102ea0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7faf78009880 tx=0x7faf7802a530 comp rx=0 tx=0).stop 2024-09-17T04:32:28.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:28.014+0000 7faf8e908640 1 -- 172.21.15.88:0/1809089129 shutdown_connections 2024-09-17T04:32:28.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:28.014+0000 7faf8e908640 1 --2- 172.21.15.88:0/1809089129 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf881033e0 0x7faf8810b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:28.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:28.014+0000 7faf8e908640 1 --2- 172.21.15.88:0/1809089129 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf88102ac0 0x7faf88102ea0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:28.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:28.014+0000 7faf8e908640 1 -- 172.21.15.88:0/1809089129 >> 172.21.15.88:0/1809089129 conn(0x7faf880fc520 msgr2=0x7faf880fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:32:28.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:28.014+0000 7faf8e908640 1 -- 172.21.15.88:0/1809089129 shutdown_connections 2024-09-17T04:32:28.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:28.015+0000 7faf8e908640 1 -- 172.21.15.88:0/1809089129 wait complete. 2024-09-17T04:32:28.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:28.015+0000 7faf8e908640 1 Processor -- start 2024-09-17T04:32:28.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:28.015+0000 7faf8e908640 1 -- start start 2024-09-17T04:32:28.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:28.015+0000 7faf8e908640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf88102ac0 0x7faf88100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:28.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:28.015+0000 7faf8e908640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf881033e0 0x7faf88100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:28.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:28.015+0000 7faf8e908640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7faf8810edf0 con 0x7faf881033e0 2024-09-17T04:32:28.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:28.015+0000 7faf8e908640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7faf8810ec70 con 0x7faf88102ac0 2024-09-17T04:32:28.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:28.016+0000 7faf877fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf881033e0 0x7faf88100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:28.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:28.016+0000 7faf877fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf881033e0 0x7faf88100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55408/0 (socket says 172.21.15.88:55408) 2024-09-17T04:32:28.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:28.016+0000 7faf877fe640 1 -- 172.21.15.88:0/347989120 learned_addr learned my addr 172.21.15.88:0/347989120 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:32:28.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:28.016+0000 7faf87fff640 1 --2- 172.21.15.88:0/347989120 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf88102ac0 0x7faf88100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:28.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:28.016+0000 7faf877fe640 1 -- 172.21.15.88:0/347989120 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf88102ac0 msgr2=0x7faf88100720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:28.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:28.016+0000 7faf877fe640 1 --2- 172.21.15.88:0/347989120 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf88102ac0 0x7faf88100720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:28.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:28.016+0000 7faf877fe640 1 -- 172.21.15.88:0/347989120 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf881011a0 con 0x7faf881033e0 2024-09-17T04:32:28.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:28.016+0000 7faf877fe640 1 --2- 172.21.15.88:0/347989120 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf881033e0 0x7faf88100c60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7faf7c00d6d0 tx=0x7faf7c00db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:32:28.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:28.016+0000 7faf857fa640 1 -- 172.21.15.88:0/347989120 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faf7c017070 con 0x7faf881033e0 2024-09-17T04:32:28.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:28.016+0000 7faf857fa640 1 -- 172.21.15.88:0/347989120 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faf7c0054e0 con 0x7faf881033e0 2024-09-17T04:32:28.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:28.016+0000 7faf857fa640 1 -- 172.21.15.88:0/347989120 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faf7c004ae0 con 0x7faf881033e0 2024-09-17T04:32:28.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:28.016+0000 7faf8e908640 1 -- 172.21.15.88:0/347989120 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf88101490 con 0x7faf881033e0 2024-09-17T04:32:28.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:28.017+0000 7faf8e908640 1 -- 172.21.15.88:0/347989120 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf881a3e40 con 0x7faf881033e0 2024-09-17T04:32:28.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:28.018+0000 7faf8e908640 1 -- 172.21.15.88:0/347989120 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf8806aa90 con 0x7faf881033e0 2024-09-17T04:32:28.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:28.018+0000 7faf857fa640 1 -- 172.21.15.88:0/347989120 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7faf7c004de0 con 0x7faf881033e0 2024-09-17T04:32:28.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:28.019+0000 7faf857fa640 1 --2- 172.21.15.88:0/347989120 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7faf7007af30 0x7faf7007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:28.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:28.019+0000 7faf857fa640 1 -- 172.21.15.88:0/347989120 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7faf7c09dbf0 con 0x7faf881033e0 2024-09-17T04:32:28.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:28.019+0000 7faf87fff640 1 --2- 172.21.15.88:0/347989120 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7faf7007af30 0x7faf7007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:28.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:28.019+0000 7faf87fff640 1 --2- 172.21.15.88:0/347989120 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7faf7007af30 0x7faf7007d3f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7faf780096c0 tx=0x7faf78031400 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:32:28.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:28.024+0000 7faf857fa640 1 -- 172.21.15.88:0/347989120 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7faf7c069140 con 0x7faf881033e0 2024-09-17T04:32:28.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:28.232+0000 7faf8e908640 1 -- 172.21.15.88:0/347989120 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) -- 0x7faf88101c50 con 0x7faf881033e0 2024-09-17T04:32:28.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:28.233+0000 7faf857fa640 1 -- 172.21.15.88:0/347989120 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v38) ==== 107+0+4454 (secure 0 0 0) 0x7faf7c06dff0 con 0x7faf881033e0 2024-09-17T04:32:28.234 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:32:28.234 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":31,"btime":"2024-09-17T04:28:01:120747+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34273,"name":"cephfs.smithi134.ktuhce","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6825/3452154372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":3452154372},{"type":"v1","addr":"172.21.15.134:6825","nonce":3452154372}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":34318,"name":"cephfs.smithi088.lgavsv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6827/3125957194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":3125957194},{"type":"v1","addr":"172.21.15.88:6827","nonce":3125957194}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":34322,"name":"cephfs.smithi088.giqrgt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6829/2683662376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2683662376},{"type":"v1","addr":"172.21.15.88:6829","nonce":2683662376}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T04:18:10.480573+0000","modified":"2024-09-17T04:28:01.120740+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T04:32:28.234 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 31 2024-09-17T04:32:28.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:28.235+0000 7faf8e908640 1 -- 172.21.15.88:0/347989120 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7faf7007af30 msgr2=0x7faf7007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:28.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:28.235+0000 7faf8e908640 1 --2- 172.21.15.88:0/347989120 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7faf7007af30 0x7faf7007d3f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7faf780096c0 tx=0x7faf78031400 comp rx=0 tx=0).stop 2024-09-17T04:32:28.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:28.235+0000 7faf8e908640 1 -- 172.21.15.88:0/347989120 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf881033e0 msgr2=0x7faf88100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:28.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:28.235+0000 7faf8e908640 1 --2- 172.21.15.88:0/347989120 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf881033e0 0x7faf88100c60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7faf7c00d6d0 tx=0x7faf7c00db90 comp rx=0 tx=0).stop 2024-09-17T04:32:28.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:28.235+0000 7faf8e908640 1 -- 172.21.15.88:0/347989120 shutdown_connections 2024-09-17T04:32:28.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:28.235+0000 7faf8e908640 1 --2- 172.21.15.88:0/347989120 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7faf7007af30 0x7faf7007d3f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:28.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:28.235+0000 7faf8e908640 1 --2- 172.21.15.88:0/347989120 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf881033e0 0x7faf88100c60 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:28.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:28.235+0000 7faf8e908640 1 --2- 172.21.15.88:0/347989120 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf88102ac0 0x7faf88100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:28.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:28.235+0000 7faf8e908640 1 -- 172.21.15.88:0/347989120 >> 172.21.15.88:0/347989120 conn(0x7faf880fc520 msgr2=0x7faf8810af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:32:28.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:28.235+0000 7faf8e908640 1 -- 172.21.15.88:0/347989120 shutdown_connections 2024-09-17T04:32:28.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:28.235+0000 7faf8e908640 1 -- 172.21.15.88:0/347989120 wait complete. 2024-09-17T04:32:28.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:27 smithi134 ceph-mon[76677]: pgmap v346: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:32:28.857 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 31 2024-09-17T04:32:28.857 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 32 2024-09-17T04:32:29.103 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:32:29.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:28 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/347989120' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 31, "format": "json"} : dispatch 2024-09-17T04:32:29.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:28 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/347989120' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 31, "format": "json"} : dispatch 2024-09-17T04:32:29.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:29.579+0000 7f6369eb5640 1 -- 172.21.15.88:0/1774422544 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6364101900 msgr2=0x7f6364101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:29.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:29.579+0000 7f6369eb5640 1 --2- 172.21.15.88:0/1774422544 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6364101900 0x7f6364101d60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6358009880 tx=0x7f635802a4a0 comp rx=0 tx=0).stop 2024-09-17T04:32:29.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:29.579+0000 7f6369eb5640 1 -- 172.21.15.88:0/1774422544 shutdown_connections 2024-09-17T04:32:29.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:29.579+0000 7f6369eb5640 1 --2- 172.21.15.88:0/1774422544 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6364101900 0x7f6364101d60 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:29.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:29.579+0000 7f6369eb5640 1 --2- 172.21.15.88:0/1774422544 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6364107900 0x7f6364107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:29.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:29.579+0000 7f6369eb5640 1 -- 172.21.15.88:0/1774422544 >> 172.21.15.88:0/1774422544 conn(0x7f63640fd5e0 msgr2=0x7f63640ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:32:29.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:29.579+0000 7f6369eb5640 1 -- 172.21.15.88:0/1774422544 shutdown_connections 2024-09-17T04:32:29.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:29.579+0000 7f6369eb5640 1 -- 172.21.15.88:0/1774422544 wait complete. 2024-09-17T04:32:29.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:29.579+0000 7f6369eb5640 1 Processor -- start 2024-09-17T04:32:29.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:29.579+0000 7f6369eb5640 1 -- start start 2024-09-17T04:32:29.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:29.580+0000 7f6369eb5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6364101900 0x7f636419d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:29.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:29.580+0000 7f6369eb5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6364107900 0x7f636419db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:29.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:29.580+0000 7f6369eb5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f636410edb0 con 0x7f6364107900 2024-09-17T04:32:29.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:29.580+0000 7f6369eb5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f636410ec30 con 0x7f6364101900 2024-09-17T04:32:29.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:29.580+0000 7f6362ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6364107900 0x7f636419db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:29.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:29.580+0000 7f6362ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6364107900 0x7f636419db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55426/0 (socket says 172.21.15.88:55426) 2024-09-17T04:32:29.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:29.580+0000 7f6362ffd640 1 -- 172.21.15.88:0/2393082676 learned_addr learned my addr 172.21.15.88:0/2393082676 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:32:29.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:29.580+0000 7f63637fe640 1 --2- 172.21.15.88:0/2393082676 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6364101900 0x7f636419d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:29.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:29.580+0000 7f6362ffd640 1 -- 172.21.15.88:0/2393082676 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6364101900 msgr2=0x7f636419d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:29.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:29.580+0000 7f6362ffd640 1 --2- 172.21.15.88:0/2393082676 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6364101900 0x7f636419d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:29.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:29.580+0000 7f6362ffd640 1 -- 172.21.15.88:0/2393082676 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63641977c0 con 0x7f6364107900 2024-09-17T04:32:29.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:29.580+0000 7f63637fe640 1 --2- 172.21.15.88:0/2393082676 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6364101900 0x7f636419d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:32:29.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:29.580+0000 7f6362ffd640 1 --2- 172.21.15.88:0/2393082676 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6364107900 0x7f636419db80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6358031460 tx=0x7f63580048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:32:29.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:29.580+0000 7f6360ff9640 1 -- 172.21.15.88:0/2393082676 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f635803f070 con 0x7f6364107900 2024-09-17T04:32:29.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:29.580+0000 7f6369eb5640 1 -- 172.21.15.88:0/2393082676 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6364197a50 con 0x7f6364107900 2024-09-17T04:32:29.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:29.580+0000 7f6360ff9640 1 -- 172.21.15.88:0/2393082676 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6358004cf0 con 0x7f6364107900 2024-09-17T04:32:29.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:29.580+0000 7f6360ff9640 1 -- 172.21.15.88:0/2393082676 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6358035030 con 0x7f6364107900 2024-09-17T04:32:29.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:29.580+0000 7f6369eb5640 1 -- 172.21.15.88:0/2393082676 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6364197f80 con 0x7f6364107900 2024-09-17T04:32:29.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:29.581+0000 7f6369eb5640 1 -- 172.21.15.88:0/2393082676 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6364103040 con 0x7f6364107900 2024-09-17T04:32:29.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:29.582+0000 7f6360ff9640 1 -- 172.21.15.88:0/2393082676 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f6358042070 con 0x7f6364107900 2024-09-17T04:32:29.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:29.583+0000 7f6360ff9640 1 --2- 172.21.15.88:0/2393082676 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f634c07af30 0x7f634c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:29.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:29.583+0000 7f6360ff9640 1 -- 172.21.15.88:0/2393082676 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f63580beb70 con 0x7f6364107900 2024-09-17T04:32:29.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:29.583+0000 7f63637fe640 1 --2- 172.21.15.88:0/2393082676 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f634c07af30 0x7f634c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:29.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:29.583+0000 7f63637fe640 1 --2- 172.21.15.88:0/2393082676 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f634c07af30 0x7f634c07d3f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f63540058c0 tx=0x7f6354005ec0 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:32:29.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:29.587+0000 7f6360ff9640 1 -- 172.21.15.88:0/2393082676 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f635808a0c0 con 0x7f6364107900 2024-09-17T04:32:29.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:29.797+0000 7f6369eb5640 1 -- 172.21.15.88:0/2393082676 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) -- 0x7f6364109e90 con 0x7f6364107900 2024-09-17T04:32:29.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:29.798+0000 7f6360ff9640 1 -- 172.21.15.88:0/2393082676 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v38) ==== 107+0+4465 (secure 0 0 0) 0x7f635808ef70 con 0x7f6364107900 2024-09-17T04:32:29.799 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:32:29.799 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":32,"btime":"2024-09-17T04:28:01:128719+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34318,"name":"cephfs.smithi088.lgavsv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6827/3125957194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":3125957194},{"type":"v1","addr":"172.21.15.88:6827","nonce":3125957194}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":34322,"name":"cephfs.smithi088.giqrgt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6829/2683662376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2683662376},{"type":"v1","addr":"172.21.15.88:6829","nonce":2683662376}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T04:18:10.480573+0000","modified":"2024-09-17T04:28:01.128702+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34273":{"gid":34273,"name":"cephfs.smithi134.ktuhce","rank":0,"incarnation":32,"state":"up:replay","state_seq":1,"addr":"172.21.15.134:6825/3452154372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":3452154372},{"type":"v1","addr":"172.21.15.134:6825","nonce":3452154372}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T04:32:29.799 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 32 2024-09-17T04:32:29.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:29.800+0000 7f6369eb5640 1 -- 172.21.15.88:0/2393082676 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f634c07af30 msgr2=0x7f634c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:29.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:29.800+0000 7f6369eb5640 1 --2- 172.21.15.88:0/2393082676 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f634c07af30 0x7f634c07d3f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f63540058c0 tx=0x7f6354005ec0 comp rx=0 tx=0).stop 2024-09-17T04:32:29.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:29.800+0000 7f6369eb5640 1 -- 172.21.15.88:0/2393082676 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6364107900 msgr2=0x7f636419db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:29.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:29.800+0000 7f6369eb5640 1 --2- 172.21.15.88:0/2393082676 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6364107900 0x7f636419db80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6358031460 tx=0x7f63580048f0 comp rx=0 tx=0).stop 2024-09-17T04:32:29.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:29.800+0000 7f6369eb5640 1 -- 172.21.15.88:0/2393082676 shutdown_connections 2024-09-17T04:32:29.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:29.800+0000 7f6369eb5640 1 --2- 172.21.15.88:0/2393082676 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f634c07af30 0x7f634c07d3f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:29.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:29.800+0000 7f6369eb5640 1 --2- 172.21.15.88:0/2393082676 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6364107900 0x7f636419db80 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:29.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:29.800+0000 7f6369eb5640 1 --2- 172.21.15.88:0/2393082676 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6364101900 0x7f636419d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:29.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:29.800+0000 7f6369eb5640 1 -- 172.21.15.88:0/2393082676 >> 172.21.15.88:0/2393082676 conn(0x7f63640fd5e0 msgr2=0x7f63640fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:32:29.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:29.800+0000 7f6369eb5640 1 -- 172.21.15.88:0/2393082676 shutdown_connections 2024-09-17T04:32:29.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:29.800+0000 7f6369eb5640 1 -- 172.21.15.88:0/2393082676 wait complete. 2024-09-17T04:32:30.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:29 smithi088 ceph-mon[90867]: pgmap v347: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:32:30.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:29 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/2393082676' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 32, "format": "json"} : dispatch 2024-09-17T04:32:30.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:29 smithi134 ceph-mon[76677]: pgmap v347: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:32:30.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:29 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/2393082676' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 32, "format": "json"} : dispatch 2024-09-17T04:32:30.457 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 32 2024-09-17T04:32:30.457 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 33 2024-09-17T04:32:30.707 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:32:31.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:31.154+0000 7fc53136e640 1 -- 172.21.15.88:0/2748552828 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc52c100d70 msgr2=0x7fc52c1065c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:31.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:31.154+0000 7fc53136e640 1 --2- 172.21.15.88:0/2748552828 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc52c100d70 0x7fc52c1065c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc514009880 tx=0x7fc51402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:32:31.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:31.154+0000 7fc53136e640 1 -- 172.21.15.88:0/2748552828 shutdown_connections 2024-09-17T04:32:31.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:31.154+0000 7fc53136e640 1 --2- 172.21.15.88:0/2748552828 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc52c100d70 0x7fc52c1065c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:31.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:31.154+0000 7fc53136e640 1 --2- 172.21.15.88:0/2748552828 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc52c1003c0 0x7fc52c1007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:31.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:31.154+0000 7fc53136e640 1 -- 172.21.15.88:0/2748552828 >> 172.21.15.88:0/2748552828 conn(0x7fc52c077150 msgr2=0x7fc52c077560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:32:31.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:31.154+0000 7fc53136e640 1 -- 172.21.15.88:0/2748552828 shutdown_connections 2024-09-17T04:32:31.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:31.154+0000 7fc53136e640 1 -- 172.21.15.88:0/2748552828 wait complete. 2024-09-17T04:32:31.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:31.154+0000 7fc53136e640 1 Processor -- start 2024-09-17T04:32:31.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:31.154+0000 7fc53136e640 1 -- start start 2024-09-17T04:32:31.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:31.154+0000 7fc53136e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc52c1003c0 0x7fc52c19d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:31.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:31.154+0000 7fc53136e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc52c100d70 0x7fc52c19dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:31.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:31.154+0000 7fc53136e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc52c10edc0 con 0x7fc52c1003c0 2024-09-17T04:32:31.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:31.154+0000 7fc53136e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc52c10ec40 con 0x7fc52c100d70 2024-09-17T04:32:31.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:31.155+0000 7fc52affd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc52c1003c0 0x7fc52c19d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:31.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:31.155+0000 7fc52affd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc52c1003c0 0x7fc52c19d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55452/0 (socket says 172.21.15.88:55452) 2024-09-17T04:32:31.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:31.155+0000 7fc52affd640 1 -- 172.21.15.88:0/1893592006 learned_addr learned my addr 172.21.15.88:0/1893592006 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:32:31.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:31.155+0000 7fc523fff640 1 --2- 172.21.15.88:0/1893592006 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc52c100d70 0x7fc52c19dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:31.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:31.155+0000 7fc52affd640 1 -- 172.21.15.88:0/1893592006 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc52c100d70 msgr2=0x7fc52c19dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:31.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:31.155+0000 7fc52affd640 1 --2- 172.21.15.88:0/1893592006 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc52c100d70 0x7fc52c19dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:31.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:31.155+0000 7fc52affd640 1 -- 172.21.15.88:0/1893592006 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc52c197850 con 0x7fc52c1003c0 2024-09-17T04:32:31.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:31.155+0000 7fc52affd640 1 --2- 172.21.15.88:0/1893592006 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc52c1003c0 0x7fc52c19d6d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc51c00d6f0 tx=0x7fc51c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:32:31.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:31.155+0000 7fc528ff9640 1 -- 172.21.15.88:0/1893592006 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc51c017070 con 0x7fc52c1003c0 2024-09-17T04:32:31.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:31.155+0000 7fc528ff9640 1 -- 172.21.15.88:0/1893592006 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc51c00de00 con 0x7fc52c1003c0 2024-09-17T04:32:31.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:31.155+0000 7fc528ff9640 1 -- 172.21.15.88:0/1893592006 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc51c004bb0 con 0x7fc52c1003c0 2024-09-17T04:32:31.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:31.155+0000 7fc53136e640 1 -- 172.21.15.88:0/1893592006 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc52c197b40 con 0x7fc52c1003c0 2024-09-17T04:32:31.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:31.155+0000 7fc53136e640 1 -- 172.21.15.88:0/1893592006 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc52c1980a0 con 0x7fc52c1003c0 2024-09-17T04:32:31.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:31.156+0000 7fc53136e640 1 -- 172.21.15.88:0/1893592006 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc52c069d90 con 0x7fc52c1003c0 2024-09-17T04:32:31.176 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:31.157+0000 7fc528ff9640 1 -- 172.21.15.88:0/1893592006 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fc51c009a30 con 0x7fc52c1003c0 2024-09-17T04:32:31.176 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:31.158+0000 7fc528ff9640 1 --2- 172.21.15.88:0/1893592006 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fc51807af80 0x7fc51807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:31.176 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:31.158+0000 7fc523fff640 1 --2- 172.21.15.88:0/1893592006 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fc51807af80 0x7fc51807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:31.176 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:31.158+0000 7fc528ff9640 1 -- 172.21.15.88:0/1893592006 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fc51c09dc20 con 0x7fc52c1003c0 2024-09-17T04:32:31.176 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:31.158+0000 7fc523fff640 1 --2- 172.21.15.88:0/1893592006 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fc51807af80 0x7fc51807d440 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc514000c00 tx=0x7fc514031400 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:32:31.176 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:31.162+0000 7fc528ff9640 1 -- 172.21.15.88:0/1893592006 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fc51c0691f0 con 0x7fc52c1003c0 2024-09-17T04:32:31.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:31.375+0000 7fc53136e640 1 -- 172.21.15.88:0/1893592006 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) -- 0x7fc52c109ea0 con 0x7fc52c1003c0 2024-09-17T04:32:31.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:31.376+0000 7fc528ff9640 1 -- 172.21.15.88:0/1893592006 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v38) ==== 107+0+5315 (secure 0 0 0) 0x7fc51c06e0a0 con 0x7fc52c1003c0 2024-09-17T04:32:31.377 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:32:31.377 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":33,"btime":"2024-09-17T04:28:10:286472+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34305,"name":"cephfs.smithi134.psnynp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/3085319848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3085319848},{"type":"v1","addr":"172.21.15.134:6827","nonce":3085319848}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":34318,"name":"cephfs.smithi088.lgavsv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6827/3125957194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":3125957194},{"type":"v1","addr":"172.21.15.88:6827","nonce":3125957194}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":34322,"name":"cephfs.smithi088.giqrgt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6829/2683662376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2683662376},{"type":"v1","addr":"172.21.15.88:6829","nonce":2683662376}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T04:18:10.480573+0000","modified":"2024-09-17T04:28:01.128702+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34273":{"gid":34273,"name":"cephfs.smithi134.ktuhce","rank":0,"incarnation":32,"state":"up:replay","state_seq":1,"addr":"172.21.15.134:6825/3452154372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":3452154372},{"type":"v1","addr":"172.21.15.134:6825","nonce":3452154372}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T04:32:31.377 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 33 2024-09-17T04:32:31.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:31.378+0000 7fc53136e640 1 -- 172.21.15.88:0/1893592006 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fc51807af80 msgr2=0x7fc51807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:31.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:31.378+0000 7fc53136e640 1 --2- 172.21.15.88:0/1893592006 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fc51807af80 0x7fc51807d440 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc514000c00 tx=0x7fc514031400 comp rx=0 tx=0).stop 2024-09-17T04:32:31.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:31.378+0000 7fc53136e640 1 -- 172.21.15.88:0/1893592006 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc52c1003c0 msgr2=0x7fc52c19d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:31.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:31.378+0000 7fc53136e640 1 --2- 172.21.15.88:0/1893592006 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc52c1003c0 0x7fc52c19d6d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc51c00d6f0 tx=0x7fc51c00dbb0 comp rx=0 tx=0).stop 2024-09-17T04:32:31.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:31.378+0000 7fc53136e640 1 -- 172.21.15.88:0/1893592006 shutdown_connections 2024-09-17T04:32:31.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:31.378+0000 7fc53136e640 1 --2- 172.21.15.88:0/1893592006 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fc51807af80 0x7fc51807d440 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:31.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:31.378+0000 7fc53136e640 1 --2- 172.21.15.88:0/1893592006 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc52c100d70 0x7fc52c19dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:31.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:31.378+0000 7fc53136e640 1 --2- 172.21.15.88:0/1893592006 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc52c1003c0 0x7fc52c19d6d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:31.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:31.378+0000 7fc53136e640 1 -- 172.21.15.88:0/1893592006 >> 172.21.15.88:0/1893592006 conn(0x7fc52c077150 msgr2=0x7fc52c0fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:32:31.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:31.378+0000 7fc53136e640 1 -- 172.21.15.88:0/1893592006 shutdown_connections 2024-09-17T04:32:31.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:31.378+0000 7fc53136e640 1 -- 172.21.15.88:0/1893592006 wait complete. 2024-09-17T04:32:32.077 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:31 smithi088 ceph-mon[90867]: pgmap v348: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:32:32.078 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:31 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/1893592006' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 33, "format": "json"} : dispatch 2024-09-17T04:32:32.105 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 33 2024-09-17T04:32:32.105 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 34 2024-09-17T04:32:32.354 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:32:32.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:31 smithi134 ceph-mon[76677]: pgmap v348: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:32:32.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:31 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/1893592006' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 33, "format": "json"} : dispatch 2024-09-17T04:32:32.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:32.812+0000 7f95cfbf4640 1 -- 172.21.15.88:0/20684518 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95c8101900 msgr2=0x7f95c8101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:32.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:32.812+0000 7f95cfbf4640 1 --2- 172.21.15.88:0/20684518 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95c8101900 0x7f95c8101d60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f95b8009880 tx=0x7f95b802a4a0 comp rx=0 tx=0).stop 2024-09-17T04:32:32.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:32.812+0000 7f95cfbf4640 1 -- 172.21.15.88:0/20684518 shutdown_connections 2024-09-17T04:32:32.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:32.812+0000 7f95cfbf4640 1 --2- 172.21.15.88:0/20684518 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95c8101900 0x7f95c8101d60 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:32.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:32.812+0000 7f95cfbf4640 1 --2- 172.21.15.88:0/20684518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95c8107900 0x7f95c8107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:32.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:32.812+0000 7f95cfbf4640 1 -- 172.21.15.88:0/20684518 >> 172.21.15.88:0/20684518 conn(0x7f95c80fd600 msgr2=0x7f95c80ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:32:32.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:32.812+0000 7f95cfbf4640 1 -- 172.21.15.88:0/20684518 shutdown_connections 2024-09-17T04:32:32.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:32.812+0000 7f95cfbf4640 1 -- 172.21.15.88:0/20684518 wait complete. 2024-09-17T04:32:32.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:32.812+0000 7f95cfbf4640 1 Processor -- start 2024-09-17T04:32:32.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:32.812+0000 7f95cfbf4640 1 -- start start 2024-09-17T04:32:32.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:32.813+0000 7f95cfbf4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95c8101900 0x7f95c819d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:32.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:32.813+0000 7f95cfbf4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95c8107900 0x7f95c819db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:32.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:32.813+0000 7f95cfbf4640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f95c810edb0 con 0x7f95c8101900 2024-09-17T04:32:32.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:32.813+0000 7f95cfbf4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f95c810ec30 con 0x7f95c8107900 2024-09-17T04:32:32.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:32.813+0000 7f95cd990640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95c8101900 0x7f95c819d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:32.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:32.813+0000 7f95cd990640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95c8101900 0x7f95c819d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51560/0 (socket says 172.21.15.88:51560) 2024-09-17T04:32:32.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:32.813+0000 7f95cd990640 1 -- 172.21.15.88:0/283969589 learned_addr learned my addr 172.21.15.88:0/283969589 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:32:32.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:32.813+0000 7f95cd18f640 1 --2- 172.21.15.88:0/283969589 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95c8107900 0x7f95c819db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:32.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:32.813+0000 7f95cd990640 1 -- 172.21.15.88:0/283969589 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95c8107900 msgr2=0x7f95c819db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:32.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:32.813+0000 7f95cd990640 1 --2- 172.21.15.88:0/283969589 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95c8107900 0x7f95c819db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:32.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:32.813+0000 7f95cd990640 1 -- 172.21.15.88:0/283969589 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95c81977d0 con 0x7f95c8101900 2024-09-17T04:32:32.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:32.813+0000 7f95cd990640 1 --2- 172.21.15.88:0/283969589 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95c8101900 0x7f95c819d650 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f95c400d8d0 tx=0x7f95c400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:32:32.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:32.813+0000 7f95beffd640 1 -- 172.21.15.88:0/283969589 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f95c4017030 con 0x7f95c8101900 2024-09-17T04:32:32.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:32.813+0000 7f95cfbf4640 1 -- 172.21.15.88:0/283969589 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95c8197ac0 con 0x7f95c8101900 2024-09-17T04:32:32.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:32.813+0000 7f95beffd640 1 -- 172.21.15.88:0/283969589 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f95c4004020 con 0x7f95c8101900 2024-09-17T04:32:32.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:32.813+0000 7f95beffd640 1 -- 172.21.15.88:0/283969589 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f95c40047a0 con 0x7f95c8101900 2024-09-17T04:32:32.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:32.813+0000 7f95cfbf4640 1 -- 172.21.15.88:0/283969589 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95c8198020 con 0x7f95c8101900 2024-09-17T04:32:32.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:32.815+0000 7f95cfbf4640 1 -- 172.21.15.88:0/283969589 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95c8103040 con 0x7f95c8101900 2024-09-17T04:32:32.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:32.815+0000 7f95beffd640 1 -- 172.21.15.88:0/283969589 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f95c40041d0 con 0x7f95c8101900 2024-09-17T04:32:32.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:32.816+0000 7f95beffd640 1 --2- 172.21.15.88:0/283969589 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f95b407af30 0x7f95b407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:32.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:32.816+0000 7f95beffd640 1 -- 172.21.15.88:0/283969589 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f95c4018070 con 0x7f95c8101900 2024-09-17T04:32:32.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:32.816+0000 7f95cd18f640 1 --2- 172.21.15.88:0/283969589 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f95b407af30 0x7f95b407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:32.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:32.816+0000 7f95cd18f640 1 --2- 172.21.15.88:0/283969589 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f95b407af30 0x7f95b407d3f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f95c8198b20 tx=0x7f95b8031400 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:32:32.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:32.820+0000 7f95beffd640 1 -- 172.21.15.88:0/283969589 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f95c40a3020 con 0x7f95c8101900 2024-09-17T04:32:33.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:33.032+0000 7f95cfbf4640 1 -- 172.21.15.88:0/283969589 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) -- 0x7f95c8109e90 con 0x7f95c8101900 2024-09-17T04:32:33.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:33.033+0000 7f95beffd640 1 -- 172.21.15.88:0/283969589 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v38) ==== 107+0+5318 (secure 0 0 0) 0x7f95c4069350 con 0x7f95c8101900 2024-09-17T04:32:33.034 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:32:33.034 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":34,"btime":"2024-09-17T04:28:11:296552+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34305,"name":"cephfs.smithi134.psnynp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/3085319848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3085319848},{"type":"v1","addr":"172.21.15.134:6827","nonce":3085319848}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":34318,"name":"cephfs.smithi088.lgavsv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6827/3125957194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":3125957194},{"type":"v1","addr":"172.21.15.88:6827","nonce":3125957194}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":34322,"name":"cephfs.smithi088.giqrgt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6829/2683662376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2683662376},{"type":"v1","addr":"172.21.15.88:6829","nonce":2683662376}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T04:18:10.480573+0000","modified":"2024-09-17T04:28:10.368850+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34273":{"gid":34273,"name":"cephfs.smithi134.ktuhce","rank":0,"incarnation":32,"state":"up:reconnect","state_seq":6,"addr":"172.21.15.134:6825/3452154372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":3452154372},{"type":"v1","addr":"172.21.15.134:6825","nonce":3452154372}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T04:32:33.034 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 34 2024-09-17T04:32:33.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:33.035+0000 7f95cfbf4640 1 -- 172.21.15.88:0/283969589 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f95b407af30 msgr2=0x7f95b407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:33.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:33.035+0000 7f95cfbf4640 1 --2- 172.21.15.88:0/283969589 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f95b407af30 0x7f95b407d3f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f95c8198b20 tx=0x7f95b8031400 comp rx=0 tx=0).stop 2024-09-17T04:32:33.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:33.035+0000 7f95cfbf4640 1 -- 172.21.15.88:0/283969589 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95c8101900 msgr2=0x7f95c819d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:33.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:33.035+0000 7f95cfbf4640 1 --2- 172.21.15.88:0/283969589 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95c8101900 0x7f95c819d650 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f95c400d8d0 tx=0x7f95c400dd90 comp rx=0 tx=0).stop 2024-09-17T04:32:33.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:33.035+0000 7f95cfbf4640 1 -- 172.21.15.88:0/283969589 shutdown_connections 2024-09-17T04:32:33.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:33.035+0000 7f95cfbf4640 1 --2- 172.21.15.88:0/283969589 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f95b407af30 0x7f95b407d3f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:33.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:33.035+0000 7f95cfbf4640 1 --2- 172.21.15.88:0/283969589 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95c8107900 0x7f95c819db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:33.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:33.035+0000 7f95cfbf4640 1 --2- 172.21.15.88:0/283969589 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95c8101900 0x7f95c819d650 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:33.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:33.035+0000 7f95cfbf4640 1 -- 172.21.15.88:0/283969589 >> 172.21.15.88:0/283969589 conn(0x7f95c80fd600 msgr2=0x7f95c80fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:32:33.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:33.035+0000 7f95cfbf4640 1 -- 172.21.15.88:0/283969589 shutdown_connections 2024-09-17T04:32:33.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:33.035+0000 7f95cfbf4640 1 -- 172.21.15.88:0/283969589 wait complete. 2024-09-17T04:32:33.804 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 34 2024-09-17T04:32:33.805 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 35 2024-09-17T04:32:34.052 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:32:34.203 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:33 smithi088 ceph-mon[90867]: pgmap v349: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:32:34.203 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:33 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/283969589' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 34, "format": "json"} : dispatch 2024-09-17T04:32:34.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:33 smithi134 ceph-mon[76677]: pgmap v349: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:32:34.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:33 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/283969589' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 34, "format": "json"} : dispatch 2024-09-17T04:32:34.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:34.526+0000 7fa1b8296640 1 -- 172.21.15.88:0/1306192079 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1b01067f0 msgr2=0x7fa1b0106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:34.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:34.526+0000 7fa1b8296640 1 --2- 172.21.15.88:0/1306192079 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1b01067f0 0x7fa1b0106bd0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa1a0009880 tx=0x7fa1a002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:32:34.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:34.526+0000 7fa1b8296640 1 -- 172.21.15.88:0/1306192079 shutdown_connections 2024-09-17T04:32:34.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:34.526+0000 7fa1b8296640 1 --2- 172.21.15.88:0/1306192079 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1b01007f0 0x7fa1b0100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:34.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:34.526+0000 7fa1b8296640 1 --2- 172.21.15.88:0/1306192079 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1b01067f0 0x7fa1b0106bd0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:34.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:34.526+0000 7fa1b8296640 1 -- 172.21.15.88:0/1306192079 >> 172.21.15.88:0/1306192079 conn(0x7fa1b00fc550 msgr2=0x7fa1b00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:32:34.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:34.526+0000 7fa1b8296640 1 -- 172.21.15.88:0/1306192079 shutdown_connections 2024-09-17T04:32:34.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:34.526+0000 7fa1b8296640 1 -- 172.21.15.88:0/1306192079 wait complete. 2024-09-17T04:32:34.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:34.527+0000 7fa1b8296640 1 Processor -- start 2024-09-17T04:32:34.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:34.527+0000 7fa1b8296640 1 -- start start 2024-09-17T04:32:34.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:34.527+0000 7fa1b8296640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1b01007f0 0x7fa1b019c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:34.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:34.527+0000 7fa1b8296640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1b01067f0 0x7fa1b019cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:34.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:34.527+0000 7fa1b8296640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa1b010dcc0 con 0x7fa1b01007f0 2024-09-17T04:32:34.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:34.527+0000 7fa1b8296640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa1b010db40 con 0x7fa1b01067f0 2024-09-17T04:32:34.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:34.527+0000 7fa1b6032640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1b01007f0 0x7fa1b019c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:34.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:34.527+0000 7fa1b6032640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1b01007f0 0x7fa1b019c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51570/0 (socket says 172.21.15.88:51570) 2024-09-17T04:32:34.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:34.527+0000 7fa1b6032640 1 -- 172.21.15.88:0/4130402799 learned_addr learned my addr 172.21.15.88:0/4130402799 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:32:34.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:34.528+0000 7fa1b5831640 1 --2- 172.21.15.88:0/4130402799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1b01067f0 0x7fa1b019cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:34.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:34.528+0000 7fa1b6032640 1 -- 172.21.15.88:0/4130402799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1b01067f0 msgr2=0x7fa1b019cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:34.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:34.528+0000 7fa1b6032640 1 --2- 172.21.15.88:0/4130402799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1b01067f0 0x7fa1b019cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:34.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:34.528+0000 7fa1b6032640 1 -- 172.21.15.88:0/4130402799 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1b01966d0 con 0x7fa1b01007f0 2024-09-17T04:32:34.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:34.528+0000 7fa1b6032640 1 --2- 172.21.15.88:0/4130402799 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1b01007f0 0x7fa1b019c600 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa1a0031460 tx=0x7fa1a00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:32:34.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:34.528+0000 7fa1a77fe640 1 -- 172.21.15.88:0/4130402799 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa1a003f070 con 0x7fa1b01007f0 2024-09-17T04:32:34.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:34.528+0000 7fa1a77fe640 1 -- 172.21.15.88:0/4130402799 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa1a00035f0 con 0x7fa1b01007f0 2024-09-17T04:32:34.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:34.528+0000 7fa1b8296640 1 -- 172.21.15.88:0/4130402799 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1b0196960 con 0x7fa1b01007f0 2024-09-17T04:32:34.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:34.528+0000 7fa1a77fe640 1 -- 172.21.15.88:0/4130402799 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa1a0035030 con 0x7fa1b01007f0 2024-09-17T04:32:34.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:34.528+0000 7fa1b8296640 1 -- 172.21.15.88:0/4130402799 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1b0196e60 con 0x7fa1b01007f0 2024-09-17T04:32:34.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:34.529+0000 7fa1b8296640 1 -- 172.21.15.88:0/4130402799 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1b0101f30 con 0x7fa1b01007f0 2024-09-17T04:32:34.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:34.531+0000 7fa1a77fe640 1 -- 172.21.15.88:0/4130402799 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fa1a0042070 con 0x7fa1b01007f0 2024-09-17T04:32:34.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:34.531+0000 7fa1a77fe640 1 --2- 172.21.15.88:0/4130402799 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fa19c07af30 0x7fa19c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:34.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:34.531+0000 7fa1a77fe640 1 -- 172.21.15.88:0/4130402799 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fa1a00bea60 con 0x7fa1b01007f0 2024-09-17T04:32:34.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:34.531+0000 7fa1b5831640 1 --2- 172.21.15.88:0/4130402799 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fa19c07af30 0x7fa19c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:34.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:34.532+0000 7fa1b5831640 1 --2- 172.21.15.88:0/4130402799 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fa19c07af30 0x7fa19c07d3f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac005fd0 tx=0x7fa1ac005850 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:32:34.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:34.536+0000 7fa1a77fe640 1 -- 172.21.15.88:0/4130402799 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fa1a0089fb0 con 0x7fa1b01007f0 2024-09-17T04:32:34.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:34.746+0000 7fa1b8296640 1 -- 172.21.15.88:0/4130402799 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) -- 0x7fa1b0108d60 con 0x7fa1b01007f0 2024-09-17T04:32:34.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:34.746+0000 7fa1a77fe640 1 -- 172.21.15.88:0/4130402799 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v38) ==== 107+0+5315 (secure 0 0 0) 0x7fa1a008ee60 con 0x7fa1b01007f0 2024-09-17T04:32:34.747 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:32:34.747 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":35,"btime":"2024-09-17T04:28:12:303131+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34305,"name":"cephfs.smithi134.psnynp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/3085319848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3085319848},{"type":"v1","addr":"172.21.15.134:6827","nonce":3085319848}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":34318,"name":"cephfs.smithi088.lgavsv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6827/3125957194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":3125957194},{"type":"v1","addr":"172.21.15.88:6827","nonce":3125957194}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":34322,"name":"cephfs.smithi088.giqrgt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6829/2683662376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2683662376},{"type":"v1","addr":"172.21.15.88:6829","nonce":2683662376}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T04:18:10.480573+0000","modified":"2024-09-17T04:28:11.310811+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34273":{"gid":34273,"name":"cephfs.smithi134.ktuhce","rank":0,"incarnation":32,"state":"up:rejoin","state_seq":7,"addr":"172.21.15.134:6825/3452154372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":3452154372},{"type":"v1","addr":"172.21.15.134:6825","nonce":3452154372}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T04:32:34.748 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 35 2024-09-17T04:32:34.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:34.749+0000 7fa1b8296640 1 -- 172.21.15.88:0/4130402799 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fa19c07af30 msgr2=0x7fa19c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:34.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:34.749+0000 7fa1b8296640 1 --2- 172.21.15.88:0/4130402799 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fa19c07af30 0x7fa19c07d3f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac005fd0 tx=0x7fa1ac005850 comp rx=0 tx=0).stop 2024-09-17T04:32:34.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:34.749+0000 7fa1b8296640 1 -- 172.21.15.88:0/4130402799 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1b01007f0 msgr2=0x7fa1b019c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:34.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:34.749+0000 7fa1b8296640 1 --2- 172.21.15.88:0/4130402799 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1b01007f0 0x7fa1b019c600 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa1a0031460 tx=0x7fa1a00045e0 comp rx=0 tx=0).stop 2024-09-17T04:32:34.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:34.749+0000 7fa1b8296640 1 -- 172.21.15.88:0/4130402799 shutdown_connections 2024-09-17T04:32:34.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:34.749+0000 7fa1b8296640 1 --2- 172.21.15.88:0/4130402799 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7fa19c07af30 0x7fa19c07d3f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:34.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:34.749+0000 7fa1b8296640 1 --2- 172.21.15.88:0/4130402799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1b01067f0 0x7fa1b019cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:34.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:34.749+0000 7fa1b8296640 1 --2- 172.21.15.88:0/4130402799 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1b01007f0 0x7fa1b019c600 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:34.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:34.749+0000 7fa1b8296640 1 -- 172.21.15.88:0/4130402799 >> 172.21.15.88:0/4130402799 conn(0x7fa1b00fc550 msgr2=0x7fa1b00fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:32:34.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:34.749+0000 7fa1b8296640 1 -- 172.21.15.88:0/4130402799 shutdown_connections 2024-09-17T04:32:34.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:34.749+0000 7fa1b8296640 1 -- 172.21.15.88:0/4130402799 wait complete. 2024-09-17T04:32:35.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:34 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/4130402799' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 35, "format": "json"} : dispatch 2024-09-17T04:32:35.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:34 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/4130402799' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 35, "format": "json"} : dispatch 2024-09-17T04:32:35.441 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 35 2024-09-17T04:32:35.441 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 36 2024-09-17T04:32:35.691 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:32:36.063 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:35 smithi088 ceph-mon[90867]: pgmap v350: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:32:36.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:36.141+0000 7efe68f0c640 1 -- 172.21.15.88:0/2166762299 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe641033e0 msgr2=0x7efe6410b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:36.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:36.141+0000 7efe68f0c640 1 --2- 172.21.15.88:0/2166762299 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe641033e0 0x7efe6410b8d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7efe58009880 tx=0x7efe5802a530 comp rx=0 tx=0).stop 2024-09-17T04:32:36.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:36.141+0000 7efe68f0c640 1 -- 172.21.15.88:0/2166762299 shutdown_connections 2024-09-17T04:32:36.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:36.141+0000 7efe68f0c640 1 --2- 172.21.15.88:0/2166762299 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe641033e0 0x7efe6410b8d0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:36.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:36.141+0000 7efe68f0c640 1 --2- 172.21.15.88:0/2166762299 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe64102ac0 0x7efe64102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:36.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:36.141+0000 7efe68f0c640 1 -- 172.21.15.88:0/2166762299 >> 172.21.15.88:0/2166762299 conn(0x7efe640fc520 msgr2=0x7efe640fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:32:36.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:36.142+0000 7efe68f0c640 1 -- 172.21.15.88:0/2166762299 shutdown_connections 2024-09-17T04:32:36.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:36.142+0000 7efe68f0c640 1 -- 172.21.15.88:0/2166762299 wait complete. 2024-09-17T04:32:36.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:36.142+0000 7efe68f0c640 1 Processor -- start 2024-09-17T04:32:36.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:36.142+0000 7efe68f0c640 1 -- start start 2024-09-17T04:32:36.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:36.143+0000 7efe68f0c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe64102ac0 0x7efe64100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:36.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:36.143+0000 7efe68f0c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe641033e0 0x7efe64100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:36.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:36.143+0000 7efe68f0c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7efe6410edf0 con 0x7efe641033e0 2024-09-17T04:32:36.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:36.143+0000 7efe68f0c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7efe6410ec70 con 0x7efe64102ac0 2024-09-17T04:32:36.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:36.143+0000 7efe61d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe641033e0 0x7efe64100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:36.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:36.143+0000 7efe61d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe641033e0 0x7efe64100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51588/0 (socket says 172.21.15.88:51588) 2024-09-17T04:32:36.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:36.143+0000 7efe61d9b640 1 -- 172.21.15.88:0/1073511404 learned_addr learned my addr 172.21.15.88:0/1073511404 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:32:36.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:36.143+0000 7efe6259c640 1 --2- 172.21.15.88:0/1073511404 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe64102ac0 0x7efe64100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:36.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:36.143+0000 7efe61d9b640 1 -- 172.21.15.88:0/1073511404 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe64102ac0 msgr2=0x7efe64100720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:36.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:36.143+0000 7efe61d9b640 1 --2- 172.21.15.88:0/1073511404 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe64102ac0 0x7efe64100720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:36.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:36.143+0000 7efe61d9b640 1 -- 172.21.15.88:0/1073511404 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe641011a0 con 0x7efe641033e0 2024-09-17T04:32:36.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:36.143+0000 7efe61d9b640 1 --2- 172.21.15.88:0/1073511404 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe641033e0 0x7efe64100c60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7efe58031460 tx=0x7efe58004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:32:36.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:36.143+0000 7efe537fe640 1 -- 172.21.15.88:0/1073511404 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efe5803f070 con 0x7efe641033e0 2024-09-17T04:32:36.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:36.143+0000 7efe68f0c640 1 -- 172.21.15.88:0/1073511404 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe64101430 con 0x7efe641033e0 2024-09-17T04:32:36.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:36.143+0000 7efe537fe640 1 -- 172.21.15.88:0/1073511404 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efe580035f0 con 0x7efe641033e0 2024-09-17T04:32:36.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:36.143+0000 7efe537fe640 1 -- 172.21.15.88:0/1073511404 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efe58035030 con 0x7efe641033e0 2024-09-17T04:32:36.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:36.143+0000 7efe68f0c640 1 -- 172.21.15.88:0/1073511404 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe641a3de0 con 0x7efe641033e0 2024-09-17T04:32:36.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:36.144+0000 7efe68f0c640 1 -- 172.21.15.88:0/1073511404 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe6406aa90 con 0x7efe641033e0 2024-09-17T04:32:36.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:36.145+0000 7efe537fe640 1 -- 172.21.15.88:0/1073511404 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7efe58042070 con 0x7efe641033e0 2024-09-17T04:32:36.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:36.145+0000 7efe537fe640 1 --2- 172.21.15.88:0/1073511404 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7efe4c07af80 0x7efe4c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:36.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:36.146+0000 7efe537fe640 1 -- 172.21.15.88:0/1073511404 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7efe580be990 con 0x7efe641033e0 2024-09-17T04:32:36.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:36.146+0000 7efe6259c640 1 --2- 172.21.15.88:0/1073511404 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7efe4c07af80 0x7efe4c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:36.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:36.146+0000 7efe6259c640 1 --2- 172.21.15.88:0/1073511404 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7efe4c07af80 0x7efe4c07d440 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efe54005fd0 tx=0x7efe54005850 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:32:36.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:36.150+0000 7efe537fe640 1 -- 172.21.15.88:0/1073511404 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7efe58089f60 con 0x7efe641033e0 2024-09-17T04:32:36.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:36.361+0000 7efe68f0c640 1 -- 172.21.15.88:0/1073511404 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 36, "format": "json"} v 0) -- 0x7efe64105f60 con 0x7efe641033e0 2024-09-17T04:32:36.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:36.362+0000 7efe537fe640 1 -- 172.21.15.88:0/1073511404 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 36, "format": "json"}]=0 dumped fsmap epoch 36 v38) ==== 107+0+5324 (secure 0 0 0) 0x7efe5808ee10 con 0x7efe641033e0 2024-09-17T04:32:36.363 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:32:36.363 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":36,"btime":"2024-09-17T04:28:13:309897+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34305,"name":"cephfs.smithi134.psnynp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/3085319848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3085319848},{"type":"v1","addr":"172.21.15.134:6827","nonce":3085319848}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":34318,"name":"cephfs.smithi088.lgavsv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6827/3125957194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":3125957194},{"type":"v1","addr":"172.21.15.88:6827","nonce":3125957194}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":34322,"name":"cephfs.smithi088.giqrgt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6829/2683662376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2683662376},{"type":"v1","addr":"172.21.15.88:6829","nonce":2683662376}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T04:18:10.480573+0000","modified":"2024-09-17T04:28:13.309887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34273":{"gid":34273,"name":"cephfs.smithi134.ktuhce","rank":0,"incarnation":32,"state":"up:active","state_seq":8,"addr":"172.21.15.134:6825/3452154372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":3452154372},{"type":"v1","addr":"172.21.15.134:6825","nonce":3452154372}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34273,"qdb_cluster":[34273]},"id":1}]} 2024-09-17T04:32:36.363 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 36 2024-09-17T04:32:36.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:36.365+0000 7efe68f0c640 1 -- 172.21.15.88:0/1073511404 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7efe4c07af80 msgr2=0x7efe4c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:36.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:36.365+0000 7efe68f0c640 1 --2- 172.21.15.88:0/1073511404 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7efe4c07af80 0x7efe4c07d440 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efe54005fd0 tx=0x7efe54005850 comp rx=0 tx=0).stop 2024-09-17T04:32:36.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:36.365+0000 7efe68f0c640 1 -- 172.21.15.88:0/1073511404 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe641033e0 msgr2=0x7efe64100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:36.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:36.365+0000 7efe68f0c640 1 --2- 172.21.15.88:0/1073511404 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe641033e0 0x7efe64100c60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7efe58031460 tx=0x7efe58004530 comp rx=0 tx=0).stop 2024-09-17T04:32:36.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:36.365+0000 7efe68f0c640 1 -- 172.21.15.88:0/1073511404 shutdown_connections 2024-09-17T04:32:36.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:36.365+0000 7efe68f0c640 1 --2- 172.21.15.88:0/1073511404 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7efe4c07af80 0x7efe4c07d440 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:36.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:36.365+0000 7efe68f0c640 1 --2- 172.21.15.88:0/1073511404 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe641033e0 0x7efe64100c60 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:36.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:36.365+0000 7efe68f0c640 1 --2- 172.21.15.88:0/1073511404 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe64102ac0 0x7efe64100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:36.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:36.365+0000 7efe68f0c640 1 -- 172.21.15.88:0/1073511404 >> 172.21.15.88:0/1073511404 conn(0x7efe640fc520 msgr2=0x7efe64108f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:32:36.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:36.365+0000 7efe68f0c640 1 -- 172.21.15.88:0/1073511404 shutdown_connections 2024-09-17T04:32:36.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:36.365+0000 7efe68f0c640 1 -- 172.21.15.88:0/1073511404 wait complete. 2024-09-17T04:32:36.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:35 smithi134 ceph-mon[76677]: pgmap v350: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:32:36.973 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 36 2024-09-17T04:32:36.974 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 37 2024-09-17T04:32:37.226 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:32:37.346 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:36 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/1073511404' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 36, "format": "json"} : dispatch 2024-09-17T04:32:37.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:36 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/1073511404' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 36, "format": "json"} : dispatch 2024-09-17T04:32:37.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:37.692+0000 7faf086be640 1 -- 172.21.15.88:0/1096623999 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf00100330 msgr2=0x7faf00100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:37.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:37.692+0000 7faf086be640 1 --2- 172.21.15.88:0/1096623999 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf00100330 0x7faf00100710 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7faefc009880 tx=0x7faefc02a4a0 comp rx=0 tx=0).stop 2024-09-17T04:32:37.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:37.692+0000 7faf086be640 1 -- 172.21.15.88:0/1096623999 shutdown_connections 2024-09-17T04:32:37.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:37.692+0000 7faf086be640 1 --2- 172.21.15.88:0/1096623999 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf00100ce0 0x7faf001065a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:37.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:37.692+0000 7faf086be640 1 --2- 172.21.15.88:0/1096623999 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf00100330 0x7faf00100710 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:37.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:37.692+0000 7faf086be640 1 -- 172.21.15.88:0/1096623999 >> 172.21.15.88:0/1096623999 conn(0x7faf00077270 msgr2=0x7faf00077680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:32:37.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:37.692+0000 7faf086be640 1 -- 172.21.15.88:0/1096623999 shutdown_connections 2024-09-17T04:32:37.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:37.692+0000 7faf086be640 1 -- 172.21.15.88:0/1096623999 wait complete. 2024-09-17T04:32:37.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:37.693+0000 7faf086be640 1 Processor -- start 2024-09-17T04:32:37.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:37.693+0000 7faf086be640 1 -- start start 2024-09-17T04:32:37.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:37.693+0000 7faf086be640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf00100330 0x7faf001943d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:37.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:37.693+0000 7faf086be640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf00100ce0 0x7faf00194910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:37.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:37.693+0000 7faf086be640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7faf0010ee10 con 0x7faf00100ce0 2024-09-17T04:32:37.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:37.693+0000 7faf086be640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7faf0010ec90 con 0x7faf00100330 2024-09-17T04:32:37.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:37.693+0000 7faf05c59640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf00100ce0 0x7faf00194910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:37.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:37.693+0000 7faf05c59640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf00100ce0 0x7faf00194910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51612/0 (socket says 172.21.15.88:51612) 2024-09-17T04:32:37.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:37.693+0000 7faf05c59640 1 -- 172.21.15.88:0/1770352950 learned_addr learned my addr 172.21.15.88:0/1770352950 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:32:37.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:37.693+0000 7faf0645a640 1 --2- 172.21.15.88:0/1770352950 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf00100330 0x7faf001943d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:37.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:37.693+0000 7faf05c59640 1 -- 172.21.15.88:0/1770352950 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf00100330 msgr2=0x7faf001943d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:37.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:37.693+0000 7faf05c59640 1 --2- 172.21.15.88:0/1770352950 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf00100330 0x7faf001943d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:37.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:37.693+0000 7faf05c59640 1 -- 172.21.15.88:0/1770352950 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf00194e50 con 0x7faf00100ce0 2024-09-17T04:32:37.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:37.694+0000 7faf05c59640 1 --2- 172.21.15.88:0/1770352950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf00100ce0 0x7faf00194910 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7faef000c8f0 tx=0x7faef000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:32:37.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:37.694+0000 7faef77fe640 1 -- 172.21.15.88:0/1770352950 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faef00079b0 con 0x7faf00100ce0 2024-09-17T04:32:37.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:37.694+0000 7faef77fe640 1 -- 172.21.15.88:0/1770352950 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faef0007b50 con 0x7faf00100ce0 2024-09-17T04:32:37.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:37.694+0000 7faf086be640 1 -- 172.21.15.88:0/1770352950 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf00195140 con 0x7faf00100ce0 2024-09-17T04:32:37.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:37.694+0000 7faef77fe640 1 -- 172.21.15.88:0/1770352950 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faef0018630 con 0x7faf00100ce0 2024-09-17T04:32:37.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:37.694+0000 7faf086be640 1 -- 172.21.15.88:0/1770352950 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf001a83e0 con 0x7faf00100ce0 2024-09-17T04:32:37.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:37.695+0000 7faf086be640 1 -- 172.21.15.88:0/1770352950 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf00069e00 con 0x7faf00100ce0 2024-09-17T04:32:37.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:37.696+0000 7faef77fe640 1 -- 172.21.15.88:0/1770352950 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7faef000f9a0 con 0x7faf00100ce0 2024-09-17T04:32:37.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:37.696+0000 7faef77fe640 1 --2- 172.21.15.88:0/1770352950 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7faeec07af30 0x7faeec07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:37.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:37.696+0000 7faef77fe640 1 -- 172.21.15.88:0/1770352950 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7faef009e310 con 0x7faf00100ce0 2024-09-17T04:32:37.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:37.696+0000 7faf0645a640 1 --2- 172.21.15.88:0/1770352950 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7faeec07af30 0x7faeec07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:37.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:37.697+0000 7faf0645a640 1 --2- 172.21.15.88:0/1770352950 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7faeec07af30 0x7faeec07d3f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7faefc031460 tx=0x7faefc005bd0 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:32:37.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:37.701+0000 7faef77fe640 1 -- 172.21.15.88:0/1770352950 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7faef0014030 con 0x7faf00100ce0 2024-09-17T04:32:37.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:37.912+0000 7faf086be640 1 -- 172.21.15.88:0/1770352950 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 37, "format": "json"} v 0) -- 0x7faf001a8610 con 0x7faf00100ce0 2024-09-17T04:32:37.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:37.912+0000 7faef77fe640 1 -- 172.21.15.88:0/1770352950 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 37, "format": "json"}]=0 dumped fsmap epoch 37 v38) ==== 107+0+5323 (secure 0 0 0) 0x7faef0069860 con 0x7faf00100ce0 2024-09-17T04:32:37.914 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-17T04:32:37.914 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":37,"btime":"2024-09-17T04:28:17:681585+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34305,"name":"cephfs.smithi134.psnynp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/3085319848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3085319848},{"type":"v1","addr":"172.21.15.134:6827","nonce":3085319848}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":34318,"name":"cephfs.smithi088.lgavsv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6827/3125957194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":3125957194},{"type":"v1","addr":"172.21.15.88:6827","nonce":3125957194}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":34322,"name":"cephfs.smithi088.giqrgt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6829/2683662376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2683662376},{"type":"v1","addr":"172.21.15.88:6829","nonce":2683662376}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":37,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T04:18:10.480573+0000","modified":"2024-09-17T04:28:16.685483+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34273":{"gid":34273,"name":"cephfs.smithi134.ktuhce","rank":0,"incarnation":32,"state":"up:active","state_seq":8,"addr":"172.21.15.134:6825/3452154372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":3452154372},{"type":"v1","addr":"172.21.15.134:6825","nonce":3452154372}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34273,"qdb_cluster":[34273]},"id":1}]} 2024-09-17T04:32:37.914 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 37 2024-09-17T04:32:37.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:37.914+0000 7faf086be640 1 -- 172.21.15.88:0/1770352950 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7faeec07af30 msgr2=0x7faeec07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:37.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:37.914+0000 7faf086be640 1 --2- 172.21.15.88:0/1770352950 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7faeec07af30 0x7faeec07d3f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7faefc031460 tx=0x7faefc005bd0 comp rx=0 tx=0).stop 2024-09-17T04:32:37.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:37.914+0000 7faf086be640 1 -- 172.21.15.88:0/1770352950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf00100ce0 msgr2=0x7faf00194910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:37.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:37.914+0000 7faf086be640 1 --2- 172.21.15.88:0/1770352950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf00100ce0 0x7faf00194910 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7faef000c8f0 tx=0x7faef000cdb0 comp rx=0 tx=0).stop 2024-09-17T04:32:37.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:37.915+0000 7faf086be640 1 -- 172.21.15.88:0/1770352950 shutdown_connections 2024-09-17T04:32:37.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:37.915+0000 7faf086be640 1 --2- 172.21.15.88:0/1770352950 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7faeec07af30 0x7faeec07d3f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:37.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:37.915+0000 7faf086be640 1 --2- 172.21.15.88:0/1770352950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf00100ce0 0x7faf00194910 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:37.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:37.915+0000 7faf086be640 1 --2- 172.21.15.88:0/1770352950 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf00100330 0x7faf001943d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:37.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:37.915+0000 7faf086be640 1 -- 172.21.15.88:0/1770352950 >> 172.21.15.88:0/1770352950 conn(0x7faf00077270 msgr2=0x7faf000fe240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:32:37.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:37.915+0000 7faf086be640 1 -- 172.21.15.88:0/1770352950 shutdown_connections 2024-09-17T04:32:37.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:37.915+0000 7faf086be640 1 -- 172.21.15.88:0/1770352950 wait complete. 2024-09-17T04:32:38.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:37 smithi134 ceph-mon[76677]: pgmap v351: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:32:38.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:37 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/1770352950' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 37, "format": "json"} : dispatch 2024-09-17T04:32:38.362 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:37 smithi088 ceph-mon[90867]: pgmap v351: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:32:38.362 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:37 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/1770352950' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 37, "format": "json"} : dispatch 2024-09-17T04:32:38.579 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-17T04:32:38.591 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-17T04:32:38.591 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-17T04:32:38.591 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T04:32:38.609 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-17T04:32:38.609 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T04:32:38.667 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-17T04:32:38.957 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:32:39.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:39.391+0000 7f52b14e6640 1 -- 172.21.15.88:0/1168728641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52ac106860 msgr2=0x7f52ac106c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:39.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:39.391+0000 7f52b14e6640 1 --2- 172.21.15.88:0/1168728641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52ac106860 0x7f52ac106c40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f529c009880 tx=0x7f529c02a4a0 comp rx=0 tx=0).stop 2024-09-17T04:32:39.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:39.391+0000 7f52b14e6640 1 -- 172.21.15.88:0/1168728641 shutdown_connections 2024-09-17T04:32:39.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:39.391+0000 7f52b14e6640 1 --2- 172.21.15.88:0/1168728641 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52ac100860 0x7f52ac100cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:39.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:39.391+0000 7f52b14e6640 1 --2- 172.21.15.88:0/1168728641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52ac106860 0x7f52ac106c40 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:39.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:39.391+0000 7f52b14e6640 1 -- 172.21.15.88:0/1168728641 >> 172.21.15.88:0/1168728641 conn(0x7f52ac0fc580 msgr2=0x7f52ac0fe9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:32:39.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:39.391+0000 7f52b14e6640 1 -- 172.21.15.88:0/1168728641 shutdown_connections 2024-09-17T04:32:39.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:39.391+0000 7f52b14e6640 1 -- 172.21.15.88:0/1168728641 wait complete. 2024-09-17T04:32:39.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:39.391+0000 7f52b14e6640 1 Processor -- start 2024-09-17T04:32:39.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:39.392+0000 7f52b14e6640 1 -- start start 2024-09-17T04:32:39.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:39.392+0000 7f52b14e6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52ac100860 0x7f52ac19d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:39.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:39.392+0000 7f52b14e6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52ac106860 0x7f52ac19dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:39.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:39.392+0000 7f52b14e6640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f52ac10dd90 con 0x7f52ac100860 2024-09-17T04:32:39.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:39.392+0000 7f52b14e6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f52ac10dc10 con 0x7f52ac106860 2024-09-17T04:32:39.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:39.392+0000 7f52aaffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52ac100860 0x7f52ac19d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:39.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:39.392+0000 7f52aaffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52ac100860 0x7f52ac19d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51620/0 (socket says 172.21.15.88:51620) 2024-09-17T04:32:39.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:39.392+0000 7f52aaffd640 1 -- 172.21.15.88:0/3833934991 learned_addr learned my addr 172.21.15.88:0/3833934991 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:32:39.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:39.392+0000 7f52aa7fc640 1 --2- 172.21.15.88:0/3833934991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52ac106860 0x7f52ac19dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:39.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:39.392+0000 7f52aaffd640 1 -- 172.21.15.88:0/3833934991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52ac106860 msgr2=0x7f52ac19dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:39.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:39.392+0000 7f52aaffd640 1 --2- 172.21.15.88:0/3833934991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52ac106860 0x7f52ac19dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:39.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:39.392+0000 7f52aaffd640 1 -- 172.21.15.88:0/3833934991 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52ac1978a0 con 0x7f52ac100860 2024-09-17T04:32:39.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:39.392+0000 7f52aaffd640 1 --2- 172.21.15.88:0/3833934991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52ac100860 0x7f52ac19d6e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f529c031460 tx=0x7f529c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:32:39.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:39.393+0000 7f5293fff640 1 -- 172.21.15.88:0/3833934991 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f529c03f070 con 0x7f52ac100860 2024-09-17T04:32:39.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:39.393+0000 7f52b14e6640 1 -- 172.21.15.88:0/3833934991 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52ac197b30 con 0x7f52ac100860 2024-09-17T04:32:39.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:39.393+0000 7f5293fff640 1 -- 172.21.15.88:0/3833934991 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f529c004cf0 con 0x7f52ac100860 2024-09-17T04:32:39.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:39.393+0000 7f5293fff640 1 -- 172.21.15.88:0/3833934991 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f529c035030 con 0x7f52ac100860 2024-09-17T04:32:39.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:39.393+0000 7f52b14e6640 1 -- 172.21.15.88:0/3833934991 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52ac198060 con 0x7f52ac100860 2024-09-17T04:32:39.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:39.394+0000 7f52b14e6640 1 -- 172.21.15.88:0/3833934991 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52ac101fa0 con 0x7f52ac100860 2024-09-17T04:32:39.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:39.394+0000 7f5293fff640 1 -- 172.21.15.88:0/3833934991 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f529c042070 con 0x7f52ac100860 2024-09-17T04:32:39.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:39.395+0000 7f5293fff640 1 --2- 172.21.15.88:0/3833934991 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f529407af30 0x7f529407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:39.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:39.395+0000 7f5293fff640 1 -- 172.21.15.88:0/3833934991 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f529c0bebb0 con 0x7f52ac100860 2024-09-17T04:32:39.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:39.395+0000 7f52aa7fc640 1 --2- 172.21.15.88:0/3833934991 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f529407af30 0x7f529407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:39.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:39.395+0000 7f52aa7fc640 1 --2- 172.21.15.88:0/3833934991 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f529407af30 0x7f529407d3f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f52ac104fd0 tx=0x7f52a0008040 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:32:39.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:39.400+0000 7f5293fff640 1 -- 172.21.15.88:0/3833934991 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f529c0c5080 con 0x7f52ac100860 2024-09-17T04:32:39.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:39.588+0000 7f52b14e6640 1 -- 172.21.15.88:0/3833934991 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f52ac198dd0 con 0x7f52ac100860 2024-09-17T04:32:39.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:39.588+0000 7f5293fff640 1 -- 172.21.15.88:0/3833934991 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 35 entries v82) ==== 81+0+2077 (secure 0 0 0) 0x7f529c08a100 con 0x7f52ac100860 2024-09-17T04:32:39.589 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.134:6827/584624515 2024-09-18T04:28:01.120403+0000 2024-09-17T04:32:39.589 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.134:6826/584624515 2024-09-18T04:28:01.120403+0000 2024-09-17T04:32:39.589 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.134:6824/967997022 2024-09-18T04:27:37.002190+0000 2024-09-17T04:32:39.590 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6828/1714846518 2024-09-18T04:27:14.742284+0000 2024-09-17T04:32:39.590 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/623494993 2024-09-18T04:20:24.478411+0000 2024-09-17T04:32:39.590 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/233265505 2024-09-18T04:11:52.936995+0000 2024-09-17T04:32:39.590 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.134:0/474311764 2024-09-18T04:22:10.385168+0000 2024-09-17T04:32:39.590 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/1996066407 2024-09-18T04:11:52.936995+0000 2024-09-17T04:32:39.590 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6829/1714846518 2024-09-18T04:27:14.742284+0000 2024-09-17T04:32:39.590 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/1144222027 2024-09-18T04:20:24.478411+0000 2024-09-17T04:32:39.590 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/602105794 2024-09-18T04:12:24.422352+0000 2024-09-17T04:32:39.590 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/73613879 2024-09-18T04:13:21.738800+0000 2024-09-17T04:32:39.590 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.134:0/1669959966 2024-09-18T04:22:10.385168+0000 2024-09-17T04:32:39.590 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/965301034 2024-09-18T04:20:24.478411+0000 2024-09-17T04:32:39.590 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/433412784 2024-09-18T04:11:52.936995+0000 2024-09-17T04:32:39.591 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.134:0/1486750243 2024-09-18T04:22:10.385168+0000 2024-09-17T04:32:39.591 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/142846725 2024-09-18T04:20:24.478411+0000 2024-09-17T04:32:39.591 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.134:6828/1122341233 2024-09-18T04:22:10.385168+0000 2024-09-17T04:32:39.591 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/469592792 2024-09-18T04:12:24.422352+0000 2024-09-17T04:32:39.591 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6826/2023184789 2024-09-18T04:18:24.739290+0000 2024-09-17T04:32:39.591 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6827/2023184789 2024-09-18T04:18:24.739290+0000 2024-09-17T04:32:39.591 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/910347675 2024-09-18T04:12:24.422352+0000 2024-09-17T04:32:39.591 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.134:6829/1122341233 2024-09-18T04:22:10.385168+0000 2024-09-17T04:32:39.591 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/2048077731 2024-09-18T04:13:21.738800+0000 2024-09-17T04:32:39.591 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.134:6825/967997022 2024-09-18T04:27:37.002190+0000 2024-09-17T04:32:39.591 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6800/2756720871 2024-09-18T04:12:24.422352+0000 2024-09-17T04:32:39.591 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6801/2756720871 2024-09-18T04:12:24.422352+0000 2024-09-17T04:32:39.591 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6800/2871304666 2024-09-18T04:11:52.936995+0000 2024-09-17T04:32:39.591 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6801/1666801150 2024-09-18T04:20:24.478411+0000 2024-09-17T04:32:39.592 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.134:0/1492310222 2024-09-18T04:22:10.385168+0000 2024-09-17T04:32:39.592 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/2258563085 2024-09-18T04:13:21.738800+0000 2024-09-17T04:32:39.592 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6801/2871304666 2024-09-18T04:11:52.936995+0000 2024-09-17T04:32:39.592 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6800/245760742 2024-09-18T04:13:21.738800+0000 2024-09-17T04:32:39.592 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6801/245760742 2024-09-18T04:13:21.738800+0000 2024-09-17T04:32:39.592 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6800/1666801150 2024-09-18T04:20:24.478411+0000 2024-09-17T04:32:39.593 INFO:teuthology.orchestra.run.smithi088.stderr:listed 35 entries 2024-09-17T04:32:39.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:39.591+0000 7f52b14e6640 1 -- 172.21.15.88:0/3833934991 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f529407af30 msgr2=0x7f529407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:39.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:39.591+0000 7f52b14e6640 1 --2- 172.21.15.88:0/3833934991 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f529407af30 0x7f529407d3f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f52ac104fd0 tx=0x7f52a0008040 comp rx=0 tx=0).stop 2024-09-17T04:32:39.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:39.591+0000 7f52b14e6640 1 -- 172.21.15.88:0/3833934991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52ac100860 msgr2=0x7f52ac19d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:39.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:39.591+0000 7f52b14e6640 1 --2- 172.21.15.88:0/3833934991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52ac100860 0x7f52ac19d6e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f529c031460 tx=0x7f529c0048f0 comp rx=0 tx=0).stop 2024-09-17T04:32:39.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:39.591+0000 7f52b14e6640 1 -- 172.21.15.88:0/3833934991 shutdown_connections 2024-09-17T04:32:39.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:39.591+0000 7f52b14e6640 1 --2- 172.21.15.88:0/3833934991 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f529407af30 0x7f529407d3f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:39.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:39.591+0000 7f52b14e6640 1 --2- 172.21.15.88:0/3833934991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52ac106860 0x7f52ac19dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:39.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:39.591+0000 7f52b14e6640 1 --2- 172.21.15.88:0/3833934991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52ac100860 0x7f52ac19d6e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:39.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:39.591+0000 7f52b14e6640 1 -- 172.21.15.88:0/3833934991 >> 172.21.15.88:0/3833934991 conn(0x7f52ac0fc580 msgr2=0x7f52ac06a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:32:39.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:39.591+0000 7f52b14e6640 1 -- 172.21.15.88:0/3833934991 shutdown_connections 2024-09-17T04:32:39.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:39.591+0000 7f52b14e6640 1 -- 172.21.15.88:0/3833934991 wait complete. 2024-09-17T04:32:40.207 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:39 smithi088 ceph-mon[90867]: pgmap v352: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:32:40.207 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:39 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/3833934991' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-17T04:32:40.238 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-17T04:32:40.238 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T04:32:40.258 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-17T04:32:40.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:39 smithi134 ceph-mon[76677]: pgmap v352: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:32:40.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:39 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/3833934991' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-17T04:32:40.549 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-17T04:32:41.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:40.998+0000 7f82aaa2f640 1 -- 172.21.15.88:0/36231858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82a41007f0 msgr2=0x7f82a4100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:41.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:40.998+0000 7f82aaa2f640 1 --2- 172.21.15.88:0/36231858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82a41007f0 0x7f82a4100c50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f828c009880 tx=0x7f828c02a4a0 comp rx=0 tx=0).stop 2024-09-17T04:32:41.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:40.998+0000 7f82aaa2f640 1 -- 172.21.15.88:0/36231858 shutdown_connections 2024-09-17T04:32:41.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:40.998+0000 7f82aaa2f640 1 --2- 172.21.15.88:0/36231858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82a41007f0 0x7f82a4100c50 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:41.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:40.998+0000 7f82aaa2f640 1 --2- 172.21.15.88:0/36231858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82a41067f0 0x7f82a4106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:41.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:40.998+0000 7f82aaa2f640 1 -- 172.21.15.88:0/36231858 >> 172.21.15.88:0/36231858 conn(0x7f82a40fc550 msgr2=0x7f82a40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:32:41.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:40.998+0000 7f82aaa2f640 1 -- 172.21.15.88:0/36231858 shutdown_connections 2024-09-17T04:32:41.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:40.998+0000 7f82aaa2f640 1 -- 172.21.15.88:0/36231858 wait complete. 2024-09-17T04:32:41.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:40.998+0000 7f82aaa2f640 1 Processor -- start 2024-09-17T04:32:41.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:40.999+0000 7f82aaa2f640 1 -- start start 2024-09-17T04:32:41.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:40.999+0000 7f82aaa2f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82a41007f0 0x7f82a419d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:41.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:40.999+0000 7f82aaa2f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82a41067f0 0x7f82a419db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:41.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:40.999+0000 7f82aaa2f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f82a410dca0 con 0x7f82a41067f0 2024-09-17T04:32:41.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:40.999+0000 7f82aaa2f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f82a410db20 con 0x7f82a41007f0 2024-09-17T04:32:41.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:40.999+0000 7f829bfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82a41067f0 0x7f82a419db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:41.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:40.999+0000 7f829bfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82a41067f0 0x7f82a419db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51636/0 (socket says 172.21.15.88:51636) 2024-09-17T04:32:41.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:40.999+0000 7f829bfff640 1 -- 172.21.15.88:0/4208612859 learned_addr learned my addr 172.21.15.88:0/4208612859 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-17T04:32:41.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:40.999+0000 7f82a3fff640 1 --2- 172.21.15.88:0/4208612859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82a41007f0 0x7f82a419d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:41.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:40.999+0000 7f829bfff640 1 -- 172.21.15.88:0/4208612859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82a41007f0 msgr2=0x7f82a419d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:41.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:40.999+0000 7f829bfff640 1 --2- 172.21.15.88:0/4208612859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82a41007f0 0x7f82a419d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:41.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:40.999+0000 7f829bfff640 1 -- 172.21.15.88:0/4208612859 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82a4197780 con 0x7f82a41067f0 2024-09-17T04:32:41.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:40.999+0000 7f829bfff640 1 --2- 172.21.15.88:0/4208612859 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82a41067f0 0x7f82a419db40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f828c031460 tx=0x7f828c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:32:41.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:41.000+0000 7f82a1ffb640 1 -- 172.21.15.88:0/4208612859 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f828c03f070 con 0x7f82a41067f0 2024-09-17T04:32:41.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:41.000+0000 7f82aaa2f640 1 -- 172.21.15.88:0/4208612859 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82a4197a10 con 0x7f82a41067f0 2024-09-17T04:32:41.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:41.000+0000 7f82a1ffb640 1 -- 172.21.15.88:0/4208612859 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f828c004cf0 con 0x7f82a41067f0 2024-09-17T04:32:41.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:41.000+0000 7f82a1ffb640 1 -- 172.21.15.88:0/4208612859 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f828c035030 con 0x7f82a41067f0 2024-09-17T04:32:41.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:41.000+0000 7f82aaa2f640 1 -- 172.21.15.88:0/4208612859 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82a4197f40 con 0x7f82a41067f0 2024-09-17T04:32:41.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:41.001+0000 7f82aaa2f640 1 -- 172.21.15.88:0/4208612859 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82a4101f30 con 0x7f82a41067f0 2024-09-17T04:32:41.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:41.001+0000 7f82a1ffb640 1 -- 172.21.15.88:0/4208612859 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f828c042070 con 0x7f82a41067f0 2024-09-17T04:32:41.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:41.002+0000 7f82a1ffb640 1 --2- 172.21.15.88:0/4208612859 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f829007af30 0x7f829007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:32:41.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:41.002+0000 7f82a1ffb640 1 -- 172.21.15.88:0/4208612859 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f828c0beac0 con 0x7f82a41067f0 2024-09-17T04:32:41.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:41.002+0000 7f82a3fff640 1 --2- 172.21.15.88:0/4208612859 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f829007af30 0x7f829007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:32:41.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:41.002+0000 7f82a3fff640 1 --2- 172.21.15.88:0/4208612859 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f829007af30 0x7f829007d3f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f82940058c0 tx=0x7f829400a2d0 comp rx=0 tx=0).ready entity=mgr.14858 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:32:41.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:41.006+0000 7f82a1ffb640 1 -- 172.21.15.88:0/4208612859 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f828c08a010 con 0x7f82a41067f0 2024-09-17T04:32:41.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:41.195+0000 7f82aaa2f640 1 -- 172.21.15.88:0/4208612859 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f82a4198cb0 con 0x7f82a41067f0 2024-09-17T04:32:41.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:41.196+0000 7f82a1ffb640 1 -- 172.21.15.88:0/4208612859 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 35 entries v82) ==== 81+0+2077 (secure 0 0 0) 0x7f828c08eec0 con 0x7f82a41067f0 2024-09-17T04:32:41.196 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.134:6827/584624515 2024-09-18T04:28:01.120403+0000 2024-09-17T04:32:41.196 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.134:6826/584624515 2024-09-18T04:28:01.120403+0000 2024-09-17T04:32:41.196 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.134:6824/967997022 2024-09-18T04:27:37.002190+0000 2024-09-17T04:32:41.196 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6828/1714846518 2024-09-18T04:27:14.742284+0000 2024-09-17T04:32:41.196 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/623494993 2024-09-18T04:20:24.478411+0000 2024-09-17T04:32:41.196 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/233265505 2024-09-18T04:11:52.936995+0000 2024-09-17T04:32:41.196 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.134:0/474311764 2024-09-18T04:22:10.385168+0000 2024-09-17T04:32:41.197 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/1996066407 2024-09-18T04:11:52.936995+0000 2024-09-17T04:32:41.197 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6829/1714846518 2024-09-18T04:27:14.742284+0000 2024-09-17T04:32:41.197 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/1144222027 2024-09-18T04:20:24.478411+0000 2024-09-17T04:32:41.197 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/602105794 2024-09-18T04:12:24.422352+0000 2024-09-17T04:32:41.197 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/73613879 2024-09-18T04:13:21.738800+0000 2024-09-17T04:32:41.197 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.134:0/1669959966 2024-09-18T04:22:10.385168+0000 2024-09-17T04:32:41.197 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/965301034 2024-09-18T04:20:24.478411+0000 2024-09-17T04:32:41.197 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/433412784 2024-09-18T04:11:52.936995+0000 2024-09-17T04:32:41.197 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.134:0/1486750243 2024-09-18T04:22:10.385168+0000 2024-09-17T04:32:41.197 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/142846725 2024-09-18T04:20:24.478411+0000 2024-09-17T04:32:41.197 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.134:6828/1122341233 2024-09-18T04:22:10.385168+0000 2024-09-17T04:32:41.197 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/469592792 2024-09-18T04:12:24.422352+0000 2024-09-17T04:32:41.197 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6826/2023184789 2024-09-18T04:18:24.739290+0000 2024-09-17T04:32:41.197 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6827/2023184789 2024-09-18T04:18:24.739290+0000 2024-09-17T04:32:41.198 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/910347675 2024-09-18T04:12:24.422352+0000 2024-09-17T04:32:41.198 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.134:6829/1122341233 2024-09-18T04:22:10.385168+0000 2024-09-17T04:32:41.198 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/2048077731 2024-09-18T04:13:21.738800+0000 2024-09-17T04:32:41.198 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.134:6825/967997022 2024-09-18T04:27:37.002190+0000 2024-09-17T04:32:41.198 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6800/2756720871 2024-09-18T04:12:24.422352+0000 2024-09-17T04:32:41.198 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6801/2756720871 2024-09-18T04:12:24.422352+0000 2024-09-17T04:32:41.198 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6800/2871304666 2024-09-18T04:11:52.936995+0000 2024-09-17T04:32:41.198 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6801/1666801150 2024-09-18T04:20:24.478411+0000 2024-09-17T04:32:41.198 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.134:0/1492310222 2024-09-18T04:22:10.385168+0000 2024-09-17T04:32:41.198 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/2258563085 2024-09-18T04:13:21.738800+0000 2024-09-17T04:32:41.198 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6801/2871304666 2024-09-18T04:11:52.936995+0000 2024-09-17T04:32:41.198 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6800/245760742 2024-09-18T04:13:21.738800+0000 2024-09-17T04:32:41.198 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6801/245760742 2024-09-18T04:13:21.738800+0000 2024-09-17T04:32:41.198 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6800/1666801150 2024-09-18T04:20:24.478411+0000 2024-09-17T04:32:41.199 INFO:teuthology.orchestra.run.smithi088.stderr:listed 35 entries 2024-09-17T04:32:41.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:41.199+0000 7f82aaa2f640 1 -- 172.21.15.88:0/4208612859 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f829007af30 msgr2=0x7f829007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:41.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:41.199+0000 7f82aaa2f640 1 --2- 172.21.15.88:0/4208612859 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f829007af30 0x7f829007d3f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f82940058c0 tx=0x7f829400a2d0 comp rx=0 tx=0).stop 2024-09-17T04:32:41.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:41.199+0000 7f82aaa2f640 1 -- 172.21.15.88:0/4208612859 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82a41067f0 msgr2=0x7f82a419db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:32:41.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:41.199+0000 7f82aaa2f640 1 --2- 172.21.15.88:0/4208612859 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82a41067f0 0x7f82a419db40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f828c031460 tx=0x7f828c0048f0 comp rx=0 tx=0).stop 2024-09-17T04:32:41.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:41.199+0000 7f82aaa2f640 1 -- 172.21.15.88:0/4208612859 shutdown_connections 2024-09-17T04:32:41.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:41.199+0000 7f82aaa2f640 1 --2- 172.21.15.88:0/4208612859 >> [v2:172.21.15.88:6800/2105377518,v1:172.21.15.88:6801/2105377518] conn(0x7f829007af30 0x7f829007d3f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:41.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:41.199+0000 7f82aaa2f640 1 --2- 172.21.15.88:0/4208612859 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82a41067f0 0x7f82a419db40 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:41.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:41.199+0000 7f82aaa2f640 1 --2- 172.21.15.88:0/4208612859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82a41007f0 0x7f82a419d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:32:41.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:41.199+0000 7f82aaa2f640 1 -- 172.21.15.88:0/4208612859 >> 172.21.15.88:0/4208612859 conn(0x7f82a40fc550 msgr2=0x7f82a4069e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:32:41.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:41.199+0000 7f82aaa2f640 1 -- 172.21.15.88:0/4208612859 shutdown_connections 2024-09-17T04:32:41.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-17T04:32:41.199+0000 7f82aaa2f640 1 -- 172.21.15.88:0/4208612859 wait complete. 2024-09-17T04:32:41.801 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi088.front.sepia.ceph.com... 2024-09-17T04:32:41.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:32:41.802 DEBUG:teuthology.orchestra.run.smithi088:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-17T04:32:41.829 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T04:32:42.099 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:41 smithi088 ceph-mon[90867]: pgmap v353: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:32:42.099 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:41 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:32:42.099 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:41 smithi088 ceph-mon[90867]: from='client.? 172.21.15.88:0/4208612859' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-17T04:32:42.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:41 smithi134 ceph-mon[76677]: pgmap v353: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:32:42.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:41 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:32:42.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:41 smithi134 ceph-mon[76677]: from='client.? 172.21.15.88:0/4208612859' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-17T04:32:44.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:43 smithi088 ceph-mon[90867]: pgmap v354: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:32:44.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:43 smithi134 ceph-mon[76677]: pgmap v354: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:32:46.288 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:45 smithi088 ceph-mon[90867]: pgmap v355: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:32:46.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:45 smithi134 ceph-mon[76677]: pgmap v355: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:32:48.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:47 smithi088 ceph-mon[90867]: pgmap v356: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:32:48.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:47 smithi134 ceph-mon[76677]: pgmap v356: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:32:50.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:49 smithi088 ceph-mon[90867]: pgmap v357: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:32:50.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:49 smithi134 ceph-mon[76677]: pgmap v357: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:32:52.260 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:51 smithi088 ceph-mon[90867]: pgmap v358: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:32:52.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:51 smithi134 ceph-mon[76677]: pgmap v358: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:32:54.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:53 smithi088 ceph-mon[90867]: pgmap v359: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:32:54.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:53 smithi134 ceph-mon[76677]: pgmap v359: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:32:56.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:55 smithi088 ceph-mon[90867]: pgmap v360: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:32:56.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:55 smithi134 ceph-mon[76677]: pgmap v360: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:32:57.342 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:57 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:32:57.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:57 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:32:58.272 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:32:58 smithi134 ceph-mon[76677]: pgmap v361: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:32:58.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:32:58 smithi088 ceph-mon[90867]: pgmap v361: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:33:00.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:33:00 smithi088 ceph-mon[90867]: pgmap v362: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:33:00.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:33:00 smithi134 ceph-mon[76677]: pgmap v362: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:33:02.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:33:02 smithi088 ceph-mon[90867]: pgmap v363: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:33:02.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:33:02 smithi134 ceph-mon[76677]: pgmap v363: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:33:04.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:33:04 smithi088 ceph-mon[90867]: pgmap v364: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:33:04.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:33:04 smithi134 ceph-mon[76677]: pgmap v364: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:33:06.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:33:06 smithi088 ceph-mon[90867]: pgmap v365: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:33:06.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:33:06 smithi134 ceph-mon[76677]: pgmap v365: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:33:08.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:33:08 smithi088 ceph-mon[90867]: pgmap v366: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:33:08.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:33:08 smithi134 ceph-mon[76677]: pgmap v366: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:33:10.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:33:10 smithi088 ceph-mon[90867]: pgmap v367: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:33:10.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:33:10 smithi134 ceph-mon[76677]: pgmap v367: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:33:12.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:33:12 smithi088 ceph-mon[90867]: pgmap v368: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:33:12.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:33:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:33:12.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:33:12 smithi134 ceph-mon[76677]: pgmap v368: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:33:12.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:33:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:33:14.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:33:14 smithi088 ceph-mon[90867]: pgmap v369: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:33:14.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:33:14 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:33:14.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:33:14 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:33:14.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:33:14 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:33:14.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:33:14 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:33:14.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:33:14 smithi134 ceph-mon[76677]: pgmap v369: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:33:14.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:33:14 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:33:14.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:33:14 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:33:14.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:33:14 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:33:14.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:33:14 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:33:16.289 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:33:16 smithi088 ceph-mon[90867]: pgmap v370: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:33:16.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:33:16 smithi134 ceph-mon[76677]: pgmap v370: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:33:18.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:33:18 smithi088 ceph-mon[90867]: pgmap v371: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:33:18.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:33:18 smithi134 ceph-mon[76677]: pgmap v371: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:33:20.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:33:20 smithi088 ceph-mon[90867]: pgmap v372: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:33:20.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:33:20 smithi134 ceph-mon[76677]: pgmap v372: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:33:22.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:33:22 smithi088 ceph-mon[90867]: pgmap v373: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:33:22.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:33:22 smithi134 ceph-mon[76677]: pgmap v373: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:33:24.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:33:24 smithi088 ceph-mon[90867]: pgmap v374: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:33:24.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:33:24 smithi134 ceph-mon[76677]: pgmap v374: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:33:26.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:33:26 smithi088 ceph-mon[90867]: pgmap v375: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:33:26.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:33:26 smithi134 ceph-mon[76677]: pgmap v375: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:33:27.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:33:27 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:33:27.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:33:27 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:33:28.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:33:28 smithi088 ceph-mon[90867]: pgmap v376: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:33:28.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:33:28 smithi134 ceph-mon[76677]: pgmap v376: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:33:30.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:33:30 smithi088 ceph-mon[90867]: pgmap v377: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:33:30.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:33:30 smithi134 ceph-mon[76677]: pgmap v377: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:33:32.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:33:32 smithi088 ceph-mon[90867]: pgmap v378: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:33:32.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:33:32 smithi134 ceph-mon[76677]: pgmap v378: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:33:34.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:33:34 smithi088 ceph-mon[90867]: pgmap v379: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:33:34.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:33:34 smithi134 ceph-mon[76677]: pgmap v379: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:33:36.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:33:36 smithi088 ceph-mon[90867]: pgmap v380: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:33:36.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:33:36 smithi134 ceph-mon[76677]: pgmap v380: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:33:38.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:33:38 smithi088 ceph-mon[90867]: pgmap v381: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:33:38.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:33:38 smithi134 ceph-mon[76677]: pgmap v381: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:33:40.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:33:40 smithi088 ceph-mon[90867]: pgmap v382: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:33:40.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:33:40 smithi134 ceph-mon[76677]: pgmap v382: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:33:41.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:33:41 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:33:41.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:33:41 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:33:42.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:33:42 smithi088 ceph-mon[90867]: pgmap v383: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:33:42.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:33:42 smithi134 ceph-mon[76677]: pgmap v383: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:33:44.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:33:44 smithi088 ceph-mon[90867]: pgmap v384: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:33:44.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:33:44 smithi134 ceph-mon[76677]: pgmap v384: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:33:46.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:33:46 smithi088 ceph-mon[90867]: pgmap v385: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:33:46.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:33:46 smithi134 ceph-mon[76677]: pgmap v385: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:33:48.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:33:48 smithi088 ceph-mon[90867]: pgmap v386: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:33:48.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:33:48 smithi134 ceph-mon[76677]: pgmap v386: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:33:50.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:33:50 smithi088 ceph-mon[90867]: pgmap v387: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:33:50.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:33:50 smithi134 ceph-mon[76677]: pgmap v387: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:33:52.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:33:52 smithi088 ceph-mon[90867]: pgmap v388: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:33:52.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:33:52 smithi134 ceph-mon[76677]: pgmap v388: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:33:54.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:33:54 smithi088 ceph-mon[90867]: pgmap v389: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:33:54.390 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:33:54 smithi134 ceph-mon[76677]: pgmap v389: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:33:56.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:33:56 smithi088 ceph-mon[90867]: pgmap v390: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:33:56.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:33:56 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:33:56.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:33:56 smithi134 ceph-mon[76677]: pgmap v390: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:33:56.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:33:56 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:33:58.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:33:58 smithi088 ceph-mon[90867]: pgmap v391: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:33:58.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:33:58 smithi134 ceph-mon[76677]: pgmap v391: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:34:00.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:34:00 smithi088 ceph-mon[90867]: pgmap v392: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:34:00.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:34:00 smithi134 ceph-mon[76677]: pgmap v392: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:34:02.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:34:02 smithi088 ceph-mon[90867]: pgmap v393: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:34:02.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:34:02 smithi134 ceph-mon[76677]: pgmap v393: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:34:04.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:34:04 smithi088 ceph-mon[90867]: pgmap v394: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:34:04.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:34:04 smithi134 ceph-mon[76677]: pgmap v394: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:34:06.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:34:06 smithi088 ceph-mon[90867]: pgmap v395: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:34:06.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:34:06 smithi134 ceph-mon[76677]: pgmap v395: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:34:08.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:34:08 smithi088 ceph-mon[90867]: pgmap v396: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:34:08.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:34:08 smithi134 ceph-mon[76677]: pgmap v396: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:34:10.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:34:10 smithi088 ceph-mon[90867]: pgmap v397: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:34:10.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:34:10 smithi134 ceph-mon[76677]: pgmap v397: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:34:11.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:34:11 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:34:11.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:34:11 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:34:12.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:34:12 smithi088 ceph-mon[90867]: pgmap v398: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:34:12.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:34:12 smithi134 ceph-mon[76677]: pgmap v398: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:34:14.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:34:14 smithi134 ceph-mon[76677]: pgmap v399: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:34:14.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:34:14 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:34:14.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:34:14 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:34:14.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:34:14 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:34:14.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:34:14 smithi088 ceph-mon[90867]: pgmap v399: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:34:14.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:34:14 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:34:14.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:34:14 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:34:14.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:34:14 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:34:15.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:34:15 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:34:15.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:34:15 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:34:15.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:34:15 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:34:15.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:34:15 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:34:15.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:34:15 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:34:15.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:34:15 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:34:16.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:34:16 smithi088 ceph-mon[90867]: pgmap v400: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:34:16.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:34:16 smithi134 ceph-mon[76677]: pgmap v400: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:34:18.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:34:18 smithi088 ceph-mon[90867]: pgmap v401: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:34:18.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:34:18 smithi134 ceph-mon[76677]: pgmap v401: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:34:20.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:34:20 smithi088 ceph-mon[90867]: pgmap v402: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:34:20.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:34:20 smithi134 ceph-mon[76677]: pgmap v402: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:34:22.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:34:22 smithi088 ceph-mon[90867]: pgmap v403: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:34:22.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:34:22 smithi134 ceph-mon[76677]: pgmap v403: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:34:24.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:34:24 smithi088 ceph-mon[90867]: pgmap v404: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:34:24.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:34:24 smithi134 ceph-mon[76677]: pgmap v404: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:34:26.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:34:26 smithi088 ceph-mon[90867]: pgmap v405: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:34:26.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:34:26 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:34:26.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:34:26 smithi134 ceph-mon[76677]: pgmap v405: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:34:26.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:34:26 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:34:28.828 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:34:28 smithi088 ceph-mon[90867]: pgmap v406: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:34:28.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:34:28 smithi134 ceph-mon[76677]: pgmap v406: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:34:30.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:34:30 smithi088 ceph-mon[90867]: pgmap v407: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:34:30.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:34:30 smithi134 ceph-mon[76677]: pgmap v407: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:34:32.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:34:32 smithi088 ceph-mon[90867]: pgmap v408: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:34:32.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:34:32 smithi134 ceph-mon[76677]: pgmap v408: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:34:34.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:34:34 smithi088 ceph-mon[90867]: pgmap v409: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:34:34.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:34:34 smithi134 ceph-mon[76677]: pgmap v409: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:34:36.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:34:36 smithi088 ceph-mon[90867]: pgmap v410: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:34:36.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:34:36 smithi134 ceph-mon[76677]: pgmap v410: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:34:38.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:34:38 smithi088 ceph-mon[90867]: pgmap v411: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:34:38.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:34:38 smithi134 ceph-mon[76677]: pgmap v411: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:34:40.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:34:40 smithi134 ceph-mon[76677]: pgmap v412: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:34:40.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:34:40 smithi088 ceph-mon[90867]: pgmap v412: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:34:41.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:34:41 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:34:41.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:34:41 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:34:42.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:34:42 smithi088 ceph-mon[90867]: pgmap v413: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:34:42.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:34:42 smithi134 ceph-mon[76677]: pgmap v413: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:34:44.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:34:44 smithi088 ceph-mon[90867]: pgmap v414: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:34:44.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:34:44 smithi134 ceph-mon[76677]: pgmap v414: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:34:46.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:34:46 smithi088 ceph-mon[90867]: pgmap v415: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:34:46.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:34:46 smithi134 ceph-mon[76677]: pgmap v415: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:34:48.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:34:48 smithi088 ceph-mon[90867]: pgmap v416: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:34:48.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:34:48 smithi134 ceph-mon[76677]: pgmap v416: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:34:50.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:34:50 smithi088 ceph-mon[90867]: pgmap v417: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:34:50.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:34:50 smithi134 ceph-mon[76677]: pgmap v417: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:34:52.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:34:52 smithi088 ceph-mon[90867]: pgmap v418: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:34:52.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:34:52 smithi134 ceph-mon[76677]: pgmap v418: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:34:54.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:34:54 smithi088 ceph-mon[90867]: pgmap v419: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:34:54.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:34:54 smithi134 ceph-mon[76677]: pgmap v419: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:34:56.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:34:56 smithi088 ceph-mon[90867]: pgmap v420: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:34:56.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:34:56 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:34:56.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:34:56 smithi134 ceph-mon[76677]: pgmap v420: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:34:56.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:34:56 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:34:58.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:34:58 smithi088 ceph-mon[90867]: pgmap v421: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:34:58.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:34:58 smithi134 ceph-mon[76677]: pgmap v421: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:35:00.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:35:00 smithi088 ceph-mon[90867]: pgmap v422: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:35:00.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:35:00 smithi134 ceph-mon[76677]: pgmap v422: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:35:02.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:35:02 smithi088 ceph-mon[90867]: pgmap v423: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:35:02.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:35:02 smithi134 ceph-mon[76677]: pgmap v423: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:35:04.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:35:04 smithi088 ceph-mon[90867]: pgmap v424: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:35:04.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:35:04 smithi134 ceph-mon[76677]: pgmap v424: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:35:06.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:35:06 smithi088 ceph-mon[90867]: pgmap v425: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:35:06.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:35:06 smithi134 ceph-mon[76677]: pgmap v425: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:35:08.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:35:08 smithi088 ceph-mon[90867]: pgmap v426: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:35:08.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:35:08 smithi134 ceph-mon[76677]: pgmap v426: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:35:10.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:35:10 smithi088 ceph-mon[90867]: pgmap v427: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:35:10.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:35:10 smithi134 ceph-mon[76677]: pgmap v427: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:35:11.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:35:11 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:35:11.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:35:11 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:35:12.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:35:12 smithi088 ceph-mon[90867]: pgmap v428: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:35:12.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:35:12 smithi134 ceph-mon[76677]: pgmap v428: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:35:14.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:35:14 smithi088 ceph-mon[90867]: pgmap v429: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:35:14.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:35:14 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:35:14.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:35:14 smithi134 ceph-mon[76677]: pgmap v429: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:35:14.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:35:14 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:35:15.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:35:15 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:35:15.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:35:15 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:35:15.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:35:15 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:35:15.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:35:15 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:35:15.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:35:15 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:35:15.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:35:15 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:35:16.789 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:35:16 smithi088 ceph-mon[90867]: pgmap v430: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:35:16.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:35:16 smithi134 ceph-mon[76677]: pgmap v430: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:35:18.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:35:18 smithi088 ceph-mon[90867]: pgmap v431: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:35:18.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:35:18 smithi134 ceph-mon[76677]: pgmap v431: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:35:20.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:35:20 smithi088 ceph-mon[90867]: pgmap v432: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:35:20.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:35:20 smithi134 ceph-mon[76677]: pgmap v432: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:35:21.887 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:35:21 smithi088 ceph-mon[90867]: pgmap v433: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:35:21.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:35:21 smithi134 ceph-mon[76677]: pgmap v433: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:35:23.941 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:35:23 smithi088 ceph-mon[90867]: pgmap v434: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:35:24.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:35:23 smithi134 ceph-mon[76677]: pgmap v434: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:35:26.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:35:25 smithi088 ceph-mon[90867]: pgmap v435: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:35:26.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:35:25 smithi134 ceph-mon[76677]: pgmap v435: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:35:26.949 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:35:26 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:35:27.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:35:26 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:35:28.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:35:27 smithi088 ceph-mon[90867]: pgmap v436: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:35:28.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:35:27 smithi134 ceph-mon[76677]: pgmap v436: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:35:29.944 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:35:29 smithi088 ceph-mon[90867]: pgmap v437: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:35:30.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:35:29 smithi134 ceph-mon[76677]: pgmap v437: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:35:32.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:35:31 smithi088 ceph-mon[90867]: pgmap v438: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:35:32.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:35:31 smithi134 ceph-mon[76677]: pgmap v438: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:35:34.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:35:33 smithi088 ceph-mon[90867]: pgmap v439: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:35:34.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:35:33 smithi134 ceph-mon[76677]: pgmap v439: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:35:36.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:35:35 smithi088 ceph-mon[90867]: pgmap v440: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:35:36.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:35:35 smithi134 ceph-mon[76677]: pgmap v440: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:35:38.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:35:37 smithi134 ceph-mon[76677]: pgmap v441: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:35:38.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:35:37 smithi088 ceph-mon[90867]: pgmap v441: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:35:40.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:35:39 smithi134 ceph-mon[76677]: pgmap v442: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:35:40.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:35:39 smithi088 ceph-mon[90867]: pgmap v442: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:35:42.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:35:41 smithi088 ceph-mon[90867]: pgmap v443: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:35:42.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:35:41 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:35:42.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:35:41 smithi134 ceph-mon[76677]: pgmap v443: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:35:42.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:35:41 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:35:44.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:35:43 smithi088 ceph-mon[90867]: pgmap v444: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:35:44.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:35:43 smithi134 ceph-mon[76677]: pgmap v444: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:35:46.292 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:35:45 smithi088 ceph-mon[90867]: pgmap v445: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:35:46.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:35:45 smithi134 ceph-mon[76677]: pgmap v445: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:35:48.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:35:47 smithi088 ceph-mon[90867]: pgmap v446: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:35:48.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:35:47 smithi134 ceph-mon[76677]: pgmap v446: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:35:50.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:35:49 smithi088 ceph-mon[90867]: pgmap v447: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:35:50.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:35:49 smithi134 ceph-mon[76677]: pgmap v447: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:35:52.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:35:51 smithi134 ceph-mon[76677]: pgmap v448: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:35:52.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:35:51 smithi088 ceph-mon[90867]: pgmap v448: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:35:54.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:35:53 smithi088 ceph-mon[90867]: pgmap v449: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:35:54.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:35:53 smithi134 ceph-mon[76677]: pgmap v449: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:35:56.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:35:55 smithi088 ceph-mon[90867]: pgmap v450: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:35:56.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:35:55 smithi134 ceph-mon[76677]: pgmap v450: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:35:57.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:35:56 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:35:57.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:35:56 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:35:58.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:35:57 smithi088 ceph-mon[90867]: pgmap v451: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:35:58.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:35:57 smithi134 ceph-mon[76677]: pgmap v451: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:36:00.314 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:35:59 smithi088 ceph-mon[90867]: pgmap v452: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:36:00.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:35:59 smithi134 ceph-mon[76677]: pgmap v452: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:36:02.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:36:01 smithi088 ceph-mon[90867]: pgmap v453: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:36:02.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:36:01 smithi134 ceph-mon[76677]: pgmap v453: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:36:04.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:36:03 smithi088 ceph-mon[90867]: pgmap v454: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:36:04.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:36:03 smithi134 ceph-mon[76677]: pgmap v454: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:36:06.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:36:05 smithi088 ceph-mon[90867]: pgmap v455: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:36:06.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:36:05 smithi134 ceph-mon[76677]: pgmap v455: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:36:08.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:36:07 smithi088 ceph-mon[90867]: pgmap v456: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:36:08.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:36:07 smithi134 ceph-mon[76677]: pgmap v456: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:36:10.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:36:09 smithi088 ceph-mon[90867]: pgmap v457: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:36:10.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:36:09 smithi134 ceph-mon[76677]: pgmap v457: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:36:12.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:36:11 smithi088 ceph-mon[90867]: pgmap v458: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:36:12.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:36:11 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:36:12.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:36:11 smithi134 ceph-mon[76677]: pgmap v458: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:36:12.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:36:11 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:36:14.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:36:13 smithi088 ceph-mon[90867]: pgmap v459: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:36:14.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:36:13 smithi134 ceph-mon[76677]: pgmap v459: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:36:16.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:36:15 smithi088 ceph-mon[90867]: pgmap v460: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:36:16.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:36:15 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:36:16.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:36:15 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:36:16.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:36:15 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:36:16.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:36:15 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:36:16.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:36:15 smithi134 ceph-mon[76677]: pgmap v460: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:36:16.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:36:15 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:36:16.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:36:15 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:36:16.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:36:15 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:36:16.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:36:15 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:36:18.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:36:17 smithi088 ceph-mon[90867]: pgmap v461: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:36:18.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:36:17 smithi134 ceph-mon[76677]: pgmap v461: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:36:20.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:36:19 smithi088 ceph-mon[90867]: pgmap v462: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:36:20.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:36:19 smithi134 ceph-mon[76677]: pgmap v462: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:36:22.339 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:36:21 smithi134 ceph-mon[76677]: pgmap v463: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:36:22.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:36:21 smithi088 ceph-mon[90867]: pgmap v463: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:36:24.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:36:23 smithi088 ceph-mon[90867]: pgmap v464: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:36:24.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:36:23 smithi134 ceph-mon[76677]: pgmap v464: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:36:26.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:36:25 smithi088 ceph-mon[90867]: pgmap v465: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:36:26.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:36:25 smithi134 ceph-mon[76677]: pgmap v465: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:36:27.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:36:26 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:36:27.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:36:26 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:36:28.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:36:27 smithi088 ceph-mon[90867]: pgmap v466: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:36:28.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:36:27 smithi134 ceph-mon[76677]: pgmap v466: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:36:30.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:36:29 smithi088 ceph-mon[90867]: pgmap v467: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:36:30.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:36:29 smithi134 ceph-mon[76677]: pgmap v467: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:36:32.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:36:31 smithi088 ceph-mon[90867]: pgmap v468: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:36:32.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:36:31 smithi134 ceph-mon[76677]: pgmap v468: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:36:34.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:36:33 smithi088 ceph-mon[90867]: pgmap v469: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:36:34.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:36:33 smithi134 ceph-mon[76677]: pgmap v469: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:36:36.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:36:35 smithi088 ceph-mon[90867]: pgmap v470: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:36:36.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:36:35 smithi134 ceph-mon[76677]: pgmap v470: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:36:38.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:36:38 smithi088 ceph-mon[90867]: pgmap v471: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:36:38.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:36:38 smithi134 ceph-mon[76677]: pgmap v471: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:36:40.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:36:40 smithi088 ceph-mon[90867]: pgmap v472: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:36:40.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:36:40 smithi134 ceph-mon[76677]: pgmap v472: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:36:42.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:36:42 smithi088 ceph-mon[90867]: pgmap v473: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:36:42.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:36:42 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:36:42.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:36:42 smithi134 ceph-mon[76677]: pgmap v473: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:36:42.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:36:42 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:36:44.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:36:44 smithi088 ceph-mon[90867]: pgmap v474: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:36:44.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:36:44 smithi134 ceph-mon[76677]: pgmap v474: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:36:46.289 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:36:46 smithi088 ceph-mon[90867]: pgmap v475: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:36:46.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:36:46 smithi134 ceph-mon[76677]: pgmap v475: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:36:48.146 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:36:48 smithi134 ceph-mon[76677]: pgmap v476: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:36:48.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:36:48 smithi088 ceph-mon[90867]: pgmap v476: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:36:50.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:36:50 smithi088 ceph-mon[90867]: pgmap v477: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:36:50.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:36:50 smithi134 ceph-mon[76677]: pgmap v477: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:36:52.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:36:52 smithi088 ceph-mon[90867]: pgmap v478: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:36:52.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:36:52 smithi134 ceph-mon[76677]: pgmap v478: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:36:54.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:36:54 smithi088 ceph-mon[90867]: pgmap v479: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:36:54.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:36:54 smithi134 ceph-mon[76677]: pgmap v479: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:36:56.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:36:56 smithi088 ceph-mon[90867]: pgmap v480: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:36:56.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:36:56 smithi134 ceph-mon[76677]: pgmap v480: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:36:57.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:36:57 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:36:57.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:36:57 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:36:58.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:36:58 smithi088 ceph-mon[90867]: pgmap v481: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:36:58.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:36:58 smithi134 ceph-mon[76677]: pgmap v481: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:37:00.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:37:00 smithi088 ceph-mon[90867]: pgmap v482: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:37:00.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:37:00 smithi134 ceph-mon[76677]: pgmap v482: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:37:02.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:37:02 smithi088 ceph-mon[90867]: pgmap v483: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:37:02.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:37:02 smithi134 ceph-mon[76677]: pgmap v483: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:37:04.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:37:04 smithi088 ceph-mon[90867]: pgmap v484: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:37:04.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:37:04 smithi134 ceph-mon[76677]: pgmap v484: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:37:06.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:37:06 smithi088 ceph-mon[90867]: pgmap v485: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:37:06.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:37:06 smithi134 ceph-mon[76677]: pgmap v485: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:37:08.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:37:08 smithi088 ceph-mon[90867]: pgmap v486: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:37:08.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:37:08 smithi134 ceph-mon[76677]: pgmap v486: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:37:10.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:37:10 smithi088 ceph-mon[90867]: pgmap v487: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:37:10.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:37:10 smithi134 ceph-mon[76677]: pgmap v487: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:37:12.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:37:12 smithi088 ceph-mon[90867]: pgmap v488: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:37:12.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:37:12 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:37:12.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:37:12 smithi134 ceph-mon[76677]: pgmap v488: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:37:12.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:37:12 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:37:14.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:37:14 smithi088 ceph-mon[90867]: pgmap v489: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:37:14.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:37:14 smithi134 ceph-mon[76677]: pgmap v489: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:37:16.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:37:16 smithi088 ceph-mon[90867]: pgmap v490: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:37:16.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:37:16 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:37:16.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:37:16 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:37:16.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:37:16 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:37:16.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:37:16 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:37:16.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:37:16 smithi134 ceph-mon[76677]: pgmap v490: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:37:16.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:37:16 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T04:37:16.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:37:16 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T04:37:16.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:37:16 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T04:37:16.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:37:16 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' 2024-09-17T04:37:18.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:37:18 smithi088 ceph-mon[90867]: pgmap v491: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:37:18.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:37:18 smithi134 ceph-mon[76677]: pgmap v491: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:37:20.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:37:20 smithi088 ceph-mon[90867]: pgmap v492: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:37:20.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:37:20 smithi134 ceph-mon[76677]: pgmap v492: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:37:22.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:37:22 smithi088 ceph-mon[90867]: pgmap v493: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:37:22.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:37:22 smithi134 ceph-mon[76677]: pgmap v493: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:37:24.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:37:24 smithi088 ceph-mon[90867]: pgmap v494: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:37:24.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:37:24 smithi134 ceph-mon[76677]: pgmap v494: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:37:26.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:37:26 smithi088 ceph-mon[90867]: pgmap v495: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:37:26.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:37:26 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:37:26.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:37:26 smithi134 ceph-mon[76677]: pgmap v495: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:37:26.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:37:26 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:37:28.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:37:28 smithi088 ceph-mon[90867]: pgmap v496: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:37:28.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:37:28 smithi134 ceph-mon[76677]: pgmap v496: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:37:30.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:37:30 smithi088 ceph-mon[90867]: pgmap v497: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:37:30.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:37:30 smithi134 ceph-mon[76677]: pgmap v497: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:37:32.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:37:32 smithi088 ceph-mon[90867]: pgmap v498: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:37:32.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:37:32 smithi134 ceph-mon[76677]: pgmap v498: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:37:34.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:37:34 smithi088 ceph-mon[90867]: pgmap v499: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:37:34.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:37:34 smithi134 ceph-mon[76677]: pgmap v499: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:37:36.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:37:36 smithi088 ceph-mon[90867]: pgmap v500: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:37:36.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:37:36 smithi134 ceph-mon[76677]: pgmap v500: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T04:37:38.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:37:38 smithi088 ceph-mon[90867]: pgmap v501: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:37:38.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:37:38 smithi134 ceph-mon[76677]: pgmap v501: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:37:40.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:37:40 smithi088 ceph-mon[90867]: pgmap v502: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:37:40.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:37:40 smithi134 ceph-mon[76677]: pgmap v502: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T04:37:40.897 ERROR:tasks.cephfs.fuse_mount:process failed to terminate after unmount. This probably indicates a bug within ceph-fuse. 2024-09-17T04:37:40.897 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-17T04:37:40.899 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-17T04:37:40.915 INFO:tasks.cephadm:Teardown begin 2024-09-17T04:37:40.915 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/cephadm.py", line 2380, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-17T04:37:40.917 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-17T04:37:40.951 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-17T04:37:40.985 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-17T04:37:40.985 DEBUG:teuthology.orchestra.run.smithi088:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-17T04:37:41.010 DEBUG:teuthology.orchestra.run.smithi134:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-17T04:37:41.042 INFO:tasks.cephadm:Stopping all daemons... 2024-09-17T04:37:41.043 INFO:tasks.cephadm.mon.smithi088:Stopping mon.smithi088... 2024-09-17T04:37:41.043 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968@mon.smithi088 2024-09-17T04:37:41.362 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:37:41 smithi088 systemd[1]: Stopping Ceph mon.smithi088 for bf2b79a4-74aa-11ef-bceb-c7b262605968... 2024-09-17T04:37:41.362 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:37:41 smithi088 ceph-mon[90867]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:37:41.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:37:41 smithi134 ceph-mon[76677]: from='mgr.14858 172.21.15.88:0/3436294496' entity='mgr.smithi088.wmndiv' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T04:37:41.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:37:41 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-mon-smithi088[90863]: 2024-09-17T04:37:41.361+0000 7fd96c045640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi088 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T04:37:41.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:37:41 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-mon-smithi088[90863]: 2024-09-17T04:37:41.361+0000 7fd96c045640 -1 mon.smithi088@0(leader) e2 *** Got Signal Terminated *** 2024-09-17T04:37:41.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:37:41 smithi088 podman[150066]: 2024-09-17 04:37:41.515128078 +0000 UTC m=+0.268732516 container died ac633201524324e2e5e02f45811dcee645315fac8c42db84b0efb9afce5e27c6 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-mon-smithi088, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_BRANCH=HEAD) 2024-09-17T04:37:42.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:37:41 smithi088 podman[150066]: 2024-09-17 04:37:41.986665739 +0000 UTC m=+0.740270168 container cleanup ac633201524324e2e5e02f45811dcee645315fac8c42db84b0efb9afce5e27c6 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-mon-smithi088, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS) 2024-09-17T04:37:42.137 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 17 04:37:41 smithi088 bash[150066]: ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-mon-smithi088 2024-09-17T04:37:42.429 DEBUG:teuthology.orchestra.run.smithi088:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968@mon.smithi088.service' 2024-09-17T04:37:42.471 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T04:37:42.471 INFO:tasks.cephadm.mon.smithi088:Stopped mon.smithi088 2024-09-17T04:37:42.471 INFO:tasks.cephadm.mon.smithi134:Stopping mon.smithi134... 2024-09-17T04:37:42.472 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968@mon.smithi134 2024-09-17T04:37:42.781 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:37:42 smithi134 systemd[1]: Stopping Ceph mon.smithi134 for bf2b79a4-74aa-11ef-bceb-c7b262605968... 2024-09-17T04:37:43.043 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:37:42 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-mon-smithi134[76673]: 2024-09-17T04:37:42.781+0000 7f27619e5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi134 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T04:37:43.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:37:42 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-mon-smithi134[76673]: 2024-09-17T04:37:42.781+0000 7f27619e5640 -1 mon.smithi134@1(peon) e2 *** Got Signal Terminated *** 2024-09-17T04:37:43.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:37:42 smithi134 podman[113712]: 2024-09-17 04:37:42.822527367 +0000 UTC m=+0.149177279 container died ea49f690e26b3fedf26718ff186d78657b883cb4ce33257307b4f59e6371eadf (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-mon-smithi134, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342) 2024-09-17T04:37:43.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:37:43 smithi134 podman[113712]: 2024-09-17 04:37:43.273018327 +0000 UTC m=+0.599668233 container cleanup ea49f690e26b3fedf26718ff186d78657b883cb4ce33257307b4f59e6371eadf (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-mon-smithi134, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, io.buildah.version=1.37.2) 2024-09-17T04:37:43.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Sep 17 04:37:43 smithi134 bash[113712]: ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-mon-smithi134 2024-09-17T04:37:43.767 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968@mon.smithi134.service' 2024-09-17T04:37:43.839 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T04:37:43.839 INFO:tasks.cephadm.mon.smithi134:Stopped mon.smithi134 2024-09-17T04:37:43.839 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-17T04:37:43.839 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968@osd.0 2024-09-17T04:37:44.137 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:37:43 smithi088 systemd[1]: Stopping Ceph osd.0 for bf2b79a4-74aa-11ef-bceb-c7b262605968... 2024-09-17T04:37:44.638 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:37:44 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-0[99589]: 2024-09-17T04:37:44.216+0000 7fa9e2f49640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T04:37:44.638 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:37:44 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-0[99589]: 2024-09-17T04:37:44.216+0000 7fa9e2f49640 -1 osd.0 82 *** Got signal Terminated *** 2024-09-17T04:37:44.638 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:37:44 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-0[99589]: 2024-09-17T04:37:44.216+0000 7fa9e2f49640 -1 osd.0 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T04:37:49.875 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:37:49 smithi088 podman[150203]: 2024-09-17 04:37:49.584442269 +0000 UTC m=+5.552701966 container died 4ef267302248f32ae39a9df00d76e80189e279a223ed4a76c0123f188e6fe54d (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-0, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T04:37:50.137 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:37:49 smithi088 podman[150203]: 2024-09-17 04:37:49.982807273 +0000 UTC m=+5.951066972 container cleanup 4ef267302248f32ae39a9df00d76e80189e279a223ed4a76c0123f188e6fe54d (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-17T04:37:50.137 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:37:49 smithi088 bash[150203]: ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-0 2024-09-17T04:37:50.591 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:37:50 smithi088 podman[150230]: 2024-09-17 04:37:50.242802553 +0000 UTC m=+0.659698592 container remove 4ef267302248f32ae39a9df00d76e80189e279a223ed4a76c0123f188e6fe54d (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-17T04:37:50.879 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:37:50 smithi088 podman[150317]: 2024-09-17 04:37:50.494861482 +0000 UTC m=+0.016001855 image pull 8e039cb7fe1eece5854872e8884a61a26632c7691b2c85cbac9078a9c5c62fae quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f 2024-09-17T04:37:50.879 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:37:50 smithi088 podman[150317]: 2024-09-17 04:37:50.618605786 +0000 UTC m=+0.139746149 container create 299c0449dc9139bdf90f57e8b9783b65eed8a3c861e29582194c66887f41a5a0 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T04:37:50.879 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:37:50 smithi088 podman[150317]: 2024-09-17 04:37:50.879766323 +0000 UTC m=+0.400906695 container init 299c0449dc9139bdf90f57e8b9783b65eed8a3c861e29582194c66887f41a5a0 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-17T04:37:51.138 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:37:50 smithi088 podman[150317]: 2024-09-17 04:37:50.883232197 +0000 UTC m=+0.404372561 container start 299c0449dc9139bdf90f57e8b9783b65eed8a3c861e29582194c66887f41a5a0 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-0-deactivate, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-17T04:37:51.138 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:37:50 smithi088 podman[150317]: 2024-09-17 04:37:50.971287026 +0000 UTC m=+0.492427398 container attach 299c0449dc9139bdf90f57e8b9783b65eed8a3c861e29582194c66887f41a5a0 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-17T04:37:51.138 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 17 04:37:51 smithi088 podman[150317]: 2024-09-17 04:37:51.071339134 +0000 UTC m=+0.592479512 container died 299c0449dc9139bdf90f57e8b9783b65eed8a3c861e29582194c66887f41a5a0 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342) 2024-09-17T04:37:51.704 DEBUG:teuthology.orchestra.run.smithi088:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968@osd.0.service' 2024-09-17T04:37:51.744 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T04:37:51.745 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-17T04:37:51.745 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-17T04:37:51.745 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968@osd.1 2024-09-17T04:37:52.070 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:37:51 smithi088 systemd[1]: Stopping Ceph osd.1 for bf2b79a4-74aa-11ef-bceb-c7b262605968... 2024-09-17T04:37:52.387 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:37:52 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-1[105199]: 2024-09-17T04:37:52.069+0000 7fb849a2b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T04:37:52.387 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:37:52 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-1[105199]: 2024-09-17T04:37:52.070+0000 7fb849a2b640 -1 osd.1 82 *** Got signal Terminated *** 2024-09-17T04:37:52.388 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:37:52 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-1[105199]: 2024-09-17T04:37:52.070+0000 7fb849a2b640 -1 osd.1 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T04:37:57.804 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:37:57 smithi088 podman[150421]: 2024-09-17 04:37:57.488691307 +0000 UTC m=+5.521235243 container died 17b67c13c7aa47289943a6671163c76b5ec9c4f12ece62c6ef4161d4811c5178 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, ceph=True) 2024-09-17T04:37:58.128 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:37:57 smithi088 podman[150421]: 2024-09-17 04:37:57.903121726 +0000 UTC m=+5.935665650 container cleanup 17b67c13c7aa47289943a6671163c76b5ec9c4f12ece62c6ef4161d4811c5178 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-1, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-17T04:37:58.129 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:37:57 smithi088 bash[150421]: ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-1 2024-09-17T04:37:58.387 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:37:58 smithi088 podman[150438]: 2024-09-17 04:37:58.129543184 +0000 UTC m=+0.637542297 container remove 17b67c13c7aa47289943a6671163c76b5ec9c4f12ece62c6ef4161d4811c5178 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-17T04:37:58.807 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:37:58 smithi088 podman[150523]: 2024-09-17 04:37:58.431634327 +0000 UTC m=+0.015875788 image pull 8e039cb7fe1eece5854872e8884a61a26632c7691b2c85cbac9078a9c5c62fae quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f 2024-09-17T04:37:58.807 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:37:58 smithi088 podman[150523]: 2024-09-17 04:37:58.538955488 +0000 UTC m=+0.123196938 container create 0935deb7795c57db2d4c004ee71432d6aecb818f1db4a009f9045778d2388f97 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T04:37:58.807 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:37:58 smithi088 podman[150523]: 2024-09-17 04:37:58.741628981 +0000 UTC m=+0.325870440 container init 0935deb7795c57db2d4c004ee71432d6aecb818f1db4a009f9045778d2388f97 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-1-deactivate, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, io.buildah.version=1.37.2) 2024-09-17T04:37:58.807 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:37:58 smithi088 podman[150523]: 2024-09-17 04:37:58.745010357 +0000 UTC m=+0.329251807 container start 0935deb7795c57db2d4c004ee71432d6aecb818f1db4a009f9045778d2388f97 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-17T04:37:58.807 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:37:58 smithi088 podman[150523]: 2024-09-17 04:37:58.807941544 +0000 UTC m=+0.392183031 container attach 0935deb7795c57db2d4c004ee71432d6aecb818f1db4a009f9045778d2388f97 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T04:37:59.137 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 17 04:37:58 smithi088 podman[150523]: 2024-09-17 04:37:58.934609058 +0000 UTC m=+0.518850521 container died 0935deb7795c57db2d4c004ee71432d6aecb818f1db4a009f9045778d2388f97 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-17T04:37:59.530 DEBUG:teuthology.orchestra.run.smithi088:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968@osd.1.service' 2024-09-17T04:37:59.570 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T04:37:59.570 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-17T04:37:59.570 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-17T04:37:59.570 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968@osd.2 2024-09-17T04:37:59.888 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:37:59 smithi088 systemd[1]: Stopping Ceph osd.2 for bf2b79a4-74aa-11ef-bceb-c7b262605968... 2024-09-17T04:38:00.388 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:37:59 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-2[110344]: 2024-09-17T04:37:59.889+0000 7fb71dea4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T04:38:00.388 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:37:59 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-2[110344]: 2024-09-17T04:37:59.889+0000 7fb71dea4640 -1 osd.2 82 *** Got signal Terminated *** 2024-09-17T04:38:00.388 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:37:59 smithi088 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-2[110344]: 2024-09-17T04:37:59.889+0000 7fb71dea4640 -1 osd.2 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T04:38:05.638 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:38:05 smithi088 podman[150626]: 2024-09-17 04:38:05.377819488 +0000 UTC m=+5.585043228 container died 83d38ad792c97e23ec49f47ac05b1a3e751030c374fb0b9d4b2e46c261608970 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-17T04:38:06.047 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:38:05 smithi088 podman[150626]: 2024-09-17 04:38:05.772053611 +0000 UTC m=+5.979277350 container cleanup 83d38ad792c97e23ec49f47ac05b1a3e751030c374fb0b9d4b2e46c261608970 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True) 2024-09-17T04:38:06.048 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:38:05 smithi088 bash[150626]: ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-2 2024-09-17T04:38:06.381 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:38:06 smithi088 podman[150642]: 2024-09-17 04:38:06.048597308 +0000 UTC m=+0.663969515 container remove 83d38ad792c97e23ec49f47ac05b1a3e751030c374fb0b9d4b2e46c261608970 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T04:38:06.638 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:38:06 smithi088 podman[150729]: 2024-09-17 04:38:06.382558901 +0000 UTC m=+0.113276329 container create 9527df533762938f5f8e9d01d35fd89d3348507fe0d9a667acb700bbbcf4b3ce (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342) 2024-09-17T04:38:06.638 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:38:06 smithi088 podman[150729]: 2024-09-17 04:38:06.28597181 +0000 UTC m=+0.016689242 image pull 8e039cb7fe1eece5854872e8884a61a26632c7691b2c85cbac9078a9c5c62fae quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f 2024-09-17T04:38:06.638 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:38:06 smithi088 podman[150729]: 2024-09-17 04:38:06.593611461 +0000 UTC m=+0.324328895 container init 9527df533762938f5f8e9d01d35fd89d3348507fe0d9a667acb700bbbcf4b3ce (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-2-deactivate, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-17T04:38:06.638 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:38:06 smithi088 podman[150729]: 2024-09-17 04:38:06.597343632 +0000 UTC m=+0.328061067 container start 9527df533762938f5f8e9d01d35fd89d3348507fe0d9a667acb700bbbcf4b3ce (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-17T04:38:07.080 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:38:06 smithi088 podman[150729]: 2024-09-17 04:38:06.701897414 +0000 UTC m=+0.432614850 container attach 9527df533762938f5f8e9d01d35fd89d3348507fe0d9a667acb700bbbcf4b3ce (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T04:38:07.080 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 17 04:38:06 smithi088 podman[150729]: 2024-09-17 04:38:06.785797878 +0000 UTC m=+0.516515307 container died 9527df533762938f5f8e9d01d35fd89d3348507fe0d9a667acb700bbbcf4b3ce (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux ) 2024-09-17T04:38:07.389 DEBUG:teuthology.orchestra.run.smithi088:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968@osd.2.service' 2024-09-17T04:38:07.428 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T04:38:07.429 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-17T04:38:07.429 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-17T04:38:07.429 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968@osd.3 2024-09-17T04:38:07.743 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:38:07 smithi134 systemd[1]: Stopping Ceph osd.3 for bf2b79a4-74aa-11ef-bceb-c7b262605968... 2024-09-17T04:38:08.146 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:38:07 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-3[84767]: 2024-09-17T04:38:07.743+0000 7f2d363b6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T04:38:08.146 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:38:07 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-3[84767]: 2024-09-17T04:38:07.743+0000 7f2d363b6640 -1 osd.3 82 *** Got signal Terminated *** 2024-09-17T04:38:08.146 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:38:07 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-3[84767]: 2024-09-17T04:38:07.743+0000 7f2d363b6640 -1 osd.3 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T04:38:12.381 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:38:12 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-3[84767]: 2024-09-17T04:38:12.013+0000 7f2d2e999640 -1 osd.3 82 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-17T04:37:48.013025+0000 front 2024-09-17T04:37:48.013006+0000 (oldest deadline 2024-09-17T04:38:11.512767+0000) 2024-09-17T04:38:12.646 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:38:12 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4[89707]: 2024-09-17T04:38:12.377+0000 7f1bff05d640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-17T04:37:48.778523+0000 front 2024-09-17T04:37:48.778412+0000 (oldest deadline 2024-09-17T04:38:12.278280+0000) 2024-09-17T04:38:12.646 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:38:12 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5[94788]: 2024-09-17T04:38:12.627+0000 7f9a6eb46640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-17T04:37:49.044549+0000 front 2024-09-17T04:37:49.044613+0000 (oldest deadline 2024-09-17T04:38:12.544579+0000) 2024-09-17T04:38:13.478 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:38:13 smithi134 podman[113850]: 2024-09-17 04:38:13.20362647 +0000 UTC m=+5.573368902 container died 336a363ac39f8646c12c87dd7bee2d2e092ab6eba7c5544ec60d8269c3587cd1 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-3, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux ) 2024-09-17T04:38:13.478 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:38:13 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4[89707]: 2024-09-17T04:38:13.421+0000 7f1bff05d640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-17T04:37:48.778523+0000 front 2024-09-17T04:37:48.778412+0000 (oldest deadline 2024-09-17T04:38:12.278280+0000) 2024-09-17T04:38:13.868 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:38:13 smithi134 podman[113850]: 2024-09-17 04:38:13.575720515 +0000 UTC m=+5.945462937 container cleanup 336a363ac39f8646c12c87dd7bee2d2e092ab6eba7c5544ec60d8269c3587cd1 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-3, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T04:38:13.868 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:38:13 smithi134 bash[113850]: ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-3 2024-09-17T04:38:13.868 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:38:13 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5[94788]: 2024-09-17T04:38:13.602+0000 7f9a6eb46640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-17T04:37:49.044549+0000 front 2024-09-17T04:37:49.044613+0000 (oldest deadline 2024-09-17T04:38:12.544579+0000) 2024-09-17T04:38:14.146 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:38:13 smithi134 podman[113865]: 2024-09-17 04:38:13.86880258 +0000 UTC m=+0.658398642 container remove 336a363ac39f8646c12c87dd7bee2d2e092ab6eba7c5544ec60d8269c3587cd1 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-3, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-17T04:38:14.458 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:38:14 smithi134 podman[113957]: 2024-09-17 04:38:14.100113184 +0000 UTC m=+0.016277013 image pull 8e039cb7fe1eece5854872e8884a61a26632c7691b2c85cbac9078a9c5c62fae quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f 2024-09-17T04:38:14.458 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:38:14 smithi134 podman[113957]: 2024-09-17 04:38:14.228108662 +0000 UTC m=+0.144272482 container create 35d9c699de3bac292d165fc033cb4abc3721a4f7c2c666bb50fe12dee9354072 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-3-deactivate, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-17T04:38:14.896 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:38:14 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4[89707]: 2024-09-17T04:38:14.458+0000 7f1bff05d640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-17T04:37:48.778523+0000 front 2024-09-17T04:37:48.778412+0000 (oldest deadline 2024-09-17T04:38:12.278280+0000) 2024-09-17T04:38:14.896 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:38:14 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5[94788]: 2024-09-17T04:38:14.557+0000 7f9a6eb46640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-17T04:37:49.044549+0000 front 2024-09-17T04:37:49.044613+0000 (oldest deadline 2024-09-17T04:38:12.544579+0000) 2024-09-17T04:38:14.896 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:38:14 smithi134 podman[113957]: 2024-09-17 04:38:14.497283456 +0000 UTC m=+0.413447281 container init 35d9c699de3bac292d165fc033cb4abc3721a4f7c2c666bb50fe12dee9354072 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-17T04:38:14.896 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:38:14 smithi134 podman[113957]: 2024-09-17 04:38:14.500693877 +0000 UTC m=+0.416857698 container start 35d9c699de3bac292d165fc033cb4abc3721a4f7c2c666bb50fe12dee9354072 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-17T04:38:14.897 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:38:14 smithi134 podman[113957]: 2024-09-17 04:38:14.580518621 +0000 UTC m=+0.496682443 container attach 35d9c699de3bac292d165fc033cb4abc3721a4f7c2c666bb50fe12dee9354072 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-17T04:38:14.897 INFO:journalctl@ceph.osd.3.smithi134.stdout:Sep 17 04:38:14 smithi134 podman[113957]: 2024-09-17 04:38:14.703308732 +0000 UTC m=+0.619472556 container died 35d9c699de3bac292d165fc033cb4abc3721a4f7c2c666bb50fe12dee9354072 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-3-deactivate, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-17T04:38:15.394 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968@osd.3.service' 2024-09-17T04:38:15.432 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T04:38:15.432 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-17T04:38:15.433 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-17T04:38:15.433 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968@osd.4 2024-09-17T04:38:15.646 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:38:15 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4[89707]: 2024-09-17T04:38:15.410+0000 7f1bff05d640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-17T04:37:48.778523+0000 front 2024-09-17T04:37:48.778412+0000 (oldest deadline 2024-09-17T04:38:12.278280+0000) 2024-09-17T04:38:15.646 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:38:15 smithi134 systemd[1]: Stopping Ceph osd.4 for bf2b79a4-74aa-11ef-bceb-c7b262605968... 2024-09-17T04:38:15.646 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:38:15 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5[94788]: 2024-09-17T04:38:15.592+0000 7f9a6eb46640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-17T04:37:49.044549+0000 front 2024-09-17T04:37:49.044613+0000 (oldest deadline 2024-09-17T04:38:12.544579+0000) 2024-09-17T04:38:16.146 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:38:15 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4[89707]: 2024-09-17T04:38:15.764+0000 7f1c02a72640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T04:38:16.146 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:38:15 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4[89707]: 2024-09-17T04:38:15.764+0000 7f1c02a72640 -1 osd.4 82 *** Got signal Terminated *** 2024-09-17T04:38:16.146 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:38:15 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4[89707]: 2024-09-17T04:38:15.764+0000 7f1c02a72640 -1 osd.4 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T04:38:16.896 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:38:16 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4[89707]: 2024-09-17T04:38:16.418+0000 7f1bff05d640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-17T04:37:48.778523+0000 front 2024-09-17T04:37:48.778412+0000 (oldest deadline 2024-09-17T04:38:12.278280+0000) 2024-09-17T04:38:16.896 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:38:16 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5[94788]: 2024-09-17T04:38:16.624+0000 7f9a6eb46640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-17T04:37:49.044549+0000 front 2024-09-17T04:37:49.044613+0000 (oldest deadline 2024-09-17T04:38:12.544579+0000) 2024-09-17T04:38:17.896 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:38:17 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4[89707]: 2024-09-17T04:38:17.441+0000 7f1bff05d640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-17T04:37:48.778523+0000 front 2024-09-17T04:37:48.778412+0000 (oldest deadline 2024-09-17T04:38:12.278280+0000) 2024-09-17T04:38:17.896 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:38:17 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5[94788]: 2024-09-17T04:38:17.591+0000 7f9a6eb46640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-17T04:37:49.044549+0000 front 2024-09-17T04:37:49.044613+0000 (oldest deadline 2024-09-17T04:38:12.544579+0000) 2024-09-17T04:38:18.896 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:38:18 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4[89707]: 2024-09-17T04:38:18.444+0000 7f1bff05d640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-17T04:37:48.778523+0000 front 2024-09-17T04:37:48.778412+0000 (oldest deadline 2024-09-17T04:38:12.278280+0000) 2024-09-17T04:38:18.896 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:38:18 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5[94788]: 2024-09-17T04:38:18.591+0000 7f9a6eb46640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-17T04:37:49.044549+0000 front 2024-09-17T04:37:49.044613+0000 (oldest deadline 2024-09-17T04:38:12.544579+0000) 2024-09-17T04:38:19.896 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:38:19 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4[89707]: 2024-09-17T04:38:19.441+0000 7f1bff05d640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-17T04:37:48.778523+0000 front 2024-09-17T04:37:48.778412+0000 (oldest deadline 2024-09-17T04:38:12.278280+0000) 2024-09-17T04:38:19.896 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:38:19 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5[94788]: 2024-09-17T04:38:19.558+0000 7f9a6eb46640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-17T04:37:49.044549+0000 front 2024-09-17T04:37:49.044613+0000 (oldest deadline 2024-09-17T04:38:12.544579+0000) 2024-09-17T04:38:20.896 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:38:20 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4[89707]: 2024-09-17T04:38:20.420+0000 7f1bff05d640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-17T04:37:48.778523+0000 front 2024-09-17T04:37:48.778412+0000 (oldest deadline 2024-09-17T04:38:12.278280+0000) 2024-09-17T04:38:20.896 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:38:20 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5[94788]: 2024-09-17T04:38:20.523+0000 7f9a6eb46640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-17T04:37:49.044549+0000 front 2024-09-17T04:37:49.044613+0000 (oldest deadline 2024-09-17T04:38:12.544579+0000) 2024-09-17T04:38:21.559 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:38:21 smithi134 podman[114061]: 2024-09-17 04:38:21.292218932 +0000 UTC m=+5.637660392 container died 6df8a692310a21bf1af83a7cfc98a091a745fe97358f9e2a9c2ec89660cc0a3c (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-17T04:38:21.896 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:38:21 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5[94788]: 2024-09-17T04:38:21.558+0000 7f9a6eb46640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-17T04:37:49.044549+0000 front 2024-09-17T04:37:49.044613+0000 (oldest deadline 2024-09-17T04:38:12.544579+0000) 2024-09-17T04:38:21.896 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:38:21 smithi134 podman[114061]: 2024-09-17 04:38:21.719825348 +0000 UTC m=+6.065266807 container cleanup 6df8a692310a21bf1af83a7cfc98a091a745fe97358f9e2a9c2ec89660cc0a3c (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, ceph=True, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS) 2024-09-17T04:38:21.896 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:38:21 smithi134 bash[114061]: ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4 2024-09-17T04:38:22.292 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:38:21 smithi134 podman[114078]: 2024-09-17 04:38:21.973563824 +0000 UTC m=+0.681406151 container remove 6df8a692310a21bf1af83a7cfc98a091a745fe97358f9e2a9c2ec89660cc0a3c (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T04:38:22.544 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:38:22 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5[94788]: 2024-09-17T04:38:22.534+0000 7f9a6eb46640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-17T04:37:49.044549+0000 front 2024-09-17T04:37:49.044613+0000 (oldest deadline 2024-09-17T04:38:12.544579+0000) 2024-09-17T04:38:22.544 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:38:22 smithi134 podman[114164]: 2024-09-17 04:38:22.292408329 +0000 UTC m=+0.107520250 container create 1beec9c3b9900b3fe96ab437b3238a29a5980d143bac1f12a34f5b05bf381068 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True) 2024-09-17T04:38:22.544 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:38:22 smithi134 podman[114164]: 2024-09-17 04:38:22.201180527 +0000 UTC m=+0.016292449 image pull 8e039cb7fe1eece5854872e8884a61a26632c7691b2c85cbac9078a9c5c62fae quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f 2024-09-17T04:38:22.544 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:38:22 smithi134 podman[114164]: 2024-09-17 04:38:22.544787331 +0000 UTC m=+0.359899253 container init 1beec9c3b9900b3fe96ab437b3238a29a5980d143bac1f12a34f5b05bf381068 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T04:38:22.896 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:38:22 smithi134 podman[114164]: 2024-09-17 04:38:22.548048896 +0000 UTC m=+0.363160836 container start 1beec9c3b9900b3fe96ab437b3238a29a5980d143bac1f12a34f5b05bf381068 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux ) 2024-09-17T04:38:22.896 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:38:22 smithi134 podman[114164]: 2024-09-17 04:38:22.628016269 +0000 UTC m=+0.443128207 container attach 1beec9c3b9900b3fe96ab437b3238a29a5980d143bac1f12a34f5b05bf381068 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-17T04:38:22.896 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 17 04:38:22 smithi134 podman[114164]: 2024-09-17 04:38:22.733649394 +0000 UTC m=+0.548761318 container died 1beec9c3b9900b3fe96ab437b3238a29a5980d143bac1f12a34f5b05bf381068 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True) 2024-09-17T04:38:23.363 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968@osd.4.service' 2024-09-17T04:38:23.403 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T04:38:23.404 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-17T04:38:23.404 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-17T04:38:23.404 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968@osd.5 2024-09-17T04:38:23.646 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:38:23 smithi134 systemd[1]: Stopping Ceph osd.5 for bf2b79a4-74aa-11ef-bceb-c7b262605968... 2024-09-17T04:38:23.646 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:38:23 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5[94788]: 2024-09-17T04:38:23.572+0000 7f9a6eb46640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-17T04:37:49.044549+0000 front 2024-09-17T04:37:49.044613+0000 (oldest deadline 2024-09-17T04:38:12.544579+0000) 2024-09-17T04:38:23.646 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:38:23 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5[94788]: 2024-09-17T04:38:23.572+0000 7f9a6eb46640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-09-17T04:37:53.645640+0000 front 2024-09-17T04:37:53.645599+0000 (oldest deadline 2024-09-17T04:38:23.045841+0000) 2024-09-17T04:38:24.146 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:38:23 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5[94788]: 2024-09-17T04:38:23.751+0000 7f9a76563640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T04:38:24.146 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:38:23 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5[94788]: 2024-09-17T04:38:23.751+0000 7f9a76563640 -1 osd.5 82 *** Got signal Terminated *** 2024-09-17T04:38:24.146 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:38:23 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5[94788]: 2024-09-17T04:38:23.751+0000 7f9a76563640 -1 osd.5 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T04:38:24.896 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:38:24 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5[94788]: 2024-09-17T04:38:24.605+0000 7f9a6eb46640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-17T04:37:49.044549+0000 front 2024-09-17T04:37:49.044613+0000 (oldest deadline 2024-09-17T04:38:12.544579+0000) 2024-09-17T04:38:24.896 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:38:24 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5[94788]: 2024-09-17T04:38:24.605+0000 7f9a6eb46640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-09-17T04:37:53.645640+0000 front 2024-09-17T04:37:53.645599+0000 (oldest deadline 2024-09-17T04:38:23.045841+0000) 2024-09-17T04:38:26.146 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:38:25 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5[94788]: 2024-09-17T04:38:25.652+0000 7f9a6eb46640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-17T04:37:49.044549+0000 front 2024-09-17T04:37:49.044613+0000 (oldest deadline 2024-09-17T04:38:12.544579+0000) 2024-09-17T04:38:26.146 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:38:25 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5[94788]: 2024-09-17T04:38:25.652+0000 7f9a6eb46640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-09-17T04:37:53.645640+0000 front 2024-09-17T04:37:53.645599+0000 (oldest deadline 2024-09-17T04:38:23.045841+0000) 2024-09-17T04:38:27.146 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:38:26 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5[94788]: 2024-09-17T04:38:26.692+0000 7f9a6eb46640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-17T04:37:49.044549+0000 front 2024-09-17T04:37:49.044613+0000 (oldest deadline 2024-09-17T04:38:12.544579+0000) 2024-09-17T04:38:27.146 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:38:26 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5[94788]: 2024-09-17T04:38:26.692+0000 7f9a6eb46640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-09-17T04:37:53.645640+0000 front 2024-09-17T04:37:53.645599+0000 (oldest deadline 2024-09-17T04:38:23.045841+0000) 2024-09-17T04:38:28.146 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:38:27 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5[94788]: 2024-09-17T04:38:27.732+0000 7f9a6eb46640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-17T04:37:49.044549+0000 front 2024-09-17T04:37:49.044613+0000 (oldest deadline 2024-09-17T04:38:12.544579+0000) 2024-09-17T04:38:28.146 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:38:27 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5[94788]: 2024-09-17T04:38:27.732+0000 7f9a6eb46640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-09-17T04:37:53.645640+0000 front 2024-09-17T04:37:53.645599+0000 (oldest deadline 2024-09-17T04:38:23.045841+0000) 2024-09-17T04:38:28.146 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:38:27 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5[94788]: 2024-09-17T04:38:27.732+0000 7f9a6eb46640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.88:6822 osd.2 since back 2024-09-17T04:38:03.046397+0000 front 2024-09-17T04:38:03.046354+0000 (oldest deadline 2024-09-17T04:38:27.146274+0000) 2024-09-17T04:38:29.127 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:38:28 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5[94788]: 2024-09-17T04:38:28.726+0000 7f9a6eb46640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-17T04:37:49.044549+0000 front 2024-09-17T04:37:49.044613+0000 (oldest deadline 2024-09-17T04:38:12.544579+0000) 2024-09-17T04:38:29.127 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:38:28 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5[94788]: 2024-09-17T04:38:28.726+0000 7f9a6eb46640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-09-17T04:37:53.645640+0000 front 2024-09-17T04:37:53.645599+0000 (oldest deadline 2024-09-17T04:38:23.045841+0000) 2024-09-17T04:38:29.127 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:38:28 smithi134 ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5[94788]: 2024-09-17T04:38:28.726+0000 7f9a6eb46640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.88:6822 osd.2 since back 2024-09-17T04:38:03.046397+0000 front 2024-09-17T04:38:03.046354+0000 (oldest deadline 2024-09-17T04:38:27.146274+0000) 2024-09-17T04:38:29.387 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:38:29 smithi134 podman[114267]: 2024-09-17 04:38:29.127332108 +0000 UTC m=+5.503632898 container died 5066799816d3d6044afdbeac0f5f5ac552cb476f20531419f7b32b83b76b9a17 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True) 2024-09-17T04:38:29.646 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:38:29 smithi134 podman[114267]: 2024-09-17 04:38:29.488365566 +0000 UTC m=+5.864666356 container cleanup 5066799816d3d6044afdbeac0f5f5ac552cb476f20531419f7b32b83b76b9a17 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-17T04:38:29.646 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:38:29 smithi134 bash[114267]: ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5 2024-09-17T04:38:30.110 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:38:29 smithi134 podman[114282]: 2024-09-17 04:38:29.760194755 +0000 UTC m=+0.626720728 container remove 5066799816d3d6044afdbeac0f5f5ac552cb476f20531419f7b32b83b76b9a17 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T04:38:30.396 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:38:30 smithi134 podman[114370]: 2024-09-17 04:38:30.013517792 +0000 UTC m=+0.016269644 image pull 8e039cb7fe1eece5854872e8884a61a26632c7691b2c85cbac9078a9c5c62fae quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f 2024-09-17T04:38:30.396 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:38:30 smithi134 podman[114370]: 2024-09-17 04:38:30.138346282 +0000 UTC m=+0.141098171 container create 951cef86176a67535c029753509f4e8524ccf8f03979fa1ee53a3b69e34c8d8b (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5-deactivate, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-17T04:38:30.397 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:38:30 smithi134 podman[114370]: 2024-09-17 04:38:30.351791908 +0000 UTC m=+0.354543764 container init 951cef86176a67535c029753509f4e8524ccf8f03979fa1ee53a3b69e34c8d8b (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-17T04:38:30.397 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:38:30 smithi134 podman[114370]: 2024-09-17 04:38:30.355452987 +0000 UTC m=+0.358204839 container start 951cef86176a67535c029753509f4e8524ccf8f03979fa1ee53a3b69e34c8d8b (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5-deactivate, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-17T04:38:30.813 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:38:30 smithi134 podman[114370]: 2024-09-17 04:38:30.434954964 +0000 UTC m=+0.437706817 container attach 951cef86176a67535c029753509f4e8524ccf8f03979fa1ee53a3b69e34c8d8b (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-17T04:38:30.813 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 17 04:38:30 smithi134 podman[114370]: 2024-09-17 04:38:30.537713797 +0000 UTC m=+0.540465643 container died 951cef86176a67535c029753509f4e8524ccf8f03979fa1ee53a3b69e34c8d8b (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968-osd-5-deactivate, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T04:38:31.107 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bf2b79a4-74aa-11ef-bceb-c7b262605968@osd.5.service' 2024-09-17T04:38:31.146 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T04:38:31.147 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-17T04:38:31.147 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-17T04:38:31.351 INFO:teuthology.orchestra.run.smithi088.stdout:Deleting cluster with fsid: bf2b79a4-74aa-11ef-bceb-c7b262605968 2024-09-17T04:38:35.644 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi088.stderr:ceph-fuse[76499]: fuse finished with error 0 and tester_r 0 2024-09-17T04:38:49.382 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-17T04:38:49.588 INFO:teuthology.orchestra.run.smithi134.stdout:Deleting cluster with fsid: bf2b79a4-74aa-11ef-bceb-c7b262605968 2024-09-17T04:39:07.373 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-17T04:39:07.406 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-17T04:39:07.433 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-17T04:39:07.435 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908507/remote/smithi088/crash 2024-09-17T04:39:07.436 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/crash -- . 2024-09-17T04:39:07.474 INFO:teuthology.orchestra.run.smithi088.stderr:tar: /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-17T04:39:07.474 INFO:teuthology.orchestra.run.smithi088.stderr:tar: Error is not recoverable: exiting now 2024-09-17T04:39:07.476 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908507/remote/smithi134/crash 2024-09-17T04:39:07.477 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/crash -- . 2024-09-17T04:39:07.501 INFO:teuthology.orchestra.run.smithi134.stderr:tar: /var/lib/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-17T04:39:07.501 INFO:teuthology.orchestra.run.smithi134.stderr:tar: Error is not recoverable: exiting now 2024-09-17T04:39:07.502 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-17T04:39:07.502 DEBUG:teuthology.orchestra.run.smithi088:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-17T04:39:07.561 INFO:tasks.cephadm:Compressing logs... 2024-09-17T04:39:07.562 DEBUG:teuthology.orchestra.run.smithi088:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T04:39:07.564 DEBUG:teuthology.orchestra.run.smithi134:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T04:39:07.586 INFO:teuthology.orchestra.run.smithi088.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-17T04:39:07.586 INFO:teuthology.orchestra.run.smithi088.stderr:: No such file or directory 2024-09-17T04:39:07.586 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-mon.smithi088.log 2024-09-17T04:39:07.587 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-17T04:39:07.587 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-mon.smithi088.log: gzip -5 --verbose -- /var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-17T04:39:07.588 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-mgr.smithi088.wmndiv.log 2024-09-17T04:39:07.591 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-17T04:39:07.592 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-volume.log: /var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-mgr.smithi088.wmndiv.log: gzip -5 --verbose -- /var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-17T04:39:07.592 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-17T04:39:07.592 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph.log 2024-09-17T04:39:07.592 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-osd.2.log: 86.3% -- replaced with /var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-17T04:39:07.592 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi088.giqrgt.log 2024-09-17T04:39:07.596 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph.log: 91.4% 88.8% -- replaced with /var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-17T04:39:07.596 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-17T04:39:07.596 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi088.lgavsv.log 2024-09-17T04:39:07.596 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi088.giqrgt.log: gzip -5 --verbose -- /var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi088.log 2024-09-17T04:39:07.598 INFO:teuthology.orchestra.run.smithi134.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-17T04:39:07.598 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-mon.smithi134.log 2024-09-17T04:39:07.598 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-17T04:39:07.598 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-17T04:39:07.599 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-mon.smithi134.log: /var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-17T04:39:07.599 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi134.log 2024-09-17T04:39:07.599 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-17T04:39:07.599 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi134.log: gzip -5 --verbose -- /var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-17T04:39:07.599 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph.log 2024-09-17T04:39:07.599 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- 84.7% /var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi134.psnynp.log -- replaced with /var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-17T04:39:07.599 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-17T04:39:07.599 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-mgr.smithi134.vwdxcb.log 2024-09-17T04:39:07.599 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph.log: /var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi134.psnynp.log: 94.0% -- replaced with /var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi134.log.gz 2024-09-17T04:39:07.599 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi134.ktuhce.log 2024-09-17T04:39:07.599 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-mgr.smithi134.vwdxcb.log: 91.6% -- replaced with /var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-17T04:39:07.599 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-17T04:39:07.599 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi134.ktuhce.log: 88.8% -- replaced with /var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-17T04:39:07.599 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.log 2024-09-17T04:39:07.603 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi088.lgavsv.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-09-17T04:39:07.605 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-17T04:39:07.611 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.1.log: 91.1% -- replaced with /var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-17T04:39:07.615 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi088.log: 91.2% 94.0% -- replaced with /var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi088.log.gz 2024-09-17T04:39:07.615 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-17T04:39:07.615 INFO:teuthology.orchestra.run.smithi088.stderr: 92.6%gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-17T04:39:07.615 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi088.lgavsv.log.gz 2024-09-17T04:39:07.619 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-17T04:39:07.648 INFO:teuthology.orchestra.run.smithi134.stderr: 89.4% -- replaced with /var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-mgr.smithi134.vwdxcb.log.gz 2024-09-17T04:39:07.657 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.0.log: /var/log/ceph/cephadm.log: 91.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-17T04:39:07.991 INFO:teuthology.orchestra.run.smithi088.stderr: 89.4% -- replaced with /var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-mgr.smithi088.wmndiv.log.gz 2024-09-17T04:39:08.066 INFO:teuthology.orchestra.run.smithi134.stderr: 92.4% -- replaced with /var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-mon.smithi134.log.gz 2024-09-17T04:39:08.697 INFO:teuthology.orchestra.run.smithi088.stderr: 90.4% -- replaced with /var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-mon.smithi088.log.gz 2024-09-17T04:39:11.759 INFO:teuthology.orchestra.run.smithi088.stderr: 93.8% -- replaced with /var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-17T04:39:12.246 INFO:teuthology.orchestra.run.smithi134.stderr: 93.8% -- replaced with /var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-17T04:39:12.247 INFO:teuthology.orchestra.run.smithi088.stderr: 93.8% -- replaced with /var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-17T04:39:13.167 INFO:teuthology.orchestra.run.smithi088.stderr: 93.7% -- replaced with /var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-17T04:39:13.253 INFO:teuthology.orchestra.run.smithi134.stderr: 93.8% -- replaced with /var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-17T04:39:13.802 INFO:teuthology.orchestra.run.smithi134.stderr: 93.8% -- replaced with /var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-17T04:39:21.942 INFO:teuthology.orchestra.run.smithi134.stderr: 94.9% -- replaced with /var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi134.ktuhce.log.gz 2024-09-17T04:39:22.190 INFO:teuthology.orchestra.run.smithi134.stderr:gzip: /var/log/ceph/ceph-client.1.log: file size changed while zipping 2024-09-17T04:39:22.190 INFO:teuthology.orchestra.run.smithi134.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.1.log.gz 2024-09-17T04:39:22.986 INFO:teuthology.orchestra.run.smithi088.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-09-17T04:39:28.467 INFO:teuthology.orchestra.run.smithi134.stderr: 94.9% -- replaced with /var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi134.psnynp.log.gz 2024-09-17T04:39:28.469 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-17T04:39:28.469 INFO:teuthology.orchestra.run.smithi134.stderr:real 0m20.891s 2024-09-17T04:39:28.470 INFO:teuthology.orchestra.run.smithi134.stderr:user 1m4.748s 2024-09-17T04:39:28.470 INFO:teuthology.orchestra.run.smithi134.stderr:sys 0m2.036s 2024-09-17T04:40:45.535 INFO:teuthology.orchestra.run.smithi088.stderr: 92.9% -- replaced with /var/log/ceph/bf2b79a4-74aa-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi088.giqrgt.log.gz 2024-09-17T04:40:45.537 INFO:teuthology.orchestra.run.smithi088.stderr: 2024-09-17T04:40:45.537 INFO:teuthology.orchestra.run.smithi088.stderr:real 1m37.960s 2024-09-17T04:40:45.537 INFO:teuthology.orchestra.run.smithi088.stderr:user 2m5.083s 2024-09-17T04:40:45.537 INFO:teuthology.orchestra.run.smithi088.stderr:sys 0m4.028s 2024-09-17T04:40:45.537 INFO:tasks.cephadm:Archiving logs... 2024-09-17T04:40:45.538 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908507/remote/smithi088/log 2024-09-17T04:40:45.539 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T04:41:04.085 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908507/remote/smithi134/log 2024-09-17T04:41:04.086 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T04:41:12.344 INFO:tasks.cephadm:Removing cluster... 2024-09-17T04:41:12.344 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 --force 2024-09-17T04:41:12.547 INFO:teuthology.orchestra.run.smithi088.stdout:Deleting cluster with fsid: bf2b79a4-74aa-11ef-bceb-c7b262605968 2024-09-17T04:41:12.986 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid bf2b79a4-74aa-11ef-bceb-c7b262605968 --force 2024-09-17T04:41:13.187 INFO:teuthology.orchestra.run.smithi134.stdout:Deleting cluster with fsid: bf2b79a4-74aa-11ef-bceb-c7b262605968 2024-09-17T04:41:13.490 INFO:tasks.cephadm:Removing cephadm ... 2024-09-17T04:41:13.490 DEBUG:teuthology.orchestra.run.smithi088:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-17T04:41:13.507 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-17T04:41:13.524 INFO:tasks.cephadm:Teardown complete 2024-09-17T04:41:13.524 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-17T04:41:13.536 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/install/__init__.py", line 641, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-17T04:41:13.537 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-17T04:41:13.537 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T04:41:13.550 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T04:41:13.634 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-17T04:41:13.645 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-17T04:41:13.645 DEBUG:teuthology.orchestra.run.smithi088:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T04:41:13.648 DEBUG:teuthology.orchestra.run.smithi134:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T04:41:13.660 INFO:teuthology.orchestra.run.smithi088.stderr:bash: line 1: ntpq: command not found 2024-09-17T04:41:13.662 INFO:teuthology.orchestra.run.smithi134.stderr:bash: line 1: ntpq: command not found 2024-09-17T04:41:13.664 INFO:teuthology.orchestra.run.smithi088.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T04:41:13.664 INFO:teuthology.orchestra.run.smithi088.stdout:=============================================================================== 2024-09-17T04:41:13.664 INFO:teuthology.orchestra.run.smithi088.stdout:^* hv01.front.sepia.ceph.com 3 6 377 50 +1666us[+1650us] +/- 64ms 2024-09-17T04:41:13.664 INFO:teuthology.orchestra.run.smithi088.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 50 +446us[ +429us] +/- 79ms 2024-09-17T04:41:13.665 INFO:teuthology.orchestra.run.smithi088.stdout:^+ hv03.front.sepia.ceph.com 3 8 377 183 -2328us[-2416us] +/- 90ms 2024-09-17T04:41:13.665 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T04:41:13.666 INFO:teuthology.orchestra.run.smithi134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T04:41:13.666 INFO:teuthology.orchestra.run.smithi134.stdout:=============================================================================== 2024-09-17T04:41:13.666 INFO:teuthology.orchestra.run.smithi134.stdout:^* hv01.front.sepia.ceph.com 3 6 377 51 +1507us[+1506us] +/- 64ms 2024-09-17T04:41:13.666 INFO:teuthology.orchestra.run.smithi134.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 52 +274us[ +273us] +/- 79ms 2024-09-17T04:41:13.666 INFO:teuthology.orchestra.run.smithi134.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 50 -2521us[-2521us] +/- 92ms 2024-09-17T04:41:13.666 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T04:41:13.667 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-17T04:41:13.680 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-17T04:41:13.680 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-17T04:41:13.741 DEBUG:teuthology.orchestra.run.smithi088:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-17T04:41:13.820 DEBUG:teuthology.orchestra.run.smithi134:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-17T04:41:13.893 DEBUG:teuthology.orchestra.run.smithi088:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-17T04:41:13.921 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T04:41:13.922 DEBUG:teuthology.orchestra.run.smithi134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-17T04:41:13.949 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T04:41:13.950 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-17T04:41:13.961 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-17T04:41:13.976 INFO:teuthology.task.internal:Duration was 2223.533380 seconds 2024-09-17T04:41:13.976 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-17T04:41:13.988 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-17T04:41:13.988 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T04:41:13.991 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T04:41:14.027 INFO:teuthology.orchestra.run.smithi088.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T04:41:14.029 INFO:teuthology.orchestra.run.smithi134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T04:41:14.427 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-17T04:41:14.427 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi088.front.sepia.ceph.com 2024-09-17T04:41:14.428 DEBUG:teuthology.orchestra.run.smithi088:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T04:41:14.488 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi134.front.sepia.ceph.com 2024-09-17T04:41:14.489 DEBUG:teuthology.orchestra.run.smithi134:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T04:41:14.515 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-17T04:41:14.515 DEBUG:teuthology.orchestra.run.smithi088:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T04:41:14.531 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T04:41:14.582 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-17T04:41:14.582 DEBUG:teuthology.orchestra.run.smithi088:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T04:41:14.599 DEBUG:teuthology.orchestra.run.smithi134:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T04:41:15.253 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-17T04:41:15.266 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-17T04:41:15.266 DEBUG:teuthology.orchestra.run.smithi088:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T04:41:15.291 DEBUG:teuthology.orchestra.run.smithi134:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T04:41:15.317 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-17T04:41:15.328 DEBUG:teuthology.orchestra.run.smithi088:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T04:41:15.334 DEBUG:teuthology.orchestra.run.smithi134:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T04:41:15.354 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern = core 2024-09-17T04:41:15.382 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = core 2024-09-17T04:41:15.407 DEBUG:teuthology.orchestra.run.smithi088:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T04:41:15.436 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T04:41:15.437 DEBUG:teuthology.orchestra.run.smithi134:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T04:41:15.461 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T04:41:15.461 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-17T04:41:15.474 INFO:teuthology.task.internal:Transferring archived files... 2024-09-17T04:41:15.474 DEBUG:teuthology.misc:Transferring archived files from smithi088:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908507/remote/smithi088 2024-09-17T04:41:15.474 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T04:41:15.524 DEBUG:teuthology.misc:Transferring archived files from smithi134:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908507/remote/smithi134 2024-09-17T04:41:15.524 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T04:41:15.561 INFO:teuthology.task.internal:Removing archive directory... 2024-09-17T04:41:15.561 DEBUG:teuthology.orchestra.run.smithi088:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T04:41:15.564 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T04:41:15.611 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-17T04:41:15.622 INFO:teuthology.task.internal:Not uploading archives. 2024-09-17T04:41:15.622 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-17T04:41:15.635 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-17T04:41:15.635 DEBUG:teuthology.orchestra.run.smithi088:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T04:41:15.638 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T04:41:15.652 INFO:teuthology.orchestra.run.smithi088.stdout: 265324 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 17 04:41 /home/ubuntu/cephtest 2024-09-17T04:41:15.652 INFO:teuthology.orchestra.run.smithi088.stdout: 531169 4 d--------- 2 ubuntu ubuntu 4096 Sep 17 04:18 /home/ubuntu/cephtest/mnt.0 2024-09-17T04:41:15.653 INFO:teuthology.orchestra.run.smithi088.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2024-09-17T04:41:15.653 INFO:teuthology.orchestra.run.smithi088.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-09-17T04:41:15.655 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T04:41:15.655 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 153, in __exit__ self.gen.throw(typ, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi088 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-09-17T04:41:15.656 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-17T04:41:15.668 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-17T04:41:15.682 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-17T04:41:15.686 INFO:teuthology.run:Summary data: description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/squid 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 2223.5333795547485 failure_reason: reached maximum tries (50) after waiting for 300 seconds flavor: default owner: scheduled_pdonnell@teuthology status: fail success: false 2024-09-17T04:41:15.686 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T04:41:15.771 INFO:teuthology.run:FAIL